2026-05-20 01:18:42.590112 | Job console starting
2026-05-20 01:18:42.600942 | Updating git repos
2026-05-20 01:18:44.550120 | Cloning repos into workspace
2026-05-20 01:18:56.665767 | Restoring repo states
2026-05-20 01:18:58.124009 | Merging changes
2026-05-20 01:18:59.006299 | Checking out repos
2026-05-20 01:19:12.174395 | Preparing playbooks
2026-05-20 01:19:17.410943 | Running Ansible setup
2026-05-20 01:19:22.833524 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-20 01:19:23.729005 | 
2026-05-20 01:19:24.833448 | PLAY [localhost]
2026-05-20 01:19:24.847186 | 
2026-05-20 01:19:24.847271 | TASK [Gathering Facts]
2026-05-20 01:19:26.035112 | localhost | ok
2026-05-20 01:19:26.046571 | 
2026-05-20 01:19:26.046791 | TASK [Setup log path fact]
2026-05-20 01:19:26.091025 | localhost | ok
2026-05-20 01:19:26.107377 | 
2026-05-20 01:19:26.107483 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-20 01:19:26.199708 | localhost | ok
2026-05-20 01:19:26.206152 | 
2026-05-20 01:19:26.206230 | TASK [emit-job-header : Print job information]
2026-05-20 01:19:26.255233 | # Job Information
2026-05-20 01:19:26.255474 | Ansible Version: 2.16.18
2026-05-20 01:19:26.255507 | Job: magnum-cluster-api-hydrophone-v1.34.7-cilium
2026-05-20 01:19:26.255530 | Pipeline: check
2026-05-20 01:19:26.255551 | Executor: 2d72f0692154
2026-05-20 01:19:26.255570 | Triggered by: https://github.com/vexxhost/magnum-cluster-api/pull/1009
2026-05-20 01:19:26.255593 | Event ID: 5293cf60-53e9-11f1-9525-ff15cc132432
2026-05-20 01:19:26.268088 | 
2026-05-20 01:19:26.268732 | LOOP [emit-job-header : Print node information]
2026-05-20 01:19:26.439190 | localhost | ok:
2026-05-20 01:19:26.439369 | localhost | # Node Information
2026-05-20 01:19:26.439398 | localhost | Inventory Hostname: controller
2026-05-20 01:19:26.439420 | localhost | Hostname: np0000175177
2026-05-20 01:19:26.439440 | localhost | Username: zuul
2026-05-20 01:19:26.439464 | localhost | Distro: Ubuntu 24.04
2026-05-20 01:19:26.439485 | localhost | Provider: yul1
2026-05-20 01:19:26.439504 | localhost | Region: ca-ymq-1
2026-05-20 01:19:26.439523 | localhost | Label: ubuntu-noble-16
2026-05-20 01:19:26.439542 | localhost | Product Name: OpenStack Nova
2026-05-20 01:19:26.439561 | localhost | Interface IP: 199.19.213.215
2026-05-20 01:19:26.448440 | 
2026-05-20 01:19:26.448557 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-20 01:19:27.154162 | localhost -> localhost | changed
2026-05-20 01:19:27.163290 | 
2026-05-20 01:19:27.163415 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-20 01:19:28.643592 | localhost -> localhost | changed
2026-05-20 01:19:28.651669 | 
2026-05-20 01:19:28.651744 | PLAY [all]
2026-05-20 01:19:28.663029 | 
2026-05-20 01:19:28.663129 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-20 01:19:29.063380 | controller -> localhost | ok
2026-05-20 01:19:29.069524 | 
2026-05-20 01:19:29.069586 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-20 01:19:29.091658 | controller | ok
2026-05-20 01:19:29.112493 | controller | included: /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-20 01:19:29.119315 | 
2026-05-20 01:19:29.119378 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-20 01:19:30.293185 | controller -> localhost | Generating public/private rsa key pair.
2026-05-20 01:19:30.293381 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/c7a27eb3e7074818a2154ba18f2e2918_id_rsa
2026-05-20 01:19:30.293426 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/c7a27eb3e7074818a2154ba18f2e2918_id_rsa.pub
2026-05-20 01:19:30.293462 | controller -> localhost | The key fingerprint is:
2026-05-20 01:19:30.293493 | controller -> localhost | SHA256:GpukE0qtz2EcV7DwDiwdr8Tg84fHL5uJOraANnbjsTw zuul-build-sshkey
2026-05-20 01:19:30.293537 | controller -> localhost | The key's randomart image is:
2026-05-20 01:19:30.293565 | controller -> localhost | +---[RSA 3072]----+
2026-05-20 01:19:30.293600 | controller -> localhost | |  . o .          |
2026-05-20 01:19:30.293631 | controller -> localhost | | . = = o         |
2026-05-20 01:19:30.293659 | controller -> localhost | |  + * + .        |
2026-05-20 01:19:30.293685 | controller -> localhost | |   * * .         |
2026-05-20 01:19:30.293763 | controller -> localhost | |  . B O S        |
2026-05-20 01:19:30.293795 | controller -> localhost | |.. + O *         |
2026-05-20 01:19:30.293821 | controller -> localhost | |o+o+* = .        |
2026-05-20 01:19:30.293847 | controller -> localhost | |o.BE++ =         |
2026-05-20 01:19:30.293876 | controller -> localhost | | .oB= +          |
2026-05-20 01:19:30.293903 | controller -> localhost | +----[SHA256]-----+
2026-05-20 01:19:30.293969 | controller -> localhost | ok: Runtime: 0:00:00.539086
2026-05-20 01:19:30.313651 | 
2026-05-20 01:19:30.313839 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-20 01:19:30.344001 | controller | ok
2026-05-20 01:19:30.362812 | controller | included: /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-20 01:19:30.370832 | 
2026-05-20 01:19:30.370893 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-20 01:19:30.392439 | controller | skipping: Conditional result was False
2026-05-20 01:19:30.398431 | 
2026-05-20 01:19:30.398501 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-20 01:19:31.028279 | controller | changed
2026-05-20 01:19:31.034300 | 
2026-05-20 01:19:31.034369 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-20 01:19:31.254406 | controller | ok
2026-05-20 01:19:31.386054 | 
2026-05-20 01:19:31.386180 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-20 01:19:32.010152 | controller | changed
2026-05-20 01:19:32.062503 | 
2026-05-20 01:19:32.062773 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-20 01:19:32.849270 | controller | changed
2026-05-20 01:19:32.873629 | 
2026-05-20 01:19:32.873732 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-20 01:19:32.906292 | controller | skipping: Conditional result was False
2026-05-20 01:19:32.916753 | 
2026-05-20 01:19:32.916856 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-20 01:19:33.593143 | controller -> localhost | changed
2026-05-20 01:19:33.606495 | 
2026-05-20 01:19:33.606617 | TASK [add-build-sshkey : Add back temp key]
2026-05-20 01:19:34.036474 | controller -> localhost | Identity added: /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/c7a27eb3e7074818a2154ba18f2e2918_id_rsa (zuul-build-sshkey)
2026-05-20 01:19:34.036651 | controller -> localhost | ok: Runtime: 0:00:00.026134
2026-05-20 01:19:34.042967 | 
2026-05-20 01:19:34.043029 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-20 01:19:34.455956 | controller | ok
2026-05-20 01:19:34.463016 | 
2026-05-20 01:19:34.463091 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-20 01:19:34.487559 | controller | skipping: Conditional result was False
2026-05-20 01:19:34.509814 | 
2026-05-20 01:19:34.509927 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-20 01:19:34.907633 | controller | ok
2026-05-20 01:19:34.916797 | 
2026-05-20 01:19:34.916901 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-20 01:20:56.070154 | controller | Output suppressed because no_log was given
2026-05-20 01:20:56.193885 | 
2026-05-20 01:20:56.194321 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-20 01:20:56.782009 | controller | ok: "logs"
2026-05-20 01:20:56.782182 | controller | ok: All items complete
2026-05-20 01:20:56.782209 | 
2026-05-20 01:20:56.952165 | controller | ok: "artifacts"
2026-05-20 01:20:57.166813 | controller | ok: "docs"
2026-05-20 01:20:57.183327 | 
2026-05-20 01:20:57.183491 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-20 01:20:57.415031 | controller | changed: "logs"
2026-05-20 01:20:57.622779 | controller | changed: "artifacts"
2026-05-20 01:20:57.832811 | controller | changed: "docs"
2026-05-20 01:20:57.853719 | 
2026-05-20 01:20:57.853913 | PLAY RECAP
2026-05-20 01:20:57.854009 | controller | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-20 01:20:57.854063 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-20 01:20:57.854086 | 
2026-05-20 01:20:58.046546 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-20 01:20:58.052787 | PRE-RUN START: [untrusted : opendev.org/openstack/devstack/playbooks/pre.yaml@master]
2026-05-20 01:20:59.760249 | 
2026-05-20 01:20:59.760428 | PLAY [all]
2026-05-20 01:20:59.794070 | 
2026-05-20 01:20:59.794199 | TASK [Fix the permissions of the zuul home directory]
2026-05-20 01:21:00.419115 | controller | changed
2026-05-20 01:21:00.426910 | 
2026-05-20 01:21:00.427046 | TASK [Gather minimum local MTU]
2026-05-20 01:21:00.517080 | controller | ok
2026-05-20 01:21:00.524890 | 
2026-05-20 01:21:00.525036 | TASK [Calculate external_bridge_mtu]
2026-05-20 01:21:00.583750 | controller | ok
2026-05-20 01:21:00.591496 | 
2026-05-20 01:21:00.591626 | TASK [configure-swap : Set ephemeral device if /dev/xvde exists]
2026-05-20 01:21:00.628798 | controller | skipping: Conditional result was False
2026-05-20 01:21:00.638824 | 
2026-05-20 01:21:00.638935 | TASK [configure-swap : Get ephemeral0 device node]
2026-05-20 01:21:01.184149 | controller | ok: Runtime: 0:00:00.010031
2026-05-20 01:21:01.226447 | 
2026-05-20 01:21:01.226600 | TASK [configure-swap : Set ephemeral device if LABEL exists]
2026-05-20 01:21:01.251682 | controller | skipping: Conditional result was False
2026-05-20 01:21:01.266746 | 
2026-05-20 01:21:01.266872 | TASK [configure-swap : Setup swap on ephemeral storage]
2026-05-20 01:21:01.293525 | controller | skipping: Conditional result was False
2026-05-20 01:21:01.304262 | 
2026-05-20 01:21:01.304700 | TASK [configure-swap : Setup swap file on root device]
2026-05-20 01:21:01.362752 | controller | ok
2026-05-20 01:21:01.411153 | controller | included: /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/untrusted/project_1/opendev.org/openstack/openstack-zuul-jobs/roles/configure-swap/tasks/root.yaml
2026-05-20 01:21:01.425777 | 
2026-05-20 01:21:01.425916 | TASK [configure-swap : Calculate required swap]
2026-05-20 01:21:01.527335 | controller | ok
2026-05-20 01:21:01.574207 | 
2026-05-20 01:21:01.574321 | TASK [configure-swap : Get root filesystem]
2026-05-20 01:21:01.830150 | controller | ext4
2026-05-20 01:21:02.118897 | controller | ok: Runtime: 0:00:00.012335
2026-05-20 01:21:02.127667 | 
2026-05-20 01:21:02.127764 | TASK [configure-swap : Save root filesystem]
2026-05-20 01:21:02.183955 | controller | ok
2026-05-20 01:21:02.198268 | 
2026-05-20 01:21:02.198529 | TASK [configure-swap : Debug the root_filesystem variable]
2026-05-20 01:21:02.253516 | controller | ok:
2026-05-20 01:21:02.253653 | controller | {
2026-05-20 01:21:02.253679 | controller |   "root_filesystem": "ext4"
2026-05-20 01:21:02.253699 | controller | }
2026-05-20 01:21:02.258723 | 
2026-05-20 01:21:02.258790 | TASK [configure-swap : Create swap backing file]
2026-05-20 01:21:12.700146 | controller | 8192+0 records in
2026-05-20 01:21:12.700266 | controller | 8192+0 records out
2026-05-20 01:21:12.700375 | controller | 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 10.1789 s, 844 MB/s
2026-05-20 01:21:12.841637 | controller | ok: Runtime: 0:00:10.189386
2026-05-20 01:21:12.847215 | 
2026-05-20 01:21:12.847281 | TASK [configure-swap : Ensure swapfile perms]
2026-05-20 01:21:13.121615 | controller | changed
2026-05-20 01:21:13.133804 | 
2026-05-20 01:21:13.133906 | TASK [configure-swap : Make swapfile]
2026-05-20 01:21:19.898148 | controller | Setting up swapspace version 1, size = 8 GiB (8589930496 bytes)
2026-05-20 01:21:19.898353 | controller | no label, UUID=0b9258d7-3e7e-49c6-9f85-33dfe15aa86c
2026-05-20 01:21:20.203453 | controller | ok: Runtime: 0:00:06.496460
2026-05-20 01:21:20.216453 | 
2026-05-20 01:21:20.216680 | TASK [configure-swap : Write swap to fstab]
2026-05-20 01:21:20.674813 | controller | changed
2026-05-20 01:21:20.680451 | 
2026-05-20 01:21:20.680522 | TASK [configure-swap : Add all swap]
2026-05-20 01:21:21.240050 | controller | ok: Runtime: 0:00:00.019988
2026-05-20 01:21:21.249442 | 
2026-05-20 01:21:21.249605 | TASK [configure-swap : Debug the swap_required variable]
2026-05-20 01:21:21.290256 | controller | ok:
2026-05-20 01:21:21.290464 | controller | {
2026-05-20 01:21:21.290505 | controller |   "swap_required": "8192"
2026-05-20 01:21:21.290536 | controller | }
2026-05-20 01:21:21.300690 | 
2026-05-20 01:21:21.300819 | TASK [configure-swap : Set swappiness]
2026-05-20 01:21:21.737213 | controller | changed
2026-05-20 01:21:21.750008 | 
2026-05-20 01:21:21.750120 | TASK [configure-swap : Debug the ephemeral_device variable]
2026-05-20 01:21:21.805175 | controller | ok:
2026-05-20 01:21:21.805354 | controller | {
2026-05-20 01:21:21.805380 | controller |   "ephemeral_device": "VARIABLE IS NOT DEFINED!: 'ephemeral_device' is undefined. 'ephemeral_device' is undefined"
2026-05-20 01:21:21.805405 | controller | }
2026-05-20 01:21:21.816523 | 
2026-05-20 01:21:21.816593 | TASK [setup-stack-user : Create stack group]
2026-05-20 01:21:22.307494 | controller | changed
2026-05-20 01:21:22.312844 | 
2026-05-20 01:21:22.312916 | TASK [setup-stack-user : Create the stack user home folder]
2026-05-20 01:21:22.557783 | controller | changed
2026-05-20 01:21:22.568968 | 
2026-05-20 01:21:22.569064 | TASK [setup-stack-user : Create stack user]
2026-05-20 01:21:23.165820 | controller | changed
2026-05-20 01:21:23.175678 | 
2026-05-20 01:21:23.175785 | TASK [setup-stack-user : Set stack user home directory permissions and ownership]
2026-05-20 01:21:23.433026 | controller | changed
2026-05-20 01:21:23.440231 | 
2026-05-20 01:21:23.440307 | TASK [setup-stack-user : Copy 50_stack_sh file to /etc/sudoers.d]
2026-05-20 01:21:24.617176 | controller | changed
2026-05-20 01:21:24.626661 | 
2026-05-20 01:21:24.626745 | TASK [setup-stack-user : Create .cache folder within BASE]
2026-05-20 01:21:24.917557 | controller | changed
2026-05-20 01:21:24.928199 | 
2026-05-20 01:21:24.928273 | TASK [setup-tempest-user : Create tempest group]
2026-05-20 01:21:25.234684 | controller | changed
2026-05-20 01:21:25.241877 | 
2026-05-20 01:21:25.242022 | TASK [setup-tempest-user : Create tempest user]
2026-05-20 01:21:25.621450 | controller | changed
2026-05-20 01:21:25.632846 | 
2026-05-20 01:21:25.633001 | TASK [setup-tempest-user : Copy 51_tempest_sh to /etc/sudoers.d]
2026-05-20 01:21:26.415816 | controller | changed
2026-05-20 01:21:26.426710 | 
2026-05-20 01:21:26.426818 | TASK [setup-devstack-source-dirs : Find all OpenStack source repos used by this job]
2026-05-20 01:21:26.766128 | controller | ok: Not all paths examined, check warnings for details
2026-05-20 01:21:26.791834 | 
2026-05-20 01:21:26.792059 | LOOP [setup-devstack-source-dirs : Copy Zuul repos into devstack working directory]
2026-05-20 01:21:27.281657 | controller | ok: Item: Runtime: 0:00:00.204039
2026-05-20 01:21:27.648532 | controller | ok: Item: Runtime: 0:00:00.144753
2026-05-20 01:21:27.924585 | controller | ok: Item: Runtime: 0:00:00.062359
2026-05-20 01:21:28.491330 | controller | ok: Item: Runtime: 0:00:00.248452
2026-05-20 01:21:28.872787 | controller | ok: Item: Runtime: 0:00:00.141207
2026-05-20 01:21:29.385325 | controller | ok: Item: Runtime: 0:00:00.293989
2026-05-20 01:21:30.119673 | controller | ok: Item: Runtime: 0:00:00.507715
2026-05-20 01:21:30.940054 | controller | ok: Item: Runtime: 0:00:00.583757
2026-05-20 01:21:31.776242 | controller | ok: Item: Runtime: 0:00:00.619556
2026-05-20 01:21:33.197990 | controller | ok: Item: Runtime: 0:00:01.183678
2026-05-20 01:21:33.532828 | controller | ok: Item: Runtime: 0:00:00.113388
2026-05-20 01:21:33.984235 | controller | ok: Item: Runtime: 0:00:00.229778
2026-05-20 01:21:34.545454 | controller | ok: Item: Runtime: 0:00:00.335253
2026-05-20 01:21:38.373375 | controller | ok: Item: Runtime: 0:00:03.604046
2026-05-20 01:21:39.797253 | controller | ok: Item: Runtime: 0:00:01.191528
2026-05-20 01:21:40.332430 | controller | ok: Item: Runtime: 0:00:00.310890
2026-05-20 01:21:40.360613 | 
2026-05-20 01:21:40.361311 | TASK [setup-devstack-source-dirs : Find top level github projects]
2026-05-20 01:21:40.579753 | controller | ok: All paths examined
2026-05-20 01:21:40.586503 | 
2026-05-20 01:21:40.586570 | TASK [setup-devstack-source-dirs : Find actual github repos]
2026-05-20 01:21:40.824791 | controller | ok: All paths examined
2026-05-20 01:21:40.835384 | 
2026-05-20 01:21:40.835475 | LOOP [setup-devstack-source-dirs : Copy github repos into devstack working directory]
2026-05-20 01:21:41.272960 | controller | ok: Item: Runtime: 0:00:00.151668
2026-05-20 01:21:41.273284 | controller | changed: All items complete
2026-05-20 01:21:41.273313 | 
2026-05-20 01:21:41.732046 | controller | ok: Item: Runtime: 0:00:00.229830
2026-05-20 01:21:41.755872 | 
2026-05-20 01:21:41.756074 | LOOP [setup-devstack-source-dirs : Setup refspec for repos into devstack working directory]
2026-05-20 01:21:41.874413 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.879723 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.884523 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.889265 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.893506 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.897510 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.901506 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.912786 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.915420 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.916410 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.927657 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.933008 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.937054 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.941709 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.945319 | controller | skipping: Conditional result was False
2026-05-20 01:21:41.948928 | controller | skipping: Conditional result was False
2026-05-20 01:21:42.024918 | 
2026-05-20 01:21:42.025060 | TASK [setup-devstack-source-dirs : Set ownership of repos]
2026-05-20 01:21:44.421838 | controller | changed
2026-05-20 01:21:44.434356 | 
2026-05-20 01:21:44.434444 | TASK [setup-devstack-log-dir : Create logs directory]
2026-05-20 01:21:44.698169 | controller | changed
2026-05-20 01:21:44.713111 | 
2026-05-20 01:21:44.713284 | TASK [setup-devstack-cache : Copy cached devstack files]
2026-05-20 01:21:44.979039 | controller | find: ‘/opt/cache/files’: No such file or directory
2026-05-20 01:21:45.267141 | controller | ERROR
2026-05-20 01:21:45.268195 | controller | {
2026-05-20 01:21:45.268239 | controller |   "delta": "0:00:00.009841",
2026-05-20 01:21:45.268262 | controller |   "end": "2026-05-20 01:21:44.979428",
2026-05-20 01:21:45.268281 | controller |   "msg": "non-zero return code",
2026-05-20 01:21:45.268300 | controller |   "rc": 1,
2026-05-20 01:21:45.268318 | controller |   "start": "2026-05-20 01:21:44.969587"
2026-05-20 01:21:45.268335 | controller | }
2026-05-20 01:21:45.268363 | controller | ERROR: Ignoring Errors
2026-05-20 01:21:45.275817 | 
2026-05-20 01:21:45.275971 | TASK [setup-devstack-cache : Set ownership of cached files]
2026-05-20 01:21:45.551298 | controller | ok
2026-05-20 01:21:45.565157 | 
2026-05-20 01:21:45.565516 | TASK [start-fresh-logging : Check for /bin/journalctl file]
2026-05-20 01:21:45.844925 | controller | /usr/bin/journalctl
2026-05-20 01:21:46.107963 | controller | ok: Runtime: 0:00:00.008338
2026-05-20 01:21:46.116277 | 
2026-05-20 01:21:46.116351 | TASK [start-fresh-logging : Get current date]
2026-05-20 01:21:46.362418 | controller | 2026-05-20 01:21:46
2026-05-20 01:21:46.655162 | controller | ok: Runtime: 0:00:00.007235
2026-05-20 01:21:46.661288 | 
2026-05-20 01:21:46.661414 | TASK [start-fresh-logging : Copy current date to log-start-timestamp.txt]
2026-05-20 01:21:47.239693 | controller | changed
2026-05-20 01:21:47.247828 | 
2026-05-20 01:21:47.251520 | TASK [start-fresh-logging : Stop rsyslog]
2026-05-20 01:21:47.281094 | controller | skipping: Conditional result was False
2026-05-20 01:21:47.292804 | 
2026-05-20 01:21:47.292942 | TASK [start-fresh-logging : Save syslog file prior to devstack run]
2026-05-20 01:21:47.830021 | controller | skipping: Conditional result was False
2026-05-20 01:21:47.839303 | 
2026-05-20 01:21:47.839533 | TASK [start-fresh-logging : Save kern.log file prior to devstack run]
2026-05-20 01:21:48.381087 | controller | skipping: Conditional result was False
2026-05-20 01:21:48.390122 | 
2026-05-20 01:21:48.390232 | TASK [start-fresh-logging : Recreate syslog file]
2026-05-20 01:21:48.417950 | controller | skipping: Conditional result was False
2026-05-20 01:21:48.429815 | 
2026-05-20 01:21:48.429936 | TASK [start-fresh-logging : Recreate syslog file owner and group]
2026-05-20 01:21:48.962557 | controller | skipping: Conditional result was False
2026-05-20 01:21:48.971147 | 
2026-05-20 01:21:48.971395 | TASK [start-fresh-logging : Recreate syslog file permissions]
2026-05-20 01:21:49.548586 | controller | skipping: Conditional result was False
2026-05-20 01:21:49.558885 | 
2026-05-20 01:21:49.558985 | TASK [start-fresh-logging : Add read permissions to all on syslog file]
2026-05-20 01:21:49.583819 | controller | skipping: Conditional result was False
2026-05-20 01:21:49.596003 | 
2026-05-20 01:21:49.596108 | TASK [start-fresh-logging : Recreate kern.log file]
2026-05-20 01:21:49.621183 | controller | skipping: Conditional result was False
2026-05-20 01:21:49.631908 | 
2026-05-20 01:21:49.632008 | TASK [start-fresh-logging : Recreate kern.log file owner and group]
2026-05-20 01:21:50.162866 | controller | skipping: Conditional result was False
2026-05-20 01:21:50.174839 | 
2026-05-20 01:21:50.174971 | TASK [start-fresh-logging : Recreate kern.log file permissions]
2026-05-20 01:21:50.712346 | controller | skipping: Conditional result was False
2026-05-20 01:21:50.722567 | 
2026-05-20 01:21:50.722800 | TASK [start-fresh-logging : Add read permissions to all on kern.log file]
2026-05-20 01:21:50.748819 | controller | skipping: Conditional result was False
2026-05-20 01:21:50.760322 | 
2026-05-20 01:21:50.760419 | TASK [start-fresh-logging : Start rsyslog]
2026-05-20 01:21:50.785284 | controller | skipping: Conditional result was False
2026-05-20 01:21:50.804868 | 
2026-05-20 01:21:50.805029 | TASK [write-devstack-local-conf : Write a job-specific local_conf file]
2026-05-20 01:21:51.293106 | controller | ok
2026-05-20 01:21:51.306768 | 
2026-05-20 01:21:51.306897 | PLAY RECAP
2026-05-20 01:21:51.306952 | controller | ok: 39 changed: 24 unreachable: 0 failed: 0 skipped: 16 rescued: 0 ignored: 1
2026-05-20 01:21:51.306976 | 
2026-05-20 01:21:51.590709 | PRE-RUN END RESULT_NORMAL: [untrusted : opendev.org/openstack/devstack/playbooks/pre.yaml@master]
2026-05-20 01:21:51.619076 | PRE-RUN START: [untrusted : github.com/vexxhost/magnum-cluster-api/zuul.d/playbooks/hydrophone/pre.yml@main]
2026-05-20 01:21:53.125477 | 
2026-05-20 01:21:53.125616 | PLAY [all]
2026-05-20 01:21:53.180901 | 
2026-05-20 01:21:53.181103 | TASK [Install curl]
2026-05-20 03:19:31.866778 | PRE-RUN END RESULT_TIMED_OUT: [untrusted : github.com/vexxhost/magnum-cluster-api/zuul.d/playbooks/hydrophone/pre.yml@main]
2026-05-20 03:19:31.873617 | POST-RUN START: [untrusted : github.com/vexxhost/magnum-cluster-api/zuul.d/playbooks/hydrophone/post.yml@main]
2026-05-20 03:19:32.543301 | 
2026-05-20 03:19:32.543512 | PLAY [all]
2026-05-20 03:19:32.559298 | 
2026-05-20 03:19:32.559494 | LOOP [Copy individual Hydrophone result files]
2026-05-20 03:19:33.223890 | controller | ERROR: Item: e2e.log
2026-05-20 03:19:33.224193 | controller | {
2026-05-20 03:19:33.224243 | controller |   "ansible_loop_var": "item",
2026-05-20 03:19:33.224275 | controller |   "item": "e2e.log",
2026-05-20 03:19:33.224336 | controller |   "msg": "Source src/github.com/vexxhost/magnum-cluster-api/hydrophone-results/e2e.log not found"
2026-05-20 03:19:33.224364 | controller | }
2026-05-20 03:19:33.508931 | controller | ERROR: Item: junit_01.xml
2026-05-20 03:19:33.509553 | controller | {
2026-05-20 03:19:33.509610 | controller |   "ansible_loop_var": "item",
2026-05-20 03:19:33.509642 | controller |   "item": "junit_01.xml",
2026-05-20 03:19:33.509667 | controller |   "msg": "Source src/github.com/vexxhost/magnum-cluster-api/hydrophone-results/junit_01.xml not found"
2026-05-20 03:19:33.509693 | controller | }
2026-05-20 03:19:33.531138 | controller | ERROR: Ignoring Errors
2026-05-20 03:19:33.536923 | 
2026-05-20 03:19:33.537020 | TASK [Copy Hydrophone results tarball to output folder]
2026-05-20 03:19:33.841248 | controller | ERROR
2026-05-20 03:19:33.841454 | controller | {
2026-05-20 03:19:33.841482 | controller |   "msg": "Source src/github.com/vexxhost/magnum-cluster-api/hydrophone-results.tar.gz not found"
2026-05-20 03:19:33.841504 | controller | }
2026-05-20 03:19:33.841529 | controller | ERROR: Ignoring Errors
2026-05-20 03:19:33.853223 | 
2026-05-20 03:19:33.853296 | TASK [Return built artifacts to Zuul]
2026-05-20 03:19:33.882880 | controller | ok
2026-05-20 03:19:33.888321 | 
2026-05-20 03:19:33.888387 | TASK [Get the Docker volume ID]
2026-05-20 03:19:34.429887 | controller | ERROR
2026-05-20 03:19:34.430228 | controller | {
2026-05-20 03:19:34.430268 | controller |   "msg": "[Errno 2] No such file or directory: b'docker'",
2026-05-20 03:19:34.430296 | controller |   "rc": 2
2026-05-20 03:19:34.430322 | controller | }
2026-05-20 03:19:34.430359 | controller | ERROR: Ignoring Errors
2026-05-20 03:19:34.437331 | 
2026-05-20 03:19:34.437430 | TASK [Copy all of the pod logs]
2026-05-20 03:19:34.472504 | controller | ERROR
2026-05-20 03:19:34.472677 | controller | {
2026-05-20 03:19:34.472705 | controller |   "msg": "The task includes an option with an undefined variable. The error was: list object has no element 0. list object has no element 0\n\nThe error appears to be in '/var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/untrusted/project_5/github.com/vexxhost/magnum-cluster-api/zuul.d/playbooks/hydrophone/post.yml': line 42, column 11, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n        - name: Copy all of the pod logs\n          ^ here\n"
2026-05-20 03:19:34.472728 | controller | }
2026-05-20 03:19:34.472752 | controller | ERROR: Ignoring Errors
2026-05-20 03:19:34.473937 | 
2026-05-20 03:19:34.473988 | PLAY RECAP
2026-05-20 03:19:34.474031 | controller | ok: 5 changed: 0 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 4
2026-05-20 03:19:34.474052 | 
2026-05-20 03:19:34.616744 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/magnum-cluster-api/zuul.d/playbooks/hydrophone/post.yml@main]
2026-05-20 03:19:34.627995 | POST-RUN START: [untrusted : opendev.org/openstack/devstack/playbooks/post.yaml@master]
2026-05-20 03:19:35.266893 | 
2026-05-20 03:19:35.267013 | PLAY [all]
2026-05-20 03:19:35.285136 | 
2026-05-20 03:19:35.285220 | TASK [export-devstack-journal : Ensure /home/zuul/logs exists]
2026-05-20 03:19:35.869309 | controller | changed
2026-05-20 03:19:35.875077 | 
2026-05-20 03:19:35.875157 | TASK [export-devstack-journal : Export legacy stack screen log files]
2026-05-20 03:19:36.914721 | controller | ok: Runtime: 0:00:00.466067
2026-05-20 03:19:36.922157 | 
2026-05-20 03:19:36.922247 | TASK [export-devstack-journal : Export legacy syslog.txt]
2026-05-20 03:19:37.460458 | controller | ok: Runtime: 0:00:00.020083
2026-05-20 03:19:37.466031 | 
2026-05-20 03:19:37.466139 | TASK [export-devstack-journal : Export journal]
2026-05-20 03:19:38.034198 | controller | ok: Runtime: 0:00:00.040761
2026-05-20 03:19:38.042213 | 
2026-05-20 03:19:38.042304 | TASK [export-devstack-journal : Save journal README]
2026-05-20 03:19:38.849980 | controller | changed
2026-05-20 03:19:38.861878 | 
2026-05-20 03:19:38.861969 | TASK [apache-logs-conf : Ensure /home/zuul/apache exists]
2026-05-20 03:19:39.109105 | controller | changed
2026-05-20 03:19:39.117027 | 
2026-05-20 03:19:39.117100 | TASK [apache-logs-conf : Find logs]
2026-05-20 03:19:39.446116 | controller | Output suppressed because no_log was given
2026-05-20 03:19:39.452285 | 
2026-05-20 03:19:39.452359 | LOOP [apache-logs-conf : Dereference files]
2026-05-20 03:19:39.485909 | 
2026-05-20 03:19:39.486083 | LOOP [apache-logs-conf : Create hard links]
2026-05-20 03:19:39.524918 | 
2026-05-20 03:19:39.525245 | TASK [apache-logs-conf : Find logs]
2026-05-20 03:19:39.562262 | 
2026-05-20 03:19:39.562462 | LOOP [apache-logs-conf : Dereference files]
2026-05-20 03:19:39.594263 | 
2026-05-20 03:19:39.594430 | LOOP [apache-logs-conf : Create hard links]
2026-05-20 03:19:39.636088 | 
2026-05-20 03:19:39.636328 | TASK [apache-logs-conf : Ensure /home/zuul/apache_config apache_config exists]
2026-05-20 03:19:39.885837 | controller | changed
2026-05-20 03:19:39.891679 | 
2026-05-20 03:19:39.891745 | TASK [apache-logs-conf : Define config paths]
2026-05-20 03:19:39.923233 | controller | ok
2026-05-20 03:19:39.929314 | 
2026-05-20 03:19:39.929379 | TASK [apache-logs-conf : Discover configurations]
2026-05-20 03:19:40.187837 | controller | Output suppressed because no_log was given
2026-05-20 03:19:40.192994 | 
2026-05-20 03:19:40.193060 | LOOP [apache-logs-conf : Dereference configurations]
2026-05-20 03:19:40.219514 | 
2026-05-20 03:19:40.219645 | LOOP [apache-logs-conf : Link configurations]
2026-05-20 03:19:40.261866 | 
2026-05-20 03:19:40.262001 | TASK [capture-performance-data : Generate statistics]
2026-05-20 03:19:40.915009 | controller | /opt/stack/devstack//inc/python: line 43: -m: command not found
2026-05-20 03:19:40.931897 | controller | Using python 3.12 to install setuptools
2026-05-20 03:19:40.969853 | controller | /usr/bin/python3.12: No module named pip
2026-05-20 03:19:40.980796 | controller | /bin/bash: line 4: /opt/stack/data/venv/bin/python3: No such file or directory
2026-05-20 03:19:41.302199 | controller | ERROR
2026-05-20 03:19:41.302424 | controller | {
2026-05-20 03:19:41.302472 | controller |   "delta": "0:00:00.482075",
2026-05-20 03:19:41.302502 | controller |   "end": "2026-05-20 03:19:40.983223",
2026-05-20 03:19:41.302529 | controller |   "msg": "non-zero return code",
2026-05-20 03:19:41.302561 | controller |   "rc": 127,
2026-05-20 03:19:41.302587 | controller |   "start": "2026-05-20 03:19:40.501148"
2026-05-20 03:19:41.302611 | controller | }
2026-05-20 03:19:41.302645 | controller | ERROR: Ignoring Errors
2026-05-20 03:19:41.314473 | 
2026-05-20 03:19:41.314542 | TASK [devstack-project-conf : Ensure /home/zuul/etc exists]
2026-05-20 03:19:41.557054 | controller | changed
2026-05-20 03:19:41.563570 | 
2026-05-20 03:19:41.563637 | LOOP [devstack-project-conf : Check which projects have a config folder]
2026-05-20 03:19:45.316169 | controller | Output suppressed because no_log was given
2026-05-20 03:19:45.328597 | 
2026-05-20 03:19:45.328683 | LOOP [devstack-project-conf : Copy configuration files]
2026-05-20 03:19:45.426437 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.427150 | 
2026-05-20 03:19:45.428461 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.431043 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.434144 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.436721 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.439255 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.441961 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.444853 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.447630 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.450299 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.452945 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.455634 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.458254 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.461171 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.463849 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.467294 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.469820 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.472107 | controller | skipping: Conditional result was False
2026-05-20 03:19:45.538524 | 
2026-05-20 03:19:45.538640 | TASK [devstack-project-conf : Check if openstack has a config folder]
2026-05-20 03:19:45.776545 | controller | ok
2026-05-20 03:19:45.783847 | 
2026-05-20 03:19:45.783934 | TASK [devstack-project-conf : Copy configuration files]
2026-05-20 03:19:46.314676 | controller | skipping: Conditional result was False
2026-05-20 03:19:46.332194 | 
2026-05-20 03:19:46.332298 | TASK [capture-system-logs : Stage various logs and reports]
2026-05-20 03:19:46.675745 | controller | /usr/bin/python3: No module named pip
2026-05-20 03:19:47.793158 | controller | grep: /home/zuul/apache/*.log: No such file or directory
2026-05-20 03:19:47.869762 | controller | ok: Runtime: 0:00:01.226519
2026-05-20 03:19:47.881925 | 
2026-05-20 03:19:47.882109 | LOOP [stage-output : Register sources]
2026-05-20 03:19:58.537114 | controller | Output suppressed because no_log was given
2026-05-20 03:19:58.545620 | 
2026-05-20 03:19:58.545685 | TASK [stage-output : Check sudo]
2026-05-20 03:19:59.086062 | controller | ok: Runtime: 0:00:00.023103
2026-05-20 03:19:59.092180 | 
2026-05-20 03:19:59.092247 | LOOP [stage-output : Set source and destination for files and folders]
2026-05-20 03:19:59.190771 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.191187 | 
2026-05-20 03:19:59.192883 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.194568 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.197432 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.232306 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.232710 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.235488 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.238034 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.240521 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.243280 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.245853 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.248381 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.250879 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.253485 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.270463 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.270811 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.292571 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.293008 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.293357 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.293685 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.294009 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.294334 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.294652 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.315550 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.316062 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.398869 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.410906 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.423319 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.433117 | controller | Output suppressed because no_log was given
2026-05-20 03:19:59.441592 | 
2026-05-20 03:19:59.441659 | TASK [stage-output : Build a list of source, dest dictionaries]
2026-05-20 03:19:59.508442 | controller | ok
2026-05-20 03:19:59.516780 | 
2026-05-20 03:19:59.516916 | LOOP [stage-output : Ensure target folders exist]
2026-05-20 03:19:59.762472 | controller | changed: "docs"
2026-05-20 03:19:59.983136 | controller | changed: "artifacts"
2026-05-20 03:20:00.203327 | controller | ok: "logs"
2026-05-20 03:20:00.233871 | 
2026-05-20 03:20:00.233997 | LOOP [stage-output : Copy files and folders to staging folder]
2026-05-20 03:20:00.523394 | controller | ok: Item: Runtime: 0:00:00.012629
2026-05-20 03:20:00.523621 | controller | changed: All items complete
2026-05-20 03:20:00.523650 | 
2026-05-20 03:20:00.744034 | controller | ok: Item: Runtime: 0:00:00.008290
2026-05-20 03:20:00.970688 | controller | ok: Item: Runtime: 0:00:00.008611
2026-05-20 03:20:01.202456 | controller | ok: Item: Runtime: 0:00:00.008973
2026-05-20 03:20:01.421982 | controller | ok: Item: Runtime: 0:00:00.008698
2026-05-20 03:20:01.646565 | controller | ok: Item: Runtime: 0:00:00.008350
2026-05-20 03:20:01.865034 | controller | ok: Item: Runtime: 0:00:00.008793
2026-05-20 03:20:02.096762 | controller | ok: Item: Runtime: 0:00:00.008268
2026-05-20 03:20:02.389090 | controller | ok: Item: Runtime: 0:00:00.009727
2026-05-20 03:20:02.564677 | controller | ok: Item: Runtime: 0:00:00.008937
2026-05-20 03:20:02.795744 | controller | ok: Item: Runtime: 0:00:00.008457
2026-05-20 03:20:03.015161 | controller | ok: Item: Runtime: 0:00:00.008368
2026-05-20 03:20:03.250360 | controller | ok: Item: Runtime: 0:00:00.008962
2026-05-20 03:20:03.484413 | controller | ok: Item: Runtime: 0:00:00.009204
2026-05-20 03:20:03.713301 | controller | ok: Item: Runtime: 0:00:00.008502
2026-05-20 03:20:03.952418 | controller | ok: Item: Runtime: 0:00:00.007926
2026-05-20 03:20:03.988002 | 
2026-05-20 03:20:03.988183 | TASK [stage-output : Make all log files readable]
2026-05-20 03:20:04.257741 | controller | changed
2026-05-20 03:20:04.264123 | 
2026-05-20 03:20:04.374406 | TASK [stage-output : Rename log files that match extensions_to_txt]
2026-05-20 03:20:04.706821 | controller | changed: Renamed files for staging.
2026-05-20 03:20:04.714631 | 
2026-05-20 03:20:04.714712 | TASK [stage-output : Discover log files for compression]
2026-05-20 03:20:04.739354 | controller | skipping: Conditional result was False
2026-05-20 03:20:04.750828 | 
2026-05-20 03:20:04.750942 | LOOP [stage-output : Archive everything from logs]
2026-05-20 03:20:04.795756 | 
2026-05-20 03:20:04.795950 | TASK [fetch-devstack-log-dir : Collect devstack logs]
2026-05-20 03:20:05.487398 | controller | changed:
2026-05-20 03:20:05.487582 | controller | created directory /var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/logs/controller
2026-05-20 03:20:05.487621 | controller | cd+++++++++ logs/
2026-05-20 03:20:05.487652 | controller | >f+++++++++ logs/deprecations_log.txt
2026-05-20 03:20:05.487680 | controller | >f+++++++++ logs/devstack.journal.README.txt
2026-05-20 03:20:05.487707 | controller | >f+++++++++ logs/devstack.journal.gz
2026-05-20 03:20:05.487733 | controller | >f+++++++++ logs/df.txt
2026-05-20 03:20:05.487760 | controller | >f+++++++++ logs/dpkg-l.txt
2026-05-20 03:20:05.487786 | controller | >f+++++++++ logs/iptables.txt
2026-05-20 03:20:05.487812 | controller | >f+++++++++ logs/listen53.txt
2026-05-20 03:20:05.487837 | controller | >f+++++++++ logs/local_conf.txt
2026-05-20 03:20:05.487862 | controller | >f+++++++++ logs/mount.txt
2026-05-20 03:20:05.487902 | controller | >f+++++++++ logs/performance.json
2026-05-20 03:20:05.487928 | controller | >f+++++++++ logs/pip3-freeze.txt
2026-05-20 03:20:05.487953 | controller | >f+++++++++ logs/resolv_conf.txt
2026-05-20 03:20:05.487978 | controller | >f+++++++++ logs/services.txt
2026-05-20 03:20:05.488004 | controller | >f+++++++++ logs/sudoers
2026-05-20 03:20:05.488030 | controller | >f+++++++++ logs/syslog.txt
2026-05-20 03:20:05.488055 | controller | cd+++++++++ logs/apache/
2026-05-20 03:20:05.488082 | controller | cd+++++++++ logs/apache_config/
2026-05-20 03:20:05.488107 | controller | cd+++++++++ logs/etc/
2026-05-20 03:20:05.488132 | controller | cd+++++++++ logs/sudoers.d/
2026-05-20 03:20:05.488158 | controller | >f+++++++++ logs/sudoers.d/50_stack_sh
2026-05-20 03:20:05.488183 | controller | >f+++++++++ logs/sudoers.d/51_tempest_sh
2026-05-20 03:20:05.488209 | controller | >f+++++++++ logs/sudoers.d/90-cloud-init-users
2026-05-20 03:20:05.488235 | controller | >f+++++++++ logs/sudoers.d/README
2026-05-20 03:20:05.488260 | controller | >f+++++++++ logs/sudoers.d/zuul
2026-05-20 03:20:05.502425 | 
2026-05-20 03:20:05.502538 | TASK [Check if a tempest log exits]
2026-05-20 03:20:05.763318 | controller | ok
2026-05-20 03:20:05.768652 | 
2026-05-20 03:20:05.768718 | TASK [Link post-devstack tempest.log]
2026-05-20 03:20:05.792638 | controller | skipping: Conditional result was False
2026-05-20 03:20:05.803229 | 
2026-05-20 03:20:05.803331 | TASK [Capture most recent qemu crash dump, if any]
2026-05-20 03:20:06.054761 | controller | /bin/bash: line 1: coredumpctl: command not found
2026-05-20 03:20:06.349773 | controller | ERROR
2026-05-20 03:20:06.350023 | controller | {
2026-05-20 03:20:06.350056 | controller |   "delta": "0:00:00.008068",
2026-05-20 03:20:06.350077 | controller |   "end": "2026-05-20 03:20:06.055459",
2026-05-20 03:20:06.350096 | controller |   "msg": "non-zero return code",
2026-05-20 03:20:06.350114 | controller |   "rc": 127,
2026-05-20 03:20:06.350132 | controller |   "start": "2026-05-20 03:20:06.047391"
2026-05-20 03:20:06.350149 | controller | }
2026-05-20 03:20:06.350173 | controller | ERROR: Ignoring Errors
2026-05-20 03:20:06.351961 | 
2026-05-20 03:20:06.352005 | PLAY RECAP
2026-05-20 03:20:06.352057 | controller | ok: 26 changed: 17 unreachable: 0 failed: 0 skipped: 12 rescued: 0 ignored: 2
2026-05-20 03:20:06.352078 | 
2026-05-20 03:20:06.538346 | POST-RUN END RESULT_NORMAL: [untrusted : opendev.org/openstack/devstack/playbooks/post.yaml@master]
2026-05-20 03:20:06.546363 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-20 03:20:07.206553 | 
2026-05-20 03:20:07.206758 | PLAY [all]
2026-05-20 03:20:07.221853 | 
2026-05-20 03:20:07.222012 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-20 03:20:07.267736 | controller | skipping: Conditional result was False
2026-05-20 03:20:07.283293 | 
2026-05-20 03:20:07.283474 | TASK [fetch-output : Set log path for single node]
2026-05-20 03:20:07.331369 | controller | ok
2026-05-20 03:20:07.341029 | 
2026-05-20 03:20:07.341153 | LOOP [fetch-output : Ensure local output dirs]
2026-05-20 03:20:07.743236 | controller -> localhost | ok: "/var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/logs"
2026-05-20 03:20:07.951640 | controller -> localhost | changed: "/var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/artifacts"
2026-05-20 03:20:08.184036 | controller -> localhost | changed: "/var/lib/zuul/builds/c7a27eb3e7074818a2154ba18f2e2918/work/docs"
2026-05-20 03:20:08.207727 | 
2026-05-20 03:20:08.207866 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-20 03:20:08.899361 | controller | changed: .d..t...... ./
2026-05-20 03:20:08.899629 | controller | changed: All items complete
2026-05-20 03:20:08.899657 | 
2026-05-20 03:20:09.370758 | controller | changed: .d..t...... ./
2026-05-20 03:20:09.850670 | controller | changed: .d..t...... ./
2026-05-20 03:20:09.877814 | 
2026-05-20 03:20:09.877975 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-20 03:20:10.363248 | controller -> localhost | ok: Item: artifacts Runtime: 0:00:00.008446
2026-05-20 03:20:10.583086 | controller -> localhost | ok: Item: docs Runtime: 0:00:00.007708
2026-05-20 03:20:10.597989 | 
2026-05-20 03:20:10.598101 | PLAY [all]
2026-05-20 03:20:10.604799 | 
2026-05-20 03:20:10.604865 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-20 03:20:11.288715 | controller | changed
2026-05-20 03:20:11.296942 | 
2026-05-20 03:20:11.301180 | PLAY RECAP
2026-05-20 03:20:11.301243 | controller | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-20 03:20:11.301267 | 
2026-05-20 03:20:11.420767 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-20 03:20:11.429251 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-20 03:20:12.005742 | 
2026-05-20 03:20:12.005873 | PLAY [localhost]
2026-05-20 03:20:12.017024 | 
2026-05-20 03:20:12.017165 | TASK [Generate Zuul manifest]
2026-05-20 03:20:12.037901 | localhost | ok
2026-05-20 03:20:12.054948 | 
2026-05-20 03:20:12.055026 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-20 03:20:12.463224 | localhost | changed
2026-05-20 03:20:12.474589 | 
2026-05-20 03:20:12.474664 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-20 03:20:12.507391 | localhost | ok
2026-05-20 03:20:12.517299 | 
2026-05-20 03:20:12.517366 | TASK [Upload logs]
2026-05-20 03:20:12.540440 | localhost | ok
2026-05-20 03:20:12.639420 | 
2026-05-20 03:20:12.639543 | TASK [Set zuul-log-path fact]
2026-05-20 03:20:12.662942 | localhost | ok
2026-05-20 03:20:12.679918 | 
2026-05-20 03:20:12.679989 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-20 03:20:12.711942 | localhost | ok
2026-05-20 03:20:12.723148 | 
2026-05-20 03:20:12.723620 | TASK [upload-logs : Create log directories]
2026-05-20 03:20:13.083287 | localhost | changed
2026-05-20 03:20:13.089287 | 
2026-05-20 03:20:13.089363 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-20 03:20:13.467860 | localhost -> localhost | ok: Runtime: 0:00:00.009519
2026-05-20 03:20:13.473931 | 
2026-05-20 03:20:13.474001 | TASK [upload-logs : Upload logs to log server]
2026-05-20 03:20:13.931963 | localhost | Output suppressed because no_log was given
2026-05-20 03:20:13.938792 | 
2026-05-20 03:20:13.938857 | LOOP [upload-logs : Compress console log and json output]
2026-05-20 03:20:13.985444 | localhost | skipping: Conditional result was False
2026-05-20 03:20:13.992605 | localhost | skipping: Conditional result was False
2026-05-20 03:20:14.003760 | 
2026-05-20 03:20:14.003966 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-20 03:20:14.047157 | localhost | skipping: Conditional result was False
2026-05-20 03:20:14.047515 | 
2026-05-20 03:20:14.051360 | localhost | skipping: Conditional result was False
2026-05-20 03:20:14.068893 | 
2026-05-20 03:20:14.069105 | LOOP [upload-logs : Upload console log and json output]