2026-04-13 20:41:08.554221 | Job console starting 2026-04-13 20:41:08.581216 | Updating git repos 2026-04-13 20:41:08.648001 | Cloning repos into workspace 2026-04-13 20:41:08.810893 | Restoring repo states 2026-04-13 20:41:08.830942 | Merging changes 2026-04-13 20:41:09.729594 | Checking out repos 2026-04-13 20:41:10.106976 | Preparing playbooks 2026-04-13 20:41:13.499925 | Running Ansible setup 2026-04-13 20:41:17.648501 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:41:18.282613 | 2026-04-13 20:41:18.282724 | PLAY [localhost] 2026-04-13 20:41:18.290002 | 2026-04-13 20:41:18.290093 | TASK [Gathering Facts] 2026-04-13 20:41:19.332416 | localhost | ok 2026-04-13 20:41:19.346951 | 2026-04-13 20:41:19.347130 | TASK [Setup log path fact] 2026-04-13 20:41:19.364564 | localhost | ok 2026-04-13 20:41:19.378647 | 2026-04-13 20:41:19.378721 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:41:19.407286 | localhost | ok 2026-04-13 20:41:19.415332 | 2026-04-13 20:41:19.415402 | TASK [emit-job-header : Print job information] 2026-04-13 20:41:19.455267 | # Job Information 2026-04-13 20:41:19.455442 | Ansible Version: 2.16.16 2026-04-13 20:41:19.455487 | Job: atmosphere-molecule-aio-ovn 2026-04-13 20:41:19.455520 | Pipeline: check 2026-04-13 20:41:19.455549 | Executor: 0a8996d2b663 2026-04-13 20:41:19.455578 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818 2026-04-13 20:41:19.455610 | Event ID: af35ae10-3778-11f1-8810-704e89e38670 2026-04-13 20:41:19.459734 | 2026-04-13 20:41:19.459826 | LOOP [emit-job-header : Print node information] 2026-04-13 20:41:19.552599 | localhost | ok: 2026-04-13 20:41:19.553035 | localhost | # Node Information 2026-04-13 20:41:19.553123 | localhost | Inventory Hostname: instance 2026-04-13 20:41:19.553233 | localhost | Hostname: np0000165710 2026-04-13 20:41:19.553283 | localhost | Username: zuul 2026-04-13 20:41:19.553332 | localhost | Distro: Ubuntu 22.04 2026-04-13 20:41:19.553373 | localhost | Provider: yul1 2026-04-13 20:41:19.553415 | localhost | Region: ca-ymq-1 2026-04-13 20:41:19.553455 | localhost | Label: ubuntu-jammy-16 2026-04-13 20:41:19.553495 | localhost | Product Name: OpenStack Nova 2026-04-13 20:41:19.553534 | localhost | Interface IP: 162.253.55.43 2026-04-13 20:41:19.567598 | 2026-04-13 20:41:19.567724 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-13 20:41:19.958224 | localhost -> localhost | changed 2026-04-13 20:41:19.968388 | 2026-04-13 20:41:19.968550 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-13 20:41:21.008787 | localhost -> localhost | changed 2026-04-13 20:41:21.017454 | 2026-04-13 20:41:21.017564 | PLAY [all] 2026-04-13 20:41:21.030235 | 2026-04-13 20:41:21.030468 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-13 20:41:21.290536 | instance -> localhost | ok 2026-04-13 20:41:21.299804 | 2026-04-13 20:41:21.299962 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-13 20:41:21.347472 | instance | ok 2026-04-13 20:41:21.361667 | instance | included: /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-13 20:41:21.367300 | 2026-04-13 20:41:21.367365 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-13 20:41:22.302079 | instance -> localhost | Generating public/private rsa key pair. 2026-04-13 20:41:22.302363 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/5ab5d13524cd4c8bb2a78b2d43d166a8_id_rsa 2026-04-13 20:41:22.302408 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/5ab5d13524cd4c8bb2a78b2d43d166a8_id_rsa.pub 2026-04-13 20:41:22.302442 | instance -> localhost | The key fingerprint is: 2026-04-13 20:41:22.302475 | instance -> localhost | SHA256:jQzRhdZ141mg7TM5a3G3Za3AFutsCit2wuOizpWPw9g zuul-build-sshkey 2026-04-13 20:41:22.302524 | instance -> localhost | The key's randomart image is: 2026-04-13 20:41:22.302556 | instance -> localhost | +---[RSA 3072]----+ 2026-04-13 20:41:22.302592 | instance -> localhost | | .. +... +..| 2026-04-13 20:41:22.302625 | instance -> localhost | | .+ . = + | 2026-04-13 20:41:22.302656 | instance -> localhost | | .. o + | 2026-04-13 20:41:22.302687 | instance -> localhost | | o o . + ..| 2026-04-13 20:41:22.302718 | instance -> localhost | | S . = B *| 2026-04-13 20:41:22.302747 | instance -> localhost | | . + . X+| 2026-04-13 20:41:22.302777 | instance -> localhost | | +o. . + +. | 2026-04-13 20:41:22.302806 | instance -> localhost | | ...Eo* .o o . | 2026-04-13 20:41:22.302840 | instance -> localhost | | .+..=o=. . | 2026-04-13 20:41:22.302871 | instance -> localhost | +----[SHA256]-----+ 2026-04-13 20:41:22.302953 | instance -> localhost | ok: Runtime: 0:00:00.530884 2026-04-13 20:41:22.311431 | 2026-04-13 20:41:22.311606 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-13 20:41:22.347732 | instance | ok 2026-04-13 20:41:22.363929 | instance | included: /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-13 20:41:22.372927 | 2026-04-13 20:41:22.373015 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-13 20:41:22.408194 | instance | skipping: Conditional result was False 2026-04-13 20:41:22.421416 | 2026-04-13 20:41:22.421616 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-13 20:41:22.889329 | instance | changed 2026-04-13 20:41:22.896151 | 2026-04-13 20:41:22.896238 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-13 20:41:23.095700 | instance | ok 2026-04-13 20:41:23.101656 | 2026-04-13 20:41:23.101736 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-13 20:41:23.599010 | instance | changed 2026-04-13 20:41:23.604765 | 2026-04-13 20:41:23.604830 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-13 20:41:24.113997 | instance | changed 2026-04-13 20:41:24.121737 | 2026-04-13 20:41:24.121830 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-13 20:41:24.145734 | instance | skipping: Conditional result was False 2026-04-13 20:41:24.157238 | 2026-04-13 20:41:24.157376 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-13 20:41:24.531813 | instance -> localhost | changed 2026-04-13 20:41:24.573968 | 2026-04-13 20:41:24.574088 | TASK [add-build-sshkey : Add back temp key] 2026-04-13 20:41:24.837106 | instance -> localhost | Identity added: /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/5ab5d13524cd4c8bb2a78b2d43d166a8_id_rsa (zuul-build-sshkey) 2026-04-13 20:41:24.837297 | instance -> localhost | ok: Runtime: 0:00:00.011882 2026-04-13 20:41:24.844317 | 2026-04-13 20:41:24.844405 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-13 20:41:25.131716 | instance | ok 2026-04-13 20:41:25.138197 | 2026-04-13 20:41:25.138283 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-13 20:41:25.161406 | instance | skipping: Conditional result was False 2026-04-13 20:41:25.176107 | 2026-04-13 20:41:25.176185 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-13 20:41:25.449718 | instance | ok 2026-04-13 20:41:25.457637 | 2026-04-13 20:41:25.457732 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-13 20:41:27.066349 | instance | Output suppressed because no_log was given 2026-04-13 20:41:27.079366 | 2026-04-13 20:41:27.079494 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-13 20:41:27.281608 | instance | ok: "logs" 2026-04-13 20:41:28.044108 | instance | ok: All items complete 2026-04-13 20:41:28.044253 | 2026-04-13 20:41:28.051686 | instance | ok: "artifacts" 2026-04-13 20:41:28.057737 | instance | ok: "docs" 2026-04-13 20:41:28.070498 | 2026-04-13 20:41:28.070648 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-13 20:41:28.281544 | instance | changed: "logs" 2026-04-13 20:41:28.475783 | instance | changed: "artifacts" 2026-04-13 20:41:28.635531 | instance | changed: "docs" 2026-04-13 20:41:28.648897 | 2026-04-13 20:41:28.649019 | PLAY RECAP 2026-04-13 20:41:28.649081 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-13 20:41:28.649113 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:41:28.649136 | 2026-04-13 20:41:28.757714 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:41:28.770237 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:41:29.423440 | 2026-04-13 20:41:29.423632 | PLAY [all] 2026-04-13 20:41:29.440985 | 2026-04-13 20:41:29.441153 | TASK [setup-uv : Extract archive] 2026-04-13 20:41:31.748266 | instance | changed 2026-04-13 20:41:31.754448 | 2026-04-13 20:41:31.754581 | TASK [setup-uv : Print version] 2026-04-13 20:41:31.934066 | instance | uv 0.8.13 2026-04-13 20:41:32.296388 | instance | ok: Runtime: 0:00:00.014585 2026-04-13 20:41:32.303305 | 2026-04-13 20:41:32.303412 | PLAY RECAP 2026-04-13 20:41:32.303457 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:41:32.303482 | 2026-04-13 20:41:32.414680 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:41:32.429369 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:41:33.059578 | 2026-04-13 20:41:33.059685 | PLAY [all] 2026-04-13 20:41:33.070189 | 2026-04-13 20:41:33.070275 | TASK [Install "jq" for log collection] 2026-04-13 20:41:45.904725 | instance | changed 2026-04-13 20:41:45.912912 | 2026-04-13 20:41:45.913121 | TASK [Install pip3 for Python package management] 2026-04-13 20:41:51.104276 | instance | changed 2026-04-13 20:41:51.109715 | 2026-04-13 20:41:51.109824 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-13 20:41:54.341108 | instance | changed 2026-04-13 20:41:54.343667 | 2026-04-13 20:41:54.343743 | PLAY [all] 2026-04-13 20:41:54.352245 | 2026-04-13 20:41:54.352365 | TASK [ensure-go : Check installed go version] 2026-04-13 20:41:54.888373 | instance | ok: ERROR (ignored) 2026-04-13 20:41:54.888645 | instance | { 2026-04-13 20:41:54.888688 | instance | "failed_when_result": false, 2026-04-13 20:41:54.888720 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 20:41:54.888751 | instance | "rc": 2 2026-04-13 20:41:54.888785 | instance | } 2026-04-13 20:41:54.895562 | 2026-04-13 20:41:54.895656 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-13 20:41:54.949681 | instance | ok 2026-04-13 20:41:54.960641 | instance | included: /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-13 20:41:54.965635 | 2026-04-13 20:41:54.965713 | TASK [ensure-go : Create temp directory] 2026-04-13 20:41:55.306292 | instance | changed 2026-04-13 20:41:55.316593 | 2026-04-13 20:41:55.316776 | TASK [ensure-go : Get archive checksum] 2026-04-13 20:41:55.894332 | instance | ok: OK (64 bytes) 2026-04-13 20:41:55.901624 | 2026-04-13 20:41:55.901691 | TASK [ensure-go : Download go archive] 2026-04-13 20:41:57.225049 | instance | changed: OK (78559214 bytes) 2026-04-13 20:41:57.232163 | 2026-04-13 20:41:57.232227 | TASK [ensure-go : Install go] 2026-04-13 20:42:03.225162 | instance | changed 2026-04-13 20:42:03.237314 | 2026-04-13 20:42:03.237482 | PLAY [all] 2026-04-13 20:42:03.246449 | 2026-04-13 20:42:03.246593 | TASK [Build atmosphere binary] 2026-04-13 20:42:03.719359 | instance -> localhost | ERROR 2026-04-13 20:42:03.719621 | instance -> localhost | { 2026-04-13 20:42:03.719677 | instance -> localhost | "delta": null, 2026-04-13 20:42:03.719707 | instance -> localhost | "end": null, 2026-04-13 20:42:03.719732 | instance -> localhost | "msg": "Unable to change directory before execution: [Errno 2] No such file or directory: b'src/github.com/vexxhost/atmosphere'", 2026-04-13 20:42:03.719758 | instance -> localhost | "rc": null, 2026-04-13 20:42:03.719781 | instance -> localhost | "start": null 2026-04-13 20:42:03.719806 | instance -> localhost | } failure 2026-04-13 20:42:03.722220 | 2026-04-13 20:42:03.722295 | PLAY RECAP 2026-04-13 20:42:03.722351 | instance | ok: 9 changed: 6 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:42:03.722411 | 2026-04-13 20:42:03.852835 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:42:03.871797 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:42:04.559321 | 2026-04-13 20:42:04.559518 | PLAY [all] 2026-04-13 20:42:04.577873 | 2026-04-13 20:42:04.578049 | TASK [gather-host-logs : creating directory for system status] 2026-04-13 20:42:04.980574 | instance | changed 2026-04-13 20:42:04.986510 | 2026-04-13 20:42:04.986608 | TASK [gather-host-logs : Get logs for each host] 2026-04-13 20:42:05.347225 | instance | + systemd-cgls --full --all --no-pager 2026-04-13 20:42:05.360392 | instance | + ip addr 2026-04-13 20:42:05.362273 | instance | + ip route 2026-04-13 20:42:05.363597 | instance | + lsblk 2026-04-13 20:42:05.366281 | instance | + mount 2026-04-13 20:42:05.367812 | instance | + docker images 2026-04-13 20:42:05.368132 | instance | /bin/bash: line 7: docker: command not found 2026-04-13 20:42:05.368313 | instance | + brctl show 2026-04-13 20:42:05.368637 | instance | /bin/bash: line 8: brctl: command not found 2026-04-13 20:42:05.368804 | instance | + ps aux --sort=-%mem 2026-04-13 20:42:05.382288 | instance | + dpkg -l 2026-04-13 20:42:05.390348 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-13 20:42:05.390929 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-13 20:42:05.391032 | instance | /bin/bash: line 11: docker: command not found 2026-04-13 20:42:05.391473 | instance | + '[' '!' -z '' ']' 2026-04-13 20:42:05.526924 | instance | ok: Runtime: 0:00:00.049097 2026-04-13 20:42:05.538238 | 2026-04-13 20:42:05.538370 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-13 20:42:06.634374 | instance | changed: 2026-04-13 20:42:06.634570 | instance | created directory /var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/logs/instance 2026-04-13 20:42:06.634602 | instance | cd+++++++++ system/ 2026-04-13 20:42:06.634625 | instance | >f+++++++++ system/brctl-show.txt 2026-04-13 20:42:06.634647 | instance | >f+++++++++ system/docker-images.txt 2026-04-13 20:42:06.634667 | instance | >f+++++++++ system/ip-addr.txt 2026-04-13 20:42:06.634691 | instance | >f+++++++++ system/ip-route.txt 2026-04-13 20:42:06.634713 | instance | >f+++++++++ system/lsblk.txt 2026-04-13 20:42:06.634733 | instance | >f+++++++++ system/mount.txt 2026-04-13 20:42:06.634756 | instance | >f+++++++++ system/packages.txt 2026-04-13 20:42:06.634776 | instance | >f+++++++++ system/ps.txt 2026-04-13 20:42:06.634796 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-13 20:42:06.643795 | 2026-04-13 20:42:06.643859 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-13 20:42:06.855175 | instance | changed: "values" 2026-04-13 20:42:07.012538 | instance | changed: "releases" 2026-04-13 20:42:07.034723 | 2026-04-13 20:42:07.034981 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-13 20:42:07.237992 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-13 20:42:07.807199 | instance | ok: Runtime: 0:00:00.004984 2026-04-13 20:42:07.814508 | 2026-04-13 20:42:07.814642 | TASK [helm-release-status : Downloads logs to executor] 2026-04-13 20:42:08.317050 | instance | changed: 2026-04-13 20:42:08.317227 | instance | cd+++++++++ helm/ 2026-04-13 20:42:08.317268 | instance | cd+++++++++ helm/releases/ 2026-04-13 20:42:08.317300 | instance | cd+++++++++ helm/values/ 2026-04-13 20:42:08.330367 | 2026-04-13 20:42:08.330490 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-13 20:42:08.545596 | instance | changed 2026-04-13 20:42:08.584619 | 2026-04-13 20:42:09.131834 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-13 20:42:09.365592 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:42:09.366106 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:42:09.370132 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:42:09.371605 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:42:09.373344 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:42:09.375078 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:42:09.376652 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:42:09.377528 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:42:09.380068 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:42:09.380563 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:42:09.381624 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:42:09.382565 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:42:09.675681 | instance | ok: Runtime: 0:00:00.027663 2026-04-13 20:42:09.682542 | 2026-04-13 20:42:09.682630 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-13 20:42:09.926457 | instance | changed 2026-04-13 20:42:09.931644 | 2026-04-13 20:42:09.931732 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-13 20:42:10.137697 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:42:10.137834 | instance | environment: line 5: kubectl: command not found 2026-04-13 20:42:10.139250 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:42:10.139354 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:42:10.468682 | instance | ok: Runtime: 0:00:00.007951 2026-04-13 20:42:10.476910 | 2026-04-13 20:42:10.476998 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-13 20:42:11.160826 | instance | changed: 2026-04-13 20:42:11.161092 | instance | cd+++++++++ objects/ 2026-04-13 20:42:11.161135 | instance | cd+++++++++ objects/cluster/ 2026-04-13 20:42:11.161169 | instance | cd+++++++++ objects/namespaced/ 2026-04-13 20:42:11.174977 | 2026-04-13 20:42:11.175214 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-13 20:42:11.393555 | instance | changed 2026-04-13 20:42:11.406717 | 2026-04-13 20:42:11.406876 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-13 20:42:11.637060 | instance | changed 2026-04-13 20:42:11.649191 | 2026-04-13 20:42:11.649288 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-13 20:42:11.852999 | instance | environment: line 3: kubectl: command not found 2026-04-13 20:42:12.181719 | instance | ok: Runtime: 0:00:00.007730 2026-04-13 20:42:12.186803 | 2026-04-13 20:42:12.186880 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-13 20:42:12.685440 | instance | changed: 2026-04-13 20:42:12.685723 | instance | cd+++++++++ pod-logs/ 2026-04-13 20:42:12.685785 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-13 20:42:12.705373 | 2026-04-13 20:42:12.705512 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-13 20:42:12.904911 | instance | changed 2026-04-13 20:42:14.365865 | 2026-04-13 20:42:14.366005 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-13 20:42:14.600827 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:42:14.906637 | instance | ok: Runtime: 0:00:00.034990 2026-04-13 20:42:14.913210 | 2026-04-13 20:42:14.913298 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-13 20:42:15.136084 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:42:15.167301 | instance | ceph-mgr endpoints: 2026-04-13 20:42:15.457530 | instance | ok: Runtime: 0:00:00.035841 2026-04-13 20:42:15.468091 | 2026-04-13 20:42:15.468305 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-13 20:42:15.704013 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-13 20:42:16.990038 | instance | ok: Runtime: 0:00:00.037692 2026-04-13 20:42:16.997729 | 2026-04-13 20:42:16.997865 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-13 20:42:17.527511 | instance | changed: cd+++++++++ prometheus/ 2026-04-13 20:42:17.545892 | 2026-04-13 20:42:17.546128 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-13 20:42:17.817472 | instance | changed 2026-04-13 20:42:18.244478 | 2026-04-13 20:42:18.244794 | TASK [gather-selenium-data : Get selenium data] 2026-04-13 20:42:18.469826 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-13 20:42:18.470927 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-13 20:42:18.940832 | instance | ERROR 2026-04-13 20:42:18.941107 | instance | { 2026-04-13 20:42:18.941190 | instance | "delta": "0:00:00.005777", 2026-04-13 20:42:18.941233 | instance | "end": "2026-04-13 20:42:18.471259", 2026-04-13 20:42:18.941271 | instance | "msg": "non-zero return code", 2026-04-13 20:42:18.941300 | instance | "rc": 1, 2026-04-13 20:42:18.941330 | instance | "start": "2026-04-13 20:42:18.465482" 2026-04-13 20:42:18.941970 | instance | } 2026-04-13 20:42:18.942045 | instance | ERROR: Ignoring Errors 2026-04-13 20:42:18.952313 | 2026-04-13 20:42:18.952496 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-13 20:42:19.493682 | instance | changed: cd+++++++++ selenium/ 2026-04-13 20:42:19.499951 | 2026-04-13 20:42:19.500022 | PLAY RECAP 2026-04-13 20:42:19.500084 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-13 20:42:19.500120 | 2026-04-13 20:42:19.754244 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:42:20.040343 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:42:20.805102 | 2026-04-13 20:42:20.805225 | PLAY [all] 2026-04-13 20:42:20.817534 | 2026-04-13 20:42:20.817626 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-13 20:42:20.872473 | instance | skipping: Conditional result was False 2026-04-13 20:42:20.883492 | 2026-04-13 20:42:20.883689 | TASK [fetch-output : Set log path for single node] 2026-04-13 20:42:20.928455 | instance | ok 2026-04-13 20:42:20.936012 | 2026-04-13 20:42:22.748821 | LOOP [fetch-output : Ensure local output dirs] 2026-04-13 20:42:23.164388 | instance -> localhost | ok: "/var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/logs" 2026-04-13 20:42:24.058682 | instance -> localhost | changed: "/var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/artifacts" 2026-04-13 20:42:24.278670 | instance -> localhost | changed: "/var/lib/zuul/builds/5ab5d13524cd4c8bb2a78b2d43d166a8/work/docs" 2026-04-13 20:42:24.292317 | 2026-04-13 20:42:24.292436 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-13 20:42:26.329842 | instance | changed: .d..t...... ./ 2026-04-13 20:42:26.330079 | instance | changed: All items complete 2026-04-13 20:42:26.330119 | 2026-04-13 20:42:26.819289 | instance | changed: .d..t...... ./ 2026-04-13 20:42:29.241434 | instance | changed: .d..t...... ./ 2026-04-13 20:42:29.292021 | 2026-04-13 20:42:29.292228 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-13 20:42:31.578688 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:01.835035 2026-04-13 20:42:31.880939 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.009233 2026-04-13 20:42:31.903718 | 2026-04-13 20:42:31.903869 | PLAY [all] 2026-04-13 20:42:31.912648 | 2026-04-13 20:42:32.600506 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-13 20:42:33.063288 | instance | changed 2026-04-13 20:42:33.070937 | 2026-04-13 20:42:33.070990 | PLAY RECAP 2026-04-13 20:42:33.071034 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-13 20:42:33.071056 | 2026-04-13 20:42:33.168294 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:42:33.180416 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-13 20:42:33.845478 | 2026-04-13 20:42:33.845793 | PLAY [localhost] 2026-04-13 20:42:33.855118 | 2026-04-13 20:42:33.855189 | TASK [Generate Zuul manifest] 2026-04-13 20:42:33.885898 | localhost | ok 2026-04-13 20:42:33.902218 | 2026-04-13 20:42:33.902305 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-13 20:42:38.427528 | localhost | changed 2026-04-13 20:42:38.439513 | 2026-04-13 20:42:38.439611 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-13 20:42:38.999471 | localhost | ok 2026-04-13 20:42:39.005856 | 2026-04-13 20:42:39.005923 | TASK [Upload logs] 2026-04-13 20:42:39.023512 | localhost | ok 2026-04-13 20:42:39.117426 | 2026-04-13 20:42:39.117552 | TASK [Set zuul-log-path fact] 2026-04-13 20:42:39.139189 | localhost | ok 2026-04-13 20:42:39.153414 | 2026-04-13 20:42:39.153535 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:42:39.186716 | localhost | ok 2026-04-13 20:42:39.197910 | 2026-04-13 20:42:39.198087 | TASK [upload-logs : Create log directories] 2026-04-13 20:42:39.697259 | localhost | changed 2026-04-13 20:42:39.703142 | 2026-04-13 20:42:39.703264 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-13 20:42:40.392278 | localhost -> localhost | ok: Runtime: 0:00:00.005829 2026-04-13 20:42:40.402882 | 2026-04-13 20:42:40.403053 | TASK [upload-logs : Upload logs to log server] 2026-04-13 20:42:41.187362 | localhost | Output suppressed because no_log was given 2026-04-13 20:42:41.191477 | 2026-04-13 20:42:41.191574 | LOOP [upload-logs : Compress console log and json output] 2026-04-13 20:42:41.235714 | localhost | skipping: Conditional result was False 2026-04-13 20:42:41.243538 | localhost | skipping: Conditional result was False 2026-04-13 20:42:41.252663 | 2026-04-13 20:42:41.252902 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-13 20:42:41.293450 | localhost | skipping: Conditional result was False 2026-04-13 20:42:41.293685 | 2026-04-13 20:42:41.298751 | localhost | skipping: Conditional result was False 2026-04-13 20:42:41.307117 | 2026-04-13 20:42:41.307262 | LOOP [upload-logs : Upload console log and json output]