2026-04-13 20:39:09.716776 | Job console starting 2026-04-13 20:39:09.736663 | Updating git repos 2026-04-13 20:39:09.795534 | Cloning repos into workspace 2026-04-13 20:39:09.852703 | Restoring repo states 2026-04-13 20:39:09.869302 | Merging changes 2026-04-13 20:39:11.612287 | Checking out repos 2026-04-13 20:39:11.735305 | Preparing playbooks 2026-04-13 20:39:19.174801 | Running Ansible setup 2026-04-13 20:39:22.535505 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:39:23.198128 | 2026-04-13 20:39:23.198255 | PLAY [localhost] 2026-04-13 20:39:23.206058 | 2026-04-13 20:39:23.206150 | TASK [Gathering Facts] 2026-04-13 20:39:25.054980 | localhost | ok 2026-04-13 20:39:25.066633 | 2026-04-13 20:39:25.066773 | TASK [Setup log path fact] 2026-04-13 20:39:25.084902 | localhost | ok 2026-04-13 20:39:25.097733 | 2026-04-13 20:39:25.097807 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:39:25.126973 | localhost | ok 2026-04-13 20:39:25.134386 | 2026-04-13 20:39:25.134492 | TASK [emit-job-header : Print job information] 2026-04-13 20:39:25.176718 | # Job Information 2026-04-13 20:39:25.177086 | Ansible Version: 2.16.16 2026-04-13 20:39:25.177153 | Job: atmosphere-molecule-aio-ovn 2026-04-13 20:39:25.177198 | Pipeline: check 2026-04-13 20:39:25.177240 | Executor: 0a8996d2b663 2026-04-13 20:39:25.177279 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3818 2026-04-13 20:39:25.177324 | Event ID: af35ae10-3778-11f1-8810-704e89e38670 2026-04-13 20:39:25.182501 | 2026-04-13 20:39:25.182638 | LOOP [emit-job-header : Print node information] 2026-04-13 20:39:25.279589 | localhost | ok: 2026-04-13 20:39:25.280002 | localhost | # Node Information 2026-04-13 20:39:25.280123 | localhost | Inventory Hostname: instance 2026-04-13 20:39:25.280157 | localhost | Hostname: np0000165705 2026-04-13 20:39:25.280178 | localhost | Username: zuul 2026-04-13 20:39:25.280204 | localhost | Distro: Ubuntu 22.04 2026-04-13 20:39:25.280226 | localhost | Provider: yul1 2026-04-13 20:39:25.280246 | localhost | Region: ca-ymq-1 2026-04-13 20:39:25.280265 | localhost | Label: ubuntu-jammy-16 2026-04-13 20:39:25.280284 | localhost | Product Name: OpenStack Nova 2026-04-13 20:39:25.280302 | localhost | Interface IP: 199.204.45.144 2026-04-13 20:39:25.299008 | 2026-04-13 20:39:25.299254 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-13 20:39:25.681104 | localhost -> localhost | changed 2026-04-13 20:39:25.689833 | 2026-04-13 20:39:25.689989 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-13 20:39:26.801544 | localhost -> localhost | changed 2026-04-13 20:39:26.813195 | 2026-04-13 20:39:26.813332 | PLAY [all] 2026-04-13 20:39:26.824088 | 2026-04-13 20:39:26.824206 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-13 20:39:27.063009 | instance -> localhost | ok 2026-04-13 20:39:27.071359 | 2026-04-13 20:39:27.071526 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-13 20:39:27.105991 | instance | ok 2026-04-13 20:39:27.124030 | instance | included: /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-13 20:39:27.131900 | 2026-04-13 20:39:27.132034 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-13 20:39:28.147763 | instance -> localhost | Generating public/private rsa key pair. 2026-04-13 20:39:28.147912 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/5781143f29f1428c9450202f82fd582c_id_rsa 2026-04-13 20:39:28.147942 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/5781143f29f1428c9450202f82fd582c_id_rsa.pub 2026-04-13 20:39:28.147964 | instance -> localhost | The key fingerprint is: 2026-04-13 20:39:28.147986 | instance -> localhost | SHA256:IIyuN8qM7eLcrE5+AkU5kASwlnMdw5YsROj7yRuaQzM zuul-build-sshkey 2026-04-13 20:39:28.148017 | instance -> localhost | The key's randomart image is: 2026-04-13 20:39:28.148039 | instance -> localhost | +---[RSA 3072]----+ 2026-04-13 20:39:28.148062 | instance -> localhost | |B+++oo. | 2026-04-13 20:39:28.148083 | instance -> localhost | |.o=+.=o | 2026-04-13 20:39:28.148104 | instance -> localhost | |o=.o=.. | 2026-04-13 20:39:28.148124 | instance -> localhost | |.o+ . . | 2026-04-13 20:39:28.148143 | instance -> localhost | | .o S | 2026-04-13 20:39:28.148163 | instance -> localhost | |.E | 2026-04-13 20:39:28.148183 | instance -> localhost | |+.B.. | 2026-04-13 20:39:28.148202 | instance -> localhost | |O*=*. | 2026-04-13 20:39:28.148225 | instance -> localhost | |=&B+. | 2026-04-13 20:39:28.148245 | instance -> localhost | +----[SHA256]-----+ 2026-04-13 20:39:28.148289 | instance -> localhost | ok: Runtime: 0:00:00.557245 2026-04-13 20:39:28.153182 | 2026-04-13 20:39:28.153244 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-13 20:39:28.185456 | instance | ok 2026-04-13 20:39:28.196233 | instance | included: /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-13 20:39:28.203542 | 2026-04-13 20:39:28.203606 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-13 20:39:28.218838 | instance | skipping: Conditional result was False 2026-04-13 20:39:28.228035 | 2026-04-13 20:39:28.228101 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-13 20:39:28.730814 | instance | changed 2026-04-13 20:39:28.736129 | 2026-04-13 20:39:28.736242 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-13 20:39:28.943800 | instance | ok 2026-04-13 20:39:28.948731 | 2026-04-13 20:39:28.948802 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-13 20:39:29.408472 | instance | changed 2026-04-13 20:39:29.413464 | 2026-04-13 20:39:29.413529 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-13 20:39:29.865021 | instance | changed 2026-04-13 20:39:29.872725 | 2026-04-13 20:39:29.872840 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-13 20:39:29.896831 | instance | skipping: Conditional result was False 2026-04-13 20:39:29.910222 | 2026-04-13 20:39:29.910386 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-13 20:39:30.252253 | instance -> localhost | changed 2026-04-13 20:39:30.300914 | 2026-04-13 20:39:30.301083 | TASK [add-build-sshkey : Add back temp key] 2026-04-13 20:39:30.575579 | instance -> localhost | Identity added: /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/5781143f29f1428c9450202f82fd582c_id_rsa (zuul-build-sshkey) 2026-04-13 20:39:30.575787 | instance -> localhost | ok: Runtime: 0:00:00.013393 2026-04-13 20:39:30.583546 | 2026-04-13 20:39:30.583607 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-13 20:39:30.885473 | instance | ok 2026-04-13 20:39:30.891258 | 2026-04-13 20:39:30.891342 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-13 20:39:30.915315 | instance | skipping: Conditional result was False 2026-04-13 20:39:30.930992 | 2026-04-13 20:39:30.931084 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-13 20:39:31.241045 | instance | ok 2026-04-13 20:39:31.246829 | 2026-04-13 20:39:31.246895 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-13 20:39:32.907140 | instance | Output suppressed because no_log was given 2026-04-13 20:39:32.918967 | 2026-04-13 20:39:32.919110 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-13 20:39:33.106943 | instance | ok: "logs" 2026-04-13 20:39:33.107181 | instance | ok: All items complete 2026-04-13 20:39:33.107212 | 2026-04-13 20:39:33.261767 | instance | ok: "artifacts" 2026-04-13 20:39:33.413421 | instance | ok: "docs" 2026-04-13 20:39:33.431790 | 2026-04-13 20:39:33.435551 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-13 20:39:33.618259 | instance | changed: "logs" 2026-04-13 20:39:33.788761 | instance | changed: "artifacts" 2026-04-13 20:39:33.954956 | instance | changed: "docs" 2026-04-13 20:39:33.974828 | 2026-04-13 20:39:33.974894 | PLAY RECAP 2026-04-13 20:39:33.974939 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-13 20:39:33.974969 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:39:33.974992 | 2026-04-13 20:39:34.096084 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-13 20:39:34.108369 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:39:34.733841 | 2026-04-13 20:39:34.733964 | PLAY [all] 2026-04-13 20:39:34.746042 | 2026-04-13 20:39:34.746127 | TASK [setup-uv : Extract archive] 2026-04-13 20:39:36.942162 | instance | changed 2026-04-13 20:39:36.950913 | 2026-04-13 20:39:36.951009 | TASK [setup-uv : Print version] 2026-04-13 20:39:37.164342 | instance | uv 0.8.13 2026-04-13 20:39:37.488777 | instance | ok: Runtime: 0:00:00.011286 2026-04-13 20:39:37.499501 | 2026-04-13 20:39:37.499650 | PLAY RECAP 2026-04-13 20:39:37.499704 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:39:37.499728 | 2026-04-13 20:39:37.694197 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-13 20:39:37.706036 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:39:38.304018 | 2026-04-13 20:39:38.304156 | PLAY [all] 2026-04-13 20:39:38.315390 | 2026-04-13 20:39:38.315488 | TASK [Install "jq" for log collection] 2026-04-13 20:39:48.409699 | instance | changed 2026-04-13 20:39:48.417101 | 2026-04-13 20:39:48.417259 | TASK [Install pip3 for Python package management] 2026-04-13 20:39:52.288942 | instance | changed 2026-04-13 20:39:52.298324 | 2026-04-13 20:39:52.298476 | TASK [Install Python "kubernetes" library for kubernetes.core modules] 2026-04-13 20:39:55.439033 | instance | changed 2026-04-13 20:39:55.442685 | 2026-04-13 20:39:55.442783 | PLAY [all] 2026-04-13 20:39:55.451099 | 2026-04-13 20:39:55.451204 | TASK [ensure-go : Check installed go version] 2026-04-13 20:39:55.987707 | instance | ok: ERROR (ignored) 2026-04-13 20:39:55.987980 | instance | { 2026-04-13 20:39:55.988024 | instance | "failed_when_result": false, 2026-04-13 20:39:55.988054 | instance | "msg": "[Errno 2] No such file or directory: b'go'", 2026-04-13 20:39:55.988085 | instance | "rc": 2 2026-04-13 20:39:55.988117 | instance | } 2026-04-13 20:39:55.994289 | 2026-04-13 20:39:55.994376 | TASK [ensure-go : Skip if correct version of go is installed] 2026-04-13 20:39:56.047563 | instance | ok 2026-04-13 20:39:56.056387 | instance | included: /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml 2026-04-13 20:39:56.061576 | 2026-04-13 20:39:56.061660 | TASK [ensure-go : Create temp directory] 2026-04-13 20:39:56.361122 | instance | changed 2026-04-13 20:39:56.365968 | 2026-04-13 20:39:56.366031 | TASK [ensure-go : Get archive checksum] 2026-04-13 20:39:56.961489 | instance | ok: OK (64 bytes) 2026-04-13 20:39:56.967173 | 2026-04-13 20:39:56.967251 | TASK [ensure-go : Download go archive] 2026-04-13 20:39:58.626372 | instance | changed: OK (78559214 bytes) 2026-04-13 20:39:58.966965 | 2026-04-13 20:39:58.967062 | TASK [ensure-go : Install go] 2026-04-13 20:40:04.708362 | instance | changed 2026-04-13 20:40:04.719740 | 2026-04-13 20:40:04.719851 | PLAY [all] 2026-04-13 20:40:04.725827 | 2026-04-13 20:40:04.725908 | TASK [Build atmosphere binary] 2026-04-13 20:40:04.970312 | instance -> localhost | ERROR 2026-04-13 20:40:04.970572 | instance -> localhost | { 2026-04-13 20:40:04.970724 | instance -> localhost | "delta": null, 2026-04-13 20:40:04.970772 | instance -> localhost | "end": null, 2026-04-13 20:40:04.970802 | instance -> localhost | "msg": "Unable to change directory before execution: [Errno 2] No such file or directory: b'src/github.com/vexxhost/atmosphere'", 2026-04-13 20:40:04.970829 | instance -> localhost | "rc": null, 2026-04-13 20:40:04.970854 | instance -> localhost | "start": null 2026-04-13 20:40:04.970879 | instance -> localhost | } failure 2026-04-13 20:40:04.972388 | 2026-04-13 20:40:04.972448 | PLAY RECAP 2026-04-13 20:40:04.972512 | instance | ok: 9 changed: 6 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-04-13 20:40:04.972557 | 2026-04-13 20:40:05.072674 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-04-13 20:40:05.084583 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:40:05.819297 | 2026-04-13 20:40:05.819446 | PLAY [all] 2026-04-13 20:40:05.834081 | 2026-04-13 20:40:05.834191 | TASK [gather-host-logs : creating directory for system status] 2026-04-13 20:40:06.170411 | instance | changed 2026-04-13 20:40:06.177678 | 2026-04-13 20:40:06.177778 | TASK [gather-host-logs : Get logs for each host] 2026-04-13 20:40:06.520733 | instance | + systemd-cgls --full --all --no-pager 2026-04-13 20:40:06.531990 | instance | + ip addr 2026-04-13 20:40:06.534893 | instance | + ip route 2026-04-13 20:40:06.536085 | instance | + lsblk 2026-04-13 20:40:06.540462 | instance | + mount 2026-04-13 20:40:06.542273 | instance | + docker images 2026-04-13 20:40:06.542627 | instance | /bin/bash: line 7: docker: command not found 2026-04-13 20:40:06.542816 | instance | + brctl show 2026-04-13 20:40:06.543202 | instance | /bin/bash: line 8: brctl: command not found 2026-04-13 20:40:06.543427 | instance | + ps aux --sort=-%mem 2026-04-13 20:40:06.562884 | instance | + dpkg -l 2026-04-13 20:40:06.569202 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-04-13 20:40:06.569672 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-04-13 20:40:06.569765 | instance | /bin/bash: line 11: docker: command not found 2026-04-13 20:40:06.570092 | instance | + '[' '!' -z '' ']' 2026-04-13 20:40:07.589744 | instance | ok: Runtime: 0:00:00.054165 2026-04-13 20:40:07.598099 | 2026-04-13 20:40:07.598166 | TASK [gather-host-logs : Downloads logs to executor] 2026-04-13 20:40:08.255769 | instance | changed: 2026-04-13 20:40:08.255950 | instance | created directory /var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/logs/instance 2026-04-13 20:40:08.255994 | instance | cd+++++++++ system/ 2026-04-13 20:40:08.256029 | instance | >f+++++++++ system/brctl-show.txt 2026-04-13 20:40:08.256094 | instance | >f+++++++++ system/docker-images.txt 2026-04-13 20:40:08.256127 | instance | >f+++++++++ system/ip-addr.txt 2026-04-13 20:40:08.256163 | instance | >f+++++++++ system/ip-route.txt 2026-04-13 20:40:08.256197 | instance | >f+++++++++ system/lsblk.txt 2026-04-13 20:40:08.256229 | instance | >f+++++++++ system/mount.txt 2026-04-13 20:40:08.256264 | instance | >f+++++++++ system/packages.txt 2026-04-13 20:40:08.256296 | instance | >f+++++++++ system/ps.txt 2026-04-13 20:40:08.256328 | instance | >f+++++++++ system/systemd-cgls.txt 2026-04-13 20:40:08.278236 | 2026-04-13 20:40:08.278386 | LOOP [helm-release-status : creating directory for helm release status] 2026-04-13 20:40:08.480921 | instance | changed: "values" 2026-04-13 20:40:08.642912 | instance | changed: "releases" 2026-04-13 20:40:08.656809 | 2026-04-13 20:40:08.657008 | TASK [helm-release-status : Gather get release status for helm charts] 2026-04-13 20:40:08.862707 | instance | /bin/bash: line 3: kubectl: command not found 2026-04-13 20:40:09.187358 | instance | ok: Runtime: 0:00:00.005748 2026-04-13 20:40:09.192391 | 2026-04-13 20:40:09.192466 | TASK [helm-release-status : Downloads logs to executor] 2026-04-13 20:40:09.705354 | instance | changed: 2026-04-13 20:40:09.705554 | instance | cd+++++++++ helm/ 2026-04-13 20:40:09.705623 | instance | cd+++++++++ helm/releases/ 2026-04-13 20:40:09.705659 | instance | cd+++++++++ helm/values/ 2026-04-13 20:40:09.715369 | 2026-04-13 20:40:09.715437 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-04-13 20:40:09.900770 | instance | changed 2026-04-13 20:40:09.933820 | 2026-04-13 20:40:09.933938 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-04-13 20:40:10.175535 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:40:10.175930 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:40:10.179859 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:40:10.181366 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:40:10.182669 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:40:10.183913 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:40:10.185397 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:40:10.186365 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:40:10.187818 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:40:10.189257 | instance | environment: line 1: kubectl: command not found 2026-04-13 20:40:10.189522 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:40:10.190031 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-04-13 20:40:10.469695 | instance | ok: Runtime: 0:00:00.021159 2026-04-13 20:40:10.477146 | 2026-04-13 20:40:10.477239 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-04-13 20:40:10.676226 | instance | changed 2026-04-13 20:40:10.681382 | 2026-04-13 20:40:10.681461 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-04-13 20:40:10.894794 | instance | environment: line 5: kubectl: command not found 2026-04-13 20:40:10.895099 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:40:10.895689 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:40:10.895876 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-04-13 20:40:11.212225 | instance | ok: Runtime: 0:00:00.006616 2026-04-13 20:40:11.219958 | 2026-04-13 20:40:11.220059 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-04-13 20:40:11.697154 | instance | changed: 2026-04-13 20:40:11.697396 | instance | cd+++++++++ objects/ 2026-04-13 20:40:11.697437 | instance | cd+++++++++ objects/cluster/ 2026-04-13 20:40:11.697470 | instance | cd+++++++++ objects/namespaced/ 2026-04-13 20:40:11.710441 | 2026-04-13 20:40:11.710523 | TASK [gather-pod-logs : creating directory for pod logs] 2026-04-13 20:40:11.897083 | instance | changed 2026-04-13 20:40:13.214383 | 2026-04-13 20:40:13.214536 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-04-13 20:40:13.416727 | instance | changed 2026-04-13 20:40:13.423605 | 2026-04-13 20:40:13.423740 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-04-13 20:40:13.645331 | instance | environment: line 3: kubectl: command not found 2026-04-13 20:40:13.979842 | instance | ok: Runtime: 0:00:00.008635 2026-04-13 20:40:13.986470 | 2026-04-13 20:40:13.986559 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-04-13 20:40:14.466852 | instance | changed: 2026-04-13 20:40:14.467102 | instance | cd+++++++++ pod-logs/ 2026-04-13 20:40:14.467182 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-04-13 20:40:14.481543 | 2026-04-13 20:40:14.481728 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-04-13 20:40:14.692943 | instance | changed 2026-04-13 20:40:14.699926 | 2026-04-13 20:40:14.699998 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-04-13 20:40:14.908501 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:40:15.310191 | instance | ok: Runtime: 0:00:00.037070 2026-04-13 20:40:15.315135 | 2026-04-13 20:40:15.315237 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-04-13 20:40:15.512862 | instance | /bin/bash: line 2: kubectl: command not found 2026-04-13 20:40:15.542173 | instance | ceph-mgr endpoints: 2026-04-13 20:40:15.856504 | instance | ok: Runtime: 0:00:00.036343 2026-04-13 20:40:15.863836 | 2026-04-13 20:40:15.863965 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-04-13 20:40:16.058009 | instance | /bin/bash: line 4: kubectl: command not found 2026-04-13 20:40:16.399873 | instance | ok: Runtime: 0:00:00.035152 2026-04-13 20:40:16.407420 | 2026-04-13 20:40:16.407553 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-04-13 20:40:22.406078 | instance | changed: cd+++++++++ prometheus/ 2026-04-13 20:40:22.420641 | 2026-04-13 20:40:22.420762 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-04-13 20:40:22.646624 | instance | changed 2026-04-13 20:40:22.651968 | 2026-04-13 20:40:22.652037 | TASK [gather-selenium-data : Get selenium data] 2026-04-13 20:40:22.863706 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-04-13 20:40:22.865015 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-04-13 20:40:23.185185 | instance | ERROR 2026-04-13 20:40:23.185380 | instance | { 2026-04-13 20:40:23.185415 | instance | "delta": "0:00:00.005168", 2026-04-13 20:40:23.185439 | instance | "end": "2026-04-13 20:40:22.865308", 2026-04-13 20:40:23.185460 | instance | "msg": "non-zero return code", 2026-04-13 20:40:23.185480 | instance | "rc": 1, 2026-04-13 20:40:23.185499 | instance | "start": "2026-04-13 20:40:22.860140" 2026-04-13 20:40:23.185519 | instance | } 2026-04-13 20:40:23.185545 | instance | ERROR: Ignoring Errors 2026-04-13 20:40:23.191281 | 2026-04-13 20:40:23.191358 | TASK [gather-selenium-data : Downloads logs to executor] 2026-04-13 20:40:23.660359 | instance | changed: cd+++++++++ selenium/ 2026-04-13 20:40:23.668374 | 2026-04-13 20:40:23.668476 | PLAY RECAP 2026-04-13 20:40:23.668537 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-04-13 20:40:23.668567 | 2026-04-13 20:40:23.792219 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-04-13 20:40:23.804094 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:40:24.455931 | 2026-04-13 20:40:24.456126 | PLAY [all] 2026-04-13 20:40:24.471890 | 2026-04-13 20:40:24.472086 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-13 20:40:24.517738 | instance | skipping: Conditional result was False 2026-04-13 20:40:24.529015 | 2026-04-13 20:40:24.529237 | TASK [fetch-output : Set log path for single node] 2026-04-13 20:40:24.573641 | instance | ok 2026-04-13 20:40:24.578541 | 2026-04-13 20:40:24.578663 | LOOP [fetch-output : Ensure local output dirs] 2026-04-13 20:40:24.964644 | instance -> localhost | ok: "/var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/logs" 2026-04-13 20:40:25.277813 | instance -> localhost | changed: "/var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/artifacts" 2026-04-13 20:40:25.508192 | instance -> localhost | changed: "/var/lib/zuul/builds/5781143f29f1428c9450202f82fd582c/work/docs" 2026-04-13 20:40:25.524372 | 2026-04-13 20:40:25.524788 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-13 20:40:26.184026 | instance | changed: .d..t...... ./ 2026-04-13 20:40:26.184322 | instance | changed: All items complete 2026-04-13 20:40:26.184368 | 2026-04-13 20:40:26.640241 | instance | changed: .d..t...... ./ 2026-04-13 20:40:31.575043 | instance | changed: .d..t...... ./ 2026-04-13 20:40:31.601313 | 2026-04-13 20:40:31.602270 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-13 20:40:32.812779 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.005877 2026-04-13 20:40:33.042530 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006860 2026-04-13 20:40:33.059836 | 2026-04-13 20:40:33.059926 | PLAY [all] 2026-04-13 20:40:33.066589 | 2026-04-13 20:40:33.066669 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-13 20:40:33.523667 | instance | changed 2026-04-13 20:40:33.531632 | 2026-04-13 20:40:33.531703 | PLAY RECAP 2026-04-13 20:40:33.531766 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-13 20:40:33.531796 | 2026-04-13 20:40:33.654688 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-13 20:40:33.668568 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-13 20:40:34.273025 | 2026-04-13 20:40:34.273155 | PLAY [localhost] 2026-04-13 20:40:34.283077 | 2026-04-13 20:40:34.283169 | TASK [Generate Zuul manifest] 2026-04-13 20:40:34.302979 | localhost | ok 2026-04-13 20:40:34.318222 | 2026-04-13 20:40:34.318342 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-13 20:40:34.694238 | localhost | changed 2026-04-13 20:40:34.705992 | 2026-04-13 20:40:34.706084 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-13 20:40:34.779266 | localhost | ok 2026-04-13 20:40:34.787968 | 2026-04-13 20:40:34.788050 | TASK [Upload logs] 2026-04-13 20:40:34.809649 | localhost | ok 2026-04-13 20:40:34.905268 | 2026-04-13 20:40:34.905392 | TASK [Set zuul-log-path fact] 2026-04-13 20:40:34.926850 | localhost | ok 2026-04-13 20:40:34.938005 | 2026-04-13 20:40:34.938079 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-13 20:40:34.969929 | localhost | ok 2026-04-13 20:40:34.977659 | 2026-04-13 20:40:34.977783 | TASK [upload-logs : Create log directories] 2026-04-13 20:40:35.436460 | localhost | changed 2026-04-13 20:40:35.442349 | 2026-04-13 20:40:35.442438 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-13 20:40:35.810571 | localhost -> localhost | ok: Runtime: 0:00:00.005182 2026-04-13 20:40:35.819223 | 2026-04-13 20:40:35.819407 | TASK [upload-logs : Upload logs to log server] 2026-04-13 20:40:36.288885 | localhost | Output suppressed because no_log was given 2026-04-13 20:40:36.293839 | 2026-04-13 20:40:36.293940 | LOOP [upload-logs : Compress console log and json output] 2026-04-13 20:40:36.338516 | localhost | skipping: Conditional result was False 2026-04-13 20:40:36.346315 | localhost | skipping: Conditional result was False 2026-04-13 20:40:36.360355 | 2026-04-13 20:40:36.360504 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-13 20:40:36.410476 | localhost | skipping: Conditional result was False 2026-04-13 20:40:36.410860 | 2026-04-13 20:40:36.414897 | localhost | skipping: Conditional result was False 2026-04-13 20:40:36.433992 | 2026-04-13 20:40:36.434140 | LOOP [upload-logs : Upload console log and json output]