2026-05-19 11:50:26.917969 | Job console starting
2026-05-19 11:50:26.933901 | Updating git repos
2026-05-19 11:50:27.021382 | Cloning repos into workspace
2026-05-19 11:50:31.200472 | Restoring repo states
2026-05-19 11:50:31.221319 | Merging changes
2026-05-19 11:50:33.442407 | Checking out repos
2026-05-19 11:50:33.664613 | Preparing playbooks
2026-05-19 11:50:40.594732 | Running Ansible setup
2026-05-19 11:50:44.538318 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-19 11:50:45.210066 | 
2026-05-19 11:50:45.210236 | PLAY [localhost]
2026-05-19 11:50:45.218341 | 
2026-05-19 11:50:45.218432 | TASK [Gathering Facts]
2026-05-19 11:50:46.197738 | localhost | ok
2026-05-19 11:50:46.206441 | 
2026-05-19 11:50:46.206630 | TASK [Setup log path fact]
2026-05-19 11:50:46.229978 | localhost | ok
2026-05-19 11:50:46.242982 | 
2026-05-19 11:50:46.243104 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-19 11:50:46.277730 | localhost | ok
2026-05-19 11:50:46.283657 | 
2026-05-19 11:50:46.283726 | TASK [emit-job-header : Print job information]
2026-05-19 11:50:46.322167 | # Job Information
2026-05-19 11:50:46.322316 | Ansible Version: 2.16.18
2026-05-19 11:50:46.322356 | Job: atmosphere-molecule-aio-openvswitch
2026-05-19 11:50:46.322378 | Pipeline: check
2026-05-19 11:50:46.322399 | Executor: 2d72f0692154
2026-05-19 11:50:46.322418 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3929
2026-05-19 11:50:46.322440 | Event ID: c8d37c00-5378-11f1-93c3-61ec54f3ab0e
2026-05-19 11:50:46.325502 | 
2026-05-19 11:50:46.325569 | LOOP [emit-job-header : Print node information]
2026-05-19 11:50:46.418262 | localhost | ok:
2026-05-19 11:50:46.418504 | localhost | # Node Information
2026-05-19 11:50:46.418535 | localhost | Inventory Hostname: instance
2026-05-19 11:50:46.418558 | localhost | Hostname: np0000174714
2026-05-19 11:50:46.418578 | localhost | Username: zuul
2026-05-19 11:50:46.418604 | localhost | Distro: Ubuntu 22.04
2026-05-19 11:50:46.418626 | localhost | Provider: yul1
2026-05-19 11:50:46.418646 | localhost | Region: ca-ymq-1
2026-05-19 11:50:46.418665 | localhost | Label: ubuntu-jammy-16
2026-05-19 11:50:46.418684 | localhost | Product Name: OpenStack Nova
2026-05-19 11:50:46.418703 | localhost | Interface IP: 199.19.213.240
2026-05-19 11:50:46.434110 | 
2026-05-19 11:50:46.434278 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-19 11:50:46.814081 | localhost -> localhost | changed
2026-05-19 11:50:46.820449 | 
2026-05-19 11:50:46.820524 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-19 11:50:47.761577 | localhost -> localhost | changed
2026-05-19 11:50:47.770744 | 
2026-05-19 11:50:47.770831 | PLAY [all]
2026-05-19 11:50:47.781200 | 
2026-05-19 11:50:47.781336 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-19 11:50:48.007682 | instance -> localhost | ok
2026-05-19 11:50:48.015835 | 
2026-05-19 11:50:48.015912 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-19 11:50:48.053494 | instance | ok
2026-05-19 11:50:48.192422 | instance | included: /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-19 11:50:48.200581 | 
2026-05-19 11:50:48.200686 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-19 11:50:48.956410 | instance -> localhost | Generating public/private rsa key pair.
2026-05-19 11:50:48.957004 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/867a1a477e79461a8ec1d410875bcae7_id_rsa
2026-05-19 11:50:48.957170 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/867a1a477e79461a8ec1d410875bcae7_id_rsa.pub
2026-05-19 11:50:48.957200 | instance -> localhost | The key fingerprint is:
2026-05-19 11:50:48.957242 | instance -> localhost | SHA256:Vm6jQBpC6A3baRZlt+2iZVXdBxmDnE8XfKaZlSB+KLc zuul-build-sshkey
2026-05-19 11:50:48.957278 | instance -> localhost | The key's randomart image is:
2026-05-19 11:50:48.957352 | instance -> localhost | +---[RSA 3072]----+
2026-05-19 11:50:48.957509 | instance -> localhost | | .. .o .   +.+B=o|
2026-05-19 11:50:48.957812 | instance -> localhost | |.o .. . o o *.o=*|
2026-05-19 11:50:48.957952 | instance -> localhost | |. * + .. +.+ + Bo|
2026-05-19 11:50:48.958169 | instance -> localhost | | o B +  ooo o =  |
2026-05-19 11:50:48.959073 | instance -> localhost | |  o . .+S.+E     |
2026-05-19 11:50:48.959105 | instance -> localhost | |      +o.o .     |
2026-05-19 11:50:48.959127 | instance -> localhost | |     .  .        |
2026-05-19 11:50:48.959236 | instance -> localhost | |                 |
2026-05-19 11:50:48.959620 | instance -> localhost | |                 |
2026-05-19 11:50:48.959731 | instance -> localhost | +----[SHA256]-----+
2026-05-19 11:50:48.960093 | instance -> localhost | ok: Runtime: 0:00:00.312201
2026-05-19 11:50:48.966810 | 
2026-05-19 11:50:48.966902 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-19 11:50:49.003467 | instance | ok
2026-05-19 11:50:49.024453 | instance | included: /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-19 11:50:49.033871 | 
2026-05-19 11:50:49.033947 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-19 11:50:49.058359 | instance | skipping: Conditional result was False
2026-05-19 11:50:49.178701 | 
2026-05-19 11:50:49.178825 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-19 11:50:49.616438 | instance | changed
2026-05-19 11:50:49.621617 | 
2026-05-19 11:50:49.621682 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-19 11:50:49.815977 | instance | ok
2026-05-19 11:50:49.825206 | 
2026-05-19 11:50:49.825335 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-19 11:50:50.347272 | instance | changed
2026-05-19 11:50:50.352217 | 
2026-05-19 11:50:50.352280 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-19 11:50:50.804939 | instance | changed
2026-05-19 11:50:50.814238 | 
2026-05-19 11:50:50.814334 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-19 11:50:50.839849 | instance | skipping: Conditional result was False
2026-05-19 11:50:50.850084 | 
2026-05-19 11:50:50.850173 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-19 11:50:51.169415 | instance -> localhost | changed
2026-05-19 11:50:51.182400 | 
2026-05-19 11:50:51.182476 | TASK [add-build-sshkey : Add back temp key]
2026-05-19 11:50:51.485698 | instance -> localhost | Identity added: /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/867a1a477e79461a8ec1d410875bcae7_id_rsa (zuul-build-sshkey)
2026-05-19 11:50:51.486352 | instance -> localhost | ok: Runtime: 0:00:00.016357
2026-05-19 11:50:51.494279 | 
2026-05-19 11:50:51.494367 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-19 11:50:51.753349 | instance | ok
2026-05-19 11:50:51.760266 | 
2026-05-19 11:50:51.760363 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-19 11:50:51.785371 | instance | skipping: Conditional result was False
2026-05-19 11:50:51.804546 | 
2026-05-19 11:50:51.804639 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-19 11:50:52.115025 | instance | ok
2026-05-19 11:50:52.121640 | 
2026-05-19 11:50:52.121708 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-19 11:50:54.256538 | instance | Output suppressed because no_log was given
2026-05-19 11:50:54.266255 | 
2026-05-19 11:50:54.266327 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-19 11:50:54.456226 | instance | ok: "logs"
2026-05-19 11:50:54.456486 | instance | ok: All items complete
2026-05-19 11:50:54.456514 | 
2026-05-19 11:50:54.620081 | instance | ok: "artifacts"
2026-05-19 11:50:54.767122 | instance | ok: "docs"
2026-05-19 11:50:54.777798 | 
2026-05-19 11:50:54.777966 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-19 11:50:54.964586 | instance | changed: "logs"
2026-05-19 11:50:55.117549 | instance | changed: "artifacts"
2026-05-19 11:50:55.274189 | instance | changed: "docs"
2026-05-19 11:50:55.289848 | 
2026-05-19 11:50:55.289966 | PLAY RECAP
2026-05-19 11:50:55.290016 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-19 11:50:55.290045 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-19 11:50:55.290068 | 
2026-05-19 11:50:55.445476 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-19 11:50:55.452800 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-19 11:50:56.099286 | 
2026-05-19 11:50:56.099445 | PLAY [all]
2026-05-19 11:50:56.111415 | 
2026-05-19 11:50:56.111502 | TASK [setup-uv : Extract archive]
2026-05-19 11:50:58.428075 | instance | changed
2026-05-19 11:50:58.435807 | 
2026-05-19 11:50:58.435893 | TASK [setup-uv : Print version]
2026-05-19 11:50:58.780159 | instance | uv 0.8.13
2026-05-19 11:50:58.973627 | instance | ok: Runtime: 0:00:00.011540
2026-05-19 11:50:58.983031 | 
2026-05-19 11:50:58.983080 | PLAY RECAP
2026-05-19 11:50:58.983128 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-19 11:50:58.983153 | 
2026-05-19 11:50:59.146870 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-19 11:50:59.156360 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2024.2]
2026-05-19 11:50:59.792542 | 
2026-05-19 11:50:59.792682 | PLAY [all]
2026-05-19 11:50:59.804103 | 
2026-05-19 11:50:59.804186 | TASK [Install "jq" for log collection]
2026-05-19 11:51:09.511806 | instance | changed
2026-05-19 11:51:09.514398 | 
2026-05-19 11:51:09.514499 | PLAY RECAP
2026-05-19 11:51:09.514633 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-19 11:51:09.514712 | 
2026-05-19 11:51:09.665110 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2024.2]
2026-05-19 11:51:09.676506 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-19 11:51:10.339897 | 
2026-05-19 11:51:10.340057 | PLAY [all]
2026-05-19 11:51:10.351694 | 
2026-05-19 11:51:10.351777 | TASK [Copy inventory file for Zuul]
2026-05-19 11:51:11.216250 | instance | changed
2026-05-19 11:51:11.224150 | 
2026-05-19 11:51:11.224237 | TASK [Switch "ansible_host" to private IP]
2026-05-19 11:51:11.551263 | instance | changed: 1 replacements made
2026-05-19 11:51:11.557061 | 
2026-05-19 11:51:11.557141 | TASK [Run Molecule scenario]
2026-05-19 11:51:11.993703 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-05-19 11:51:11.993844 | instance | Creating virtual environment at: .venv
2026-05-19 11:51:12.021043 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-05-19 11:51:12.050292 | instance | Downloading cryptography (4.2MiB)
2026-05-19 11:51:12.050560 | instance | Downloading openstacksdk (1.7MiB)
2026-05-19 11:51:12.051131 | instance | Downloading ansible-core (2.1MiB)
2026-05-19 11:51:12.052418 | instance | Downloading pygments (1.2MiB)
2026-05-19 11:51:12.053653 | instance | Downloading kubernetes (1.9MiB)
2026-05-19 11:51:12.053888 | instance | Downloading setuptools (1.1MiB)
2026-05-19 11:51:12.054860 | instance | Downloading rjsonnet (1.2MiB)
2026-05-19 11:51:12.055115 | instance | Downloading netaddr (2.2MiB)
2026-05-19 11:51:12.369878 | instance |  Downloading rjsonnet
2026-05-19 11:51:12.372611 | instance |    Building pyperclip==1.9.0
2026-05-19 11:51:12.534143 | instance |  Downloading netaddr
2026-05-19 11:51:12.546058 | instance |  Downloading pygments
2026-05-19 11:51:12.560950 | instance |  Downloading cryptography
2026-05-19 11:51:12.600226 | instance |  Downloading setuptools
2026-05-19 11:51:12.664989 | instance |  Downloading kubernetes
2026-05-19 11:51:12.704706 | instance |  Downloading ansible-core
2026-05-19 11:51:12.751500 | instance |  Downloading openstacksdk
2026-05-19 11:51:13.104540 | instance |       Built pyperclip==1.9.0
2026-05-19 11:51:13.312913 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-05-19 11:51:13.357659 | instance | Installed 79 packages in 42ms
2026-05-19 11:51:14.003996 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-05-19 11:51:14.611490 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-05-19 11:51:14.611582 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-05-19 11:51:43.884914 | instance | WARNING  Retrying execution failure 1 of: ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0
2026-05-19 11:51:43.885026 | instance | ERROR    Command ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0, returned 1 code:
2026-05-19 11:51:43.885039 | instance | Starting galaxy collection install process
2026-05-19 11:51:43.885049 | instance | Process install dependency map
2026-05-19 11:51:43.885059 | instance | Starting collection install process
2026-05-19 11:51:43.885085 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/vexxhost-ceph-3.2.0.tar.gz to /home/zuul/.ansible/tmp/ansible-local-1411_mows9zb/tmp_2fz5wy7/vexxhost-ceph-3.2.0-0xoi8jvh
2026-05-19 11:51:43.885097 | instance |
2026-05-19 11:51:43.885107 | instance | ansible-galaxy
2026-05-19 11:51:43.885116 | instance |   config file = None
2026-05-19 11:51:43.885125 | instance |   configured module search path =
2026-05-19 11:51:43.885134 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-05-19 11:51:43.885145 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-05-19 11:51:43.885173 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-05-19 11:51:43.885182 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32)  (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-05-19 11:51:43.885192 | instance |   jinja version = 3.1.6
2026-05-19 11:51:43.885201 | instance |   libyaml = True
2026-05-19 11:51:43.885210 | instance | No config file found; using defaults
2026-05-19 11:51:43.885219 | instance | : Collection ansible.netcommon does not support Ansible version
2026-05-19 11:51:43.885234 | instance | 2.17.12
2026-05-19 11:51:43.885244 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-05-19 11:51:43.885253 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-05-19 11:51:43.885282 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-05-19 11:51:43.885293 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-05-19 11:51:43.885302 | instance | Found installed collection ansible.utils:6.0.2 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-05-19 11:51:43.885311 | instance | Found installed collection openstack.cloud:2.5.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-05-19 11:51:43.885320 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-05-19 11:51:43.885329 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-05-19 11:51:43.885338 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-05-19 11:51:43.885347 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-05-19 11:51:43.885609 | instance |
2026-05-19 11:51:43.886283 | instance | Traceback (most recent call last):
2026-05-19 11:51:43.886501 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-05-19 11:51:43.886857 | instance |     sys.exit(main())
2026-05-19 11:51:43.887063 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-05-19 11:51:43.887571 | instance |     return self.main(*args, **kwargs)
2026-05-19 11:51:43.887767 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-05-19 11:51:43.888239 | instance |     rv = self.invoke(ctx)
2026-05-19 11:51:43.888451 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-05-19 11:51:43.889012 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-05-19 11:51:43.889223 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-05-19 11:51:43.889674 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-05-19 11:51:43.889860 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-05-19 11:51:43.890223 | instance |     return callback(*args, **kwargs)
2026-05-19 11:51:43.890453 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-05-19 11:51:43.890803 | instance |     return func(*args, **kwargs)
2026-05-19 11:51:43.890997 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-05-19 11:51:43.891249 | instance |     return f(get_current_context(), *args, **kwargs)
2026-05-19 11:51:43.891461 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-05-19 11:51:43.891775 | instance |     return func(ctx)
2026-05-19 11:51:43.891961 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-05-19 11:51:43.892243 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-05-19 11:51:43.892456 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-05-19 11:51:43.892965 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-05-19 11:51:43.893162 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 240, in _run_scenarios
2026-05-19 11:51:43.893471 | instance |     scenario.config.runtime.prepare_environment(
2026-05-19 11:51:43.893670 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 694, in prepare_environment
2026-05-19 11:51:43.894047 | instance |     self.install_collection(
2026-05-19 11:51:43.894265 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 552, in install_collection
2026-05-19 11:51:43.894617 | instance |     raise InvalidPrerequisiteError(msg)
2026-05-19 11:51:43.896496 | instance | ansible_compat.errors.InvalidPrerequisiteError: Command ansible-galaxy collection install -vvv vexxhost.ceph:>=3.2.0, returned 1 code:
2026-05-19 11:51:43.896516 | instance | Starting galaxy collection install process
2026-05-19 11:51:43.896524 | instance | Process install dependency map
2026-05-19 11:51:43.896531 | instance | Starting collection install process
2026-05-19 11:51:43.896539 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/vexxhost-ceph-3.2.0.tar.gz to /home/zuul/.ansible/tmp/ansible-local-1411_mows9zb/tmp_2fz5wy7/vexxhost-ceph-3.2.0-0xoi8jvh
2026-05-19 11:51:43.896548 | instance |
2026-05-19 11:51:43.896555 | instance | ansible-galaxy [core 2.17.12]
2026-05-19 11:51:43.896562 | instance |   config file = None
2026-05-19 11:51:43.896598 | instance |   configured module search path = ['/home/zuul/src/github.com/vexxhost/atmosphere/plugins/modules', '/home/zuul/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
2026-05-19 11:51:43.896607 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-05-19 11:51:43.896615 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-05-19 11:51:43.896626 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-05-19 11:51:43.896633 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32) [GCC 11.4.0] (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-05-19 11:51:43.896641 | instance |   jinja version = 3.1.6
2026-05-19 11:51:43.896649 | instance |   libyaml = True
2026-05-19 11:51:43.896657 | instance | No config file found; using defaults
2026-05-19 11:51:43.896666 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-05-19 11:51:43.896675 | instance | 2.17.12
2026-05-19 11:51:43.896683 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-05-19 11:51:43.896690 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-05-19 11:51:43.896697 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-05-19 11:51:43.896704 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-05-19 11:51:43.896711 | instance | Found installed collection ansible.utils:6.0.2 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-05-19 11:51:43.896718 | instance | Found installed collection openstack.cloud:2.5.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-05-19 11:51:43.896725 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-05-19 11:51:43.896732 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-05-19 11:51:43.896744 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-05-19 11:51:43.896752 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-05-19 11:51:43.896888 | instance |
2026-05-19 11:51:44.158898 | instance | ERROR
2026-05-19 11:51:44.159316 | instance | {
2026-05-19 11:51:44.159358 | instance |   "delta": "0:00:32.061464",
2026-05-19 11:51:44.159387 | instance |   "end": "2026-05-19 11:51:43.985399",
2026-05-19 11:51:44.159415 | instance |   "msg": "non-zero return code",
2026-05-19 11:51:44.159441 | instance |   "rc": 1,
2026-05-19 11:51:44.159469 | instance |   "start": "2026-05-19 11:51:11.923935"
2026-05-19 11:51:44.159495 | instance | }
failure
2026-05-19 11:51:44.162799 | 
2026-05-19 11:51:44.162868 | PLAY RECAP
2026-05-19 11:51:44.162933 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-05-19 11:51:44.162988 | 
2026-05-19 11:51:44.317775 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-19 11:51:44.329441 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2024.2]
2026-05-19 11:51:44.983523 | 
2026-05-19 11:51:44.983670 | PLAY [all]
2026-05-19 11:51:44.998405 | 
2026-05-19 11:51:44.998485 | TASK [gather-host-logs : creating directory for system status]
2026-05-19 11:51:45.364771 | instance | changed
2026-05-19 11:51:45.372412 | 
2026-05-19 11:51:45.372518 | TASK [gather-host-logs : Get logs for each host]
2026-05-19 11:51:45.755242 | instance | + systemd-cgls --full --all --no-pager
2026-05-19 11:51:45.768489 | instance | + ip addr
2026-05-19 11:51:45.770016 | instance | + ip route
2026-05-19 11:51:45.771283 | instance | + lsblk
2026-05-19 11:51:45.773524 | instance | + mount
2026-05-19 11:51:45.774954 | instance | + docker images
2026-05-19 11:51:45.775384 | instance | /bin/bash: line 7: docker: command not found
2026-05-19 11:51:45.775584 | instance | + brctl show
2026-05-19 11:51:45.775985 | instance | /bin/bash: line 8: brctl: command not found
2026-05-19 11:51:45.776154 | instance | + ps aux --sort=-%mem
2026-05-19 11:51:45.786798 | instance | + dpkg -l
2026-05-19 11:51:45.799281 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-05-19 11:51:45.799847 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-05-19 11:51:45.799884 | instance | /bin/bash: line 11: docker: command not found
2026-05-19 11:51:45.800256 | instance | + '[' '!' -z '' ']'
2026-05-19 11:51:45.914229 | instance | ok: Runtime: 0:00:00.051258
2026-05-19 11:51:45.922722 | 
2026-05-19 11:51:45.922823 | TASK [gather-host-logs : Downloads logs to executor]
2026-05-19 11:51:46.575127 | instance | changed:
2026-05-19 11:51:46.575417 | instance | created directory /var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/logs/instance
2026-05-19 11:51:46.575536 | instance | cd+++++++++ system/
2026-05-19 11:51:46.575613 | instance | >f+++++++++ system/brctl-show.txt
2026-05-19 11:51:46.575689 | instance | >f+++++++++ system/docker-images.txt
2026-05-19 11:51:46.575759 | instance | >f+++++++++ system/ip-addr.txt
2026-05-19 11:51:46.575813 | instance | >f+++++++++ system/ip-route.txt
2026-05-19 11:51:46.575881 | instance | >f+++++++++ system/lsblk.txt
2026-05-19 11:51:46.575978 | instance | >f+++++++++ system/mount.txt
2026-05-19 11:51:46.576067 | instance | >f+++++++++ system/packages.txt
2026-05-19 11:51:46.576117 | instance | >f+++++++++ system/ps.txt
2026-05-19 11:51:46.576160 | instance | >f+++++++++ system/systemd-cgls.txt
2026-05-19 11:51:46.586792 | 
2026-05-19 11:51:46.586869 | LOOP [helm-release-status : creating directory for helm release status]
2026-05-19 11:51:46.792463 | instance | changed: "values"
2026-05-19 11:51:46.961839 | instance | changed: "releases"
2026-05-19 11:51:46.979155 | 
2026-05-19 11:51:46.979326 | TASK [helm-release-status : Gather get release status for helm charts]
2026-05-19 11:51:47.199081 | instance | /bin/bash: line 3: kubectl: command not found
2026-05-19 11:51:47.526285 | instance | ok: Runtime: 0:00:00.006976
2026-05-19 11:51:47.569991 | 
2026-05-19 11:51:47.570140 | TASK [helm-release-status : Downloads logs to executor]
2026-05-19 11:51:48.062696 | instance | changed:
2026-05-19 11:51:48.062970 | instance | cd+++++++++ helm/
2026-05-19 11:51:48.063029 | instance | cd+++++++++ helm/releases/
2026-05-19 11:51:48.063075 | instance | cd+++++++++ helm/values/
2026-05-19 11:51:48.072664 | 
2026-05-19 11:51:48.072746 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-05-19 11:51:48.282943 | instance | changed
2026-05-19 11:51:48.288318 | 
2026-05-19 11:51:48.288389 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-05-19 11:51:48.507030 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-05-19 11:51:48.507155 | instance |
2026-05-19 11:51:48.511951 | instance | environment: line 1: kubectl: command not found
2026-05-19 11:51:48.513574 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-05-19 11:51:48.514422 | instance | environment: line 1: kubectl: command not found
2026-05-19 11:51:48.515435 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-05-19 11:51:48.516312 | instance | environment: line 1: kubectl: command not found
2026-05-19 11:51:48.518024 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-05-19 11:51:48.519328 | instance | environment: line 1: kubectl: command not found
2026-05-19 11:51:48.520351 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-05-19 11:51:48.520902 | instance | environment: line 1: kubectl: command not found
2026-05-19 11:51:48.521725 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-05-19 11:51:48.827208 | instance | ok: Runtime: 0:00:00.025417
2026-05-19 11:51:48.832823 | 
2026-05-19 11:51:48.832890 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-05-19 11:51:49.029819 | instance | changed
2026-05-19 11:51:49.035354 | 
2026-05-19 11:51:49.035427 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-05-19 11:51:49.242580 | instance | environment: line 5: kubectl: command not found
2026-05-19 11:51:49.243134 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-05-19 11:51:49.244045 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-05-19 11:51:49.244061 | instance |
2026-05-19 11:51:49.574295 | instance | ok: Runtime: 0:00:00.010024
2026-05-19 11:51:49.580544 | 
2026-05-19 11:51:49.580612 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-05-19 11:51:50.070958 | instance | changed:
2026-05-19 11:51:50.071182 | instance | cd+++++++++ objects/
2026-05-19 11:51:50.071210 | instance | cd+++++++++ objects/cluster/
2026-05-19 11:51:50.071232 | instance | cd+++++++++ objects/namespaced/
2026-05-19 11:51:50.080581 | 
2026-05-19 11:51:50.080668 | TASK [gather-pod-logs : creating directory for pod logs]
2026-05-19 11:51:50.278853 | instance | changed
2026-05-19 11:51:50.285524 | 
2026-05-19 11:51:50.285593 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-05-19 11:51:50.483120 | instance | changed
2026-05-19 11:51:50.490322 | 
2026-05-19 11:51:50.490393 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-05-19 11:51:50.715867 | instance | environment: line 3: kubectl: command not found
2026-05-19 11:51:51.028879 | instance | ok: Runtime: 0:00:00.009753
2026-05-19 11:51:51.034650 | 
2026-05-19 11:51:51.034774 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-05-19 11:51:51.566982 | instance | changed:
2026-05-19 11:51:51.567175 | instance | cd+++++++++ pod-logs/
2026-05-19 11:51:51.567202 | instance | cd+++++++++ pod-logs/failed-pods/
2026-05-19 11:51:51.576538 | 
2026-05-19 11:51:51.576651 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-05-19 11:51:51.786815 | instance | changed
2026-05-19 11:51:51.792980 | 
2026-05-19 11:51:51.793055 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-05-19 11:51:52.007740 | instance | /bin/bash: line 2: kubectl: command not found
2026-05-19 11:51:52.331334 | instance | ok: Runtime: 0:00:00.036068
2026-05-19 11:51:52.336239 | 
2026-05-19 11:51:52.336306 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-05-19 11:51:52.543732 | instance | /bin/bash: line 2: kubectl: command not found
2026-05-19 11:51:52.571744 | instance | ceph-mgr endpoints:
2026-05-19 11:51:52.869099 | instance | ok: Runtime: 0:00:00.034721
2026-05-19 11:51:52.875256 | 
2026-05-19 11:51:52.875341 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-05-19 11:51:53.093972 | instance | /bin/bash: line 4: kubectl: command not found
2026-05-19 11:51:53.409927 | instance | ok: Runtime: 0:00:00.035207
2026-05-19 11:51:53.459241 | 
2026-05-19 11:51:53.459399 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-05-19 11:51:53.958414 | instance | changed: cd+++++++++ prometheus/
2026-05-19 11:51:53.972600 | 
2026-05-19 11:51:53.972785 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-05-19 11:51:54.180434 | instance | changed
2026-05-19 11:51:54.187458 | 
2026-05-19 11:51:54.187548 | TASK [gather-selenium-data : Get selenium data]
2026-05-19 11:51:54.424755 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-05-19 11:51:54.426329 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-05-19 11:51:54.725727 | instance | ERROR
2026-05-19 11:51:54.725980 | instance | {
2026-05-19 11:51:54.726028 | instance |   "delta": "0:00:00.007204",
2026-05-19 11:51:54.726058 | instance |   "end": "2026-05-19 11:51:54.426809",
2026-05-19 11:51:54.726085 | instance |   "msg": "non-zero return code",
2026-05-19 11:51:54.726111 | instance |   "rc": 1,
2026-05-19 11:51:54.726137 | instance |   "start": "2026-05-19 11:51:54.419605"
2026-05-19 11:51:54.726163 | instance | }
2026-05-19 11:51:54.726198 | instance | ERROR: Ignoring Errors
2026-05-19 11:51:54.732496 | 
2026-05-19 11:51:54.732564 | TASK [gather-selenium-data : Downloads logs to executor]
2026-05-19 11:51:55.222464 | instance | changed: cd+++++++++ selenium/
2026-05-19 11:51:55.229883 | 
2026-05-19 11:51:55.229937 | PLAY RECAP
2026-05-19 11:51:55.229984 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-05-19 11:51:55.230006 | 
2026-05-19 11:51:55.359933 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2024.2]
2026-05-19 11:51:55.372884 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-19 11:51:56.009545 | 
2026-05-19 11:51:56.009687 | PLAY [all]
2026-05-19 11:51:56.021375 | 
2026-05-19 11:51:56.021481 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-19 11:51:56.057689 | instance | skipping: Conditional result was False
2026-05-19 11:51:56.066547 | 
2026-05-19 11:51:56.066636 | TASK [fetch-output : Set log path for single node]
2026-05-19 11:51:56.109135 | instance | ok
2026-05-19 11:51:56.116034 | 
2026-05-19 11:51:56.116107 | LOOP [fetch-output : Ensure local output dirs]
2026-05-19 11:51:56.564950 | instance -> localhost | ok: "/var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/logs"
2026-05-19 11:51:56.774060 | instance -> localhost | changed: "/var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/artifacts"
2026-05-19 11:51:56.991602 | instance -> localhost | changed: "/var/lib/zuul/builds/867a1a477e79461a8ec1d410875bcae7/work/docs"
2026-05-19 11:51:57.005981 | 
2026-05-19 11:51:57.006150 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-19 11:51:57.636275 | instance | changed: .d..t...... ./
2026-05-19 11:51:57.636501 | instance | changed: All items complete
2026-05-19 11:51:57.636529 | 
2026-05-19 11:51:58.092217 | instance | changed: .d..t...... ./
2026-05-19 11:51:58.550013 | instance | changed: .d..t...... ./
2026-05-19 11:51:58.588406 | 
2026-05-19 11:51:58.588562 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-19 11:51:59.046332 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.008469
2026-05-19 11:51:59.266857 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007442
2026-05-19 11:51:59.282754 | 
2026-05-19 11:51:59.282919 | PLAY [all]
2026-05-19 11:51:59.289805 | 
2026-05-19 11:51:59.289875 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-19 11:51:59.711811 | instance | changed
2026-05-19 11:51:59.717587 | 
2026-05-19 11:51:59.717649 | PLAY RECAP
2026-05-19 11:51:59.717695 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-19 11:51:59.717717 | 
2026-05-19 11:51:59.902103 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-19 11:51:59.917799 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-19 11:52:00.556704 | 
2026-05-19 11:52:00.556851 | PLAY [localhost]
2026-05-19 11:52:00.567366 | 
2026-05-19 11:52:00.567442 | TASK [Generate Zuul manifest]
2026-05-19 11:52:00.589391 | localhost | ok
2026-05-19 11:52:00.605021 | 
2026-05-19 11:52:00.605120 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-19 11:52:00.982865 | localhost | changed
2026-05-19 11:52:00.996895 | 
2026-05-19 11:52:00.997087 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-19 11:52:01.029107 | localhost | ok
2026-05-19 11:52:01.038904 | 
2026-05-19 11:52:01.039132 | TASK [Upload logs]
2026-05-19 11:52:01.061686 | localhost | ok
2026-05-19 11:52:01.169934 | 
2026-05-19 11:52:01.170080 | TASK [Set zuul-log-path fact]
2026-05-19 11:52:01.192793 | localhost | ok
2026-05-19 11:52:01.206223 | 
2026-05-19 11:52:01.206325 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-19 11:52:01.239446 | localhost | ok
2026-05-19 11:52:01.247721 | 
2026-05-19 11:52:01.247799 | TASK [upload-logs : Create log directories]
2026-05-19 11:52:01.601365 | localhost | changed
2026-05-19 11:52:01.607779 | 
2026-05-19 11:52:01.607851 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-19 11:52:01.979269 | localhost -> localhost | ok: Runtime: 0:00:00.006247
2026-05-19 11:52:01.986596 | 
2026-05-19 11:52:01.986759 | TASK [upload-logs : Upload logs to log server]
2026-05-19 11:52:02.480432 | localhost | Output suppressed because no_log was given
2026-05-19 11:52:02.485674 | 
2026-05-19 11:52:02.485767 | LOOP [upload-logs : Compress console log and json output]
2026-05-19 11:52:02.535241 | localhost | skipping: Conditional result was False
2026-05-19 11:52:02.545577 | localhost | skipping: Conditional result was False
2026-05-19 11:52:02.561301 | 
2026-05-19 11:52:02.561624 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-19 11:52:02.606416 | localhost | skipping: Conditional result was False
2026-05-19 11:52:02.606890 | 
2026-05-19 11:52:02.610148 | localhost | skipping: Conditional result was False
2026-05-19 11:52:02.625440 | 
2026-05-19 11:52:02.625587 | LOOP [upload-logs : Upload console log and json output]