2026-03-06 00:24:26.084546 | Job console starting
2026-03-06 00:24:26.352888 | Updating git repos
2026-03-06 00:24:26.729273 | Cloning repos into workspace
2026-03-06 00:24:27.268634 | Restoring repo states
2026-03-06 00:24:27.329316 | Merging changes
2026-03-06 00:24:29.722069 | Checking out repos
2026-03-06 00:24:30.144584 | Preparing playbooks
2026-03-06 00:24:43.421917 | Running Ansible setup
2026-03-06 00:24:47.216169 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-06 00:24:47.879976 | 
2026-03-06 00:24:47.880121 | PLAY [localhost]
2026-03-06 00:24:47.890371 | 
2026-03-06 00:24:47.890510 | TASK [Gathering Facts]
2026-03-06 00:24:49.105257 | localhost | ok
2026-03-06 00:24:49.117050 | 
2026-03-06 00:24:49.117166 | TASK [Setup log path fact]
2026-03-06 00:24:49.137305 | localhost | ok
2026-03-06 00:24:49.170591 | 
2026-03-06 00:24:49.170702 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-06 00:24:49.211207 | localhost | ok
2026-03-06 00:24:49.220399 | 
2026-03-06 00:24:49.220476 | TASK [emit-job-header : Print job information]
2026-03-06 00:24:49.259869 | # Job Information
2026-03-06 00:24:49.260074 | Ansible Version: 2.16.16
2026-03-06 00:24:49.260107 | Job: atmosphere-molecule-aio-ovn
2026-03-06 00:24:49.260130 | Pipeline: check
2026-03-06 00:24:49.260150 | Executor: 0a8996d2b663
2026-03-06 00:24:49.260171 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3726
2026-03-06 00:24:49.260194 | Event ID: b54bc4f0-18f2-11f1-8305-548caa1ebf2c
2026-03-06 00:24:49.263290 | 
2026-03-06 00:24:49.263368 | LOOP [emit-job-header : Print node information]
2026-03-06 00:24:49.359450 | localhost | ok:
2026-03-06 00:24:49.359703 | localhost | # Node Information
2026-03-06 00:24:49.359748 | localhost | Inventory Hostname: instance
2026-03-06 00:24:49.359785 | localhost | Hostname: np0000157973
2026-03-06 00:24:49.359817 | localhost | Username: zuul
2026-03-06 00:24:49.359849 | localhost | Distro: Ubuntu 22.04
2026-03-06 00:24:49.359881 | localhost | Provider: yul1
2026-03-06 00:24:49.359911 | localhost | Region: ca-ymq-1
2026-03-06 00:24:49.359940 | localhost | Label: ubuntu-jammy-16
2026-03-06 00:24:49.359969 | localhost | Product Name: OpenStack Nova
2026-03-06 00:24:49.359999 | localhost | Interface IP: 199.204.45.115
2026-03-06 00:24:49.369022 | 
2026-03-06 00:24:49.392000 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-06 00:24:49.857147 | localhost -> localhost | changed
2026-03-06 00:24:49.865120 | 
2026-03-06 00:24:49.865220 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-06 00:24:50.994674 | localhost -> localhost | changed
2026-03-06 00:24:51.000745 | 
2026-03-06 00:24:51.032385 | PLAY [all]
2026-03-06 00:24:51.063521 | 
2026-03-06 00:24:51.063631 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-06 00:24:51.372584 | instance -> localhost | ok
2026-03-06 00:24:51.383956 | 
2026-03-06 00:24:51.384040 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-06 00:24:51.418688 | instance | ok
2026-03-06 00:24:51.431577 | instance | included: /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-06 00:24:51.452858 | 
2026-03-06 00:24:51.468712 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-06 00:24:52.710120 | instance -> localhost | Generating public/private rsa key pair.
2026-03-06 00:24:52.710317 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/1b84acdf8bfe4a62a6990100ff324c9a_id_rsa
2026-03-06 00:24:52.710360 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/1b84acdf8bfe4a62a6990100ff324c9a_id_rsa.pub
2026-03-06 00:24:52.710394 | instance -> localhost | The key fingerprint is:
2026-03-06 00:24:52.710425 | instance -> localhost | SHA256:EM46zW+pPKO+ZoSQRJgaDrFwAKTZ44s+iHPfhODRCms zuul-build-sshkey
2026-03-06 00:24:52.710476 | instance -> localhost | The key's randomart image is:
2026-03-06 00:24:52.710508 | instance -> localhost | +---[RSA 3072]----+
2026-03-06 00:24:52.710540 | instance -> localhost | |X*.   .          |
2026-03-06 00:24:52.710572 | instance -> localhost | |B*   o .         |
2026-03-06 00:24:52.710603 | instance -> localhost | |Ooo   +          |
2026-03-06 00:24:52.710633 | instance -> localhost | |+o o + .         |
2026-03-06 00:24:52.710663 | instance -> localhost | |..+.+ o S        |
2026-03-06 00:24:52.710693 | instance -> localhost | | =.=.o . .       |
2026-03-06 00:24:52.710723 | instance -> localhost | |=E+.. . +        |
2026-03-06 00:24:52.710753 | instance -> localhost | |*.. o+oo         |
2026-03-06 00:24:52.710786 | instance -> localhost | | +.==o+o         |
2026-03-06 00:24:52.710816 | instance -> localhost | +----[SHA256]-----+
2026-03-06 00:24:52.710880 | instance -> localhost | ok: Runtime: 0:00:00.643897
2026-03-06 00:24:52.717481 | 
2026-03-06 00:24:52.717541 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-06 00:24:52.738773 | instance | ok
2026-03-06 00:24:52.755438 | instance | included: /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-06 00:24:52.781252 | 
2026-03-06 00:24:52.781411 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-06 00:24:52.806617 | instance | skipping: Conditional result was False
2026-03-06 00:24:52.862554 | 
2026-03-06 00:24:52.862676 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-06 00:24:53.311954 | instance | changed
2026-03-06 00:24:53.364699 | 
2026-03-06 00:24:53.364805 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-06 00:24:53.560629 | instance | ok
2026-03-06 00:24:53.568461 | 
2026-03-06 00:24:53.568537 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-06 00:24:54.161350 | instance | changed
2026-03-06 00:24:54.166857 | 
2026-03-06 00:24:54.166928 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-06 00:24:54.638140 | instance | changed
2026-03-06 00:24:54.643124 | 
2026-03-06 00:24:54.643188 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-06 00:24:54.667453 | instance | skipping: Conditional result was False
2026-03-06 00:24:54.677805 | 
2026-03-06 00:24:54.677895 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-06 00:24:55.069337 | instance -> localhost | changed
2026-03-06 00:24:55.144458 | 
2026-03-06 00:24:55.215603 | TASK [add-build-sshkey : Add back temp key]
2026-03-06 00:24:55.534454 | instance -> localhost | Identity added: /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/1b84acdf8bfe4a62a6990100ff324c9a_id_rsa (zuul-build-sshkey)
2026-03-06 00:24:55.534779 | instance -> localhost | ok: Runtime: 0:00:00.014558
2026-03-06 00:24:55.540949 | 
2026-03-06 00:24:55.541040 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-06 00:24:55.842303 | instance | ok
2026-03-06 00:24:55.847346 | 
2026-03-06 00:24:55.847413 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-06 00:24:55.873880 | instance | skipping: Conditional result was False
2026-03-06 00:24:55.889500 | 
2026-03-06 00:24:55.889609 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-06 00:24:56.196360 | instance | ok
2026-03-06 00:24:56.202170 | 
2026-03-06 00:24:56.202257 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-06 00:24:58.218519 | instance | Output suppressed because no_log was given
2026-03-06 00:24:58.232819 | 
2026-03-06 00:24:58.328474 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-06 00:24:58.511459 | instance | ok: "logs"
2026-03-06 00:24:58.511678 | instance | ok: All items complete
2026-03-06 00:24:58.511707 | 
2026-03-06 00:24:58.658823 | instance | ok: "artifacts"
2026-03-06 00:24:58.825220 | instance | ok: "docs"
2026-03-06 00:24:58.833439 | 
2026-03-06 00:24:58.833547 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-06 00:24:59.035491 | instance | changed: "logs"
2026-03-06 00:24:59.188953 | instance | changed: "artifacts"
2026-03-06 00:24:59.350145 | instance | changed: "docs"
2026-03-06 00:24:59.360787 | 
2026-03-06 00:24:59.378278 | PLAY RECAP
2026-03-06 00:24:59.378419 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-06 00:24:59.378490 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 00:24:59.378538 | 
2026-03-06 00:24:59.518952 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-06 00:24:59.527451 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-06 00:25:00.178455 | 
2026-03-06 00:25:00.178571 | PLAY [all]
2026-03-06 00:25:00.190388 | 
2026-03-06 00:25:00.190503 | TASK [setup-uv : Extract archive]
2026-03-06 00:25:02.704202 | instance | changed
2026-03-06 00:25:02.709811 | 
2026-03-06 00:25:02.709906 | TASK [setup-uv : Print version]
2026-03-06 00:25:03.054955 | instance | uv 0.8.13
2026-03-06 00:25:03.308498 | instance | ok: Runtime: 0:00:00.013222
2026-03-06 00:25:03.314239 | 
2026-03-06 00:25:03.314287 | PLAY RECAP
2026-03-06 00:25:03.314331 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 00:25:03.314357 | 
2026-03-06 00:25:03.454375 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-06 00:25:03.463934 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2023.1]
2026-03-06 00:25:04.143042 | 
2026-03-06 00:25:04.195296 | PLAY [all]
2026-03-06 00:25:04.213388 | 
2026-03-06 00:25:04.213508 | TASK [Install "jq" for log collection]
2026-03-06 00:25:15.528018 | instance | changed
2026-03-06 00:25:15.531428 | 
2026-03-06 00:25:15.531493 | PLAY RECAP
2026-03-06 00:25:15.531544 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-06 00:25:15.531593 | 
2026-03-06 00:25:15.662987 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@stable/2023.1]
2026-03-06 00:25:15.675440 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-06 00:25:16.310058 | 
2026-03-06 00:25:16.310200 | PLAY [all]
2026-03-06 00:25:16.322231 | 
2026-03-06 00:25:16.322302 | TASK [Copy inventory file for Zuul]
2026-03-06 00:25:17.220195 | instance | changed
2026-03-06 00:25:17.225759 | 
2026-03-06 00:25:17.225871 | TASK [Switch "ansible_host" to private IP]
2026-03-06 00:25:17.555883 | instance | changed: 1 replacements made
2026-03-06 00:25:17.563976 | 
2026-03-06 00:25:17.564082 | TASK [Run Molecule scenario]
2026-03-06 00:25:18.006975 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-03-06 00:25:18.007092 | instance | Creating virtual environment at: .venv
2026-03-06 00:25:18.034215 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-06 00:25:18.051264 | instance | Downloading setuptools (1.1MiB)
2026-03-06 00:25:18.058014 | instance | Downloading cryptography (4.2MiB)
2026-03-06 00:25:18.059039 | instance | Downloading pygments (1.2MiB)
2026-03-06 00:25:18.059853 | instance | Downloading ansible-core (2.1MiB)
2026-03-06 00:25:18.066053 | instance | Downloading netaddr (2.2MiB)
2026-03-06 00:25:18.067500 | instance | Downloading openstacksdk (1.7MiB)
2026-03-06 00:25:18.115874 | instance | Downloading kubernetes (1.9MiB)
2026-03-06 00:25:18.133000 | instance | Downloading rjsonnet (1.2MiB)
2026-03-06 00:25:18.342136 | instance |    Building pyperclip==1.9.0
2026-03-06 00:25:18.401612 | instance |  Downloading rjsonnet
2026-03-06 00:25:18.499200 | instance |  Downloading netaddr
2026-03-06 00:25:18.518637 | instance |  Downloading pygments
2026-03-06 00:25:18.531998 | instance |  Downloading cryptography
2026-03-06 00:25:18.568556 | instance |  Downloading setuptools
2026-03-06 00:25:18.631544 | instance |  Downloading kubernetes
2026-03-06 00:25:18.665462 | instance |  Downloading ansible-core
2026-03-06 00:25:18.700101 | instance |  Downloading openstacksdk
2026-03-06 00:25:19.064846 | instance |       Built pyperclip==1.9.0
2026-03-06 00:25:19.291055 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-03-06 00:25:19.330046 | instance | Installed 79 packages in 37ms
2026-03-06 00:25:19.987502 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-03-06 00:25:20.556620 | instance | INFO     [aio > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-06 00:25:20.556719 | instance | INFO     [aio > prerun] Performing prerun with role_name_check=0...
2026-03-06 00:25:45.404962 | instance | WARNING  Retrying execution failure 1 of: ansible-galaxy collection install -vvv atmosphere.common:>=0.6.0
2026-03-06 00:25:45.405096 | instance | ERROR    Command ansible-galaxy collection install -vvv atmosphere.common:>=0.6.0, returned 1 code:
2026-03-06 00:25:45.405104 | instance | Starting galaxy collection install process
2026-03-06 00:25:45.405109 | instance | Process install dependency map
2026-03-06 00:25:45.405114 | instance | Starting collection install process
2026-03-06 00:25:45.405119 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/atmosphere-common-0.6.0.tar.gz to /home/zuul/.ansible/tmp/ansible-local-14136jma87yh/tmp4ipzlgts/atmosphere-common-0.6.0-lnakc6_1
2026-03-06 00:25:45.405124 | instance |
2026-03-06 00:25:45.405128 | instance | ansible-galaxy
2026-03-06 00:25:45.405132 | instance |   config file = None
2026-03-06 00:25:45.405137 | instance |   configured module search path =
2026-03-06 00:25:45.405141 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-03-06 00:25:45.405147 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-03-06 00:25:45.405153 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-03-06 00:25:45.405157 | instance |   python version = 3.10.12 (main, Jan 26 2026, 14:55:28)  (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-03-06 00:25:45.405161 | instance |   jinja version = 3.1.6
2026-03-06 00:25:45.405165 | instance |   libyaml = True
2026-03-06 00:25:45.405170 | instance | No config file found; using defaults
2026-03-06 00:25:45.405174 | instance | Found installed collection openstack.cloud:1.7.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-03-06 00:25:45.405178 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-03-06 00:25:45.405182 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-03-06 00:25:45.405201 | instance | Found installed collection ansible.utils:6.0.1 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-03-06 00:25:45.405206 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-03-06 00:25:45.405210 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-03-06 00:25:45.405214 | instance | : Collection ansible.netcommon does not support Ansible version
2026-03-06 00:25:45.405218 | instance | 2.17.12
2026-03-06 00:25:45.405222 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-03-06 00:25:45.405226 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-03-06 00:25:45.405230 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-03-06 00:25:45.405235 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 503: Service Unavailable. HTTP Error 503: Service Unavailable
2026-03-06 00:25:45.405240 | instance |
2026-03-06 00:25:45.405255 | instance | Traceback (most recent call last):
2026-03-06 00:25:45.405543 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-03-06 00:25:45.405974 | instance |     sys.exit(main())
2026-03-06 00:25:45.406266 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-03-06 00:25:45.406939 | instance |     return self.main(*args, **kwargs)
2026-03-06 00:25:45.407231 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-03-06 00:25:45.407864 | instance |     rv = self.invoke(ctx)
2026-03-06 00:25:45.408153 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-03-06 00:25:45.408955 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-03-06 00:25:45.409207 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-03-06 00:25:45.409944 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-03-06 00:25:45.410293 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-03-06 00:25:45.410926 | instance |     return callback(*args, **kwargs)
2026-03-06 00:25:45.411263 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-03-06 00:25:45.411793 | instance |     return func(*args, **kwargs)
2026-03-06 00:25:45.412127 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-03-06 00:25:45.412595 | instance |     return f(get_current_context(), *args, **kwargs)
2026-03-06 00:25:45.412751 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-03-06 00:25:45.412979 | instance |     return func(ctx)
2026-03-06 00:25:45.413135 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-03-06 00:25:45.413388 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-03-06 00:25:45.413563 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-03-06 00:25:45.413768 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-03-06 00:25:45.413981 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 240, in _run_scenarios
2026-03-06 00:25:45.414081 | instance |     scenario.config.runtime.prepare_environment(
2026-03-06 00:25:45.414242 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 694, in prepare_environment
2026-03-06 00:25:45.414752 | instance |     self.install_collection(
2026-03-06 00:25:45.414787 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 552, in install_collection
2026-03-06 00:25:45.415061 | instance |     raise InvalidPrerequisiteError(msg)
2026-03-06 00:25:45.416153 | instance | ansible_compat.errors.InvalidPrerequisiteError: Command ansible-galaxy collection install -vvv atmosphere.common:>=0.6.0, returned 1 code:
2026-03-06 00:25:45.416175 | instance | Starting galaxy collection install process
2026-03-06 00:25:45.416187 | instance | Process install dependency map
2026-03-06 00:25:45.416199 | instance | Starting collection install process
2026-03-06 00:25:45.416212 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/atmosphere-common-0.6.0.tar.gz to /home/zuul/.ansible/tmp/ansible-local-14136jma87yh/tmp4ipzlgts/atmosphere-common-0.6.0-lnakc6_1
2026-03-06 00:25:45.416225 | instance |
2026-03-06 00:25:45.416236 | instance | ansible-galaxy [core 2.17.12]
2026-03-06 00:25:45.416248 | instance |   config file = None
2026-03-06 00:25:45.416260 | instance |   configured module search path = ['/home/zuul/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
2026-03-06 00:25:45.416273 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-03-06 00:25:45.416286 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-03-06 00:25:45.416300 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-03-06 00:25:45.416312 | instance |   python version = 3.10.12 (main, Jan 26 2026, 14:55:28) [GCC 11.4.0] (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-03-06 00:25:45.416323 | instance |   jinja version = 3.1.6
2026-03-06 00:25:45.416335 | instance |   libyaml = True
2026-03-06 00:25:45.416347 | instance | No config file found; using defaults
2026-03-06 00:25:45.416359 | instance | Found installed collection openstack.cloud:1.7.0 at '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-03-06 00:25:45.416370 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-03-06 00:25:45.416381 | instance | Found installed collection community.general:7.3.0 at '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-03-06 00:25:45.416392 | instance | Found installed collection ansible.utils:6.0.1 at '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-03-06 00:25:45.416403 | instance | Found installed collection kubernetes.core:2.4.0 at '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-03-06 00:25:45.416428 | instance | Found installed collection community.mysql:3.6.0 at '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-03-06 00:25:45.416440 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-03-06 00:25:45.416452 | instance | 2.17.12
2026-03-06 00:25:45.416464 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-03-06 00:25:45.416475 | instance | Found installed collection community.crypto:2.2.3 at '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-03-06 00:25:45.416486 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-03-06 00:25:45.416497 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 503: Service Unavailable. HTTP Error 503: Service Unavailable
2026-03-06 00:25:45.416524 | instance |
2026-03-06 00:25:45.681077 | instance | ERROR
2026-03-06 00:25:45.681304 | instance | {
2026-03-06 00:25:45.681346 | instance |   "delta": "0:00:27.542770",
2026-03-06 00:25:45.681375 | instance |   "end": "2026-03-06 00:25:45.486591",
2026-03-06 00:25:45.681404 | instance |   "msg": "non-zero return code",
2026-03-06 00:25:45.681429 | instance |   "rc": 1,
2026-03-06 00:25:45.681456 | instance |   "start": "2026-03-06 00:25:17.943821"
2026-03-06 00:25:45.681481 | instance | }
failure
2026-03-06 00:25:45.684389 | 
2026-03-06 00:25:45.684452 | PLAY RECAP
2026-03-06 00:25:45.684514 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-06 00:25:45.684544 | 
2026-03-06 00:25:45.841013 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-06 00:25:45.851618 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2023.1]
2026-03-06 00:25:46.437934 | 
2026-03-06 00:25:46.438056 | PLAY [all]
2026-03-06 00:25:46.451347 | 
2026-03-06 00:25:46.451425 | TASK [gather-host-logs : creating directory for system status]
2026-03-06 00:25:46.818981 | instance | changed
2026-03-06 00:25:46.828139 | 
2026-03-06 00:25:46.828221 | TASK [gather-host-logs : Get logs for each host]
2026-03-06 00:25:47.158363 | instance | + systemd-cgls --full --all --no-pager
2026-03-06 00:25:47.179467 | instance | + ip addr
2026-03-06 00:25:47.182365 | instance | + ip route
2026-03-06 00:25:47.184545 | instance | + lsblk
2026-03-06 00:25:47.188617 | instance | + mount
2026-03-06 00:25:47.190105 | instance | + docker images
2026-03-06 00:25:47.190524 | instance | /bin/bash: line 7: docker: command not found
2026-03-06 00:25:47.190686 | instance | + brctl show
2026-03-06 00:25:47.191042 | instance | /bin/bash: line 8: brctl: command not found
2026-03-06 00:25:47.191255 | instance | + ps aux --sort=-%mem
2026-03-06 00:25:47.205945 | instance | + dpkg -l
2026-03-06 00:25:47.212832 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-03-06 00:25:47.213238 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-03-06 00:25:47.213256 | instance | /bin/bash: line 11: docker: command not found
2026-03-06 00:25:47.213594 | instance | + '[' '!' -z '' ']'
2026-03-06 00:25:47.366733 | instance | ok: Runtime: 0:00:00.060287
2026-03-06 00:25:47.372998 | 
2026-03-06 00:25:47.373075 | TASK [gather-host-logs : Downloads logs to executor]
2026-03-06 00:25:47.990341 | instance | changed:
2026-03-06 00:25:47.990508 | instance | created directory /var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/logs/instance
2026-03-06 00:25:47.990536 | instance | cd+++++++++ system/
2026-03-06 00:25:47.990558 | instance | >f+++++++++ system/brctl-show.txt
2026-03-06 00:25:47.990579 | instance | >f+++++++++ system/docker-images.txt
2026-03-06 00:25:47.990598 | instance | >f+++++++++ system/ip-addr.txt
2026-03-06 00:25:47.990621 | instance | >f+++++++++ system/ip-route.txt
2026-03-06 00:25:47.990641 | instance | >f+++++++++ system/lsblk.txt
2026-03-06 00:25:47.990660 | instance | >f+++++++++ system/mount.txt
2026-03-06 00:25:47.990681 | instance | >f+++++++++ system/packages.txt
2026-03-06 00:25:47.990700 | instance | >f+++++++++ system/ps.txt
2026-03-06 00:25:47.990719 | instance | >f+++++++++ system/systemd-cgls.txt
2026-03-06 00:25:47.999680 | 
2026-03-06 00:25:47.999749 | LOOP [helm-release-status : creating directory for helm release status]
2026-03-06 00:25:48.199755 | instance | changed: "values"
2026-03-06 00:25:48.380926 | instance | changed: "releases"
2026-03-06 00:25:48.401533 | 
2026-03-06 00:25:48.401752 | TASK [helm-release-status : Gather get release status for helm charts]
2026-03-06 00:25:48.609628 | instance | /bin/bash: line 3: kubectl: command not found
2026-03-06 00:25:48.941596 | instance | ok: Runtime: 0:00:00.006532
2026-03-06 00:25:48.953565 | 
2026-03-06 00:25:48.953642 | TASK [helm-release-status : Downloads logs to executor]
2026-03-06 00:25:49.453763 | instance | changed:
2026-03-06 00:25:49.453959 | instance | cd+++++++++ helm/
2026-03-06 00:25:49.454011 | instance | cd+++++++++ helm/releases/
2026-03-06 00:25:49.454040 | instance | cd+++++++++ helm/values/
2026-03-06 00:25:49.497006 | 
2026-03-06 00:25:49.497156 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-03-06 00:25:49.704537 | instance | changed
2026-03-06 00:25:49.709792 | 
2026-03-06 00:25:49.709867 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-03-06 00:25:49.917774 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-06 00:25:49.918243 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-06 00:25:49.923699 | instance | environment: line 1: kubectl: command not found
2026-03-06 00:25:49.925304 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-06 00:25:49.926219 | instance | environment: line 1: kubectl: command not found
2026-03-06 00:25:49.927938 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-06 00:25:49.929163 | instance | environment: line 1: kubectl: command not found
2026-03-06 00:25:49.930055 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-06 00:25:49.931550 | instance | environment: line 1: kubectl: command not found
2026-03-06 00:25:49.933013 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-06 00:25:49.933685 | instance | environment: line 1: kubectl: command not found
2026-03-06 00:25:49.935225 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-03-06 00:25:50.246073 | instance | ok: Runtime: 0:00:00.027589
2026-03-06 00:25:50.252729 | 
2026-03-06 00:25:50.252794 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-03-06 00:25:50.446670 | instance | changed
2026-03-06 00:25:50.454175 | 
2026-03-06 00:25:50.454268 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-03-06 00:25:50.675202 | instance | environment: line 5: kubectl: command not found
2026-03-06 00:25:50.675789 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-06 00:25:50.677616 | instance | xargs: xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args valuewarning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-03-06 00:25:50.677693 | instance |
2026-03-06 00:25:50.986119 | instance | ok: Runtime: 0:00:00.009894
2026-03-06 00:25:50.992489 | 
2026-03-06 00:25:50.992552 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-03-06 00:25:51.500366 | instance | changed:
2026-03-06 00:25:51.500556 | instance | cd+++++++++ objects/
2026-03-06 00:25:51.500593 | instance | cd+++++++++ objects/cluster/
2026-03-06 00:25:51.500622 | instance | cd+++++++++ objects/namespaced/
2026-03-06 00:25:51.513411 | 
2026-03-06 00:25:51.513500 | TASK [gather-pod-logs : creating directory for pod logs]
2026-03-06 00:25:51.710566 | instance | changed
2026-03-06 00:25:51.717221 | 
2026-03-06 00:25:51.717291 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-03-06 00:25:51.928460 | instance | changed
2026-03-06 00:25:51.935591 | 
2026-03-06 00:25:51.935676 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-03-06 00:25:52.155723 | instance | environment: line 3: kubectl: command not found
2026-03-06 00:25:52.473059 | instance | ok: Runtime: 0:00:00.009027
2026-03-06 00:25:52.478126 | 
2026-03-06 00:25:52.478190 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-03-06 00:25:52.949566 | instance | changed:
2026-03-06 00:25:52.949764 | instance | cd+++++++++ pod-logs/
2026-03-06 00:25:52.949802 | instance | cd+++++++++ pod-logs/failed-pods/
2026-03-06 00:25:52.960995 | 
2026-03-06 00:25:52.961060 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-03-06 00:25:53.156082 | instance | changed
2026-03-06 00:25:53.163035 | 
2026-03-06 00:25:53.163128 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-03-06 00:25:53.382753 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-06 00:25:53.698870 | instance | ok: Runtime: 0:00:00.037472
2026-03-06 00:25:53.704301 | 
2026-03-06 00:25:53.704370 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-03-06 00:25:53.908902 | instance | /bin/bash: line 2: kubectl: command not found
2026-03-06 00:25:53.942770 | instance | ceph-mgr endpoints:
2026-03-06 00:25:54.238069 | instance | ok: Runtime: 0:00:00.041205
2026-03-06 00:25:54.244611 | 
2026-03-06 00:25:54.244702 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-03-06 00:25:54.459012 | instance | /bin/bash: line 4: kubectl: command not found
2026-03-06 00:25:54.781521 | instance | ok: Runtime: 0:00:00.036565
2026-03-06 00:25:54.786980 | 
2026-03-06 00:25:54.787045 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-03-06 00:25:55.271185 | instance | changed: cd+++++++++ prometheus/
2026-03-06 00:25:55.317651 | 
2026-03-06 00:25:55.317782 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-03-06 00:25:55.533716 | instance | changed
2026-03-06 00:25:55.540625 | 
2026-03-06 00:25:55.540714 | TASK [gather-selenium-data : Get selenium data]
2026-03-06 00:25:55.749050 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-03-06 00:25:55.750932 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-03-06 00:25:56.121293 | instance | ERROR
2026-03-06 00:25:56.121605 | instance | {
2026-03-06 00:25:56.121683 | instance |   "delta": "0:00:00.007549",
2026-03-06 00:25:56.121734 | instance |   "end": "2026-03-06 00:25:55.751382",
2026-03-06 00:25:56.121781 | instance |   "msg": "non-zero return code",
2026-03-06 00:25:56.121826 | instance |   "rc": 1,
2026-03-06 00:25:56.121870 | instance |   "start": "2026-03-06 00:25:55.743833"
2026-03-06 00:25:56.121914 | instance | }
2026-03-06 00:25:56.121967 | instance | ERROR: Ignoring Errors
2026-03-06 00:25:56.128672 | 
2026-03-06 00:25:56.128748 | TASK [gather-selenium-data : Downloads logs to executor]
2026-03-06 00:25:56.610601 | instance | changed: cd+++++++++ selenium/
2026-03-06 00:25:56.619549 | 
2026-03-06 00:25:56.619604 | PLAY RECAP
2026-03-06 00:25:56.619649 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-03-06 00:25:56.619670 | 
2026-03-06 00:25:56.729496 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@stable/2023.1]
2026-03-06 00:25:56.744291 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-06 00:25:57.324599 | 
2026-03-06 00:25:57.324773 | PLAY [all]
2026-03-06 00:25:57.335835 | 
2026-03-06 00:25:57.335958 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-06 00:25:57.381083 | instance | skipping: Conditional result was False
2026-03-06 00:25:57.393327 | 
2026-03-06 00:25:57.393407 | TASK [fetch-output : Set log path for single node]
2026-03-06 00:25:57.437526 | instance | ok
2026-03-06 00:25:57.443836 | 
2026-03-06 00:25:57.443901 | LOOP [fetch-output : Ensure local output dirs]
2026-03-06 00:25:57.809044 | instance -> localhost | ok: "/var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/logs"
2026-03-06 00:25:58.041426 | instance -> localhost | changed: "/var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/artifacts"
2026-03-06 00:25:58.313224 | instance -> localhost | changed: "/var/lib/zuul/builds/1b84acdf8bfe4a62a6990100ff324c9a/work/docs"
2026-03-06 00:25:58.334475 | 
2026-03-06 00:25:58.334598 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-06 00:25:58.955889 | instance | changed: .d..t...... ./
2026-03-06 00:25:58.956105 | instance | changed: All items complete
2026-03-06 00:25:58.956134 | 
2026-03-06 00:25:59.400154 | instance | changed: .d..t...... ./
2026-03-06 00:25:59.827935 | instance | changed: .d..t...... ./
2026-03-06 00:25:59.856999 | 
2026-03-06 00:25:59.857130 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-06 00:26:00.301469 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007591
2026-03-06 00:26:00.525760 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007865
2026-03-06 00:26:00.545536 | 
2026-03-06 00:26:00.545595 | PLAY [all]
2026-03-06 00:26:00.551947 | 
2026-03-06 00:26:00.552007 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-06 00:26:00.940444 | instance | changed
2026-03-06 00:26:00.946148 | 
2026-03-06 00:26:00.946198 | PLAY RECAP
2026-03-06 00:26:00.946243 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-06 00:26:00.946265 | 
2026-03-06 00:26:01.065459 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-06 00:26:01.079584 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-06 00:26:01.684392 | 
2026-03-06 00:26:01.684509 | PLAY [localhost]
2026-03-06 00:26:01.694268 | 
2026-03-06 00:26:01.694339 | TASK [Generate Zuul manifest]
2026-03-06 00:26:01.715783 | localhost | ok
2026-03-06 00:26:01.731564 | 
2026-03-06 00:26:01.731638 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-06 00:26:02.097543 | localhost | changed
2026-03-06 00:26:02.109776 | 
2026-03-06 00:26:02.109849 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-06 00:26:02.141154 | localhost | ok
2026-03-06 00:26:02.148408 | 
2026-03-06 00:26:02.148470 | TASK [Upload logs]
2026-03-06 00:26:02.180024 | localhost | ok
2026-03-06 00:26:02.281729 | 
2026-03-06 00:26:02.281952 | TASK [Set zuul-log-path fact]
2026-03-06 00:26:02.306021 | localhost | ok
2026-03-06 00:26:02.317957 | 
2026-03-06 00:26:02.318032 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-06 00:26:02.347316 | localhost | ok
2026-03-06 00:26:02.359123 | 
2026-03-06 00:26:02.359195 | TASK [upload-logs : Create log directories]
2026-03-06 00:26:02.723364 | localhost | changed
2026-03-06 00:26:02.729961 | 
2026-03-06 00:26:02.730031 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-06 00:26:03.077203 | localhost -> localhost | ok: Runtime: 0:00:00.005867
2026-03-06 00:26:03.087228 | 
2026-03-06 00:26:03.087308 | TASK [upload-logs : Upload logs to log server]
2026-03-06 00:26:03.516560 | localhost | Output suppressed because no_log was given
2026-03-06 00:26:03.522143 | 
2026-03-06 00:26:03.522242 | LOOP [upload-logs : Compress console log and json output]
2026-03-06 00:26:03.566297 | localhost | skipping: Conditional result was False
2026-03-06 00:26:03.573022 | localhost | skipping: Conditional result was False
2026-03-06 00:26:03.587621 | 
2026-03-06 00:26:03.587774 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-06 00:26:03.628632 | localhost | skipping: Conditional result was False
2026-03-06 00:26:03.629129 | 
2026-03-06 00:26:03.632752 | localhost | skipping: Conditional result was False
2026-03-06 00:26:03.642662 | 
2026-03-06 00:26:03.642874 | LOOP [upload-logs : Upload console log and json output]