2026-04-16 06:08:05.045051 | Job console starting
2026-04-16 06:08:05.054164 | Updating git repos
2026-04-16 06:08:05.117219 | Cloning repos into workspace
2026-04-16 06:08:15.964343 | Restoring repo states
2026-04-16 06:08:15.984155 | Merging changes
2026-04-16 06:08:18.296229 | Checking out repos
2026-04-16 06:08:19.432042 | Preparing playbooks
2026-04-16 06:08:38.053846 | Running Ansible setup
2026-04-16 06:08:46.321530 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-16 06:08:46.911852 | 
2026-04-16 06:08:46.912447 | PLAY [localhost]
2026-04-16 06:08:46.920611 | 
2026-04-16 06:08:46.920683 | TASK [Gathering Facts]
2026-04-16 06:08:47.830007 | localhost | ok
2026-04-16 06:08:47.842139 | 
2026-04-16 06:08:47.842280 | TASK [Setup log path fact]
2026-04-16 06:08:47.863042 | localhost | ok
2026-04-16 06:08:47.883157 | 
2026-04-16 06:08:47.883315 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-16 06:08:47.910256 | localhost | ok
2026-04-16 06:08:47.918591 | 
2026-04-16 06:08:47.918658 | TASK [emit-job-header : Print job information]
2026-04-16 06:08:47.961994 | # Job Information
2026-04-16 06:08:47.962122 | Ansible Version: 2.16.16
2026-04-16 06:08:47.962154 | Job: atmosphere-molecule-csi-local-path-provisioner
2026-04-16 06:08:47.962176 | Pipeline: check
2026-04-16 06:08:47.962196 | Executor: 0a8996d2b663
2026-04-16 06:08:47.962215 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3834
2026-04-16 06:08:47.962236 | Event ID: 84dc3560-395a-11f1-80b3-d21ad873769d
2026-04-16 06:08:47.964950 | 
2026-04-16 06:08:47.965029 | LOOP [emit-job-header : Print node information]
2026-04-16 06:08:48.060761 | localhost | ok:
2026-04-16 06:08:48.061133 | localhost | # Node Information
2026-04-16 06:08:48.061185 | localhost | Inventory Hostname: instance
2026-04-16 06:08:48.061218 | localhost | Hostname: np0000166619
2026-04-16 06:08:48.061248 | localhost | Username: zuul
2026-04-16 06:08:48.061282 | localhost | Distro: Ubuntu 22.04
2026-04-16 06:08:48.061312 | localhost | Provider: yul1
2026-04-16 06:08:48.061339 | localhost | Region: ca-ymq-1
2026-04-16 06:08:48.061367 | localhost | Label: ubuntu-jammy
2026-04-16 06:08:48.061393 | localhost | Product Name: OpenStack Nova
2026-04-16 06:08:48.061420 | localhost | Interface IP: 199.204.45.95
2026-04-16 06:08:48.080745 | 
2026-04-16 06:08:48.080870 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-16 06:08:48.478255 | localhost -> localhost | changed
2026-04-16 06:08:48.483311 | 
2026-04-16 06:08:48.483383 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-16 06:08:49.397239 | localhost -> localhost | changed
2026-04-16 06:08:49.407846 | 
2026-04-16 06:08:49.407921 | PLAY [all]
2026-04-16 06:08:49.417013 | 
2026-04-16 06:08:49.417096 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-16 06:08:49.643833 | instance -> localhost | ok
2026-04-16 06:08:49.649934 | 
2026-04-16 06:08:49.650003 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-16 06:08:49.682635 | instance | ok
2026-04-16 06:08:49.696987 | instance | included: /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-16 06:08:49.702397 | 
2026-04-16 06:08:49.702456 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-16 06:08:50.424332 | instance -> localhost | Generating public/private rsa key pair.
2026-04-16 06:08:50.424510 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/85598c25b89d4b919c7db85eb68ae267_id_rsa
2026-04-16 06:08:50.424540 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/85598c25b89d4b919c7db85eb68ae267_id_rsa.pub
2026-04-16 06:08:50.424563 | instance -> localhost | The key fingerprint is:
2026-04-16 06:08:50.424585 | instance -> localhost | SHA256:1jpiohAdv0mSXHYiOmEYcO5ZQ2L3yTZFpIsyP4HWNFU zuul-build-sshkey
2026-04-16 06:08:50.424618 | instance -> localhost | The key's randomart image is:
2026-04-16 06:08:50.424640 | instance -> localhost | +---[RSA 3072]----+
2026-04-16 06:08:50.424670 | instance -> localhost | |+ + o .+E        |
2026-04-16 06:08:50.424691 | instance -> localhost | |.= + + +         |
2026-04-16 06:08:50.424712 | instance -> localhost | |o.+ O O          |
2026-04-16 06:08:50.424732 | instance -> localhost | |.* & B o .       |
2026-04-16 06:08:50.424752 | instance -> localhost | |+ % * . S .      |
2026-04-16 06:08:50.424771 | instance -> localhost | | + * + . .       |
2026-04-16 06:08:50.424791 | instance -> localhost | |.   * o o        |
2026-04-16 06:08:50.424811 | instance -> localhost | | . . + . .       |
2026-04-16 06:08:50.424833 | instance -> localhost | |  .              |
2026-04-16 06:08:50.424853 | instance -> localhost | +----[SHA256]-----+
2026-04-16 06:08:50.424905 | instance -> localhost | ok: Runtime: 0:00:00.318841
2026-04-16 06:08:50.430218 | 
2026-04-16 06:08:50.430280 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-16 06:08:50.462228 | instance | ok
2026-04-16 06:08:50.472917 | instance | included: /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-16 06:08:50.480066 | 
2026-04-16 06:08:50.480127 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-16 06:08:50.504128 | instance | skipping: Conditional result was False
2026-04-16 06:08:50.514269 | 
2026-04-16 06:08:50.514355 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-16 06:08:51.002511 | instance | changed
2026-04-16 06:08:51.009195 | 
2026-04-16 06:08:51.009281 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-16 06:08:51.193435 | instance | ok
2026-04-16 06:08:51.200474 | 
2026-04-16 06:08:51.200542 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-16 06:08:51.671342 | instance | changed
2026-04-16 06:08:51.678236 | 
2026-04-16 06:08:51.678361 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-16 06:08:52.140868 | instance | changed
2026-04-16 06:08:52.147949 | 
2026-04-16 06:08:52.148028 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-16 06:08:52.179130 | instance | skipping: Conditional result was False
2026-04-16 06:08:52.189160 | 
2026-04-16 06:08:52.189230 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-16 06:08:52.569494 | instance -> localhost | changed
2026-04-16 06:08:52.587763 | 
2026-04-16 06:08:52.587844 | TASK [add-build-sshkey : Add back temp key]
2026-04-16 06:08:52.883855 | instance -> localhost | Identity added: /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/85598c25b89d4b919c7db85eb68ae267_id_rsa (zuul-build-sshkey)
2026-04-16 06:08:52.884089 | instance -> localhost | ok: Runtime: 0:00:00.013001
2026-04-16 06:08:52.892628 | 
2026-04-16 06:08:52.892693 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-16 06:08:53.239605 | instance | ok
2026-04-16 06:08:53.248040 | 
2026-04-16 06:08:53.248111 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-16 06:08:53.272812 | instance | skipping: Conditional result was False
2026-04-16 06:08:53.287044 | 
2026-04-16 06:08:53.287128 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-16 06:08:53.622705 | instance | ok
2026-04-16 06:08:53.631400 | 
2026-04-16 06:08:53.631464 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-16 06:08:55.278634 | instance | Output suppressed because no_log was given
2026-04-16 06:08:55.288449 | 
2026-04-16 06:08:55.288557 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-16 06:08:55.468665 | instance | ok: "logs"
2026-04-16 06:08:55.468997 | instance | ok: All items complete
2026-04-16 06:08:55.469028 | 
2026-04-16 06:08:55.624743 | instance | ok: "artifacts"
2026-04-16 06:08:55.777181 | instance | ok: "docs"
2026-04-16 06:08:55.942644 | 
2026-04-16 06:08:55.942811 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-16 06:08:56.136094 | instance | changed: "logs"
2026-04-16 06:08:56.297616 | instance | changed: "artifacts"
2026-04-16 06:08:56.454967 | instance | changed: "docs"
2026-04-16 06:08:56.474267 | 
2026-04-16 06:08:56.474449 | PLAY RECAP
2026-04-16 06:08:56.474541 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-16 06:08:56.474588 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-16 06:08:56.474618 | 
2026-04-16 06:08:56.627304 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-16 06:08:56.631737 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-16 06:08:57.249603 | 
2026-04-16 06:08:57.249746 | PLAY [all]
2026-04-16 06:08:57.263203 | 
2026-04-16 06:08:57.263315 | TASK [setup-uv : Extract archive]
2026-04-16 06:08:59.389236 | instance | changed
2026-04-16 06:08:59.397342 | 
2026-04-16 06:08:59.397430 | TASK [setup-uv : Print version]
2026-04-16 06:08:59.715519 | instance | uv 0.8.13
2026-04-16 06:08:59.935370 | instance | ok: Runtime: 0:00:00.013658
2026-04-16 06:08:59.943769 | 
2026-04-16 06:08:59.943838 | PLAY RECAP
2026-04-16 06:08:59.943902 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-16 06:08:59.943936 | 
2026-04-16 06:09:00.094314 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-16 06:09:00.103584 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-16 06:09:00.672449 | 
2026-04-16 06:09:00.672583 | PLAY [all]
2026-04-16 06:09:00.684015 | 
2026-04-16 06:09:00.684095 | TASK [Install "jq" for log collection]
2026-04-16 06:12:19.072363 | instance | changed
2026-04-16 06:12:19.079886 | 
2026-04-16 06:12:19.080000 | TASK [Install pip3 for Python package management]
2026-04-16 06:12:23.754054 | instance | changed
2026-04-16 06:12:23.760987 | 
2026-04-16 06:12:23.761077 | TASK [Install Python "kubernetes" library for kubernetes.core modules]
2026-04-16 06:12:26.677484 | instance | changed
2026-04-16 06:12:26.680371 | 
2026-04-16 06:12:26.680425 | PLAY [all]
2026-04-16 06:12:26.688627 | 
2026-04-16 06:12:26.688694 | TASK [ensure-go : Check installed go version]
2026-04-16 06:12:27.224122 | instance | ok: ERROR (ignored)
2026-04-16 06:12:27.224441 | instance | {
2026-04-16 06:12:27.224485 | instance |   "failed_when_result": false,
2026-04-16 06:12:27.224514 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-04-16 06:12:27.224543 | instance |   "rc": 2
2026-04-16 06:12:27.224574 | instance | }
2026-04-16 06:12:27.231062 | 
2026-04-16 06:12:27.231157 | TASK [ensure-go : Skip if correct version of go is installed]
2026-04-16 06:12:27.285970 | instance | ok
2026-04-16 06:12:27.296807 | instance | included: /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-04-16 06:12:27.301606 | 
2026-04-16 06:12:27.301671 | TASK [ensure-go : Create temp directory]
2026-04-16 06:12:27.630300 | instance | changed
2026-04-16 06:12:27.637147 | 
2026-04-16 06:12:27.637236 | TASK [ensure-go : Get archive checksum]
2026-04-16 06:12:28.601317 | instance | ok: OK (64 bytes)
2026-04-16 06:12:28.606746 | 
2026-04-16 06:12:28.606810 | TASK [ensure-go : Download go archive]
2026-04-16 06:12:30.118921 | instance | changed: OK (78559214 bytes)
2026-04-16 06:12:30.124452 | 
2026-04-16 06:12:30.124514 | TASK [ensure-go : Install go]
2026-04-16 06:12:36.014519 | instance | changed
2026-04-16 06:12:36.024662 | 
2026-04-16 06:12:36.024719 | PLAY [all]
2026-04-16 06:12:36.030947 | 
2026-04-16 06:12:36.031006 | TASK [Copy inventory file for Zuul]
2026-04-16 06:12:36.794769 | instance | changed
2026-04-16 06:12:36.800301 | 
2026-04-16 06:12:36.800374 | TASK [Switch "ansible_host" to private IP]
2026-04-16 06:12:37.119837 | instance | changed: 1 replacements made
2026-04-16 06:12:37.125428 | 
2026-04-16 06:12:37.125502 | TASK [Run molecule prepare]
2026-04-16 06:12:37.401275 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-16 06:12:37.401514 | instance | Creating virtual environment at: .venv
2026-04-16 06:12:37.432400 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-16 06:12:37.463618 | instance | Downloading netaddr (2.2MiB)
2026-04-16 06:12:37.467511 | instance | Downloading pygments (1.2MiB)
2026-04-16 06:12:37.467817 | instance | Downloading kubernetes (1.9MiB)
2026-04-16 06:12:37.468139 | instance | Downloading openstacksdk (1.7MiB)
2026-04-16 06:12:37.481915 | instance | Downloading cryptography (4.2MiB)
2026-04-16 06:12:37.483050 | instance | Downloading ansible-core (2.1MiB)
2026-04-16 06:12:37.488052 | instance | Downloading rjsonnet (1.2MiB)
2026-04-16 06:12:37.497360 | instance | Downloading setuptools (1.1MiB)
2026-04-16 06:12:37.605845 | instance | Downloading pydantic-core (2.0MiB)
2026-04-16 06:12:37.797831 | instance |    Building pyperclip==1.9.0
2026-04-16 06:12:37.836912 | instance |  Downloading rjsonnet
2026-04-16 06:12:37.953913 | instance |  Downloading pydantic-core
2026-04-16 06:12:37.974877 | instance |  Downloading netaddr
2026-04-16 06:12:37.994546 | instance |  Downloading pygments
2026-04-16 06:12:38.007850 | instance |  Downloading cryptography
2026-04-16 06:12:38.043201 | instance |  Downloading setuptools
2026-04-16 06:12:38.095841 | instance |  Downloading kubernetes
2026-04-16 06:12:38.129400 | instance |  Downloading ansible-core
2026-04-16 06:12:38.161238 | instance |  Downloading openstacksdk
2026-04-16 06:12:38.529531 | instance |       Built pyperclip==1.9.0
2026-04-16 06:12:38.685363 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-16 06:12:38.733914 | instance | Installed 83 packages in 46ms
2026-04-16 06:12:39.373301 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-16 06:12:39.953016 | instance | INFO     [csi > discovery] scenario test matrix: prepare
2026-04-16 06:12:39.953093 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-04-16 06:12:50.624890 | instance | WARNING  Retrying execution failure 1 of: ansible-galaxy collection install -vvv ansible.utils:>=2.9.0
2026-04-16 06:12:50.625030 | instance | ERROR    Command ansible-galaxy collection install -vvv ansible.utils:>=2.9.0, returned 1 code:
2026-04-16 06:12:50.625043 | instance | Starting galaxy collection install process
2026-04-16 06:12:50.625053 | instance | Process install dependency map
2026-04-16 06:12:50.625062 | instance | Starting collection install process
2026-04-16 06:12:50.625083 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/ansible-utils-6.0.2.tar.gz to /home/zuul/.ansible/tmp/ansible-local-145000zuk_v0/tmpww_lve8v/ansible-utils-6.0.2-r0g56lsu
2026-04-16 06:12:50.625098 | instance |
2026-04-16 06:12:50.625107 | instance | ansible-galaxy
2026-04-16 06:12:50.625116 | instance |   config file = None
2026-04-16 06:12:50.625125 | instance |   configured module search path =
2026-04-16 06:12:50.625134 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-04-16 06:12:50.625145 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-04-16 06:12:50.625162 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-04-16 06:12:50.625171 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32)  (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-04-16 06:12:50.625180 | instance |   jinja version = 3.1.6
2026-04-16 06:12:50.625189 | instance |   libyaml = True
2026-04-16 06:12:50.625198 | instance | No config file found; using defaults
2026-04-16 06:12:50.625207 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-04-16 06:12:50.625216 | instance | : Collection ansible.netcommon does not support Ansible version
2026-04-16 06:12:50.625225 | instance | 2.17.12
2026-04-16 06:12:50.625233 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-04-16 06:12:50.625261 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-04-16 06:12:50.625270 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-04-16 06:12:50.625280 | instance |
2026-04-16 06:12:50.625764 | instance | Traceback (most recent call last):
2026-04-16 06:12:50.626085 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-04-16 06:12:50.626840 | instance |     sys.exit(main())
2026-04-16 06:12:50.626979 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-04-16 06:12:50.627764 | instance |     return self.main(*args, **kwargs)
2026-04-16 06:12:50.628089 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-04-16 06:12:50.628915 | instance |     rv = self.invoke(ctx)
2026-04-16 06:12:50.629218 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-04-16 06:12:50.630061 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-04-16 06:12:50.630358 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-04-16 06:12:50.631088 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-04-16 06:12:50.631382 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-04-16 06:12:50.632055 | instance |     return callback(*args, **kwargs)
2026-04-16 06:12:50.632334 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-04-16 06:12:50.632962 | instance |     return func(*args, **kwargs)
2026-04-16 06:12:50.633261 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-04-16 06:12:50.633688 | instance |     return f(get_current_context(), *args, **kwargs)
2026-04-16 06:12:50.634035 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-04-16 06:12:50.634577 | instance |     return func(ctx)
2026-04-16 06:12:50.634818 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/prepare.py", line 139, in prepare
2026-04-16 06:12:50.635030 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, excludes=exclude)
2026-04-16 06:12:50.635160 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-04-16 06:12:50.635349 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-04-16 06:12:50.635487 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 240, in _run_scenarios
2026-04-16 06:12:50.635696 | instance |     scenario.config.runtime.prepare_environment(
2026-04-16 06:12:50.635823 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 694, in prepare_environment
2026-04-16 06:12:50.636099 | instance |     self.install_collection(
2026-04-16 06:12:50.636228 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible_compat/runtime.py", line 552, in install_collection
2026-04-16 06:12:50.636487 | instance |     raise InvalidPrerequisiteError(msg)
2026-04-16 06:12:50.637270 | instance | ansible_compat.errors.InvalidPrerequisiteError: Command ansible-galaxy collection install -vvv ansible.utils:>=2.9.0, returned 1 code:
2026-04-16 06:12:50.637284 | instance | Starting galaxy collection install process
2026-04-16 06:12:50.637294 | instance | Process install dependency map
2026-04-16 06:12:50.637303 | instance | Starting collection install process
2026-04-16 06:12:50.637328 | instance | Downloading https://galaxy.ansible.com/api/v3/plugin/ansible/content/published/collections/artifacts/ansible-utils-6.0.2.tar.gz to /home/zuul/.ansible/tmp/ansible-local-145000zuk_v0/tmpww_lve8v/ansible-utils-6.0.2-r0g56lsu
2026-04-16 06:12:50.637339 | instance |
2026-04-16 06:12:50.637348 | instance | ansible-galaxy [core 2.17.12]
2026-04-16 06:12:50.637357 | instance |   config file = None
2026-04-16 06:12:50.637366 | instance |   configured module search path = ['/home/zuul/src/github.com/vexxhost/atmosphere/plugins/modules', '/home/zuul/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
2026-04-16 06:12:50.637376 | instance |   ansible python module location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/ansible
2026-04-16 06:12:50.637386 | instance |   ansible collection location = /home/zuul/.ansible/collections:/usr/share/ansible/collections:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/local/lib/python3.10/dist-packages:/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages
2026-04-16 06:12:50.637397 | instance |   executable location = /home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/ansible-galaxy
2026-04-16 06:12:50.637406 | instance |   python version = 3.10.12 (main, Mar  3 2026, 11:56:32) [GCC 11.4.0] (/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/python)
2026-04-16 06:12:50.637414 | instance |   jinja version = 3.1.6
2026-04-16 06:12:50.637423 | instance |   libyaml = True
2026-04-16 06:12:50.637432 | instance | No config file found; using defaults
2026-04-16 06:12:50.637441 | instance | Found installed collection ansible.posix:1.6.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-04-16 06:12:50.637449 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-04-16 06:12:50.637459 | instance | 2.17.12
2026-04-16 06:12:50.637468 | instance | Found installed collection ansible.netcommon:1.2.0 at '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-04-16 06:12:50.637477 | instance | Opened /home/zuul/.ansible/galaxy_token
2026-04-16 06:12:50.637486 | instance | ERROR! Failed to download collection tar from 'default' due to the following unforeseen error: HTTP Error 502: Bad Gateway. HTTP Error 502: Bad Gateway
2026-04-16 06:12:50.637497 | instance |
2026-04-16 06:12:51.179116 | instance | ERROR
2026-04-16 06:12:51.179416 | instance | {
2026-04-16 06:12:51.179481 | instance |   "delta": "0:00:13.376614",
2026-04-16 06:12:51.179527 | instance |   "end": "2026-04-16 06:12:50.715832",
2026-04-16 06:12:51.179569 | instance |   "msg": "non-zero return code",
2026-04-16 06:12:51.179609 | instance |   "rc": 1,
2026-04-16 06:12:51.179674 | instance |   "start": "2026-04-16 06:12:37.339218"
2026-04-16 06:12:51.179716 | instance | }
failure
2026-04-16 06:12:51.182763 | 
2026-04-16 06:12:51.182802 | PLAY RECAP
2026-04-16 06:12:51.182847 | instance | ok: 11 changed: 8 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-16 06:12:51.182868 | 
2026-04-16 06:12:51.291546 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-16 06:12:51.295720 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-16 06:12:51.927315 | 
2026-04-16 06:12:51.927434 | PLAY [all]
2026-04-16 06:12:51.942065 | 
2026-04-16 06:12:51.942149 | TASK [gather-host-logs : creating directory for system status]
2026-04-16 06:12:52.290474 | instance | changed
2026-04-16 06:12:52.298324 | 
2026-04-16 06:12:52.298464 | TASK [gather-host-logs : Get logs for each host]
2026-04-16 06:12:52.649277 | instance | + systemd-cgls --full --all --no-pager
2026-04-16 06:12:52.660426 | instance | + ip addr
2026-04-16 06:12:52.662032 | instance | + ip route
2026-04-16 06:12:52.663397 | instance | + lsblk
2026-04-16 06:12:52.665884 | instance | + mount
2026-04-16 06:12:52.667471 | instance | + docker images
2026-04-16 06:12:52.667847 | instance | /bin/bash: line 7: docker: command not found
2026-04-16 06:12:52.668057 | instance | + brctl show
2026-04-16 06:12:52.668370 | instance | /bin/bash: line 8: brctl: command not found
2026-04-16 06:12:52.668508 | instance | + ps aux --sort=-%mem
2026-04-16 06:12:52.676206 | instance | + dpkg -l
2026-04-16 06:12:52.683593 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-16 06:12:52.683984 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-16 06:12:52.684017 | instance | /bin/bash: line 11: docker: command not found
2026-04-16 06:12:52.684286 | instance | + '[' '!' -z '' ']'
2026-04-16 06:12:52.837752 | instance | ok: Runtime: 0:00:00.039528
2026-04-16 06:12:52.846489 | 
2026-04-16 06:12:52.846591 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-16 06:12:53.490053 | instance | changed:
2026-04-16 06:12:53.490253 | instance | created directory /var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/logs/instance
2026-04-16 06:12:53.490292 | instance | cd+++++++++ system/
2026-04-16 06:12:53.490330 | instance | >f+++++++++ system/brctl-show.txt
2026-04-16 06:12:53.490366 | instance | >f+++++++++ system/docker-images.txt
2026-04-16 06:12:53.490393 | instance | >f+++++++++ system/ip-addr.txt
2026-04-16 06:12:53.490424 | instance | >f+++++++++ system/ip-route.txt
2026-04-16 06:12:53.490452 | instance | >f+++++++++ system/lsblk.txt
2026-04-16 06:12:53.490480 | instance | >f+++++++++ system/mount.txt
2026-04-16 06:12:53.490510 | instance | >f+++++++++ system/packages.txt
2026-04-16 06:12:53.490536 | instance | >f+++++++++ system/ps.txt
2026-04-16 06:12:53.490563 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-16 06:12:53.503042 | 
2026-04-16 06:12:53.503115 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-16 06:12:53.706740 | instance | changed: "values"
2026-04-16 06:12:53.910285 | instance | changed: "releases"
2026-04-16 06:12:53.926707 | 
2026-04-16 06:12:53.926877 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-16 06:12:54.135760 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-16 06:12:54.463210 | instance | ok: Runtime: 0:00:00.005410
2026-04-16 06:12:54.468774 | 
2026-04-16 06:12:54.468847 | TASK [helm-release-status : Downloads logs to executor]
2026-04-16 06:12:54.963747 | instance | changed:
2026-04-16 06:12:54.963983 | instance | cd+++++++++ helm/
2026-04-16 06:12:54.964022 | instance | cd+++++++++ helm/releases/
2026-04-16 06:12:54.964053 | instance | cd+++++++++ helm/values/
2026-04-16 06:12:54.975031 | 
2026-04-16 06:12:54.975099 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-16 06:12:55.172132 | instance | changed
2026-04-16 06:12:55.178054 | 
2026-04-16 06:12:55.178124 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-16 06:12:55.385616 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 06:12:55.385850 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 06:12:55.389763 | instance | environment: line 1: kubectl: command not found
2026-04-16 06:12:55.391336 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 06:12:55.392489 | instance | environment: line 1: kubectl: command not found
2026-04-16 06:12:55.393555 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 06:12:55.395441 | instance | environment: line 1: kubectl: command not found
2026-04-16 06:12:55.396375 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 06:12:55.396923 | instance | environment: line 1: kubectl: command not found
2026-04-16 06:12:55.397789 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 06:12:55.398777 | instance | environment: line 1: kubectl: command not found
2026-04-16 06:12:55.399423 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-16 06:12:55.715059 | instance | ok: Runtime: 0:00:00.022279
2026-04-16 06:12:55.721880 | 
2026-04-16 06:12:55.721967 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-16 06:12:55.919463 | instance | changed
2026-04-16 06:12:55.926266 | 
2026-04-16 06:12:55.926340 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-16 06:12:56.189302 | instance | environment: line 5: kubectl: command not found
2026-04-16 06:12:56.189819 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 06:12:56.190273 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 06:12:56.190657 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-16 06:12:56.536331 | instance | ok: Runtime: 0:00:00.008584
2026-04-16 06:12:56.545397 | 
2026-04-16 06:12:56.545465 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-16 06:12:57.045366 | instance | changed:
2026-04-16 06:12:57.045606 | instance | cd+++++++++ objects/
2026-04-16 06:12:57.045645 | instance | cd+++++++++ objects/cluster/
2026-04-16 06:12:57.045678 | instance | cd+++++++++ objects/namespaced/
2026-04-16 06:12:57.060606 | 
2026-04-16 06:12:57.060798 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-16 06:12:57.258439 | instance | changed
2026-04-16 06:12:57.280454 | 
2026-04-16 06:12:57.280553 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-16 06:12:57.476137 | instance | changed
2026-04-16 06:12:57.483241 | 
2026-04-16 06:12:57.483322 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-16 06:12:57.700919 | instance | environment: line 3: kubectl: command not found
2026-04-16 06:12:58.019769 | instance | ok: Runtime: 0:00:00.007573
2026-04-16 06:12:58.028206 | 
2026-04-16 06:12:58.028311 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-16 06:12:58.518722 | instance | changed:
2026-04-16 06:12:58.518909 | instance | cd+++++++++ pod-logs/
2026-04-16 06:12:58.518936 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-16 06:12:58.528477 | 
2026-04-16 06:12:58.528560 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-16 06:12:58.734380 | instance | changed
2026-04-16 06:12:58.739530 | 
2026-04-16 06:12:58.739601 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-16 06:12:58.965369 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-16 06:12:59.278333 | instance | ok: Runtime: 0:00:00.036268
2026-04-16 06:12:59.285233 | 
2026-04-16 06:12:59.285327 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-16 06:12:59.494088 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-16 06:12:59.523245 | instance | ceph-mgr endpoints:
2026-04-16 06:12:59.820261 | instance | ok: Runtime: 0:00:00.035298
2026-04-16 06:12:59.827283 | 
2026-04-16 06:12:59.827374 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-16 06:13:00.041350 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-16 06:13:00.364857 | instance | ok: Runtime: 0:00:00.036354
2026-04-16 06:13:00.371990 | 
2026-04-16 06:13:00.372057 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-16 06:13:00.861498 | instance | changed: cd+++++++++ prometheus/
2026-04-16 06:13:00.872395 | 
2026-04-16 06:13:00.872458 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-16 06:13:01.069950 | instance | changed
2026-04-16 06:13:01.074666 | 
2026-04-16 06:13:01.074726 | TASK [gather-selenium-data : Get selenium data]
2026-04-16 06:13:01.303347 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-16 06:13:01.305070 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-16 06:13:01.612239 | instance | ERROR
2026-04-16 06:13:01.612519 | instance | {
2026-04-16 06:13:01.612550 | instance |   "delta": "0:00:00.008473",
2026-04-16 06:13:01.612571 | instance |   "end": "2026-04-16 06:13:01.305512",
2026-04-16 06:13:01.612589 | instance |   "msg": "non-zero return code",
2026-04-16 06:13:01.612607 | instance |   "rc": 1,
2026-04-16 06:13:01.612625 | instance |   "start": "2026-04-16 06:13:01.297039"
2026-04-16 06:13:01.612643 | instance | }
2026-04-16 06:13:01.612666 | instance | ERROR: Ignoring Errors
2026-04-16 06:13:01.618169 | 
2026-04-16 06:13:01.618241 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-16 06:13:02.108755 | instance | changed: cd+++++++++ selenium/
2026-04-16 06:13:02.114740 | 
2026-04-16 06:13:02.114795 | PLAY RECAP
2026-04-16 06:13:02.114848 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-16 06:13:02.114871 | 
2026-04-16 06:13:02.254567 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-16 06:13:02.258902 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-16 06:13:02.813463 | 
2026-04-16 06:13:02.813595 | PLAY [all]
2026-04-16 06:13:02.825025 | 
2026-04-16 06:13:02.825105 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-16 06:13:02.870850 | instance | skipping: Conditional result was False
2026-04-16 06:13:02.881205 | 
2026-04-16 06:13:02.881285 | TASK [fetch-output : Set log path for single node]
2026-04-16 06:13:02.923417 | instance | ok
2026-04-16 06:13:02.928317 | 
2026-04-16 06:13:02.928387 | LOOP [fetch-output : Ensure local output dirs]
2026-04-16 06:13:03.306378 | instance -> localhost | ok: "/var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/logs"
2026-04-16 06:13:03.519904 | instance -> localhost | changed: "/var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/artifacts"
2026-04-16 06:13:03.739771 | instance -> localhost | changed: "/var/lib/zuul/builds/85598c25b89d4b919c7db85eb68ae267/work/docs"
2026-04-16 06:13:03.760875 | 
2026-04-16 06:13:03.761046 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-16 06:13:04.371102 | instance | changed: .d..t...... ./
2026-04-16 06:13:04.371374 | instance | changed: All items complete
2026-04-16 06:13:04.371519 | 
2026-04-16 06:13:04.802959 | instance | changed: .d..t...... ./
2026-04-16 06:13:05.253167 | instance | changed: .d..t...... ./
2026-04-16 06:13:05.276226 | 
2026-04-16 06:13:05.276361 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-16 06:13:05.692740 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007778
2026-04-16 06:13:05.915169 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007929
2026-04-16 06:13:05.929929 | 
2026-04-16 06:13:05.930029 | PLAY [all]
2026-04-16 06:13:05.936118 | 
2026-04-16 06:13:05.936181 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-16 06:13:06.347586 | instance | changed
2026-04-16 06:13:06.354853 | 
2026-04-16 06:13:06.354906 | PLAY RECAP
2026-04-16 06:13:06.354950 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-16 06:13:06.354971 | 
2026-04-16 06:13:06.472202 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-16 06:13:06.474316 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-16 06:13:07.081722 | 
2026-04-16 06:13:07.082188 | PLAY [localhost]
2026-04-16 06:13:07.092467 | 
2026-04-16 06:13:07.092546 | TASK [Generate Zuul manifest]
2026-04-16 06:13:07.115075 | localhost | ok
2026-04-16 06:13:07.131117 | 
2026-04-16 06:13:07.131200 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-16 06:13:07.471754 | localhost | changed
2026-04-16 06:13:07.482795 | 
2026-04-16 06:13:07.482863 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-16 06:13:07.514864 | localhost | ok
2026-04-16 06:13:07.524659 | 
2026-04-16 06:13:07.524731 | TASK [Upload logs]
2026-04-16 06:13:07.548579 | localhost | ok
2026-04-16 06:13:07.605167 | 
2026-04-16 06:13:07.605266 | TASK [Set zuul-log-path fact]
2026-04-16 06:13:07.623093 | localhost | ok
2026-04-16 06:13:07.633305 | 
2026-04-16 06:13:07.633370 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-16 06:13:07.661306 | localhost | ok
2026-04-16 06:13:07.667889 | 
2026-04-16 06:13:07.667954 | TASK [upload-logs : Create log directories]
2026-04-16 06:13:08.069712 | localhost | changed
2026-04-16 06:13:08.074558 | 
2026-04-16 06:13:08.074639 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-16 06:13:08.483325 | localhost -> localhost | ok: Runtime: 0:00:00.005771
2026-04-16 06:13:08.489872 | 
2026-04-16 06:13:08.489956 | TASK [upload-logs : Upload logs to log server]
2026-04-16 06:13:08.950635 | localhost | Output suppressed because no_log was given
2026-04-16 06:13:08.955462 | 
2026-04-16 06:13:08.955549 | LOOP [upload-logs : Compress console log and json output]
2026-04-16 06:13:09.002920 | localhost | skipping: Conditional result was False
2026-04-16 06:13:09.012526 | localhost | skipping: Conditional result was False
2026-04-16 06:13:09.029530 | 
2026-04-16 06:13:09.029646 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-16 06:13:09.071013 | localhost | skipping: Conditional result was False
2026-04-16 06:13:09.071455 | 
2026-04-16 06:13:09.075235 | localhost | skipping: Conditional result was False
2026-04-16 06:13:09.086093 | 
2026-04-16 06:13:09.086317 | LOOP [upload-logs : Upload console log and json output]