2026-08-28 03:58:29.435719 | Job console starting
2026-08-28 03:58:29.448078 | Updating git repos
2026-08-28 03:58:33.281512 | Cloning repos into workspace
2026-08-28 03:58:49.178754 | Restoring repo states
2026-08-28 03:58:53.095740 | Merging changes
2026-08-28 03:58:54.553017 | Checking out repos
2026-08-28 03:58:56.569850 | Preparing playbooks
2026-08-28 03:58:58.502003 | Running Ansible setup
2026-08-28 03:59:01.944368 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-28 03:59:02.549493 | 
2026-08-28 03:59:02.549638 | PLAY [localhost]
2026-08-28 03:59:02.557502 | 
2026-08-28 03:59:02.557573 | TASK [Gathering Facts]
2026-08-28 03:59:03.437553 | localhost | ok
2026-08-28 03:59:03.448278 | 
2026-08-28 03:59:03.448378 | TASK [Setup log path fact]
2026-08-28 03:59:03.470297 | localhost | ok
2026-08-28 03:59:03.484257 | 
2026-08-28 03:59:03.484323 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-28 03:59:03.512404 | localhost | ok
2026-08-28 03:59:03.518107 | 
2026-08-28 03:59:03.518174 | TASK [emit-job-header : Print job information]
2026-08-28 03:59:03.556522 | # Job Information
2026-08-28 03:59:03.556688 | Ansible Version: 2.16.18
2026-08-28 03:59:03.556723 | Job: atmosphere-molecule-csi-rbd
2026-08-28 03:59:03.556746 | Pipeline: check
2026-08-28 03:59:03.556766 | Executor: 2d72f0692154
2026-08-28 03:59:03.556786 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4352
2026-08-28 03:59:03.556809 | Event ID: a7ec9cf0-a293-11f1-9353-4c33a946c5d5
2026-08-28 03:59:03.559513 | 
2026-08-28 03:59:03.559576 | LOOP [emit-job-header : Print node information]
2026-08-28 03:59:03.652427 | localhost | ok:
2026-08-28 03:59:03.652662 | localhost | # Node Information
2026-08-28 03:59:03.652714 | localhost | Inventory Hostname: instance
2026-08-28 03:59:03.652745 | localhost | Hostname: np0000191387
2026-08-28 03:59:03.652772 | localhost | Username: zuul
2026-08-28 03:59:03.652806 | localhost | Distro: Ubuntu 22.04
2026-08-28 03:59:03.652834 | localhost | Provider: yul1
2026-08-28 03:59:03.652860 | localhost | Region: ca-ymq-1
2026-08-28 03:59:03.652886 | localhost | Label: ubuntu-jammy
2026-08-28 03:59:03.652911 | localhost | Product Name: OpenStack Nova
2026-08-28 03:59:03.652937 | localhost | Interface IP: 162.253.55.45
2026-08-28 03:59:03.670591 | 
2026-08-28 03:59:03.670707 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-28 03:59:04.070470 | localhost -> localhost | changed
2026-08-28 03:59:04.078686 | 
2026-08-28 03:59:04.078790 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-28 03:59:04.936902 | localhost -> localhost | changed
2026-08-28 03:59:04.947368 | 
2026-08-28 03:59:04.947455 | PLAY [all]
2026-08-28 03:59:04.957279 | 
2026-08-28 03:59:04.957350 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-28 03:59:05.185072 | instance -> localhost | ok
2026-08-28 03:59:05.195318 | 
2026-08-28 03:59:05.195393 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-28 03:59:05.229934 | instance | ok
2026-08-28 03:59:05.244321 | instance | included: /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-28 03:59:05.250086 | 
2026-08-28 03:59:05.250145 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-28 03:59:06.882204 | instance -> localhost | Generating public/private rsa key pair.
2026-08-28 03:59:06.882523 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/4fcedb7297a743459836f0f69bea51f0_id_rsa
2026-08-28 03:59:06.882598 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/4fcedb7297a743459836f0f69bea51f0_id_rsa.pub
2026-08-28 03:59:06.882657 | instance -> localhost | The key fingerprint is:
2026-08-28 03:59:06.882713 | instance -> localhost | SHA256:LN2yIa9SmWhUDs7UYGMqWY0rOPOX8hYhjzsA1vaiT+8 zuul-build-sshkey
2026-08-28 03:59:06.882793 | instance -> localhost | The key's randomart image is:
2026-08-28 03:59:06.882851 | instance -> localhost | +---[RSA 3072]----+
2026-08-28 03:59:06.882923 | instance -> localhost | |  .o=o           |
2026-08-28 03:59:06.882981 | instance -> localhost | | o.++.o          |
2026-08-28 03:59:06.883034 | instance -> localhost | |+ o= +           |
2026-08-28 03:59:06.883087 | instance -> localhost | |*ooo= .o .       |
2026-08-28 03:59:06.883139 | instance -> localhost | |o=.=.+ooS .      |
2026-08-28 03:59:06.883190 | instance -> localhost | |. +.B.++ +       |
2026-08-28 03:59:06.883241 | instance -> localhost | | ..B.o  o        |
2026-08-28 03:59:06.883292 | instance -> localhost | | .+ =  .         |
2026-08-28 03:59:06.883350 | instance -> localhost | |  .+.E.          |
2026-08-28 03:59:06.883407 | instance -> localhost | +----[SHA256]-----+
2026-08-28 03:59:06.883525 | instance -> localhost | ok: Runtime: 0:00:01.218329
2026-08-28 03:59:06.891598 | 
2026-08-28 03:59:06.891669 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-28 03:59:06.925122 | instance | ok
2026-08-28 03:59:06.936471 | instance | included: /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-28 03:59:06.944036 | 
2026-08-28 03:59:06.944098 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-28 03:59:06.969091 | instance | skipping: Conditional result was False
2026-08-28 03:59:06.979528 | 
2026-08-28 03:59:06.979604 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-28 03:59:07.447032 | instance | changed
2026-08-28 03:59:07.453434 | 
2026-08-28 03:59:07.453502 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-28 03:59:07.671262 | instance | ok
2026-08-28 03:59:07.678406 | 
2026-08-28 03:59:07.678494 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-28 03:59:08.270146 | instance | changed
2026-08-28 03:59:08.277339 | 
2026-08-28 03:59:08.277462 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-28 03:59:08.781106 | instance | changed
2026-08-28 03:59:08.787359 | 
2026-08-28 03:59:08.787434 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-28 03:59:08.811684 | instance | skipping: Conditional result was False
2026-08-28 03:59:08.821647 | 
2026-08-28 03:59:08.821740 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-28 03:59:09.210439 | instance -> localhost | changed
2026-08-28 03:59:09.223283 | 
2026-08-28 03:59:09.223373 | TASK [add-build-sshkey : Add back temp key]
2026-08-28 03:59:09.508145 | instance -> localhost | Identity added: /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/4fcedb7297a743459836f0f69bea51f0_id_rsa (zuul-build-sshkey)
2026-08-28 03:59:09.508470 | instance -> localhost | ok: Runtime: 0:00:00.013301
2026-08-28 03:59:09.515052 | 
2026-08-28 03:59:09.515117 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-28 03:59:09.883018 | instance | ok
2026-08-28 03:59:09.889588 | 
2026-08-28 03:59:09.889770 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-28 03:59:09.926396 | instance | skipping: Conditional result was False
2026-08-28 03:59:09.942655 | 
2026-08-28 03:59:09.942734 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-28 03:59:10.283894 | instance | ok
2026-08-28 03:59:10.293248 | 
2026-08-28 03:59:10.293360 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-28 03:59:13.799775 | instance | Output suppressed because no_log was given
2026-08-28 03:59:13.810596 | 
2026-08-28 03:59:13.810679 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-28 03:59:14.017303 | instance | ok: "logs"
2026-08-28 03:59:14.017568 | instance | ok: All items complete
2026-08-28 03:59:14.017599 | 
2026-08-28 03:59:14.155846 | instance | ok: "artifacts"
2026-08-28 03:59:14.328063 | instance | ok: "docs"
2026-08-28 03:59:14.347286 | 
2026-08-28 03:59:14.347506 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-28 03:59:14.546065 | instance | changed: "logs"
2026-08-28 03:59:14.703523 | instance | changed: "artifacts"
2026-08-28 03:59:14.844224 | instance | changed: "docs"
2026-08-28 03:59:14.858510 | 
2026-08-28 03:59:14.858650 | PLAY RECAP
2026-08-28 03:59:14.858714 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-28 03:59:14.858753 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 03:59:14.858801 | 
2026-08-28 03:59:15.025381 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-28 03:59:15.028751 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-28 03:59:15.720386 | 
2026-08-28 03:59:15.877615 | PLAY [all]
2026-08-28 03:59:15.895167 | 
2026-08-28 03:59:15.895252 | TASK [setup-uv : Extract archive]
2026-08-28 03:59:19.086130 | instance | changed
2026-08-28 03:59:19.093620 | 
2026-08-28 03:59:19.093740 | TASK [setup-uv : Print version]
2026-08-28 03:59:19.444532 | instance | uv 0.8.13
2026-08-28 03:59:19.631479 | instance | ok: Runtime: 0:00:00.011498
2026-08-28 03:59:19.643746 | 
2026-08-28 03:59:19.643888 | TASK [Install Ansible collection siblings]
2026-08-28 03:59:28.176132 | instance | changed:
2026-08-28 03:59:28.176317 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-28 03:59:28.176356 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-28 03:59:28.176387 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-28 03:59:28.176415 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-28 03:59:28.176442 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-08-28 03:59:28.176474 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-28 03:59:28.176502 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-28 03:59:28.176532 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-28 03:59:28.176599 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-28 03:59:28.176628 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-28 03:59:28.176655 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-28 03:59:28.176682 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-28 03:59:28.176708 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-08-28 03:59:28.176764 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-08-28 03:59:28.176794 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-08-28 03:59:28.176821 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-08-28 03:59:28.176846 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-08-28 03:59:28.176872 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-08-28 03:59:28.176897 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-08-28 03:59:28.176922 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-08-28 03:59:28.176947 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-08-28 03:59:28.176997 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-08-28 03:59:28.177058 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-28 03:59:28.177868 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-08-28 03:59:28.177927 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-08-28 03:59:28.177958 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-28 03:59:28.177986 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-28 03:59:28.178009 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-08-28 03:59:28.178036 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-08-28 03:59:28.178056 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-08-28 03:59:28.178075 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-08-28 03:59:28.178094 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-08-28 03:59:28.178112 | instance | Checked out ansible.netcommon to 1.2.0
2026-08-28 03:59:28.178131 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-08-28 03:59:28.178156 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.178175 | instance | Process install dependency map
2026-08-28 03:59:28.178193 | instance | Starting collection install process
2026-08-28 03:59:28.178211 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-08-28 03:59:28.178229 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-08-28 03:59:28.178246 | instance | ansible.netcommon:* was installed successfully
2026-08-28 03:59:28.178264 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-08-28 03:59:28.178282 | instance | Creating virtual environment at: .venv
2026-08-28 03:59:28.178299 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-28 03:59:28.178317 | instance | Downloading openstacksdk (1.7MiB)
2026-08-28 03:59:28.178335 | instance | Downloading rjsonnet (1.2MiB)
2026-08-28 03:59:28.178355 | instance | Downloading cryptography (4.2MiB)
2026-08-28 03:59:28.178374 | instance | Downloading kubernetes (1.9MiB)
2026-08-28 03:59:28.178391 | instance | Downloading pygments (1.2MiB)
2026-08-28 03:59:28.178410 | instance | Downloading setuptools (1.1MiB)
2026-08-28 03:59:28.178429 | instance | Downloading netaddr (2.2MiB)
2026-08-28 03:59:28.178448 | instance | Downloading ansible-core (2.1MiB)
2026-08-28 03:59:28.178467 | instance |  Downloading rjsonnet
2026-08-28 03:59:28.178485 | instance |    Building pyperclip==1.9.0
2026-08-28 03:59:28.178504 | instance |  Downloading netaddr
2026-08-28 03:59:28.178523 | instance |  Downloading pygments
2026-08-28 03:59:28.178540 | instance |  Downloading cryptography
2026-08-28 03:59:28.178558 | instance |  Downloading setuptools
2026-08-28 03:59:28.178576 | instance |  Downloading kubernetes
2026-08-28 03:59:28.178594 | instance |  Downloading ansible-core
2026-08-28 03:59:28.178611 | instance |  Downloading openstacksdk
2026-08-28 03:59:28.178630 | instance |       Built pyperclip==1.9.0
2026-08-28 03:59:28.178648 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-08-28 03:59:28.178666 | instance | Installed 79 packages in 52ms
2026-08-28 03:59:28.178684 | instance | Checked out ansible.posix to 1.6.0
2026-08-28 03:59:28.178703 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-08-28 03:59:28.178721 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.178739 | instance | Process install dependency map
2026-08-28 03:59:28.178756 | instance | Starting collection install process
2026-08-28 03:59:28.178774 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-08-28 03:59:28.178801 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-08-28 03:59:28.178819 | instance | ansible.posix:1.6.0 was installed successfully
2026-08-28 03:59:28.178837 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.178855 | instance | 2.17.12
2026-08-28 03:59:28.178874 | instance | Checked out ansible.utils to v6.1.0
2026-08-28 03:59:28.178892 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-08-28 03:59:28.178911 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.178929 | instance | Process install dependency map
2026-08-28 03:59:28.178947 | instance | Starting collection install process
2026-08-28 03:59:28.178965 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-08-28 03:59:28.178982 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-08-28 03:59:28.179000 | instance | ansible.utils:6.1.0 was installed successfully
2026-08-28 03:59:28.179019 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179037 | instance | 2.17.12
2026-08-28 03:59:28.179054 | instance | Checked out atmosphere.common to v0.7.0
2026-08-28 03:59:28.179072 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-08-28 03:59:28.179090 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.179108 | instance | Process install dependency map
2026-08-28 03:59:28.179125 | instance | Starting collection install process
2026-08-28 03:59:28.179143 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-08-28 03:59:28.179161 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-08-28 03:59:28.179180 | instance | atmosphere.common:0.7.0 was installed successfully
2026-08-28 03:59:28.179198 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179215 | instance | 2.17.12
2026-08-28 03:59:28.179233 | instance | Checked out community.crypto to 2.2.3
2026-08-28 03:59:28.179250 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-08-28 03:59:28.179268 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.179286 | instance | Process install dependency map
2026-08-28 03:59:28.179303 | instance | Starting collection install process
2026-08-28 03:59:28.179320 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-08-28 03:59:28.179338 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-08-28 03:59:28.179356 | instance | community.crypto:2.2.3 was installed successfully
2026-08-28 03:59:28.179373 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179392 | instance | 2.17.12
2026-08-28 03:59:28.179409 | instance | Checked out community.general to 7.3.0
2026-08-28 03:59:28.179428 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-08-28 03:59:28.179445 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.179468 | instance | Process install dependency map
2026-08-28 03:59:28.179486 | instance | Starting collection install process
2026-08-28 03:59:28.179503 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-08-28 03:59:28.179521 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-08-28 03:59:28.179538 | instance | community.general:7.3.0 was installed successfully
2026-08-28 03:59:28.179556 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179573 | instance | 2.17.12
2026-08-28 03:59:28.179591 | instance | Checked out community.mysql to 3.6.0
2026-08-28 03:59:28.179608 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-08-28 03:59:28.179626 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.179645 | instance | Process install dependency map
2026-08-28 03:59:28.179663 | instance | Starting collection install process
2026-08-28 03:59:28.179681 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-08-28 03:59:28.179698 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-08-28 03:59:28.179716 | instance | community.mysql:3.6.0 was installed successfully
2026-08-28 03:59:28.179734 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179752 | instance | 2.17.12
2026-08-28 03:59:28.179770 | instance | Checked out kubernetes.core to 2.4.0
2026-08-28 03:59:28.179788 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-08-28 03:59:28.179805 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.179823 | instance | Process install dependency map
2026-08-28 03:59:28.179840 | instance | Starting collection install process
2026-08-28 03:59:28.179857 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-08-28 03:59:28.179875 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-08-28 03:59:28.179893 | instance | kubernetes.core:2.4.0 was installed successfully
2026-08-28 03:59:28.179910 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.179928 | instance | 2.17.12
2026-08-28 03:59:28.179946 | instance | Checked out openstack.cloud to 2.6.0
2026-08-28 03:59:28.179963 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-08-28 03:59:28.179982 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.180000 | instance | Process install dependency map
2026-08-28 03:59:28.180017 | instance | Starting collection install process
2026-08-28 03:59:28.180035 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-08-28 03:59:28.180052 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-08-28 03:59:28.180069 | instance | openstack.cloud:2.6.0 was installed successfully
2026-08-28 03:59:28.180086 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.180103 | instance | 2.17.12
2026-08-28 03:59:28.180121 | instance | Checked out vexxhost.ceph to v4.2.0
2026-08-28 03:59:28.180138 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-08-28 03:59:28.180160 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.180178 | instance | Process install dependency map
2026-08-28 03:59:28.180196 | instance | Starting collection install process
2026-08-28 03:59:28.180214 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-08-28 03:59:28.180232 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-08-28 03:59:28.180250 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-08-28 03:59:28.180267 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.180284 | instance | 2.17.12
2026-08-28 03:59:28.180301 | instance | Checked out vexxhost.containers to v1.6.8
2026-08-28 03:59:28.180319 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-08-28 03:59:28.180336 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.180353 | instance | Process install dependency map
2026-08-28 03:59:28.180370 | instance | Starting collection install process
2026-08-28 03:59:28.180388 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-08-28 03:59:28.180405 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-08-28 03:59:28.180422 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-08-28 03:59:28.180440 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.180457 | instance | 2.17.12
2026-08-28 03:59:28.180474 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-08-28 03:59:28.180492 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-08-28 03:59:28.180511 | instance | Starting galaxy collection install process
2026-08-28 03:59:28.180529 | instance | Process install dependency map
2026-08-28 03:59:28.180548 | instance | Starting collection install process
2026-08-28 03:59:28.180565 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-08-28 03:59:28.180582 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-08-28 03:59:28.180600 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-08-28 03:59:28.180617 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-08-28 03:59:28.180635 | instance | 2.17.12
2026-08-28 03:59:28.186387 | 
2026-08-28 03:59:28.186429 | PLAY RECAP
2026-08-28 03:59:28.186473 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 03:59:28.186495 | 
2026-08-28 03:59:28.305464 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-28 03:59:28.308244 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-28 03:59:28.882649 | 
2026-08-28 03:59:28.882772 | PLAY [all]
2026-08-28 03:59:28.894737 | 
2026-08-28 03:59:28.894810 | TASK [Install "jq" for log collection]
2026-08-28 03:59:38.554302 | instance | changed
2026-08-28 03:59:38.556590 | 
2026-08-28 03:59:38.556669 | PLAY RECAP
2026-08-28 03:59:38.556737 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-28 03:59:38.556803 | 
2026-08-28 03:59:38.767921 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-08-28 03:59:38.771205 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-28 03:59:39.385566 | 
2026-08-28 03:59:39.385701 | PLAY [all]
2026-08-28 03:59:39.396730 | 
2026-08-28 03:59:39.396800 | LOOP [Check inventory directories]
2026-08-28 03:59:39.739242 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-08-28 03:59:39.902977 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-08-28 03:59:40.067114 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-08-28 03:59:40.228594 | 
2026-08-28 03:59:40.228715 | LOOP [Copy inventory file for Zuul]
2026-08-28 03:59:41.027024 | instance | changed:
2026-08-28 03:59:41.027262 | instance | {
2026-08-28 03:59:41.027304 | instance |   "ansible_loop_var": "item",
2026-08-28 03:59:41.027340 | instance |   "changed": false,
2026-08-28 03:59:41.027370 | instance |   "failed": false,
2026-08-28 03:59:41.027402 | instance |   "invocation": {
2026-08-28 03:59:41.027431 | instance |     "module_args": {
2026-08-28 03:59:41.027458 | instance |       "checksum_algorithm": "sha1",
2026-08-28 03:59:41.027486 | instance |       "follow": true,
2026-08-28 03:59:41.027514 | instance |       "get_attributes": true,
2026-08-28 03:59:41.027543 | instance |       "get_checksum": true,
2026-08-28 03:59:41.027571 | instance |       "get_mime": true,
2026-08-28 03:59:41.027598 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-08-28 03:59:41.027625 | instance |     }
2026-08-28 03:59:41.027652 | instance |   },
2026-08-28 03:59:41.027679 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-08-28 03:59:41.027706 | instance |   "stat": {
2026-08-28 03:59:41.027733 | instance |     "atime": 1787889561.4483223,
2026-08-28 03:59:41.027760 | instance |     "attr_flags": "e",
2026-08-28 03:59:41.027787 | instance |     "attributes": [
2026-08-28 03:59:41.027814 | instance |       "extents"
2026-08-28 03:59:41.027840 | instance |     ],
2026-08-28 03:59:41.027866 | instance |     "block_size": 4096,
2026-08-28 03:59:41.027892 | instance |     "blocks": 8,
2026-08-28 03:59:41.027918 | instance |     "charset": "unknown",
2026-08-28 03:59:41.027946 | instance |     "ctime": 1787889560.532281,
2026-08-28 03:59:41.027973 | instance |     "dev": 64513,
2026-08-28 03:59:41.028000 | instance |     "device_type": 0,
2026-08-28 03:59:41.028027 | instance |     "executable": true,
2026-08-28 03:59:41.028054 | instance |     "exists": true,
2026-08-28 03:59:41.028080 | instance |     "gid": 1000,
2026-08-28 03:59:41.028106 | instance |     "gr_name": "zuul",
2026-08-28 03:59:41.028132 | instance |     "inode": 1048043,
2026-08-28 03:59:41.028282 | instance |     "isblk": false,
2026-08-28 03:59:41.028314 | instance |     "ischr": false,
2026-08-28 03:59:41.028341 | instance |     "isdir": true,
2026-08-28 03:59:41.028368 | instance |     "isfifo": false,
2026-08-28 03:59:41.028394 | instance |     "isgid": false,
2026-08-28 03:59:41.028421 | instance |     "islnk": false,
2026-08-28 03:59:41.028450 | instance |     "isreg": false,
2026-08-28 03:59:41.028477 | instance |     "issock": false,
2026-08-28 03:59:41.028503 | instance |     "isuid": false,
2026-08-28 03:59:41.028529 | instance |     "mimetype": "unknown",
2026-08-28 03:59:41.028556 | instance |     "mode": "0755",
2026-08-28 03:59:41.028581 | instance |     "mtime": 1787889560.532281,
2026-08-28 03:59:41.028607 | instance |     "nlink": 21,
2026-08-28 03:59:41.028632 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-08-28 03:59:41.028659 | instance |     "pw_name": "zuul",
2026-08-28 03:59:41.028691 | instance |     "readable": true,
2026-08-28 03:59:41.028719 | instance |     "rgrp": true,
2026-08-28 03:59:41.028745 | instance |     "roth": true,
2026-08-28 03:59:41.028772 | instance |     "rusr": true,
2026-08-28 03:59:41.028798 | instance |     "size": 4096,
2026-08-28 03:59:41.028823 | instance |     "uid": 1000,
2026-08-28 03:59:41.028860 | instance |     "version": "2779530234",
2026-08-28 03:59:41.028888 | instance |     "wgrp": false,
2026-08-28 03:59:41.028918 | instance |     "woth": false,
2026-08-28 03:59:41.028946 | instance |     "writeable": true,
2026-08-28 03:59:41.028994 | instance |     "wusr": true,
2026-08-28 03:59:41.029022 | instance |     "xgrp": true,
2026-08-28 03:59:41.029048 | instance |     "xoth": true,
2026-08-28 03:59:41.029074 | instance |     "xusr": true
2026-08-28 03:59:41.029100 | instance |   }
2026-08-28 03:59:41.029127 | instance | }
2026-08-28 03:59:41.029176 | instance | ok: All items complete
2026-08-28 03:59:41.029208 | 
2026-08-28 03:59:41.030870 | instance | skipping: Conditional result was False
2026-08-28 03:59:41.031638 | instance | skipping: Conditional result was False
2026-08-28 03:59:41.048626 | 
2026-08-28 03:59:41.048802 | LOOP [Switch "ansible_host" to private IP]
2026-08-28 03:59:41.427075 | instance | changed: 1 replacements made
2026-08-28 03:59:41.428859 | instance | skipping: Conditional result was False
2026-08-28 03:59:41.431333 | instance | skipping: Conditional result was False
2026-08-28 03:59:41.450469 | 
2026-08-28 03:59:41.450683 | TASK [Run Molecule scenario]
2026-08-28 03:59:42.334089 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-08-28 03:59:42.729010 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-28 03:59:42.729058 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-08-28 03:59:52.545506 | instance | INFO     [csi > dependency] Executing
2026-08-28 03:59:52.545892 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-08-28 03:59:52.546294 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-08-28 03:59:52.546506 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-28 03:59:52.560637 | instance | INFO     [csi > cleanup] Executing
2026-08-28 03:59:52.561243 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-28 03:59:52.575446 | instance | INFO     [csi > destroy] Executing
2026-08-28 03:59:52.575578 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-08-28 03:59:52.575750 | instance | INFO     [csi > destroy] Executed: Successful
2026-08-28 03:59:52.584462 | instance | INFO     [csi > syntax] Executing
2026-08-28 03:59:53.993578 | instance |
2026-08-28 03:59:53.993849 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 03:59:54.048151 | instance | INFO     [csi > syntax] Executed: Successful
2026-08-28 03:59:54.063472 | instance | INFO     [csi > create] Executing
2026-08-28 03:59:54.067059 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-28 03:59:54.081621 | instance | INFO     [csi > prepare] Executing
2026-08-28 03:59:54.790847 | instance |
2026-08-28 03:59:54.791074 | instance | PLAY [Prepare] *****************************************************************
2026-08-28 03:59:54.791290 | instance |
2026-08-28 03:59:54.791529 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 03:59:54.791760 | instance | Friday 28 August 2026  03:59:54 +0000 (0:00:00.022)       0:00:00.022 *********
2026-08-28 03:59:55.949377 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-28 03:59:55.949605 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-28 03:59:55.949843 | instance | interpreter could change the meaning of that path. See
2026-08-28 03:59:55.950101 | instance | https://docs.ansible.com/ansible-
2026-08-28 03:59:55.950337 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-28 03:59:55.955639 | instance | ok: [instance]
2026-08-28 03:59:55.955864 | instance |
2026-08-28 03:59:55.956127 | instance | TASK [Configure short hostname] ************************************************
2026-08-28 03:59:55.956359 | instance | Friday 28 August 2026  03:59:55 +0000 (0:00:01.165)       0:00:01.188 *********
2026-08-28 03:59:56.647854 | instance | changed: [instance]
2026-08-28 03:59:56.648116 | instance |
2026-08-28 03:59:56.648381 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-28 03:59:56.648666 | instance | Friday 28 August 2026  03:59:56 +0000 (0:00:00.691)       0:00:01.879 *********
2026-08-28 03:59:56.930417 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-28 03:59:56.930650 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-08-28 03:59:56.930898 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-28 03:59:56.939635 | instance | changed: [instance]
2026-08-28 03:59:56.939881 | instance |
2026-08-28 03:59:56.940128 | instance | TASK [Purge "snapd" package] ***************************************************
2026-08-28 03:59:56.940360 | instance | Friday 28 August 2026  03:59:56 +0000 (0:00:00.291)       0:00:02.171 *********
2026-08-28 03:59:57.693045 | instance | ok: [instance]
2026-08-28 03:59:57.693265 | instance |
2026-08-28 03:59:57.693511 | instance | PLAY [Create devices for Ceph] *************************************************
2026-08-28 03:59:57.693737 | instance |
2026-08-28 03:59:57.693996 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 03:59:57.694193 | instance | Friday 28 August 2026  03:59:57 +0000 (0:00:00.753)       0:00:02.924 *********
2026-08-28 03:59:58.430053 | instance | ok: [instance]
2026-08-28 03:59:58.430271 | instance |
2026-08-28 03:59:58.430542 | instance | TASK [Install depedencies] *****************************************************
2026-08-28 03:59:58.430819 | instance | Friday 28 August 2026  03:59:58 +0000 (0:00:00.736)       0:00:03.661 *********
2026-08-28 04:00:23.981886 | instance | changed: [instance]
2026-08-28 04:00:23.982118 | instance |
2026-08-28 04:00:23.982379 | instance | TASK [Start up service] ********************************************************
2026-08-28 04:00:23.982654 | instance | Friday 28 August 2026  04:00:23 +0000 (0:00:25.552)       0:00:29.213 *********
2026-08-28 04:00:24.519065 | instance | ok: [instance]
2026-08-28 04:00:24.519258 | instance |
2026-08-28 04:00:24.519497 | instance | TASK [Generate lvm.conf] *******************************************************
2026-08-28 04:00:24.519759 | instance | Friday 28 August 2026  04:00:24 +0000 (0:00:00.537)       0:00:29.750 *********
2026-08-28 04:00:24.832353 | instance | ok: [instance]
2026-08-28 04:00:24.832597 | instance |
2026-08-28 04:00:24.832842 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-28 04:00:24.833097 | instance | Friday 28 August 2026  04:00:24 +0000 (0:00:00.313)       0:00:30.064 *********
2026-08-28 04:00:25.480423 | instance | changed: [instance]
2026-08-28 04:00:25.480465 | instance |
2026-08-28 04:00:25.480473 | instance | TASK [Get list of all loopback devices] ****************************************
2026-08-28 04:00:25.480480 | instance | Friday 28 August 2026  04:00:25 +0000 (0:00:00.647)       0:00:30.711 *********
2026-08-28 04:00:25.676059 | instance | ok: [instance]
2026-08-28 04:00:25.676574 | instance |
2026-08-28 04:00:25.676616 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-08-28 04:00:25.676856 | instance | Friday 28 August 2026  04:00:25 +0000 (0:00:00.196)       0:00:30.907 *********
2026-08-28 04:00:25.697229 | instance | skipping: [instance]
2026-08-28 04:00:25.697693 | instance |
2026-08-28 04:00:25.697717 | instance | TASK [Create devices for Ceph] *************************************************
2026-08-28 04:00:25.697725 | instance | Friday 28 August 2026  04:00:25 +0000 (0:00:00.021)       0:00:30.929 *********
2026-08-28 04:00:26.266110 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:00:26.266163 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:00:26.266174 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:00:26.266184 | instance |
2026-08-28 04:00:26.266193 | instance | TASK [Set permissions on loopback devices] *************************************
2026-08-28 04:00:26.266203 | instance | Friday 28 August 2026  04:00:26 +0000 (0:00:00.566)       0:00:31.496 *********
2026-08-28 04:00:26.914696 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:00:26.914944 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:00:26.915294 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:00:26.915623 | instance |
2026-08-28 04:00:26.915936 | instance | TASK [Start loop devices] ******************************************************
2026-08-28 04:00:26.916244 | instance | Friday 28 August 2026  04:00:26 +0000 (0:00:00.650)       0:00:32.146 *********
2026-08-28 04:00:27.615143 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:00:27.616184 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:00:27.616410 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:00:27.616423 | instance |
2026-08-28 04:00:27.616430 | instance | TASK [Create a volume group for each loop device] ******************************
2026-08-28 04:00:27.616437 | instance | Friday 28 August 2026  04:00:27 +0000 (0:00:00.700)       0:00:32.847 *********
2026-08-28 04:00:30.811966 | instance | changed: [instance] => (item=osd0)
2026-08-28 04:00:30.812595 | instance | changed: [instance] => (item=osd1)
2026-08-28 04:00:30.812645 | instance | changed: [instance] => (item=osd2)
2026-08-28 04:00:30.812656 | instance |
2026-08-28 04:00:30.812673 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-08-28 04:00:30.812789 | instance | Friday 28 August 2026  04:00:30 +0000 (0:00:03.196)       0:00:36.044 *********
2026-08-28 04:00:32.617121 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-08-28 04:00:32.617158 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-08-28 04:00:32.617175 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-08-28 04:00:32.617182 | instance |
2026-08-28 04:00:32.617188 | instance | PLAY RECAP *********************************************************************
2026-08-28 04:00:32.617214 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-28 04:00:32.620553 | instance |
2026-08-28 04:00:32.620593 | instance | Friday 28 August 2026  04:00:32 +0000 (0:00:01.805)       0:00:37.849 *********
2026-08-28 04:00:32.620600 | instance | ===============================================================================
2026-08-28 04:00:32.620606 | instance | Install depedencies ---------------------------------------------------- 25.55s
2026-08-28 04:00:32.620612 | instance | Create a volume group for each loop device ------------------------------ 3.20s
2026-08-28 04:00:32.620617 | instance | Create a logical volume for each loop device ---------------------------- 1.81s
2026-08-28 04:00:32.620623 | instance | Gathering Facts --------------------------------------------------------- 1.17s
2026-08-28 04:00:32.620628 | instance | Purge "snapd" package --------------------------------------------------- 0.75s
2026-08-28 04:00:32.620634 | instance | Gathering Facts --------------------------------------------------------- 0.74s
2026-08-28 04:00:32.620639 | instance | Start loop devices ------------------------------------------------------ 0.70s
2026-08-28 04:00:32.620645 | instance | Configure short hostname ------------------------------------------------ 0.69s
2026-08-28 04:00:32.620650 | instance | Set permissions on loopback devices ------------------------------------- 0.65s
2026-08-28 04:00:32.620656 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s
2026-08-28 04:00:32.620661 | instance | Create devices for Ceph ------------------------------------------------- 0.57s
2026-08-28 04:00:32.620811 | instance | Start up service -------------------------------------------------------- 0.54s
2026-08-28 04:00:32.621132 | instance | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-08-28 04:00:32.621425 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-28 04:00:32.621742 | instance | Get list of all loopback devices ---------------------------------------- 0.20s
2026-08-28 04:00:32.622031 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-08-28 04:00:32.701131 | instance | INFO     [csi > prepare] Executed: Successful
2026-08-28 04:00:32.716038 | instance | INFO     [csi > converge] Executing
2026-08-28 04:00:34.110310 | instance |
2026-08-28 04:00:34.110587 | instance | PLAY [Debug CSI driver value] **************************************************
2026-08-28 04:00:34.110779 | instance |
2026-08-28 04:00:34.110977 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:00:34.111173 | instance | Friday 28 August 2026  04:00:34 +0000 (0:00:00.011)       0:00:00.011 *********
2026-08-28 04:00:35.081920 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-08-28 04:00:35.081968 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-28 04:00:35.081975 | instance | interpreter could change the meaning of that path. See
2026-08-28 04:00:35.081981 | instance | https://docs.ansible.com/ansible-
2026-08-28 04:00:35.081987 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-08-28 04:00:35.090970 | instance | ok: [instance]
2026-08-28 04:00:35.091011 | instance |
2026-08-28 04:00:35.091018 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-08-28 04:00:35.091025 | instance | Friday 28 August 2026  04:00:35 +0000 (0:00:00.980)       0:00:00.991 *********
2026-08-28 04:00:35.128623 | instance | ok: [instance] => {
2026-08-28 04:00:35.128692 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-08-28 04:00:35.128704 | instance | }
2026-08-28 04:00:35.128720 | instance |
2026-08-28 04:00:35.129345 | instance | PLAY [all] *********************************************************************
2026-08-28 04:00:35.129410 | instance |
2026-08-28 04:00:35.129417 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:00:35.129443 | instance | Friday 28 August 2026  04:00:35 +0000 (0:00:00.037)       0:00:01.029 *********
2026-08-28 04:00:36.030501 | instance | ok: [instance]
2026-08-28 04:00:36.030709 | instance |
2026-08-28 04:00:36.031063 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-08-28 04:00:36.031477 | instance | Friday 28 August 2026  04:00:36 +0000 (0:00:00.901)       0:00:01.931 *********
2026-08-28 04:00:36.221184 | instance | ok: [instance]
2026-08-28 04:00:36.221307 | instance |
2026-08-28 04:00:36.221556 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-28 04:00:36.221740 | instance |
2026-08-28 04:00:36.221933 | instance | TASK [Gathering Facts] *********************************************************
2026-08-28 04:00:36.222127 | instance | Friday 28 August 2026  04:00:36 +0000 (0:00:00.191)       0:00:02.122 *********
2026-08-28 04:00:37.049417 | instance | ok: [instance]
2026-08-28 04:00:37.049537 | instance |
2026-08-28 04:00:37.049762 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:00:37.049957 | instance | Friday 28 August 2026  04:00:37 +0000 (0:00:00.828)       0:00:02.950 *********
2026-08-28 04:00:37.369612 | instance | ok: [instance]
2026-08-28 04:00:37.369708 | instance |
2026-08-28 04:00:37.369888 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:00:37.370119 | instance | Friday 28 August 2026  04:00:37 +0000 (0:00:00.320)       0:00:03.270 *********
2026-08-28 04:00:37.413062 | instance | skipping: [instance]
2026-08-28 04:00:37.413176 | instance |
2026-08-28 04:00:37.413431 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-28 04:00:37.413636 | instance | Friday 28 August 2026  04:00:37 +0000 (0:00:00.041)       0:00:03.312 *********
2026-08-28 04:00:37.792266 | instance | changed: [instance]
2026-08-28 04:00:37.792533 | instance |
2026-08-28 04:00:37.792734 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:00:37.792947 | instance | Friday 28 August 2026  04:00:37 +0000 (0:00:00.379)       0:00:03.691 *********
2026-08-28 04:00:37.862593 | instance | ok: [instance] => {
2026-08-28 04:00:37.862636 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-28 04:00:37.862643 | instance | }
2026-08-28 04:00:37.862649 | instance |
2026-08-28 04:00:37.862655 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:00:37.862661 | instance | Friday 28 August 2026  04:00:37 +0000 (0:00:00.071)       0:00:03.762 *********
2026-08-28 04:00:38.472315 | instance | changed: [instance]
2026-08-28 04:00:38.472374 | instance |
2026-08-28 04:00:38.472381 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:00:38.472391 | instance | Friday 28 August 2026  04:00:38 +0000 (0:00:00.607)       0:00:04.370 *********
2026-08-28 04:00:38.518760 | instance | skipping: [instance]
2026-08-28 04:00:38.518991 | instance |
2026-08-28 04:00:38.519281 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:00:38.519573 | instance | Friday 28 August 2026  04:00:38 +0000 (0:00:00.049)       0:00:04.419 *********
2026-08-28 04:00:38.567632 | instance | skipping: [instance]
2026-08-28 04:00:38.567766 | instance |
2026-08-28 04:00:38.567932 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:00:38.568093 | instance | Friday 28 August 2026  04:00:38 +0000 (0:00:00.049)       0:00:04.468 *********
2026-08-28 04:00:38.816390 | instance | ok: [instance]
2026-08-28 04:00:38.816519 | instance |
2026-08-28 04:00:38.816689 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-28 04:00:38.816850 | instance | Friday 28 August 2026  04:00:38 +0000 (0:00:00.248)       0:00:04.717 *********
2026-08-28 04:00:40.077417 | instance | ok: [instance]
2026-08-28 04:00:40.077863 | instance |
2026-08-28 04:00:40.077881 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:00:40.077888 | instance | Friday 28 August 2026  04:00:40 +0000 (0:00:01.261)       0:00:05.978 *********
2026-08-28 04:00:40.144159 | instance | ok: [instance] => {
2026-08-28 04:00:40.144662 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-28 04:00:40.144743 | instance | }
2026-08-28 04:00:40.144756 | instance |
2026-08-28 04:00:40.145071 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:00:40.145096 | instance | Friday 28 August 2026  04:00:40 +0000 (0:00:00.066)       0:00:06.045 *********
2026-08-28 04:00:41.006178 | instance | changed: [instance]
2026-08-28 04:00:41.006220 | instance |
2026-08-28 04:00:41.006227 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:00:41.006233 | instance | Friday 28 August 2026  04:00:40 +0000 (0:00:00.861)       0:00:06.906 *********
2026-08-28 04:00:43.852280 | instance | changed: [instance]
2026-08-28 04:00:43.852326 | instance |
2026-08-28 04:00:43.852333 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-28 04:00:43.852340 | instance | Friday 28 August 2026  04:00:43 +0000 (0:00:02.846)       0:00:09.753 *********
2026-08-28 04:00:43.891570 | instance | skipping: [instance]
2026-08-28 04:00:43.892361 | instance |
2026-08-28 04:00:43.892539 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-28 04:00:43.892550 | instance | Friday 28 August 2026  04:00:43 +0000 (0:00:00.039)       0:00:09.792 *********
2026-08-28 04:00:43.918816 | instance | skipping: [instance]
2026-08-28 04:00:43.919579 | instance |
2026-08-28 04:00:43.919620 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-28 04:00:43.919628 | instance | Friday 28 August 2026  04:00:43 +0000 (0:00:00.027)       0:00:09.819 *********
2026-08-28 04:00:43.953086 | instance | skipping: [instance]
2026-08-28 04:00:43.953819 | instance |
2026-08-28 04:00:43.953869 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-28 04:00:43.953880 | instance | Friday 28 August 2026  04:00:43 +0000 (0:00:00.033)       0:00:09.853 *********
2026-08-28 04:00:49.581325 | instance | changed: [instance]
2026-08-28 04:00:49.581541 | instance |
2026-08-28 04:00:49.581894 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-28 04:00:49.582223 | instance | Friday 28 August 2026  04:00:49 +0000 (0:00:05.628)       0:00:15.481 *********
2026-08-28 04:00:50.124814 | instance | changed: [instance]
2026-08-28 04:00:50.124930 | instance |
2026-08-28 04:00:50.125304 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-28 04:00:50.125422 | instance | Friday 28 August 2026  04:00:50 +0000 (0:00:00.544)       0:00:16.025 *********
2026-08-28 04:00:51.023217 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-08-28 04:00:51.023284 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-28 04:00:51.024017 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-28 04:00:51.024055 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-28 04:00:51.024061 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-28 04:00:51.024065 | instance |
2026-08-28 04:00:51.024073 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-28 04:00:51.024078 | instance | Friday 28 August 2026  04:00:51 +0000 (0:00:00.898)       0:00:16.924 *********
2026-08-28 04:00:51.650229 | instance | changed: [instance]
2026-08-28 04:00:51.651186 | instance |
2026-08-28 04:00:51.651205 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-28 04:00:51.651212 | instance | Friday 28 August 2026  04:00:51 +0000 (0:00:00.604)       0:00:17.528 *********
2026-08-28 04:00:51.651218 | instance |
2026-08-28 04:00:51.651223 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-28 04:00:51.651229 | instance | Friday 28 August 2026  04:00:51 +0000 (0:00:00.022)       0:00:17.551 *********
2026-08-28 04:00:52.572925 | instance | ok: [instance]
2026-08-28 04:00:52.573412 | instance |
2026-08-28 04:00:52.573449 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-28 04:00:52.573457 | instance | Friday 28 August 2026  04:00:52 +0000 (0:00:00.922)       0:00:18.474 *********
2026-08-28 04:00:53.005083 | instance | changed: [instance]
2026-08-28 04:00:53.005225 | instance |
2026-08-28 04:00:53.005431 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-28 04:00:53.005626 | instance | Friday 28 August 2026  04:00:52 +0000 (0:00:00.432)       0:00:18.906 *********
2026-08-28 04:00:53.502954 | instance | changed: [instance]
2026-08-28 04:00:53.503316 | instance |
2026-08-28 04:00:53.503332 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-28 04:00:53.503337 | instance | Friday 28 August 2026  04:00:53 +0000 (0:00:00.498)       0:00:19.404 *********
2026-08-28 04:00:53.690768 | instance | ok: [instance]
2026-08-28 04:00:53.690805 | instance |
2026-08-28 04:00:53.690810 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-28 04:00:53.690815 | instance | Friday 28 August 2026  04:00:53 +0000 (0:00:00.187)       0:00:19.591 *********
2026-08-28 04:00:53.742382 | instance | ok: [instance] => {
2026-08-28 04:00:53.742470 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-28 04:00:53.742915 | instance | }
2026-08-28 04:00:53.742952 | instance |
2026-08-28 04:00:53.742958 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-28 04:00:53.742963 | instance | Friday 28 August 2026  04:00:53 +0000 (0:00:00.051)       0:00:19.643 *********
2026-08-28 04:00:54.428391 | instance | changed: [instance]
2026-08-28 04:00:54.428582 | instance |
2026-08-28 04:00:54.428855 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-28 04:00:54.428903 | instance | Friday 28 August 2026  04:00:54 +0000 (0:00:00.685)       0:00:20.329 *********
2026-08-28 04:00:58.929717 | instance | changed: [instance]
2026-08-28 04:00:58.929870 | instance |
2026-08-28 04:00:58.930215 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-28 04:00:58.930260 | instance | Friday 28 August 2026  04:00:58 +0000 (0:00:04.501)       0:00:24.830 *********
2026-08-28 04:01:00.230129 | instance | ok: [instance]
2026-08-28 04:01:00.230587 | instance |
2026-08-28 04:01:00.230606 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-28 04:01:00.230613 | instance | Friday 28 August 2026  04:01:00 +0000 (0:00:01.300)       0:00:26.131 *********
2026-08-28 04:01:00.575605 | instance | changed: [instance]
2026-08-28 04:01:00.576614 | instance |
2026-08-28 04:01:00.576676 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-28 04:01:00.576689 | instance | Friday 28 August 2026  04:01:00 +0000 (0:00:00.344)       0:00:26.476 *********
2026-08-28 04:01:01.048995 | instance | changed: [instance]
2026-08-28 04:01:01.049727 | instance |
2026-08-28 04:01:01.049792 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-28 04:01:01.049805 | instance | Friday 28 August 2026  04:01:01 +0000 (0:00:00.473)       0:00:26.949 *********
2026-08-28 04:01:01.639172 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-08-28 04:01:01.640407 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-28 04:01:01.640532 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-28 04:01:01.640551 | instance |
2026-08-28 04:01:01.640564 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-28 04:01:01.640579 | instance | Friday 28 August 2026  04:01:01 +0000 (0:00:00.590)       0:00:27.539 *********
2026-08-28 04:01:02.097983 | instance | changed: [instance]
2026-08-28 04:01:02.098052 | instance |
2026-08-28 04:01:02.098318 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-28 04:01:02.098378 | instance | Friday 28 August 2026  04:01:02 +0000 (0:00:00.459)       0:00:27.999 *********
2026-08-28 04:01:02.606647 | instance | changed: [instance]
2026-08-28 04:01:02.606769 | instance |
2026-08-28 04:01:02.607227 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-28 04:01:02.607286 | instance | Friday 28 August 2026  04:01:02 +0000 (0:00:00.486)       0:00:28.485 *********
2026-08-28 04:01:02.607778 | instance |
2026-08-28 04:01:02.607795 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-28 04:01:02.607802 | instance | Friday 28 August 2026  04:01:02 +0000 (0:00:00.022)       0:00:28.507 *********
2026-08-28 04:01:03.330958 | instance | ok: [instance]
2026-08-28 04:01:03.331007 | instance |
2026-08-28 04:01:03.331015 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-28 04:01:03.331036 | instance | Friday 28 August 2026  04:01:03 +0000 (0:00:00.723)       0:00:29.231 *********
2026-08-28 04:01:04.496578 | instance | changed: [instance]
2026-08-28 04:01:04.497338 | instance |
2026-08-28 04:01:04.497397 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-28 04:01:04.497409 | instance | Friday 28 August 2026  04:01:04 +0000 (0:00:01.165)       0:00:30.397 *********
2026-08-28 04:01:05.088297 | instance | changed: [instance]
2026-08-28 04:01:05.088589 | instance |
2026-08-28 04:01:05.089012 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-28 04:01:05.089064 | instance | Friday 28 August 2026  04:01:05 +0000 (0:00:00.591)       0:00:30.989 *********
2026-08-28 04:01:05.164386 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-28 04:01:05.164559 | instance |
2026-08-28 04:01:05.165041 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-28 04:01:05.165090 | instance | Friday 28 August 2026  04:01:05 +0000 (0:00:00.076)       0:00:31.065 *********
2026-08-28 04:01:09.983310 | instance | changed: [instance]
2026-08-28 04:01:09.983537 | instance |
2026-08-28 04:01:09.983549 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-28 04:01:09.983561 | instance | Friday 28 August 2026  04:01:09 +0000 (0:00:04.819)       0:00:35.884 *********
2026-08-28 04:01:10.588882 | instance | ok: [instance] => (item=chronyd)
2026-08-28 04:01:10.588992 | instance | ok: [instance] => (item=sshd)
2026-08-28 04:01:10.589505 | instance |
2026-08-28 04:01:10.589550 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-28 04:01:10.589557 | instance | Friday 28 August 2026  04:01:10 +0000 (0:00:00.605)       0:00:36.489 *********
2026-08-28 04:01:10.909320 | instance | changed: [instance]
2026-08-28 04:01:10.909373 | instance |
2026-08-28 04:01:10.909614 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-28 04:01:10.909700 | instance | Friday 28 August 2026  04:01:10 +0000 (0:00:00.320)       0:00:36.810 *********
2026-08-28 04:01:11.105423 | instance | ok: [instance]
2026-08-28 04:01:11.105544 | instance |
2026-08-28 04:01:11.105860 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-28 04:01:11.105877 | instance | Friday 28 August 2026  04:01:11 +0000 (0:00:00.195)       0:00:37.006 *********
2026-08-28 04:01:11.556465 | instance | changed: [instance]
2026-08-28 04:01:11.556981 | instance |
2026-08-28 04:01:11.557004 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-28 04:01:11.557012 | instance | Friday 28 August 2026  04:01:11 +0000 (0:00:00.450)       0:00:37.457 *********
2026-08-28 04:01:11.886620 | instance | changed: [instance]
2026-08-28 04:01:11.886675 | instance |
2026-08-28 04:01:11.886920 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-28 04:01:11.886937 | instance | Friday 28 August 2026  04:01:11 +0000 (0:00:00.330)       0:00:37.787 *********
2026-08-28 04:01:11.994579 | instance | ok: [instance]
2026-08-28 04:01:11.994637 | instance |
2026-08-28 04:01:11.994896 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-28 04:01:11.994959 | instance | Friday 28 August 2026  04:01:11 +0000 (0:00:00.107)       0:00:37.895 *********
2026-08-28 04:01:12.249932 | instance | ok: [instance] => (item=instance)
2026-08-28 04:01:12.250048 | instance |
2026-08-28 04:01:12.250610 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-28 04:01:12.250673 | instance | Friday 28 August 2026  04:01:12 +0000 (0:00:00.255)       0:00:38.150 *********
2026-08-28 04:01:12.321908 | instance | ok: [instance]
2026-08-28 04:01:12.321988 | instance |
2026-08-28 04:01:12.322240 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-28 04:01:12.322282 | instance | Friday 28 August 2026  04:01:12 +0000 (0:00:00.072)       0:00:38.222 *********
2026-08-28 04:01:12.386303 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-08-28 04:01:12.386379 | instance |
2026-08-28 04:01:12.386445 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-28 04:01:12.386556 | instance | Friday 28 August 2026  04:01:12 +0000 (0:00:00.064)       0:00:38.287 *********
2026-08-28 04:01:12.689579 | instance | changed: [instance]
2026-08-28 04:01:12.690395 | instance |
2026-08-28 04:01:12.690428 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-28 04:01:12.690439 | instance | Friday 28 August 2026  04:01:12 +0000 (0:00:00.302)       0:00:38.590 *********
2026-08-28 04:01:13.373172 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-08-28 04:01:13.374411 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-28 04:01:13.374444 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-28 04:01:13.374455 | instance |
2026-08-28 04:01:13.374465 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-28 04:01:13.374475 | instance | Friday 28 August 2026  04:01:13 +0000 (0:00:00.683)       0:00:39.273 *********
2026-08-28 04:02:43.533069 | instance | ok: [instance]
2026-08-28 04:02:43.533144 | instance |
2026-08-28 04:02:43.533386 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-28 04:02:43.533424 | instance | Friday 28 August 2026  04:02:43 +0000 (0:01:30.160)       0:02:09.434 *********
2026-08-28 04:02:43.764084 | instance | changed: [instance]
2026-08-28 04:02:43.764300 | instance |
2026-08-28 04:02:43.764609 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-28 04:02:43.764848 | instance | Friday 28 August 2026  04:02:43 +0000 (0:00:00.230)       0:02:09.664 *********
2026-08-28 04:02:43.847686 | instance | ok: [instance]
2026-08-28 04:02:43.847763 | instance |
2026-08-28 04:02:43.848025 | instance | TASK [Install Ceph host] *******************************************************
2026-08-28 04:02:43.848067 | instance | Friday 28 August 2026  04:02:43 +0000 (0:00:00.084)       0:02:09.749 *********
2026-08-28 04:02:43.926210 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-08-28 04:02:43.926301 | instance |
2026-08-28 04:02:43.926542 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-28 04:02:43.926575 | instance | Friday 28 August 2026  04:02:43 +0000 (0:00:00.078)       0:02:09.827 *********
2026-08-28 04:02:45.784266 | instance | ok: [instance]
2026-08-28 04:02:45.784513 | instance |
2026-08-28 04:02:45.784842 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-28 04:02:45.785099 | instance | Friday 28 August 2026  04:02:45 +0000 (0:00:01.857)       0:02:11.685 *********
2026-08-28 04:02:45.857475 | instance | ok: [instance] => (item=instance)
2026-08-28 04:02:45.857627 | instance |
2026-08-28 04:02:45.857878 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-28 04:02:45.858124 | instance | Friday 28 August 2026  04:02:45 +0000 (0:00:00.073)       0:02:11.758 *********
2026-08-28 04:02:46.233436 | instance | ok: [instance]
2026-08-28 04:02:46.233785 | instance |
2026-08-28 04:02:46.234104 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-28 04:02:46.234386 | instance | Friday 28 August 2026  04:02:46 +0000 (0:00:00.375)       0:02:12.133 *********
2026-08-28 04:02:48.501116 | instance | ok: [instance]
2026-08-28 04:02:48.501315 | instance |
2026-08-28 04:02:48.501624 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-28 04:02:48.501881 | instance | Friday 28 August 2026  04:02:48 +0000 (0:00:02.267)       0:02:14.401 *********
2026-08-28 04:03:40.125531 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-08-28 04:03:40.125969 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_efv8241p/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_efv8241p/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_efv8241p/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_efv8241p/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgA9CJFqnq9KAyAAfrFZ61ULrmp30ytUcP+JDAFXnzbJUCA3X6QCemrzSwI=: Malformed input [buffer:3]\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgA9CJFqnq9KAyAAfrFZ61ULrmp30ytUcP+JDAFXnzbJUCA3X6QCemrzSwI=: Malformed input [buffer:3]\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgA9CJFqnq9KAyAAfrFZ61ULrmp30ytUcP+JDAFXnzbJUCA3X6QCemrzSwI=: Malformed input [buffer:3]\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:03:39.952+0000 7f44fb750640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-08-28 04:03:40.126632 | instance |
2026-08-28 04:03:40.127582 | instance | PLAY RECAP *********************************************************************
2026-08-28 04:03:40.127620 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-08-28 04:03:40.127636 | instance |
2026-08-28 04:03:40.127655 | instance | Friday 28 August 2026  04:03:40 +0000 (0:00:51.626)       0:03:06.028 *********
2026-08-28 04:03:40.128581 | instance | ===============================================================================
2026-08-28 04:03:40.128610 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 90.16s
2026-08-28 04:03:40.128620 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 51.63s
2026-08-28 04:03:40.128629 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.63s
2026-08-28 04:03:40.130169 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.82s
2026-08-28 04:03:40.130203 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.50s
2026-08-28 04:03:40.130214 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.85s
2026-08-28 04:03:40.130223 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.27s
2026-08-28 04:03:40.130232 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.86s
2026-08-28 04:03:40.130257 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.65s
2026-08-28 04:03:40.130266 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.30s
2026-08-28 04:03:40.130280 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.26s
2026-08-28 04:03:40.130552 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 1.17s
2026-08-28 04:03:40.130910 | instance | Gathering Facts --------------------------------------------------------- 0.98s
2026-08-28 04:03:40.131205 | instance | Gathering Facts --------------------------------------------------------- 0.90s
2026-08-28 04:03:40.131514 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.90s
2026-08-28 04:03:40.131815 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.86s
2026-08-28 04:03:40.132141 | instance | Gathering Facts --------------------------------------------------------- 0.83s
2026-08-28 04:03:40.132453 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.69s
2026-08-28 04:03:40.132788 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.68s
2026-08-28 04:03:40.133078 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.61s
2026-08-28 04:03:40.238125 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 04:03:40.238315 | instance | ERROR    [csi > converge] Executed: Failed
2026-08-28 04:03:40.238460 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-08-28 04:03:40.790514 | instance | ERROR
2026-08-28 04:03:40.790698 | instance | {
2026-08-28 04:03:40.790739 | instance |   "delta": "0:03:58.487215",
2026-08-28 04:03:40.790761 | instance |   "end": "2026-08-28 04:03:40.290615",
2026-08-28 04:03:40.790780 | instance |   "msg": "non-zero return code",
2026-08-28 04:03:40.790798 | instance |   "rc": 2,
2026-08-28 04:03:40.790816 | instance |   "start": "2026-08-28 03:59:41.803400"
2026-08-28 04:03:40.790834 | instance | }
failure
2026-08-28 04:03:40.796387 | 
2026-08-28 04:03:40.796437 | PLAY RECAP
2026-08-28 04:03:40.796488 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-28 04:03:40.796511 | 
2026-08-28 04:03:40.987694 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-28 04:03:40.993110 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-28 04:03:41.678936 | 
2026-08-28 04:03:41.679094 | PLAY [all]
2026-08-28 04:03:41.701468 | 
2026-08-28 04:03:41.701785 | TASK [gather-host-logs : creating directory for system status]
2026-08-28 04:03:42.075650 | instance | changed
2026-08-28 04:03:42.082429 | 
2026-08-28 04:03:42.082530 | TASK [gather-host-logs : Get logs for each host]
2026-08-28 04:03:42.448219 | instance | + systemd-cgls --full --all --no-pager
2026-08-28 04:03:42.470424 | instance | + ip addr
2026-08-28 04:03:42.473196 | instance | + ip route
2026-08-28 04:03:42.475647 | instance | + lsblk
2026-08-28 04:03:42.481284 | instance | + mount
2026-08-28 04:03:42.484108 | instance | + docker images
2026-08-28 04:03:42.505626 | instance | + brctl show
2026-08-28 04:03:42.506168 | instance | /bin/bash: line 8: brctl: command not found
2026-08-28 04:03:42.506443 | instance | + ps aux --sort=-%mem
2026-08-28 04:03:42.544639 | instance | + dpkg -l
2026-08-28 04:03:42.555536 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-08-28 04:03:42.556006 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-08-28 04:03:42.575340 | instance | + '[' '!' -z '' ']'
2026-08-28 04:03:42.621919 | instance | ok: Runtime: 0:00:00.131602
2026-08-28 04:03:42.629337 | 
2026-08-28 04:03:42.629418 | TASK [gather-host-logs : Downloads logs to executor]
2026-08-28 04:03:43.304750 | instance | changed:
2026-08-28 04:03:43.304971 | instance | created directory /var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/logs/instance
2026-08-28 04:03:43.305014 | instance | cd+++++++++ system/
2026-08-28 04:03:43.305045 | instance | >f+++++++++ system/brctl-show.txt
2026-08-28 04:03:43.305074 | instance | >f+++++++++ system/docker-images.txt
2026-08-28 04:03:43.305101 | instance | >f+++++++++ system/ip-addr.txt
2026-08-28 04:03:43.305131 | instance | >f+++++++++ system/ip-route.txt
2026-08-28 04:03:43.305160 | instance | >f+++++++++ system/lsblk.txt
2026-08-28 04:03:43.305187 | instance | >f+++++++++ system/mount.txt
2026-08-28 04:03:43.305214 | instance | >f+++++++++ system/packages.txt
2026-08-28 04:03:43.305240 | instance | >f+++++++++ system/ps.txt
2026-08-28 04:03:43.305269 | instance | >f+++++++++ system/systemd-cgls.txt
2026-08-28 04:03:43.316537 | 
2026-08-28 04:03:43.316609 | LOOP [helm-release-status : creating directory for helm release status]
2026-08-28 04:03:43.527679 | instance | changed: "values"
2026-08-28 04:03:43.715389 | instance | changed: "releases"
2026-08-28 04:03:43.736474 | 
2026-08-28 04:03:43.736650 | TASK [helm-release-status : Gather get release status for helm charts]
2026-08-28 04:03:43.966561 | instance | /bin/bash: line 3: kubectl: command not found
2026-08-28 04:03:44.280462 | instance | ok: Runtime: 0:00:00.005295
2026-08-28 04:03:44.287814 | 
2026-08-28 04:03:44.287963 | TASK [helm-release-status : Downloads logs to executor]
2026-08-28 04:03:44.756863 | instance | changed:
2026-08-28 04:03:44.757329 | instance | cd+++++++++ helm/
2026-08-28 04:03:44.757385 | instance | cd+++++++++ helm/releases/
2026-08-28 04:03:44.757416 | instance | cd+++++++++ helm/values/
2026-08-28 04:03:44.768747 | 
2026-08-28 04:03:44.768827 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-08-28 04:03:44.983582 | instance | changed
2026-08-28 04:03:44.992187 | 
2026-08-28 04:03:44.992325 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-08-28 04:03:45.269805 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:03:45.269915 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:03:45.274179 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:03:45.275360 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:03:45.277324 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:03:45.278788 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:03:45.280097 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:03:45.281464 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:03:45.282283 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:03:45.283659 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:03:45.284085 | instance | environment: line 1: kubectl: command not found
2026-08-28 04:03:45.284774 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-08-28 04:03:45.529556 | instance | ok: Runtime: 0:00:00.022331
2026-08-28 04:03:45.534710 | 
2026-08-28 04:03:45.534774 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-08-28 04:03:45.753134 | instance | changed
2026-08-28 04:03:45.758546 | 
2026-08-28 04:03:45.758620 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-08-28 04:03:45.993814 | instance | environment: line 5: kubectl: command not found
2026-08-28 04:03:45.994944 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:03:45.994985 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:03:45.995295 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-08-28 04:03:46.299126 | instance | ok: Runtime: 0:00:00.008202
2026-08-28 04:03:46.306716 | 
2026-08-28 04:03:46.306807 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-08-28 04:03:46.808875 | instance | changed:
2026-08-28 04:03:46.809078 | instance | cd+++++++++ objects/
2026-08-28 04:03:46.809107 | instance | cd+++++++++ objects/cluster/
2026-08-28 04:03:46.809128 | instance | cd+++++++++ objects/namespaced/
2026-08-28 04:03:46.818585 | 
2026-08-28 04:03:46.818724 | TASK [gather-pod-logs : creating directory for pod logs]
2026-08-28 04:03:47.037520 | instance | changed
2026-08-28 04:03:47.045118 | 
2026-08-28 04:03:47.045217 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-08-28 04:03:47.260703 | instance | changed
2026-08-28 04:03:47.266406 | 
2026-08-28 04:03:47.266502 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-08-28 04:03:47.499814 | instance | environment: line 3: kubectl: command not found
2026-08-28 04:03:47.804677 | instance | ok: Runtime: 0:00:00.008420
2026-08-28 04:03:47.812257 | 
2026-08-28 04:03:47.812352 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-08-28 04:03:48.293843 | instance | changed:
2026-08-28 04:03:48.294075 | instance | cd+++++++++ pod-logs/
2026-08-28 04:03:48.294128 | instance | cd+++++++++ pod-logs/failed-pods/
2026-08-28 04:03:48.306776 | 
2026-08-28 04:03:48.306842 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-08-28 04:03:48.512001 | instance | changed
2026-08-28 04:03:48.518932 | 
2026-08-28 04:03:48.519022 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-08-28 04:03:48.741600 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-28 04:03:49.059432 | instance | ok: Runtime: 0:00:00.051553
2026-08-28 04:03:49.066338 | 
2026-08-28 04:03:49.066434 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-08-28 04:03:49.289903 | instance | /bin/bash: line 2: kubectl: command not found
2026-08-28 04:03:49.333928 | instance | ceph-mgr endpoints:
2026-08-28 04:03:49.603171 | instance | ok: Runtime: 0:00:00.049398
2026-08-28 04:03:49.611243 | 
2026-08-28 04:03:49.611312 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-08-28 04:03:49.834798 | instance | /bin/bash: line 4: kubectl: command not found
2026-08-28 04:03:50.149198 | instance | ok: Runtime: 0:00:00.055075
2026-08-28 04:03:50.156239 | 
2026-08-28 04:03:50.156330 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-08-28 04:03:50.665293 | instance | changed: cd+++++++++ prometheus/
2026-08-28 04:03:50.677849 | 
2026-08-28 04:03:50.677913 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-08-28 04:03:50.895713 | instance | changed
2026-08-28 04:03:50.902146 | 
2026-08-28 04:03:50.902241 | TASK [gather-selenium-data : Get selenium data]
2026-08-28 04:03:51.173309 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-08-28 04:03:51.174750 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-08-28 04:03:51.441227 | instance | ERROR
2026-08-28 04:03:51.441558 | instance | {
2026-08-28 04:03:51.441628 | instance |   "delta": "0:00:00.005888",
2026-08-28 04:03:51.441674 | instance |   "end": "2026-08-28 04:03:51.175044",
2026-08-28 04:03:51.441721 | instance |   "msg": "non-zero return code",
2026-08-28 04:03:51.441762 | instance |   "rc": 1,
2026-08-28 04:03:51.441803 | instance |   "start": "2026-08-28 04:03:51.169156"
2026-08-28 04:03:51.441843 | instance | }
2026-08-28 04:03:51.441894 | instance | ERROR: Ignoring Errors
2026-08-28 04:03:51.448070 | 
2026-08-28 04:03:51.448136 | TASK [gather-selenium-data : Downloads logs to executor]
2026-08-28 04:03:51.941560 | instance | changed: cd+++++++++ selenium/
2026-08-28 04:03:51.949399 | 
2026-08-28 04:03:51.949466 | PLAY RECAP
2026-08-28 04:03:51.949530 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-08-28 04:03:51.949562 | 
2026-08-28 04:03:52.103536 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-08-28 04:03:52.108366 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-28 04:03:52.791750 | 
2026-08-28 04:03:52.792329 | PLAY [all]
2026-08-28 04:03:52.804152 | 
2026-08-28 04:03:52.804227 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-28 04:03:52.849919 | instance | skipping: Conditional result was False
2026-08-28 04:03:52.860573 | 
2026-08-28 04:03:52.860680 | TASK [fetch-output : Set log path for single node]
2026-08-28 04:03:52.904721 | instance | ok
2026-08-28 04:03:52.909300 | 
2026-08-28 04:03:52.909368 | LOOP [fetch-output : Ensure local output dirs]
2026-08-28 04:03:53.300930 | instance -> localhost | ok: "/var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/logs"
2026-08-28 04:03:53.517367 | instance -> localhost | changed: "/var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/artifacts"
2026-08-28 04:03:53.742032 | instance -> localhost | changed: "/var/lib/zuul/builds/4fcedb7297a743459836f0f69bea51f0/work/docs"
2026-08-28 04:03:53.759830 | 
2026-08-28 04:03:53.760004 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-28 04:03:54.463712 | instance | changed: .d..t...... ./
2026-08-28 04:03:54.464004 | instance | changed: All items complete
2026-08-28 04:03:54.464054 | 
2026-08-28 04:03:54.936489 | instance | changed: .d..t...... ./
2026-08-28 04:03:55.476016 | instance | changed: .d..t...... ./
2026-08-28 04:03:55.497795 | 
2026-08-28 04:03:55.497939 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-28 04:03:55.915252 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007831
2026-08-28 04:03:56.134316 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.009037
2026-08-28 04:03:56.154604 | 
2026-08-28 04:03:56.154746 | PLAY [all]
2026-08-28 04:03:56.161233 | 
2026-08-28 04:03:56.161299 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-28 04:03:56.579916 | instance | changed
2026-08-28 04:03:56.588162 | 
2026-08-28 04:03:56.588214 | PLAY RECAP
2026-08-28 04:03:56.588263 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-28 04:03:56.588285 | 
2026-08-28 04:03:56.740405 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-28 04:03:56.745112 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-28 04:03:57.346287 | 
2026-08-28 04:03:57.346427 | PLAY [localhost]
2026-08-28 04:03:57.363957 | 
2026-08-28 04:03:57.364179 | TASK [Generate Zuul manifest]
2026-08-28 04:03:57.387307 | localhost | ok
2026-08-28 04:03:57.409487 | 
2026-08-28 04:03:57.409637 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-28 04:03:57.785468 | localhost | changed
2026-08-28 04:03:57.797638 | 
2026-08-28 04:03:57.797729 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-28 04:03:57.830268 | localhost | ok
2026-08-28 04:03:57.840369 | 
2026-08-28 04:03:57.840448 | TASK [Upload logs]
2026-08-28 04:03:57.864034 | localhost | ok
2026-08-28 04:03:57.925617 | 
2026-08-28 04:03:57.925796 | TASK [Set zuul-log-path fact]
2026-08-28 04:03:57.949294 | localhost | ok
2026-08-28 04:03:57.964452 | 
2026-08-28 04:03:57.964541 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-28 04:03:57.996882 | localhost | ok
2026-08-28 04:03:58.006241 | 
2026-08-28 04:03:58.006330 | TASK [upload-logs : Create log directories]
2026-08-28 04:03:58.415189 | localhost | changed
2026-08-28 04:03:58.421898 | 
2026-08-28 04:03:58.421994 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-28 04:03:58.838843 | localhost -> localhost | ok: Runtime: 0:00:00.006278
2026-08-28 04:03:58.845480 | 
2026-08-28 04:03:58.845569 | TASK [upload-logs : Upload logs to log server]
2026-08-28 04:03:59.323307 | localhost | Output suppressed because no_log was given
2026-08-28 04:03:59.362809 | 
2026-08-28 04:03:59.362964 | LOOP [upload-logs : Compress console log and json output]
2026-08-28 04:03:59.411494 | localhost | skipping: Conditional result was False
2026-08-28 04:03:59.419464 | localhost | skipping: Conditional result was False
2026-08-28 04:03:59.429066 | 
2026-08-28 04:03:59.429215 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-28 04:03:59.471106 | localhost | skipping: Conditional result was False
2026-08-28 04:03:59.471505 | 
2026-08-28 04:03:59.475101 | localhost | skipping: Conditional result was False
2026-08-28 04:03:59.485055 | 
2026-08-28 04:03:59.485248 | LOOP [upload-logs : Upload console log and json output]