2026-09-09 00:58:55.526685 | Job console starting
2026-09-09 00:58:55.536417 | Updating git repos
2026-09-09 00:59:01.197144 | Cloning repos into workspace
2026-09-09 00:59:16.458819 | Restoring repo states
2026-09-09 00:59:22.074166 | Merging changes
2026-09-09 00:59:24.008626 | Checking out repos
2026-09-09 00:59:26.245316 | Preparing playbooks
2026-09-09 00:59:28.607904 | Running Ansible setup
2026-09-09 00:59:32.313363 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-09 00:59:33.048023 | 
2026-09-09 00:59:33.058195 | PLAY [localhost]
2026-09-09 00:59:33.076285 | 
2026-09-09 00:59:33.076451 | TASK [Gathering Facts]
2026-09-09 00:59:34.084369 | localhost | ok
2026-09-09 00:59:34.094991 | 
2026-09-09 00:59:34.095156 | TASK [Setup log path fact]
2026-09-09 00:59:34.115658 | localhost | ok
2026-09-09 00:59:34.144335 | 
2026-09-09 00:59:34.144472 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-09 00:59:34.181974 | localhost | ok
2026-09-09 00:59:34.187879 | 
2026-09-09 00:59:34.187963 | TASK [emit-job-header : Print job information]
2026-09-09 00:59:34.227313 | # Job Information
2026-09-09 00:59:34.278022 | Ansible Version: 2.16.18
2026-09-09 00:59:34.278273 | Job: atmosphere-molecule-csi-rbd
2026-09-09 00:59:34.278373 | Pipeline: check
2026-09-09 00:59:34.278456 | Executor: 2d72f0692154
2026-09-09 00:59:34.278522 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4093
2026-09-09 00:59:34.278575 | Event ID: 1aaef7c0-abe9-11f1-885d-53d4992dc17f
2026-09-09 00:59:34.288998 | 
2026-09-09 00:59:34.289133 | LOOP [emit-job-header : Print node information]
2026-09-09 00:59:34.401453 | localhost | ok:
2026-09-09 00:59:34.401709 | localhost | # Node Information
2026-09-09 00:59:34.401749 | localhost | Inventory Hostname: instance
2026-09-09 00:59:34.401779 | localhost | Hostname: np0000192326
2026-09-09 00:59:34.401806 | localhost | Username: zuul
2026-09-09 00:59:34.401838 | localhost | Distro: Ubuntu 22.04
2026-09-09 00:59:34.401871 | localhost | Provider: yul1
2026-09-09 00:59:34.401900 | localhost | Region: ca-ymq-1
2026-09-09 00:59:34.401929 | localhost | Label: ubuntu-jammy
2026-09-09 00:59:34.401957 | localhost | Product Name: OpenStack Nova
2026-09-09 00:59:34.401985 | localhost | Interface IP: 162.253.55.155
2026-09-09 00:59:34.418854 | 
2026-09-09 00:59:34.419044 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-09-09 00:59:34.927048 | localhost -> localhost | changed
2026-09-09 00:59:34.948586 | 
2026-09-09 00:59:34.949152 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-09-09 00:59:35.988719 | localhost -> localhost | changed
2026-09-09 00:59:36.000346 | 
2026-09-09 00:59:36.000546 | PLAY [all]
2026-09-09 00:59:36.016032 | 
2026-09-09 00:59:36.016203 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-09-09 00:59:36.340036 | instance -> localhost | ok
2026-09-09 00:59:36.351835 | 
2026-09-09 00:59:36.352053 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-09-09 00:59:36.382872 | instance | ok
2026-09-09 00:59:36.404849 | instance | included: /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-09-09 00:59:36.410977 | 
2026-09-09 00:59:36.411049 | TASK [add-build-sshkey : Create Temp SSH key]
2026-09-09 00:59:37.483539 | instance -> localhost | Generating public/private rsa key pair.
2026-09-09 00:59:37.483821 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/1521a7a4a5ec49089c34783f786f108a_id_rsa
2026-09-09 00:59:37.483863 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/1521a7a4a5ec49089c34783f786f108a_id_rsa.pub
2026-09-09 00:59:37.483893 | instance -> localhost | The key fingerprint is:
2026-09-09 00:59:37.483920 | instance -> localhost | SHA256:gQO3hKR5VZeQnH559RwxKNnXxrZXtPQBVCzD9x+QBFQ zuul-build-sshkey
2026-09-09 00:59:37.483961 | instance -> localhost | The key's randomart image is:
2026-09-09 00:59:37.483988 | instance -> localhost | +---[RSA 3072]----+
2026-09-09 00:59:37.484023 | instance -> localhost | |   .o.+oo+o+OE*O+|
2026-09-09 00:59:37.484051 | instance -> localhost | |   o.= o+..o Oo=@|
2026-09-09 00:59:37.484076 | instance -> localhost | |  o . +..  ...***|
2026-09-09 00:59:37.484102 | instance -> localhost | |   .   ...o .  o=|
2026-09-09 00:59:37.484128 | instance -> localhost | |        S. .    +|
2026-09-09 00:59:37.484153 | instance -> localhost | |                .|
2026-09-09 00:59:37.484177 | instance -> localhost | |                 |
2026-09-09 00:59:37.484202 | instance -> localhost | |                 |
2026-09-09 00:59:37.484230 | instance -> localhost | |                 |
2026-09-09 00:59:37.484271 | instance -> localhost | +----[SHA256]-----+
2026-09-09 00:59:37.484383 | instance -> localhost | ok: Runtime: 0:00:00.557745
2026-09-09 00:59:37.493624 | 
2026-09-09 00:59:37.493749 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-09-09 00:59:37.524523 | instance | ok
2026-09-09 00:59:37.538090 | instance | included: /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-09-09 00:59:37.547534 | 
2026-09-09 00:59:37.547616 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-09-09 00:59:37.577463 | instance | skipping: Conditional result was False
2026-09-09 00:59:37.584755 | 
2026-09-09 00:59:37.585143 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-09-09 00:59:38.058157 | instance | changed
2026-09-09 00:59:38.066949 | 
2026-09-09 00:59:38.067049 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-09-09 00:59:38.279097 | instance | ok
2026-09-09 00:59:38.288993 | 
2026-09-09 00:59:38.289101 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-09-09 00:59:38.805954 | instance | changed
2026-09-09 00:59:38.810510 | 
2026-09-09 00:59:38.810572 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-09-09 00:59:39.342739 | instance | changed
2026-09-09 00:59:39.354590 | 
2026-09-09 00:59:39.354741 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-09-09 00:59:39.379760 | instance | skipping: Conditional result was False
2026-09-09 00:59:39.390438 | 
2026-09-09 00:59:39.390677 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-09-09 00:59:39.863447 | instance -> localhost | changed
2026-09-09 00:59:39.872647 | 
2026-09-09 00:59:39.872713 | TASK [add-build-sshkey : Add back temp key]
2026-09-09 00:59:40.203963 | instance -> localhost | Identity added: /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/1521a7a4a5ec49089c34783f786f108a_id_rsa (zuul-build-sshkey)
2026-09-09 00:59:40.204174 | instance -> localhost | ok: Runtime: 0:00:00.041391
2026-09-09 00:59:40.208660 | 
2026-09-09 00:59:40.208720 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-09-09 00:59:40.557550 | instance | ok
2026-09-09 00:59:40.567051 | 
2026-09-09 00:59:40.567181 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-09-09 00:59:40.603440 | instance | skipping: Conditional result was False
2026-09-09 00:59:40.622960 | 
2026-09-09 00:59:40.623107 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-09-09 00:59:41.005029 | instance | ok
2026-09-09 00:59:41.018086 | 
2026-09-09 00:59:41.018226 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-09-09 00:59:44.645038 | instance | Output suppressed because no_log was given
2026-09-09 00:59:44.654212 | 
2026-09-09 00:59:44.654281 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-09-09 00:59:44.883430 | instance | ok: "logs"
2026-09-09 00:59:44.884188 | instance | ok: All items complete
2026-09-09 00:59:44.884344 | 
2026-09-09 00:59:45.016840 | instance | ok: "artifacts"
2026-09-09 00:59:45.154590 | instance | ok: "docs"
2026-09-09 00:59:45.164243 | 
2026-09-09 00:59:45.164414 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-09-09 00:59:45.352612 | instance | changed: "logs"
2026-09-09 00:59:45.489729 | instance | changed: "artifacts"
2026-09-09 00:59:45.632586 | instance | changed: "docs"
2026-09-09 00:59:45.655244 | 
2026-09-09 00:59:45.655427 | PLAY RECAP
2026-09-09 00:59:45.655554 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-09-09 00:59:45.655616 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-09 00:59:45.655886 | 
2026-09-09 00:59:45.866441 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-09-09 00:59:45.870614 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-09 00:59:46.502349 | 
2026-09-09 00:59:46.502499 | PLAY [all]
2026-09-09 00:59:46.512793 | 
2026-09-09 00:59:46.512879 | TASK [setup-uv : Extract archive]
2026-09-09 00:59:48.803364 | instance | changed
2026-09-09 00:59:48.816204 | 
2026-09-09 00:59:48.816365 | TASK [setup-uv : Print version]
2026-09-09 00:59:49.223048 | instance | uv 0.8.13
2026-09-09 00:59:49.360313 | instance | ok: Runtime: 0:00:00.012565
2026-09-09 00:59:49.380287 | 
2026-09-09 00:59:49.380580 | TASK [Install Ansible collection siblings]
2026-09-09 00:59:59.181677 | instance | changed:
2026-09-09 00:59:59.181967 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-09 00:59:59.182025 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-09 00:59:59.182068 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-09 00:59:59.182107 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-09 00:59:59.182144 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general
2026-09-09 00:59:59.182192 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-09 00:59:59.182232 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-09 00:59:59.182275 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-09 00:59:59.182314 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-09 00:59:59.182352 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-09 00:59:59.182390 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-09 00:59:59.182426 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-09 00:59:59.182463 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0
2026-09-09 00:59:59.182524 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0
2026-09-09 00:59:59.182564 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0
2026-09-09 00:59:59.182602 | instance | Resolved community.crypto to 2.2.3 for 2.2.3
2026-09-09 00:59:59.182638 | instance | Resolved community.general to 7.3.0 for 7.3.0
2026-09-09 00:59:59.182676 | instance | Resolved community.mysql to 3.6.0 for 3.6.0
2026-09-09 00:59:59.182712 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0
2026-09-09 00:59:59.182749 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0
2026-09-09 00:59:59.182785 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0
2026-09-09 00:59:59.182822 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0
2026-09-09 00:59:59.182861 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-09 00:59:59.182919 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0
2026-09-09 00:59:59.182958 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0
2026-09-09 00:59:59.182995 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-09 00:59:59.183032 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-09 00:59:59.183069 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0
2026-09-09 00:59:59.183105 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0
2026-09-09 00:59:59.183141 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3
2026-09-09 00:59:59.183177 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2
2026-09-09 00:59:59.183214 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0
2026-09-09 00:59:59.183251 | instance | Checked out ansible.netcommon to 1.2.0
2026-09-09 00:59:59.183289 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon
2026-09-09 00:59:59.183335 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.183372 | instance | Process install dependency map
2026-09-09 00:59:59.183408 | instance | Starting collection install process
2026-09-09 00:59:59.183444 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon'
2026-09-09 00:59:59.183486 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon
2026-09-09 00:59:59.183569 | instance | ansible.netcommon:* was installed successfully
2026-09-09 00:59:59.183615 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-09-09 00:59:59.183653 | instance | Creating virtual environment at: .venv
2026-09-09 00:59:59.183693 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-09 00:59:59.183732 | instance | Downloading setuptools (1.1MiB)
2026-09-09 00:59:59.183771 | instance | Downloading ansible-core (2.1MiB)
2026-09-09 00:59:59.183817 | instance | Downloading cryptography (4.2MiB)
2026-09-09 00:59:59.183872 | instance | Downloading pygments (1.2MiB)
2026-09-09 00:59:59.183923 | instance | Downloading rjsonnet (1.2MiB)
2026-09-09 00:59:59.183965 | instance | Downloading openstacksdk (1.7MiB)
2026-09-09 00:59:59.184003 | instance | Downloading netaddr (2.2MiB)
2026-09-09 00:59:59.184043 | instance | Downloading kubernetes (1.9MiB)
2026-09-09 00:59:59.184092 | instance |    Building pyperclip==1.9.0
2026-09-09 00:59:59.184140 | instance |  Downloading rjsonnet
2026-09-09 00:59:59.184184 | instance |  Downloading netaddr
2026-09-09 00:59:59.184227 | instance |  Downloading pygments
2026-09-09 00:59:59.184308 | instance |  Downloading cryptography
2026-09-09 00:59:59.184351 | instance |  Downloading setuptools
2026-09-09 00:59:59.184390 | instance |  Downloading kubernetes
2026-09-09 00:59:59.184448 | instance |  Downloading ansible-core
2026-09-09 00:59:59.184636 | instance |  Downloading openstacksdk
2026-09-09 00:59:59.184707 | instance |       Built pyperclip==1.9.0
2026-09-09 00:59:59.184753 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-09-09 00:59:59.184795 | instance | Installed 79 packages in 137ms
2026-09-09 00:59:59.184836 | instance | Checked out ansible.posix to 1.6.0
2026-09-09 00:59:59.184876 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix
2026-09-09 00:59:59.184916 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.184955 | instance | Process install dependency map
2026-09-09 00:59:59.184994 | instance | Starting collection install process
2026-09-09 00:59:59.185030 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix'
2026-09-09 00:59:59.185084 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix
2026-09-09 00:59:59.185125 | instance | ansible.posix:1.6.0 was installed successfully
2026-09-09 00:59:59.185313 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.185364 | instance | 2.17.12
2026-09-09 00:59:59.185407 | instance | Checked out ansible.utils to v6.1.0
2026-09-09 00:59:59.185448 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils
2026-09-09 00:59:59.185486 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.185623 | instance | Process install dependency map
2026-09-09 00:59:59.185758 | instance | Starting collection install process
2026-09-09 00:59:59.185813 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils'
2026-09-09 00:59:59.185853 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils
2026-09-09 00:59:59.185893 | instance | ansible.utils:6.1.0 was installed successfully
2026-09-09 00:59:59.185933 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.185973 | instance | 2.17.12
2026-09-09 00:59:59.186013 | instance | Checked out atmosphere.common to v0.7.0
2026-09-09 00:59:59.186053 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common
2026-09-09 00:59:59.186093 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.186132 | instance | Process install dependency map
2026-09-09 00:59:59.186170 | instance | Starting collection install process
2026-09-09 00:59:59.186207 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common'
2026-09-09 00:59:59.186246 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common
2026-09-09 00:59:59.186284 | instance | atmosphere.common:0.7.0 was installed successfully
2026-09-09 00:59:59.186319 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.186356 | instance | 2.17.12
2026-09-09 00:59:59.186396 | instance | Checked out community.crypto to 2.2.3
2026-09-09 00:59:59.186435 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto
2026-09-09 00:59:59.186474 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.186538 | instance | Process install dependency map
2026-09-09 00:59:59.186581 | instance | Starting collection install process
2026-09-09 00:59:59.186618 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto'
2026-09-09 00:59:59.186660 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto
2026-09-09 00:59:59.186716 | instance | community.crypto:2.2.3 was installed successfully
2026-09-09 00:59:59.186758 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.186794 | instance | 2.17.12
2026-09-09 00:59:59.186831 | instance | Checked out community.general to 7.3.0
2026-09-09 00:59:59.186870 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general
2026-09-09 00:59:59.186908 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.186960 | instance | Process install dependency map
2026-09-09 00:59:59.186999 | instance | Starting collection install process
2026-09-09 00:59:59.187037 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general'
2026-09-09 00:59:59.187075 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general
2026-09-09 00:59:59.187113 | instance | community.general:7.3.0 was installed successfully
2026-09-09 00:59:59.187149 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.187187 | instance | 2.17.12
2026-09-09 00:59:59.187226 | instance | Checked out community.mysql to 3.6.0
2026-09-09 00:59:59.187339 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql
2026-09-09 00:59:59.187473 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.187564 | instance | Process install dependency map
2026-09-09 00:59:59.187609 | instance | Starting collection install process
2026-09-09 00:59:59.187651 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql'
2026-09-09 00:59:59.187691 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql
2026-09-09 00:59:59.187728 | instance | community.mysql:3.6.0 was installed successfully
2026-09-09 00:59:59.187768 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.187807 | instance | 2.17.12
2026-09-09 00:59:59.187860 | instance | Checked out kubernetes.core to 2.4.0
2026-09-09 00:59:59.187910 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core
2026-09-09 00:59:59.187949 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.187987 | instance | Process install dependency map
2026-09-09 00:59:59.188026 | instance | Starting collection install process
2026-09-09 00:59:59.188062 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core'
2026-09-09 00:59:59.188101 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core
2026-09-09 00:59:59.188140 | instance | kubernetes.core:2.4.0 was installed successfully
2026-09-09 00:59:59.188177 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.188215 | instance | 2.17.12
2026-09-09 00:59:59.188254 | instance | Checked out openstack.cloud to 2.6.0
2026-09-09 00:59:59.188294 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack
2026-09-09 00:59:59.188333 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.188371 | instance | Process install dependency map
2026-09-09 00:59:59.188408 | instance | Starting collection install process
2026-09-09 00:59:59.188446 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud'
2026-09-09 00:59:59.188484 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud
2026-09-09 00:59:59.188591 | instance | openstack.cloud:2.6.0 was installed successfully
2026-09-09 00:59:59.188632 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.188671 | instance | 2.17.12
2026-09-09 00:59:59.188710 | instance | Checked out vexxhost.ceph to v4.2.0
2026-09-09 00:59:59.188749 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph
2026-09-09 00:59:59.188797 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.188839 | instance | Process install dependency map
2026-09-09 00:59:59.188878 | instance | Starting collection install process
2026-09-09 00:59:59.188916 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph'
2026-09-09 00:59:59.188955 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph
2026-09-09 00:59:59.188993 | instance | vexxhost.ceph:4.2.0 was installed successfully
2026-09-09 00:59:59.189031 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.189069 | instance | 2.17.12
2026-09-09 00:59:59.189105 | instance | Checked out vexxhost.containers to v1.6.8
2026-09-09 00:59:59.189143 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers
2026-09-09 00:59:59.189184 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.189222 | instance | Process install dependency map
2026-09-09 00:59:59.189259 | instance | Starting collection install process
2026-09-09 00:59:59.189297 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers'
2026-09-09 00:59:59.189335 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers
2026-09-09 00:59:59.189373 | instance | vexxhost.containers:1.6.8 was installed successfully
2026-09-09 00:59:59.189411 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.189449 | instance | 2.17.12
2026-09-09 00:59:59.189486 | instance | Checked out vexxhost.kubernetes to v3.3.0
2026-09-09 00:59:59.189557 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes
2026-09-09 00:59:59.189597 | instance | Starting galaxy collection install process
2026-09-09 00:59:59.189635 | instance | Process install dependency map
2026-09-09 00:59:59.189673 | instance | Starting collection install process
2026-09-09 00:59:59.189712 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes'
2026-09-09 00:59:59.189750 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes
2026-09-09 00:59:59.189788 | instance | vexxhost.kubernetes:3.3.0 was installed successfully
2026-09-09 00:59:59.189826 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version
2026-09-09 00:59:59.189865 | instance | 2.17.12
2026-09-09 00:59:59.200923 | 
2026-09-09 00:59:59.201021 | PLAY RECAP
2026-09-09 00:59:59.201111 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-09 00:59:59.201155 | 
2026-09-09 00:59:59.387841 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-09-09 00:59:59.391858 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-09 01:00:00.032440 | 
2026-09-09 01:00:00.032618 | PLAY [all]
2026-09-09 01:00:00.043734 | 
2026-09-09 01:00:00.043818 | TASK [Install "jq" for log collection]
2026-09-09 01:00:10.770225 | instance | changed
2026-09-09 01:00:10.773604 | 
2026-09-09 01:00:10.773760 | PLAY RECAP
2026-09-09 01:00:10.773883 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-09-09 01:00:10.773984 | 
2026-09-09 01:00:10.941013 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main]
2026-09-09 01:00:10.942837 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-09 01:00:11.563177 | 
2026-09-09 01:00:11.563360 | PLAY [all]
2026-09-09 01:00:11.575133 | 
2026-09-09 01:00:11.575287 | LOOP [Check inventory directories]
2026-09-09 01:00:11.933727 | instance | ok: "src/github.com/vexxhost/atmosphere"
2026-09-09 01:00:12.101475 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory"
2026-09-09 01:00:12.254669 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory"
2026-09-09 01:00:12.276930 | 
2026-09-09 01:00:12.277240 | LOOP [Copy inventory file for Zuul]
2026-09-09 01:00:13.083793 | instance | changed:
2026-09-09 01:00:13.084090 | instance | {
2026-09-09 01:00:13.084145 | instance |   "ansible_loop_var": "item",
2026-09-09 01:00:13.084188 | instance |   "changed": false,
2026-09-09 01:00:13.084225 | instance |   "failed": false,
2026-09-09 01:00:13.084271 | instance |   "invocation": {
2026-09-09 01:00:13.084308 | instance |     "module_args": {
2026-09-09 01:00:13.084343 | instance |       "checksum_algorithm": "sha1",
2026-09-09 01:00:13.084377 | instance |       "follow": true,
2026-09-09 01:00:13.084411 | instance |       "get_attributes": true,
2026-09-09 01:00:13.084447 | instance |       "get_checksum": true,
2026-09-09 01:00:13.084481 | instance |       "get_mime": true,
2026-09-09 01:00:13.084593 | instance |       "path": "src/github.com/vexxhost/atmosphere"
2026-09-09 01:00:13.084631 | instance |     }
2026-09-09 01:00:13.084664 | instance |   },
2026-09-09 01:00:13.084697 | instance |   "item": "src/github.com/vexxhost/atmosphere",
2026-09-09 01:00:13.084729 | instance |   "stat": {
2026-09-09 01:00:13.084761 | instance |     "atime": 1788915591.9489975,
2026-09-09 01:00:13.084794 | instance |     "attr_flags": "e",
2026-09-09 01:00:13.084827 | instance |     "attributes": [
2026-09-09 01:00:13.084859 | instance |       "extents"
2026-09-09 01:00:13.084892 | instance |     ],
2026-09-09 01:00:13.084923 | instance |     "block_size": 4096,
2026-09-09 01:00:13.084955 | instance |     "blocks": 8,
2026-09-09 01:00:13.084988 | instance |     "charset": "unknown",
2026-09-09 01:00:13.085023 | instance |     "ctime": 1788915590.2930121,
2026-09-09 01:00:13.085057 | instance |     "dev": 64513,
2026-09-09 01:00:13.085089 | instance |     "device_type": 0,
2026-09-09 01:00:13.085121 | instance |     "executable": true,
2026-09-09 01:00:13.085154 | instance |     "exists": true,
2026-09-09 01:00:13.085187 | instance |     "gid": 1000,
2026-09-09 01:00:13.085219 | instance |     "gr_name": "zuul",
2026-09-09 01:00:13.085251 | instance |     "inode": 1048965,
2026-09-09 01:00:13.085283 | instance |     "isblk": false,
2026-09-09 01:00:13.085317 | instance |     "ischr": false,
2026-09-09 01:00:13.085349 | instance |     "isdir": true,
2026-09-09 01:00:13.085442 | instance |     "isfifo": false,
2026-09-09 01:00:13.085552 | instance |     "isgid": false,
2026-09-09 01:00:13.085595 | instance |     "islnk": false,
2026-09-09 01:00:13.085630 | instance |     "isreg": false,
2026-09-09 01:00:13.085664 | instance |     "issock": false,
2026-09-09 01:00:13.085696 | instance |     "isuid": false,
2026-09-09 01:00:13.085728 | instance |     "mimetype": "unknown",
2026-09-09 01:00:13.085760 | instance |     "mode": "0755",
2026-09-09 01:00:13.085791 | instance |     "mtime": 1788915590.2930121,
2026-09-09 01:00:13.085823 | instance |     "nlink": 22,
2026-09-09 01:00:13.085854 | instance |     "path": "src/github.com/vexxhost/atmosphere",
2026-09-09 01:00:13.085887 | instance |     "pw_name": "zuul",
2026-09-09 01:00:13.085927 | instance |     "readable": true,
2026-09-09 01:00:13.085961 | instance |     "rgrp": true,
2026-09-09 01:00:13.085995 | instance |     "roth": true,
2026-09-09 01:00:13.086028 | instance |     "rusr": true,
2026-09-09 01:00:13.086061 | instance |     "size": 4096,
2026-09-09 01:00:13.086094 | instance |     "uid": 1000,
2026-09-09 01:00:13.086145 | instance |     "version": "133301490",
2026-09-09 01:00:13.086181 | instance |     "wgrp": false,
2026-09-09 01:00:13.086219 | instance |     "woth": false,
2026-09-09 01:00:13.086253 | instance |     "writeable": true,
2026-09-09 01:00:13.086316 | instance |     "wusr": true,
2026-09-09 01:00:13.086351 | instance |     "xgrp": true,
2026-09-09 01:00:13.086384 | instance |     "xoth": true,
2026-09-09 01:00:13.086417 | instance |     "xusr": true
2026-09-09 01:00:13.086468 | instance |   }
2026-09-09 01:00:13.086504 | instance | }
2026-09-09 01:00:13.086626 | instance | ok: All items complete
2026-09-09 01:00:13.086672 | 
2026-09-09 01:00:13.089112 | instance | skipping: Conditional result was False
2026-09-09 01:00:13.091244 | instance | skipping: Conditional result was False
2026-09-09 01:00:13.114970 | 
2026-09-09 01:00:13.115173 | LOOP [Switch "ansible_host" to private IP]
2026-09-09 01:00:13.511422 | instance | changed: 1 replacements made
2026-09-09 01:00:13.514451 | instance | skipping: Conditional result was False
2026-09-09 01:00:13.523228 | instance | skipping: Conditional result was False
2026-09-09 01:00:13.542242 | 
2026-09-09 01:00:13.542450 | TASK [Run Molecule scenario]
2026-09-09 01:00:14.447082 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-09-09 01:00:14.856250 | instance | INFO     [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-09-09 01:00:14.856342 | instance | INFO     [csi > prerun] Performing prerun with role_name_check=0...
2026-09-09 01:00:25.383624 | instance | INFO     [csi > dependency] Executing
2026-09-09 01:00:25.383842 | instance | WARNING  [csi > dependency] Missing roles requirements file: requirements.yml
2026-09-09 01:00:25.384058 | instance | WARNING  [csi > dependency] Missing collections requirements file: collections.yml
2026-09-09 01:00:25.384189 | instance | WARNING  [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-09-09 01:00:25.391979 | instance | INFO     [csi > cleanup] Executing
2026-09-09 01:00:25.392415 | instance | WARNING  [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-09 01:00:25.401279 | instance | INFO     [csi > destroy] Executing
2026-09-09 01:00:25.401380 | instance | WARNING  [csi > destroy] Skipping, '--destroy=never' requested.
2026-09-09 01:00:25.401521 | instance | INFO     [csi > destroy] Executed: Successful
2026-09-09 01:00:25.410484 | instance | INFO     [csi > syntax] Executing
2026-09-09 01:00:26.908802 | instance |
2026-09-09 01:00:26.909062 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-09 01:00:26.970169 | instance | INFO     [csi > syntax] Executed: Successful
2026-09-09 01:00:26.992546 | instance | INFO     [csi > create] Executing
2026-09-09 01:00:26.996447 | instance | WARNING  [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-09-09 01:00:27.010181 | instance | INFO     [csi > prepare] Executing
2026-09-09 01:00:27.840848 | instance |
2026-09-09 01:00:27.841169 | instance | PLAY [Prepare] *****************************************************************
2026-09-09 01:00:27.841416 | instance |
2026-09-09 01:00:27.841669 | instance | TASK [Gathering Facts] *********************************************************
2026-09-09 01:00:27.842017 | instance | Wednesday 09 September 2026  01:00:27 +0000 (0:00:00.033)       0:00:00.033 ***
2026-09-09 01:00:29.146968 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-09 01:00:29.147226 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-09 01:00:29.147476 | instance | interpreter could change the meaning of that path. See
2026-09-09 01:00:29.147782 | instance | https://docs.ansible.com/ansible-
2026-09-09 01:00:29.148057 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-09 01:00:29.157832 | instance | ok: [instance]
2026-09-09 01:00:29.158119 | instance |
2026-09-09 01:00:29.158423 | instance | TASK [Configure short hostname] ************************************************
2026-09-09 01:00:29.158724 | instance | Wednesday 09 September 2026  01:00:29 +0000 (0:00:01.322)       0:00:01.355 ***
2026-09-09 01:00:30.616285 | instance | changed: [instance]
2026-09-09 01:00:30.616496 | instance |
2026-09-09 01:00:30.616743 | instance | TASK [Ensure hostname inside hosts file] ***************************************
2026-09-09 01:00:30.617001 | instance | Wednesday 09 September 2026  01:00:30 +0000 (0:00:01.458)       0:00:02.813 ***
2026-09-09 01:00:30.898973 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-09-09 01:00:30.899097 | instance | with a mode of 0700, this may cause issues when running as another user. To
2026-09-09 01:00:30.899237 | instance | avoid this, create the remote_tmp dir with the correct permissions manually
2026-09-09 01:00:30.909198 | instance | changed: [instance]
2026-09-09 01:00:30.909421 | instance |
2026-09-09 01:00:30.909669 | instance | TASK [Purge "snapd" package] ***************************************************
2026-09-09 01:00:30.909978 | instance | Wednesday 09 September 2026  01:00:30 +0000 (0:00:00.293)       0:00:03.106 ***
2026-09-09 01:00:31.706107 | instance | ok: [instance]
2026-09-09 01:00:31.706389 | instance |
2026-09-09 01:00:31.706744 | instance | PLAY [Create devices for Ceph] *************************************************
2026-09-09 01:00:31.707088 | instance |
2026-09-09 01:00:31.707442 | instance | TASK [Gathering Facts] *********************************************************
2026-09-09 01:00:31.707776 | instance | Wednesday 09 September 2026  01:00:31 +0000 (0:00:00.796)       0:00:03.903 ***
2026-09-09 01:00:32.485254 | instance | ok: [instance]
2026-09-09 01:00:32.485513 | instance |
2026-09-09 01:00:32.485854 | instance | TASK [Install depedencies] *****************************************************
2026-09-09 01:00:32.486183 | instance | Wednesday 09 September 2026  01:00:32 +0000 (0:00:00.779)       0:00:04.682 ***
2026-09-09 01:00:57.309217 | instance | changed: [instance]
2026-09-09 01:00:57.309307 | instance |
2026-09-09 01:00:57.309319 | instance | TASK [Start up service] ********************************************************
2026-09-09 01:00:57.309445 | instance | Wednesday 09 September 2026  01:00:57 +0000 (0:00:24.824)       0:00:29.506 ***
2026-09-09 01:00:57.901241 | instance | ok: [instance]
2026-09-09 01:00:57.901379 | instance |
2026-09-09 01:00:57.901541 | instance | TASK [Generate lvm.conf] *******************************************************
2026-09-09 01:00:57.901722 | instance | Wednesday 09 September 2026  01:00:57 +0000 (0:00:00.591)       0:00:30.098 ***
2026-09-09 01:00:58.235598 | instance | ok: [instance]
2026-09-09 01:00:58.235848 | instance |
2026-09-09 01:00:58.236133 | instance | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-09-09 01:00:58.236364 | instance | Wednesday 09 September 2026  01:00:58 +0000 (0:00:00.334)       0:00:30.432 ***
2026-09-09 01:00:58.943378 | instance | changed: [instance]
2026-09-09 01:00:58.943420 | instance |
2026-09-09 01:00:58.943428 | instance | TASK [Get list of all loopback devices] ****************************************
2026-09-09 01:00:58.943435 | instance | Wednesday 09 September 2026  01:00:58 +0000 (0:00:00.708)       0:00:31.140 ***
2026-09-09 01:00:59.173894 | instance | ok: [instance]
2026-09-09 01:00:59.174599 | instance |
2026-09-09 01:00:59.174675 | instance | TASK [Fail if there is any existing loopback devices] **************************
2026-09-09 01:00:59.174688 | instance | Wednesday 09 September 2026  01:00:59 +0000 (0:00:00.230)       0:00:31.371 ***
2026-09-09 01:00:59.204483 | instance | skipping: [instance]
2026-09-09 01:00:59.205361 | instance |
2026-09-09 01:00:59.205678 | instance | TASK [Create devices for Ceph] *************************************************
2026-09-09 01:00:59.205695 | instance | Wednesday 09 September 2026  01:00:59 +0000 (0:00:00.029)       0:00:31.401 ***
2026-09-09 01:00:59.796742 | instance | changed: [instance] => (item=osd0)
2026-09-09 01:00:59.796868 | instance | changed: [instance] => (item=osd1)
2026-09-09 01:00:59.797029 | instance | changed: [instance] => (item=osd2)
2026-09-09 01:00:59.797258 | instance |
2026-09-09 01:00:59.797437 | instance | TASK [Set permissions on loopback devices] *************************************
2026-09-09 01:00:59.797582 | instance | Wednesday 09 September 2026  01:00:59 +0000 (0:00:00.593)       0:00:31.994 ***
2026-09-09 01:01:00.460508 | instance | changed: [instance] => (item=osd0)
2026-09-09 01:01:00.460761 | instance | changed: [instance] => (item=osd1)
2026-09-09 01:01:00.461184 | instance | changed: [instance] => (item=osd2)
2026-09-09 01:01:00.461500 | instance |
2026-09-09 01:01:00.461881 | instance | TASK [Start loop devices] ******************************************************
2026-09-09 01:01:00.462209 | instance | Wednesday 09 September 2026  01:01:00 +0000 (0:00:00.663)       0:00:32.658 ***
2026-09-09 01:01:01.182412 | instance | changed: [instance] => (item=osd0)
2026-09-09 01:01:01.183773 | instance | changed: [instance] => (item=osd1)
2026-09-09 01:01:01.183831 | instance | changed: [instance] => (item=osd2)
2026-09-09 01:01:01.183842 | instance |
2026-09-09 01:01:01.183852 | instance | TASK [Create a volume group for each loop device] ******************************
2026-09-09 01:01:01.183864 | instance | Wednesday 09 September 2026  01:01:01 +0000 (0:00:00.721)       0:00:33.380 ***
2026-09-09 01:01:04.519336 | instance | changed: [instance] => (item=osd0)
2026-09-09 01:01:04.519391 | instance | changed: [instance] => (item=osd1)
2026-09-09 01:01:04.519401 | instance | changed: [instance] => (item=osd2)
2026-09-09 01:01:04.519411 | instance |
2026-09-09 01:01:04.519420 | instance | TASK [Create a logical volume for each loop device] ****************************
2026-09-09 01:01:04.519430 | instance | Wednesday 09 September 2026  01:01:04 +0000 (0:00:03.335)       0:00:36.715 ***
2026-09-09 01:01:06.499077 | instance | changed: [instance] => (item=ceph-instance-osd0)
2026-09-09 01:01:06.499594 | instance | changed: [instance] => (item=ceph-instance-osd1)
2026-09-09 01:01:06.499664 | instance | changed: [instance] => (item=ceph-instance-osd2)
2026-09-09 01:01:06.499862 | instance |
2026-09-09 01:01:06.501873 | instance | PLAY RECAP *********************************************************************
2026-09-09 01:01:06.501921 | instance | instance                   : ok=15   changed=9    unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-09-09 01:01:06.501932 | instance |
2026-09-09 01:01:06.501942 | instance | Wednesday 09 September 2026  01:01:06 +0000 (0:00:01.981)       0:00:38.697 ***
2026-09-09 01:01:06.501951 | instance | ===============================================================================
2026-09-09 01:01:06.501960 | instance | Install depedencies ---------------------------------------------------- 24.82s
2026-09-09 01:01:06.501968 | instance | Create a volume group for each loop device ------------------------------ 3.34s
2026-09-09 01:01:06.501977 | instance | Create a logical volume for each loop device ---------------------------- 1.98s
2026-09-09 01:01:06.501987 | instance | Configure short hostname ------------------------------------------------ 1.46s
2026-09-09 01:01:06.504777 | instance | Gathering Facts --------------------------------------------------------- 1.32s
2026-09-09 01:01:06.504811 | instance | Purge "snapd" package --------------------------------------------------- 0.80s
2026-09-09 01:01:06.504822 | instance | Gathering Facts --------------------------------------------------------- 0.78s
2026-09-09 01:01:06.504831 | instance | Start loop devices ------------------------------------------------------ 0.72s
2026-09-09 01:01:06.504840 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.71s
2026-09-09 01:01:06.504849 | instance | Set permissions on loopback devices ------------------------------------- 0.66s
2026-09-09 01:01:06.504858 | instance | Create devices for Ceph ------------------------------------------------- 0.59s
2026-09-09 01:01:06.504867 | instance | Start up service -------------------------------------------------------- 0.59s
2026-09-09 01:01:06.504875 | instance | Generate lvm.conf ------------------------------------------------------- 0.33s
2026-09-09 01:01:06.504885 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-09-09 01:01:06.504919 | instance | Get list of all loopback devices ---------------------------------------- 0.23s
2026-09-09 01:01:06.504930 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-09-09 01:01:06.578790 | instance | INFO     [csi > prepare] Executed: Successful
2026-09-09 01:01:06.595081 | instance | INFO     [csi > converge] Executing
2026-09-09 01:01:07.983455 | instance |
2026-09-09 01:01:07.983720 | instance | PLAY [Debug CSI driver value] **************************************************
2026-09-09 01:01:07.983912 | instance |
2026-09-09 01:01:07.984126 | instance | TASK [Gathering Facts] *********************************************************
2026-09-09 01:01:07.984327 | instance | Wednesday 09 September 2026  01:01:07 +0000 (0:00:00.007)       0:00:00.007 ***
2026-09-09 01:01:08.999107 | instance | [WARNING]: Platform linux on host instance is using the discovered Python
2026-09-09 01:01:08.999153 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-09-09 01:01:08.999159 | instance | interpreter could change the meaning of that path. See
2026-09-09 01:01:08.999164 | instance | https://docs.ansible.com/ansible-
2026-09-09 01:01:08.999168 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information.
2026-09-09 01:01:09.006960 | instance | ok: [instance]
2026-09-09 01:01:09.006990 | instance |
2026-09-09 01:01:09.006997 | instance | TASK [Display CSI driver value and environment variable] ***********************
2026-09-09 01:01:09.007001 | instance | Wednesday 09 September 2026  01:01:09 +0000 (0:00:01.023)       0:00:01.030 ***
2026-09-09 01:01:09.057965 | instance | ok: [instance] => {
2026-09-09 01:01:09.058046 | instance |     "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER="
2026-09-09 01:01:09.058058 | instance | }
2026-09-09 01:01:09.058068 | instance |
2026-09-09 01:01:09.058077 | instance | PLAY [all] *********************************************************************
2026-09-09 01:01:09.058087 | instance |
2026-09-09 01:01:09.058102 | instance | TASK [Gathering Facts] *********************************************************
2026-09-09 01:01:09.058257 | instance | Wednesday 09 September 2026  01:01:09 +0000 (0:00:00.050)       0:00:01.081 ***
2026-09-09 01:01:10.021918 | instance | ok: [instance]
2026-09-09 01:01:10.022766 | instance |
2026-09-09 01:01:10.022821 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] *****************
2026-09-09 01:01:10.022832 | instance | Wednesday 09 September 2026  01:01:10 +0000 (0:00:00.964)       0:00:02.045 ***
2026-09-09 01:01:10.237224 | instance | ok: [instance]
2026-09-09 01:01:10.237303 | instance |
2026-09-09 01:01:10.237700 | instance | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-09-09 01:01:10.237742 | instance |
2026-09-09 01:01:10.237747 | instance | TASK [Gathering Facts] *********************************************************
2026-09-09 01:01:10.237752 | instance | Wednesday 09 September 2026  01:01:10 +0000 (0:00:00.216)       0:00:02.261 ***
2026-09-09 01:01:11.213343 | instance | ok: [instance]
2026-09-09 01:01:11.213409 | instance |
2026-09-09 01:01:11.213597 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-09 01:01:11.213902 | instance | Wednesday 09 September 2026  01:01:11 +0000 (0:00:00.975)       0:00:03.236 ***
2026-09-09 01:01:11.519950 | instance | ok: [instance]
2026-09-09 01:01:11.520158 | instance |
2026-09-09 01:01:11.520296 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-09 01:01:11.520431 | instance | Wednesday 09 September 2026  01:01:11 +0000 (0:00:00.306)       0:00:03.543 ***
2026-09-09 01:01:11.563538 | instance | skipping: [instance]
2026-09-09 01:01:11.563695 | instance |
2026-09-09 01:01:11.563833 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-09-09 01:01:11.563967 | instance | Wednesday 09 September 2026  01:01:11 +0000 (0:00:00.044)       0:00:03.587 ***
2026-09-09 01:01:11.886371 | instance | changed: [instance]
2026-09-09 01:01:11.886776 | instance |
2026-09-09 01:01:11.887181 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-09 01:01:11.887510 | instance | Wednesday 09 September 2026  01:01:11 +0000 (0:00:00.322)       0:00:03.909 ***
2026-09-09 01:01:11.983653 | instance | ok: [instance] => {
2026-09-09 01:01:11.984399 | instance |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-09-09 01:01:11.984952 | instance | }
2026-09-09 01:01:11.985421 | instance |
2026-09-09 01:01:11.985967 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-09 01:01:11.986494 | instance | Wednesday 09 September 2026  01:01:11 +0000 (0:00:00.096)       0:00:04.006 ***
2026-09-09 01:01:12.737718 | instance | changed: [instance]
2026-09-09 01:01:12.738171 | instance |
2026-09-09 01:01:12.738510 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-09 01:01:12.738815 | instance | Wednesday 09 September 2026  01:01:12 +0000 (0:00:00.754)       0:00:04.760 ***
2026-09-09 01:01:12.797483 | instance | skipping: [instance]
2026-09-09 01:01:12.797856 | instance |
2026-09-09 01:01:12.798197 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-09 01:01:12.798502 | instance | Wednesday 09 September 2026  01:01:12 +0000 (0:00:00.060)       0:00:04.821 ***
2026-09-09 01:01:12.845902 | instance | skipping: [instance]
2026-09-09 01:01:12.846260 | instance |
2026-09-09 01:01:12.846565 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-09 01:01:12.846863 | instance | Wednesday 09 September 2026  01:01:12 +0000 (0:00:00.048)       0:00:04.869 ***
2026-09-09 01:01:13.098389 | instance | ok: [instance]
2026-09-09 01:01:13.098771 | instance |
2026-09-09 01:01:13.099087 | instance | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-09-09 01:01:13.099421 | instance | Wednesday 09 September 2026  01:01:13 +0000 (0:00:00.251)       0:00:05.121 ***
2026-09-09 01:01:14.432554 | instance | ok: [instance]
2026-09-09 01:01:14.432609 | instance |
2026-09-09 01:01:14.432620 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-09 01:01:14.432631 | instance | Wednesday 09 September 2026  01:01:14 +0000 (0:00:01.333)       0:00:06.455 ***
2026-09-09 01:01:14.527997 | instance | ok: [instance] => {
2026-09-09 01:01:14.528053 | instance |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-09-09 01:01:14.528082 | instance | }
2026-09-09 01:01:14.528093 | instance |
2026-09-09 01:01:14.528102 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-09 01:01:14.528111 | instance | Wednesday 09 September 2026  01:01:14 +0000 (0:00:00.094)       0:00:06.550 ***
2026-09-09 01:01:15.368659 | instance | changed: [instance]
2026-09-09 01:01:15.368713 | instance |
2026-09-09 01:01:15.368724 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-09 01:01:15.368734 | instance | Wednesday 09 September 2026  01:01:15 +0000 (0:00:00.840)       0:00:07.391 ***
2026-09-09 01:01:18.379857 | instance | changed: [instance]
2026-09-09 01:01:18.380238 | instance |
2026-09-09 01:01:18.380253 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-09-09 01:01:18.380265 | instance | Wednesday 09 September 2026  01:01:18 +0000 (0:00:03.011)       0:00:10.402 ***
2026-09-09 01:01:18.413524 | instance | skipping: [instance]
2026-09-09 01:01:18.413599 | instance |
2026-09-09 01:01:18.413887 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-09-09 01:01:18.413951 | instance | Wednesday 09 September 2026  01:01:18 +0000 (0:00:00.034)       0:00:10.437 ***
2026-09-09 01:01:18.453439 | instance | skipping: [instance]
2026-09-09 01:01:18.453936 | instance |
2026-09-09 01:01:18.454650 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-09-09 01:01:18.454707 | instance | Wednesday 09 September 2026  01:01:18 +0000 (0:00:00.039)       0:00:10.476 ***
2026-09-09 01:01:18.494094 | instance | skipping: [instance]
2026-09-09 01:01:18.494514 | instance |
2026-09-09 01:01:18.494842 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-09-09 01:01:18.495155 | instance | Wednesday 09 September 2026  01:01:18 +0000 (0:00:00.040)       0:00:10.517 ***
2026-09-09 01:01:24.884955 | instance | changed: [instance]
2026-09-09 01:01:24.885136 | instance |
2026-09-09 01:01:24.885501 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-09-09 01:01:24.885881 | instance | Wednesday 09 September 2026  01:01:24 +0000 (0:00:06.390)       0:00:16.908 ***
2026-09-09 01:01:25.521326 | instance | changed: [instance]
2026-09-09 01:01:25.521375 | instance |
2026-09-09 01:01:25.521386 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-09-09 01:01:25.521396 | instance | Wednesday 09 September 2026  01:01:25 +0000 (0:00:00.635)       0:00:17.544 ***
2026-09-09 01:01:26.541617 | instance | changed: [instance] => (item={'path': '/etc/containerd'})
2026-09-09 01:01:26.541771 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-09-09 01:01:26.542812 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-09-09 01:01:26.542862 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-09-09 01:01:26.542871 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-09-09 01:01:26.542878 | instance |
2026-09-09 01:01:26.542891 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-09-09 01:01:26.542897 | instance | Wednesday 09 September 2026  01:01:26 +0000 (0:00:01.021)       0:00:18.565 ***
2026-09-09 01:01:27.176798 | instance | changed: [instance]
2026-09-09 01:01:27.176859 | instance |
2026-09-09 01:01:27.177699 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-09-09 01:01:27.177728 | instance | Wednesday 09 September 2026  01:01:27 +0000 (0:00:00.603)       0:00:19.169 ***
2026-09-09 01:01:27.177743 | instance |
2026-09-09 01:01:27.177751 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-09 01:01:27.177759 | instance | Wednesday 09 September 2026  01:01:27 +0000 (0:00:00.031)       0:00:19.200 ***
2026-09-09 01:01:28.140309 | instance | ok: [instance]
2026-09-09 01:01:28.141099 | instance |
2026-09-09 01:01:28.141154 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-09-09 01:01:28.141166 | instance | Wednesday 09 September 2026  01:01:28 +0000 (0:00:00.962)       0:00:20.163 ***
2026-09-09 01:01:28.568685 | instance | changed: [instance]
2026-09-09 01:01:28.568790 | instance |
2026-09-09 01:01:28.568802 | instance | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-09-09 01:01:28.568812 | instance | Wednesday 09 September 2026  01:01:28 +0000 (0:00:00.428)       0:00:20.591 ***
2026-09-09 01:01:29.148679 | instance | changed: [instance]
2026-09-09 01:01:29.148737 | instance |
2026-09-09 01:01:29.148747 | instance | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-09-09 01:01:29.148754 | instance | Wednesday 09 September 2026  01:01:29 +0000 (0:00:00.580)       0:00:21.172 ***
2026-09-09 01:01:29.386338 | instance | ok: [instance]
2026-09-09 01:01:29.386448 | instance |
2026-09-09 01:01:29.386778 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-09-09 01:01:29.386819 | instance | Wednesday 09 September 2026  01:01:29 +0000 (0:00:00.238)       0:00:21.410 ***
2026-09-09 01:01:29.460108 | instance | ok: [instance] => {
2026-09-09 01:01:29.460872 | instance |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-09-09 01:01:29.460896 | instance | }
2026-09-09 01:01:29.460904 | instance |
2026-09-09 01:01:29.460910 | instance | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-09-09 01:01:29.460917 | instance | Wednesday 09 September 2026  01:01:29 +0000 (0:00:00.073)       0:00:21.484 ***
2026-09-09 01:01:30.383444 | instance | changed: [instance]
2026-09-09 01:01:30.384197 | instance |
2026-09-09 01:01:30.384264 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-09-09 01:01:30.384284 | instance | Wednesday 09 September 2026  01:01:30 +0000 (0:00:00.922)       0:00:22.406 ***
2026-09-09 01:01:34.757195 | instance | changed: [instance]
2026-09-09 01:01:34.757970 | instance |
2026-09-09 01:01:34.758038 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-09-09 01:01:34.758056 | instance | Wednesday 09 September 2026  01:01:34 +0000 (0:00:04.373)       0:00:26.780 ***
2026-09-09 01:01:35.961032 | instance | ok: [instance]
2026-09-09 01:01:35.961898 | instance |
2026-09-09 01:01:35.961969 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-09-09 01:01:35.962011 | instance | Wednesday 09 September 2026  01:01:35 +0000 (0:00:01.203)       0:00:27.983 ***
2026-09-09 01:01:36.333903 | instance | changed: [instance]
2026-09-09 01:01:36.334678 | instance |
2026-09-09 01:01:36.334730 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-09-09 01:01:36.334741 | instance | Wednesday 09 September 2026  01:01:36 +0000 (0:00:00.373)       0:00:28.357 ***
2026-09-09 01:01:36.855008 | instance | changed: [instance]
2026-09-09 01:01:36.855797 | instance |
2026-09-09 01:01:36.855991 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-09-09 01:01:36.856011 | instance | Wednesday 09 September 2026  01:01:36 +0000 (0:00:00.521)       0:00:28.878 ***
2026-09-09 01:01:37.457430 | instance | changed: [instance] => (item={'path': '/etc/docker'})
2026-09-09 01:01:37.457884 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-09-09 01:01:37.457931 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-09-09 01:01:37.458682 | instance |
2026-09-09 01:01:37.458735 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-09-09 01:01:37.458747 | instance | Wednesday 09 September 2026  01:01:37 +0000 (0:00:00.602)       0:00:29.480 ***
2026-09-09 01:01:37.959102 | instance | changed: [instance]
2026-09-09 01:01:37.959167 | instance |
2026-09-09 01:01:37.959410 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-09-09 01:01:37.959444 | instance | Wednesday 09 September 2026  01:01:37 +0000 (0:00:00.502)       0:00:29.983 ***
2026-09-09 01:01:38.416688 | instance | changed: [instance]
2026-09-09 01:01:38.416806 | instance |
2026-09-09 01:01:38.417579 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-09-09 01:01:38.417621 | instance | Wednesday 09 September 2026  01:01:38 +0000 (0:00:00.437)       0:00:30.421 ***
2026-09-09 01:01:38.417629 | instance |
2026-09-09 01:01:38.417636 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-09-09 01:01:38.417642 | instance | Wednesday 09 September 2026  01:01:38 +0000 (0:00:00.019)       0:00:30.440 ***
2026-09-09 01:01:39.103682 | instance | ok: [instance]
2026-09-09 01:01:39.104270 | instance |
2026-09-09 01:01:39.104321 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-09-09 01:01:39.104339 | instance | Wednesday 09 September 2026  01:01:39 +0000 (0:00:00.686)       0:00:31.127 ***
2026-09-09 01:01:40.043251 | instance | changed: [instance]
2026-09-09 01:01:40.043323 | instance |
2026-09-09 01:01:40.043551 | instance | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-09-09 01:01:40.043594 | instance | Wednesday 09 September 2026  01:01:40 +0000 (0:00:00.939)       0:00:32.067 ***
2026-09-09 01:01:40.639120 | instance | changed: [instance]
2026-09-09 01:01:40.639207 | instance |
2026-09-09 01:01:40.639491 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-09-09 01:01:40.639527 | instance | Wednesday 09 September 2026  01:01:40 +0000 (0:00:00.595)       0:00:32.663 ***
2026-09-09 01:01:40.725879 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-09-09 01:01:40.726376 | instance |
2026-09-09 01:01:40.726421 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-09-09 01:01:40.726429 | instance | Wednesday 09 September 2026  01:01:40 +0000 (0:00:00.086)       0:00:32.749 ***
2026-09-09 01:01:46.566821 | instance | changed: [instance]
2026-09-09 01:01:46.567027 | instance |
2026-09-09 01:01:46.567038 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-09-09 01:01:46.567045 | instance | Wednesday 09 September 2026  01:01:46 +0000 (0:00:05.840)       0:00:38.590 ***
2026-09-09 01:01:47.244335 | instance | ok: [instance] => (item=chronyd)
2026-09-09 01:01:47.244392 | instance | ok: [instance] => (item=sshd)
2026-09-09 01:01:47.244406 | instance |
2026-09-09 01:01:47.244418 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-09-09 01:01:47.244431 | instance | Wednesday 09 September 2026  01:01:47 +0000 (0:00:00.676)       0:00:39.266 ***
2026-09-09 01:01:56.845784 | instance | changed: [instance]
2026-09-09 01:01:56.846577 | instance |
2026-09-09 01:01:56.846632 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-09-09 01:01:56.846644 | instance | Wednesday 09 September 2026  01:01:56 +0000 (0:00:09.602)       0:00:48.869 ***
2026-09-09 01:01:57.083359 | instance | ok: [instance]
2026-09-09 01:01:57.083425 | instance |
2026-09-09 01:01:57.083437 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-09-09 01:01:57.083447 | instance | Wednesday 09 September 2026  01:01:57 +0000 (0:00:00.235)       0:00:49.104 ***
2026-09-09 01:01:57.569087 | instance | changed: [instance]
2026-09-09 01:01:57.569173 | instance |
2026-09-09 01:01:57.569535 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-09-09 01:01:57.569575 | instance | Wednesday 09 September 2026  01:01:57 +0000 (0:00:00.488)       0:00:49.592 ***
2026-09-09 01:01:57.962402 | instance | changed: [instance]
2026-09-09 01:01:57.962463 | instance |
2026-09-09 01:01:57.962820 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-09-09 01:01:57.962863 | instance | Wednesday 09 September 2026  01:01:57 +0000 (0:00:00.393)       0:00:49.986 ***
2026-09-09 01:01:58.090888 | instance | ok: [instance]
2026-09-09 01:01:58.091642 | instance |
2026-09-09 01:01:58.091696 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-09-09 01:01:58.091708 | instance | Wednesday 09 September 2026  01:01:58 +0000 (0:00:00.127)       0:00:50.114 ***
2026-09-09 01:01:58.347751 | instance | ok: [instance] => (item=instance)
2026-09-09 01:01:58.348581 | instance |
2026-09-09 01:01:58.348636 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-09-09 01:01:58.348648 | instance | Wednesday 09 September 2026  01:01:58 +0000 (0:00:00.257)       0:00:50.371 ***
2026-09-09 01:01:58.400893 | instance | ok: [instance]
2026-09-09 01:01:58.401379 | instance |
2026-09-09 01:01:58.401427 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-09-09 01:01:58.401437 | instance | Wednesday 09 September 2026  01:01:58 +0000 (0:00:00.053)       0:00:50.424 ***
2026-09-09 01:01:58.481739 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance
2026-09-09 01:01:58.481985 | instance |
2026-09-09 01:01:58.482324 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-09-09 01:01:58.482351 | instance | Wednesday 09 September 2026  01:01:58 +0000 (0:00:00.080)       0:00:50.505 ***
2026-09-09 01:01:58.820701 | instance | changed: [instance]
2026-09-09 01:01:58.820759 | instance |
2026-09-09 01:01:58.820771 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-09-09 01:01:58.820781 | instance | Wednesday 09 September 2026  01:01:58 +0000 (0:00:00.337)       0:00:50.842 ***
2026-09-09 01:01:59.496898 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True})
2026-09-09 01:01:59.496957 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-09-09 01:01:59.496970 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-09-09 01:01:59.496981 | instance |
2026-09-09 01:01:59.496991 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-09-09 01:01:59.497000 | instance | Wednesday 09 September 2026  01:01:59 +0000 (0:00:00.675)       0:00:51.518 ***
2026-09-09 01:03:43.953646 | instance | ok: [instance]
2026-09-09 01:03:43.953766 | instance |
2026-09-09 01:03:43.954522 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-09-09 01:03:43.954581 | instance | Wednesday 09 September 2026  01:03:43 +0000 (0:01:44.458)       0:02:35.976 ***
2026-09-09 01:03:44.199038 | instance | changed: [instance]
2026-09-09 01:03:44.199176 | instance |
2026-09-09 01:03:44.199367 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-09-09 01:03:44.199558 | instance | Wednesday 09 September 2026  01:03:44 +0000 (0:00:00.245)       0:02:36.222 ***
2026-09-09 01:03:44.277067 | instance | ok: [instance]
2026-09-09 01:03:44.277126 | instance |
2026-09-09 01:03:44.277423 | instance | TASK [Install Ceph host] *******************************************************
2026-09-09 01:03:44.277441 | instance | Wednesday 09 September 2026  01:03:44 +0000 (0:00:00.078)       0:02:36.301 ***
2026-09-09 01:03:44.336839 | instance | included: vexxhost.ceph.cephadm_host for instance
2026-09-09 01:03:44.336905 | instance |
2026-09-09 01:03:44.336977 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-09-09 01:03:44.337069 | instance | Wednesday 09 September 2026  01:03:44 +0000 (0:00:00.059)       0:02:36.360 ***
2026-09-09 01:03:46.047616 | instance | ok: [instance]
2026-09-09 01:03:46.047742 | instance |
2026-09-09 01:03:46.047791 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-09-09 01:03:46.047935 | instance | Wednesday 09 September 2026  01:03:46 +0000 (0:00:01.710)       0:02:38.071 ***
2026-09-09 01:03:46.118405 | instance | ok: [instance] => (item=instance)
2026-09-09 01:03:46.118498 | instance |
2026-09-09 01:03:46.118552 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-09-09 01:03:46.118696 | instance | Wednesday 09 September 2026  01:03:46 +0000 (0:00:00.070)       0:02:38.141 ***
2026-09-09 01:03:46.483920 | instance | ok: [instance]
2026-09-09 01:03:46.484080 | instance |
2026-09-09 01:03:46.484350 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-09-09 01:03:46.484583 | instance | Wednesday 09 September 2026  01:03:46 +0000 (0:00:00.365)       0:02:38.507 ***
2026-09-09 01:03:48.879483 | instance | ok: [instance]
2026-09-09 01:03:48.879675 | instance |
2026-09-09 01:03:48.879922 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-09-09 01:03:48.880160 | instance | Wednesday 09 September 2026  01:03:48 +0000 (0:00:02.394)       0:02:40.902 ***
2026-09-09 01:04:42.771935 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster)
2026-09-09 01:04:42.772021 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n  File \"<stdin>\", line 107, in <module>\n  File \"<stdin>\", line 99, in _ansiballz_main\n  File \"<stdin>\", line 47, in invoke_module\n  File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n    return _run_module_code(code, init_globals, run_name, mod_spec)\n  File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n    _run_code(code, mod_globals, init_globals,\n  File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n    exec(code, run_globals)\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_9fa_btta/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in <module>\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_9fa_btta/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_9fa_btta/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n  File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_9fa_btta/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBEsKBqIYm+CiAA+MF0S7mjepMYUbyKPKW2A85PXNVp7frqJTUqisNa3DM=: Malformed input [buffer:3]\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBEsKBqIYm+CiAA+MF0S7mjepMYUbyKPKW2A85PXNVp7frqJTUqisNa3DM=: Malformed input [buffer:3]\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgBEsKBqIYm+CiAA+MF0S7mjepMYUbyKPKW2A85PXNVp7frqJTUqisNa3DM=: Malformed input [buffer:3]\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-09T01:04:42.587+0000 7ff3b406a640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1}
2026-09-09 01:04:42.773640 | instance |
2026-09-09 01:04:42.776280 | instance | PLAY RECAP *********************************************************************
2026-09-09 01:04:42.776326 | instance | instance                   : ok=55   changed=26   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-09-09 01:04:42.776344 | instance |
2026-09-09 01:04:42.776359 | instance | Wednesday 09 September 2026  01:04:42 +0000 (0:00:53.895)       0:03:34.797 ***
2026-09-09 01:04:42.776373 | instance | ===============================================================================
2026-09-09 01:04:42.776386 | instance | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 104.46s
2026-09-09 01:04:42.776400 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 53.90s
2026-09-09 01:04:42.776413 | instance | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 9.60s
2026-09-09 01:04:42.776427 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.39s
2026-09-09 01:04:42.776440 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.84s
2026-09-09 01:04:42.776459 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.37s
2026-09-09 01:04:42.776688 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 3.01s
2026-09-09 01:04:42.776999 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.39s
2026-09-09 01:04:42.777346 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.71s
2026-09-09 01:04:42.777649 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.65s
2026-09-09 01:04:42.778011 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.33s
2026-09-09 01:04:42.778353 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.20s
2026-09-09 01:04:42.778647 | instance | Gathering Facts --------------------------------------------------------- 1.02s
2026-09-09 01:04:42.778936 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 1.02s
2026-09-09 01:04:42.779244 | instance | Gathering Facts --------------------------------------------------------- 0.98s
2026-09-09 01:04:42.779531 | instance | Gathering Facts --------------------------------------------------------- 0.96s
2026-09-09 01:04:42.779818 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 0.94s
2026-09-09 01:04:42.780109 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.92s
2026-09-09 01:04:42.780428 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.84s
2026-09-09 01:04:42.780722 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.75s
2026-09-09 01:04:42.872449 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-09 01:04:42.872898 | instance | ERROR    [csi > converge] Executed: Failed
2026-09-09 01:04:42.873074 | instance | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml
2026-09-09 01:04:43.429483 | instance | ERROR
2026-09-09 01:04:43.429793 | instance | {
2026-09-09 01:04:43.429870 | instance |   "delta": "0:04:29.040116",
2026-09-09 01:04:43.429910 | instance |   "end": "2026-09-09 01:04:42.938627",
2026-09-09 01:04:43.429947 | instance |   "msg": "non-zero return code",
2026-09-09 01:04:43.429980 | instance |   "rc": 2,
2026-09-09 01:04:43.430014 | instance |   "start": "2026-09-09 01:00:13.898511"
2026-09-09 01:04:43.430048 | instance | }
failure
2026-09-09 01:04:43.439310 | 
2026-09-09 01:04:43.439409 | PLAY RECAP
2026-09-09 01:04:43.439497 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-09-09 01:04:43.439539 | 
2026-09-09 01:04:43.602053 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-09-09 01:04:43.604007 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-09 01:04:44.280284 | 
2026-09-09 01:04:44.280449 | PLAY [all]
2026-09-09 01:04:44.295963 | 
2026-09-09 01:04:44.296105 | TASK [gather-host-logs : creating directory for system status]
2026-09-09 01:04:44.702133 | instance | changed
2026-09-09 01:04:44.708911 | 
2026-09-09 01:04:44.709036 | TASK [gather-host-logs : Get logs for each host]
2026-09-09 01:04:45.083470 | instance | + systemd-cgls --full --all --no-pager
2026-09-09 01:04:45.100377 | instance | + ip addr
2026-09-09 01:04:45.103048 | instance | + ip route
2026-09-09 01:04:45.105620 | instance | + lsblk
2026-09-09 01:04:45.110447 | instance | + mount
2026-09-09 01:04:45.113335 | instance | + docker images
2026-09-09 01:04:45.138988 | instance | + brctl show
2026-09-09 01:04:45.139538 | instance | /bin/bash: line 8: brctl: command not found
2026-09-09 01:04:45.139918 | instance | + ps aux --sort=-%mem
2026-09-09 01:04:45.162444 | instance | + dpkg -l
2026-09-09 01:04:45.175982 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-09-09 01:04:45.176561 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-09-09 01:04:45.197767 | instance | + '[' '!' -z '' ']'
2026-09-09 01:04:45.257935 | instance | ok: Runtime: 0:00:00.119881
2026-09-09 01:04:45.268891 | 
2026-09-09 01:04:45.269110 | TASK [gather-host-logs : Downloads logs to executor]
2026-09-09 01:04:45.917430 | instance | changed:
2026-09-09 01:04:45.917731 | instance | created directory /var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/logs/instance
2026-09-09 01:04:45.917803 | instance | cd+++++++++ system/
2026-09-09 01:04:45.917863 | instance | >f+++++++++ system/brctl-show.txt
2026-09-09 01:04:45.917920 | instance | >f+++++++++ system/docker-images.txt
2026-09-09 01:04:45.917962 | instance | >f+++++++++ system/ip-addr.txt
2026-09-09 01:04:45.918004 | instance | >f+++++++++ system/ip-route.txt
2026-09-09 01:04:45.918047 | instance | >f+++++++++ system/lsblk.txt
2026-09-09 01:04:45.918101 | instance | >f+++++++++ system/mount.txt
2026-09-09 01:04:45.918139 | instance | >f+++++++++ system/packages.txt
2026-09-09 01:04:45.918175 | instance | >f+++++++++ system/ps.txt
2026-09-09 01:04:45.918217 | instance | >f+++++++++ system/systemd-cgls.txt
2026-09-09 01:04:45.936940 | 
2026-09-09 01:04:45.937182 | LOOP [helm-release-status : creating directory for helm release status]
2026-09-09 01:04:46.167323 | instance | changed: "values"
2026-09-09 01:04:46.362464 | instance | changed: "releases"
2026-09-09 01:04:46.383134 | 
2026-09-09 01:04:46.383354 | TASK [helm-release-status : Gather get release status for helm charts]
2026-09-09 01:04:46.644810 | instance | /bin/bash: line 3: kubectl: command not found
2026-09-09 01:04:46.935630 | instance | ok: Runtime: 0:00:00.005374
2026-09-09 01:04:46.949215 | 
2026-09-09 01:04:46.949398 | TASK [helm-release-status : Downloads logs to executor]
2026-09-09 01:04:47.540074 | instance | changed:
2026-09-09 01:04:47.540814 | instance | cd+++++++++ helm/
2026-09-09 01:04:47.540908 | instance | cd+++++++++ helm/releases/
2026-09-09 01:04:47.540957 | instance | cd+++++++++ helm/values/
2026-09-09 01:04:47.559575 | 
2026-09-09 01:04:47.559677 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-09-09 01:04:47.799049 | instance | changed
2026-09-09 01:04:47.810516 | 
2026-09-09 01:04:47.810717 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-09-09 01:04:48.099091 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-09 01:04:48.099466 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-09 01:04:48.103556 | instance | environment: line 1: kubectl: command not found
2026-09-09 01:04:48.104941 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-09 01:04:48.105744 | instance | environment: line 1: kubectl: command not found
2026-09-09 01:04:48.107241 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-09 01:04:48.108625 | instance | environment: line 1: kubectl: command not found
2026-09-09 01:04:48.109844 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-09 01:04:48.111356 | instance | environment: line 1: kubectl: command not found
2026-09-09 01:04:48.112670 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-09 01:04:48.113565 | instance | environment: line 1: kubectl: command not found
2026-09-09 01:04:48.114918 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-09-09 01:04:48.360350 | instance | ok: Runtime: 0:00:00.022722
2026-09-09 01:04:48.366302 | 
2026-09-09 01:04:48.366396 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-09-09 01:04:48.585206 | instance | changed
2026-09-09 01:04:48.598580 | 
2026-09-09 01:04:48.598837 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-09-09 01:04:48.864968 | instance | environment: line 5: kubectl: command not found
2026-09-09 01:04:48.866004 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-09 01:04:48.866051 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-09 01:04:48.866226 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-09-09 01:04:49.153819 | instance | ok: Runtime: 0:00:00.006193
2026-09-09 01:04:49.169079 | 
2026-09-09 01:04:49.169260 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-09-09 01:04:49.735078 | instance | changed:
2026-09-09 01:04:49.735352 | instance | cd+++++++++ objects/
2026-09-09 01:04:49.735407 | instance | cd+++++++++ objects/cluster/
2026-09-09 01:04:49.735451 | instance | cd+++++++++ objects/namespaced/
2026-09-09 01:04:49.756244 | 
2026-09-09 01:04:49.756367 | TASK [gather-pod-logs : creating directory for pod logs]
2026-09-09 01:04:49.986538 | instance | changed
2026-09-09 01:04:50.000104 | 
2026-09-09 01:04:50.000390 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-09-09 01:04:50.224546 | instance | changed
2026-09-09 01:04:50.237080 | 
2026-09-09 01:04:50.237195 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-09-09 01:04:50.507589 | instance | environment: line 3: kubectl: command not found
2026-09-09 01:04:50.784869 | instance | ok: Runtime: 0:00:00.009577
2026-09-09 01:04:50.794410 | 
2026-09-09 01:04:50.794560 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-09-09 01:04:51.387913 | instance | changed:
2026-09-09 01:04:51.388137 | instance | cd+++++++++ pod-logs/
2026-09-09 01:04:51.388281 | instance | cd+++++++++ pod-logs/failed-pods/
2026-09-09 01:04:51.404768 | 
2026-09-09 01:04:51.404917 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-09-09 01:04:51.647594 | instance | changed
2026-09-09 01:04:51.660631 | 
2026-09-09 01:04:51.660779 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-09-09 01:04:51.913080 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-09 01:04:52.209272 | instance | ok: Runtime: 0:00:00.039099
2026-09-09 01:04:52.217068 | 
2026-09-09 01:04:52.217215 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-09-09 01:04:52.449502 | instance | /bin/bash: line 2: kubectl: command not found
2026-09-09 01:04:52.496604 | instance | ceph-mgr endpoints:
2026-09-09 01:04:52.760670 | instance | ok: Runtime: 0:00:00.052743
2026-09-09 01:04:52.766513 | 
2026-09-09 01:04:52.766608 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-09-09 01:04:53.047882 | instance | /bin/bash: line 4: kubectl: command not found
2026-09-09 01:04:53.295070 | instance | ok: Runtime: 0:00:00.055766
2026-09-09 01:04:53.303667 | 
2026-09-09 01:04:53.303840 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-09-09 01:04:53.824790 | instance | changed: cd+++++++++ prometheus/
2026-09-09 01:04:53.841840 | 
2026-09-09 01:04:53.841977 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-09-09 01:04:54.062167 | instance | changed
2026-09-09 01:04:54.071665 | 
2026-09-09 01:04:54.071840 | TASK [gather-selenium-data : Get selenium data]
2026-09-09 01:04:54.399790 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-09-09 01:04:54.401429 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-09-09 01:04:54.619746 | instance | ERROR
2026-09-09 01:04:54.620079 | instance | {
2026-09-09 01:04:54.620164 | instance |   "delta": "0:00:00.006404",
2026-09-09 01:04:54.620209 | instance |   "end": "2026-09-09 01:04:54.401819",
2026-09-09 01:04:54.620251 | instance |   "msg": "non-zero return code",
2026-09-09 01:04:54.620286 | instance |   "rc": 1,
2026-09-09 01:04:54.620321 | instance |   "start": "2026-09-09 01:04:54.395415"
2026-09-09 01:04:54.620354 | instance | }
2026-09-09 01:04:54.620398 | instance | ERROR: Ignoring Errors
2026-09-09 01:04:54.631084 | 
2026-09-09 01:04:54.631226 | TASK [gather-selenium-data : Downloads logs to executor]
2026-09-09 01:04:55.146843 | instance | changed: cd+++++++++ selenium/
2026-09-09 01:04:55.152385 | 
2026-09-09 01:04:55.152440 | PLAY RECAP
2026-09-09 01:04:55.152480 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-09-09 01:04:55.152519 | 
2026-09-09 01:04:55.303541 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main]
2026-09-09 01:04:55.315091 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-09 01:04:55.928193 | 
2026-09-09 01:04:55.928316 | PLAY [all]
2026-09-09 01:04:55.939051 | 
2026-09-09 01:04:55.939130 | TASK [fetch-output : Set log path for multiple nodes]
2026-09-09 01:04:55.993615 | instance | skipping: Conditional result was False
2026-09-09 01:04:56.000103 | 
2026-09-09 01:04:56.000207 | TASK [fetch-output : Set log path for single node]
2026-09-09 01:04:56.043294 | instance | ok
2026-09-09 01:04:56.052716 | 
2026-09-09 01:04:56.052866 | LOOP [fetch-output : Ensure local output dirs]
2026-09-09 01:04:56.472593 | instance -> localhost | ok: "/var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/logs"
2026-09-09 01:04:56.713147 | instance -> localhost | changed: "/var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/artifacts"
2026-09-09 01:04:56.952946 | instance -> localhost | changed: "/var/lib/zuul/builds/1521a7a4a5ec49089c34783f786f108a/work/docs"
2026-09-09 01:04:56.975729 | 
2026-09-09 01:04:56.975910 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-09-09 01:04:57.661062 | instance | changed: .d..t...... ./
2026-09-09 01:04:57.661346 | instance | changed: All items complete
2026-09-09 01:04:57.661383 | 
2026-09-09 01:04:58.149603 | instance | changed: .d..t...... ./
2026-09-09 01:04:58.690221 | instance | changed: .d..t...... ./
2026-09-09 01:04:58.706850 | 
2026-09-09 01:04:58.707622 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-09-09 01:04:59.217930 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007736
2026-09-09 01:04:59.468862 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.008843
2026-09-09 01:04:59.488015 | 
2026-09-09 01:04:59.488163 | PLAY [all]
2026-09-09 01:04:59.499593 | 
2026-09-09 01:04:59.499741 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-09-09 01:04:59.990003 | instance | changed
2026-09-09 01:04:59.995238 | 
2026-09-09 01:04:59.995290 | PLAY RECAP
2026-09-09 01:04:59.995332 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-09-09 01:04:59.995352 | 
2026-09-09 01:05:00.138238 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-09-09 01:05:00.142790 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-09-09 01:05:00.720460 | 
2026-09-09 01:05:00.720997 | PLAY [localhost]
2026-09-09 01:05:00.730129 | 
2026-09-09 01:05:00.730199 | TASK [Generate Zuul manifest]
2026-09-09 01:05:00.746963 | localhost | ok
2026-09-09 01:05:00.763170 | 
2026-09-09 01:05:00.763261 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-09-09 01:05:01.166715 | localhost | changed
2026-09-09 01:05:01.179944 | 
2026-09-09 01:05:01.180055 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-09-09 01:05:01.208562 | localhost | ok
2026-09-09 01:05:01.217133 | 
2026-09-09 01:05:01.217219 | TASK [Upload logs]
2026-09-09 01:05:01.260111 | localhost | ok
2026-09-09 01:05:01.327074 | 
2026-09-09 01:05:01.327201 | TASK [Set zuul-log-path fact]
2026-09-09 01:05:01.345001 | localhost | ok
2026-09-09 01:05:01.355540 | 
2026-09-09 01:05:01.355606 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-09-09 01:05:01.385213 | localhost | ok
2026-09-09 01:05:01.394626 | 
2026-09-09 01:05:01.394752 | TASK [upload-logs : Create log directories]
2026-09-09 01:05:01.963806 | localhost | changed
2026-09-09 01:05:01.970622 | 
2026-09-09 01:05:01.970728 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-09-09 01:05:02.373648 | localhost -> localhost | ok: Runtime: 0:00:00.006471
2026-09-09 01:05:02.385449 | 
2026-09-09 01:05:02.385626 | TASK [upload-logs : Upload logs to log server]
2026-09-09 01:05:02.923502 | localhost | Output suppressed because no_log was given
2026-09-09 01:05:02.996626 | 
2026-09-09 01:05:02.996816 | LOOP [upload-logs : Compress console log and json output]
2026-09-09 01:05:03.060638 | localhost | skipping: Conditional result was False
2026-09-09 01:05:03.070773 | localhost | skipping: Conditional result was False
2026-09-09 01:05:03.077336 | 
2026-09-09 01:05:03.077437 | LOOP [upload-logs : Upload compressed console log and json output]
2026-09-09 01:05:03.123285 | localhost | skipping: Conditional result was False
2026-09-09 01:05:03.123635 | 
2026-09-09 01:05:03.126984 | localhost | skipping: Conditional result was False
2026-09-09 01:05:03.138936 | 
2026-09-09 01:05:03.139145 | LOOP [upload-logs : Upload console log and json output]