2026-09-10 10:52:01.459836 | Job console starting 2026-09-10 10:52:01.603246 | Updating git repos 2026-09-10 10:52:09.796860 | Cloning repos into workspace 2026-09-10 10:52:26.698662 | Restoring repo states 2026-09-10 10:52:33.507382 | Merging changes 2026-09-10 10:52:35.121676 | Checking out repos 2026-09-10 10:52:37.132801 | Preparing playbooks 2026-09-10 10:52:39.225098 | Running Ansible setup 2026-09-10 10:52:43.944967 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-09-10 10:52:44.583130 | 2026-09-10 10:52:44.583671 | PLAY [localhost] 2026-09-10 10:52:44.591733 | 2026-09-10 10:52:44.591848 | TASK [Gathering Facts] 2026-09-10 10:52:45.445978 | localhost | ok 2026-09-10 10:52:45.453795 | 2026-09-10 10:52:45.453915 | TASK [Setup log path fact] 2026-09-10 10:52:45.471382 | localhost | ok 2026-09-10 10:52:45.483816 | 2026-09-10 10:52:45.483927 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-09-10 10:52:45.519779 | localhost | ok 2026-09-10 10:52:45.530318 | 2026-09-10 10:52:45.530433 | TASK [emit-job-header : Print job information] 2026-09-10 10:52:45.567890 | # Job Information 2026-09-10 10:52:45.568085 | Ansible Version: 2.16.18 2026-09-10 10:52:45.568133 | Job: atmosphere-molecule-csi-rbd 2026-09-10 10:52:45.568167 | Pipeline: check 2026-09-10 10:52:45.568194 | Executor: 2d72f0692154 2026-09-10 10:52:45.568218 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3501 2026-09-10 10:52:45.568247 | Event ID: 1a77da20-ad05-11f1-940a-27dcc9a1206b 2026-09-10 10:52:45.571924 | 2026-09-10 10:52:45.572015 | LOOP [emit-job-header : Print node information] 2026-09-10 10:52:45.661331 | localhost | ok: 2026-09-10 10:52:45.661629 | localhost | # Node Information 2026-09-10 10:52:45.661656 | localhost | Inventory Hostname: instance 2026-09-10 10:52:45.661676 | localhost | Hostname: np0000192479 2026-09-10 10:52:45.661693 | localhost | Username: zuul 2026-09-10 10:52:45.661715 | localhost | Distro: Ubuntu 22.04 2026-09-10 10:52:45.661732 | localhost | Provider: yul1 2026-09-10 10:52:45.661749 | localhost | Region: ca-ymq-1 2026-09-10 10:52:45.661765 | localhost | Label: ubuntu-jammy 2026-09-10 10:52:45.661782 | localhost | Product Name: OpenStack Nova 2026-09-10 10:52:45.661798 | localhost | Interface IP: 162.253.55.241 2026-09-10 10:52:45.674875 | 2026-09-10 10:52:45.675031 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-09-10 10:52:46.076986 | localhost -> localhost | changed 2026-09-10 10:52:46.086201 | 2026-09-10 10:52:46.086362 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-09-10 10:52:47.074127 | localhost -> localhost | changed 2026-09-10 10:52:47.085298 | 2026-09-10 10:52:47.085446 | PLAY [all] 2026-09-10 10:52:47.103413 | 2026-09-10 10:52:47.103601 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-09-10 10:52:47.361503 | instance -> localhost | ok 2026-09-10 10:52:47.367513 | 2026-09-10 10:52:47.367633 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-09-10 10:52:47.387222 | instance | ok 2026-09-10 10:52:47.401849 | instance | included: /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-09-10 10:52:47.409327 | 2026-09-10 10:52:47.409433 | TASK [add-build-sshkey : Create Temp SSH key] 2026-09-10 10:52:48.335463 | instance -> localhost | Generating public/private rsa key pair. 2026-09-10 10:52:48.335641 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/0110af2b99a641c6b1c7b25ba2177788_id_rsa 2026-09-10 10:52:48.335684 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/0110af2b99a641c6b1c7b25ba2177788_id_rsa.pub 2026-09-10 10:52:48.335718 | instance -> localhost | The key fingerprint is: 2026-09-10 10:52:48.335749 | instance -> localhost | SHA256:Gps4W7U0uRhoJjcbC5dg2wYXla8L0KxCOqdrpav7jGY zuul-build-sshkey 2026-09-10 10:52:48.335792 | instance -> localhost | The key's randomart image is: 2026-09-10 10:52:48.335824 | instance -> localhost | +---[RSA 3072]----+ 2026-09-10 10:52:48.335860 | instance -> localhost | | .... | 2026-09-10 10:52:48.335892 | instance -> localhost | | .. | 2026-09-10 10:52:48.335921 | instance -> localhost | | +o. . | 2026-09-10 10:52:48.335950 | instance -> localhost | | o.*oo .. | 2026-09-10 10:52:48.335979 | instance -> localhost | |o +o% o.S | 2026-09-10 10:52:48.336009 | instance -> localhost | |+ oX.*.X + | 2026-09-10 10:52:48.336038 | instance -> localhost | | =o =.*.o | 2026-09-10 10:52:48.336085 | instance -> localhost | |.E +. | 2026-09-10 10:52:48.336120 | instance -> localhost | |X=+ . | 2026-09-10 10:52:48.336151 | instance -> localhost | +----[SHA256]-----+ 2026-09-10 10:52:48.336217 | instance -> localhost | ok: Runtime: 0:00:00.330687 2026-09-10 10:52:48.344293 | 2026-09-10 10:52:48.344417 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-09-10 10:52:48.364038 | instance | ok 2026-09-10 10:52:48.374948 | instance | included: /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-09-10 10:52:48.385775 | 2026-09-10 10:52:48.385919 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-09-10 10:52:48.409659 | instance | skipping: Conditional result was False 2026-09-10 10:52:48.417599 | 2026-09-10 10:52:48.417732 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-09-10 10:52:48.886768 | instance | changed 2026-09-10 10:52:48.897029 | 2026-09-10 10:52:48.897159 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-09-10 10:52:49.076371 | instance | ok 2026-09-10 10:52:49.080956 | 2026-09-10 10:52:49.081034 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-09-10 10:52:49.592342 | instance | changed 2026-09-10 10:52:49.598644 | 2026-09-10 10:52:49.598744 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-09-10 10:52:50.109538 | instance | changed 2026-09-10 10:52:50.115649 | 2026-09-10 10:52:50.115734 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-09-10 10:52:50.140181 | instance | skipping: Conditional result was False 2026-09-10 10:52:50.148163 | 2026-09-10 10:52:50.148284 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-09-10 10:52:50.539704 | instance -> localhost | changed 2026-09-10 10:52:50.554098 | 2026-09-10 10:52:50.554228 | TASK [add-build-sshkey : Add back temp key] 2026-09-10 10:52:50.948024 | instance -> localhost | Identity added: /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/0110af2b99a641c6b1c7b25ba2177788_id_rsa (zuul-build-sshkey) 2026-09-10 10:52:50.948221 | instance -> localhost | ok: Runtime: 0:00:00.011041 2026-09-10 10:52:50.953393 | 2026-09-10 10:52:50.953493 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-09-10 10:52:51.286723 | instance | ok 2026-09-10 10:52:51.296476 | 2026-09-10 10:52:51.296700 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-09-10 10:52:51.322915 | instance | skipping: Conditional result was False 2026-09-10 10:52:51.340299 | 2026-09-10 10:52:51.340431 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-09-10 10:52:51.726318 | instance | ok 2026-09-10 10:52:51.731295 | 2026-09-10 10:52:51.731371 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-09-10 10:53:01.864535 | instance | Output suppressed because no_log was given 2026-09-10 10:53:01.872577 | 2026-09-10 10:53:01.872643 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-09-10 10:53:02.073395 | instance | ok: "logs" 2026-09-10 10:53:02.073882 | instance | ok: All items complete 2026-09-10 10:53:02.073991 | 2026-09-10 10:53:02.255643 | instance | ok: "artifacts" 2026-09-10 10:53:02.439331 | instance | ok: "docs" 2026-09-10 10:53:02.455229 | 2026-09-10 10:53:02.455446 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-09-10 10:53:02.649620 | instance | changed: "logs" 2026-09-10 10:53:02.840577 | instance | changed: "artifacts" 2026-09-10 10:53:02.994377 | instance | changed: "docs" 2026-09-10 10:53:03.009550 | 2026-09-10 10:53:03.009723 | PLAY RECAP 2026-09-10 10:53:03.009837 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-09-10 10:53:03.009919 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-10 10:53:03.010000 | 2026-09-10 10:53:03.199277 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-09-10 10:53:03.202039 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-09-10 10:53:03.781755 | 2026-09-10 10:53:03.781881 | PLAY [all] 2026-09-10 10:53:03.793196 | 2026-09-10 10:53:03.793332 | TASK [setup-uv : Extract archive] 2026-09-10 10:53:06.126353 | instance | changed 2026-09-10 10:53:06.132277 | 2026-09-10 10:53:06.132390 | TASK [setup-uv : Print version] 2026-09-10 10:53:06.678956 | instance | uv 0.8.13 2026-09-10 10:53:07.162382 | instance | ok: Runtime: 0:00:00.010158 2026-09-10 10:53:07.174065 | 2026-09-10 10:53:07.174183 | TASK [Install Ansible collection siblings] 2026-09-10 10:53:17.546911 | instance | changed: 2026-09-10 10:53:17.551058 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon 2026-09-10 10:53:17.551113 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix 2026-09-10 10:53:17.551151 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils 2026-09-10 10:53:17.551175 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto 2026-09-10 10:53:17.551194 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general 2026-09-10 10:53:17.551216 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql 2026-09-10 10:53:17.551243 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core 2026-09-10 10:53:17.551275 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph 2026-09-10 10:53:17.551301 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers 2026-09-10 10:53:17.551328 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes 2026-09-10 10:53:17.551347 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common 2026-09-10 10:53:17.551364 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack 2026-09-10 10:53:17.551382 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0 2026-09-10 10:53:17.551400 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0 2026-09-10 10:53:17.551417 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0 2026-09-10 10:53:17.551434 | instance | Resolved community.crypto to 2.2.3 for 2.2.3 2026-09-10 10:53:17.551451 | instance | Resolved community.general to 7.3.0 for 7.3.0 2026-09-10 10:53:17.551469 | instance | Resolved community.mysql to 3.6.0 for 3.6.0 2026-09-10 10:53:17.551485 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0 2026-09-10 10:53:17.551502 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0 2026-09-10 10:53:17.551518 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.2.0 2026-09-10 10:53:17.551536 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0 2026-09-10 10:53:17.551554 | instance | Resolved vexxhost.kubernetes to v3.4.0 for >=3.3.0,>=2.5.0 2026-09-10 10:53:17.551581 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0 2026-09-10 10:53:17.551599 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0 2026-09-10 10:53:17.551615 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0 2026-09-10 10:53:17.551633 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2 2026-09-10 10:53:17.551649 | instance | Resolved vexxhost.kubernetes to v3.4.0 for >=3.3.0,>=2.5.0 2026-09-10 10:53:17.551666 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0 2026-09-10 10:53:17.551683 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3 2026-09-10 10:53:17.551700 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2 2026-09-10 10:53:17.551717 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0 2026-09-10 10:53:17.551734 | instance | Checked out ansible.netcommon to 1.2.0 2026-09-10 10:53:17.551751 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon 2026-09-10 10:53:17.551775 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.551792 | instance | Process install dependency map 2026-09-10 10:53:17.551809 | instance | Starting collection install process 2026-09-10 10:53:17.551826 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon' 2026-09-10 10:53:17.551843 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon 2026-09-10 10:53:17.551859 | instance | ansible.netcommon:* was installed successfully 2026-09-10 10:53:17.551874 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-09-10 10:53:17.551891 | instance | Creating virtual environment at: .venv 2026-09-10 10:53:17.551907 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-09-10 10:53:17.551925 | instance | Downloading cryptography (4.2MiB) 2026-09-10 10:53:17.551941 | instance | Downloading kubernetes (1.9MiB) 2026-09-10 10:53:17.551963 | instance | Downloading rjsonnet (1.2MiB) 2026-09-10 10:53:17.551982 | instance | Downloading openstacksdk (1.7MiB) 2026-09-10 10:53:17.551998 | instance | Downloading netaddr (2.2MiB) 2026-09-10 10:53:17.552015 | instance | Downloading setuptools (1.1MiB) 2026-09-10 10:53:17.552032 | instance | Downloading ansible-core (2.1MiB) 2026-09-10 10:53:17.552049 | instance | Downloading pydantic-core (2.0MiB) 2026-09-10 10:53:17.552067 | instance | Downloading pygments (1.2MiB) 2026-09-10 10:53:17.552083 | instance | Building pyperclip==1.9.0 2026-09-10 10:53:17.552101 | instance | Downloading rjsonnet 2026-09-10 10:53:17.552119 | instance | Downloading pydantic-core 2026-09-10 10:53:17.552157 | instance | Downloading netaddr 2026-09-10 10:53:17.552178 | instance | Downloading pygments 2026-09-10 10:53:17.552197 | instance | Downloading cryptography 2026-09-10 10:53:17.552213 | instance | Downloading setuptools 2026-09-10 10:53:17.552230 | instance | Downloading kubernetes 2026-09-10 10:53:17.552247 | instance | Downloading ansible-core 2026-09-10 10:53:17.552263 | instance | Downloading openstacksdk 2026-09-10 10:53:17.552281 | instance | Built pyperclip==1.9.0 2026-09-10 10:53:17.552298 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-09-10 10:53:17.552315 | instance | Installed 83 packages in 61ms 2026-09-10 10:53:17.552333 | instance | Checked out ansible.posix to 1.6.0 2026-09-10 10:53:17.552350 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix 2026-09-10 10:53:17.552367 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.552384 | instance | Process install dependency map 2026-09-10 10:53:17.552405 | instance | Starting collection install process 2026-09-10 10:53:17.552423 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix' 2026-09-10 10:53:17.552440 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix 2026-09-10 10:53:17.552457 | instance | ansible.posix:1.6.0 was installed successfully 2026-09-10 10:53:17.552474 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.552491 | instance | 2.17.12 2026-09-10 10:53:17.552537 | instance | Checked out ansible.utils to v6.1.0 2026-09-10 10:53:17.552556 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils 2026-09-10 10:53:17.552573 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.552591 | instance | Process install dependency map 2026-09-10 10:53:17.552607 | instance | Starting collection install process 2026-09-10 10:53:17.552625 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils' 2026-09-10 10:53:17.552641 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils 2026-09-10 10:53:17.552658 | instance | ansible.utils:6.1.0 was installed successfully 2026-09-10 10:53:17.552675 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.552691 | instance | 2.17.12 2026-09-10 10:53:17.552708 | instance | Checked out atmosphere.common to v0.7.0 2026-09-10 10:53:17.552725 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common 2026-09-10 10:53:17.552742 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.552759 | instance | Process install dependency map 2026-09-10 10:53:17.552775 | instance | Starting collection install process 2026-09-10 10:53:17.552791 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common' 2026-09-10 10:53:17.552809 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common 2026-09-10 10:53:17.552828 | instance | atmosphere.common:0.7.0 was installed successfully 2026-09-10 10:53:17.552847 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.552864 | instance | 2.17.12 2026-09-10 10:53:17.552880 | instance | Checked out community.crypto to 2.2.3 2026-09-10 10:53:17.552898 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto 2026-09-10 10:53:17.552914 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.552931 | instance | Process install dependency map 2026-09-10 10:53:17.552947 | instance | Starting collection install process 2026-09-10 10:53:17.552964 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto' 2026-09-10 10:53:17.552981 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto 2026-09-10 10:53:17.552998 | instance | community.crypto:2.2.3 was installed successfully 2026-09-10 10:53:17.553014 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553029 | instance | 2.17.12 2026-09-10 10:53:17.553046 | instance | Checked out community.general to 7.3.0 2026-09-10 10:53:17.553063 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general 2026-09-10 10:53:17.553084 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553102 | instance | Process install dependency map 2026-09-10 10:53:17.553118 | instance | Starting collection install process 2026-09-10 10:53:17.553156 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general' 2026-09-10 10:53:17.553176 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general 2026-09-10 10:53:17.553194 | instance | community.general:7.3.0 was installed successfully 2026-09-10 10:53:17.553211 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553228 | instance | 2.17.12 2026-09-10 10:53:17.553245 | instance | Checked out community.mysql to 3.6.0 2026-09-10 10:53:17.553264 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql 2026-09-10 10:53:17.553281 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553298 | instance | Process install dependency map 2026-09-10 10:53:17.553315 | instance | Starting collection install process 2026-09-10 10:53:17.553331 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql' 2026-09-10 10:53:17.553349 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql 2026-09-10 10:53:17.553365 | instance | community.mysql:3.6.0 was installed successfully 2026-09-10 10:53:17.553381 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553397 | instance | 2.17.12 2026-09-10 10:53:17.553413 | instance | Checked out kubernetes.core to 2.4.0 2026-09-10 10:53:17.553430 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core 2026-09-10 10:53:17.553447 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553463 | instance | Process install dependency map 2026-09-10 10:53:17.553479 | instance | Starting collection install process 2026-09-10 10:53:17.553497 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core' 2026-09-10 10:53:17.553513 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core 2026-09-10 10:53:17.553530 | instance | kubernetes.core:2.4.0 was installed successfully 2026-09-10 10:53:17.553546 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553563 | instance | 2.17.12 2026-09-10 10:53:17.553579 | instance | Checked out openstack.cloud to 2.6.0 2026-09-10 10:53:17.553596 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack 2026-09-10 10:53:17.553614 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553630 | instance | Process install dependency map 2026-09-10 10:53:17.553645 | instance | Starting collection install process 2026-09-10 10:53:17.553661 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud' 2026-09-10 10:53:17.553679 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud 2026-09-10 10:53:17.553695 | instance | openstack.cloud:2.6.0 was installed successfully 2026-09-10 10:53:17.553712 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553729 | instance | 2.17.12 2026-09-10 10:53:17.553750 | instance | Checked out vexxhost.ceph to v4.2.0 2026-09-10 10:53:17.553767 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph 2026-09-10 10:53:17.553784 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553800 | instance | Process install dependency map 2026-09-10 10:53:17.553816 | instance | Starting collection install process 2026-09-10 10:53:17.553832 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph' 2026-09-10 10:53:17.553849 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph 2026-09-10 10:53:17.553866 | instance | vexxhost.ceph:4.2.0 was installed successfully 2026-09-10 10:53:17.553882 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.553898 | instance | 2.17.12 2026-09-10 10:53:17.553915 | instance | Checked out vexxhost.containers to v1.6.8 2026-09-10 10:53:17.553931 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers 2026-09-10 10:53:17.553949 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.553966 | instance | Process install dependency map 2026-09-10 10:53:17.553983 | instance | Starting collection install process 2026-09-10 10:53:17.553999 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers' 2026-09-10 10:53:17.554016 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers 2026-09-10 10:53:17.554034 | instance | vexxhost.containers:1.6.8 was installed successfully 2026-09-10 10:53:17.554050 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.554067 | instance | 2.17.12 2026-09-10 10:53:17.554084 | instance | Checked out vexxhost.kubernetes to v3.4.0 2026-09-10 10:53:17.554101 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes 2026-09-10 10:53:17.554118 | instance | Starting galaxy collection install process 2026-09-10 10:53:17.554146 | instance | Process install dependency map 2026-09-10 10:53:17.554165 | instance | Starting collection install process 2026-09-10 10:53:17.554182 | instance | Installing 'vexxhost.kubernetes:3.4.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes' 2026-09-10 10:53:17.554198 | instance | Created collection for vexxhost.kubernetes:3.4.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes 2026-09-10 10:53:17.554215 | instance | vexxhost.kubernetes:3.4.0 was installed successfully 2026-09-10 10:53:17.554231 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-09-10 10:53:17.554246 | instance | 2.17.12 2026-09-10 10:53:17.559562 | 2026-09-10 10:53:17.559609 | PLAY RECAP 2026-09-10 10:53:17.559650 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-10 10:53:17.559670 | 2026-09-10 10:53:17.698623 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-09-10 10:53:17.701301 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main] 2026-09-10 10:53:18.359052 | 2026-09-10 10:53:18.359227 | PLAY [all] 2026-09-10 10:53:18.370881 | 2026-09-10 10:53:18.371018 | TASK [Install "jq" for log collection] 2026-09-10 10:53:28.386474 | instance | changed 2026-09-10 10:53:28.389274 | 2026-09-10 10:53:28.389356 | PLAY RECAP 2026-09-10 10:53:28.389426 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-09-10 10:53:28.389508 | 2026-09-10 10:53:28.519107 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main] 2026-09-10 10:53:28.738519 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-09-10 10:53:29.477371 | 2026-09-10 10:53:29.477535 | PLAY [all] 2026-09-10 10:53:29.488242 | 2026-09-10 10:53:29.488327 | LOOP [Check inventory directories] 2026-09-10 10:53:29.837796 | instance | ok: "src/github.com/vexxhost/atmosphere" 2026-09-10 10:53:30.014323 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory" 2026-09-10 10:53:30.186575 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory" 2026-09-10 10:53:30.205414 | 2026-09-10 10:53:30.205576 | LOOP [Copy inventory file for Zuul] 2026-09-10 10:53:31.003476 | instance | changed: 2026-09-10 10:53:31.004632 | instance | { 2026-09-10 10:53:31.004687 | instance | "ansible_loop_var": "item", 2026-09-10 10:53:31.004732 | instance | "changed": false, 2026-09-10 10:53:31.004765 | instance | "failed": false, 2026-09-10 10:53:31.004797 | instance | "invocation": { 2026-09-10 10:53:31.004824 | instance | "module_args": { 2026-09-10 10:53:31.004848 | instance | "checksum_algorithm": "sha1", 2026-09-10 10:53:31.004871 | instance | "follow": true, 2026-09-10 10:53:31.004893 | instance | "get_attributes": true, 2026-09-10 10:53:31.004918 | instance | "get_checksum": true, 2026-09-10 10:53:31.004943 | instance | "get_mime": true, 2026-09-10 10:53:31.004968 | instance | "path": "src/github.com/vexxhost/atmosphere" 2026-09-10 10:53:31.004994 | instance | } 2026-09-10 10:53:31.005018 | instance | }, 2026-09-10 10:53:31.005042 | instance | "item": "src/github.com/vexxhost/atmosphere", 2026-09-10 10:53:31.005068 | instance | "stat": { 2026-09-10 10:53:31.005097 | instance | "atime": 1789037590.144329, 2026-09-10 10:53:31.005126 | instance | "attr_flags": "e", 2026-09-10 10:53:31.005155 | instance | "attributes": [ 2026-09-10 10:53:31.005199 | instance | "extents" 2026-09-10 10:53:31.005231 | instance | ], 2026-09-10 10:53:31.005261 | instance | "block_size": 4096, 2026-09-10 10:53:31.005291 | instance | "blocks": 8, 2026-09-10 10:53:31.005321 | instance | "charset": "unknown", 2026-09-10 10:53:31.005352 | instance | "ctime": 1789037588.1123621, 2026-09-10 10:53:31.005382 | instance | "dev": 64513, 2026-09-10 10:53:31.005409 | instance | "device_type": 0, 2026-09-10 10:53:31.005436 | instance | "executable": true, 2026-09-10 10:53:31.005461 | instance | "exists": true, 2026-09-10 10:53:31.005486 | instance | "gid": 1000, 2026-09-10 10:53:31.005517 | instance | "gr_name": "zuul", 2026-09-10 10:53:31.005550 | instance | "inode": 1047589, 2026-09-10 10:53:31.005581 | instance | "isblk": false, 2026-09-10 10:53:31.005613 | instance | "ischr": false, 2026-09-10 10:53:31.005642 | instance | "isdir": true, 2026-09-10 10:53:31.005672 | instance | "isfifo": false, 2026-09-10 10:53:31.005701 | instance | "isgid": false, 2026-09-10 10:53:31.005731 | instance | "islnk": false, 2026-09-10 10:53:31.005758 | instance | "isreg": false, 2026-09-10 10:53:31.005784 | instance | "issock": false, 2026-09-10 10:53:31.005809 | instance | "isuid": false, 2026-09-10 10:53:31.005833 | instance | "mimetype": "unknown", 2026-09-10 10:53:31.005858 | instance | "mode": "0755", 2026-09-10 10:53:31.005883 | instance | "mtime": 1789037588.1123621, 2026-09-10 10:53:31.005909 | instance | "nlink": 23, 2026-09-10 10:53:31.005937 | instance | "path": "src/github.com/vexxhost/atmosphere", 2026-09-10 10:53:31.005967 | instance | "pw_name": "zuul", 2026-09-10 10:53:31.006001 | instance | "readable": true, 2026-09-10 10:53:31.006030 | instance | "rgrp": true, 2026-09-10 10:53:31.006056 | instance | "roth": true, 2026-09-10 10:53:31.006093 | instance | "rusr": true, 2026-09-10 10:53:31.006120 | instance | "size": 4096, 2026-09-10 10:53:31.006147 | instance | "uid": 1000, 2026-09-10 10:53:31.006190 | instance | "version": "452763910", 2026-09-10 10:53:31.006221 | instance | "wgrp": false, 2026-09-10 10:53:31.006250 | instance | "woth": false, 2026-09-10 10:53:31.006275 | instance | "writeable": true, 2026-09-10 10:53:31.006300 | instance | "wusr": true, 2026-09-10 10:53:31.006326 | instance | "xgrp": true, 2026-09-10 10:53:31.006351 | instance | "xoth": true, 2026-09-10 10:53:31.006376 | instance | "xusr": true 2026-09-10 10:53:31.006402 | instance | } 2026-09-10 10:53:31.006431 | instance | } 2026-09-10 10:53:31.006485 | instance | ok: All items complete 2026-09-10 10:53:31.006517 | 2026-09-10 10:53:31.008329 | instance | skipping: Conditional result was False 2026-09-10 10:53:31.009055 | instance | skipping: Conditional result was False 2026-09-10 10:53:31.020619 | 2026-09-10 10:53:31.020720 | LOOP [Switch "ansible_host" to private IP] 2026-09-10 10:53:31.383406 | instance | changed: 1 replacements made 2026-09-10 10:53:31.389519 | instance | skipping: Conditional result was False 2026-09-10 10:53:31.394091 | instance | skipping: Conditional result was False 2026-09-10 10:53:31.411958 | 2026-09-10 10:53:31.412100 | TASK [Run Molecule scenario] 2026-09-10 10:53:32.373572 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-09-10 10:53:32.804970 | instance | INFO [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-09-10 10:53:32.805066 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-09-10 10:53:43.774670 | instance | INFO [csi > dependency] Executing 2026-09-10 10:53:43.775070 | instance | WARNING [csi > dependency] Missing roles requirements file: requirements.yml 2026-09-10 10:53:43.775504 | instance | WARNING [csi > dependency] Missing collections requirements file: collections.yml 2026-09-10 10:53:43.775731 | instance | WARNING [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-09-10 10:53:43.791809 | instance | INFO [csi > cleanup] Executing 2026-09-10 10:53:43.792504 | instance | WARNING [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-10 10:53:43.805758 | instance | INFO [csi > destroy] Executing 2026-09-10 10:53:43.805885 | instance | WARNING [csi > destroy] Skipping, '--destroy=never' requested. 2026-09-10 10:53:43.806042 | instance | INFO [csi > destroy] Executed: Successful 2026-09-10 10:53:43.816537 | instance | INFO [csi > syntax] Executing 2026-09-10 10:53:45.361259 | instance | 2026-09-10 10:53:45.361503 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-09-10 10:53:45.425615 | instance | INFO [csi > syntax] Executed: Successful 2026-09-10 10:53:45.443497 | instance | INFO [csi > create] Executing 2026-09-10 10:53:45.447626 | instance | WARNING [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-09-10 10:53:45.462314 | instance | INFO [csi > prepare] Executing 2026-09-10 10:53:46.254045 | instance | 2026-09-10 10:53:46.254179 | instance | PLAY [Prepare] ***************************************************************** 2026-09-10 10:53:46.254384 | instance | 2026-09-10 10:53:46.254559 | instance | TASK [Gathering Facts] ********************************************************* 2026-09-10 10:53:46.254743 | instance | Thursday 10 September 2026 10:53:46 +0000 (0:00:00.024) 0:00:00.024 **** 2026-09-10 10:53:47.456319 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-09-10 10:53:47.456412 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-09-10 10:53:47.456640 | instance | interpreter could change the meaning of that path. See 2026-09-10 10:53:47.456817 | instance | https://docs.ansible.com/ansible- 2026-09-10 10:53:47.457008 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-09-10 10:53:47.468597 | instance | ok: [instance] 2026-09-10 10:53:47.468773 | instance | 2026-09-10 10:53:47.469077 | instance | TASK [Configure short hostname] ************************************************ 2026-09-10 10:53:47.469278 | instance | Thursday 10 September 2026 10:53:47 +0000 (0:00:01.214) 0:00:01.239 **** 2026-09-10 10:53:48.216756 | instance | changed: [instance] 2026-09-10 10:53:48.216973 | instance | 2026-09-10 10:53:48.217239 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-09-10 10:53:48.217472 | instance | Thursday 10 September 2026 10:53:48 +0000 (0:00:00.748) 0:00:01.987 **** 2026-09-10 10:53:48.491141 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-09-10 10:53:48.491217 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-09-10 10:53:48.491298 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-09-10 10:53:48.502343 | instance | changed: [instance] 2026-09-10 10:53:48.502418 | instance | 2026-09-10 10:53:48.502574 | instance | TASK [Purge "snapd" package] *************************************************** 2026-09-10 10:53:48.502722 | instance | Thursday 10 September 2026 10:53:48 +0000 (0:00:00.285) 0:00:02.273 **** 2026-09-10 10:53:49.376784 | instance | ok: [instance] 2026-09-10 10:53:49.376874 | instance | 2026-09-10 10:53:49.376997 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-09-10 10:53:49.377127 | instance | 2026-09-10 10:53:49.377241 | instance | TASK [Gathering Facts] ********************************************************* 2026-09-10 10:53:49.377353 | instance | Thursday 10 September 2026 10:53:49 +0000 (0:00:00.875) 0:00:03.148 **** 2026-09-10 10:53:50.107846 | instance | ok: [instance] 2026-09-10 10:53:50.107935 | instance | 2026-09-10 10:53:50.108124 | instance | TASK [Install depedencies] ***************************************************** 2026-09-10 10:53:50.108268 | instance | Thursday 10 September 2026 10:53:50 +0000 (0:00:00.730) 0:00:03.878 **** 2026-09-10 10:54:13.624816 | instance | changed: [instance] 2026-09-10 10:54:13.624946 | instance | 2026-09-10 10:54:13.625111 | instance | TASK [Start up service] ******************************************************** 2026-09-10 10:54:13.625306 | instance | Thursday 10 September 2026 10:54:13 +0000 (0:00:23.516) 0:00:27.395 **** 2026-09-10 10:54:14.257611 | instance | ok: [instance] 2026-09-10 10:54:14.257820 | instance | 2026-09-10 10:54:14.258062 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-09-10 10:54:14.258332 | instance | Thursday 10 September 2026 10:54:14 +0000 (0:00:00.632) 0:00:28.028 **** 2026-09-10 10:54:14.581197 | instance | ok: [instance] 2026-09-10 10:54:14.581417 | instance | 2026-09-10 10:54:14.581665 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-09-10 10:54:14.581985 | instance | Thursday 10 September 2026 10:54:14 +0000 (0:00:00.323) 0:00:28.351 **** 2026-09-10 10:54:15.307235 | instance | changed: [instance] 2026-09-10 10:54:15.307282 | instance | 2026-09-10 10:54:15.307288 | instance | TASK [Get list of all loopback devices] **************************************** 2026-09-10 10:54:15.307294 | instance | Thursday 10 September 2026 10:54:15 +0000 (0:00:00.725) 0:00:29.077 **** 2026-09-10 10:54:15.496269 | instance | ok: [instance] 2026-09-10 10:54:15.496655 | instance | 2026-09-10 10:54:15.496686 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-09-10 10:54:15.496693 | instance | Thursday 10 September 2026 10:54:15 +0000 (0:00:00.190) 0:00:29.267 **** 2026-09-10 10:54:15.514785 | instance | skipping: [instance] 2026-09-10 10:54:15.515110 | instance | 2026-09-10 10:54:15.515146 | instance | TASK [Create devices for Ceph] ************************************************* 2026-09-10 10:54:15.515151 | instance | Thursday 10 September 2026 10:54:15 +0000 (0:00:00.018) 0:00:29.286 **** 2026-09-10 10:54:17.111528 | instance | changed: [instance] => (item=osd0) 2026-09-10 10:54:17.112904 | instance | changed: [instance] => (item=osd1) 2026-09-10 10:54:17.113003 | instance | changed: [instance] => (item=osd2) 2026-09-10 10:54:17.113015 | instance | 2026-09-10 10:54:17.113025 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-09-10 10:54:17.113036 | instance | Thursday 10 September 2026 10:54:17 +0000 (0:00:01.595) 0:00:30.882 **** 2026-09-10 10:54:17.796454 | instance | changed: [instance] => (item=osd0) 2026-09-10 10:54:17.797727 | instance | changed: [instance] => (item=osd1) 2026-09-10 10:54:17.797793 | instance | changed: [instance] => (item=osd2) 2026-09-10 10:54:17.797804 | instance | 2026-09-10 10:54:17.797815 | instance | TASK [Start loop devices] ****************************************************** 2026-09-10 10:54:17.797825 | instance | Thursday 10 September 2026 10:54:17 +0000 (0:00:00.684) 0:00:31.567 **** 2026-09-10 10:54:18.538953 | instance | changed: [instance] => (item=osd0) 2026-09-10 10:54:18.540791 | instance | changed: [instance] => (item=osd1) 2026-09-10 10:54:18.540823 | instance | changed: [instance] => (item=osd2) 2026-09-10 10:54:18.540834 | instance | 2026-09-10 10:54:18.540843 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-09-10 10:54:18.540853 | instance | Thursday 10 September 2026 10:54:18 +0000 (0:00:00.742) 0:00:32.309 **** 2026-09-10 10:54:21.775307 | instance | changed: [instance] => (item=osd0) 2026-09-10 10:54:21.775456 | instance | changed: [instance] => (item=osd1) 2026-09-10 10:54:21.775644 | instance | changed: [instance] => (item=osd2) 2026-09-10 10:54:21.775890 | instance | 2026-09-10 10:54:21.776107 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-09-10 10:54:21.776320 | instance | Thursday 10 September 2026 10:54:21 +0000 (0:00:03.236) 0:00:35.546 **** 2026-09-10 10:54:23.796063 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-09-10 10:54:23.798292 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-09-10 10:54:23.798350 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-09-10 10:54:23.798355 | instance | 2026-09-10 10:54:23.798360 | instance | PLAY RECAP ********************************************************************* 2026-09-10 10:54:23.798365 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-09-10 10:54:23.798369 | instance | 2026-09-10 10:54:23.798373 | instance | Thursday 10 September 2026 10:54:23 +0000 (0:00:02.021) 0:00:37.567 **** 2026-09-10 10:54:23.798377 | instance | =============================================================================== 2026-09-10 10:54:23.798381 | instance | Install depedencies ---------------------------------------------------- 23.52s 2026-09-10 10:54:23.801883 | instance | Create a volume group for each loop device ------------------------------ 3.24s 2026-09-10 10:54:23.801941 | instance | Create a logical volume for each loop device ---------------------------- 2.02s 2026-09-10 10:54:23.801953 | instance | Create devices for Ceph ------------------------------------------------- 1.60s 2026-09-10 10:54:23.801962 | instance | Gathering Facts --------------------------------------------------------- 1.21s 2026-09-10 10:54:23.801974 | instance | Purge "snapd" package --------------------------------------------------- 0.88s 2026-09-10 10:54:23.801984 | instance | Configure short hostname ------------------------------------------------ 0.75s 2026-09-10 10:54:23.801993 | instance | Start loop devices ------------------------------------------------------ 0.74s 2026-09-10 10:54:23.802001 | instance | Gathering Facts --------------------------------------------------------- 0.73s 2026-09-10 10:54:23.802010 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.73s 2026-09-10 10:54:23.802018 | instance | Set permissions on loopback devices ------------------------------------- 0.69s 2026-09-10 10:54:23.802027 | instance | Start up service -------------------------------------------------------- 0.63s 2026-09-10 10:54:23.802035 | instance | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-09-10 10:54:23.802044 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-09-10 10:54:23.802053 | instance | Get list of all loopback devices ---------------------------------------- 0.19s 2026-09-10 10:54:23.802061 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-09-10 10:54:23.881294 | instance | INFO [csi > prepare] Executed: Successful 2026-09-10 10:54:23.890733 | instance | INFO [csi > converge] Executing 2026-09-10 10:54:25.381395 | instance | 2026-09-10 10:54:25.381743 | instance | PLAY [Debug CSI driver value] ************************************************** 2026-09-10 10:54:25.381956 | instance | 2026-09-10 10:54:25.382197 | instance | TASK [Gathering Facts] ********************************************************* 2026-09-10 10:54:25.382505 | instance | Thursday 10 September 2026 10:54:25 +0000 (0:00:00.007) 0:00:00.007 **** 2026-09-10 10:54:26.425969 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-09-10 10:54:26.426266 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-09-10 10:54:26.426483 | instance | interpreter could change the meaning of that path. See 2026-09-10 10:54:26.426640 | instance | https://docs.ansible.com/ansible- 2026-09-10 10:54:26.426789 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-09-10 10:54:26.442566 | instance | ok: [instance] 2026-09-10 10:54:26.442994 | instance | 2026-09-10 10:54:26.443377 | instance | TASK [Display CSI driver value and environment variable] *********************** 2026-09-10 10:54:26.443826 | instance | Thursday 10 September 2026 10:54:26 +0000 (0:00:01.060) 0:00:01.067 **** 2026-09-10 10:54:26.516275 | instance | ok: [instance] => { 2026-09-10 10:54:26.516634 | instance | "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER=" 2026-09-10 10:54:26.516870 | instance | } 2026-09-10 10:54:26.517090 | instance | 2026-09-10 10:54:26.517319 | instance | PLAY [all] ********************************************************************* 2026-09-10 10:54:26.517575 | instance | 2026-09-10 10:54:26.517808 | instance | TASK [Gathering Facts] ********************************************************* 2026-09-10 10:54:26.518068 | instance | Thursday 10 September 2026 10:54:26 +0000 (0:00:00.073) 0:00:01.141 **** 2026-09-10 10:54:27.442848 | instance | ok: [instance] 2026-09-10 10:54:27.443348 | instance | 2026-09-10 10:54:27.443789 | instance | TASK [Fail if atmosphere_ceph_enabled is set] ********************************** 2026-09-10 10:54:27.444153 | instance | Thursday 10 September 2026 10:54:27 +0000 (0:00:00.926) 0:00:02.068 **** 2026-09-10 10:54:27.503217 | instance | skipping: [instance] 2026-09-10 10:54:27.503638 | instance | 2026-09-10 10:54:27.503959 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-09-10 10:54:27.504270 | instance | Thursday 10 September 2026 10:54:27 +0000 (0:00:00.056) 0:00:02.125 **** 2026-09-10 10:54:27.738434 | instance | ok: [instance] 2026-09-10 10:54:27.738549 | instance | 2026-09-10 10:54:27.738564 | instance | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-09-10 10:54:27.738577 | instance | 2026-09-10 10:54:27.738588 | instance | TASK [Gathering Facts] ********************************************************* 2026-09-10 10:54:27.738623 | instance | Thursday 10 September 2026 10:54:27 +0000 (0:00:00.238) 0:00:02.363 **** 2026-09-10 10:54:28.646544 | instance | ok: [instance] 2026-09-10 10:54:28.646768 | instance | 2026-09-10 10:54:28.647042 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-10 10:54:28.647298 | instance | Thursday 10 September 2026 10:54:28 +0000 (0:00:00.908) 0:00:03.271 **** 2026-09-10 10:54:28.952053 | instance | ok: [instance] 2026-09-10 10:54:28.952294 | instance | 2026-09-10 10:54:28.952592 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-10 10:54:28.952851 | instance | Thursday 10 September 2026 10:54:28 +0000 (0:00:00.305) 0:00:03.577 **** 2026-09-10 10:54:28.979240 | instance | skipping: [instance] 2026-09-10 10:54:28.979457 | instance | 2026-09-10 10:54:28.979750 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-09-10 10:54:28.979990 | instance | Thursday 10 September 2026 10:54:28 +0000 (0:00:00.027) 0:00:03.605 **** 2026-09-10 10:54:29.323393 | instance | changed: [instance] 2026-09-10 10:54:29.323637 | instance | 2026-09-10 10:54:29.323894 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-10 10:54:29.324139 | instance | Thursday 10 September 2026 10:54:29 +0000 (0:00:00.343) 0:00:03.949 **** 2026-09-10 10:54:29.415389 | instance | ok: [instance] => { 2026-09-10 10:54:29.415649 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-09-10 10:54:29.415883 | instance | } 2026-09-10 10:54:29.416114 | instance | 2026-09-10 10:54:29.416350 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-10 10:54:29.416589 | instance | Thursday 10 September 2026 10:54:29 +0000 (0:00:00.091) 0:00:04.041 **** 2026-09-10 10:54:30.081985 | instance | changed: [instance] 2026-09-10 10:54:30.082222 | instance | 2026-09-10 10:54:30.082522 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-10 10:54:30.082815 | instance | Thursday 10 September 2026 10:54:30 +0000 (0:00:00.666) 0:00:04.707 **** 2026-09-10 10:54:30.126590 | instance | skipping: [instance] 2026-09-10 10:54:30.126760 | instance | 2026-09-10 10:54:30.126904 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-10 10:54:30.127060 | instance | Thursday 10 September 2026 10:54:30 +0000 (0:00:00.044) 0:00:04.752 **** 2026-09-10 10:54:30.171979 | instance | skipping: [instance] 2026-09-10 10:54:30.172132 | instance | 2026-09-10 10:54:30.172350 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-10 10:54:30.172576 | instance | Thursday 10 September 2026 10:54:30 +0000 (0:00:00.045) 0:00:04.798 **** 2026-09-10 10:54:30.404338 | instance | ok: [instance] 2026-09-10 10:54:30.404440 | instance | 2026-09-10 10:54:30.404616 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-09-10 10:54:30.404765 | instance | Thursday 10 September 2026 10:54:30 +0000 (0:00:00.231) 0:00:05.030 **** 2026-09-10 10:54:31.955433 | instance | ok: [instance] 2026-09-10 10:54:31.955733 | instance | 2026-09-10 10:54:31.956007 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-10 10:54:31.956265 | instance | Thursday 10 September 2026 10:54:31 +0000 (0:00:01.551) 0:00:06.581 **** 2026-09-10 10:54:32.038213 | instance | ok: [instance] => { 2026-09-10 10:54:32.038498 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-09-10 10:54:32.038753 | instance | } 2026-09-10 10:54:32.038984 | instance | 2026-09-10 10:54:32.039219 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-10 10:54:32.039488 | instance | Thursday 10 September 2026 10:54:32 +0000 (0:00:00.082) 0:00:06.663 **** 2026-09-10 10:54:32.980624 | instance | changed: [instance] 2026-09-10 10:54:32.980979 | instance | 2026-09-10 10:54:32.981290 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-10 10:54:32.981616 | instance | Thursday 10 September 2026 10:54:32 +0000 (0:00:00.942) 0:00:07.606 **** 2026-09-10 10:54:35.960898 | instance | changed: [instance] 2026-09-10 10:54:35.961108 | instance | 2026-09-10 10:54:35.961123 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-09-10 10:54:35.961324 | instance | Thursday 10 September 2026 10:54:35 +0000 (0:00:02.980) 0:00:10.586 **** 2026-09-10 10:54:36.008050 | instance | skipping: [instance] 2026-09-10 10:54:36.009071 | instance | 2026-09-10 10:54:36.009123 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-09-10 10:54:36.009135 | instance | Thursday 10 September 2026 10:54:35 +0000 (0:00:00.046) 0:00:10.633 **** 2026-09-10 10:54:36.048325 | instance | skipping: [instance] 2026-09-10 10:54:36.048616 | instance | 2026-09-10 10:54:36.048982 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-09-10 10:54:36.049298 | instance | Thursday 10 September 2026 10:54:36 +0000 (0:00:00.040) 0:00:10.673 **** 2026-09-10 10:54:36.092647 | instance | skipping: [instance] 2026-09-10 10:54:36.092805 | instance | 2026-09-10 10:54:36.093054 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-09-10 10:54:36.093255 | instance | Thursday 10 September 2026 10:54:36 +0000 (0:00:00.044) 0:00:10.718 **** 2026-09-10 10:54:42.267603 | instance | changed: [instance] 2026-09-10 10:54:42.267845 | instance | 2026-09-10 10:54:42.268257 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-09-10 10:54:42.268605 | instance | Thursday 10 September 2026 10:54:42 +0000 (0:00:06.174) 0:00:16.893 **** 2026-09-10 10:54:42.935246 | instance | changed: [instance] 2026-09-10 10:54:42.935617 | instance | 2026-09-10 10:54:42.935955 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-09-10 10:54:42.936274 | instance | Thursday 10 September 2026 10:54:42 +0000 (0:00:00.663) 0:00:17.557 **** 2026-09-10 10:54:43.906698 | instance | changed: [instance] => (item={'path': '/etc/containerd'}) 2026-09-10 10:54:43.906820 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-09-10 10:54:43.906889 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-09-10 10:54:43.907004 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-09-10 10:54:43.907114 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-09-10 10:54:43.907210 | instance | 2026-09-10 10:54:43.907318 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-09-10 10:54:43.907428 | instance | Thursday 10 September 2026 10:54:43 +0000 (0:00:00.976) 0:00:18.533 **** 2026-09-10 10:54:44.517500 | instance | changed: [instance] 2026-09-10 10:54:44.517633 | instance | 2026-09-10 10:54:44.517849 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-09-10 10:54:44.518053 | instance | Thursday 10 September 2026 10:54:44 +0000 (0:00:00.589) 0:00:19.122 **** 2026-09-10 10:54:44.518197 | instance | 2026-09-10 10:54:44.518455 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-10 10:54:44.518702 | instance | Thursday 10 September 2026 10:54:44 +0000 (0:00:00.020) 0:00:19.143 **** 2026-09-10 10:54:45.537556 | instance | ok: [instance] 2026-09-10 10:54:45.537855 | instance | 2026-09-10 10:54:45.538182 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-09-10 10:54:45.538537 | instance | Thursday 10 September 2026 10:54:45 +0000 (0:00:01.019) 0:00:20.162 **** 2026-09-10 10:54:46.046428 | instance | changed: [instance] 2026-09-10 10:54:46.046774 | instance | 2026-09-10 10:54:46.046948 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-09-10 10:54:46.047140 | instance | Thursday 10 September 2026 10:54:46 +0000 (0:00:00.508) 0:00:20.671 **** 2026-09-10 10:54:46.621470 | instance | changed: [instance] 2026-09-10 10:54:46.621539 | instance | 2026-09-10 10:54:46.621563 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-09-10 10:54:46.621577 | instance | Thursday 10 September 2026 10:54:46 +0000 (0:00:00.575) 0:00:21.246 **** 2026-09-10 10:54:46.852104 | instance | ok: [instance] 2026-09-10 10:54:46.852602 | instance | 2026-09-10 10:54:46.852654 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-09-10 10:54:46.852665 | instance | Thursday 10 September 2026 10:54:46 +0000 (0:00:00.230) 0:00:21.477 **** 2026-09-10 10:54:46.919327 | instance | ok: [instance] => { 2026-09-10 10:54:46.920684 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-09-10 10:54:46.920731 | instance | } 2026-09-10 10:54:46.920743 | instance | 2026-09-10 10:54:46.920752 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-09-10 10:54:46.920779 | instance | Thursday 10 September 2026 10:54:46 +0000 (0:00:00.067) 0:00:21.545 **** 2026-09-10 10:54:47.831163 | instance | changed: [instance] 2026-09-10 10:54:47.831348 | instance | 2026-09-10 10:54:47.831360 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-09-10 10:54:47.831370 | instance | Thursday 10 September 2026 10:54:47 +0000 (0:00:00.911) 0:00:22.456 **** 2026-09-10 10:54:52.302262 | instance | changed: [instance] 2026-09-10 10:54:52.302820 | instance | 2026-09-10 10:54:52.302908 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-09-10 10:54:52.302918 | instance | Thursday 10 September 2026 10:54:52 +0000 (0:00:04.471) 0:00:26.927 **** 2026-09-10 10:54:53.430110 | instance | ok: [instance] 2026-09-10 10:54:53.430203 | instance | 2026-09-10 10:54:53.430530 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-09-10 10:54:53.430601 | instance | Thursday 10 September 2026 10:54:53 +0000 (0:00:01.127) 0:00:28.055 **** 2026-09-10 10:54:54.189499 | instance | changed: [instance] 2026-09-10 10:54:54.189578 | instance | 2026-09-10 10:54:54.189591 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-09-10 10:54:54.189602 | instance | Thursday 10 September 2026 10:54:54 +0000 (0:00:00.757) 0:00:28.813 **** 2026-09-10 10:54:54.727860 | instance | changed: [instance] 2026-09-10 10:54:54.728762 | instance | 2026-09-10 10:54:54.728847 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-09-10 10:54:54.728861 | instance | Thursday 10 September 2026 10:54:54 +0000 (0:00:00.539) 0:00:29.353 **** 2026-09-10 10:54:55.388197 | instance | changed: [instance] => (item={'path': '/etc/docker'}) 2026-09-10 10:54:55.388293 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-09-10 10:54:55.388749 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-09-10 10:54:55.388893 | instance | 2026-09-10 10:54:55.388917 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-09-10 10:54:55.388924 | instance | Thursday 10 September 2026 10:54:55 +0000 (0:00:00.661) 0:00:30.014 **** 2026-09-10 10:54:55.889260 | instance | changed: [instance] 2026-09-10 10:54:55.890061 | instance | 2026-09-10 10:54:55.890117 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-09-10 10:54:55.890131 | instance | Thursday 10 September 2026 10:54:55 +0000 (0:00:00.500) 0:00:30.515 **** 2026-09-10 10:54:56.406292 | instance | changed: [instance] 2026-09-10 10:54:56.407281 | instance | 2026-09-10 10:54:56.407300 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-09-10 10:54:56.407319 | instance | Thursday 10 September 2026 10:54:56 +0000 (0:00:00.489) 0:00:31.004 **** 2026-09-10 10:54:56.407325 | instance | 2026-09-10 10:54:56.407331 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-09-10 10:54:56.407344 | instance | Thursday 10 September 2026 10:54:56 +0000 (0:00:00.027) 0:00:31.032 **** 2026-09-10 10:54:57.223510 | instance | ok: [instance] 2026-09-10 10:54:57.223553 | instance | 2026-09-10 10:54:57.223560 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-09-10 10:54:57.223567 | instance | Thursday 10 September 2026 10:54:57 +0000 (0:00:00.816) 0:00:31.848 **** 2026-09-10 10:54:58.184404 | instance | changed: [instance] 2026-09-10 10:54:58.184705 | instance | 2026-09-10 10:54:58.185071 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-09-10 10:54:58.185416 | instance | Thursday 10 September 2026 10:54:58 +0000 (0:00:00.961) 0:00:32.809 **** 2026-09-10 10:54:58.829772 | instance | changed: [instance] 2026-09-10 10:54:58.829824 | instance | 2026-09-10 10:54:58.829835 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-09-10 10:54:58.829845 | instance | Thursday 10 September 2026 10:54:58 +0000 (0:00:00.644) 0:00:33.454 **** 2026-09-10 10:54:58.892168 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-09-10 10:54:58.892218 | instance | 2026-09-10 10:54:58.892423 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-09-10 10:54:58.892440 | instance | Thursday 10 September 2026 10:54:58 +0000 (0:00:00.063) 0:00:33.518 **** 2026-09-10 10:55:04.252511 | instance | changed: [instance] 2026-09-10 10:55:04.252639 | instance | 2026-09-10 10:55:04.253309 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-09-10 10:55:04.253380 | instance | Thursday 10 September 2026 10:55:04 +0000 (0:00:05.358) 0:00:38.877 **** 2026-09-10 10:55:04.946115 | instance | ok: [instance] => (item=chronyd) 2026-09-10 10:55:04.946216 | instance | ok: [instance] => (item=sshd) 2026-09-10 10:55:04.946749 | instance | 2026-09-10 10:55:04.946819 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-09-10 10:55:04.946827 | instance | Thursday 10 September 2026 10:55:04 +0000 (0:00:00.694) 0:00:39.571 **** 2026-09-10 10:55:17.916296 | instance | changed: [instance] 2026-09-10 10:55:17.917030 | instance | 2026-09-10 10:55:17.917229 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-09-10 10:55:17.917242 | instance | Thursday 10 September 2026 10:55:17 +0000 (0:00:12.970) 0:00:52.541 **** 2026-09-10 10:55:18.137338 | instance | ok: [instance] 2026-09-10 10:55:18.137402 | instance | 2026-09-10 10:55:18.137764 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-09-10 10:55:18.137811 | instance | Thursday 10 September 2026 10:55:18 +0000 (0:00:00.221) 0:00:52.763 **** 2026-09-10 10:55:18.634721 | instance | changed: [instance] 2026-09-10 10:55:18.634968 | instance | 2026-09-10 10:55:18.635268 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-09-10 10:55:18.635508 | instance | Thursday 10 September 2026 10:55:18 +0000 (0:00:00.496) 0:00:53.260 **** 2026-09-10 10:55:18.970346 | instance | changed: [instance] 2026-09-10 10:55:18.970499 | instance | 2026-09-10 10:55:18.970746 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-09-10 10:55:18.970904 | instance | Thursday 10 September 2026 10:55:18 +0000 (0:00:00.335) 0:00:53.596 **** 2026-09-10 10:55:19.103173 | instance | ok: [instance] 2026-09-10 10:55:19.103234 | instance | 2026-09-10 10:55:19.103395 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-09-10 10:55:19.103558 | instance | Thursday 10 September 2026 10:55:19 +0000 (0:00:00.132) 0:00:53.729 **** 2026-09-10 10:55:19.314298 | instance | ok: [instance] => (item=instance) 2026-09-10 10:55:19.314531 | instance | 2026-09-10 10:55:19.314832 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-09-10 10:55:19.315078 | instance | Thursday 10 September 2026 10:55:19 +0000 (0:00:00.210) 0:00:53.939 **** 2026-09-10 10:55:19.359216 | instance | ok: [instance] 2026-09-10 10:55:19.359476 | instance | 2026-09-10 10:55:19.359944 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-09-10 10:55:19.360225 | instance | Thursday 10 September 2026 10:55:19 +0000 (0:00:00.045) 0:00:53.985 **** 2026-09-10 10:55:19.435999 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance 2026-09-10 10:55:19.436153 | instance | 2026-09-10 10:55:19.436413 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-09-10 10:55:19.436650 | instance | Thursday 10 September 2026 10:55:19 +0000 (0:00:00.076) 0:00:54.061 **** 2026-09-10 10:55:19.750970 | instance | changed: [instance] 2026-09-10 10:55:19.751186 | instance | 2026-09-10 10:55:19.751510 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-09-10 10:55:19.751880 | instance | Thursday 10 September 2026 10:55:19 +0000 (0:00:00.315) 0:00:54.376 **** 2026-09-10 10:55:20.500407 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True}) 2026-09-10 10:55:20.500658 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-09-10 10:55:20.500991 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-09-10 10:55:20.501251 | instance | 2026-09-10 10:55:20.501513 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-09-10 10:55:20.501832 | instance | Thursday 10 September 2026 10:55:20 +0000 (0:00:00.749) 0:00:55.125 **** 2026-09-10 10:56:52.660090 | instance | ok: [instance] 2026-09-10 10:56:52.660190 | instance | 2026-09-10 10:56:52.660205 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-09-10 10:56:52.660218 | instance | Thursday 10 September 2026 10:56:52 +0000 (0:01:32.157) 0:02:27.283 **** 2026-09-10 10:56:52.920775 | instance | changed: [instance] 2026-09-10 10:56:52.920836 | instance | 2026-09-10 10:56:52.920848 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-09-10 10:56:52.920860 | instance | Thursday 10 September 2026 10:56:52 +0000 (0:00:00.261) 0:02:27.545 **** 2026-09-10 10:56:52.962960 | instance | ok: [instance] 2026-09-10 10:56:52.962989 | instance | 2026-09-10 10:56:52.962994 | instance | TASK [Install Ceph host] ******************************************************* 2026-09-10 10:56:52.962998 | instance | Thursday 10 September 2026 10:56:52 +0000 (0:00:00.043) 0:02:27.589 **** 2026-09-10 10:56:53.071492 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-09-10 10:56:53.071544 | instance | 2026-09-10 10:56:53.071555 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-09-10 10:56:53.071565 | instance | Thursday 10 September 2026 10:56:53 +0000 (0:00:00.107) 0:02:27.696 **** 2026-09-10 10:56:54.661564 | instance | ok: [instance] 2026-09-10 10:56:54.661679 | instance | 2026-09-10 10:56:54.661702 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-09-10 10:56:54.661714 | instance | Thursday 10 September 2026 10:56:54 +0000 (0:00:01.589) 0:02:29.286 **** 2026-09-10 10:56:54.749949 | instance | ok: [instance] => (item=instance) 2026-09-10 10:56:54.750010 | instance | 2026-09-10 10:56:54.750021 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-09-10 10:56:54.750031 | instance | Thursday 10 September 2026 10:56:54 +0000 (0:00:00.088) 0:02:29.374 **** 2026-09-10 10:56:55.077765 | instance | ok: [instance] 2026-09-10 10:56:55.077834 | instance | 2026-09-10 10:56:55.077850 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-09-10 10:56:55.077863 | instance | Thursday 10 September 2026 10:56:55 +0000 (0:00:00.328) 0:02:29.703 **** 2026-09-10 10:56:57.313189 | instance | ok: [instance] 2026-09-10 10:56:57.313256 | instance | 2026-09-10 10:56:57.313267 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-09-10 10:56:57.313276 | instance | Thursday 10 September 2026 10:56:57 +0000 (0:00:02.234) 0:02:31.937 **** 2026-09-10 10:57:37.792825 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster) 2026-09-10 10:57:37.793774 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n File \"\", line 107, in \n File \"\", line 99, in _ansiballz_main\n File \"\", line 47, in invoke_module\n File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n _run_code(code, mod_globals, init_globals,\n File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__mnk8vmg/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in \n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__mnk8vmg/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__mnk8vmg/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload__mnk8vmg/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDIjKJqYVEiFCAAvhWVUSZm7BULJ1cZs/eFYO1dYLBEnFZfRuUAY1NHrPE=: Malformed input [buffer:3]\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDIjKJqYVEiFCAAvhWVUSZm7BULJ1cZs/eFYO1dYLBEnFZfRuUAY1NHrPE=: Malformed input [buffer:3]\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDIjKJqYVEiFCAAvhWVUSZm7BULJ1cZs/eFYO1dYLBEnFZfRuUAY1NHrPE=: Malformed input [buffer:3]\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-09-10T10:57:37.601+0000 7f162d516640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2026-09-10 10:57:37.796105 | instance | 2026-09-10 10:57:37.796263 | instance | PLAY RECAP ********************************************************************* 2026-09-10 10:57:37.798377 | instance | instance : ok=55 changed=26 unreachable=0 failed=1 skipped=7 rescued=0 ignored=0 2026-09-10 10:57:37.798474 | instance | 2026-09-10 10:57:37.798493 | instance | Thursday 10 September 2026 10:57:37 +0000 (0:00:40.484) 0:03:12.422 **** 2026-09-10 10:57:37.798507 | instance | =============================================================================== 2026-09-10 10:57:37.798520 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 92.16s 2026-09-10 10:57:37.798529 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 40.48s 2026-09-10 10:57:37.798538 | instance | vexxhost.ceph.cephadm : Download "cephadm" ----------------------------- 12.97s 2026-09-10 10:57:37.798547 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.17s 2026-09-10 10:57:37.798555 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.36s 2026-09-10 10:57:37.798564 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.47s 2026-09-10 10:57:37.798595 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s 2026-09-10 10:57:37.798638 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.23s 2026-09-10 10:57:37.798652 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.84s 2026-09-10 10:57:37.798681 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.59s 2026-09-10 10:57:37.800392 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.55s 2026-09-10 10:57:37.800438 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.13s 2026-09-10 10:57:37.800445 | instance | Gathering Facts --------------------------------------------------------- 1.06s 2026-09-10 10:57:37.800451 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.98s 2026-09-10 10:57:37.800457 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 0.96s 2026-09-10 10:57:37.800463 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.94s 2026-09-10 10:57:37.800469 | instance | Gathering Facts --------------------------------------------------------- 0.93s 2026-09-10 10:57:37.800475 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.91s 2026-09-10 10:57:37.800481 | instance | Gathering Facts --------------------------------------------------------- 0.91s 2026-09-10 10:57:37.800487 | instance | vexxhost.containers.docker : Ensure group "docker" exists --------------- 0.76s 2026-09-10 10:57:37.950520 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-09-10 10:57:37.950741 | instance | ERROR [csi > converge] Executed: Failed 2026-09-10 10:57:37.950866 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-09-10 10:57:38.262232 | instance | ERROR 2026-09-10 10:57:38.262426 | instance | { 2026-09-10 10:57:38.262464 | instance | "delta": "0:04:06.245731", 2026-09-10 10:57:38.262491 | instance | "end": "2026-09-10 10:57:38.022877", 2026-09-10 10:57:38.262515 | instance | "msg": "non-zero return code", 2026-09-10 10:57:38.262538 | instance | "rc": 2, 2026-09-10 10:57:38.262562 | instance | "start": "2026-09-10 10:53:31.777146" 2026-09-10 10:57:38.262586 | instance | } failure 2026-09-10 10:57:38.272881 | 2026-09-10 10:57:38.273030 | PLAY RECAP 2026-09-10 10:57:38.273104 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-09-10 10:57:38.273141 | 2026-09-10 10:57:38.525142 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-09-10 10:57:38.527825 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main] 2026-09-10 10:57:39.207059 | 2026-09-10 10:57:39.207191 | PLAY [all] 2026-09-10 10:57:39.220504 | 2026-09-10 10:57:39.220609 | TASK [gather-host-logs : creating directory for system status] 2026-09-10 10:57:39.622926 | instance | changed 2026-09-10 10:57:39.630013 | 2026-09-10 10:57:39.630142 | TASK [gather-host-logs : Get logs for each host] 2026-09-10 10:57:39.981074 | instance | + systemd-cgls --full --all --no-pager 2026-09-10 10:57:40.000375 | instance | + ip addr 2026-09-10 10:57:40.003584 | instance | + ip route 2026-09-10 10:57:40.006449 | instance | + lsblk 2026-09-10 10:57:40.010626 | instance | + mount 2026-09-10 10:57:40.012730 | instance | + docker images 2026-09-10 10:57:40.030997 | instance | + brctl show 2026-09-10 10:57:40.031383 | instance | /bin/bash: line 8: brctl: command not found 2026-09-10 10:57:40.031883 | instance | + ps aux --sort=-%mem 2026-09-10 10:57:40.053747 | instance | + dpkg -l 2026-09-10 10:57:40.060439 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-09-10 10:57:40.060838 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-09-10 10:57:40.081220 | instance | + '[' '!' -z '' ']' 2026-09-10 10:57:40.169900 | instance | ok: Runtime: 0:00:00.105488 2026-09-10 10:57:40.175619 | 2026-09-10 10:57:40.175766 | TASK [gather-host-logs : Downloads logs to executor] 2026-09-10 10:57:41.176457 | instance | changed: 2026-09-10 10:57:41.195312 | instance | created directory /var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/logs/instance 2026-09-10 10:57:41.195425 | instance | cd+++++++++ system/ 2026-09-10 10:57:41.195467 | instance | >f+++++++++ system/brctl-show.txt 2026-09-10 10:57:41.195502 | instance | >f+++++++++ system/docker-images.txt 2026-09-10 10:57:41.195534 | instance | >f+++++++++ system/ip-addr.txt 2026-09-10 10:57:41.195572 | instance | >f+++++++++ system/ip-route.txt 2026-09-10 10:57:41.195608 | instance | >f+++++++++ system/lsblk.txt 2026-09-10 10:57:41.195641 | instance | >f+++++++++ system/mount.txt 2026-09-10 10:57:41.195673 | instance | >f+++++++++ system/packages.txt 2026-09-10 10:57:41.195739 | instance | >f+++++++++ system/ps.txt 2026-09-10 10:57:41.195776 | instance | >f+++++++++ system/systemd-cgls.txt 2026-09-10 10:57:41.205436 | 2026-09-10 10:57:41.205516 | LOOP [helm-release-status : creating directory for helm release status] 2026-09-10 10:57:41.410594 | instance | changed: "values" 2026-09-10 10:57:41.575215 | instance | changed: "releases" 2026-09-10 10:57:41.589314 | 2026-09-10 10:57:41.589525 | TASK [helm-release-status : Gather get release status for helm charts] 2026-09-10 10:57:41.814921 | instance | /bin/bash: line 3: kubectl: command not found 2026-09-10 10:57:42.218857 | instance | ok: Runtime: 0:00:00.003814 2026-09-10 10:57:42.237327 | 2026-09-10 10:57:42.237506 | TASK [helm-release-status : Downloads logs to executor] 2026-09-10 10:57:42.777710 | instance | changed: 2026-09-10 10:57:42.778010 | instance | cd+++++++++ helm/ 2026-09-10 10:57:42.778050 | instance | cd+++++++++ helm/releases/ 2026-09-10 10:57:42.778081 | instance | cd+++++++++ helm/values/ 2026-09-10 10:57:42.792679 | 2026-09-10 10:57:42.792884 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-09-10 10:57:42.992458 | instance | changed 2026-09-10 10:57:43.003163 | 2026-09-10 10:57:43.003431 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-09-10 10:57:43.282159 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-09-10 10:57:43.282585 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-09-10 10:57:43.287461 | instance | environment: line 1: kubectl: command not found 2026-09-10 10:57:43.288373 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-09-10 10:57:43.289422 | instance | environment: line 1: kubectl: command not found 2026-09-10 10:57:43.290323 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-09-10 10:57:43.292725 | instance | environment: line 1: kubectl: command not found 2026-09-10 10:57:43.294091 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-09-10 10:57:43.295542 | instance | environment: line 1: kubectl: command not found 2026-09-10 10:57:43.296935 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-09-10 10:57:43.300261 | instance | environment: line 1: kubectl: command not found 2026-09-10 10:57:43.301891 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-09-10 10:57:43.544431 | instance | ok: Runtime: 0:00:00.027878 2026-09-10 10:57:43.549678 | 2026-09-10 10:57:43.549778 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-09-10 10:57:43.782431 | instance | changed 2026-09-10 10:57:43.787439 | 2026-09-10 10:57:43.787531 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-09-10 10:57:43.994478 | instance | environment: line 5: kubectl: command not found 2026-09-10 10:57:43.995290 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-09-10 10:57:43.996232 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-09-10 10:57:43.996262 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-09-10 10:57:44.324388 | instance | ok: Runtime: 0:00:00.011069 2026-09-10 10:57:44.329430 | 2026-09-10 10:57:44.329495 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-09-10 10:57:44.867919 | instance | changed: 2026-09-10 10:57:44.868232 | instance | cd+++++++++ objects/ 2026-09-10 10:57:44.868269 | instance | cd+++++++++ objects/cluster/ 2026-09-10 10:57:44.868293 | instance | cd+++++++++ objects/namespaced/ 2026-09-10 10:57:44.880024 | 2026-09-10 10:57:44.880146 | TASK [gather-pod-logs : creating directory for pod logs] 2026-09-10 10:57:45.097405 | instance | changed 2026-09-10 10:57:45.105619 | 2026-09-10 10:57:45.105751 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-09-10 10:57:45.321837 | instance | changed 2026-09-10 10:57:45.415318 | 2026-09-10 10:57:45.415464 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-09-10 10:57:45.634075 | instance | environment: line 3: kubectl: command not found 2026-09-10 10:57:45.979643 | instance | ok: Runtime: 0:00:00.008043 2026-09-10 10:57:45.987828 | 2026-09-10 10:57:45.987949 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-09-10 10:57:46.579383 | instance | changed: 2026-09-10 10:57:46.579652 | instance | cd+++++++++ pod-logs/ 2026-09-10 10:57:46.579685 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-09-10 10:57:46.602450 | 2026-09-10 10:57:46.602660 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-09-10 10:57:46.834640 | instance | changed 2026-09-10 10:57:46.840415 | 2026-09-10 10:57:46.840516 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-09-10 10:57:47.061309 | instance | /bin/bash: line 2: kubectl: command not found 2026-09-10 10:57:47.457377 | instance | ok: Runtime: 0:00:00.054742 2026-09-10 10:57:47.461768 | 2026-09-10 10:57:47.461884 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-09-10 10:57:47.701673 | instance | /bin/bash: line 2: kubectl: command not found 2026-09-10 10:57:47.730283 | instance | ceph-mgr endpoints: 2026-09-10 10:57:47.995435 | instance | ok: Runtime: 0:00:00.034809 2026-09-10 10:57:48.006620 | 2026-09-10 10:57:48.006852 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-09-10 10:57:48.319858 | instance | /bin/bash: line 4: kubectl: command not found 2026-09-10 10:57:48.549184 | instance | ok: Runtime: 0:00:00.028355 2026-09-10 10:57:48.553988 | 2026-09-10 10:57:48.554053 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-09-10 10:57:49.130567 | instance | changed: cd+++++++++ prometheus/ 2026-09-10 10:57:49.142408 | 2026-09-10 10:57:49.142516 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-09-10 10:57:49.367944 | instance | changed 2026-09-10 10:57:49.374095 | 2026-09-10 10:57:49.374241 | TASK [gather-selenium-data : Get selenium data] 2026-09-10 10:57:49.673234 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-09-10 10:57:49.673955 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-09-10 10:57:49.907728 | instance | ERROR 2026-09-10 10:57:49.907927 | instance | { 2026-09-10 10:57:49.907981 | instance | "delta": "0:00:00.005392", 2026-09-10 10:57:49.908012 | instance | "end": "2026-09-10 10:57:49.674482", 2026-09-10 10:57:49.908041 | instance | "msg": "non-zero return code", 2026-09-10 10:57:49.908066 | instance | "rc": 1, 2026-09-10 10:57:49.908094 | instance | "start": "2026-09-10 10:57:49.669090" 2026-09-10 10:57:49.908119 | instance | } 2026-09-10 10:57:49.908151 | instance | ERROR: Ignoring Errors 2026-09-10 10:57:49.914442 | 2026-09-10 10:57:49.914539 | TASK [gather-selenium-data : Downloads logs to executor] 2026-09-10 10:57:50.463906 | instance | changed: cd+++++++++ selenium/ 2026-09-10 10:57:50.471622 | 2026-09-10 10:57:50.471766 | PLAY RECAP 2026-09-10 10:57:50.471828 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-09-10 10:57:50.471857 | 2026-09-10 10:57:50.609053 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main] 2026-09-10 10:57:50.627784 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-09-10 10:57:51.746112 | 2026-09-10 10:57:51.746306 | PLAY [all] 2026-09-10 10:57:51.760265 | 2026-09-10 10:57:51.760427 | TASK [fetch-output : Set log path for multiple nodes] 2026-09-10 10:57:51.825236 | instance | skipping: Conditional result was False 2026-09-10 10:57:51.834606 | 2026-09-10 10:57:51.834767 | TASK [fetch-output : Set log path for single node] 2026-09-10 10:57:51.884186 | instance | ok 2026-09-10 10:57:51.889736 | 2026-09-10 10:57:51.889840 | LOOP [fetch-output : Ensure local output dirs] 2026-09-10 10:57:52.321176 | instance -> localhost | ok: "/var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/logs" 2026-09-10 10:57:52.524030 | instance -> localhost | changed: "/var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/artifacts" 2026-09-10 10:57:52.720984 | instance -> localhost | changed: "/var/lib/zuul/builds/0110af2b99a641c6b1c7b25ba2177788/work/docs" 2026-09-10 10:57:52.739317 | 2026-09-10 10:57:52.739556 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-09-10 10:57:53.429612 | instance | changed: .d..t...... ./ 2026-09-10 10:57:53.430023 | instance | changed: All items complete 2026-09-10 10:57:53.430108 | 2026-09-10 10:57:53.917678 | instance | changed: .d..t...... ./ 2026-09-10 10:57:54.427457 | instance | changed: .d..t...... ./ 2026-09-10 10:57:54.450184 | 2026-09-10 10:57:54.450542 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-09-10 10:57:54.901872 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.005084 2026-09-10 10:57:55.192829 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.061830 2026-09-10 10:57:55.203490 | 2026-09-10 10:57:55.203605 | PLAY [all] 2026-09-10 10:57:55.209434 | 2026-09-10 10:57:55.209501 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-09-10 10:57:55.662138 | instance | changed 2026-09-10 10:57:55.673315 | 2026-09-10 10:57:55.673429 | PLAY RECAP 2026-09-10 10:57:55.673509 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-09-10 10:57:55.673553 | 2026-09-10 10:57:55.874111 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-09-10 10:57:55.878934 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-09-10 10:57:56.476482 | 2026-09-10 10:57:56.476750 | PLAY [localhost] 2026-09-10 10:57:56.488432 | 2026-09-10 10:57:56.488585 | TASK [Generate Zuul manifest] 2026-09-10 10:57:56.505475 | localhost | ok 2026-09-10 10:57:56.661347 | 2026-09-10 10:57:56.661672 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-09-10 10:57:57.101144 | localhost | changed 2026-09-10 10:57:57.115746 | 2026-09-10 10:57:57.116123 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-09-10 10:57:57.195261 | localhost | ok 2026-09-10 10:57:57.203426 | 2026-09-10 10:57:57.203529 | TASK [Upload logs] 2026-09-10 10:57:57.225631 | localhost | ok 2026-09-10 10:57:57.347505 | 2026-09-10 10:57:57.347928 | TASK [Set zuul-log-path fact] 2026-09-10 10:57:57.370389 | localhost | ok 2026-09-10 10:57:57.394885 | 2026-09-10 10:57:57.395014 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-09-10 10:57:57.433947 | localhost | ok 2026-09-10 10:57:57.447641 | 2026-09-10 10:57:57.447747 | TASK [upload-logs : Create log directories] 2026-09-10 10:57:57.870882 | localhost | changed 2026-09-10 10:57:57.875335 | 2026-09-10 10:57:57.875405 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-09-10 10:57:58.400947 | localhost -> localhost | ok: Runtime: 0:00:00.036895 2026-09-10 10:57:58.405945 | 2026-09-10 10:57:58.406038 | TASK [upload-logs : Upload logs to log server] 2026-09-10 10:57:59.026684 | localhost | Output suppressed because no_log was given 2026-09-10 10:57:59.079935 | 2026-09-10 10:57:59.080082 | LOOP [upload-logs : Compress console log and json output] 2026-09-10 10:57:59.133620 | localhost | skipping: Conditional result was False 2026-09-10 10:57:59.141325 | localhost | skipping: Conditional result was False 2026-09-10 10:57:59.157928 | 2026-09-10 10:57:59.158200 | LOOP [upload-logs : Upload compressed console log and json output] 2026-09-10 10:57:59.223296 | localhost | skipping: Conditional result was False 2026-09-10 10:57:59.223660 | 2026-09-10 10:57:59.230267 | localhost | skipping: Conditional result was False 2026-09-10 10:57:59.464857 | 2026-09-10 10:57:59.465009 | LOOP [upload-logs : Upload console log and json output]