2026-08-28 03:56:13.538390 | Job console starting 2026-08-28 03:56:13.553877 | Updating git repos 2026-08-28 03:56:20.505578 | Cloning repos into workspace 2026-08-28 03:56:35.695549 | Restoring repo states 2026-08-28 03:56:48.349288 | Merging changes 2026-08-28 03:56:50.244334 | Checking out repos 2026-08-28 03:56:53.191499 | Preparing playbooks 2026-08-28 03:57:01.406935 | Running Ansible setup 2026-08-28 03:57:05.155632 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-28 03:57:05.771824 | 2026-08-28 03:57:05.771959 | PLAY [localhost] 2026-08-28 03:57:05.779433 | 2026-08-28 03:57:05.779499 | TASK [Gathering Facts] 2026-08-28 03:57:06.725466 | localhost | ok 2026-08-28 03:57:06.737112 | 2026-08-28 03:57:06.737216 | TASK [Setup log path fact] 2026-08-28 03:57:06.758624 | localhost | ok 2026-08-28 03:57:06.772627 | 2026-08-28 03:57:06.772693 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-28 03:57:06.803948 | localhost | ok 2026-08-28 03:57:06.811517 | 2026-08-28 03:57:06.811581 | TASK [emit-job-header : Print job information] 2026-08-28 03:57:06.852510 | # Job Information 2026-08-28 03:57:06.852657 | Ansible Version: 2.16.18 2026-08-28 03:57:06.852703 | Job: atmosphere-molecule-csi-rbd 2026-08-28 03:57:06.852734 | Pipeline: check 2026-08-28 03:57:06.852763 | Executor: 2d72f0692154 2026-08-28 03:57:06.852791 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4350 2026-08-28 03:57:06.852824 | Event ID: a20736b0-a293-11f1-8346-713229ab5810 2026-08-28 03:57:06.856595 | 2026-08-28 03:57:06.856680 | LOOP [emit-job-header : Print node information] 2026-08-28 03:57:06.954132 | localhost | ok: 2026-08-28 03:57:06.954464 | localhost | # Node Information 2026-08-28 03:57:06.954500 | localhost | Inventory Hostname: instance 2026-08-28 03:57:06.954568 | localhost | Hostname: np0000191377 2026-08-28 03:57:06.954624 | localhost | Username: zuul 2026-08-28 03:57:06.955018 | localhost | Distro: Ubuntu 22.04 2026-08-28 03:57:06.955050 | localhost | Provider: yul1 2026-08-28 03:57:06.955076 | localhost | Region: ca-ymq-1 2026-08-28 03:57:06.955101 | localhost | Label: ubuntu-jammy 2026-08-28 03:57:06.955125 | localhost | Product Name: OpenStack Nova 2026-08-28 03:57:06.955149 | localhost | Interface IP: 162.253.55.109 2026-08-28 03:57:06.966141 | 2026-08-28 03:57:06.966316 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-28 03:57:07.448316 | localhost -> localhost | changed 2026-08-28 03:57:07.459186 | 2026-08-28 03:57:07.459342 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-28 03:57:08.295073 | localhost -> localhost | changed 2026-08-28 03:57:08.301829 | 2026-08-28 03:57:08.301884 | PLAY [all] 2026-08-28 03:57:08.310594 | 2026-08-28 03:57:08.310667 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-28 03:57:08.547344 | instance -> localhost | ok 2026-08-28 03:57:08.557611 | 2026-08-28 03:57:08.557727 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-28 03:57:08.592199 | instance | ok 2026-08-28 03:57:08.608841 | instance | included: /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-28 03:57:08.614701 | 2026-08-28 03:57:08.614762 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-28 03:57:09.378376 | instance -> localhost | Generating public/private rsa key pair. 2026-08-28 03:57:09.378588 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/3f4cab45b13643bb818b914ca556fb97_id_rsa 2026-08-28 03:57:09.378630 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/3f4cab45b13643bb818b914ca556fb97_id_rsa.pub 2026-08-28 03:57:09.378661 | instance -> localhost | The key fingerprint is: 2026-08-28 03:57:09.378691 | instance -> localhost | SHA256:5PsjHlPUvFA6yIE6Dag6rmkF3iqxFA6LUZRHJf4++/0 zuul-build-sshkey 2026-08-28 03:57:09.378735 | instance -> localhost | The key's randomart image is: 2026-08-28 03:57:09.378765 | instance -> localhost | +---[RSA 3072]----+ 2026-08-28 03:57:09.378797 | instance -> localhost | | ..+o.... . | 2026-08-28 03:57:09.378826 | instance -> localhost | | +.o... o = | 2026-08-28 03:57:09.378853 | instance -> localhost | | o ..+ + = o | 2026-08-28 03:57:09.378881 | instance -> localhost | |+o o..o . o . | 2026-08-28 03:57:09.378908 | instance -> localhost | |*o+ .. S . . | 2026-08-28 03:57:09.378935 | instance -> localhost | |*+ o . o | 2026-08-28 03:57:09.378961 | instance -> localhost | |o+o o + | 2026-08-28 03:57:09.378988 | instance -> localhost | |o= o.=. | 2026-08-28 03:57:09.379018 | instance -> localhost | |* .oo.ooE | 2026-08-28 03:57:09.379046 | instance -> localhost | +----[SHA256]-----+ 2026-08-28 03:57:09.379106 | instance -> localhost | ok: Runtime: 0:00:00.307907 2026-08-28 03:57:09.387385 | 2026-08-28 03:57:09.387470 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-28 03:57:09.420107 | instance | ok 2026-08-28 03:57:09.430717 | instance | included: /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-28 03:57:09.437851 | 2026-08-28 03:57:09.437915 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-28 03:57:09.462185 | instance | skipping: Conditional result was False 2026-08-28 03:57:09.471580 | 2026-08-28 03:57:09.471851 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-28 03:57:09.942825 | instance | changed 2026-08-28 03:57:09.951838 | 2026-08-28 03:57:09.951928 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-28 03:57:10.157387 | instance | ok 2026-08-28 03:57:10.164579 | 2026-08-28 03:57:10.164670 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-28 03:57:10.684400 | instance | changed 2026-08-28 03:57:10.689932 | 2026-08-28 03:57:10.689996 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-28 03:57:11.166649 | instance | changed 2026-08-28 03:57:11.175526 | 2026-08-28 03:57:11.175611 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-28 03:57:11.202214 | instance | skipping: Conditional result was False 2026-08-28 03:57:11.213292 | 2026-08-28 03:57:11.213382 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-28 03:57:11.684254 | instance -> localhost | changed 2026-08-28 03:57:11.701300 | 2026-08-28 03:57:11.701392 | TASK [add-build-sshkey : Add back temp key] 2026-08-28 03:57:12.008984 | instance -> localhost | Identity added: /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/3f4cab45b13643bb818b914ca556fb97_id_rsa (zuul-build-sshkey) 2026-08-28 03:57:12.009254 | instance -> localhost | ok: Runtime: 0:00:00.017809 2026-08-28 03:57:12.020985 | 2026-08-28 03:57:12.021119 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-28 03:57:12.350216 | instance | ok 2026-08-28 03:57:12.357406 | 2026-08-28 03:57:12.357502 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-28 03:57:12.382900 | instance | skipping: Conditional result was False 2026-08-28 03:57:12.399752 | 2026-08-28 03:57:12.399865 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-28 03:57:12.712410 | instance | ok 2026-08-28 03:57:12.719259 | 2026-08-28 03:57:12.719321 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-28 03:57:16.403350 | instance | Output suppressed because no_log was given 2026-08-28 03:57:16.414564 | 2026-08-28 03:57:16.414647 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-28 03:57:16.625471 | instance | ok: "logs" 2026-08-28 03:57:16.625769 | instance | ok: All items complete 2026-08-28 03:57:16.625798 | 2026-08-28 03:57:16.794019 | instance | ok: "artifacts" 2026-08-28 03:57:16.941404 | instance | ok: "docs" 2026-08-28 03:57:16.963645 | 2026-08-28 03:57:16.963826 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-28 03:57:17.172931 | instance | changed: "logs" 2026-08-28 03:57:17.345907 | instance | changed: "artifacts" 2026-08-28 03:57:17.492605 | instance | changed: "docs" 2026-08-28 03:57:17.510831 | 2026-08-28 03:57:17.510950 | PLAY RECAP 2026-08-28 03:57:17.510998 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-28 03:57:17.511029 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-28 03:57:17.511052 | 2026-08-28 03:57:17.665494 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-28 03:57:17.670425 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-28 03:57:18.319461 | 2026-08-28 03:57:18.319613 | PLAY [all] 2026-08-28 03:57:18.330297 | 2026-08-28 03:57:18.330371 | TASK [setup-uv : Extract archive] 2026-08-28 03:57:20.832482 | instance | changed 2026-08-28 03:57:20.839974 | 2026-08-28 03:57:20.840077 | TASK [setup-uv : Print version] 2026-08-28 03:57:21.206153 | instance | uv 0.8.13 2026-08-28 03:57:21.381649 | instance | ok: Runtime: 0:00:00.013517 2026-08-28 03:57:21.390673 | 2026-08-28 03:57:21.390781 | TASK [Install Ansible collection siblings] 2026-08-28 03:57:30.641038 | instance | changed: 2026-08-28 03:57:30.641274 | instance | Sibling collection ansible.netcommon at /home/zuul/src/github.com/ansible-collections/ansible.netcommon 2026-08-28 03:57:30.641315 | instance | Sibling collection ansible.posix at /home/zuul/src/github.com/ansible-collections/ansible.posix 2026-08-28 03:57:30.641346 | instance | Sibling collection ansible.utils at /home/zuul/src/github.com/ansible-collections/ansible.utils 2026-08-28 03:57:30.641374 | instance | Sibling collection community.crypto at /home/zuul/src/github.com/ansible-collections/community.crypto 2026-08-28 03:57:30.641401 | instance | Sibling collection community.general at /home/zuul/src/github.com/ansible-collections/community.general 2026-08-28 03:57:30.641433 | instance | Sibling collection community.mysql at /home/zuul/src/github.com/ansible-collections/community.mysql 2026-08-28 03:57:30.641461 | instance | Sibling collection kubernetes.core at /home/zuul/src/github.com/ansible-collections/kubernetes.core 2026-08-28 03:57:30.641490 | instance | Sibling collection vexxhost.ceph at /home/zuul/src/github.com/vexxhost/ansible-collection-ceph 2026-08-28 03:57:30.641516 | instance | Sibling collection vexxhost.containers at /home/zuul/src/github.com/vexxhost/ansible-collection-containers 2026-08-28 03:57:30.641542 | instance | Sibling collection vexxhost.kubernetes at /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes 2026-08-28 03:57:30.641568 | instance | Sibling collection atmosphere.common at /home/zuul/src/github.com/vexxhost/atmosphere.common 2026-08-28 03:57:30.641593 | instance | Sibling collection openstack.cloud at /home/zuul/src/opendev.org/openstack/ansible-collections-openstack 2026-08-28 03:57:30.641618 | instance | Resolved ansible.netcommon to 1.2.0 for 1.2.0 2026-08-28 03:57:30.641643 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0 2026-08-28 03:57:30.641668 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0 2026-08-28 03:57:30.641695 | instance | Resolved community.crypto to 2.2.3 for 2.2.3 2026-08-28 03:57:30.641720 | instance | Resolved community.general to 7.3.0 for 7.3.0 2026-08-28 03:57:30.641745 | instance | Resolved community.mysql to 3.6.0 for 3.6.0 2026-08-28 03:57:30.641769 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0 2026-08-28 03:57:30.641794 | instance | Resolved openstack.cloud to 2.6.0 for >=2.0.0 2026-08-28 03:57:30.641818 | instance | Resolved vexxhost.ceph to v4.2.0 for >=3.1.2 2026-08-28 03:57:30.641843 | instance | Resolved atmosphere.common to v0.7.0 for >=0.7.0 2026-08-28 03:57:30.641870 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0 2026-08-28 03:57:30.641919 | instance | Resolved community.general to 7.3.0 for 7.3.0,>=4.5.0 2026-08-28 03:57:30.641946 | instance | Resolved ansible.utils to v6.1.0 for >=2.9.0,>=6.0.0 2026-08-28 03:57:30.641971 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0 2026-08-28 03:57:30.641996 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2 2026-08-28 03:57:30.642021 | instance | Resolved vexxhost.kubernetes to v3.3.0 for >=3.3.0,>=2.5.0 2026-08-28 03:57:30.642045 | instance | Resolved ansible.posix to 1.6.0 for 1.6.0,>=1.6.0 2026-08-28 03:57:30.642069 | instance | Resolved community.crypto to 2.2.3 for 2.2.3,>=2.2.3 2026-08-28 03:57:30.642093 | instance | Resolved kubernetes.core to 2.4.0 for 2.4.0,>=2.4.0,>=2.3.2 2026-08-28 03:57:30.642118 | instance | Resolved vexxhost.containers to v1.6.8 for >=1.1.1,>=1.6.0 2026-08-28 03:57:30.642143 | instance | Checked out ansible.netcommon to 1.2.0 2026-08-28 03:57:30.642169 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.netcommon 2026-08-28 03:57:30.642202 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.642226 | instance | Process install dependency map 2026-08-28 03:57:30.642251 | instance | Starting collection install process 2026-08-28 03:57:30.642276 | instance | Installing 'ansible.netcommon:*' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon' 2026-08-28 03:57:30.642300 | instance | Created collection for ansible.netcommon:* at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon 2026-08-28 03:57:30.642324 | instance | ansible.netcommon:* was installed successfully 2026-08-28 03:57:30.642348 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-08-28 03:57:30.642373 | instance | Creating virtual environment at: .venv 2026-08-28 03:57:30.642398 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-08-28 03:57:30.642423 | instance | Downloading netaddr (2.2MiB) 2026-08-28 03:57:30.642447 | instance | Downloading setuptools (1.1MiB) 2026-08-28 03:57:30.642480 | instance | Downloading openstacksdk (1.7MiB) 2026-08-28 03:57:30.642506 | instance | Downloading ansible-core (2.1MiB) 2026-08-28 03:57:30.642532 | instance | Downloading kubernetes (1.9MiB) 2026-08-28 03:57:30.642557 | instance | Downloading cryptography (4.2MiB) 2026-08-28 03:57:30.642582 | instance | Downloading rjsonnet (1.2MiB) 2026-08-28 03:57:30.642606 | instance | Downloading pygments (1.2MiB) 2026-08-28 03:57:30.642631 | instance | Building pyperclip==1.9.0 2026-08-28 03:57:30.642656 | instance | Downloading rjsonnet 2026-08-28 03:57:30.642687 | instance | Downloading netaddr 2026-08-28 03:57:30.642713 | instance | Downloading pygments 2026-08-28 03:57:30.642738 | instance | Downloading cryptography 2026-08-28 03:57:30.642763 | instance | Downloading setuptools 2026-08-28 03:57:30.642787 | instance | Downloading kubernetes 2026-08-28 03:57:30.642812 | instance | Downloading ansible-core 2026-08-28 03:57:30.642836 | instance | Downloading openstacksdk 2026-08-28 03:57:30.642861 | instance | Built pyperclip==1.9.0 2026-08-28 03:57:30.642885 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-08-28 03:57:30.642910 | instance | Installed 79 packages in 158ms 2026-08-28 03:57:30.642935 | instance | Checked out ansible.posix to 1.6.0 2026-08-28 03:57:30.642960 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.posix 2026-08-28 03:57:30.642985 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.643010 | instance | Process install dependency map 2026-08-28 03:57:30.643034 | instance | Starting collection install process 2026-08-28 03:57:30.643059 | instance | Installing 'ansible.posix:1.6.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix' 2026-08-28 03:57:30.643092 | instance | Created collection for ansible.posix:1.6.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix 2026-08-28 03:57:30.643119 | instance | ansible.posix:1.6.0 was installed successfully 2026-08-28 03:57:30.643144 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.643221 | instance | 2.17.12 2026-08-28 03:57:30.643264 | instance | Checked out ansible.utils to v6.1.0 2026-08-28 03:57:30.643292 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/ansible.utils 2026-08-28 03:57:30.643318 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.643344 | instance | Process install dependency map 2026-08-28 03:57:30.643368 | instance | Starting collection install process 2026-08-28 03:57:30.643394 | instance | Installing 'ansible.utils:6.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils' 2026-08-28 03:57:30.643419 | instance | Created collection for ansible.utils:6.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils 2026-08-28 03:57:30.643445 | instance | ansible.utils:6.1.0 was installed successfully 2026-08-28 03:57:30.643470 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.643496 | instance | 2.17.12 2026-08-28 03:57:30.643521 | instance | Checked out atmosphere.common to v0.7.0 2026-08-28 03:57:30.643593 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/atmosphere.common 2026-08-28 03:57:30.643624 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.643649 | instance | Process install dependency map 2026-08-28 03:57:30.643675 | instance | Starting collection install process 2026-08-28 03:57:30.643701 | instance | Installing 'atmosphere.common:0.7.0' to '/home/zuul/.ansible/collections/ansible_collections/atmosphere/common' 2026-08-28 03:57:30.643726 | instance | Created collection for atmosphere.common:0.7.0 at /home/zuul/.ansible/collections/ansible_collections/atmosphere/common 2026-08-28 03:57:30.643751 | instance | atmosphere.common:0.7.0 was installed successfully 2026-08-28 03:57:30.643776 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.643800 | instance | 2.17.12 2026-08-28 03:57:30.643830 | instance | Checked out community.crypto to 2.2.3 2026-08-28 03:57:30.643855 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.crypto 2026-08-28 03:57:30.643880 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.643904 | instance | Process install dependency map 2026-08-28 03:57:30.643928 | instance | Starting collection install process 2026-08-28 03:57:30.643952 | instance | Installing 'community.crypto:2.2.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto' 2026-08-28 03:57:30.643977 | instance | Created collection for community.crypto:2.2.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto 2026-08-28 03:57:30.644001 | instance | community.crypto:2.2.3 was installed successfully 2026-08-28 03:57:30.644025 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.644049 | instance | 2.17.12 2026-08-28 03:57:30.644073 | instance | Checked out community.general to 7.3.0 2026-08-28 03:57:30.644097 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.general 2026-08-28 03:57:30.644122 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.644155 | instance | Process install dependency map 2026-08-28 03:57:30.644180 | instance | Starting collection install process 2026-08-28 03:57:30.644205 | instance | Installing 'community.general:7.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/general' 2026-08-28 03:57:30.644229 | instance | Created collection for community.general:7.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/general 2026-08-28 03:57:30.644253 | instance | community.general:7.3.0 was installed successfully 2026-08-28 03:57:30.644271 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.644288 | instance | 2.17.12 2026-08-28 03:57:30.644307 | instance | Checked out community.mysql to 3.6.0 2026-08-28 03:57:30.644325 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/community.mysql 2026-08-28 03:57:30.644343 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.644363 | instance | Process install dependency map 2026-08-28 03:57:30.644381 | instance | Starting collection install process 2026-08-28 03:57:30.644400 | instance | Installing 'community.mysql:3.6.0' to '/home/zuul/.ansible/collections/ansible_collections/community/mysql' 2026-08-28 03:57:30.644418 | instance | Created collection for community.mysql:3.6.0 at /home/zuul/.ansible/collections/ansible_collections/community/mysql 2026-08-28 03:57:30.644436 | instance | community.mysql:3.6.0 was installed successfully 2026-08-28 03:57:30.644453 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.644471 | instance | 2.17.12 2026-08-28 03:57:30.644489 | instance | Checked out kubernetes.core to 2.4.0 2026-08-28 03:57:30.644506 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/ansible-collections/kubernetes.core 2026-08-28 03:57:30.644524 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.644542 | instance | Process install dependency map 2026-08-28 03:57:30.644560 | instance | Starting collection install process 2026-08-28 03:57:30.644578 | instance | Installing 'kubernetes.core:2.4.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core' 2026-08-28 03:57:30.644596 | instance | Created collection for kubernetes.core:2.4.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core 2026-08-28 03:57:30.644614 | instance | kubernetes.core:2.4.0 was installed successfully 2026-08-28 03:57:30.644632 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.644649 | instance | 2.17.12 2026-08-28 03:57:30.644667 | instance | Checked out openstack.cloud to 2.6.0 2026-08-28 03:57:30.644685 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/opendev.org/openstack/ansible-collections-openstack 2026-08-28 03:57:30.644703 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.644721 | instance | Process install dependency map 2026-08-28 03:57:30.644738 | instance | Starting collection install process 2026-08-28 03:57:30.644756 | instance | Installing 'openstack.cloud:2.6.0' to '/home/zuul/.ansible/collections/ansible_collections/openstack/cloud' 2026-08-28 03:57:30.644773 | instance | Created collection for openstack.cloud:2.6.0 at /home/zuul/.ansible/collections/ansible_collections/openstack/cloud 2026-08-28 03:57:30.644791 | instance | openstack.cloud:2.6.0 was installed successfully 2026-08-28 03:57:30.644809 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.644826 | instance | 2.17.12 2026-08-28 03:57:30.644844 | instance | Checked out vexxhost.ceph to v4.2.0 2026-08-28 03:57:30.644862 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-ceph 2026-08-28 03:57:30.644884 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.644902 | instance | Process install dependency map 2026-08-28 03:57:30.644919 | instance | Starting collection install process 2026-08-28 03:57:30.644937 | instance | Installing 'vexxhost.ceph:4.2.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph' 2026-08-28 03:57:30.644972 | instance | Created collection for vexxhost.ceph:4.2.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph 2026-08-28 03:57:30.644993 | instance | vexxhost.ceph:4.2.0 was installed successfully 2026-08-28 03:57:30.645011 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.645029 | instance | 2.17.12 2026-08-28 03:57:30.645047 | instance | Checked out vexxhost.containers to v1.6.8 2026-08-28 03:57:30.645066 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-containers 2026-08-28 03:57:30.645084 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.645101 | instance | Process install dependency map 2026-08-28 03:57:30.645119 | instance | Starting collection install process 2026-08-28 03:57:30.645137 | instance | Installing 'vexxhost.containers:1.6.8' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/containers' 2026-08-28 03:57:30.645155 | instance | Created collection for vexxhost.containers:1.6.8 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/containers 2026-08-28 03:57:30.645173 | instance | vexxhost.containers:1.6.8 was installed successfully 2026-08-28 03:57:30.645191 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.645209 | instance | 2.17.12 2026-08-28 03:57:30.645227 | instance | Checked out vexxhost.kubernetes to v3.3.0 2026-08-28 03:57:30.645245 | instance | Running: uv run ansible-galaxy collection install --force --no-deps --collections-path /home/zuul/.ansible/collections /home/zuul/src/github.com/vexxhost/ansible-collection-kubernetes 2026-08-28 03:57:30.645263 | instance | Starting galaxy collection install process 2026-08-28 03:57:30.645281 | instance | Process install dependency map 2026-08-28 03:57:30.645298 | instance | Starting collection install process 2026-08-28 03:57:30.645316 | instance | Installing 'vexxhost.kubernetes:3.3.0' to '/home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes' 2026-08-28 03:57:30.645333 | instance | Created collection for vexxhost.kubernetes:3.3.0 at /home/zuul/.ansible/collections/ansible_collections/vexxhost/kubernetes 2026-08-28 03:57:30.645351 | instance | vexxhost.kubernetes:3.3.0 was installed successfully 2026-08-28 03:57:30.645369 | instance | [WARNING]: Collection ansible.netcommon does not support Ansible version 2026-08-28 03:57:30.645387 | instance | 2.17.12 2026-08-28 03:57:30.650728 | 2026-08-28 03:57:30.650769 | PLAY RECAP 2026-08-28 03:57:30.650811 | instance | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-28 03:57:30.650832 | 2026-08-28 03:57:30.783177 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-28 03:57:30.787322 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main] 2026-08-28 03:57:31.366045 | 2026-08-28 03:57:31.366172 | PLAY [all] 2026-08-28 03:57:31.377609 | 2026-08-28 03:57:31.377681 | TASK [Install "jq" for log collection] 2026-08-28 03:57:40.442593 | instance | changed 2026-08-28 03:57:40.444627 | 2026-08-28 03:57:40.444685 | PLAY RECAP 2026-08-28 03:57:40.444737 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-28 03:57:40.444789 | 2026-08-28 03:57:40.572257 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/pre.yml@main] 2026-08-28 03:57:40.576491 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-28 03:57:41.235192 | 2026-08-28 03:57:41.235337 | PLAY [all] 2026-08-28 03:57:41.246754 | 2026-08-28 03:57:41.246830 | LOOP [Check inventory directories] 2026-08-28 03:57:41.591134 | instance | ok: "src/github.com/vexxhost/atmosphere" 2026-08-28 03:57:41.760710 | instance | ok: "src/github.com/vexxhost/atmosphere/molecule/csi/inventory" 2026-08-28 03:57:41.922936 | instance | ok: "src/github.com/vexxhost/atmosphere/extensions/molecule/csi/inventory" 2026-08-28 03:57:41.933568 | 2026-08-28 03:57:41.933789 | LOOP [Copy inventory file for Zuul] 2026-08-28 03:57:42.742233 | instance | changed: 2026-08-28 03:57:42.742458 | instance | { 2026-08-28 03:57:42.742588 | instance | "ansible_loop_var": "item", 2026-08-28 03:57:42.742622 | instance | "changed": false, 2026-08-28 03:57:42.742651 | instance | "failed": false, 2026-08-28 03:57:42.742681 | instance | "invocation": { 2026-08-28 03:57:42.742709 | instance | "module_args": { 2026-08-28 03:57:42.742736 | instance | "checksum_algorithm": "sha1", 2026-08-28 03:57:42.742763 | instance | "follow": true, 2026-08-28 03:57:42.742789 | instance | "get_attributes": true, 2026-08-28 03:57:42.742817 | instance | "get_checksum": true, 2026-08-28 03:57:42.742843 | instance | "get_mime": true, 2026-08-28 03:57:42.742870 | instance | "path": "src/github.com/vexxhost/atmosphere" 2026-08-28 03:57:42.742896 | instance | } 2026-08-28 03:57:42.742922 | instance | }, 2026-08-28 03:57:42.742948 | instance | "item": "src/github.com/vexxhost/atmosphere", 2026-08-28 03:57:42.742973 | instance | "stat": { 2026-08-28 03:57:42.742999 | instance | "atime": 1787889443.2461736, 2026-08-28 03:57:42.743071 | instance | "attr_flags": "e", 2026-08-28 03:57:42.743102 | instance | "attributes": [ 2026-08-28 03:57:42.743128 | instance | "extents" 2026-08-28 03:57:42.743153 | instance | ], 2026-08-28 03:57:42.743178 | instance | "block_size": 4096, 2026-08-28 03:57:42.743203 | instance | "blocks": 8, 2026-08-28 03:57:42.743229 | instance | "charset": "unknown", 2026-08-28 03:57:42.743257 | instance | "ctime": 1787889442.2461634, 2026-08-28 03:57:42.743283 | instance | "dev": 64513, 2026-08-28 03:57:42.743309 | instance | "device_type": 0, 2026-08-28 03:57:42.743335 | instance | "executable": true, 2026-08-28 03:57:42.743361 | instance | "exists": true, 2026-08-28 03:57:42.743387 | instance | "gid": 1000, 2026-08-28 03:57:42.743413 | instance | "gr_name": "zuul", 2026-08-28 03:57:42.743437 | instance | "inode": 1048518, 2026-08-28 03:57:42.743460 | instance | "isblk": false, 2026-08-28 03:57:42.743483 | instance | "ischr": false, 2026-08-28 03:57:42.743506 | instance | "isdir": true, 2026-08-28 03:57:42.743529 | instance | "isfifo": false, 2026-08-28 03:57:42.743554 | instance | "isgid": false, 2026-08-28 03:57:42.743579 | instance | "islnk": false, 2026-08-28 03:57:42.743605 | instance | "isreg": false, 2026-08-28 03:57:42.743631 | instance | "issock": false, 2026-08-28 03:57:42.743656 | instance | "isuid": false, 2026-08-28 03:57:42.743681 | instance | "mimetype": "unknown", 2026-08-28 03:57:42.743706 | instance | "mode": "0755", 2026-08-28 03:57:42.743732 | instance | "mtime": 1787889442.2461634, 2026-08-28 03:57:42.743757 | instance | "nlink": 21, 2026-08-28 03:57:42.743782 | instance | "path": "src/github.com/vexxhost/atmosphere", 2026-08-28 03:57:42.743808 | instance | "pw_name": "zuul", 2026-08-28 03:57:42.743838 | instance | "readable": true, 2026-08-28 03:57:42.743865 | instance | "rgrp": true, 2026-08-28 03:57:42.743892 | instance | "roth": true, 2026-08-28 03:57:42.743918 | instance | "rusr": true, 2026-08-28 03:57:42.743943 | instance | "size": 4096, 2026-08-28 03:57:42.743968 | instance | "uid": 1000, 2026-08-28 03:57:42.744009 | instance | "version": "3507941048", 2026-08-28 03:57:42.744037 | instance | "wgrp": false, 2026-08-28 03:57:42.744065 | instance | "woth": false, 2026-08-28 03:57:42.744091 | instance | "writeable": true, 2026-08-28 03:57:42.744118 | instance | "wusr": true, 2026-08-28 03:57:42.744144 | instance | "xgrp": true, 2026-08-28 03:57:42.744169 | instance | "xoth": true, 2026-08-28 03:57:42.744194 | instance | "xusr": true 2026-08-28 03:57:42.744220 | instance | } 2026-08-28 03:57:42.744245 | instance | } 2026-08-28 03:57:42.744293 | instance | ok: All items complete 2026-08-28 03:57:42.744326 | 2026-08-28 03:57:42.746064 | instance | skipping: Conditional result was False 2026-08-28 03:57:42.746864 | instance | skipping: Conditional result was False 2026-08-28 03:57:42.756297 | 2026-08-28 03:57:42.756366 | LOOP [Switch "ansible_host" to private IP] 2026-08-28 03:57:43.101458 | instance | changed: 1 replacements made 2026-08-28 03:57:43.103155 | instance | skipping: Conditional result was False 2026-08-28 03:57:43.105562 | instance | skipping: Conditional result was False 2026-08-28 03:57:43.124196 | 2026-08-28 03:57:43.124330 | TASK [Run Molecule scenario] 2026-08-28 03:57:44.000702 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-08-28 03:57:44.400421 | instance | INFO [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-28 03:57:44.400472 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-08-28 03:57:55.067831 | instance | INFO [csi > dependency] Executing 2026-08-28 03:57:55.068277 | instance | WARNING [csi > dependency] Missing roles requirements file: requirements.yml 2026-08-28 03:57:55.068687 | instance | WARNING [csi > dependency] Missing collections requirements file: collections.yml 2026-08-28 03:57:55.068912 | instance | WARNING [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-28 03:57:55.083488 | instance | INFO [csi > cleanup] Executing 2026-08-28 03:57:55.084093 | instance | WARNING [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-28 03:57:55.097059 | instance | INFO [csi > destroy] Executing 2026-08-28 03:57:55.097153 | instance | WARNING [csi > destroy] Skipping, '--destroy=never' requested. 2026-08-28 03:57:55.097257 | instance | INFO [csi > destroy] Executed: Successful 2026-08-28 03:57:55.106077 | instance | INFO [csi > syntax] Executing 2026-08-28 03:57:56.530438 | instance | 2026-08-28 03:57:56.530727 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-08-28 03:57:56.610481 | instance | INFO [csi > syntax] Executed: Successful 2026-08-28 03:57:56.625878 | instance | INFO [csi > create] Executing 2026-08-28 03:57:56.629443 | instance | WARNING [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-28 03:57:56.644008 | instance | INFO [csi > prepare] Executing 2026-08-28 03:57:57.370698 | instance | 2026-08-28 03:57:57.370958 | instance | PLAY [Prepare] ***************************************************************** 2026-08-28 03:57:57.371128 | instance | 2026-08-28 03:57:57.371355 | instance | TASK [Gathering Facts] ********************************************************* 2026-08-28 03:57:57.371609 | instance | Friday 28 August 2026 03:57:57 +0000 (0:00:00.022) 0:00:00.022 ********* 2026-08-28 03:57:58.620775 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-08-28 03:57:58.620991 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-28 03:57:58.621223 | instance | interpreter could change the meaning of that path. See 2026-08-28 03:57:58.621448 | instance | https://docs.ansible.com/ansible- 2026-08-28 03:57:58.621695 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-08-28 03:57:58.630535 | instance | ok: [instance] 2026-08-28 03:57:58.630761 | instance | 2026-08-28 03:57:58.630988 | instance | TASK [Configure short hostname] ************************************************ 2026-08-28 03:57:58.631215 | instance | Friday 28 August 2026 03:57:58 +0000 (0:00:01.260) 0:00:01.282 ********* 2026-08-28 03:57:59.365240 | instance | changed: [instance] 2026-08-28 03:57:59.365436 | instance | 2026-08-28 03:57:59.365696 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-28 03:57:59.365926 | instance | Friday 28 August 2026 03:57:59 +0000 (0:00:00.734) 0:00:02.017 ********* 2026-08-28 03:57:59.641036 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-28 03:57:59.641273 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-08-28 03:57:59.641519 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-28 03:57:59.651258 | instance | changed: [instance] 2026-08-28 03:57:59.651450 | instance | 2026-08-28 03:57:59.651730 | instance | TASK [Purge "snapd" package] *************************************************** 2026-08-28 03:57:59.652099 | instance | Friday 28 August 2026 03:57:59 +0000 (0:00:00.286) 0:00:02.303 ********* 2026-08-28 03:58:00.415430 | instance | ok: [instance] 2026-08-28 03:58:00.415576 | instance | 2026-08-28 03:58:00.415840 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-08-28 03:58:00.416099 | instance | 2026-08-28 03:58:00.416368 | instance | TASK [Gathering Facts] ********************************************************* 2026-08-28 03:58:00.416625 | instance | Friday 28 August 2026 03:58:00 +0000 (0:00:00.764) 0:00:03.067 ********* 2026-08-28 03:58:01.176448 | instance | ok: [instance] 2026-08-28 03:58:01.176639 | instance | 2026-08-28 03:58:01.176923 | instance | TASK [Install depedencies] ***************************************************** 2026-08-28 03:58:01.177158 | instance | Friday 28 August 2026 03:58:01 +0000 (0:00:00.760) 0:00:03.828 ********* 2026-08-28 03:58:25.452075 | instance | changed: [instance] 2026-08-28 03:58:25.452320 | instance | 2026-08-28 03:58:25.452752 | instance | TASK [Start up service] ******************************************************** 2026-08-28 03:58:25.452843 | instance | Friday 28 August 2026 03:58:25 +0000 (0:00:24.275) 0:00:28.103 ********* 2026-08-28 03:58:26.022014 | instance | ok: [instance] 2026-08-28 03:58:26.022742 | instance | 2026-08-28 03:58:26.022818 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-08-28 03:58:26.022831 | instance | Friday 28 August 2026 03:58:26 +0000 (0:00:00.570) 0:00:28.673 ********* 2026-08-28 03:58:26.334885 | instance | ok: [instance] 2026-08-28 03:58:26.335543 | instance | 2026-08-28 03:58:26.335597 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-28 03:58:26.335609 | instance | Friday 28 August 2026 03:58:26 +0000 (0:00:00.312) 0:00:28.986 ********* 2026-08-28 03:58:27.041648 | instance | changed: [instance] 2026-08-28 03:58:27.041883 | instance | 2026-08-28 03:58:27.042275 | instance | TASK [Get list of all loopback devices] **************************************** 2026-08-28 03:58:27.042589 | instance | Friday 28 August 2026 03:58:27 +0000 (0:00:00.706) 0:00:29.692 ********* 2026-08-28 03:58:27.264995 | instance | ok: [instance] 2026-08-28 03:58:27.265213 | instance | 2026-08-28 03:58:27.265560 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-28 03:58:27.265882 | instance | Friday 28 August 2026 03:58:27 +0000 (0:00:00.223) 0:00:29.916 ********* 2026-08-28 03:58:27.292125 | instance | skipping: [instance] 2026-08-28 03:58:27.292350 | instance | 2026-08-28 03:58:27.292587 | instance | TASK [Create devices for Ceph] ************************************************* 2026-08-28 03:58:27.292854 | instance | Friday 28 August 2026 03:58:27 +0000 (0:00:00.027) 0:00:29.943 ********* 2026-08-28 03:58:27.877529 | instance | changed: [instance] => (item=osd0) 2026-08-28 03:58:27.877585 | instance | changed: [instance] => (item=osd1) 2026-08-28 03:58:27.877596 | instance | changed: [instance] => (item=osd2) 2026-08-28 03:58:27.877606 | instance | 2026-08-28 03:58:27.877616 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-08-28 03:58:27.877625 | instance | Friday 28 August 2026 03:58:27 +0000 (0:00:00.584) 0:00:30.528 ********* 2026-08-28 03:58:28.551157 | instance | changed: [instance] => (item=osd0) 2026-08-28 03:58:28.552118 | instance | changed: [instance] => (item=osd1) 2026-08-28 03:58:28.552189 | instance | changed: [instance] => (item=osd2) 2026-08-28 03:58:28.552202 | instance | 2026-08-28 03:58:28.552212 | instance | TASK [Start loop devices] ****************************************************** 2026-08-28 03:58:28.552341 | instance | Friday 28 August 2026 03:58:28 +0000 (0:00:00.674) 0:00:31.202 ********* 2026-08-28 03:58:29.308999 | instance | changed: [instance] => (item=osd0) 2026-08-28 03:58:29.309061 | instance | changed: [instance] => (item=osd1) 2026-08-28 03:58:29.309453 | instance | changed: [instance] => (item=osd2) 2026-08-28 03:58:29.309535 | instance | 2026-08-28 03:58:29.309995 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-08-28 03:58:29.310060 | instance | Friday 28 August 2026 03:58:29 +0000 (0:00:00.757) 0:00:31.960 ********* 2026-08-28 03:58:32.404742 | instance | changed: [instance] => (item=osd0) 2026-08-28 03:58:32.405025 | instance | changed: [instance] => (item=osd1) 2026-08-28 03:58:32.405400 | instance | changed: [instance] => (item=osd2) 2026-08-28 03:58:32.405695 | instance | 2026-08-28 03:58:32.406054 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-08-28 03:58:32.406366 | instance | Friday 28 August 2026 03:58:32 +0000 (0:00:03.095) 0:00:35.056 ********* 2026-08-28 03:58:34.277124 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-08-28 03:58:34.277547 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-08-28 03:58:34.277920 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-08-28 03:58:34.278210 | instance | 2026-08-28 03:58:34.278518 | instance | PLAY RECAP ********************************************************************* 2026-08-28 03:58:34.278904 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-28 03:58:34.279200 | instance | 2026-08-28 03:58:34.279502 | instance | Friday 28 August 2026 03:58:34 +0000 (0:00:01.873) 0:00:36.929 ********* 2026-08-28 03:58:34.279846 | instance | =============================================================================== 2026-08-28 03:58:34.280226 | instance | Install depedencies ---------------------------------------------------- 24.28s 2026-08-28 03:58:34.280530 | instance | Create a volume group for each loop device ------------------------------ 3.10s 2026-08-28 03:58:34.280883 | instance | Create a logical volume for each loop device ---------------------------- 1.87s 2026-08-28 03:58:34.281189 | instance | Gathering Facts --------------------------------------------------------- 1.26s 2026-08-28 03:58:34.281487 | instance | Purge "snapd" package --------------------------------------------------- 0.76s 2026-08-28 03:58:34.281835 | instance | Gathering Facts --------------------------------------------------------- 0.76s 2026-08-28 03:58:34.282143 | instance | Start loop devices ------------------------------------------------------ 0.76s 2026-08-28 03:58:34.282443 | instance | Configure short hostname ------------------------------------------------ 0.73s 2026-08-28 03:58:34.282789 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.71s 2026-08-28 03:58:34.283109 | instance | Set permissions on loopback devices ------------------------------------- 0.67s 2026-08-28 03:58:34.283411 | instance | Create devices for Ceph ------------------------------------------------- 0.58s 2026-08-28 03:58:34.283707 | instance | Start up service -------------------------------------------------------- 0.57s 2026-08-28 03:58:34.284131 | instance | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-08-28 03:58:34.284441 | instance | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-08-28 03:58:34.284741 | instance | Get list of all loopback devices ---------------------------------------- 0.22s 2026-08-28 03:58:34.285097 | instance | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-08-28 03:58:34.392600 | instance | INFO [csi > prepare] Executed: Successful 2026-08-28 03:58:34.408980 | instance | INFO [csi > converge] Executing 2026-08-28 03:58:35.737923 | instance | 2026-08-28 03:58:35.738338 | instance | PLAY [Debug CSI driver value] ************************************************** 2026-08-28 03:58:35.738630 | instance | 2026-08-28 03:58:35.738962 | instance | TASK [Gathering Facts] ********************************************************* 2026-08-28 03:58:35.739259 | instance | Friday 28 August 2026 03:58:35 +0000 (0:00:00.007) 0:00:00.007 ********* 2026-08-28 03:58:36.742007 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-08-28 03:58:36.742543 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-28 03:58:36.743019 | instance | interpreter could change the meaning of that path. See 2026-08-28 03:58:36.743465 | instance | https://docs.ansible.com/ansible- 2026-08-28 03:58:36.743940 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-08-28 03:58:36.757183 | instance | ok: [instance] 2026-08-28 03:58:36.757565 | instance | 2026-08-28 03:58:36.757977 | instance | TASK [Display CSI driver value and environment variable] *********************** 2026-08-28 03:58:36.758351 | instance | Friday 28 August 2026 03:58:36 +0000 (0:00:01.019) 0:00:01.026 ********* 2026-08-28 03:58:36.818668 | instance | ok: [instance] => { 2026-08-28 03:58:36.819123 | instance | "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER=" 2026-08-28 03:58:36.819493 | instance | } 2026-08-28 03:58:36.819884 | instance | 2026-08-28 03:58:36.820313 | instance | PLAY [all] ********************************************************************* 2026-08-28 03:58:36.820681 | instance | 2026-08-28 03:58:36.821134 | instance | TASK [Gathering Facts] ********************************************************* 2026-08-28 03:58:36.821584 | instance | Friday 28 August 2026 03:58:36 +0000 (0:00:00.061) 0:00:01.088 ********* 2026-08-28 03:58:37.780385 | instance | ok: [instance] 2026-08-28 03:58:37.780708 | instance | 2026-08-28 03:58:37.781039 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-08-28 03:58:37.781331 | instance | Friday 28 August 2026 03:58:37 +0000 (0:00:00.961) 0:00:02.050 ********* 2026-08-28 03:58:37.988074 | instance | ok: [instance] 2026-08-28 03:58:37.988251 | instance | 2026-08-28 03:58:37.988391 | instance | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-28 03:58:37.988527 | instance | 2026-08-28 03:58:37.988665 | instance | TASK [Gathering Facts] ********************************************************* 2026-08-28 03:58:37.988812 | instance | Friday 28 August 2026 03:58:37 +0000 (0:00:00.206) 0:00:02.256 ********* 2026-08-28 03:58:38.950546 | instance | ok: [instance] 2026-08-28 03:58:38.950596 | instance | 2026-08-28 03:58:38.950607 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-28 03:58:38.950625 | instance | Friday 28 August 2026 03:58:38 +0000 (0:00:00.962) 0:00:03.219 ********* 2026-08-28 03:58:39.266506 | instance | ok: [instance] 2026-08-28 03:58:39.266557 | instance | 2026-08-28 03:58:39.266569 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-28 03:58:39.266578 | instance | Friday 28 August 2026 03:58:39 +0000 (0:00:00.315) 0:00:03.535 ********* 2026-08-28 03:58:39.320189 | instance | skipping: [instance] 2026-08-28 03:58:39.320258 | instance | 2026-08-28 03:58:39.320269 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-28 03:58:39.320383 | instance | Friday 28 August 2026 03:58:39 +0000 (0:00:00.054) 0:00:03.589 ********* 2026-08-28 03:58:39.660506 | instance | changed: [instance] 2026-08-28 03:58:39.660755 | instance | 2026-08-28 03:58:39.661014 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-28 03:58:39.661297 | instance | Friday 28 August 2026 03:58:39 +0000 (0:00:00.340) 0:00:03.930 ********* 2026-08-28 03:58:39.748417 | instance | ok: [instance] => { 2026-08-28 03:58:39.748452 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-28 03:58:39.748690 | instance | } 2026-08-28 03:58:39.748940 | instance | 2026-08-28 03:58:39.749181 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-28 03:58:39.749423 | instance | Friday 28 August 2026 03:58:39 +0000 (0:00:00.088) 0:00:04.018 ********* 2026-08-28 03:58:40.475534 | instance | changed: [instance] 2026-08-28 03:58:40.475804 | instance | 2026-08-28 03:58:40.476041 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-28 03:58:40.476236 | instance | Friday 28 August 2026 03:58:40 +0000 (0:00:00.727) 0:00:04.745 ********* 2026-08-28 03:58:40.539888 | instance | skipping: [instance] 2026-08-28 03:58:40.540048 | instance | 2026-08-28 03:58:40.540344 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-28 03:58:40.540538 | instance | Friday 28 August 2026 03:58:40 +0000 (0:00:00.064) 0:00:04.809 ********* 2026-08-28 03:58:40.612104 | instance | skipping: [instance] 2026-08-28 03:58:40.612326 | instance | 2026-08-28 03:58:40.612520 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-28 03:58:40.612740 | instance | Friday 28 August 2026 03:58:40 +0000 (0:00:00.069) 0:00:04.879 ********* 2026-08-28 03:58:40.823522 | instance | ok: [instance] 2026-08-28 03:58:40.823900 | instance | 2026-08-28 03:58:40.824243 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-28 03:58:40.824548 | instance | Friday 28 August 2026 03:58:40 +0000 (0:00:00.213) 0:00:05.093 ********* 2026-08-28 03:58:42.250919 | instance | ok: [instance] 2026-08-28 03:58:42.251261 | instance | 2026-08-28 03:58:42.251555 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-28 03:58:42.251865 | instance | Friday 28 August 2026 03:58:42 +0000 (0:00:01.426) 0:00:06.520 ********* 2026-08-28 03:58:42.340024 | instance | ok: [instance] => { 2026-08-28 03:58:42.340366 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-28 03:58:42.340673 | instance | } 2026-08-28 03:58:42.340964 | instance | 2026-08-28 03:58:42.341247 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-28 03:58:42.341550 | instance | Friday 28 August 2026 03:58:42 +0000 (0:00:00.089) 0:00:06.609 ********* 2026-08-28 03:58:43.225889 | instance | changed: [instance] 2026-08-28 03:58:43.226242 | instance | 2026-08-28 03:58:43.226547 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-28 03:58:43.226866 | instance | Friday 28 August 2026 03:58:43 +0000 (0:00:00.885) 0:00:07.495 ********* 2026-08-28 03:58:46.146953 | instance | changed: [instance] 2026-08-28 03:58:46.147321 | instance | 2026-08-28 03:58:46.147649 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-28 03:58:46.148046 | instance | Friday 28 August 2026 03:58:46 +0000 (0:00:02.920) 0:00:10.416 ********* 2026-08-28 03:58:46.193052 | instance | skipping: [instance] 2026-08-28 03:58:46.193330 | instance | 2026-08-28 03:58:46.193750 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-28 03:58:46.194074 | instance | Friday 28 August 2026 03:58:46 +0000 (0:00:00.044) 0:00:10.460 ********* 2026-08-28 03:58:46.236705 | instance | skipping: [instance] 2026-08-28 03:58:46.236780 | instance | 2026-08-28 03:58:46.237240 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-28 03:58:46.237484 | instance | Friday 28 August 2026 03:58:46 +0000 (0:00:00.045) 0:00:10.505 ********* 2026-08-28 03:58:46.283019 | instance | skipping: [instance] 2026-08-28 03:58:46.283394 | instance | 2026-08-28 03:58:46.283728 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-28 03:58:46.284244 | instance | Friday 28 August 2026 03:58:46 +0000 (0:00:00.044) 0:00:10.550 ********* 2026-08-28 03:58:52.656952 | instance | changed: [instance] 2026-08-28 03:58:52.657173 | instance | 2026-08-28 03:58:52.657459 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-28 03:58:52.657842 | instance | Friday 28 August 2026 03:58:52 +0000 (0:00:06.373) 0:00:16.923 ********* 2026-08-28 03:58:53.312665 | instance | changed: [instance] 2026-08-28 03:58:53.312760 | instance | 2026-08-28 03:58:53.312857 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-28 03:58:53.312969 | instance | Friday 28 August 2026 03:58:53 +0000 (0:00:00.658) 0:00:17.582 ********* 2026-08-28 03:58:54.292711 | instance | changed: [instance] => (item={'path': '/etc/containerd'}) 2026-08-28 03:58:54.294495 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-28 03:58:54.294588 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-28 03:58:54.294601 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-28 03:58:54.294612 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-28 03:58:54.294623 | instance | 2026-08-28 03:58:54.294641 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-28 03:58:54.294651 | instance | Friday 28 August 2026 03:58:54 +0000 (0:00:00.980) 0:00:18.562 ********* 2026-08-28 03:58:54.913160 | instance | changed: [instance] 2026-08-28 03:58:54.913223 | instance | 2026-08-28 03:58:54.914001 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-28 03:58:54.914049 | instance | Friday 28 August 2026 03:58:54 +0000 (0:00:00.592) 0:00:19.155 ********* 2026-08-28 03:58:54.914056 | instance | 2026-08-28 03:58:54.914063 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-28 03:58:54.914069 | instance | Friday 28 August 2026 03:58:54 +0000 (0:00:00.027) 0:00:19.183 ********* 2026-08-28 03:58:55.875180 | instance | ok: [instance] 2026-08-28 03:58:55.875905 | instance | 2026-08-28 03:58:55.875958 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-28 03:58:55.876015 | instance | Friday 28 August 2026 03:58:55 +0000 (0:00:00.961) 0:00:20.144 ********* 2026-08-28 03:58:56.373265 | instance | changed: [instance] 2026-08-28 03:58:56.374304 | instance | 2026-08-28 03:58:56.374340 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-28 03:58:56.374354 | instance | Friday 28 August 2026 03:58:56 +0000 (0:00:00.497) 0:00:20.642 ********* 2026-08-28 03:58:56.994039 | instance | changed: [instance] 2026-08-28 03:58:56.994505 | instance | 2026-08-28 03:58:56.994558 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-28 03:58:56.994566 | instance | Friday 28 August 2026 03:58:56 +0000 (0:00:00.620) 0:00:21.263 ********* 2026-08-28 03:58:57.248968 | instance | ok: [instance] 2026-08-28 03:58:57.249715 | instance | 2026-08-28 03:58:57.249783 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-28 03:58:57.249796 | instance | Friday 28 August 2026 03:58:57 +0000 (0:00:00.254) 0:00:21.518 ********* 2026-08-28 03:58:57.343564 | instance | ok: [instance] => { 2026-08-28 03:58:57.344192 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-28 03:58:57.344277 | instance | } 2026-08-28 03:58:57.344295 | instance | 2026-08-28 03:58:57.344826 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-28 03:58:57.344865 | instance | Friday 28 August 2026 03:58:57 +0000 (0:00:00.094) 0:00:21.613 ********* 2026-08-28 03:58:58.273641 | instance | changed: [instance] 2026-08-28 03:58:58.274316 | instance | 2026-08-28 03:58:58.274382 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-28 03:58:58.274395 | instance | Friday 28 August 2026 03:58:58 +0000 (0:00:00.929) 0:00:22.543 ********* 2026-08-28 03:59:02.615112 | instance | changed: [instance] 2026-08-28 03:59:02.615845 | instance | 2026-08-28 03:59:02.615905 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-28 03:59:02.615917 | instance | Friday 28 August 2026 03:59:02 +0000 (0:00:04.341) 0:00:26.884 ********* 2026-08-28 03:59:04.146617 | instance | ok: [instance] 2026-08-28 03:59:04.147340 | instance | 2026-08-28 03:59:04.147400 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-28 03:59:04.147411 | instance | Friday 28 August 2026 03:59:04 +0000 (0:00:01.531) 0:00:28.416 ********* 2026-08-28 03:59:04.514939 | instance | changed: [instance] 2026-08-28 03:59:04.515686 | instance | 2026-08-28 03:59:04.515747 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-28 03:59:04.515759 | instance | Friday 28 August 2026 03:59:04 +0000 (0:00:00.368) 0:00:28.784 ********* 2026-08-28 03:59:05.009680 | instance | changed: [instance] 2026-08-28 03:59:05.009727 | instance | 2026-08-28 03:59:05.009734 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-28 03:59:05.009741 | instance | Friday 28 August 2026 03:59:05 +0000 (0:00:00.494) 0:00:29.279 ********* 2026-08-28 03:59:05.605448 | instance | changed: [instance] => (item={'path': '/etc/docker'}) 2026-08-28 03:59:05.606668 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-28 03:59:05.606897 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-28 03:59:05.606909 | instance | 2026-08-28 03:59:05.606919 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-28 03:59:05.606929 | instance | Friday 28 August 2026 03:59:05 +0000 (0:00:00.595) 0:00:29.874 ********* 2026-08-28 03:59:06.088740 | instance | changed: [instance] 2026-08-28 03:59:06.089432 | instance | 2026-08-28 03:59:06.089506 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-28 03:59:06.089519 | instance | Friday 28 August 2026 03:59:06 +0000 (0:00:00.483) 0:00:30.358 ********* 2026-08-28 03:59:06.636696 | instance | changed: [instance] 2026-08-28 03:59:06.636763 | instance | 2026-08-28 03:59:06.637540 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-28 03:59:06.637591 | instance | Friday 28 August 2026 03:59:06 +0000 (0:00:00.520) 0:00:30.879 ********* 2026-08-28 03:59:06.637599 | instance | 2026-08-28 03:59:06.637605 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-28 03:59:06.637611 | instance | Friday 28 August 2026 03:59:06 +0000 (0:00:00.027) 0:00:30.906 ********* 2026-08-28 03:59:07.356598 | instance | ok: [instance] 2026-08-28 03:59:07.357306 | instance | 2026-08-28 03:59:07.357363 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-28 03:59:07.357409 | instance | Friday 28 August 2026 03:59:07 +0000 (0:00:00.719) 0:00:31.626 ********* 2026-08-28 03:59:08.409279 | instance | changed: [instance] 2026-08-28 03:59:08.410013 | instance | 2026-08-28 03:59:08.410045 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-28 03:59:08.410057 | instance | Friday 28 August 2026 03:59:08 +0000 (0:00:01.052) 0:00:32.678 ********* 2026-08-28 03:59:09.005121 | instance | changed: [instance] 2026-08-28 03:59:09.005234 | instance | 2026-08-28 03:59:09.005607 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-28 03:59:09.005654 | instance | Friday 28 August 2026 03:59:08 +0000 (0:00:00.596) 0:00:33.275 ********* 2026-08-28 03:59:09.073204 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-28 03:59:09.073667 | instance | 2026-08-28 03:59:09.073717 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-28 03:59:09.073725 | instance | Friday 28 August 2026 03:59:09 +0000 (0:00:00.068) 0:00:33.343 ********* 2026-08-28 03:59:14.900276 | instance | changed: [instance] 2026-08-28 03:59:14.900515 | instance | 2026-08-28 03:59:14.900774 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-28 03:59:14.901012 | instance | Friday 28 August 2026 03:59:14 +0000 (0:00:05.826) 0:00:39.169 ********* 2026-08-28 03:59:15.590935 | instance | ok: [instance] => (item=chronyd) 2026-08-28 03:59:15.591122 | instance | ok: [instance] => (item=sshd) 2026-08-28 03:59:15.591393 | instance | 2026-08-28 03:59:15.591656 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-28 03:59:15.591914 | instance | Friday 28 August 2026 03:59:15 +0000 (0:00:00.690) 0:00:39.860 ********* 2026-08-28 03:59:15.928824 | instance | changed: [instance] 2026-08-28 03:59:15.928892 | instance | 2026-08-28 03:59:15.929112 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-28 03:59:15.929225 | instance | Friday 28 August 2026 03:59:15 +0000 (0:00:00.338) 0:00:40.198 ********* 2026-08-28 03:59:16.146324 | instance | ok: [instance] 2026-08-28 03:59:16.146574 | instance | 2026-08-28 03:59:16.146784 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-28 03:59:16.147027 | instance | Friday 28 August 2026 03:59:16 +0000 (0:00:00.217) 0:00:40.415 ********* 2026-08-28 03:59:16.701628 | instance | changed: [instance] 2026-08-28 03:59:16.701847 | instance | 2026-08-28 03:59:16.702109 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-28 03:59:16.702529 | instance | Friday 28 August 2026 03:59:16 +0000 (0:00:00.555) 0:00:40.970 ********* 2026-08-28 03:59:17.077361 | instance | changed: [instance] 2026-08-28 03:59:17.077658 | instance | 2026-08-28 03:59:17.077671 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-28 03:59:17.077679 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.375) 0:00:41.346 ********* 2026-08-28 03:59:17.204624 | instance | ok: [instance] 2026-08-28 03:59:17.205455 | instance | 2026-08-28 03:59:17.205527 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-28 03:59:17.205541 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.127) 0:00:41.474 ********* 2026-08-28 03:59:17.471385 | instance | ok: [instance] => (item=instance) 2026-08-28 03:59:17.472090 | instance | 2026-08-28 03:59:17.472159 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-28 03:59:17.472167 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.266) 0:00:41.740 ********* 2026-08-28 03:59:17.535995 | instance | ok: [instance] 2026-08-28 03:59:17.536836 | instance | 2026-08-28 03:59:17.536912 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-28 03:59:17.536925 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.064) 0:00:41.805 ********* 2026-08-28 03:59:17.616380 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance 2026-08-28 03:59:17.616437 | instance | 2026-08-28 03:59:17.616664 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-08-28 03:59:17.616688 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.081) 0:00:41.886 ********* 2026-08-28 03:59:17.970823 | instance | changed: [instance] 2026-08-28 03:59:17.971525 | instance | 2026-08-28 03:59:17.971558 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-08-28 03:59:17.971571 | instance | Friday 28 August 2026 03:59:17 +0000 (0:00:00.353) 0:00:42.240 ********* 2026-08-28 03:59:18.751847 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True}) 2026-08-28 03:59:18.752087 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-08-28 03:59:18.752349 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-08-28 03:59:18.752557 | instance | 2026-08-28 03:59:18.752784 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-08-28 03:59:18.753008 | instance | Friday 28 August 2026 03:59:18 +0000 (0:00:00.781) 0:00:43.021 ********* 2026-08-28 04:00:50.441286 | instance | ok: [instance] 2026-08-28 04:00:50.441394 | instance | 2026-08-28 04:00:50.441407 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-08-28 04:00:50.441418 | instance | Friday 28 August 2026 04:00:50 +0000 (0:01:31.688) 0:02:14.710 ********* 2026-08-28 04:00:50.722143 | instance | changed: [instance] 2026-08-28 04:00:50.722351 | instance | 2026-08-28 04:00:50.722615 | instance | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-08-28 04:00:50.722850 | instance | Friday 28 August 2026 04:00:50 +0000 (0:00:00.281) 0:02:14.991 ********* 2026-08-28 04:00:50.797611 | instance | ok: [instance] 2026-08-28 04:00:50.797897 | instance | 2026-08-28 04:00:50.798225 | instance | TASK [Install Ceph host] ******************************************************* 2026-08-28 04:00:50.798604 | instance | Friday 28 August 2026 04:00:50 +0000 (0:00:00.076) 0:02:15.067 ********* 2026-08-28 04:00:50.887534 | instance | included: vexxhost.ceph.cephadm_host for instance 2026-08-28 04:00:50.887817 | instance | 2026-08-28 04:00:50.888177 | instance | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-28 04:00:50.888532 | instance | Friday 28 August 2026 04:00:50 +0000 (0:00:00.089) 0:02:15.157 ********* 2026-08-28 04:00:52.431764 | instance | ok: [instance] 2026-08-28 04:00:52.431832 | instance | 2026-08-28 04:00:52.431846 | instance | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-28 04:00:52.431857 | instance | Friday 28 August 2026 04:00:52 +0000 (0:00:01.542) 0:02:16.700 ********* 2026-08-28 04:00:52.507586 | instance | ok: [instance] => (item=instance) 2026-08-28 04:00:52.507793 | instance | 2026-08-28 04:00:52.508089 | instance | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-28 04:00:52.508340 | instance | Friday 28 August 2026 04:00:52 +0000 (0:00:00.077) 0:02:16.777 ********* 2026-08-28 04:00:52.913086 | instance | ok: [instance] 2026-08-28 04:00:52.913401 | instance | 2026-08-28 04:00:52.913632 | instance | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-28 04:00:52.913962 | instance | Friday 28 August 2026 04:00:52 +0000 (0:00:00.405) 0:02:17.182 ********* 2026-08-28 04:00:55.153529 | instance | ok: [instance] 2026-08-28 04:00:55.153575 | instance | 2026-08-28 04:00:55.153583 | instance | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-28 04:00:55.153589 | instance | Friday 28 August 2026 04:00:55 +0000 (0:00:02.240) 0:02:19.423 ********* 2026-08-28 04:01:52.922526 | instance | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: [errno 5] RADOS I/O error (error connecting to the cluster) 2026-08-28 04:01:52.923578 | instance | fatal: [instance]: FAILED! => {"changed": false, "module_stderr": "Traceback (most recent call last):\n File \"\", line 107, in \n File \"\", line 99, in _ansiballz_main\n File \"\", line 47, in invoke_module\n File \"/usr/lib/python3.10/runpy.py\", line 224, in run_module\n return _run_module_code(code, init_globals, run_name, mod_spec)\n File \"/usr/lib/python3.10/runpy.py\", line 96, in _run_module_code\n _run_code(code, mod_globals, init_globals,\n File \"/usr/lib/python3.10/runpy.py\", line 86, in _run_code\n exec(code, run_globals)\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_c34lh3hu/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 202, in \n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_c34lh3hu/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 198, in main\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_c34lh3hu/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 177, in run_module\n File \"/tmp/ansible_vexxhost.ceph.orch_apply_payload_c34lh3hu/ansible_vexxhost.ceph.orch_apply_payload.zip/ansible_collections/vexxhost/ceph/plugins/modules/orch_apply.py\", line 120, in apply_spec\nRuntimeError: Inferring config /var/lib/ceph/4837cbf8-4f90-4300-b3f6-726c9b9f89b4/mon.instance/config\n2026-08-28T04:01:52.728+0000 7f0dd22d2640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDKB5FqP8yvIiAA5HrZ3z06r7WLCT4ZbMbAUTkGVthGB8ED/+LfKvFEshA=: Malformed input [buffer:3]\n2026-08-28T04:01:52.728+0000 7f0dd22d2640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:01:52.732+0000 7f0dd22d2640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDKB5FqP8yvIiAA5HrZ3z06r7WLCT4ZbMbAUTkGVthGB8ED/+LfKvFEshA=: Malformed input [buffer:3]\n2026-08-28T04:01:52.732+0000 7f0dd22d2640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:01:52.732+0000 7f0dd22d2640 -1 auth: error parsing file /etc/ceph/ceph.keyring: error setting modifier for [client.admin] type=key val=AgDKB5FqP8yvIiAA5HrZ3z06r7WLCT4ZbMbAUTkGVthGB8ED/+LfKvFEshA=: Malformed input [buffer:3]\n2026-08-28T04:01:52.732+0000 7f0dd22d2640 -1 auth: failed to load /etc/ceph/ceph.keyring: (5) Input/output error\n2026-08-28T04:01:52.732+0000 7f0dd22d2640 -1 monclient: keyring not found\n[errno 5] RADOS I/O error (error connecting to the cluster)\n\n", "module_stdout": "", "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error", "rc": 1} 2026-08-28 04:01:52.926389 | instance | 2026-08-28 04:01:52.928057 | instance | PLAY RECAP ********************************************************************* 2026-08-28 04:01:52.928081 | instance | instance : ok=55 changed=26 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 2026-08-28 04:01:52.928088 | instance | 2026-08-28 04:01:52.928094 | instance | Friday 28 August 2026 04:01:52 +0000 (0:00:57.773) 0:03:17.196 ********* 2026-08-28 04:01:52.932075 | instance | =============================================================================== 2026-08-28 04:01:52.932126 | instance | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 91.69s 2026-08-28 04:01:52.932136 | instance | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 57.77s 2026-08-28 04:01:52.932142 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.37s 2026-08-28 04:01:52.932147 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.83s 2026-08-28 04:01:52.932153 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.34s 2026-08-28 04:01:52.932158 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.92s 2026-08-28 04:01:52.932164 | instance | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.24s 2026-08-28 04:01:52.932169 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.68s 2026-08-28 04:01:52.932190 | instance | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.54s 2026-08-28 04:01:52.932439 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.53s 2026-08-28 04:01:52.932957 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.43s 2026-08-28 04:01:52.933444 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 1.05s 2026-08-28 04:01:52.933877 | instance | Gathering Facts --------------------------------------------------------- 1.02s 2026-08-28 04:01:52.934304 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.98s 2026-08-28 04:01:52.934761 | instance | Gathering Facts --------------------------------------------------------- 0.96s 2026-08-28 04:01:52.935192 | instance | Gathering Facts --------------------------------------------------------- 0.96s 2026-08-28 04:01:52.935652 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.93s 2026-08-28 04:01:52.936122 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.89s 2026-08-28 04:01:52.936612 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.78s 2026-08-28 04:01:52.937028 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.73s 2026-08-28 04:01:53.025607 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-08-28 04:01:53.025757 | instance | ERROR [csi > converge] Executed: Failed 2026-08-28 04:01:53.025858 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-08-28 04:01:53.471973 | instance | ERROR 2026-08-28 04:01:53.472410 | instance | { 2026-08-28 04:01:53.472470 | instance | "delta": "0:04:09.631947", 2026-08-28 04:01:53.472500 | instance | "end": "2026-08-28 04:01:53.083836", 2026-08-28 04:01:53.472526 | instance | "msg": "non-zero return code", 2026-08-28 04:01:53.472551 | instance | "rc": 2, 2026-08-28 04:01:53.472576 | instance | "start": "2026-08-28 03:57:43.451889" 2026-08-28 04:01:53.472601 | instance | } failure 2026-08-28 04:01:53.479756 | 2026-08-28 04:01:53.479861 | PLAY RECAP 2026-08-28 04:01:53.479993 | instance | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-28 04:01:53.480055 | 2026-08-28 04:01:53.684675 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-28 04:01:53.687336 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main] 2026-08-28 04:01:54.631721 | 2026-08-28 04:01:54.667500 | PLAY [all] 2026-08-28 04:01:54.687262 | 2026-08-28 04:01:54.687340 | TASK [gather-host-logs : creating directory for system status] 2026-08-28 04:01:55.072437 | instance | changed 2026-08-28 04:01:55.102515 | 2026-08-28 04:01:55.102726 | TASK [gather-host-logs : Get logs for each host] 2026-08-28 04:01:55.460824 | instance | + systemd-cgls --full --all --no-pager 2026-08-28 04:01:55.475500 | instance | + ip addr 2026-08-28 04:01:55.478044 | instance | + ip route 2026-08-28 04:01:55.480096 | instance | + lsblk 2026-08-28 04:01:55.485400 | instance | + mount 2026-08-28 04:01:55.488039 | instance | + docker images 2026-08-28 04:01:55.509834 | instance | + brctl show 2026-08-28 04:01:55.511211 | instance | /bin/bash: line 8: brctl: command not found 2026-08-28 04:01:55.511504 | instance | + ps aux --sort=-%mem 2026-08-28 04:01:55.533025 | instance | + dpkg -l 2026-08-28 04:01:55.544004 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-08-28 04:01:55.544457 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-08-28 04:01:55.563851 | instance | + '[' '!' -z '' ']' 2026-08-28 04:01:55.648068 | instance | ok: Runtime: 0:00:00.106959 2026-08-28 04:01:55.657142 | 2026-08-28 04:01:55.661546 | TASK [gather-host-logs : Downloads logs to executor] 2026-08-28 04:01:56.323532 | instance | changed: 2026-08-28 04:01:56.327452 | instance | created directory /var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/logs/instance 2026-08-28 04:01:56.327495 | instance | cd+++++++++ system/ 2026-08-28 04:01:56.327520 | instance | >f+++++++++ system/brctl-show.txt 2026-08-28 04:01:56.327543 | instance | >f+++++++++ system/docker-images.txt 2026-08-28 04:01:56.327562 | instance | >f+++++++++ system/ip-addr.txt 2026-08-28 04:01:56.327584 | instance | >f+++++++++ system/ip-route.txt 2026-08-28 04:01:56.327605 | instance | >f+++++++++ system/lsblk.txt 2026-08-28 04:01:56.329120 | instance | >f+++++++++ system/mount.txt 2026-08-28 04:01:56.330145 | instance | >f+++++++++ system/packages.txt 2026-08-28 04:01:56.330203 | instance | >f+++++++++ system/ps.txt 2026-08-28 04:01:56.330287 | instance | >f+++++++++ system/systemd-cgls.txt 2026-08-28 04:01:56.351449 | 2026-08-28 04:01:56.358958 | LOOP [helm-release-status : creating directory for helm release status] 2026-08-28 04:01:56.572684 | instance | changed: "values" 2026-08-28 04:01:56.743662 | instance | changed: "releases" 2026-08-28 04:01:56.756607 | 2026-08-28 04:01:56.756815 | TASK [helm-release-status : Gather get release status for helm charts] 2026-08-28 04:01:56.982953 | instance | /bin/bash: line 3: kubectl: command not found 2026-08-28 04:01:57.301738 | instance | ok: Runtime: 0:00:00.005064 2026-08-28 04:01:57.309144 | 2026-08-28 04:01:57.309302 | TASK [helm-release-status : Downloads logs to executor] 2026-08-28 04:01:57.923218 | instance | changed: 2026-08-28 04:01:57.923392 | instance | cd+++++++++ helm/ 2026-08-28 04:01:57.923421 | instance | cd+++++++++ helm/releases/ 2026-08-28 04:01:57.923443 | instance | cd+++++++++ helm/values/ 2026-08-28 04:01:57.940119 | 2026-08-28 04:01:57.940201 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-08-28 04:01:58.162511 | instance | changed 2026-08-28 04:01:58.170614 | 2026-08-28 04:01:58.170687 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-08-28 04:01:58.469628 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-08-28 04:01:58.470751 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-08-28 04:01:58.475671 | instance | environment: line 1: kubectl: command not found 2026-08-28 04:01:58.476391 | instance | environment: line 1: kubectl: command not found 2026-08-28 04:01:58.477144 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-08-28 04:01:58.477588 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-08-28 04:01:58.479950 | instance | environment: line 1: kubectl: command not found 2026-08-28 04:01:58.481070 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-08-28 04:01:58.481688 | instance | environment: line 1: kubectl: command not found 2026-08-28 04:01:58.482325 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-08-28 04:01:58.483903 | instance | environment: line 1: kubectl: command not found 2026-08-28 04:01:58.484740 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-08-28 04:01:58.722840 | instance | ok: Runtime: 0:00:00.020667 2026-08-28 04:01:58.748115 | 2026-08-28 04:01:58.748254 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-08-28 04:01:58.966573 | instance | changed 2026-08-28 04:01:58.973665 | 2026-08-28 04:01:58.973765 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-08-28 04:01:59.199940 | instance | environment: line 5: kubectl: command not found 2026-08-28 04:01:59.200131 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-08-28 04:01:59.200537 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-08-28 04:01:59.200631 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-08-28 04:01:59.516102 | instance | ok: Runtime: 0:00:00.007571 2026-08-28 04:01:59.524626 | 2026-08-28 04:01:59.524709 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-08-28 04:02:00.024668 | instance | changed: 2026-08-28 04:02:00.025024 | instance | cd+++++++++ objects/ 2026-08-28 04:02:00.025068 | instance | cd+++++++++ objects/cluster/ 2026-08-28 04:02:00.025123 | instance | cd+++++++++ objects/namespaced/ 2026-08-28 04:02:00.038923 | 2026-08-28 04:02:00.039017 | TASK [gather-pod-logs : creating directory for pod logs] 2026-08-28 04:02:00.254806 | instance | changed 2026-08-28 04:02:00.259988 | 2026-08-28 04:02:00.260062 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-08-28 04:02:00.479985 | instance | changed 2026-08-28 04:02:00.484926 | 2026-08-28 04:02:00.485052 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-08-28 04:02:00.718581 | instance | environment: line 3: kubectl: command not found 2026-08-28 04:02:01.021695 | instance | ok: Runtime: 0:00:00.006154 2026-08-28 04:02:01.026801 | 2026-08-28 04:02:01.049157 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-08-28 04:02:01.616071 | instance | changed: 2026-08-28 04:02:01.616279 | instance | cd+++++++++ pod-logs/ 2026-08-28 04:02:01.616324 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-08-28 04:02:01.626282 | 2026-08-28 04:02:01.626350 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-08-28 04:02:01.840453 | instance | changed 2026-08-28 04:02:01.847022 | 2026-08-28 04:02:01.847091 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-08-28 04:02:02.072678 | instance | /bin/bash: line 2: kubectl: command not found 2026-08-28 04:02:02.385202 | instance | ok: Runtime: 0:00:00.050753 2026-08-28 04:02:02.392650 | 2026-08-28 04:02:02.392773 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-08-28 04:02:02.627382 | instance | /bin/bash: line 2: kubectl: command not found 2026-08-28 04:02:02.673988 | instance | ceph-mgr endpoints: 2026-08-28 04:02:03.070597 | instance | ok: Runtime: 0:00:00.052327 2026-08-28 04:02:03.082735 | 2026-08-28 04:02:03.082804 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-08-28 04:02:03.344494 | instance | /bin/bash: line 4: kubectl: command not found 2026-08-28 04:02:03.632147 | instance | ok: Runtime: 0:00:00.049794 2026-08-28 04:02:03.638173 | 2026-08-28 04:02:03.638240 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-08-28 04:02:04.150286 | instance | changed: cd+++++++++ prometheus/ 2026-08-28 04:02:04.159620 | 2026-08-28 04:02:04.159693 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-08-28 04:02:04.374206 | instance | changed 2026-08-28 04:02:04.379217 | 2026-08-28 04:02:04.379287 | TASK [gather-selenium-data : Get selenium data] 2026-08-28 04:02:04.671664 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-08-28 04:02:04.672628 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-08-28 04:02:04.916848 | instance | ERROR 2026-08-28 04:02:04.917123 | instance | { 2026-08-28 04:02:04.917170 | instance | "delta": "0:00:00.004221", 2026-08-28 04:02:04.917200 | instance | "end": "2026-08-28 04:02:04.672903", 2026-08-28 04:02:04.917230 | instance | "msg": "non-zero return code", 2026-08-28 04:02:04.917256 | instance | "rc": 1, 2026-08-28 04:02:04.917282 | instance | "start": "2026-08-28 04:02:04.668682" 2026-08-28 04:02:04.917307 | instance | } 2026-08-28 04:02:04.917341 | instance | ERROR: Ignoring Errors 2026-08-28 04:02:04.923925 | 2026-08-28 04:02:04.924016 | TASK [gather-selenium-data : Downloads logs to executor] 2026-08-28 04:02:05.422264 | instance | changed: cd+++++++++ selenium/ 2026-08-28 04:02:05.432438 | 2026-08-28 04:02:05.432509 | PLAY RECAP 2026-08-28 04:02:05.432560 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-08-28 04:02:05.432582 | 2026-08-28 04:02:05.651304 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/molecule/post.yml@main] 2026-08-28 04:02:05.668981 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-28 04:02:06.473509 | 2026-08-28 04:02:06.473960 | PLAY [all] 2026-08-28 04:02:06.488024 | 2026-08-28 04:02:06.488195 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-28 04:02:06.533766 | instance | skipping: Conditional result was False 2026-08-28 04:02:06.545075 | 2026-08-28 04:02:06.545298 | TASK [fetch-output : Set log path for single node] 2026-08-28 04:02:06.590263 | instance | ok 2026-08-28 04:02:06.597532 | 2026-08-28 04:02:06.597635 | LOOP [fetch-output : Ensure local output dirs] 2026-08-28 04:02:07.034675 | instance -> localhost | ok: "/var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/logs" 2026-08-28 04:02:07.256143 | instance -> localhost | changed: "/var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/artifacts" 2026-08-28 04:02:07.502142 | instance -> localhost | changed: "/var/lib/zuul/builds/3f4cab45b13643bb818b914ca556fb97/work/docs" 2026-08-28 04:02:07.527042 | 2026-08-28 04:02:07.527193 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-28 04:02:08.204498 | instance | changed: .d..t...... ./ 2026-08-28 04:02:08.204760 | instance | changed: All items complete 2026-08-28 04:02:08.204789 | 2026-08-28 04:02:08.670353 | instance | changed: .d..t...... ./ 2026-08-28 04:02:09.133383 | instance | changed: .d..t...... ./ 2026-08-28 04:02:09.158545 | 2026-08-28 04:02:09.158700 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-28 04:02:09.602183 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007439 2026-08-28 04:02:09.825982 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.007127 2026-08-28 04:02:09.835636 | 2026-08-28 04:02:09.835839 | PLAY [all] 2026-08-28 04:02:09.842843 | 2026-08-28 04:02:09.842912 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-28 04:02:10.282920 | instance | changed 2026-08-28 04:02:10.290540 | 2026-08-28 04:02:10.290609 | PLAY RECAP 2026-08-28 04:02:10.290673 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-28 04:02:10.290702 | 2026-08-28 04:02:10.414235 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-28 04:02:10.419431 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-28 04:02:11.004584 | 2026-08-28 04:02:11.004725 | PLAY [localhost] 2026-08-28 04:02:11.015092 | 2026-08-28 04:02:11.015167 | TASK [Generate Zuul manifest] 2026-08-28 04:02:11.037871 | localhost | ok 2026-08-28 04:02:11.056882 | 2026-08-28 04:02:11.056983 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-28 04:02:11.433504 | localhost | changed 2026-08-28 04:02:11.444992 | 2026-08-28 04:02:11.445079 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-28 04:02:11.477485 | localhost | ok 2026-08-28 04:02:11.487302 | 2026-08-28 04:02:11.487367 | TASK [Upload logs] 2026-08-28 04:02:11.511629 | localhost | ok 2026-08-28 04:02:11.568525 | 2026-08-28 04:02:11.568649 | TASK [Set zuul-log-path fact] 2026-08-28 04:02:11.591646 | localhost | ok 2026-08-28 04:02:11.604981 | 2026-08-28 04:02:11.605052 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-28 04:02:11.638144 | localhost | ok 2026-08-28 04:02:11.647960 | 2026-08-28 04:02:11.648038 | TASK [upload-logs : Create log directories] 2026-08-28 04:02:12.068325 | localhost | changed 2026-08-28 04:02:12.074912 | 2026-08-28 04:02:12.075217 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-28 04:02:12.488009 | localhost -> localhost | ok: Runtime: 0:00:00.005927 2026-08-28 04:02:12.495853 | 2026-08-28 04:02:12.495950 | TASK [upload-logs : Upload logs to log server] 2026-08-28 04:02:13.012350 | localhost | Output suppressed because no_log was given 2026-08-28 04:02:13.048667 | 2026-08-28 04:02:13.048810 | LOOP [upload-logs : Compress console log and json output] 2026-08-28 04:02:13.092853 | localhost | skipping: Conditional result was False 2026-08-28 04:02:13.100721 | localhost | skipping: Conditional result was False 2026-08-28 04:02:13.112354 | 2026-08-28 04:02:13.112451 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-28 04:02:13.154918 | localhost | skipping: Conditional result was False 2026-08-28 04:02:13.155297 | 2026-08-28 04:02:13.159077 | localhost | skipping: Conditional result was False 2026-08-28 04:02:13.175980 | 2026-08-28 04:02:13.176167 | LOOP [upload-logs : Upload console log and json output]