2026-02-09 20:50:56.639968 | Job console starting 2026-02-09 20:50:56.648765 | Updating git repos 2026-02-09 20:50:56.718472 | Cloning repos into workspace 2026-02-09 20:50:56.811467 | Restoring repo states 2026-02-09 20:50:56.829165 | Merging changes 2026-02-09 20:50:57.624319 | Checking out repos 2026-02-09 20:50:57.970307 | Preparing playbooks 2026-02-09 20:51:00.075405 | Running Ansible setup 2026-02-09 20:51:03.343847 | PRE-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main] 2026-02-09 20:51:03.939631 | 2026-02-09 20:51:03.939797 | PLAY [localhost] 2026-02-09 20:51:03.948082 | 2026-02-09 20:51:03.948159 | TASK [Gathering Facts] 2026-02-09 20:51:04.798894 | localhost | ok 2026-02-09 20:51:04.810241 | 2026-02-09 20:51:04.810336 | TASK [Setup log path fact] 2026-02-09 20:51:04.832449 | localhost | ok 2026-02-09 20:51:04.845232 | 2026-02-09 20:51:04.845310 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-09 20:51:04.874859 | localhost | ok 2026-02-09 20:51:04.883350 | 2026-02-09 20:51:04.883417 | TASK [emit-job-header : Print job information] 2026-02-09 20:51:04.924205 | # Job Information 2026-02-09 20:51:04.924437 | Ansible Version: 2.16.15 2026-02-09 20:51:04.924505 | Job: atmosphere-molecule-csi-rbd 2026-02-09 20:51:04.924553 | Pipeline: check 2026-02-09 20:51:04.924597 | Executor: 3a2793d2bd32 2026-02-09 20:51:04.924639 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3501 2026-02-09 20:51:04.924688 | Event ID: f57c5330-05f8-11f1-9f9c-98d579363b6c 2026-02-09 20:51:04.929766 | 2026-02-09 20:51:04.929860 | LOOP [emit-job-header : Print node information] 2026-02-09 20:51:05.024728 | localhost | ok: 2026-02-09 20:51:05.025557 | localhost | # Node Information 2026-02-09 20:51:05.025602 | localhost | Inventory Hostname: instance 2026-02-09 20:51:05.025631 | localhost | Hostname: np0000155140 2026-02-09 20:51:05.025657 | localhost | Username: zuul 2026-02-09 20:51:05.025690 | localhost | Distro: Ubuntu 22.04 2026-02-09 20:51:05.025716 | localhost | Provider: yul1 2026-02-09 20:51:05.025742 | localhost | Region: ca-ymq-1 2026-02-09 20:51:05.025767 | localhost | Label: ubuntu-jammy 2026-02-09 20:51:05.025792 | localhost | Product Name: OpenStack Nova 2026-02-09 20:51:05.025817 | localhost | Interface IP: 162.253.55.204 2026-02-09 20:51:05.040629 | 2026-02-09 20:51:05.040850 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-02-09 20:51:05.433245 | localhost -> localhost | changed 2026-02-09 20:51:05.443794 | 2026-02-09 20:51:05.444005 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-02-09 20:51:06.270821 | localhost -> localhost | changed 2026-02-09 20:51:06.282144 | 2026-02-09 20:51:06.282230 | PLAY [all] 2026-02-09 20:51:06.291398 | 2026-02-09 20:51:06.291510 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-02-09 20:51:06.529159 | instance -> localhost | ok 2026-02-09 20:51:06.541794 | 2026-02-09 20:51:06.541957 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-02-09 20:51:06.576766 | instance | ok 2026-02-09 20:51:06.590712 | instance | included: /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-02-09 20:51:06.596688 | 2026-02-09 20:51:06.596773 | TASK [add-build-sshkey : Create Temp SSH key] 2026-02-09 20:51:07.452842 | instance -> localhost | Generating public/private rsa key pair. 2026-02-09 20:51:07.453108 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/258462424004429a873bfbb05c04ede7_id_rsa 2026-02-09 20:51:07.453152 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/258462424004429a873bfbb05c04ede7_id_rsa.pub 2026-02-09 20:51:07.453184 | instance -> localhost | The key fingerprint is: 2026-02-09 20:51:07.453213 | instance -> localhost | SHA256:NFOIXcKSRMXRzk3plWw6h/k+zzB9w5BUINhOJ2tXcDs zuul-build-sshkey 2026-02-09 20:51:07.453261 | instance -> localhost | The key's randomart image is: 2026-02-09 20:51:07.453291 | instance -> localhost | +---[RSA 3072]----+ 2026-02-09 20:51:07.453330 | instance -> localhost | | ooB+==. =o+ | 2026-02-09 20:51:07.453361 | instance -> localhost | | + =+.++.B..| 2026-02-09 20:51:07.453389 | instance -> localhost | | .+oo++B.E | 2026-02-09 20:51:07.453416 | instance -> localhost | | . oo+O.o .| 2026-02-09 20:51:07.453443 | instance -> localhost | | S . .* | 2026-02-09 20:51:07.453470 | instance -> localhost | | +. | 2026-02-09 20:51:07.453497 | instance -> localhost | | .ooo| 2026-02-09 20:51:07.453532 | instance -> localhost | | o+o| 2026-02-09 20:51:07.453580 | instance -> localhost | | oo| 2026-02-09 20:51:07.453626 | instance -> localhost | +----[SHA256]-----+ 2026-02-09 20:51:07.453710 | instance -> localhost | ok: Runtime: 0:00:00.454352 2026-02-09 20:51:07.459638 | 2026-02-09 20:51:07.459709 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-02-09 20:51:07.495266 | instance | ok 2026-02-09 20:51:07.505677 | instance | included: /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-02-09 20:51:07.513109 | 2026-02-09 20:51:07.513168 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-02-09 20:51:07.538513 | instance | skipping: Conditional result was False 2026-02-09 20:51:07.549751 | 2026-02-09 20:51:07.549898 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-02-09 20:51:07.992340 | instance | changed 2026-02-09 20:51:07.999260 | 2026-02-09 20:51:07.999347 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-02-09 20:51:08.177157 | instance | ok 2026-02-09 20:51:08.183286 | 2026-02-09 20:51:08.183360 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-02-09 20:51:08.633501 | instance | changed 2026-02-09 20:51:08.638808 | 2026-02-09 20:51:08.638884 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-02-09 20:51:09.099410 | instance | changed 2026-02-09 20:51:09.105421 | 2026-02-09 20:51:09.105488 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-02-09 20:51:09.120447 | instance | skipping: Conditional result was False 2026-02-09 20:51:09.131051 | 2026-02-09 20:51:09.131175 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-02-09 20:51:09.538147 | instance -> localhost | changed 2026-02-09 20:51:09.552797 | 2026-02-09 20:51:09.552941 | TASK [add-build-sshkey : Add back temp key] 2026-02-09 20:51:09.829491 | instance -> localhost | Identity added: /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/258462424004429a873bfbb05c04ede7_id_rsa (zuul-build-sshkey) 2026-02-09 20:51:09.829768 | instance -> localhost | ok: Runtime: 0:00:00.015756 2026-02-09 20:51:09.836472 | 2026-02-09 20:51:09.836591 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-02-09 20:51:10.145011 | instance | ok 2026-02-09 20:51:10.153570 | 2026-02-09 20:51:10.153816 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-02-09 20:51:10.179599 | instance | skipping: Conditional result was False 2026-02-09 20:51:10.197022 | 2026-02-09 20:51:10.197160 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-02-09 20:51:10.505929 | instance | ok 2026-02-09 20:51:10.514196 | 2026-02-09 20:51:10.514269 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-02-09 20:51:12.199511 | instance | Output suppressed because no_log was given 2026-02-09 20:51:12.211522 | 2026-02-09 20:51:12.211704 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-02-09 20:51:12.398990 | instance | ok: "logs" 2026-02-09 20:51:12.399377 | instance | ok: All items complete 2026-02-09 20:51:12.399428 | 2026-02-09 20:51:12.550955 | instance | ok: "artifacts" 2026-02-09 20:51:12.697407 | instance | ok: "docs" 2026-02-09 20:51:12.718027 | 2026-02-09 20:51:12.718214 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-02-09 20:51:12.904165 | instance | changed: "logs" 2026-02-09 20:51:13.056260 | instance | changed: "artifacts" 2026-02-09 20:51:13.211429 | instance | changed: "docs" 2026-02-09 20:51:13.224897 | 2026-02-09 20:51:13.225090 | PLAY RECAP 2026-02-09 20:51:13.225162 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-02-09 20:51:13.225202 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-09 20:51:13.225235 | 2026-02-09 20:51:13.375127 | PRE-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/pre.yaml@main] 2026-02-09 20:51:13.379307 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-02-09 20:51:14.001827 | 2026-02-09 20:51:14.002613 | PLAY [all] 2026-02-09 20:51:14.014032 | 2026-02-09 20:51:14.014105 | TASK [setup-uv : Extract archive] 2026-02-09 20:51:17.266755 | instance | changed 2026-02-09 20:51:17.274593 | 2026-02-09 20:51:17.274670 | TASK [setup-uv : Print version] 2026-02-09 20:51:17.648552 | instance | uv 0.8.13 2026-02-09 20:51:17.807175 | instance | ok: Runtime: 0:00:00.008829 2026-02-09 20:51:17.813468 | 2026-02-09 20:51:17.813520 | PLAY RECAP 2026-02-09 20:51:17.813569 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-09 20:51:17.813593 | 2026-02-09 20:51:17.944053 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-02-09 20:51:17.946104 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-02-09 20:51:18.537172 | 2026-02-09 20:51:18.537405 | PLAY [all] 2026-02-09 20:51:18.549782 | 2026-02-09 20:51:18.549859 | TASK [Install "jq" for log collection] 2026-02-09 20:51:27.312690 | instance | changed 2026-02-09 20:51:27.316568 | 2026-02-09 20:51:27.316629 | PLAY RECAP 2026-02-09 20:51:27.316684 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-02-09 20:51:27.316735 | 2026-02-09 20:51:27.442143 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main] 2026-02-09 20:51:27.446518 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-02-09 20:51:28.029571 | 2026-02-09 20:51:28.029727 | PLAY [all] 2026-02-09 20:51:28.041349 | 2026-02-09 20:51:28.041421 | TASK [Copy inventory file for Zuul] 2026-02-09 20:51:28.845218 | instance | changed 2026-02-09 20:51:28.851462 | 2026-02-09 20:51:28.851548 | TASK [Switch "ansible_host" to private IP] 2026-02-09 20:51:29.128096 | instance | changed: 1 replacements made 2026-02-09 20:51:29.135452 | 2026-02-09 20:51:29.135545 | TASK [Run Molecule scenario] 2026-02-09 20:51:29.527530 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3 2026-02-09 20:51:29.527714 | instance | Creating virtual environment at: .venv 2026-02-09 20:51:29.556306 | instance | Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-02-09 20:51:29.606156 | instance | Downloading rjsonnet (1.2MiB) 2026-02-09 20:51:29.606572 | instance | Downloading ansible-core (2.1MiB) 2026-02-09 20:51:29.607170 | instance | Downloading kubernetes (1.9MiB) 2026-02-09 20:51:29.633272 | instance | Downloading openstacksdk (1.7MiB) 2026-02-09 20:51:29.633601 | instance | Downloading cryptography (4.2MiB) 2026-02-09 20:51:29.634875 | instance | Downloading netaddr (2.2MiB) 2026-02-09 20:51:29.643796 | instance | Downloading pygments (1.2MiB) 2026-02-09 20:51:29.644272 | instance | Downloading setuptools (1.1MiB) 2026-02-09 20:51:29.897054 | instance | Building pyperclip==1.9.0 2026-02-09 20:51:29.939055 | instance | Downloading rjsonnet 2026-02-09 20:51:30.067810 | instance | Downloading pygments 2026-02-09 20:51:30.070349 | instance | Downloading netaddr 2026-02-09 20:51:30.128273 | instance | Downloading setuptools 2026-02-09 20:51:30.150352 | instance | Downloading cryptography 2026-02-09 20:51:30.215307 | instance | Downloading kubernetes 2026-02-09 20:51:30.253091 | instance | Downloading ansible-core 2026-02-09 20:51:30.266926 | instance | Downloading openstacksdk 2026-02-09 20:51:30.654052 | instance | Built pyperclip==1.9.0 2026-02-09 20:51:30.893093 | instance | Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere 2026-02-09 20:51:30.956248 | instance | Installed 79 packages in 62ms 2026-02-09 20:51:31.573772 | instance | WARNING Molecule scenarios should migrate to 'extensions/molecule' 2026-02-09 20:51:32.263121 | instance | INFO [csi > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-02-09 20:51:32.263263 | instance | INFO [csi > prerun] Performing prerun with role_name_check=0... 2026-02-09 20:52:09.401469 | instance | INFO [csi > dependency] Executing 2026-02-09 20:52:09.401762 | instance | WARNING [csi > dependency] Missing roles requirements file: requirements.yml 2026-02-09 20:52:09.401997 | instance | WARNING [csi > dependency] Missing collections requirements file: collections.yml 2026-02-09 20:52:09.402141 | instance | WARNING [csi > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-02-09 20:52:09.409691 | instance | INFO [csi > cleanup] Executing 2026-02-09 20:52:09.410058 | instance | WARNING [csi > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-02-09 20:52:09.417565 | instance | INFO [csi > destroy] Executing 2026-02-09 20:52:09.417690 | instance | WARNING [csi > destroy] Skipping, '--destroy=never' requested. 2026-02-09 20:52:09.417792 | instance | INFO [csi > destroy] Executed: Successful 2026-02-09 20:52:09.425269 | instance | INFO [csi > syntax] Executing 2026-02-09 20:52:10.868748 | instance | 2026-02-09 20:52:10.868816 | instance | playbook: /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-02-09 20:52:10.932276 | instance | INFO [csi > syntax] Executed: Successful 2026-02-09 20:52:10.944267 | instance | INFO [csi > create] Executing 2026-02-09 20:52:10.946865 | instance | WARNING [csi > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-02-09 20:52:10.954392 | instance | INFO [csi > prepare] Executing 2026-02-09 20:52:11.700510 | instance | 2026-02-09 20:52:11.700570 | instance | PLAY [Prepare] ***************************************************************** 2026-02-09 20:52:11.700583 | instance | 2026-02-09 20:52:11.700592 | instance | TASK [Gathering Facts] ********************************************************* 2026-02-09 20:52:11.700602 | instance | Monday 09 February 2026 20:52:11 +0000 (0:00:00.028) 0:00:00.028 ******* 2026-02-09 20:52:12.810366 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-02-09 20:52:12.810414 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-02-09 20:52:12.810423 | instance | interpreter could change the meaning of that path. See 2026-02-09 20:52:12.810429 | instance | https://docs.ansible.com/ansible- 2026-02-09 20:52:12.810435 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-02-09 20:52:12.818820 | instance | ok: [instance] 2026-02-09 20:52:12.818840 | instance | 2026-02-09 20:52:12.818859 | instance | TASK [Configure short hostname] ************************************************ 2026-02-09 20:52:12.818864 | instance | Monday 09 February 2026 20:52:12 +0000 (0:00:01.119) 0:00:01.148 ******* 2026-02-09 20:52:13.579157 | instance | changed: [instance] 2026-02-09 20:52:13.579199 | instance | 2026-02-09 20:52:13.579205 | instance | TASK [Ensure hostname inside hosts file] *************************************** 2026-02-09 20:52:13.579209 | instance | Monday 09 February 2026 20:52:13 +0000 (0:00:00.760) 0:00:01.908 ******* 2026-02-09 20:52:13.827109 | instance | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-02-09 20:52:13.827156 | instance | with a mode of 0700, this may cause issues when running as another user. To 2026-02-09 20:52:13.827165 | instance | avoid this, create the remote_tmp dir with the correct permissions manually 2026-02-09 20:52:13.835604 | instance | changed: [instance] 2026-02-09 20:52:13.835625 | instance | 2026-02-09 20:52:13.835633 | instance | TASK [Purge "snapd" package] *************************************************** 2026-02-09 20:52:13.835639 | instance | Monday 09 February 2026 20:52:13 +0000 (0:00:00.256) 0:00:02.164 ******* 2026-02-09 20:52:14.625271 | instance | ok: [instance] 2026-02-09 20:52:14.625353 | instance | 2026-02-09 20:52:14.625359 | instance | PLAY [Create devices for Ceph] ************************************************* 2026-02-09 20:52:14.625364 | instance | 2026-02-09 20:52:14.625368 | instance | TASK [Gathering Facts] ********************************************************* 2026-02-09 20:52:14.625373 | instance | Monday 09 February 2026 20:52:14 +0000 (0:00:00.789) 0:00:02.954 ******* 2026-02-09 20:52:15.277050 | instance | ok: [instance] 2026-02-09 20:52:15.277077 | instance | 2026-02-09 20:52:15.277083 | instance | TASK [Install depedencies] ***************************************************** 2026-02-09 20:52:15.277088 | instance | Monday 09 February 2026 20:52:15 +0000 (0:00:00.652) 0:00:03.606 ******* 2026-02-09 20:52:33.865488 | instance | changed: [instance] 2026-02-09 20:52:33.865519 | instance | 2026-02-09 20:52:33.865524 | instance | TASK [Start up service] ******************************************************** 2026-02-09 20:52:33.865529 | instance | Monday 09 February 2026 20:52:33 +0000 (0:00:18.588) 0:00:22.194 ******* 2026-02-09 20:52:34.366651 | instance | ok: [instance] 2026-02-09 20:52:34.366679 | instance | 2026-02-09 20:52:34.366688 | instance | TASK [Generate lvm.conf] ******************************************************* 2026-02-09 20:52:34.366693 | instance | Monday 09 February 2026 20:52:34 +0000 (0:00:00.501) 0:00:22.696 ******* 2026-02-09 20:52:34.623112 | instance | ok: [instance] 2026-02-09 20:52:34.623138 | instance | 2026-02-09 20:52:34.623143 | instance | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-02-09 20:52:34.623148 | instance | Monday 09 February 2026 20:52:34 +0000 (0:00:00.256) 0:00:22.952 ******* 2026-02-09 20:52:35.215745 | instance | changed: [instance] 2026-02-09 20:52:35.215780 | instance | 2026-02-09 20:52:35.215788 | instance | TASK [Get list of all loopback devices] **************************************** 2026-02-09 20:52:35.215794 | instance | Monday 09 February 2026 20:52:35 +0000 (0:00:00.592) 0:00:23.544 ******* 2026-02-09 20:52:35.395660 | instance | ok: [instance] 2026-02-09 20:52:35.395689 | instance | 2026-02-09 20:52:35.395696 | instance | TASK [Fail if there is any existing loopback devices] ************************** 2026-02-09 20:52:35.395702 | instance | Monday 09 February 2026 20:52:35 +0000 (0:00:00.180) 0:00:23.725 ******* 2026-02-09 20:52:35.420938 | instance | skipping: [instance] 2026-02-09 20:52:35.420996 | instance | 2026-02-09 20:52:35.421008 | instance | TASK [Create devices for Ceph] ************************************************* 2026-02-09 20:52:35.421024 | instance | Monday 09 February 2026 20:52:35 +0000 (0:00:00.024) 0:00:23.749 ******* 2026-02-09 20:52:35.895973 | instance | changed: [instance] => (item=osd0) 2026-02-09 20:52:35.896253 | instance | changed: [instance] => (item=osd1) 2026-02-09 20:52:35.896533 | instance | changed: [instance] => (item=osd2) 2026-02-09 20:52:35.896793 | instance | 2026-02-09 20:52:35.897200 | instance | TASK [Set permissions on loopback devices] ************************************* 2026-02-09 20:52:35.897480 | instance | Monday 09 February 2026 20:52:35 +0000 (0:00:00.475) 0:00:24.225 ******* 2026-02-09 20:52:36.473657 | instance | changed: [instance] => (item=osd0) 2026-02-09 20:52:36.473829 | instance | changed: [instance] => (item=osd1) 2026-02-09 20:52:36.474006 | instance | changed: [instance] => (item=osd2) 2026-02-09 20:52:36.474174 | instance | 2026-02-09 20:52:36.474361 | instance | TASK [Start loop devices] ****************************************************** 2026-02-09 20:52:36.474529 | instance | Monday 09 February 2026 20:52:36 +0000 (0:00:00.577) 0:00:24.803 ******* 2026-02-09 20:52:37.084844 | instance | changed: [instance] => (item=osd0) 2026-02-09 20:52:37.085959 | instance | changed: [instance] => (item=osd1) 2026-02-09 20:52:37.086168 | instance | changed: [instance] => (item=osd2) 2026-02-09 20:52:37.086341 | instance | 2026-02-09 20:52:37.086521 | instance | TASK [Create a volume group for each loop device] ****************************** 2026-02-09 20:52:37.086700 | instance | Monday 09 February 2026 20:52:37 +0000 (0:00:00.611) 0:00:25.414 ******* 2026-02-09 20:52:39.713510 | instance | changed: [instance] => (item=osd0) 2026-02-09 20:52:39.713740 | instance | changed: [instance] => (item=osd1) 2026-02-09 20:52:39.714052 | instance | changed: [instance] => (item=osd2) 2026-02-09 20:52:39.714285 | instance | 2026-02-09 20:52:39.714531 | instance | TASK [Create a logical volume for each loop device] **************************** 2026-02-09 20:52:39.714775 | instance | Monday 09 February 2026 20:52:39 +0000 (0:00:02.628) 0:00:28.042 ******* 2026-02-09 20:52:41.417691 | instance | changed: [instance] => (item=ceph-instance-osd0) 2026-02-09 20:52:41.417751 | instance | changed: [instance] => (item=ceph-instance-osd1) 2026-02-09 20:52:41.417763 | instance | changed: [instance] => (item=ceph-instance-osd2) 2026-02-09 20:52:41.417773 | instance | 2026-02-09 20:52:41.417783 | instance | PLAY RECAP ********************************************************************* 2026-02-09 20:52:41.417798 | instance | instance : ok=15 changed=9 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-02-09 20:52:41.417977 | instance | 2026-02-09 20:52:41.418111 | instance | Monday 09 February 2026 20:52:41 +0000 (0:00:01.703) 0:00:29.746 ******* 2026-02-09 20:52:41.418907 | instance | =============================================================================== 2026-02-09 20:52:41.419087 | instance | Install depedencies ---------------------------------------------------- 18.59s 2026-02-09 20:52:41.419768 | instance | Create a volume group for each loop device ------------------------------ 2.63s 2026-02-09 20:52:41.419774 | instance | Create a logical volume for each loop device ---------------------------- 1.70s 2026-02-09 20:52:41.419778 | instance | Gathering Facts --------------------------------------------------------- 1.12s 2026-02-09 20:52:41.419798 | instance | Purge "snapd" package --------------------------------------------------- 0.79s 2026-02-09 20:52:41.419977 | instance | Configure short hostname ------------------------------------------------ 0.76s 2026-02-09 20:52:41.420145 | instance | Gathering Facts --------------------------------------------------------- 0.65s 2026-02-09 20:52:41.420317 | instance | Start loop devices ------------------------------------------------------ 0.61s 2026-02-09 20:52:41.420498 | instance | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.59s 2026-02-09 20:52:41.420671 | instance | Set permissions on loopback devices ------------------------------------- 0.58s 2026-02-09 20:52:41.420859 | instance | Start up service -------------------------------------------------------- 0.50s 2026-02-09 20:52:41.421029 | instance | Create devices for Ceph ------------------------------------------------- 0.48s 2026-02-09 20:52:41.421220 | instance | Generate lvm.conf ------------------------------------------------------- 0.26s 2026-02-09 20:52:41.421383 | instance | Ensure hostname inside hosts file --------------------------------------- 0.26s 2026-02-09 20:52:41.421553 | instance | Get list of all loopback devices ---------------------------------------- 0.18s 2026-02-09 20:52:41.421727 | instance | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-02-09 20:52:41.479810 | instance | INFO [csi > prepare] Executed: Successful 2026-02-09 20:52:41.486986 | instance | INFO [csi > converge] Executing 2026-02-09 20:52:42.800897 | instance | 2026-02-09 20:52:42.800954 | instance | PLAY [Debug CSI driver value] ************************************************** 2026-02-09 20:52:42.801892 | instance | 2026-02-09 20:52:42.801919 | instance | TASK [Gathering Facts] ********************************************************* 2026-02-09 20:52:42.801930 | instance | Monday 09 February 2026 20:52:42 +0000 (0:00:00.010) 0:00:00.010 ******* 2026-02-09 20:52:43.756379 | instance | [WARNING]: Platform linux on host instance is using the discovered Python 2026-02-09 20:52:43.756427 | instance | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-02-09 20:52:43.756433 | instance | interpreter could change the meaning of that path. See 2026-02-09 20:52:43.756437 | instance | https://docs.ansible.com/ansible- 2026-02-09 20:52:43.756442 | instance | core/2.17/reference_appendices/interpreter_discovery.html for more information. 2026-02-09 20:52:43.768264 | instance | ok: [instance] 2026-02-09 20:52:43.768293 | instance | 2026-02-09 20:52:43.768313 | instance | TASK [Display CSI driver value and environment variable] *********************** 2026-02-09 20:52:43.768323 | instance | Monday 09 February 2026 20:52:43 +0000 (0:00:00.967) 0:00:00.977 ******* 2026-02-09 20:52:43.813946 | instance | ok: [instance] => { 2026-02-09 20:52:43.813997 | instance | "msg": "csi_driver=rbd, MOLECULE_CSI_DRIVER=" 2026-02-09 20:52:43.814009 | instance | } 2026-02-09 20:52:43.814018 | instance | 2026-02-09 20:52:43.814028 | instance | PLAY [all] ********************************************************************* 2026-02-09 20:52:43.814037 | instance | 2026-02-09 20:52:43.814047 | instance | TASK [Gathering Facts] ********************************************************* 2026-02-09 20:52:43.814056 | instance | Monday 09 February 2026 20:52:43 +0000 (0:00:00.044) 0:00:01.022 ******* 2026-02-09 20:52:44.643140 | instance | ok: [instance] 2026-02-09 20:52:44.643167 | instance | 2026-02-09 20:52:44.643173 | instance | TASK [Set a fact with the "atmosphere_images" for other plays] ***************** 2026-02-09 20:52:44.643177 | instance | Monday 09 February 2026 20:52:44 +0000 (0:00:00.830) 0:00:01.853 ******* 2026-02-09 20:52:44.820579 | instance | ok: [instance] 2026-02-09 20:52:44.820613 | instance | 2026-02-09 20:52:44.820619 | instance | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-02-09 20:52:44.820623 | instance | 2026-02-09 20:52:44.820628 | instance | TASK [Gathering Facts] ********************************************************* 2026-02-09 20:52:44.820632 | instance | Monday 09 February 2026 20:52:44 +0000 (0:00:00.177) 0:00:02.030 ******* 2026-02-09 20:52:45.665894 | instance | ok: [instance] 2026-02-09 20:52:45.665929 | instance | 2026-02-09 20:52:45.665935 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-09 20:52:45.665940 | instance | Monday 09 February 2026 20:52:45 +0000 (0:00:00.845) 0:00:02.875 ******* 2026-02-09 20:52:45.962209 | instance | ok: [instance] 2026-02-09 20:52:45.962239 | instance | 2026-02-09 20:52:45.962245 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-09 20:52:45.962250 | instance | Monday 09 February 2026 20:52:45 +0000 (0:00:00.296) 0:00:03.172 ******* 2026-02-09 20:52:46.005002 | instance | skipping: [instance] 2026-02-09 20:52:46.005030 | instance | 2026-02-09 20:52:46.005035 | instance | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-02-09 20:52:46.005039 | instance | Monday 09 February 2026 20:52:46 +0000 (0:00:00.042) 0:00:03.215 ******* 2026-02-09 20:52:46.267086 | instance | changed: [instance] 2026-02-09 20:52:46.267119 | instance | 2026-02-09 20:52:46.267124 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-09 20:52:46.267129 | instance | Monday 09 February 2026 20:52:46 +0000 (0:00:00.261) 0:00:03.477 ******* 2026-02-09 20:52:46.340888 | instance | ok: [instance] => { 2026-02-09 20:52:46.341011 | instance | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-02-09 20:52:46.341180 | instance | } 2026-02-09 20:52:46.341336 | instance | 2026-02-09 20:52:46.341506 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-09 20:52:46.341673 | instance | Monday 09 February 2026 20:52:46 +0000 (0:00:00.074) 0:00:03.551 ******* 2026-02-09 20:52:46.983567 | instance | changed: [instance] 2026-02-09 20:52:46.983724 | instance | 2026-02-09 20:52:46.983896 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-09 20:52:46.984067 | instance | Monday 09 February 2026 20:52:46 +0000 (0:00:00.642) 0:00:04.193 ******* 2026-02-09 20:52:47.028782 | instance | skipping: [instance] 2026-02-09 20:52:47.029098 | instance | 2026-02-09 20:52:47.029389 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-09 20:52:47.029660 | instance | Monday 09 February 2026 20:52:47 +0000 (0:00:00.045) 0:00:04.238 ******* 2026-02-09 20:52:47.076929 | instance | skipping: [instance] 2026-02-09 20:52:47.077190 | instance | 2026-02-09 20:52:47.077467 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-09 20:52:47.077737 | instance | Monday 09 February 2026 20:52:47 +0000 (0:00:00.048) 0:00:04.287 ******* 2026-02-09 20:52:47.281285 | instance | ok: [instance] 2026-02-09 20:52:47.281550 | instance | 2026-02-09 20:52:47.281832 | instance | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-02-09 20:52:47.282109 | instance | Monday 09 February 2026 20:52:47 +0000 (0:00:00.204) 0:00:04.491 ******* 2026-02-09 20:52:48.338393 | instance | ok: [instance] 2026-02-09 20:52:48.338496 | instance | 2026-02-09 20:52:48.338633 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-09 20:52:48.338756 | instance | Monday 09 February 2026 20:52:48 +0000 (0:00:01.057) 0:00:05.548 ******* 2026-02-09 20:52:48.398218 | instance | ok: [instance] => { 2026-02-09 20:52:48.398655 | instance | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-02-09 20:52:48.398948 | instance | } 2026-02-09 20:52:48.399204 | instance | 2026-02-09 20:52:48.399484 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-09 20:52:48.399757 | instance | Monday 09 February 2026 20:52:48 +0000 (0:00:00.059) 0:00:05.608 ******* 2026-02-09 20:52:49.135295 | instance | changed: [instance] 2026-02-09 20:52:49.135433 | instance | 2026-02-09 20:52:49.135572 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-09 20:52:49.135697 | instance | Monday 09 February 2026 20:52:49 +0000 (0:00:00.737) 0:00:06.345 ******* 2026-02-09 20:52:51.920702 | instance | changed: [instance] 2026-02-09 20:52:51.920753 | instance | 2026-02-09 20:52:51.920765 | instance | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-02-09 20:52:51.920775 | instance | Monday 09 February 2026 20:52:51 +0000 (0:00:02.784) 0:00:09.129 ******* 2026-02-09 20:52:51.949631 | instance | skipping: [instance] 2026-02-09 20:52:51.949692 | instance | 2026-02-09 20:52:51.949977 | instance | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-02-09 20:52:51.950044 | instance | Monday 09 February 2026 20:52:51 +0000 (0:00:00.030) 0:00:09.159 ******* 2026-02-09 20:52:51.977555 | instance | skipping: [instance] 2026-02-09 20:52:51.978137 | instance | 2026-02-09 20:52:51.978161 | instance | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-02-09 20:52:51.978172 | instance | Monday 09 February 2026 20:52:51 +0000 (0:00:00.027) 0:00:09.187 ******* 2026-02-09 20:52:52.002831 | instance | skipping: [instance] 2026-02-09 20:52:52.002926 | instance | 2026-02-09 20:52:52.003252 | instance | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-02-09 20:52:52.003273 | instance | Monday 09 February 2026 20:52:52 +0000 (0:00:00.025) 0:00:09.213 ******* 2026-02-09 20:52:56.793139 | instance | changed: [instance] 2026-02-09 20:52:56.793198 | instance | 2026-02-09 20:52:56.793343 | instance | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-02-09 20:52:56.793470 | instance | Monday 09 February 2026 20:52:56 +0000 (0:00:04.790) 0:00:14.003 ******* 2026-02-09 20:52:57.267818 | instance | changed: [instance] 2026-02-09 20:52:57.268085 | instance | 2026-02-09 20:52:57.268378 | instance | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-02-09 20:52:57.268661 | instance | Monday 09 February 2026 20:52:57 +0000 (0:00:00.474) 0:00:14.477 ******* 2026-02-09 20:52:58.105227 | instance | changed: [instance] => (item={'path': '/etc/containerd'}) 2026-02-09 20:52:58.105292 | instance | changed: [instance] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-02-09 20:52:58.105305 | instance | changed: [instance] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-02-09 20:52:58.105329 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-02-09 20:52:58.105390 | instance | changed: [instance] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-02-09 20:52:58.105552 | instance | 2026-02-09 20:52:58.105716 | instance | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-02-09 20:52:58.106079 | instance | Monday 09 February 2026 20:52:58 +0000 (0:00:00.834) 0:00:15.312 ******* 2026-02-09 20:52:58.618577 | instance | changed: [instance] 2026-02-09 20:52:58.618834 | instance | 2026-02-09 20:52:58.619134 | instance | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-02-09 20:52:58.619420 | instance | Monday 09 February 2026 20:52:58 +0000 (0:00:00.499) 0:00:15.811 ******* 2026-02-09 20:52:58.619685 | instance | 2026-02-09 20:52:58.620009 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-02-09 20:52:58.620301 | instance | Monday 09 February 2026 20:52:58 +0000 (0:00:00.016) 0:00:15.828 ******* 2026-02-09 20:52:59.555507 | instance | ok: [instance] 2026-02-09 20:52:59.555547 | instance | 2026-02-09 20:52:59.555556 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-02-09 20:52:59.555562 | instance | Monday 09 February 2026 20:52:59 +0000 (0:00:00.936) 0:00:16.765 ******* 2026-02-09 20:52:59.956345 | instance | changed: [instance] 2026-02-09 20:52:59.956425 | instance | 2026-02-09 20:52:59.956707 | instance | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-02-09 20:52:59.956742 | instance | Monday 09 February 2026 20:52:59 +0000 (0:00:00.401) 0:00:17.166 ******* 2026-02-09 20:53:00.458980 | instance | changed: [instance] 2026-02-09 20:53:00.459072 | instance | 2026-02-09 20:53:00.459297 | instance | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-02-09 20:53:00.459335 | instance | Monday 09 February 2026 20:53:00 +0000 (0:00:00.502) 0:00:17.669 ******* 2026-02-09 20:53:00.645014 | instance | ok: [instance] 2026-02-09 20:53:00.645087 | instance | 2026-02-09 20:53:00.645374 | instance | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-02-09 20:53:00.645408 | instance | Monday 09 February 2026 20:53:00 +0000 (0:00:00.186) 0:00:17.855 ******* 2026-02-09 20:53:00.695767 | instance | ok: [instance] => { 2026-02-09 20:53:00.696374 | instance | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-02-09 20:53:00.696414 | instance | } 2026-02-09 20:53:00.696420 | instance | 2026-02-09 20:53:00.696424 | instance | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-02-09 20:53:00.696429 | instance | Monday 09 February 2026 20:53:00 +0000 (0:00:00.050) 0:00:17.906 ******* 2026-02-09 20:53:01.595297 | instance | changed: [instance] 2026-02-09 20:53:01.595330 | instance | 2026-02-09 20:53:01.595335 | instance | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-02-09 20:53:01.595340 | instance | Monday 09 February 2026 20:53:01 +0000 (0:00:00.899) 0:00:18.805 ******* 2026-02-09 20:53:05.948936 | instance | changed: [instance] 2026-02-09 20:53:05.948997 | instance | 2026-02-09 20:53:05.949296 | instance | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-02-09 20:53:05.949370 | instance | Monday 09 February 2026 20:53:05 +0000 (0:00:04.353) 0:00:23.159 ******* 2026-02-09 20:53:06.894228 | instance | ok: [instance] 2026-02-09 20:53:06.894322 | instance | 2026-02-09 20:53:06.894588 | instance | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-02-09 20:53:06.894603 | instance | Monday 09 February 2026 20:53:06 +0000 (0:00:00.945) 0:00:24.104 ******* 2026-02-09 20:53:07.221429 | instance | changed: [instance] 2026-02-09 20:53:07.221465 | instance | 2026-02-09 20:53:07.221471 | instance | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-02-09 20:53:07.221475 | instance | Monday 09 February 2026 20:53:07 +0000 (0:00:00.326) 0:00:24.431 ******* 2026-02-09 20:53:07.623111 | instance | changed: [instance] 2026-02-09 20:53:07.623173 | instance | 2026-02-09 20:53:07.623479 | instance | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-02-09 20:53:07.623527 | instance | Monday 09 February 2026 20:53:07 +0000 (0:00:00.402) 0:00:24.833 ******* 2026-02-09 20:53:08.128085 | instance | changed: [instance] => (item={'path': '/etc/docker'}) 2026-02-09 20:53:08.128718 | instance | changed: [instance] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-02-09 20:53:08.128753 | instance | changed: [instance] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-02-09 20:53:08.128759 | instance | 2026-02-09 20:53:08.128763 | instance | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-02-09 20:53:08.128768 | instance | Monday 09 February 2026 20:53:08 +0000 (0:00:00.504) 0:00:25.338 ******* 2026-02-09 20:53:08.511710 | instance | changed: [instance] 2026-02-09 20:53:08.511805 | instance | 2026-02-09 20:53:08.512091 | instance | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-02-09 20:53:08.512126 | instance | Monday 09 February 2026 20:53:08 +0000 (0:00:00.383) 0:00:25.722 ******* 2026-02-09 20:53:08.914982 | instance | changed: [instance] 2026-02-09 20:53:08.915078 | instance | 2026-02-09 20:53:08.915689 | instance | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-02-09 20:53:08.915724 | instance | Monday 09 February 2026 20:53:08 +0000 (0:00:00.386) 0:00:26.108 ******* 2026-02-09 20:53:08.915730 | instance | 2026-02-09 20:53:08.915734 | instance | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-02-09 20:53:08.915738 | instance | Monday 09 February 2026 20:53:08 +0000 (0:00:00.017) 0:00:26.125 ******* 2026-02-09 20:53:09.698768 | instance | ok: [instance] 2026-02-09 20:53:09.698826 | instance | 2026-02-09 20:53:09.699110 | instance | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-02-09 20:53:09.699148 | instance | Monday 09 February 2026 20:53:09 +0000 (0:00:00.783) 0:00:26.909 ******* 2026-02-09 20:53:10.755952 | instance | changed: [instance] 2026-02-09 20:53:10.756022 | instance | 2026-02-09 20:53:10.756312 | instance | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-02-09 20:53:10.756348 | instance | Monday 09 February 2026 20:53:10 +0000 (0:00:01.057) 0:00:27.966 ******* 2026-02-09 20:53:11.298895 | instance | changed: [instance] 2026-02-09 20:53:11.298925 | instance | 2026-02-09 20:53:11.298931 | instance | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-02-09 20:53:11.298935 | instance | Monday 09 February 2026 20:53:11 +0000 (0:00:00.542) 0:00:28.508 ******* 2026-02-09 20:53:11.341558 | instance | ok: [instance] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-02-09 20:53:11.342008 | instance | 2026-02-09 20:53:11.342041 | instance | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-02-09 20:53:11.342048 | instance | Monday 09 February 2026 20:53:11 +0000 (0:00:00.043) 0:00:28.551 ******* 2026-02-09 20:53:16.200189 | instance | changed: [instance] 2026-02-09 20:53:16.200251 | instance | 2026-02-09 20:53:16.200541 | instance | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-02-09 20:53:16.200576 | instance | Monday 09 February 2026 20:53:16 +0000 (0:00:04.858) 0:00:33.410 ******* 2026-02-09 20:53:16.802549 | instance | ok: [instance] => (item=chronyd) 2026-02-09 20:53:16.802584 | instance | ok: [instance] => (item=sshd) 2026-02-09 20:53:16.802590 | instance | 2026-02-09 20:53:16.802594 | instance | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-02-09 20:53:16.802599 | instance | Monday 09 February 2026 20:53:16 +0000 (0:00:00.601) 0:00:34.012 ******* 2026-02-09 20:53:17.367532 | instance | changed: [instance] 2026-02-09 20:53:17.367568 | instance | 2026-02-09 20:53:17.367574 | instance | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-02-09 20:53:17.367579 | instance | Monday 09 February 2026 20:53:17 +0000 (0:00:00.565) 0:00:34.577 ******* 2026-02-09 20:53:17.546167 | instance | ok: [instance] 2026-02-09 20:53:17.546199 | instance | 2026-02-09 20:53:17.546204 | instance | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-02-09 20:53:17.546209 | instance | Monday 09 February 2026 20:53:17 +0000 (0:00:00.178) 0:00:34.756 ******* 2026-02-09 20:53:17.952577 | instance | changed: [instance] 2026-02-09 20:53:17.952610 | instance | 2026-02-09 20:53:17.952616 | instance | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-02-09 20:53:17.952621 | instance | Monday 09 February 2026 20:53:17 +0000 (0:00:00.406) 0:00:35.162 ******* 2026-02-09 20:53:18.251506 | instance | changed: [instance] 2026-02-09 20:53:18.251537 | instance | 2026-02-09 20:53:18.251543 | instance | TASK [vexxhost.ceph.mon : Get `cephadm ls` status] ***************************** 2026-02-09 20:53:18.251548 | instance | Monday 09 February 2026 20:53:18 +0000 (0:00:00.298) 0:00:35.461 ******* 2026-02-09 20:53:19.816747 | instance | ok: [instance] 2026-02-09 20:53:19.816782 | instance | 2026-02-09 20:53:19.816788 | instance | TASK [vexxhost.ceph.mon : Parse the `cephadm ls` output] *********************** 2026-02-09 20:53:19.816793 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:01.565) 0:00:37.026 ******* 2026-02-09 20:53:19.860627 | instance | ok: [instance] 2026-02-09 20:53:19.860720 | instance | 2026-02-09 20:53:19.861033 | instance | TASK [vexxhost.ceph.mon : Assimilate existing configs in `ceph.conf`] ********** 2026-02-09 20:53:19.861050 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:00.044) 0:00:37.071 ******* 2026-02-09 20:53:19.889268 | instance | skipping: [instance] 2026-02-09 20:53:19.889767 | instance | 2026-02-09 20:53:19.889786 | instance | TASK [vexxhost.ceph.mon : Adopt monitor to cluster] **************************** 2026-02-09 20:53:19.889793 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:00.028) 0:00:37.099 ******* 2026-02-09 20:53:19.919763 | instance | skipping: [instance] 2026-02-09 20:53:19.919826 | instance | 2026-02-09 20:53:19.920112 | instance | TASK [vexxhost.ceph.mon : Adopt manager to cluster] **************************** 2026-02-09 20:53:19.920151 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:00.030) 0:00:37.130 ******* 2026-02-09 20:53:19.951181 | instance | skipping: [instance] 2026-02-09 20:53:19.951244 | instance | 2026-02-09 20:53:19.951507 | instance | TASK [vexxhost.ceph.mon : Enable "cephadm" mgr module] ************************* 2026-02-09 20:53:19.951530 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:00.031) 0:00:37.161 ******* 2026-02-09 20:53:19.981465 | instance | skipping: [instance] 2026-02-09 20:53:19.981814 | instance | 2026-02-09 20:53:19.981838 | instance | TASK [vexxhost.ceph.mon : Set orchestrator backend to "cephadm"] *************** 2026-02-09 20:53:19.981844 | instance | Monday 09 February 2026 20:53:19 +0000 (0:00:00.030) 0:00:37.191 ******* 2026-02-09 20:53:20.013097 | instance | skipping: [instance] 2026-02-09 20:53:20.013226 | instance | 2026-02-09 20:53:20.013403 | instance | TASK [vexxhost.ceph.mon : Use `cephadm` user for cephadm] ********************** 2026-02-09 20:53:20.013568 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.031) 0:00:37.223 ******* 2026-02-09 20:53:20.041715 | instance | skipping: [instance] 2026-02-09 20:53:20.041959 | instance | 2026-02-09 20:53:20.042234 | instance | TASK [vexxhost.ceph.mon : Generate "cephadm" key] ****************************** 2026-02-09 20:53:20.042492 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.028) 0:00:37.251 ******* 2026-02-09 20:53:20.076655 | instance | skipping: [instance] 2026-02-09 20:53:20.076801 | instance | 2026-02-09 20:53:20.077210 | instance | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-02-09 20:53:20.077485 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.035) 0:00:37.286 ******* 2026-02-09 20:53:20.185498 | instance | ok: [instance] 2026-02-09 20:53:20.185589 | instance | 2026-02-09 20:53:20.185719 | instance | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-02-09 20:53:20.185835 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.108) 0:00:37.395 ******* 2026-02-09 20:53:20.382268 | instance | ok: [instance] => (item=instance) 2026-02-09 20:53:20.382513 | instance | 2026-02-09 20:53:20.382784 | instance | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-02-09 20:53:20.383073 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.196) 0:00:37.592 ******* 2026-02-09 20:53:20.434004 | instance | ok: [instance] 2026-02-09 20:53:20.434264 | instance | 2026-02-09 20:53:20.434539 | instance | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-02-09 20:53:20.434831 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.051) 0:00:37.644 ******* 2026-02-09 20:53:20.493497 | instance | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for instance 2026-02-09 20:53:20.493753 | instance | 2026-02-09 20:53:20.494087 | instance | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-02-09 20:53:20.494364 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.059) 0:00:37.703 ******* 2026-02-09 20:53:20.780941 | instance | changed: [instance] 2026-02-09 20:53:20.781191 | instance | 2026-02-09 20:53:20.781466 | instance | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-02-09 20:53:20.781736 | instance | Monday 09 February 2026 20:53:20 +0000 (0:00:00.286) 0:00:37.990 ******* 2026-02-09 20:53:21.424970 | instance | changed: [instance] => (item={'option': 'mon allow pool size one', 'section': 'global', 'value': True}) 2026-02-09 20:53:21.425054 | instance | changed: [instance] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-02-09 20:53:21.425138 | instance | changed: [instance] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-02-09 20:53:21.425257 | instance | 2026-02-09 20:53:21.425374 | instance | TASK [vexxhost.ceph.mon : Run Bootstrap coomand] ******************************* 2026-02-09 20:53:21.425513 | instance | Monday 09 February 2026 20:53:21 +0000 (0:00:00.644) 0:00:38.635 ******* 2026-02-09 20:53:23.080330 | instance | fatal: [instance]: FAILED! => {"changed": false, "cmd": ["cephadm", "bootstrap", "--fsid", "4837cbf8-4f90-4300-b3f6-726c9b9f89b4", "--mon-ip", "162.253.55.204", "--cluster-network", "0.0.0.0/0", "--ssh-user", "cephadm", "--config", "/tmp/ceph_aaxcxybh.conf", "--skip-monitoring-stack"], "delta": "0:00:01.473019", "end": "2026-02-09 20:53:23.053386", "msg": "non-zero return code", "rc": 1, "start": "2026-02-09 20:53:21.580367", "stderr": "Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts.\nThe cluster CIDR network 0.0.0.0/0 is not configured locally.\nError: Failed command: /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1\nERROR: Failed command: /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1", "stderr_lines": ["Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts.", "The cluster CIDR network 0.0.0.0/0 is not configured locally.", "Error: Failed command: /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1", "ERROR: Failed command: /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1"], "stdout": "Creating directory /etc/ceph for ceph.conf\nVerifying ssh connectivity using standard pubkey authentication ...\nAdding key to cephadm@localhost authorized_keys...\nVerifying podman|docker is present...\nVerifying lvm2 is present...\nVerifying time synchronization is in place...\nUnit chrony.service is enabled and running\nRepeating the final host check...\ndocker (/usr/bin/docker) is present\nsystemctl is present\nlvcreate is present\nUnit chrony.service is enabled and running\nHost looks OK\nCluster fsid: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4\nVerifying IP 162.253.55.204 port 3300 ...\nVerifying IP 162.253.55.204 port 6789 ...\nMon IP `162.253.55.204` is in CIDR network `162.253.52.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.52.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.53.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.53.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.54.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.54.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.0/24`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.1/32`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.1/32`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.8/32`\nMon IP `162.253.55.204` is in CIDR network `162.253.55.8/32`\nMon IP `162.253.55.204` is in CIDR network `199.19.212.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.212.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.213.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.213.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.214.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.214.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.215.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.19.215.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.204.45.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.204.45.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.204.46.0/24`\nMon IP `162.253.55.204` is in CIDR network `199.204.46.0/24`\nPulling container image quay.io/ceph/ceph:v18.2.1...\nNon-zero exit code 1 from /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1\n/usr/bin/docker: stderr Error response from daemon: Head \"https://quay.io/v2/ceph/ceph/manifests/v18.2.1\": unable to decode token response: EOF\n\n\n\t***************\n\tCephadm hit an issue during cluster installation. Current cluster files will NOT BE DELETED automatically to change\n\tthis behaviour you can pass the --cleanup-on-failure. To remove this broken cluster manually please run:\n\n\t > cephadm rm-cluster --force --fsid 4837cbf8-4f90-4300-b3f6-726c9b9f89b4\n\n\tin case of any previous broken installation user must use the rm-cluster command to delete the broken cluster:\n\n\t > cephadm rm-cluster --force --zap-osds --fsid \n\n\tfor more information please refer to https://docs.ceph.com/en/latest/cephadm/operations/#purging-a-cluster\n\t***************", "stdout_lines": ["Creating directory /etc/ceph for ceph.conf", "Verifying ssh connectivity using standard pubkey authentication ...", "Adding key to cephadm@localhost authorized_keys...", "Verifying podman|docker is present...", "Verifying lvm2 is present...", "Verifying time synchronization is in place...", "Unit chrony.service is enabled and running", "Repeating the final host check...", "docker (/usr/bin/docker) is present", "systemctl is present", "lvcreate is present", "Unit chrony.service is enabled and running", "Host looks OK", "Cluster fsid: 4837cbf8-4f90-4300-b3f6-726c9b9f89b4", "Verifying IP 162.253.55.204 port 3300 ...", "Verifying IP 162.253.55.204 port 6789 ...", "Mon IP `162.253.55.204` is in CIDR network `162.253.52.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.52.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.53.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.53.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.54.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.54.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.0/24`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.1/32`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.1/32`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.8/32`", "Mon IP `162.253.55.204` is in CIDR network `162.253.55.8/32`", "Mon IP `162.253.55.204` is in CIDR network `199.19.212.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.212.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.213.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.213.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.214.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.214.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.215.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.19.215.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.204.45.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.204.45.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.204.46.0/24`", "Mon IP `162.253.55.204` is in CIDR network `199.204.46.0/24`", "Pulling container image quay.io/ceph/ceph:v18.2.1...", "Non-zero exit code 1 from /usr/bin/docker pull quay.io/ceph/ceph:v18.2.1", "/usr/bin/docker: stderr Error response from daemon: Head \"https://quay.io/v2/ceph/ceph/manifests/v18.2.1\": unable to decode token response: EOF", "", "", "\t***************", "\tCephadm hit an issue during cluster installation. Current cluster files will NOT BE DELETED automatically to change", "\tthis behaviour you can pass the --cleanup-on-failure. To remove this broken cluster manually please run:", "", "\t > cephadm rm-cluster --force --fsid 4837cbf8-4f90-4300-b3f6-726c9b9f89b4", "", "\tin case of any previous broken installation user must use the rm-cluster command to delete the broken cluster:", "", "\t > cephadm rm-cluster --force --zap-osds --fsid ", "", "\tfor more information please refer to https://docs.ceph.com/en/latest/cephadm/operations/#purging-a-cluster", "\t***************"]} 2026-02-09 20:53:23.095942 | instance | 2026-02-09 20:53:23.096102 | instance | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-02-09 20:53:23.096244 | instance | Monday 09 February 2026 20:53:23 +0000 (0:00:01.671) 0:00:40.306 ******* 2026-02-09 20:53:23.275889 | instance | changed: [instance] 2026-02-09 20:53:23.276879 | instance | 2026-02-09 20:53:23.276926 | instance | PLAY RECAP ********************************************************************* 2026-02-09 20:53:23.276934 | instance | instance : ok=50 changed=26 unreachable=0 failed=1 skipped=13 rescued=0 ignored=0 2026-02-09 20:53:23.276941 | instance | 2026-02-09 20:53:23.280495 | instance | Monday 09 February 2026 20:53:23 +0000 (0:00:00.179) 0:00:40.486 ******* 2026-02-09 20:53:23.280514 | instance | =============================================================================== 2026-02-09 20:53:23.280523 | instance | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.86s 2026-02-09 20:53:23.280531 | instance | vexxhost.containers.containerd : Install AppArmor packages -------------- 4.79s 2026-02-09 20:53:23.280539 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 4.35s 2026-02-09 20:53:23.280547 | instance | vexxhost.containers.download_artifact : Extract archive ----------------- 2.78s 2026-02-09 20:53:23.280554 | instance | vexxhost.containers.containerd : Reload systemd ------------------------- 1.72s 2026-02-09 20:53:23.280562 | instance | vexxhost.ceph.mon : Run Bootstrap coomand ------------------------------- 1.67s 2026-02-09 20:53:23.280568 | instance | vexxhost.ceph.mon : Get `cephadm ls` status ----------------------------- 1.57s 2026-02-09 20:53:23.280574 | instance | vexxhost.containers.package : Update state for tar ---------------------- 1.06s 2026-02-09 20:53:23.280579 | instance | vexxhost.containers.docker : Restart docker ----------------------------- 1.06s 2026-02-09 20:53:23.280585 | instance | Gathering Facts --------------------------------------------------------- 0.97s 2026-02-09 20:53:23.280592 | instance | vexxhost.containers.docker : Install AppArmor packages ------------------ 0.95s 2026-02-09 20:53:23.280600 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.90s 2026-02-09 20:53:23.280642 | instance | Gathering Facts --------------------------------------------------------- 0.85s 2026-02-09 20:53:23.280648 | instance | vexxhost.containers.containerd : Create folders for configuration ------- 0.83s 2026-02-09 20:53:23.280653 | instance | Gathering Facts --------------------------------------------------------- 0.83s 2026-02-09 20:53:23.280659 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.74s 2026-02-09 20:53:23.280664 | instance | vexxhost.ceph.mon : Include extra configuration values ------------------ 0.64s 2026-02-09 20:53:23.280670 | instance | vexxhost.containers.download_artifact : Download item ------------------- 0.64s 2026-02-09 20:53:23.280675 | instance | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.60s 2026-02-09 20:53:23.280681 | instance | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 0.57s 2026-02-09 20:53:23.365436 | instance | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-02-09 20:53:23.365699 | instance | ERROR [csi > converge] Executed: Failed 2026-02-09 20:53:23.365891 | instance | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.v9Wo.csi/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/atmosphere/inventory.yaml /home/zuul/src/github.com/vexxhost/atmosphere/molecule/csi/converge.yml 2026-02-09 20:53:23.807979 | instance | ERROR 2026-02-09 20:53:23.808338 | instance | { 2026-02-09 20:53:23.808374 | instance | "delta": "0:01:53.974749", 2026-02-09 20:53:23.808400 | instance | "end": "2026-02-09 20:53:23.437349", 2026-02-09 20:53:23.808421 | instance | "msg": "non-zero return code", 2026-02-09 20:53:23.808439 | instance | "rc": 2, 2026-02-09 20:53:23.808461 | instance | "start": "2026-02-09 20:51:29.462600" 2026-02-09 20:53:23.808480 | instance | } failure 2026-02-09 20:53:23.815010 | 2026-02-09 20:53:23.815169 | PLAY RECAP 2026-02-09 20:53:23.815257 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-02-09 20:53:23.815303 | 2026-02-09 20:53:23.930949 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-02-09 20:53:23.934947 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-02-09 20:53:24.564145 | 2026-02-09 20:53:24.564282 | PLAY [all] 2026-02-09 20:53:24.578411 | 2026-02-09 20:53:24.578489 | TASK [gather-host-logs : creating directory for system status] 2026-02-09 20:53:24.915893 | instance | changed 2026-02-09 20:53:24.921253 | 2026-02-09 20:53:24.921337 | TASK [gather-host-logs : Get logs for each host] 2026-02-09 20:53:25.276628 | instance | + systemd-cgls --full --all --no-pager 2026-02-09 20:53:25.285936 | instance | + ip addr 2026-02-09 20:53:25.287609 | instance | + ip route 2026-02-09 20:53:25.288995 | instance | + lsblk 2026-02-09 20:53:25.292142 | instance | + mount 2026-02-09 20:53:25.293859 | instance | + docker images 2026-02-09 20:53:25.306916 | instance | + brctl show 2026-02-09 20:53:25.307203 | instance | /bin/bash: line 8: brctl: command not found 2026-02-09 20:53:25.307417 | instance | + ps aux --sort=-%mem 2026-02-09 20:53:25.318769 | instance | + dpkg -l 2026-02-09 20:53:25.326207 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul)) 2026-02-09 20:53:25.326622 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul 2026-02-09 20:53:25.343567 | instance | + '[' '!' -z '' ']' 2026-02-09 20:53:25.458253 | instance | ok: Runtime: 0:00:00.071744 2026-02-09 20:53:25.466664 | 2026-02-09 20:53:25.466758 | TASK [gather-host-logs : Downloads logs to executor] 2026-02-09 20:53:26.080184 | instance | changed: 2026-02-09 20:53:26.080437 | instance | created directory /var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/logs/instance 2026-02-09 20:53:26.080465 | instance | cd+++++++++ system/ 2026-02-09 20:53:26.080486 | instance | >f+++++++++ system/brctl-show.txt 2026-02-09 20:53:26.080507 | instance | >f+++++++++ system/docker-images.txt 2026-02-09 20:53:26.080526 | instance | >f+++++++++ system/ip-addr.txt 2026-02-09 20:53:26.080548 | instance | >f+++++++++ system/ip-route.txt 2026-02-09 20:53:26.080569 | instance | >f+++++++++ system/lsblk.txt 2026-02-09 20:53:26.080589 | instance | >f+++++++++ system/mount.txt 2026-02-09 20:53:26.080608 | instance | >f+++++++++ system/packages.txt 2026-02-09 20:53:26.080627 | instance | >f+++++++++ system/ps.txt 2026-02-09 20:53:26.080647 | instance | >f+++++++++ system/systemd-cgls.txt 2026-02-09 20:53:26.090096 | 2026-02-09 20:53:26.090169 | LOOP [helm-release-status : creating directory for helm release status] 2026-02-09 20:53:26.279521 | instance | changed: "values" 2026-02-09 20:53:26.436397 | instance | changed: "releases" 2026-02-09 20:53:26.453780 | 2026-02-09 20:53:26.453943 | TASK [helm-release-status : Gather get release status for helm charts] 2026-02-09 20:53:26.654444 | instance | /bin/bash: line 3: kubectl: command not found 2026-02-09 20:53:26.991192 | instance | ok: Runtime: 0:00:00.005104 2026-02-09 20:53:26.998604 | 2026-02-09 20:53:26.998693 | TASK [helm-release-status : Downloads logs to executor] 2026-02-09 20:53:27.480356 | instance | changed: 2026-02-09 20:53:27.480544 | instance | cd+++++++++ helm/ 2026-02-09 20:53:27.480571 | instance | cd+++++++++ helm/releases/ 2026-02-09 20:53:27.480612 | instance | cd+++++++++ helm/values/ 2026-02-09 20:53:27.489522 | 2026-02-09 20:53:27.489586 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects] 2026-02-09 20:53:27.675536 | instance | changed 2026-02-09 20:53:27.682220 | 2026-02-09 20:53:27.682320 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects] 2026-02-09 20:53:27.886117 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-02-09 20:53:27.886183 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-02-09 20:53:27.890288 | instance | environment: line 1: kubectl: command not found 2026-02-09 20:53:27.890417 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-02-09 20:53:27.892092 | instance | environment: line 1: kubectl: command not found 2026-02-09 20:53:27.894738 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-02-09 20:53:27.894945 | instance | environment: line 1: kubectl: command not found 2026-02-09 20:53:27.895512 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-02-09 20:53:27.896891 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-02-09 20:53:27.897066 | instance | environment: line 1: kubectl: command not found 2026-02-09 20:53:27.897561 | instance | environment: line 1: kubectl: command not found 2026-02-09 20:53:27.898175 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value 2026-02-09 20:53:28.220232 | instance | ok: Runtime: 0:00:00.018545 2026-02-09 20:53:28.225437 | 2026-02-09 20:53:28.225502 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects] 2026-02-09 20:53:28.410147 | instance | changed 2026-02-09 20:53:28.416819 | 2026-02-09 20:53:28.416888 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects] 2026-02-09 20:53:28.648856 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-02-09 20:53:28.649035 | instance | environment: line 5: kubectl: command not found 2026-02-09 20:53:28.650024 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-02-09 20:53:28.650959 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value 2026-02-09 20:53:28.986139 | instance | ok: Runtime: 0:00:00.006509 2026-02-09 20:53:28.992102 | 2026-02-09 20:53:28.992168 | TASK [describe-kubernetes-objects : Downloads logs to executor] 2026-02-09 20:53:29.463771 | instance | changed: 2026-02-09 20:53:29.464054 | instance | cd+++++++++ objects/ 2026-02-09 20:53:29.464113 | instance | cd+++++++++ objects/cluster/ 2026-02-09 20:53:29.464158 | instance | cd+++++++++ objects/namespaced/ 2026-02-09 20:53:29.473619 | 2026-02-09 20:53:29.473684 | TASK [gather-pod-logs : creating directory for pod logs] 2026-02-09 20:53:29.661871 | instance | changed 2026-02-09 20:53:29.668601 | 2026-02-09 20:53:29.668691 | TASK [gather-pod-logs : creating directory for failed pod logs] 2026-02-09 20:53:29.851064 | instance | changed 2026-02-09 20:53:29.858674 | 2026-02-09 20:53:29.858748 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)] 2026-02-09 20:53:30.046476 | instance | environment: line 3: kubectl: command not found 2026-02-09 20:53:30.393648 | instance | ok: Runtime: 0:00:00.004206 2026-02-09 20:53:30.398739 | 2026-02-09 20:53:30.398804 | TASK [gather-pod-logs : Downloads pod logs to executor] 2026-02-09 20:53:30.892175 | instance | changed: 2026-02-09 20:53:30.892509 | instance | cd+++++++++ pod-logs/ 2026-02-09 20:53:30.892577 | instance | cd+++++++++ pod-logs/failed-pods/ 2026-02-09 20:53:30.902786 | 2026-02-09 20:53:30.902850 | TASK [gather-prom-metrics : creating directory for helm release descriptions] 2026-02-09 20:53:31.091996 | instance | changed 2026-02-09 20:53:31.098721 | 2026-02-09 20:53:31.098806 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces] 2026-02-09 20:53:31.301200 | instance | /bin/bash: line 2: kubectl: command not found 2026-02-09 20:53:31.635307 | instance | ok: Runtime: 0:00:00.033834 2026-02-09 20:53:31.642854 | 2026-02-09 20:53:31.642975 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr] 2026-02-09 20:53:31.837831 | instance | /bin/bash: line 2: kubectl: command not found 2026-02-09 20:53:31.860585 | instance | ceph-mgr endpoints: 2026-02-09 20:53:32.179696 | instance | ok: Runtime: 0:00:00.027913 2026-02-09 20:53:32.185397 | 2026-02-09 20:53:32.185463 | TASK [gather-prom-metrics : Get metrics from fluentd pods] 2026-02-09 20:53:32.377229 | instance | /bin/bash: line 4: kubectl: command not found 2026-02-09 20:53:32.720194 | instance | ok: Runtime: 0:00:00.033081 2026-02-09 20:53:32.726030 | 2026-02-09 20:53:32.726096 | TASK [gather-prom-metrics : Downloads logs to executor] 2026-02-09 20:53:33.195641 | instance | changed: cd+++++++++ prometheus/ 2026-02-09 20:53:33.206101 | 2026-02-09 20:53:33.206160 | TASK [gather-selenium-data : creating directory for helm release descriptions] 2026-02-09 20:53:33.398770 | instance | changed 2026-02-09 20:53:33.404351 | 2026-02-09 20:53:33.404415 | TASK [gather-selenium-data : Get selenium data] 2026-02-09 20:53:33.597954 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/. 2026-02-09 20:53:33.598615 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory 2026-02-09 20:53:33.936503 | instance | ERROR 2026-02-09 20:53:33.936749 | instance | { 2026-02-09 20:53:33.936790 | instance | "delta": "0:00:00.003652", 2026-02-09 20:53:33.936819 | instance | "end": "2026-02-09 20:53:33.598794", 2026-02-09 20:53:33.936848 | instance | "msg": "non-zero return code", 2026-02-09 20:53:33.936874 | instance | "rc": 1, 2026-02-09 20:53:33.936898 | instance | "start": "2026-02-09 20:53:33.595142" 2026-02-09 20:53:33.936922 | instance | } 2026-02-09 20:53:33.937002 | instance | ERROR: Ignoring Errors 2026-02-09 20:53:33.943590 | 2026-02-09 20:53:33.943678 | TASK [gather-selenium-data : Downloads logs to executor] 2026-02-09 20:53:34.410065 | instance | changed: cd+++++++++ selenium/ 2026-02-09 20:53:34.417825 | 2026-02-09 20:53:34.417877 | PLAY RECAP 2026-02-09 20:53:34.417924 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2026-02-09 20:53:34.417945 | 2026-02-09 20:53:34.567272 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main] 2026-02-09 20:53:34.571848 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main] 2026-02-09 20:53:35.142211 | 2026-02-09 20:53:35.142445 | PLAY [all] 2026-02-09 20:53:35.154692 | 2026-02-09 20:53:35.154771 | TASK [fetch-output : Set log path for multiple nodes] 2026-02-09 20:53:35.199676 | instance | skipping: Conditional result was False 2026-02-09 20:53:35.210695 | 2026-02-09 20:53:35.210773 | TASK [fetch-output : Set log path for single node] 2026-02-09 20:53:35.240002 | instance | ok 2026-02-09 20:53:35.244427 | 2026-02-09 20:53:35.244492 | LOOP [fetch-output : Ensure local output dirs] 2026-02-09 20:53:35.625182 | instance -> localhost | ok: "/var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/logs" 2026-02-09 20:53:35.832422 | instance -> localhost | changed: "/var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/artifacts" 2026-02-09 20:53:36.031666 | instance -> localhost | changed: "/var/lib/zuul/builds/258462424004429a873bfbb05c04ede7/work/docs" 2026-02-09 20:53:36.048095 | 2026-02-09 20:53:36.048289 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-02-09 20:53:36.639322 | instance | changed: .d..t...... ./ 2026-02-09 20:53:36.639665 | instance | changed: All items complete 2026-02-09 20:53:36.639729 | 2026-02-09 20:53:37.074275 | instance | changed: .d..t...... ./ 2026-02-09 20:53:37.520731 | instance | changed: .d..t...... ./ 2026-02-09 20:53:37.535576 | 2026-02-09 20:53:37.535753 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-02-09 20:53:37.937007 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007188 2026-02-09 20:53:38.173237 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006738 2026-02-09 20:53:38.195261 | 2026-02-09 20:53:38.195404 | PLAY [all] 2026-02-09 20:53:38.201395 | 2026-02-09 20:53:38.201462 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-02-09 20:53:38.612536 | instance | changed 2026-02-09 20:53:38.619746 | 2026-02-09 20:53:38.619796 | PLAY RECAP 2026-02-09 20:53:38.619845 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-02-09 20:53:38.619866 | 2026-02-09 20:53:38.757463 | POST-RUN END RESULT_NORMAL: [trusted : vexxhost.dev/zuul-config/playbooks/base/post.yaml@main] 2026-02-09 20:53:38.759645 | POST-RUN START: [trusted : vexxhost.dev/zuul-config/playbooks/base/post-logs.yaml@main] 2026-02-09 20:53:39.297048 | 2026-02-09 20:53:39.297768 | PLAY [localhost] 2026-02-09 20:53:39.307710 | 2026-02-09 20:53:39.307777 | TASK [Generate Zuul manifest] 2026-02-09 20:53:39.325376 | localhost | ok 2026-02-09 20:53:39.340252 | 2026-02-09 20:53:39.340329 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-02-09 20:53:39.645246 | localhost | changed 2026-02-09 20:53:39.656817 | 2026-02-09 20:53:39.656889 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-02-09 20:53:39.688266 | localhost | ok 2026-02-09 20:53:39.696633 | 2026-02-09 20:53:39.696695 | TASK [Upload logs] 2026-02-09 20:53:39.718054 | localhost | ok 2026-02-09 20:53:39.780213 | 2026-02-09 20:53:39.780378 | TASK [Set zuul-log-path fact] 2026-02-09 20:53:39.801434 | localhost | ok 2026-02-09 20:53:39.813057 | 2026-02-09 20:53:39.813122 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-02-09 20:53:39.844661 | localhost | ok 2026-02-09 20:53:39.853203 | 2026-02-09 20:53:39.853289 | TASK [upload-logs : Create log directories] 2026-02-09 20:53:40.229235 | localhost | changed 2026-02-09 20:53:40.235679 | 2026-02-09 20:53:40.235749 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-02-09 20:53:40.622817 | localhost -> localhost | ok: Runtime: 0:00:00.005749 2026-02-09 20:53:40.630199 | 2026-02-09 20:53:40.630292 | TASK [upload-logs : Upload logs to log server] 2026-02-09 20:53:41.057392 | localhost | Output suppressed because no_log was given 2026-02-09 20:53:41.063451 | 2026-02-09 20:53:41.063541 | LOOP [upload-logs : Compress console log and json output] 2026-02-09 20:53:41.108547 | localhost | skipping: Conditional result was False 2026-02-09 20:53:41.114494 | localhost | skipping: Conditional result was False 2026-02-09 20:53:41.126982 | 2026-02-09 20:53:41.127126 | LOOP [upload-logs : Upload compressed console log and json output] 2026-02-09 20:53:41.167972 | localhost | skipping: Conditional result was False 2026-02-09 20:53:41.168411 | 2026-02-09 20:53:41.170930 | localhost | skipping: Conditional result was False 2026-02-09 20:53:41.182494 | 2026-02-09 20:53:41.182634 | LOOP [upload-logs : Upload console log and json output]