2026-05-20 21:45:51.955903 | Job console starting 2026-05-20 21:45:51.982717 | Updating git repos 2026-05-20 21:45:52.004436 | Cloning repos into workspace 2026-05-20 21:45:52.049926 | Restoring repo states 2026-05-20 21:45:52.061580 | Merging changes 2026-05-20 21:45:52.346385 | Checking out repos 2026-05-20 21:45:52.378341 | Preparing playbooks 2026-05-20 21:45:53.487641 | Running Ansible setup 2026-05-20 21:45:59.589799 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-20 21:46:00.232627 | 2026-05-20 21:46:00.232770 | PLAY [localhost] 2026-05-20 21:46:00.241245 | 2026-05-20 21:46:00.241317 | TASK [Gathering Facts] 2026-05-20 21:46:01.152623 | localhost | ok 2026-05-20 21:46:01.159790 | 2026-05-20 21:46:01.159951 | TASK [Setup log path fact] 2026-05-20 21:46:01.179501 | localhost | ok 2026-05-20 21:46:01.203788 | 2026-05-20 21:46:01.290481 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-20 21:46:01.323569 | localhost | ok 2026-05-20 21:46:01.330998 | 2026-05-20 21:46:01.331072 | TASK [emit-job-header : Print job information] 2026-05-20 21:46:01.394977 | # Job Information 2026-05-20 21:46:01.395189 | Ansible Version: 2.16.18 2026-05-20 21:46:01.395236 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-05-20 21:46:01.395268 | Pipeline: check 2026-05-20 21:46:01.395298 | Executor: 2d72f0692154 2026-05-20 21:46:01.395326 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/110 2026-05-20 21:46:01.395361 | Event ID: 9a2b2d90-5494-11f1-9364-fc330ab6f27b 2026-05-20 21:46:01.399440 | 2026-05-20 21:46:01.399536 | LOOP [emit-job-header : Print node information] 2026-05-20 21:46:01.496422 | localhost | ok: 2026-05-20 21:46:01.496597 | localhost | # Node Information 2026-05-20 21:46:01.496625 | localhost | Inventory Hostname: aio 2026-05-20 21:46:01.496647 | localhost | Hostname: np0000175568 2026-05-20 21:46:01.496666 | localhost | Username: zuul 2026-05-20 21:46:01.496689 | localhost | Distro: Ubuntu 22.04 2026-05-20 21:46:01.496708 | localhost | Provider: yul1 2026-05-20 21:46:01.496728 | localhost | Region: ca-ymq-1 2026-05-20 21:46:01.496747 | localhost | Label: ubuntu-jammy 2026-05-20 21:46:01.496765 | localhost | Product Name: OpenStack Nova 2026-05-20 21:46:01.496782 | localhost | Interface IP: 199.19.213.222 2026-05-20 21:46:01.509304 | 2026-05-20 21:46:01.509623 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-05-20 21:46:01.931060 | localhost -> localhost | changed 2026-05-20 21:46:01.942004 | 2026-05-20 21:46:01.942169 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-05-20 21:46:02.878871 | localhost -> localhost | changed 2026-05-20 21:46:02.890413 | 2026-05-20 21:46:02.890482 | PLAY [all] 2026-05-20 21:46:02.898237 | 2026-05-20 21:46:02.898307 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-05-20 21:46:03.168572 | aio -> localhost | ok 2026-05-20 21:46:03.175761 | 2026-05-20 21:46:03.175836 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-05-20 21:46:03.209081 | aio | ok 2026-05-20 21:46:03.231332 | aio | included: /var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-05-20 21:46:03.241958 | 2026-05-20 21:46:03.242115 | TASK [add-build-sshkey : Create Temp SSH key] 2026-05-20 21:46:04.677179 | aio -> localhost | Generating public/private rsa key pair. 2026-05-20 21:46:04.677426 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/e18c6621d71d44918b9d781f82a56adb_id_rsa 2026-05-20 21:46:04.677467 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/e18c6621d71d44918b9d781f82a56adb_id_rsa.pub 2026-05-20 21:46:04.677493 | aio -> localhost | The key fingerprint is: 2026-05-20 21:46:04.677520 | aio -> localhost | SHA256:Y6c1Pny3gTsT+OjHwhn+jsYFFQBX/Xot5y/KxIb5Rlo zuul-build-sshkey 2026-05-20 21:46:04.677561 | aio -> localhost | The key's randomart image is: 2026-05-20 21:46:04.677585 | aio -> localhost | +---[RSA 3072]----+ 2026-05-20 21:46:04.677638 | aio -> localhost | | ..oooo | 2026-05-20 21:46:04.677669 | aio -> localhost | | . . . | 2026-05-20 21:46:04.677695 | aio -> localhost | | . . | 2026-05-20 21:46:04.677722 | aio -> localhost | | . .| 2026-05-20 21:46:04.677744 | aio -> localhost | | S +o ..| 2026-05-20 21:46:04.677770 | aio -> localhost | | . Bo=E.o +| 2026-05-20 21:46:04.677796 | aio -> localhost | | .+*@*.o= | 2026-05-20 21:46:04.677817 | aio -> localhost | | XOBo.o.| 2026-05-20 21:46:04.677844 | aio -> localhost | | oo*B+..o| 2026-05-20 21:46:04.677866 | aio -> localhost | +----[SHA256]-----+ 2026-05-20 21:46:04.677939 | aio -> localhost | ok: Runtime: 0:00:00.958407 2026-05-20 21:46:04.689521 | 2026-05-20 21:46:04.689793 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-05-20 21:46:04.724466 | aio | ok 2026-05-20 21:46:04.734949 | aio | included: /var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-05-20 21:46:04.742098 | 2026-05-20 21:46:04.742159 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-05-20 21:46:04.767135 | aio | skipping: Conditional result was False 2026-05-20 21:46:04.776443 | 2026-05-20 21:46:04.776517 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-05-20 21:46:05.498688 | aio | changed 2026-05-20 21:46:05.504074 | 2026-05-20 21:46:05.504143 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-05-20 21:46:05.712654 | aio | ok 2026-05-20 21:46:07.731252 | 2026-05-20 21:46:07.731424 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-05-20 21:46:08.288813 | aio | changed 2026-05-20 21:46:08.294361 | 2026-05-20 21:46:08.294443 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-05-20 21:46:08.758547 | aio | changed 2026-05-20 21:46:08.765135 | 2026-05-20 21:46:08.765216 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-05-20 21:46:08.790036 | aio | skipping: Conditional result was False 2026-05-20 21:46:08.795882 | 2026-05-20 21:46:08.797628 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-05-20 21:46:09.301932 | aio -> localhost | changed 2026-05-20 21:46:09.322641 | 2026-05-20 21:46:09.322984 | TASK [add-build-sshkey : Add back temp key] 2026-05-20 21:46:09.672326 | aio -> localhost | Identity added: /var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/e18c6621d71d44918b9d781f82a56adb_id_rsa (zuul-build-sshkey) 2026-05-20 21:46:09.672569 | aio -> localhost | ok: Runtime: 0:00:00.014107 2026-05-20 21:46:09.678603 | 2026-05-20 21:46:09.678675 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-05-20 21:46:10.006178 | aio | ok 2026-05-20 21:46:10.019258 | 2026-05-20 21:46:10.019408 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-05-20 21:46:10.045173 | aio | skipping: Conditional result was False 2026-05-20 21:46:10.062070 | 2026-05-20 21:46:10.062221 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-05-20 21:46:10.438857 | aio | ok 2026-05-20 21:46:10.446340 | 2026-05-20 21:46:10.446465 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-05-20 21:46:11.219440 | aio | Output suppressed because no_log was given 2026-05-20 21:46:11.276208 | 2026-05-20 21:46:11.276359 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-05-20 21:46:11.464014 | aio | ok: "logs" 2026-05-20 21:46:11.464357 | aio | ok: All items complete 2026-05-20 21:46:11.464390 | 2026-05-20 21:46:11.626782 | aio | ok: "artifacts" 2026-05-20 21:46:11.784805 | aio | ok: "docs" 2026-05-20 21:46:11.801981 | 2026-05-20 21:46:11.802138 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-05-20 21:46:11.993056 | aio | changed: "logs" 2026-05-20 21:46:12.159780 | aio | changed: "artifacts" 2026-05-20 21:46:12.321556 | aio | changed: "docs" 2026-05-20 21:46:12.342822 | 2026-05-20 21:46:12.342879 | PLAY RECAP 2026-05-20 21:46:12.342929 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-05-20 21:46:12.342958 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-20 21:46:12.342979 | 2026-05-20 21:46:12.531697 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-20 21:46:12.536616 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-20 21:46:13.156392 | 2026-05-20 21:46:13.156562 | PLAY [all] 2026-05-20 21:46:13.168424 | 2026-05-20 21:46:13.168572 | TASK [setup-uv : Extract archive] 2026-05-20 21:46:15.807105 | aio | changed 2026-05-20 21:46:15.814963 | 2026-05-20 21:46:15.815347 | TASK [setup-uv : Print version] 2026-05-20 21:46:16.544069 | aio | uv 0.8.13 2026-05-20 21:46:16.352947 | aio | ok: Runtime: 0:00:00.058160 2026-05-20 21:46:16.363693 | 2026-05-20 21:46:16.363778 | TASK [Install Ansible collection siblings] 2026-05-20 21:46:16.803939 | aio | ok: 2026-05-20 21:46:16.804155 | aio | Skipping community.general: no checked-out sibling 2026-05-20 21:46:16.804186 | aio | Skipping ansible.utils: no checked-out sibling 2026-05-20 21:46:16.804209 | aio | Skipping vexxhost.containers: no checked-out sibling 2026-05-20 21:46:16.806377 | 2026-05-20 21:46:16.806444 | PLAY RECAP 2026-05-20 21:46:16.806509 | aio | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-20 21:46:16.806540 | 2026-05-20 21:46:16.956390 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-20 21:46:16.959743 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-20 21:46:17.628068 | 2026-05-20 21:46:17.628304 | PLAY [all] 2026-05-20 21:46:17.645625 | 2026-05-20 21:46:17.645818 | TASK [Copy inventory file for Zuul] 2026-05-20 21:46:18.514564 | aio | changed 2026-05-20 21:46:18.522051 | 2026-05-20 21:46:18.522199 | TASK [Switch "ansible_host" to private IP] 2026-05-20 21:46:18.835572 | aio | changed: 1 replacements made 2026-05-20 21:46:18.841350 | 2026-05-20 21:46:18.841453 | TASK [Run Molecule scenario] 2026-05-20 21:46:20.686797 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-05-20 21:46:21.607828 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-05-20 21:46:21.784309 | aio | Using CPython 3.13.7 2026-05-20 21:46:21.784395 | aio | Creating virtual environment at: .venv 2026-05-20 21:46:22.030827 | aio | Downloading ansible-core (2.1MiB) 2026-05-20 21:46:22.031059 | aio | Downloading netaddr (2.2MiB) 2026-05-20 21:46:22.031250 | aio | Downloading cryptography (4.3MiB) 2026-05-20 21:46:22.034056 | aio | Downloading pygments (1.2MiB) 2026-05-20 21:46:22.205301 | aio | Downloading netaddr 2026-05-20 21:46:22.213561 | aio | Downloading cryptography 2026-05-20 21:46:22.268647 | aio | Downloading pygments 2026-05-20 21:46:22.407619 | aio | Downloading ansible-core 2026-05-20 21:46:22.433566 | aio | Installed 36 packages in 25ms 2026-05-20 21:46:23.565513 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-05-20 21:46:23.565594 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-05-20 21:46:24.190394 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-05-20 21:46:24.190486 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-05-20 21:46:38.285534 | aio | INFO [default > dependency] Executing 2026-05-20 21:46:38.285757 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-05-20 21:46:38.286119 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-05-20 21:46:38.286177 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-05-20 21:46:38.291495 | aio | INFO [default > cleanup] Executing 2026-05-20 21:46:38.291778 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-20 21:46:38.296837 | aio | INFO [default > destroy] Executing 2026-05-20 21:46:38.296871 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-20 21:46:38.296957 | aio | INFO [default > destroy] Executed: Successful 2026-05-20 21:46:38.302317 | aio | INFO [default > syntax] Executing 2026-05-20 21:46:39.329658 | aio | 2026-05-20 21:46:39.329956 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-05-20 21:46:39.392697 | aio | INFO [default > syntax] Executed: Successful 2026-05-20 21:46:39.398303 | aio | INFO [default > create] Executing 2026-05-20 21:46:39.401354 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-20 21:46:39.407855 | aio | INFO [default > prepare] Executing 2026-05-20 21:46:40.145541 | aio | 2026-05-20 21:46:40.145732 | aio | PLAY [Prepare] ***************************************************************** 2026-05-20 21:46:40.145932 | aio | 2026-05-20 21:46:40.146140 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:46:40.146326 | aio | Wednesday 20 May 2026 21:46:40 +0000 (0:00:00.032) 0:00:00.032 ********* 2026-05-20 21:46:41.284675 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-20 21:46:41.284899 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-20 21:46:41.285149 | aio | interpreter could change the meaning of that path. See 2026-05-20 21:46:41.285344 | aio | https://docs.ansible.com/ansible- 2026-05-20 21:46:41.285691 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-20 21:46:41.293516 | aio | ok: [aio] 2026-05-20 21:46:41.293726 | aio | 2026-05-20 21:46:41.293980 | aio | TASK [Configure short hostname] ************************************************ 2026-05-20 21:46:41.294220 | aio | Wednesday 20 May 2026 21:46:41 +0000 (0:00:01.148) 0:00:01.181 ********* 2026-05-20 21:46:41.987635 | aio | changed: [aio] 2026-05-20 21:46:41.987784 | aio | 2026-05-20 21:46:41.987960 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-05-20 21:46:41.988178 | aio | Wednesday 20 May 2026 21:46:41 +0000 (0:00:00.694) 0:00:01.875 ********* 2026-05-20 21:46:42.245789 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-05-20 21:46:42.246042 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-05-20 21:46:42.246255 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-05-20 21:46:42.253138 | aio | changed: [aio] 2026-05-20 21:46:42.253309 | aio | 2026-05-20 21:46:42.253531 | aio | TASK [Update apt cache] ******************************************************** 2026-05-20 21:46:42.253812 | aio | Wednesday 20 May 2026 21:46:42 +0000 (0:00:00.265) 0:00:02.141 ********* 2026-05-20 21:46:49.002406 | aio | changed: [aio] 2026-05-20 21:46:49.002609 | aio | 2026-05-20 21:46:49.002856 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-05-20 21:46:49.003058 | aio | 2026-05-20 21:46:49.003443 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:46:49.003658 | aio | Wednesday 20 May 2026 21:46:49 +0000 (0:00:06.749) 0:00:08.890 ********* 2026-05-20 21:46:49.699544 | aio | ok: [aio] 2026-05-20 21:46:49.699725 | aio | 2026-05-20 21:46:49.699966 | aio | TASK [Install depedencies] ***************************************************** 2026-05-20 21:46:49.700189 | aio | Wednesday 20 May 2026 21:46:49 +0000 (0:00:00.696) 0:00:09.587 ********* 2026-05-20 21:47:20.979516 | aio | changed: [aio] 2026-05-20 21:47:20.979722 | aio | 2026-05-20 21:47:20.979759 | aio | TASK [Start up service] ******************************************************** 2026-05-20 21:47:20.980076 | aio | Wednesday 20 May 2026 21:47:20 +0000 (0:00:31.280) 0:00:40.867 ********* 2026-05-20 21:47:21.546258 | aio | ok: [aio] 2026-05-20 21:47:21.546351 | aio | 2026-05-20 21:47:21.546452 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-05-20 21:47:21.546561 | aio | Wednesday 20 May 2026 21:47:21 +0000 (0:00:00.567) 0:00:41.434 ********* 2026-05-20 21:47:21.868206 | aio | ok: [aio] 2026-05-20 21:47:21.868407 | aio | 2026-05-20 21:47:21.868646 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-05-20 21:47:21.868880 | aio | Wednesday 20 May 2026 21:47:21 +0000 (0:00:00.321) 0:00:41.755 ********* 2026-05-20 21:47:22.486250 | aio | changed: [aio] 2026-05-20 21:47:22.486404 | aio | 2026-05-20 21:47:22.486621 | aio | TASK [Get list of all loopback devices] **************************************** 2026-05-20 21:47:22.486835 | aio | Wednesday 20 May 2026 21:47:22 +0000 (0:00:00.618) 0:00:42.373 ********* 2026-05-20 21:47:22.679097 | aio | ok: [aio] 2026-05-20 21:47:22.679277 | aio | 2026-05-20 21:47:22.679534 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-05-20 21:47:22.679837 | aio | Wednesday 20 May 2026 21:47:22 +0000 (0:00:00.192) 0:00:42.566 ********* 2026-05-20 21:47:22.694725 | aio | skipping: [aio] 2026-05-20 21:47:22.694961 | aio | 2026-05-20 21:47:22.695256 | aio | TASK [Create devices for Ceph] ************************************************* 2026-05-20 21:47:22.695539 | aio | Wednesday 20 May 2026 21:47:22 +0000 (0:00:00.015) 0:00:42.582 ********* 2026-05-20 21:47:23.221604 | aio | changed: [aio] => (item=osd0) 2026-05-20 21:47:23.221806 | aio | changed: [aio] => (item=osd1) 2026-05-20 21:47:23.222034 | aio | changed: [aio] => (item=osd2) 2026-05-20 21:47:23.222238 | aio | 2026-05-20 21:47:23.222463 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-05-20 21:47:23.222682 | aio | Wednesday 20 May 2026 21:47:23 +0000 (0:00:00.526) 0:00:43.109 ********* 2026-05-20 21:47:23.856399 | aio | changed: [aio] => (item=osd0) 2026-05-20 21:47:23.856607 | aio | changed: [aio] => (item=osd1) 2026-05-20 21:47:23.856819 | aio | changed: [aio] => (item=osd2) 2026-05-20 21:47:23.857012 | aio | 2026-05-20 21:47:23.857115 | aio | TASK [Start loop devices] ****************************************************** 2026-05-20 21:47:23.857206 | aio | Wednesday 20 May 2026 21:47:23 +0000 (0:00:00.634) 0:00:43.743 ********* 2026-05-20 21:47:24.569322 | aio | changed: [aio] => (item=osd0) 2026-05-20 21:47:24.569545 | aio | changed: [aio] => (item=osd1) 2026-05-20 21:47:24.569787 | aio | changed: [aio] => (item=osd2) 2026-05-20 21:47:24.569991 | aio | 2026-05-20 21:47:24.570223 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-05-20 21:47:24.570449 | aio | Wednesday 20 May 2026 21:47:24 +0000 (0:00:00.713) 0:00:44.456 ********* 2026-05-20 21:47:28.298900 | aio | changed: [aio] => (item=osd0) 2026-05-20 21:47:28.299130 | aio | changed: [aio] => (item=osd1) 2026-05-20 21:47:28.299383 | aio | changed: [aio] => (item=osd2) 2026-05-20 21:47:28.299606 | aio | 2026-05-20 21:47:28.299887 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-05-20 21:47:28.300107 | aio | Wednesday 20 May 2026 21:47:28 +0000 (0:00:03.729) 0:00:48.186 ********* 2026-05-20 21:47:30.381424 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-05-20 21:47:30.381553 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-05-20 21:47:30.381683 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-05-20 21:47:30.381830 | aio | 2026-05-20 21:47:30.381939 | aio | PLAY RECAP ********************************************************************* 2026-05-20 21:47:30.382093 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-05-20 21:47:30.382191 | aio | 2026-05-20 21:47:30.382323 | aio | 2026-05-20 21:47:30.382425 | aio | TASKS RECAP ******************************************************************** 2026-05-20 21:47:30.382548 | aio | Wednesday 20 May 2026 21:47:30 +0000 (0:00:02.082) 0:00:50.269 ********* 2026-05-20 21:47:30.382668 | aio | =============================================================================== 2026-05-20 21:47:30.382792 | aio | Install depedencies ---------------------------------------------------- 31.28s 2026-05-20 21:47:30.382908 | aio | Update apt cache -------------------------------------------------------- 6.75s 2026-05-20 21:47:30.383027 | aio | Create a volume group for each loop device ------------------------------ 3.73s 2026-05-20 21:47:30.383147 | aio | Create a logical volume for each loop device ---------------------------- 2.08s 2026-05-20 21:47:30.383289 | aio | Gathering Facts --------------------------------------------------------- 1.15s 2026-05-20 21:47:30.383408 | aio | Start loop devices ------------------------------------------------------ 0.71s 2026-05-20 21:47:30.383529 | aio | Gathering Facts --------------------------------------------------------- 0.70s 2026-05-20 21:47:30.383648 | aio | Configure short hostname ------------------------------------------------ 0.69s 2026-05-20 21:47:30.383804 | aio | Set permissions on loopback devices ------------------------------------- 0.63s 2026-05-20 21:47:30.383926 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s 2026-05-20 21:47:30.384050 | aio | Start up service -------------------------------------------------------- 0.57s 2026-05-20 21:47:30.384167 | aio | Create devices for Ceph ------------------------------------------------- 0.53s 2026-05-20 21:47:30.384286 | aio | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-05-20 21:47:30.384408 | aio | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-05-20 21:47:30.384529 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-05-20 21:47:30.384651 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-05-20 21:47:30.455664 | aio | INFO [default > prepare] Executed: Successful 2026-05-20 21:47:30.466146 | aio | INFO [default > converge] Executing 2026-05-20 21:47:31.265892 | aio | 2026-05-20 21:47:31.266107 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-20 21:47:31.266397 | aio | 2026-05-20 21:47:31.266634 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:47:31.266855 | aio | Wednesday 20 May 2026 21:47:31 +0000 (0:00:00.047) 0:00:00.047 ********* 2026-05-20 21:47:32.402279 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-20 21:47:32.402347 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-20 21:47:32.402445 | aio | interpreter could change the meaning of that path. See 2026-05-20 21:47:32.402540 | aio | https://docs.ansible.com/ansible- 2026-05-20 21:47:32.402636 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-20 21:47:32.414334 | aio | ok: [aio] 2026-05-20 21:47:32.414432 | aio | 2026-05-20 21:47:32.414571 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:47:32.414694 | aio | Wednesday 20 May 2026 21:47:32 +0000 (0:00:01.148) 0:00:01.196 ********* 2026-05-20 21:47:32.766389 | aio | ok: [aio] 2026-05-20 21:47:32.766684 | aio | 2026-05-20 21:47:32.766992 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:47:32.767268 | aio | Wednesday 20 May 2026 21:47:32 +0000 (0:00:00.351) 0:00:01.547 ********* 2026-05-20 21:47:32.805777 | aio | skipping: [aio] 2026-05-20 21:47:32.806060 | aio | 2026-05-20 21:47:32.806361 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-20 21:47:32.806663 | aio | Wednesday 20 May 2026 21:47:32 +0000 (0:00:00.039) 0:00:01.587 ********* 2026-05-20 21:47:33.126924 | aio | changed: [aio] 2026-05-20 21:47:33.126971 | aio | 2026-05-20 21:47:33.127078 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:47:33.127180 | aio | Wednesday 20 May 2026 21:47:33 +0000 (0:00:00.321) 0:00:01.908 ********* 2026-05-20 21:47:33.222391 | aio | ok: [aio] => { 2026-05-20 21:47:33.222519 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-20 21:47:33.222657 | aio | } 2026-05-20 21:47:33.222780 | aio | 2026-05-20 21:47:33.222919 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:47:33.223056 | aio | Wednesday 20 May 2026 21:47:33 +0000 (0:00:00.095) 0:00:02.004 ********* 2026-05-20 21:47:33.907930 | aio | changed: [aio] 2026-05-20 21:47:33.908169 | aio | 2026-05-20 21:47:33.908492 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:47:33.908754 | aio | Wednesday 20 May 2026 21:47:33 +0000 (0:00:00.685) 0:00:02.689 ********* 2026-05-20 21:47:33.949021 | aio | skipping: [aio] 2026-05-20 21:47:33.949198 | aio | 2026-05-20 21:47:33.949472 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:47:33.949690 | aio | Wednesday 20 May 2026 21:47:33 +0000 (0:00:00.041) 0:00:02.730 ********* 2026-05-20 21:47:33.993061 | aio | skipping: [aio] 2026-05-20 21:47:33.993247 | aio | 2026-05-20 21:47:33.993530 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:47:33.993736 | aio | Wednesday 20 May 2026 21:47:33 +0000 (0:00:00.044) 0:00:02.774 ********* 2026-05-20 21:47:34.187397 | aio | ok: [aio] 2026-05-20 21:47:34.187716 | aio | 2026-05-20 21:47:34.187969 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:47:34.188196 | aio | Wednesday 20 May 2026 21:47:34 +0000 (0:00:00.193) 0:00:02.968 ********* 2026-05-20 21:47:35.416724 | aio | ok: [aio] 2026-05-20 21:47:35.416900 | aio | 2026-05-20 21:47:35.417133 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:47:35.417421 | aio | Wednesday 20 May 2026 21:47:35 +0000 (0:00:01.229) 0:00:04.198 ********* 2026-05-20 21:47:35.510756 | aio | ok: [aio] => { 2026-05-20 21:47:35.510994 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-20 21:47:35.511227 | aio | } 2026-05-20 21:47:35.511545 | aio | 2026-05-20 21:47:35.511843 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:47:35.512073 | aio | Wednesday 20 May 2026 21:47:35 +0000 (0:00:00.093) 0:00:04.292 ********* 2026-05-20 21:47:36.273143 | aio | changed: [aio] 2026-05-20 21:47:36.273314 | aio | 2026-05-20 21:47:36.273552 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:47:36.273857 | aio | Wednesday 20 May 2026 21:47:36 +0000 (0:00:00.762) 0:00:05.054 ********* 2026-05-20 21:47:39.342357 | aio | changed: [aio] 2026-05-20 21:47:39.342675 | aio | 2026-05-20 21:47:39.342946 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-20 21:47:39.343157 | aio | Wednesday 20 May 2026 21:47:39 +0000 (0:00:03.069) 0:00:08.124 ********* 2026-05-20 21:47:39.376527 | aio | skipping: [aio] 2026-05-20 21:47:39.377032 | aio | 2026-05-20 21:47:39.377375 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-20 21:47:39.377728 | aio | Wednesday 20 May 2026 21:47:39 +0000 (0:00:00.032) 0:00:08.156 ********* 2026-05-20 21:47:39.407437 | aio | skipping: [aio] 2026-05-20 21:47:39.407605 | aio | 2026-05-20 21:47:39.407762 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-20 21:47:39.407894 | aio | Wednesday 20 May 2026 21:47:39 +0000 (0:00:00.030) 0:00:08.187 ********* 2026-05-20 21:47:39.432550 | aio | skipping: [aio] 2026-05-20 21:47:39.432672 | aio | 2026-05-20 21:47:39.432905 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-20 21:47:39.433083 | aio | Wednesday 20 May 2026 21:47:39 +0000 (0:00:00.026) 0:00:08.214 ********* 2026-05-20 21:47:45.270937 | aio | changed: [aio] 2026-05-20 21:47:45.271018 | aio | 2026-05-20 21:47:45.271080 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-20 21:47:45.271209 | aio | Wednesday 20 May 2026 21:47:45 +0000 (0:00:05.838) 0:00:14.052 ********* 2026-05-20 21:47:45.812587 | aio | changed: [aio] 2026-05-20 21:47:45.812662 | aio | 2026-05-20 21:47:45.812883 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-20 21:47:45.812928 | aio | Wednesday 20 May 2026 21:47:45 +0000 (0:00:00.541) 0:00:14.594 ********* 2026-05-20 21:47:46.718221 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-05-20 21:47:46.718391 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-20 21:47:46.718399 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-20 21:47:46.718403 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-20 21:47:46.718408 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-20 21:47:46.718412 | aio | 2026-05-20 21:47:46.718417 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-20 21:47:46.718421 | aio | Wednesday 20 May 2026 21:47:46 +0000 (0:00:00.905) 0:00:15.499 ********* 2026-05-20 21:47:47.291849 | aio | changed: [aio] 2026-05-20 21:47:47.292275 | aio | 2026-05-20 21:47:47.292405 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-20 21:47:47.292526 | aio | Wednesday 20 May 2026 21:47:47 +0000 (0:00:00.560) 0:00:16.060 ********* 2026-05-20 21:47:47.292617 | aio | 2026-05-20 21:47:47.292717 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-20 21:47:47.292807 | aio | Wednesday 20 May 2026 21:47:47 +0000 (0:00:00.007) 0:00:16.068 ********* 2026-05-20 21:47:48.228005 | aio | ok: [aio] 2026-05-20 21:47:48.228160 | aio | 2026-05-20 21:47:48.228365 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-05-20 21:47:48.228544 | aio | Wednesday 20 May 2026 21:47:48 +0000 (0:00:00.941) 0:00:17.009 ********* 2026-05-20 21:47:48.702882 | aio | changed: [aio] 2026-05-20 21:47:48.703173 | aio | 2026-05-20 21:47:48.703445 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-20 21:47:48.703826 | aio | Wednesday 20 May 2026 21:47:48 +0000 (0:00:00.474) 0:00:17.484 ********* 2026-05-20 21:47:49.265048 | aio | changed: [aio] 2026-05-20 21:47:49.265111 | aio | 2026-05-20 21:47:49.265122 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:47:49.265133 | aio | Wednesday 20 May 2026 21:47:49 +0000 (0:00:00.561) 0:00:18.045 ********* 2026-05-20 21:47:49.461280 | aio | ok: [aio] 2026-05-20 21:47:49.461344 | aio | 2026-05-20 21:47:49.461566 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:47:49.461622 | aio | Wednesday 20 May 2026 21:47:49 +0000 (0:00:00.197) 0:00:18.243 ********* 2026-05-20 21:47:49.530250 | aio | ok: [aio] => { 2026-05-20 21:47:49.530323 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-20 21:47:49.530385 | aio | } 2026-05-20 21:47:49.530671 | aio | 2026-05-20 21:47:49.530715 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:47:49.530721 | aio | Wednesday 20 May 2026 21:47:49 +0000 (0:00:00.068) 0:00:18.312 ********* 2026-05-20 21:47:50.414437 | aio | changed: [aio] 2026-05-20 21:47:50.414510 | aio | 2026-05-20 21:47:50.414568 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:47:50.414695 | aio | Wednesday 20 May 2026 21:47:50 +0000 (0:00:00.884) 0:00:19.196 ********* 2026-05-20 21:47:54.821669 | aio | changed: [aio] 2026-05-20 21:47:54.821746 | aio | 2026-05-20 21:47:54.821806 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-20 21:47:54.821935 | aio | Wednesday 20 May 2026 21:47:54 +0000 (0:00:04.407) 0:00:23.603 ********* 2026-05-20 21:47:55.933164 | aio | ok: [aio] 2026-05-20 21:47:55.933240 | aio | 2026-05-20 21:47:55.933506 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-20 21:47:55.933689 | aio | Wednesday 20 May 2026 21:47:55 +0000 (0:00:01.111) 0:00:24.714 ********* 2026-05-20 21:47:58.295667 | aio | changed: [aio] 2026-05-20 21:47:58.295768 | aio | 2026-05-20 21:47:58.296098 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-20 21:47:58.296160 | aio | Wednesday 20 May 2026 21:47:58 +0000 (0:00:02.362) 0:00:27.077 ********* 2026-05-20 21:47:58.741128 | aio | changed: [aio] 2026-05-20 21:47:58.741191 | aio | 2026-05-20 21:47:58.741436 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-20 21:47:58.741479 | aio | Wednesday 20 May 2026 21:47:58 +0000 (0:00:00.445) 0:00:27.522 ********* 2026-05-20 21:47:59.289846 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-05-20 21:47:59.289923 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-20 21:47:59.290364 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-20 21:47:59.290413 | aio | 2026-05-20 21:47:59.290421 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-20 21:47:59.290427 | aio | Wednesday 20 May 2026 21:47:59 +0000 (0:00:00.548) 0:00:28.071 ********* 2026-05-20 21:47:59.733093 | aio | changed: [aio] 2026-05-20 21:47:59.733178 | aio | 2026-05-20 21:47:59.733311 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-20 21:47:59.733470 | aio | Wednesday 20 May 2026 21:47:59 +0000 (0:00:00.443) 0:00:28.515 ********* 2026-05-20 21:48:00.171424 | aio | changed: [aio] 2026-05-20 21:48:00.171536 | aio | 2026-05-20 21:48:00.171564 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-20 21:48:00.171849 | aio | Wednesday 20 May 2026 21:48:00 +0000 (0:00:00.428) 0:00:28.943 ********* 2026-05-20 21:48:00.171932 | aio | 2026-05-20 21:48:00.171953 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-20 21:48:00.171990 | aio | Wednesday 20 May 2026 21:48:00 +0000 (0:00:00.009) 0:00:28.953 ********* 2026-05-20 21:48:00.848164 | aio | ok: [aio] 2026-05-20 21:48:00.848221 | aio | 2026-05-20 21:48:00.848435 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-05-20 21:48:00.848478 | aio | Wednesday 20 May 2026 21:48:00 +0000 (0:00:00.676) 0:00:29.630 ********* 2026-05-20 21:48:07.770095 | aio | changed: [aio] 2026-05-20 21:48:07.770174 | aio | 2026-05-20 21:48:07.770239 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-20 21:48:07.770359 | aio | Wednesday 20 May 2026 21:48:07 +0000 (0:00:06.922) 0:00:36.552 ********* 2026-05-20 21:48:08.307925 | aio | changed: [aio] 2026-05-20 21:48:08.307997 | aio | 2026-05-20 21:48:08.308372 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-20 21:48:08.308428 | aio | Wednesday 20 May 2026 21:48:08 +0000 (0:00:00.537) 0:00:37.089 ********* 2026-05-20 21:48:08.357147 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-20 21:48:08.357216 | aio | 2026-05-20 21:48:08.357546 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-20 21:48:08.357589 | aio | Wednesday 20 May 2026 21:48:08 +0000 (0:00:00.049) 0:00:37.138 ********* 2026-05-20 21:48:13.884658 | aio | changed: [aio] 2026-05-20 21:48:13.884708 | aio | 2026-05-20 21:48:13.884713 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-20 21:48:13.884718 | aio | Wednesday 20 May 2026 21:48:13 +0000 (0:00:05.527) 0:00:42.666 ********* 2026-05-20 21:48:14.508920 | aio | ok: [aio] => (item=chronyd) 2026-05-20 21:48:14.508989 | aio | ok: [aio] => (item=sshd) 2026-05-20 21:48:14.509064 | aio | 2026-05-20 21:48:14.509298 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-20 21:48:14.509342 | aio | Wednesday 20 May 2026 21:48:14 +0000 (0:00:00.624) 0:00:43.290 ********* 2026-05-20 21:48:14.807228 | aio | changed: [aio] 2026-05-20 21:48:14.807311 | aio | 2026-05-20 21:48:14.807563 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-20 21:48:14.807607 | aio | Wednesday 20 May 2026 21:48:14 +0000 (0:00:00.298) 0:00:43.589 ********* 2026-05-20 21:48:15.005862 | aio | ok: [aio] 2026-05-20 21:48:15.005927 | aio | 2026-05-20 21:48:15.006269 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-20 21:48:15.006314 | aio | Wednesday 20 May 2026 21:48:15 +0000 (0:00:00.198) 0:00:43.787 ********* 2026-05-20 21:48:15.475775 | aio | changed: [aio] 2026-05-20 21:48:15.475821 | aio | 2026-05-20 21:48:15.475827 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-20 21:48:15.475832 | aio | Wednesday 20 May 2026 21:48:15 +0000 (0:00:00.469) 0:00:44.257 ********* 2026-05-20 21:48:15.817419 | aio | changed: [aio] 2026-05-20 21:48:15.817479 | aio | 2026-05-20 21:48:15.817569 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-20 21:48:15.817707 | aio | Wednesday 20 May 2026 21:48:15 +0000 (0:00:00.342) 0:00:44.599 ********* 2026-05-20 21:48:15.964607 | aio | ok: [aio] 2026-05-20 21:48:15.964673 | aio | 2026-05-20 21:48:15.964747 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-20 21:48:15.964880 | aio | Wednesday 20 May 2026 21:48:15 +0000 (0:00:00.147) 0:00:44.746 ********* 2026-05-20 21:48:16.180503 | aio | ok: [aio] => (item=aio) 2026-05-20 21:48:16.180907 | aio | 2026-05-20 21:48:16.180959 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-20 21:48:16.180966 | aio | Wednesday 20 May 2026 21:48:16 +0000 (0:00:00.215) 0:00:44.962 ********* 2026-05-20 21:48:16.223838 | aio | ok: [aio] 2026-05-20 21:48:16.223896 | aio | 2026-05-20 21:48:16.224162 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-20 21:48:16.224198 | aio | Wednesday 20 May 2026 21:48:16 +0000 (0:00:00.043) 0:00:45.005 ********* 2026-05-20 21:48:16.322185 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-05-20 21:48:16.322259 | aio | 2026-05-20 21:48:16.322483 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-05-20 21:48:16.322531 | aio | Wednesday 20 May 2026 21:48:16 +0000 (0:00:00.098) 0:00:45.104 ********* 2026-05-20 21:48:16.599285 | aio | changed: [aio] 2026-05-20 21:48:16.599353 | aio | 2026-05-20 21:48:16.599453 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-05-20 21:48:16.599594 | aio | Wednesday 20 May 2026 21:48:16 +0000 (0:00:00.277) 0:00:45.381 ********* 2026-05-20 21:48:17.271483 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-05-20 21:48:17.271565 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-05-20 21:48:17.271625 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-05-20 21:48:17.271745 | aio | 2026-05-20 21:48:17.271854 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-05-20 21:48:17.271947 | aio | Wednesday 20 May 2026 21:48:17 +0000 (0:00:00.672) 0:00:46.053 ********* 2026-05-20 21:50:41.499939 | aio | ok: [aio] 2026-05-20 21:50:41.500103 | aio | 2026-05-20 21:50:41.500314 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-05-20 21:50:41.500502 | aio | Wednesday 20 May 2026 21:50:41 +0000 (0:02:24.228) 0:03:10.281 ********* 2026-05-20 21:50:41.714020 | aio | changed: [aio] 2026-05-20 21:50:41.714080 | aio | 2026-05-20 21:50:41.714229 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-05-20 21:50:41.714369 | aio | Wednesday 20 May 2026 21:50:41 +0000 (0:00:00.213) 0:03:10.495 ********* 2026-05-20 21:50:41.755008 | aio | ok: [aio] 2026-05-20 21:50:41.755124 | aio | 2026-05-20 21:50:41.755770 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:50:41.755836 | aio | Wednesday 20 May 2026 21:50:41 +0000 (0:00:00.041) 0:03:10.536 ********* 2026-05-20 21:50:41.821105 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:50:41.821242 | aio | 2026-05-20 21:50:41.821249 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:50:41.821254 | aio | Wednesday 20 May 2026 21:50:41 +0000 (0:00:00.065) 0:03:10.601 ********* 2026-05-20 21:50:47.471815 | aio | ok: [aio] 2026-05-20 21:50:47.471908 | aio | 2026-05-20 21:50:47.471993 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:50:47.472224 | aio | Wednesday 20 May 2026 21:50:47 +0000 (0:00:05.650) 0:03:16.252 ********* 2026-05-20 21:50:47.519363 | aio | ok: [aio] => (item=aio) 2026-05-20 21:50:47.519475 | aio | 2026-05-20 21:50:47.519494 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:50:47.519621 | aio | Wednesday 20 May 2026 21:50:47 +0000 (0:00:00.048) 0:03:16.301 ********* 2026-05-20 21:50:47.894878 | aio | ok: [aio] 2026-05-20 21:50:47.895413 | aio | 2026-05-20 21:50:47.895470 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:50:47.895481 | aio | Wednesday 20 May 2026 21:50:47 +0000 (0:00:00.375) 0:03:16.676 ********* 2026-05-20 21:50:54.270341 | aio | ok: [aio] 2026-05-20 21:50:54.270386 | aio | 2026-05-20 21:50:54.270391 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-20 21:50:54.270396 | aio | Wednesday 20 May 2026 21:50:54 +0000 (0:00:06.375) 0:03:23.051 ********* 2026-05-20 21:51:06.354839 | aio | changed: [aio] 2026-05-20 21:51:06.354967 | aio | 2026-05-20 21:51:06.355268 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-20 21:51:06.355296 | aio | Wednesday 20 May 2026 21:51:06 +0000 (0:00:12.084) 0:03:35.136 ********* 2026-05-20 21:51:20.361362 | aio | ok: [aio] 2026-05-20 21:51:20.361440 | aio | 2026-05-20 21:51:20.361706 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:51:20.361753 | aio | Wednesday 20 May 2026 21:51:20 +0000 (0:00:14.006) 0:03:49.143 ********* 2026-05-20 21:51:20.423308 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:51:20.423351 | aio | 2026-05-20 21:51:20.423596 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:51:20.423637 | aio | Wednesday 20 May 2026 21:51:20 +0000 (0:00:00.061) 0:03:49.205 ********* 2026-05-20 21:51:20.473463 | aio | skipping: [aio] 2026-05-20 21:51:20.473541 | aio | 2026-05-20 21:51:20.473862 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:51:20.473912 | aio | Wednesday 20 May 2026 21:51:20 +0000 (0:00:00.049) 0:03:49.255 ********* 2026-05-20 21:51:20.520285 | aio | skipping: [aio] => (item=aio) 2026-05-20 21:51:20.520359 | aio | skipping: [aio] 2026-05-20 21:51:20.520673 | aio | 2026-05-20 21:51:20.520715 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:51:20.520721 | aio | Wednesday 20 May 2026 21:51:20 +0000 (0:00:00.047) 0:03:49.302 ********* 2026-05-20 21:51:20.759637 | aio | ok: [aio] 2026-05-20 21:51:20.759724 | aio | 2026-05-20 21:51:20.759871 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:51:20.759979 | aio | Wednesday 20 May 2026 21:51:20 +0000 (0:00:00.239) 0:03:49.541 ********* 2026-05-20 21:51:27.099161 | aio | ok: [aio] 2026-05-20 21:51:27.099347 | aio | 2026-05-20 21:51:27.099594 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-20 21:51:27.099866 | aio | Wednesday 20 May 2026 21:51:27 +0000 (0:00:06.339) 0:03:55.880 ********* 2026-05-20 21:51:38.814519 | aio | changed: [aio] 2026-05-20 21:51:38.814586 | aio | 2026-05-20 21:51:38.814599 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-20 21:51:38.814610 | aio | Wednesday 20 May 2026 21:51:38 +0000 (0:00:11.714) 0:04:07.595 ********* 2026-05-20 21:51:44.917450 | aio | ok: [aio] 2026-05-20 21:51:44.917544 | aio | 2026-05-20 21:51:44.917937 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-20 21:51:44.917986 | aio | Wednesday 20 May 2026 21:51:44 +0000 (0:00:06.104) 0:04:13.699 ********* 2026-05-20 21:51:49.603484 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-20 21:51:49.603568 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-20 21:51:49.603618 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-05-20 21:51:49.603740 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-20 21:51:49.603824 | aio | 2026-05-20 21:51:49.603920 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-20 21:51:49.603996 | aio | 2026-05-20 21:51:49.604088 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:51:49.604181 | aio | Wednesday 20 May 2026 21:51:49 +0000 (0:00:04.686) 0:04:18.385 ********* 2026-05-20 21:51:50.498419 | aio | ok: [aio] 2026-05-20 21:51:50.499226 | aio | 2026-05-20 21:51:50.499303 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:51:50.499311 | aio | Wednesday 20 May 2026 21:51:50 +0000 (0:00:00.894) 0:04:19.279 ********* 2026-05-20 21:51:50.696569 | aio | ok: [aio] 2026-05-20 21:51:50.696640 | aio | 2026-05-20 21:51:50.696719 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:51:50.696817 | aio | Wednesday 20 May 2026 21:51:50 +0000 (0:00:00.198) 0:04:19.478 ********* 2026-05-20 21:51:50.728677 | aio | skipping: [aio] 2026-05-20 21:51:50.728754 | aio | 2026-05-20 21:51:50.728885 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-20 21:51:50.728986 | aio | Wednesday 20 May 2026 21:51:50 +0000 (0:00:00.032) 0:04:19.510 ********* 2026-05-20 21:51:50.932975 | aio | ok: [aio] 2026-05-20 21:51:50.933046 | aio | 2026-05-20 21:51:50.933124 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:51:50.933274 | aio | Wednesday 20 May 2026 21:51:50 +0000 (0:00:00.204) 0:04:19.714 ********* 2026-05-20 21:51:50.986536 | aio | ok: [aio] => { 2026-05-20 21:51:50.986650 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-20 21:51:50.986779 | aio | } 2026-05-20 21:51:50.986903 | aio | 2026-05-20 21:51:50.987049 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:51:50.987190 | aio | Wednesday 20 May 2026 21:51:50 +0000 (0:00:00.053) 0:04:19.768 ********* 2026-05-20 21:51:51.279273 | aio | ok: [aio] 2026-05-20 21:51:51.279368 | aio | 2026-05-20 21:51:51.279511 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:51:51.279630 | aio | Wednesday 20 May 2026 21:51:51 +0000 (0:00:00.292) 0:04:20.061 ********* 2026-05-20 21:51:51.319267 | aio | skipping: [aio] 2026-05-20 21:51:51.319360 | aio | 2026-05-20 21:51:51.319417 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:51:51.319512 | aio | Wednesday 20 May 2026 21:51:51 +0000 (0:00:00.040) 0:04:20.101 ********* 2026-05-20 21:51:51.357832 | aio | skipping: [aio] 2026-05-20 21:51:51.357898 | aio | 2026-05-20 21:51:51.357975 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:51:51.358067 | aio | Wednesday 20 May 2026 21:51:51 +0000 (0:00:00.038) 0:04:20.140 ********* 2026-05-20 21:51:51.547377 | aio | ok: [aio] 2026-05-20 21:51:51.547449 | aio | 2026-05-20 21:51:51.547531 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:51:51.547634 | aio | Wednesday 20 May 2026 21:51:51 +0000 (0:00:00.189) 0:04:20.329 ********* 2026-05-20 21:51:52.543530 | aio | ok: [aio] 2026-05-20 21:51:52.543607 | aio | 2026-05-20 21:51:52.543716 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:51:52.543814 | aio | Wednesday 20 May 2026 21:51:52 +0000 (0:00:00.996) 0:04:21.325 ********* 2026-05-20 21:51:52.603881 | aio | ok: [aio] => { 2026-05-20 21:51:52.604020 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-20 21:51:52.604161 | aio | } 2026-05-20 21:51:52.604289 | aio | 2026-05-20 21:51:52.604438 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:51:52.604574 | aio | Wednesday 20 May 2026 21:51:52 +0000 (0:00:00.060) 0:04:21.385 ********* 2026-05-20 21:51:52.937890 | aio | ok: [aio] 2026-05-20 21:51:52.937997 | aio | 2026-05-20 21:51:52.938046 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:51:52.938143 | aio | Wednesday 20 May 2026 21:51:52 +0000 (0:00:00.331) 0:04:21.716 ********* 2026-05-20 21:51:54.859233 | aio | ok: [aio] 2026-05-20 21:51:54.859295 | aio | 2026-05-20 21:51:54.859398 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-20 21:51:54.859499 | aio | Wednesday 20 May 2026 21:51:54 +0000 (0:00:01.924) 0:04:23.641 ********* 2026-05-20 21:51:54.885067 | aio | skipping: [aio] 2026-05-20 21:51:54.885134 | aio | 2026-05-20 21:51:54.885216 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-20 21:51:54.885312 | aio | Wednesday 20 May 2026 21:51:54 +0000 (0:00:00.025) 0:04:23.666 ********* 2026-05-20 21:51:54.916002 | aio | skipping: [aio] 2026-05-20 21:51:54.916145 | aio | 2026-05-20 21:51:54.916315 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-20 21:51:54.916476 | aio | Wednesday 20 May 2026 21:51:54 +0000 (0:00:00.031) 0:04:23.697 ********* 2026-05-20 21:51:54.940264 | aio | skipping: [aio] 2026-05-20 21:51:54.940344 | aio | 2026-05-20 21:51:54.940474 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-20 21:51:54.940607 | aio | Wednesday 20 May 2026 21:51:54 +0000 (0:00:00.024) 0:04:23.722 ********* 2026-05-20 21:51:55.957473 | aio | ok: [aio] 2026-05-20 21:51:55.957543 | aio | 2026-05-20 21:51:55.957692 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-20 21:51:55.957809 | aio | Wednesday 20 May 2026 21:51:55 +0000 (0:00:01.017) 0:04:24.739 ********* 2026-05-20 21:51:56.378997 | aio | ok: [aio] 2026-05-20 21:51:56.379063 | aio | 2026-05-20 21:51:56.379156 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-20 21:51:56.379252 | aio | Wednesday 20 May 2026 21:51:56 +0000 (0:00:00.421) 0:04:25.161 ********* 2026-05-20 21:51:57.332996 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-20 21:51:57.333121 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-20 21:51:57.333245 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-20 21:51:57.333394 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-20 21:51:57.333548 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-20 21:51:57.333658 | aio | 2026-05-20 21:51:57.333828 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-20 21:51:57.333930 | aio | Wednesday 20 May 2026 21:51:57 +0000 (0:00:00.953) 0:04:26.114 ********* 2026-05-20 21:51:57.841368 | aio | ok: [aio] 2026-05-20 21:51:57.841409 | aio | 2026-05-20 21:51:57.841415 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-20 21:51:57.841419 | aio | Wednesday 20 May 2026 21:51:57 +0000 (0:00:00.500) 0:04:26.615 ********* 2026-05-20 21:51:57.841424 | aio | 2026-05-20 21:51:57.841428 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-20 21:51:57.841432 | aio | Wednesday 20 May 2026 21:51:57 +0000 (0:00:00.006) 0:04:26.622 ********* 2026-05-20 21:51:58.185685 | aio | ok: [aio] 2026-05-20 21:51:58.185754 | aio | 2026-05-20 21:51:58.185848 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:51:58.185957 | aio | Wednesday 20 May 2026 21:51:58 +0000 (0:00:00.344) 0:04:26.967 ********* 2026-05-20 21:51:58.413021 | aio | ok: [aio] 2026-05-20 21:51:58.413076 | aio | 2026-05-20 21:51:58.413089 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:51:58.413095 | aio | Wednesday 20 May 2026 21:51:58 +0000 (0:00:00.227) 0:04:27.194 ********* 2026-05-20 21:51:58.468842 | aio | ok: [aio] => { 2026-05-20 21:51:58.468893 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-20 21:51:58.468902 | aio | } 2026-05-20 21:51:58.468908 | aio | 2026-05-20 21:51:58.468915 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:51:58.468921 | aio | Wednesday 20 May 2026 21:51:58 +0000 (0:00:00.054) 0:04:27.249 ********* 2026-05-20 21:51:58.799605 | aio | ok: [aio] 2026-05-20 21:51:58.799647 | aio | 2026-05-20 21:51:58.799652 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:51:58.799657 | aio | Wednesday 20 May 2026 21:51:58 +0000 (0:00:00.331) 0:04:27.581 ********* 2026-05-20 21:52:01.867760 | aio | ok: [aio] 2026-05-20 21:52:01.867971 | aio | 2026-05-20 21:52:01.868220 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-20 21:52:01.868433 | aio | Wednesday 20 May 2026 21:52:01 +0000 (0:00:03.068) 0:04:30.649 ********* 2026-05-20 21:52:02.860314 | aio | ok: [aio] 2026-05-20 21:52:02.860534 | aio | 2026-05-20 21:52:02.860812 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-20 21:52:02.861068 | aio | Wednesday 20 May 2026 21:52:02 +0000 (0:00:00.992) 0:04:31.642 ********* 2026-05-20 21:52:03.051366 | aio | ok: [aio] 2026-05-20 21:52:03.051417 | aio | 2026-05-20 21:52:03.051424 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-20 21:52:03.051431 | aio | Wednesday 20 May 2026 21:52:03 +0000 (0:00:00.190) 0:04:31.832 ********* 2026-05-20 21:52:03.455423 | aio | ok: [aio] 2026-05-20 21:52:03.455490 | aio | 2026-05-20 21:52:03.455713 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-20 21:52:03.455753 | aio | Wednesday 20 May 2026 21:52:03 +0000 (0:00:00.404) 0:04:32.237 ********* 2026-05-20 21:52:03.997845 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-20 21:52:03.998190 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-20 21:52:03.998205 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-20 21:52:03.998215 | aio | 2026-05-20 21:52:03.998226 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-20 21:52:03.998290 | aio | Wednesday 20 May 2026 21:52:03 +0000 (0:00:00.542) 0:04:32.779 ********* 2026-05-20 21:52:04.412611 | aio | ok: [aio] 2026-05-20 21:52:04.412675 | aio | 2026-05-20 21:52:04.412760 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-20 21:52:04.412865 | aio | Wednesday 20 May 2026 21:52:04 +0000 (0:00:00.414) 0:04:33.194 ********* 2026-05-20 21:52:04.831749 | aio | ok: [aio] 2026-05-20 21:52:04.831789 | aio | 2026-05-20 21:52:04.831794 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-20 21:52:04.831799 | aio | Wednesday 20 May 2026 21:52:04 +0000 (0:00:00.411) 0:04:33.605 ********* 2026-05-20 21:52:04.831803 | aio | 2026-05-20 21:52:04.831807 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-20 21:52:04.831931 | aio | Wednesday 20 May 2026 21:52:04 +0000 (0:00:00.007) 0:04:33.613 ********* 2026-05-20 21:52:05.218806 | aio | ok: [aio] 2026-05-20 21:52:05.218868 | aio | 2026-05-20 21:52:05.218963 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-20 21:52:05.219083 | aio | Wednesday 20 May 2026 21:52:05 +0000 (0:00:00.387) 0:04:34.000 ********* 2026-05-20 21:52:05.262933 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-20 21:52:05.262992 | aio | 2026-05-20 21:52:05.263270 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-20 21:52:05.263293 | aio | Wednesday 20 May 2026 21:52:05 +0000 (0:00:00.044) 0:04:34.044 ********* 2026-05-20 21:52:06.241489 | aio | ok: [aio] 2026-05-20 21:52:06.241553 | aio | 2026-05-20 21:52:06.241633 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-20 21:52:06.241761 | aio | Wednesday 20 May 2026 21:52:06 +0000 (0:00:00.978) 0:04:35.023 ********* 2026-05-20 21:52:06.887741 | aio | ok: [aio] => (item=chronyd) 2026-05-20 21:52:06.888184 | aio | ok: [aio] => (item=sshd) 2026-05-20 21:52:06.888228 | aio | 2026-05-20 21:52:06.888234 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-20 21:52:06.888239 | aio | Wednesday 20 May 2026 21:52:06 +0000 (0:00:00.646) 0:04:35.669 ********* 2026-05-20 21:52:07.171114 | aio | ok: [aio] 2026-05-20 21:52:07.171188 | aio | 2026-05-20 21:52:07.171542 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-20 21:52:07.171587 | aio | Wednesday 20 May 2026 21:52:07 +0000 (0:00:00.283) 0:04:35.952 ********* 2026-05-20 21:52:07.367638 | aio | ok: [aio] 2026-05-20 21:52:07.367727 | aio | 2026-05-20 21:52:07.368061 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-20 21:52:07.368112 | aio | Wednesday 20 May 2026 21:52:07 +0000 (0:00:00.196) 0:04:36.149 ********* 2026-05-20 21:52:07.611936 | aio | ok: [aio] 2026-05-20 21:52:07.612031 | aio | 2026-05-20 21:52:07.612055 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-20 21:52:07.612220 | aio | Wednesday 20 May 2026 21:52:07 +0000 (0:00:00.244) 0:04:36.393 ********* 2026-05-20 21:52:07.825524 | aio | ok: [aio] 2026-05-20 21:52:07.825594 | aio | 2026-05-20 21:52:07.825675 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-20 21:52:07.825809 | aio | Wednesday 20 May 2026 21:52:07 +0000 (0:00:00.213) 0:04:36.607 ********* 2026-05-20 21:52:08.073297 | aio | ok: [aio] => (item=aio) 2026-05-20 21:52:08.073760 | aio | 2026-05-20 21:52:08.073808 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-20 21:52:08.073816 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.247) 0:04:36.855 ********* 2026-05-20 21:52:08.114707 | aio | ok: [aio] 2026-05-20 21:52:08.114762 | aio | 2026-05-20 21:52:08.114977 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:52:08.115023 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.041) 0:04:36.896 ********* 2026-05-20 21:52:08.172892 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:52:08.172979 | aio | 2026-05-20 21:52:08.173228 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:52:08.173270 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.058) 0:04:36.954 ********* 2026-05-20 21:52:08.219528 | aio | skipping: [aio] 2026-05-20 21:52:08.219592 | aio | 2026-05-20 21:52:08.219701 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:52:08.219842 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.046) 0:04:37.001 ********* 2026-05-20 21:52:08.258472 | aio | skipping: [aio] => (item=aio) 2026-05-20 21:52:08.258536 | aio | skipping: [aio] 2026-05-20 21:52:08.258617 | aio | 2026-05-20 21:52:08.258883 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:52:08.259071 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.039) 0:04:37.040 ********* 2026-05-20 21:52:08.506827 | aio | ok: [aio] 2026-05-20 21:52:08.507261 | aio | 2026-05-20 21:52:08.507520 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:52:08.507560 | aio | Wednesday 20 May 2026 21:52:08 +0000 (0:00:00.248) 0:04:37.288 ********* 2026-05-20 21:52:14.886786 | aio | ok: [aio] 2026-05-20 21:52:14.886874 | aio | 2026-05-20 21:52:14.886888 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-20 21:52:14.887041 | aio | Wednesday 20 May 2026 21:52:14 +0000 (0:00:06.379) 0:04:43.668 ********* 2026-05-20 21:52:20.196256 | aio | ok: [aio] 2026-05-20 21:52:20.196358 | aio | 2026-05-20 21:52:20.196376 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-20 21:52:20.196531 | aio | Wednesday 20 May 2026 21:52:20 +0000 (0:00:05.309) 0:04:48.977 ********* 2026-05-20 21:52:34.108400 | aio | ok: [aio] 2026-05-20 21:52:34.108524 | aio | 2026-05-20 21:52:34.108538 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-20 21:52:34.108656 | aio | Wednesday 20 May 2026 21:52:34 +0000 (0:00:13.912) 0:05:02.890 ********* 2026-05-20 21:54:56.764645 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-20 21:54:56.764727 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-20 21:54:56.765144 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-20 21:54:56.765189 | aio | 2026-05-20 21:54:56.765195 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-20 21:54:56.765200 | aio | Wednesday 20 May 2026 21:54:56 +0000 (0:02:22.656) 0:07:25.546 ********* 2026-05-20 21:55:04.818274 | aio | ok: [aio] 2026-05-20 21:55:04.818319 | aio | 2026-05-20 21:55:04.818325 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-20 21:55:04.818329 | aio | Wednesday 20 May 2026 21:55:04 +0000 (0:00:08.053) 0:07:33.599 ********* 2026-05-20 21:55:10.829449 | aio | ok: [aio] 2026-05-20 21:55:10.829529 | aio | 2026-05-20 21:55:10.829739 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-20 21:55:10.829790 | aio | Wednesday 20 May 2026 21:55:10 +0000 (0:00:06.011) 0:07:39.611 ********* 2026-05-20 21:55:10.876888 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-20 21:55:10.876959 | aio | 2026-05-20 21:55:10.877169 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-20 21:55:10.877212 | aio | Wednesday 20 May 2026 21:55:10 +0000 (0:00:00.047) 0:07:39.658 ********* 2026-05-20 21:55:10.919387 | aio | ok: [aio] 2026-05-20 21:55:10.919446 | aio | 2026-05-20 21:55:10.919694 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-20 21:55:10.919743 | aio | Wednesday 20 May 2026 21:55:10 +0000 (0:00:00.042) 0:07:39.701 ********* 2026-05-20 21:55:17.206051 | aio | ok: [aio] 2026-05-20 21:55:17.206142 | aio | 2026-05-20 21:55:17.206433 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-20 21:55:17.206476 | aio | Wednesday 20 May 2026 21:55:17 +0000 (0:00:06.286) 0:07:45.987 ********* 2026-05-20 21:55:17.247241 | aio | ok: [aio] 2026-05-20 21:55:17.247317 | aio | 2026-05-20 21:55:17.247518 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-20 21:55:17.247556 | aio | Wednesday 20 May 2026 21:55:17 +0000 (0:00:00.041) 0:07:46.029 ********* 2026-05-20 21:55:17.290068 | aio | skipping: [aio] => (item=1) 2026-05-20 21:55:17.290114 | aio | skipping: [aio] => (item=1) 2026-05-20 21:55:17.290667 | aio | skipping: [aio] => (item=1) 2026-05-20 21:55:17.290721 | aio | skipping: [aio] 2026-05-20 21:55:17.290726 | aio | 2026-05-20 21:55:17.290731 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-20 21:55:17.290736 | aio | Wednesday 20 May 2026 21:55:17 +0000 (0:00:00.042) 0:07:46.071 ********* 2026-05-20 21:55:17.322369 | aio | skipping: [aio] 2026-05-20 21:55:17.322434 | aio | 2026-05-20 21:55:17.323814 | aio | PLAY RECAP ********************************************************************* 2026-05-20 21:55:17.323860 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-05-20 21:55:17.323872 | aio | 2026-05-20 21:55:17.323882 | aio | 2026-05-20 21:55:17.323892 | aio | TASKS RECAP ******************************************************************** 2026-05-20 21:55:17.323901 | aio | Wednesday 20 May 2026 21:55:17 +0000 (0:00:00.032) 0:07:46.104 ********* 2026-05-20 21:55:17.323910 | aio | =============================================================================== 2026-05-20 21:55:17.323919 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 144.23s 2026-05-20 21:55:17.323928 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 142.66s 2026-05-20 21:55:17.323937 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.01s 2026-05-20 21:55:17.323945 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.91s 2026-05-20 21:55:17.323954 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.08s 2026-05-20 21:55:17.323962 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.71s 2026-05-20 21:55:17.323971 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 8.05s 2026-05-20 21:55:17.323980 | aio | vexxhost.containers.docker : Restart docker ----------------------------- 6.92s 2026-05-20 21:55:17.323993 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.38s 2026-05-20 21:55:17.324002 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.38s 2026-05-20 21:55:17.324887 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.34s 2026-05-20 21:55:17.324903 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.29s 2026-05-20 21:55:17.324908 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.10s 2026-05-20 21:55:17.324913 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.01s 2026-05-20 21:55:17.324917 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.84s 2026-05-20 21:55:17.324921 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.65s 2026-05-20 21:55:17.324925 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.53s 2026-05-20 21:55:17.324929 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.31s 2026-05-20 21:55:17.324933 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.69s 2026-05-20 21:55:17.324937 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.41s 2026-05-20 21:55:17.423184 | aio | INFO [default > converge] Executed: Successful 2026-05-20 21:55:17.432037 | aio | INFO [default > idempotence] Executing 2026-05-20 21:55:18.275417 | aio | 2026-05-20 21:55:18.275870 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-20 21:55:18.276168 | aio | 2026-05-20 21:55:18.276479 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:55:18.276782 | aio | Wednesday 20 May 2026 21:55:18 +0000 (0:00:00.048) 0:00:00.048 ********* 2026-05-20 21:55:19.427752 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-20 21:55:19.427811 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-20 21:55:19.427981 | aio | interpreter could change the meaning of that path. See 2026-05-20 21:55:19.428197 | aio | https://docs.ansible.com/ansible- 2026-05-20 21:55:19.428450 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-20 21:55:19.440840 | aio | ok: [aio] 2026-05-20 21:55:19.441013 | aio | 2026-05-20 21:55:19.441212 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:55:19.441453 | aio | Wednesday 20 May 2026 21:55:19 +0000 (0:00:01.165) 0:00:01.213 ********* 2026-05-20 21:55:19.744799 | aio | ok: [aio] 2026-05-20 21:55:19.745042 | aio | 2026-05-20 21:55:19.745294 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:55:19.745530 | aio | Wednesday 20 May 2026 21:55:19 +0000 (0:00:00.303) 0:00:01.517 ********* 2026-05-20 21:55:19.779504 | aio | skipping: [aio] 2026-05-20 21:55:19.779700 | aio | 2026-05-20 21:55:19.779951 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-20 21:55:19.780172 | aio | Wednesday 20 May 2026 21:55:19 +0000 (0:00:00.034) 0:00:01.552 ********* 2026-05-20 21:55:20.077030 | aio | ok: [aio] 2026-05-20 21:55:20.077314 | aio | 2026-05-20 21:55:20.077620 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:55:20.077901 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.297) 0:00:01.850 ********* 2026-05-20 21:55:20.150267 | aio | ok: [aio] => { 2026-05-20 21:55:20.150446 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-20 21:55:20.150616 | aio | } 2026-05-20 21:55:20.150793 | aio | 2026-05-20 21:55:20.150994 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:55:20.151174 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.073) 0:00:01.923 ********* 2026-05-20 21:55:20.575660 | aio | ok: [aio] 2026-05-20 21:55:20.575849 | aio | 2026-05-20 21:55:20.576074 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:55:20.576293 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.425) 0:00:02.348 ********* 2026-05-20 21:55:20.612690 | aio | skipping: [aio] 2026-05-20 21:55:20.612867 | aio | 2026-05-20 21:55:20.613081 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:55:20.613289 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.037) 0:00:02.386 ********* 2026-05-20 21:55:20.654980 | aio | skipping: [aio] 2026-05-20 21:55:20.655106 | aio | 2026-05-20 21:55:20.655314 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:55:20.655535 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.042) 0:00:02.428 ********* 2026-05-20 21:55:20.856801 | aio | ok: [aio] 2026-05-20 21:55:20.856963 | aio | 2026-05-20 21:55:20.857214 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:55:20.857415 | aio | Wednesday 20 May 2026 21:55:20 +0000 (0:00:00.201) 0:00:02.629 ********* 2026-05-20 21:55:22.010192 | aio | ok: [aio] 2026-05-20 21:55:22.010257 | aio | 2026-05-20 21:55:22.010269 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:55:22.010279 | aio | Wednesday 20 May 2026 21:55:22 +0000 (0:00:01.152) 0:00:03.782 ********* 2026-05-20 21:55:22.083265 | aio | ok: [aio] => { 2026-05-20 21:55:22.083862 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-20 21:55:22.083931 | aio | } 2026-05-20 21:55:22.083944 | aio | 2026-05-20 21:55:22.083955 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:55:22.083965 | aio | Wednesday 20 May 2026 21:55:22 +0000 (0:00:00.073) 0:00:03.856 ********* 2026-05-20 21:55:22.431255 | aio | ok: [aio] 2026-05-20 21:55:22.431298 | aio | 2026-05-20 21:55:22.431304 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:55:22.431308 | aio | Wednesday 20 May 2026 21:55:22 +0000 (0:00:00.347) 0:00:04.204 ********* 2026-05-20 21:55:24.699930 | aio | ok: [aio] 2026-05-20 21:55:24.699984 | aio | 2026-05-20 21:55:24.700096 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-20 21:55:24.700235 | aio | Wednesday 20 May 2026 21:55:24 +0000 (0:00:02.269) 0:00:06.473 ********* 2026-05-20 21:55:24.728850 | aio | skipping: [aio] 2026-05-20 21:55:24.729225 | aio | 2026-05-20 21:55:24.729271 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-20 21:55:24.729277 | aio | Wednesday 20 May 2026 21:55:24 +0000 (0:00:00.028) 0:00:06.502 ********* 2026-05-20 21:55:24.757354 | aio | skipping: [aio] 2026-05-20 21:55:24.757432 | aio | 2026-05-20 21:55:24.757666 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-20 21:55:24.757741 | aio | Wednesday 20 May 2026 21:55:24 +0000 (0:00:00.028) 0:00:06.530 ********* 2026-05-20 21:55:24.789663 | aio | skipping: [aio] 2026-05-20 21:55:24.789747 | aio | 2026-05-20 21:55:24.790110 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-20 21:55:24.790172 | aio | Wednesday 20 May 2026 21:55:24 +0000 (0:00:00.032) 0:00:06.562 ********* 2026-05-20 21:55:25.833371 | aio | ok: [aio] 2026-05-20 21:55:25.833470 | aio | 2026-05-20 21:55:25.833795 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-20 21:55:25.833879 | aio | Wednesday 20 May 2026 21:55:25 +0000 (0:00:01.043) 0:00:07.606 ********* 2026-05-20 21:55:26.301488 | aio | ok: [aio] 2026-05-20 21:55:26.301559 | aio | 2026-05-20 21:55:26.301634 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-20 21:55:26.301762 | aio | Wednesday 20 May 2026 21:55:26 +0000 (0:00:00.468) 0:00:08.074 ********* 2026-05-20 21:55:27.241246 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-20 21:55:27.241325 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-20 21:55:27.241398 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-20 21:55:27.241818 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-20 21:55:27.241872 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-20 21:55:27.241878 | aio | 2026-05-20 21:55:27.241889 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-20 21:55:27.241958 | aio | Wednesday 20 May 2026 21:55:27 +0000 (0:00:00.939) 0:00:09.014 ********* 2026-05-20 21:55:27.751694 | aio | ok: [aio] 2026-05-20 21:55:27.751760 | aio | 2026-05-20 21:55:27.752277 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-20 21:55:27.752321 | aio | Wednesday 20 May 2026 21:55:27 +0000 (0:00:00.502) 0:00:09.517 ********* 2026-05-20 21:55:27.752327 | aio | 2026-05-20 21:55:27.752332 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-20 21:55:27.752336 | aio | Wednesday 20 May 2026 21:55:27 +0000 (0:00:00.007) 0:00:09.525 ********* 2026-05-20 21:55:28.347791 | aio | ok: [aio] 2026-05-20 21:55:28.347865 | aio | 2026-05-20 21:55:28.348122 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:55:28.348166 | aio | Wednesday 20 May 2026 21:55:28 +0000 (0:00:00.596) 0:00:10.121 ********* 2026-05-20 21:55:28.561619 | aio | ok: [aio] 2026-05-20 21:55:28.561739 | aio | 2026-05-20 21:55:28.561757 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:55:28.561893 | aio | Wednesday 20 May 2026 21:55:28 +0000 (0:00:00.213) 0:00:10.334 ********* 2026-05-20 21:55:28.637202 | aio | ok: [aio] => { 2026-05-20 21:55:28.637323 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-20 21:55:28.637952 | aio | } 2026-05-20 21:55:28.638001 | aio | 2026-05-20 21:55:28.638009 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:55:28.638015 | aio | Wednesday 20 May 2026 21:55:28 +0000 (0:00:00.075) 0:00:10.410 ********* 2026-05-20 21:55:28.988320 | aio | ok: [aio] 2026-05-20 21:55:28.988402 | aio | 2026-05-20 21:55:28.988591 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:55:28.988634 | aio | Wednesday 20 May 2026 21:55:28 +0000 (0:00:00.351) 0:00:10.761 ********* 2026-05-20 21:55:32.141006 | aio | ok: [aio] 2026-05-20 21:55:32.141093 | aio | 2026-05-20 21:55:32.141331 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-20 21:55:32.141387 | aio | Wednesday 20 May 2026 21:55:32 +0000 (0:00:03.152) 0:00:13.914 ********* 2026-05-20 21:55:33.461379 | aio | ok: [aio] 2026-05-20 21:55:33.461597 | aio | 2026-05-20 21:55:33.461603 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-20 21:55:33.461608 | aio | Wednesday 20 May 2026 21:55:33 +0000 (0:00:01.320) 0:00:15.234 ********* 2026-05-20 21:55:33.751116 | aio | ok: [aio] 2026-05-20 21:55:33.751182 | aio | 2026-05-20 21:55:33.751274 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-20 21:55:33.751410 | aio | Wednesday 20 May 2026 21:55:33 +0000 (0:00:00.290) 0:00:15.524 ********* 2026-05-20 21:55:34.191512 | aio | ok: [aio] 2026-05-20 21:55:34.191594 | aio | 2026-05-20 21:55:34.191916 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-20 21:55:34.191939 | aio | Wednesday 20 May 2026 21:55:34 +0000 (0:00:00.440) 0:00:15.964 ********* 2026-05-20 21:55:34.761705 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-20 21:55:34.761840 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-20 21:55:34.762394 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-20 21:55:34.762454 | aio | 2026-05-20 21:55:34.762460 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-20 21:55:34.762465 | aio | Wednesday 20 May 2026 21:55:34 +0000 (0:00:00.569) 0:00:16.534 ********* 2026-05-20 21:55:35.193885 | aio | ok: [aio] 2026-05-20 21:55:35.193963 | aio | 2026-05-20 21:55:35.194309 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-20 21:55:35.194371 | aio | Wednesday 20 May 2026 21:55:35 +0000 (0:00:00.432) 0:00:16.966 ********* 2026-05-20 21:55:35.640751 | aio | ok: [aio] 2026-05-20 21:55:35.640831 | aio | 2026-05-20 21:55:35.641470 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-20 21:55:35.641527 | aio | Wednesday 20 May 2026 21:55:35 +0000 (0:00:00.440) 0:00:17.407 ********* 2026-05-20 21:55:35.641533 | aio | 2026-05-20 21:55:35.641538 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-20 21:55:35.641542 | aio | Wednesday 20 May 2026 21:55:35 +0000 (0:00:00.007) 0:00:17.414 ********* 2026-05-20 21:55:35.993444 | aio | ok: [aio] 2026-05-20 21:55:35.993546 | aio | 2026-05-20 21:55:35.993734 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-20 21:55:35.993749 | aio | Wednesday 20 May 2026 21:55:35 +0000 (0:00:00.352) 0:00:17.766 ********* 2026-05-20 21:55:36.037265 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-20 21:55:36.037323 | aio | 2026-05-20 21:55:36.037433 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-20 21:55:36.037600 | aio | Wednesday 20 May 2026 21:55:36 +0000 (0:00:00.043) 0:00:17.810 ********* 2026-05-20 21:55:37.344885 | aio | ok: [aio] 2026-05-20 21:55:37.344975 | aio | 2026-05-20 21:55:37.345310 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-20 21:55:37.345370 | aio | Wednesday 20 May 2026 21:55:37 +0000 (0:00:01.307) 0:00:19.117 ********* 2026-05-20 21:55:38.012468 | aio | ok: [aio] => (item=chronyd) 2026-05-20 21:55:38.012548 | aio | ok: [aio] => (item=sshd) 2026-05-20 21:55:38.012605 | aio | 2026-05-20 21:55:38.012879 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-20 21:55:38.012939 | aio | Wednesday 20 May 2026 21:55:38 +0000 (0:00:00.667) 0:00:19.785 ********* 2026-05-20 21:55:38.310543 | aio | ok: [aio] 2026-05-20 21:55:38.310627 | aio | 2026-05-20 21:55:38.310981 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-20 21:55:38.311050 | aio | Wednesday 20 May 2026 21:55:38 +0000 (0:00:00.297) 0:00:20.083 ********* 2026-05-20 21:55:38.509526 | aio | ok: [aio] 2026-05-20 21:55:38.509620 | aio | 2026-05-20 21:55:38.509919 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-20 21:55:38.509979 | aio | Wednesday 20 May 2026 21:55:38 +0000 (0:00:00.199) 0:00:20.282 ********* 2026-05-20 21:55:38.910881 | aio | ok: [aio] 2026-05-20 21:55:38.910969 | aio | 2026-05-20 21:55:38.911305 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-20 21:55:38.911371 | aio | Wednesday 20 May 2026 21:55:38 +0000 (0:00:00.401) 0:00:20.683 ********* 2026-05-20 21:55:39.246047 | aio | ok: [aio] 2026-05-20 21:55:39.246135 | aio | 2026-05-20 21:55:39.246363 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-20 21:55:39.246422 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.335) 0:00:21.019 ********* 2026-05-20 21:55:39.317572 | aio | ok: [aio] 2026-05-20 21:55:39.317651 | aio | 2026-05-20 21:55:39.317985 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-20 21:55:39.318043 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.071) 0:00:21.090 ********* 2026-05-20 21:55:39.553839 | aio | ok: [aio] => (item=aio) 2026-05-20 21:55:39.553924 | aio | 2026-05-20 21:55:39.554243 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-20 21:55:39.554416 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.236) 0:00:21.327 ********* 2026-05-20 21:55:39.603149 | aio | ok: [aio] 2026-05-20 21:55:39.603233 | aio | 2026-05-20 21:55:39.603484 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-20 21:55:39.603535 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.049) 0:00:21.376 ********* 2026-05-20 21:55:39.639580 | aio | skipping: [aio] 2026-05-20 21:55:39.639636 | aio | 2026-05-20 21:55:39.639912 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:55:39.639969 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.036) 0:00:21.412 ********* 2026-05-20 21:55:39.698503 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:55:39.698593 | aio | 2026-05-20 21:55:39.698608 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:55:39.698762 | aio | Wednesday 20 May 2026 21:55:39 +0000 (0:00:00.059) 0:00:21.471 ********* 2026-05-20 21:55:46.762714 | aio | ok: [aio] 2026-05-20 21:55:46.762813 | aio | 2026-05-20 21:55:46.763168 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:55:46.763232 | aio | Wednesday 20 May 2026 21:55:46 +0000 (0:00:07.063) 0:00:28.535 ********* 2026-05-20 21:55:46.815578 | aio | ok: [aio] => (item=aio) 2026-05-20 21:55:46.815667 | aio | 2026-05-20 21:55:46.816107 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:55:46.816169 | aio | Wednesday 20 May 2026 21:55:46 +0000 (0:00:00.053) 0:00:28.588 ********* 2026-05-20 21:55:47.193926 | aio | ok: [aio] 2026-05-20 21:55:47.194005 | aio | 2026-05-20 21:55:47.194101 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:55:47.194222 | aio | Wednesday 20 May 2026 21:55:47 +0000 (0:00:00.378) 0:00:28.967 ********* 2026-05-20 21:55:53.661549 | aio | ok: [aio] 2026-05-20 21:55:53.661860 | aio | 2026-05-20 21:55:53.661874 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-20 21:55:53.661884 | aio | Wednesday 20 May 2026 21:55:53 +0000 (0:00:06.467) 0:00:35.434 ********* 2026-05-20 21:56:00.144726 | aio | ok: [aio] 2026-05-20 21:56:00.144841 | aio | 2026-05-20 21:56:00.144853 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-20 21:56:00.144921 | aio | Wednesday 20 May 2026 21:56:00 +0000 (0:00:06.483) 0:00:41.918 ********* 2026-05-20 21:56:15.208580 | aio | ok: [aio] 2026-05-20 21:56:15.208693 | aio | 2026-05-20 21:56:15.208705 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:56:15.208797 | aio | Wednesday 20 May 2026 21:56:15 +0000 (0:00:15.063) 0:00:56.981 ********* 2026-05-20 21:56:15.279186 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:56:15.279252 | aio | 2026-05-20 21:56:15.279261 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:56:15.279266 | aio | Wednesday 20 May 2026 21:56:15 +0000 (0:00:00.069) 0:00:57.051 ********* 2026-05-20 21:56:15.328100 | aio | skipping: [aio] 2026-05-20 21:56:15.328226 | aio | 2026-05-20 21:56:15.328239 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:56:15.328370 | aio | Wednesday 20 May 2026 21:56:15 +0000 (0:00:00.049) 0:00:57.101 ********* 2026-05-20 21:56:15.379319 | aio | skipping: [aio] => (item=aio) 2026-05-20 21:56:15.379406 | aio | skipping: [aio] 2026-05-20 21:56:15.379420 | aio | 2026-05-20 21:56:15.379667 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:56:15.379742 | aio | Wednesday 20 May 2026 21:56:15 +0000 (0:00:00.051) 0:00:57.152 ********* 2026-05-20 21:56:15.628038 | aio | ok: [aio] 2026-05-20 21:56:15.628121 | aio | 2026-05-20 21:56:15.628325 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:56:15.628379 | aio | Wednesday 20 May 2026 21:56:15 +0000 (0:00:00.249) 0:00:57.401 ********* 2026-05-20 21:56:22.201144 | aio | ok: [aio] 2026-05-20 21:56:22.201238 | aio | 2026-05-20 21:56:22.201316 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-20 21:56:22.201427 | aio | Wednesday 20 May 2026 21:56:22 +0000 (0:00:06.573) 0:01:03.974 ********* 2026-05-20 21:56:28.270879 | aio | ok: [aio] 2026-05-20 21:56:28.270927 | aio | 2026-05-20 21:56:28.270933 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-20 21:56:28.270938 | aio | Wednesday 20 May 2026 21:56:28 +0000 (0:00:06.069) 0:01:10.043 ********* 2026-05-20 21:56:34.278055 | aio | ok: [aio] 2026-05-20 21:56:34.278136 | aio | 2026-05-20 21:56:34.278337 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-20 21:56:34.278382 | aio | Wednesday 20 May 2026 21:56:34 +0000 (0:00:06.007) 0:01:16.051 ********* 2026-05-20 21:56:39.415533 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-20 21:56:39.415665 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-20 21:56:39.416793 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-05-20 21:56:39.416885 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-20 21:56:39.416894 | aio | 2026-05-20 21:56:39.416903 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-20 21:56:39.416911 | aio | 2026-05-20 21:56:39.416917 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:56:39.416924 | aio | Wednesday 20 May 2026 21:56:39 +0000 (0:00:05.136) 0:01:21.188 ********* 2026-05-20 21:56:40.320345 | aio | ok: [aio] 2026-05-20 21:56:40.320458 | aio | 2026-05-20 21:56:40.320468 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:56:40.320593 | aio | Wednesday 20 May 2026 21:56:40 +0000 (0:00:00.905) 0:01:22.093 ********* 2026-05-20 21:56:40.516738 | aio | ok: [aio] 2026-05-20 21:56:40.516806 | aio | 2026-05-20 21:56:40.517012 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:56:40.517058 | aio | Wednesday 20 May 2026 21:56:40 +0000 (0:00:00.196) 0:01:22.289 ********* 2026-05-20 21:56:40.550322 | aio | skipping: [aio] 2026-05-20 21:56:40.550390 | aio | 2026-05-20 21:56:40.550685 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-20 21:56:40.550719 | aio | Wednesday 20 May 2026 21:56:40 +0000 (0:00:00.033) 0:01:22.323 ********* 2026-05-20 21:56:40.753879 | aio | ok: [aio] 2026-05-20 21:56:40.753922 | aio | 2026-05-20 21:56:40.753928 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:56:40.753933 | aio | Wednesday 20 May 2026 21:56:40 +0000 (0:00:00.203) 0:01:22.526 ********* 2026-05-20 21:56:40.824402 | aio | ok: [aio] => { 2026-05-20 21:56:40.824439 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-20 21:56:40.824445 | aio | } 2026-05-20 21:56:40.824450 | aio | 2026-05-20 21:56:40.824454 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:56:40.824459 | aio | Wednesday 20 May 2026 21:56:40 +0000 (0:00:00.069) 0:01:22.596 ********* 2026-05-20 21:56:41.150287 | aio | ok: [aio] 2026-05-20 21:56:41.150383 | aio | 2026-05-20 21:56:41.150683 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:56:41.150744 | aio | Wednesday 20 May 2026 21:56:41 +0000 (0:00:00.326) 0:01:22.923 ********* 2026-05-20 21:56:41.195550 | aio | skipping: [aio] 2026-05-20 21:56:41.195759 | aio | 2026-05-20 21:56:41.196066 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:56:41.196157 | aio | Wednesday 20 May 2026 21:56:41 +0000 (0:00:00.045) 0:01:22.968 ********* 2026-05-20 21:56:41.238617 | aio | skipping: [aio] 2026-05-20 21:56:41.238752 | aio | 2026-05-20 21:56:41.238769 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:56:41.238839 | aio | Wednesday 20 May 2026 21:56:41 +0000 (0:00:00.043) 0:01:23.011 ********* 2026-05-20 21:56:41.450933 | aio | ok: [aio] 2026-05-20 21:56:41.451047 | aio | 2026-05-20 21:56:41.451060 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-20 21:56:41.451205 | aio | Wednesday 20 May 2026 21:56:41 +0000 (0:00:00.212) 0:01:23.224 ********* 2026-05-20 21:56:42.726580 | aio | ok: [aio] 2026-05-20 21:56:42.726664 | aio | 2026-05-20 21:56:42.726724 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:56:42.726864 | aio | Wednesday 20 May 2026 21:56:42 +0000 (0:00:01.275) 0:01:24.499 ********* 2026-05-20 21:56:42.809740 | aio | ok: [aio] => { 2026-05-20 21:56:42.809820 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-20 21:56:42.810235 | aio | } 2026-05-20 21:56:42.810282 | aio | 2026-05-20 21:56:42.810287 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:56:42.810293 | aio | Wednesday 20 May 2026 21:56:42 +0000 (0:00:00.083) 0:01:24.582 ********* 2026-05-20 21:56:43.143016 | aio | ok: [aio] 2026-05-20 21:56:43.143087 | aio | 2026-05-20 21:56:43.143232 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:56:43.143398 | aio | Wednesday 20 May 2026 21:56:43 +0000 (0:00:00.333) 0:01:24.916 ********* 2026-05-20 21:56:45.148495 | aio | ok: [aio] 2026-05-20 21:56:45.148571 | aio | 2026-05-20 21:56:45.148657 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-20 21:56:45.148761 | aio | Wednesday 20 May 2026 21:56:45 +0000 (0:00:02.005) 0:01:26.921 ********* 2026-05-20 21:56:45.170469 | aio | skipping: [aio] 2026-05-20 21:56:45.170556 | aio | 2026-05-20 21:56:45.170661 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-20 21:56:45.170822 | aio | Wednesday 20 May 2026 21:56:45 +0000 (0:00:00.021) 0:01:26.943 ********* 2026-05-20 21:56:45.197062 | aio | skipping: [aio] 2026-05-20 21:56:45.197133 | aio | 2026-05-20 21:56:45.197440 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-20 21:56:45.197466 | aio | Wednesday 20 May 2026 21:56:45 +0000 (0:00:00.026) 0:01:26.970 ********* 2026-05-20 21:56:45.222408 | aio | skipping: [aio] 2026-05-20 21:56:45.222478 | aio | 2026-05-20 21:56:45.222798 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-20 21:56:45.222844 | aio | Wednesday 20 May 2026 21:56:45 +0000 (0:00:00.024) 0:01:26.995 ********* 2026-05-20 21:56:46.512056 | aio | ok: [aio] 2026-05-20 21:56:46.512128 | aio | 2026-05-20 21:56:46.512382 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-20 21:56:46.512427 | aio | Wednesday 20 May 2026 21:56:46 +0000 (0:00:01.290) 0:01:28.285 ********* 2026-05-20 21:56:46.942990 | aio | ok: [aio] 2026-05-20 21:56:46.943059 | aio | 2026-05-20 21:56:46.943405 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-20 21:56:46.943458 | aio | Wednesday 20 May 2026 21:56:46 +0000 (0:00:00.430) 0:01:28.716 ********* 2026-05-20 21:56:47.848978 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-20 21:56:47.849895 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-20 21:56:47.849940 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-20 21:56:47.849946 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-20 21:56:47.849951 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-20 21:56:47.849956 | aio | 2026-05-20 21:56:47.849961 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-20 21:56:47.849967 | aio | Wednesday 20 May 2026 21:56:47 +0000 (0:00:00.905) 0:01:29.622 ********* 2026-05-20 21:56:48.355010 | aio | ok: [aio] 2026-05-20 21:56:48.355100 | aio | 2026-05-20 21:56:48.355236 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-20 21:56:48.355790 | aio | Wednesday 20 May 2026 21:56:48 +0000 (0:00:00.499) 0:01:30.121 ********* 2026-05-20 21:56:48.355855 | aio | 2026-05-20 21:56:48.355876 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-20 21:56:48.355892 | aio | Wednesday 20 May 2026 21:56:48 +0000 (0:00:00.007) 0:01:30.128 ********* 2026-05-20 21:56:48.693321 | aio | ok: [aio] 2026-05-20 21:56:48.693376 | aio | 2026-05-20 21:56:48.693482 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-20 21:56:48.693593 | aio | Wednesday 20 May 2026 21:56:48 +0000 (0:00:00.338) 0:01:30.466 ********* 2026-05-20 21:56:48.894384 | aio | ok: [aio] 2026-05-20 21:56:48.894447 | aio | 2026-05-20 21:56:48.894545 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-20 21:56:48.894683 | aio | Wednesday 20 May 2026 21:56:48 +0000 (0:00:00.200) 0:01:30.667 ********* 2026-05-20 21:56:48.961694 | aio | ok: [aio] => { 2026-05-20 21:56:48.961772 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-20 21:56:48.962312 | aio | } 2026-05-20 21:56:48.962367 | aio | 2026-05-20 21:56:48.962373 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-20 21:56:48.962379 | aio | Wednesday 20 May 2026 21:56:48 +0000 (0:00:00.067) 0:01:30.734 ********* 2026-05-20 21:56:49.313077 | aio | ok: [aio] 2026-05-20 21:56:49.313136 | aio | 2026-05-20 21:56:49.313154 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-20 21:56:49.313326 | aio | Wednesday 20 May 2026 21:56:49 +0000 (0:00:00.351) 0:01:31.085 ********* 2026-05-20 21:56:52.428404 | aio | ok: [aio] 2026-05-20 21:56:52.428485 | aio | 2026-05-20 21:56:52.428602 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-20 21:56:52.428710 | aio | Wednesday 20 May 2026 21:56:52 +0000 (0:00:03.115) 0:01:34.201 ********* 2026-05-20 21:56:53.437069 | aio | ok: [aio] 2026-05-20 21:56:53.437279 | aio | 2026-05-20 21:56:53.437632 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-20 21:56:53.437974 | aio | Wednesday 20 May 2026 21:56:53 +0000 (0:00:01.008) 0:01:35.210 ********* 2026-05-20 21:56:53.623102 | aio | ok: [aio] 2026-05-20 21:56:53.623156 | aio | 2026-05-20 21:56:53.623274 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-20 21:56:53.623397 | aio | Wednesday 20 May 2026 21:56:53 +0000 (0:00:00.186) 0:01:35.396 ********* 2026-05-20 21:56:54.037651 | aio | ok: [aio] 2026-05-20 21:56:54.037914 | aio | 2026-05-20 21:56:54.038209 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-20 21:56:54.038445 | aio | Wednesday 20 May 2026 21:56:54 +0000 (0:00:00.414) 0:01:35.810 ********* 2026-05-20 21:56:54.597395 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-20 21:56:54.597477 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-20 21:56:54.597489 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-20 21:56:54.597499 | aio | 2026-05-20 21:56:54.597508 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-20 21:56:54.597517 | aio | Wednesday 20 May 2026 21:56:54 +0000 (0:00:00.558) 0:01:36.369 ********* 2026-05-20 21:56:54.999355 | aio | ok: [aio] 2026-05-20 21:56:54.999426 | aio | 2026-05-20 21:56:54.999623 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-20 21:56:54.999668 | aio | Wednesday 20 May 2026 21:56:54 +0000 (0:00:00.403) 0:01:36.772 ********* 2026-05-20 21:56:55.421542 | aio | ok: [aio] 2026-05-20 21:56:55.421616 | aio | 2026-05-20 21:56:55.421675 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-20 21:56:55.422093 | aio | Wednesday 20 May 2026 21:56:55 +0000 (0:00:00.416) 0:01:37.189 ********* 2026-05-20 21:56:55.422136 | aio | 2026-05-20 21:56:55.422141 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-20 21:56:55.422146 | aio | Wednesday 20 May 2026 21:56:55 +0000 (0:00:00.005) 0:01:37.195 ********* 2026-05-20 21:56:55.764220 | aio | ok: [aio] 2026-05-20 21:56:55.764283 | aio | 2026-05-20 21:56:55.764371 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-20 21:56:55.764469 | aio | Wednesday 20 May 2026 21:56:55 +0000 (0:00:00.342) 0:01:37.537 ********* 2026-05-20 21:56:55.806594 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-20 21:56:55.806756 | aio | 2026-05-20 21:56:55.806994 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-20 21:56:55.807226 | aio | Wednesday 20 May 2026 21:56:55 +0000 (0:00:00.042) 0:01:37.579 ********* 2026-05-20 21:56:56.837187 | aio | ok: [aio] 2026-05-20 21:56:56.837261 | aio | 2026-05-20 21:56:56.837322 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-20 21:56:56.837415 | aio | Wednesday 20 May 2026 21:56:56 +0000 (0:00:01.030) 0:01:38.610 ********* 2026-05-20 21:56:57.493706 | aio | ok: [aio] => (item=chronyd) 2026-05-20 21:56:57.493901 | aio | ok: [aio] => (item=sshd) 2026-05-20 21:56:57.494104 | aio | 2026-05-20 21:56:57.494326 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-20 21:56:57.494567 | aio | Wednesday 20 May 2026 21:56:57 +0000 (0:00:00.655) 0:01:39.266 ********* 2026-05-20 21:56:57.775489 | aio | ok: [aio] 2026-05-20 21:56:57.775682 | aio | 2026-05-20 21:56:57.776032 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-20 21:56:57.776258 | aio | Wednesday 20 May 2026 21:56:57 +0000 (0:00:00.282) 0:01:39.548 ********* 2026-05-20 21:56:57.963831 | aio | ok: [aio] 2026-05-20 21:56:57.963910 | aio | 2026-05-20 21:56:57.963934 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-20 21:56:57.964062 | aio | Wednesday 20 May 2026 21:56:57 +0000 (0:00:00.187) 0:01:39.736 ********* 2026-05-20 21:56:58.199015 | aio | ok: [aio] 2026-05-20 21:56:58.199087 | aio | 2026-05-20 21:56:58.199416 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-20 21:56:58.199465 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.235) 0:01:39.972 ********* 2026-05-20 21:56:58.394391 | aio | ok: [aio] 2026-05-20 21:56:58.394484 | aio | 2026-05-20 21:56:58.394502 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-20 21:56:58.394625 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.195) 0:01:40.167 ********* 2026-05-20 21:56:58.608022 | aio | ok: [aio] => (item=aio) 2026-05-20 21:56:58.608088 | aio | 2026-05-20 21:56:58.608304 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-20 21:56:58.608348 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.213) 0:01:40.381 ********* 2026-05-20 21:56:58.648686 | aio | ok: [aio] 2026-05-20 21:56:58.648754 | aio | 2026-05-20 21:56:58.648987 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-20 21:56:58.649032 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.040) 0:01:40.421 ********* 2026-05-20 21:56:58.698192 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-20 21:56:58.698271 | aio | 2026-05-20 21:56:58.698287 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-20 21:56:58.698416 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.049) 0:01:40.471 ********* 2026-05-20 21:56:58.731013 | aio | skipping: [aio] 2026-05-20 21:56:58.731101 | aio | 2026-05-20 21:56:58.731346 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-20 21:56:58.731391 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.032) 0:01:40.504 ********* 2026-05-20 21:56:58.769074 | aio | skipping: [aio] => (item=aio) 2026-05-20 21:56:58.769160 | aio | skipping: [aio] 2026-05-20 21:56:58.769468 | aio | 2026-05-20 21:56:58.769512 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-20 21:56:58.769517 | aio | Wednesday 20 May 2026 21:56:58 +0000 (0:00:00.038) 0:01:40.542 ********* 2026-05-20 21:56:59.004789 | aio | ok: [aio] 2026-05-20 21:56:59.004920 | aio | 2026-05-20 21:56:59.005203 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-20 21:56:59.005251 | aio | Wednesday 20 May 2026 21:56:59 +0000 (0:00:00.235) 0:01:40.778 ********* 2026-05-20 21:57:05.413617 | aio | ok: [aio] 2026-05-20 21:57:05.413689 | aio | 2026-05-20 21:57:05.413776 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-20 21:57:05.413877 | aio | Wednesday 20 May 2026 21:57:05 +0000 (0:00:06.409) 0:01:47.187 ********* 2026-05-20 21:57:10.864749 | aio | ok: [aio] 2026-05-20 21:57:10.864820 | aio | 2026-05-20 21:57:10.864993 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-20 21:57:10.865009 | aio | Wednesday 20 May 2026 21:57:10 +0000 (0:00:05.451) 0:01:52.638 ********* 2026-05-20 21:57:24.870250 | aio | ok: [aio] 2026-05-20 21:57:24.870334 | aio | 2026-05-20 21:57:24.870395 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-20 21:57:24.870521 | aio | Wednesday 20 May 2026 21:57:24 +0000 (0:00:14.005) 0:02:06.643 ********* 2026-05-20 21:57:24.936543 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-20 21:57:24.936595 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-20 21:57:24.937089 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-20 21:57:24.937135 | aio | skipping: [aio] 2026-05-20 21:57:24.937141 | aio | 2026-05-20 21:57:24.937146 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-20 21:57:24.937151 | aio | Wednesday 20 May 2026 21:57:24 +0000 (0:00:00.066) 0:02:06.709 ********* 2026-05-20 21:57:31.059060 | aio | ok: [aio] 2026-05-20 21:57:31.059122 | aio | 2026-05-20 21:57:31.059233 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-20 21:57:31.059362 | aio | Wednesday 20 May 2026 21:57:31 +0000 (0:00:06.122) 0:02:12.832 ********* 2026-05-20 21:57:39.641374 | aio | ok: [aio] 2026-05-20 21:57:39.641460 | aio | 2026-05-20 21:57:39.641637 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-20 21:57:39.641653 | aio | Wednesday 20 May 2026 21:57:39 +0000 (0:00:08.582) 0:02:21.414 ********* 2026-05-20 21:57:39.693996 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-20 21:57:39.694078 | aio | 2026-05-20 21:57:39.694137 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-20 21:57:39.694276 | aio | Wednesday 20 May 2026 21:57:39 +0000 (0:00:00.052) 0:02:21.467 ********* 2026-05-20 21:57:39.727728 | aio | ok: [aio] 2026-05-20 21:57:39.727790 | aio | 2026-05-20 21:57:39.728019 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-20 21:57:39.728086 | aio | Wednesday 20 May 2026 21:57:39 +0000 (0:00:00.033) 0:02:21.501 ********* 2026-05-20 21:57:45.710296 | aio | ok: [aio] 2026-05-20 21:57:45.710340 | aio | 2026-05-20 21:57:45.710346 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-20 21:57:45.710350 | aio | Wednesday 20 May 2026 21:57:45 +0000 (0:00:05.982) 0:02:27.483 ********* 2026-05-20 21:57:45.744310 | aio | ok: [aio] 2026-05-20 21:57:45.744361 | aio | 2026-05-20 21:57:45.744651 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-20 21:57:45.744699 | aio | Wednesday 20 May 2026 21:57:45 +0000 (0:00:00.034) 0:02:27.517 ********* 2026-05-20 21:57:45.782915 | aio | skipping: [aio] => (item=1) 2026-05-20 21:57:45.783025 | aio | skipping: [aio] => (item=1) 2026-05-20 21:57:45.783662 | aio | skipping: [aio] => (item=1) 2026-05-20 21:57:45.783703 | aio | skipping: [aio] 2026-05-20 21:57:45.783712 | aio | 2026-05-20 21:57:45.783718 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-20 21:57:45.783724 | aio | Wednesday 20 May 2026 21:57:45 +0000 (0:00:00.038) 0:02:27.556 ********* 2026-05-20 21:57:45.813367 | aio | skipping: [aio] 2026-05-20 21:57:45.813425 | aio | 2026-05-20 21:57:45.813522 | aio | PLAY RECAP ********************************************************************* 2026-05-20 21:57:45.815843 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-05-20 21:57:45.815911 | aio | 2026-05-20 21:57:45.815922 | aio | 2026-05-20 21:57:45.815942 | aio | TASKS RECAP ******************************************************************** 2026-05-20 21:57:45.815952 | aio | Wednesday 20 May 2026 21:57:45 +0000 (0:00:00.030) 0:02:27.587 ********* 2026-05-20 21:57:45.815961 | aio | =============================================================================== 2026-05-20 21:57:45.815969 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 15.06s 2026-05-20 21:57:45.815978 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.01s 2026-05-20 21:57:45.815986 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 8.58s 2026-05-20 21:57:45.815995 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.06s 2026-05-20 21:57:45.816003 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.57s 2026-05-20 21:57:45.816045 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.48s 2026-05-20 21:57:45.816058 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.47s 2026-05-20 21:57:45.816070 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.41s 2026-05-20 21:57:45.816081 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.12s 2026-05-20 21:57:45.816092 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.07s 2026-05-20 21:57:45.816103 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.01s 2026-05-20 21:57:45.816113 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.98s 2026-05-20 21:57:45.816122 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.45s 2026-05-20 21:57:45.816130 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.14s 2026-05-20 21:57:45.816139 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s 2026-05-20 21:57:45.816147 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.12s 2026-05-20 21:57:45.816155 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.27s 2026-05-20 21:57:45.816164 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.01s 2026-05-20 21:57:45.816180 | aio | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.32s 2026-05-20 21:57:45.816189 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 1.31s 2026-05-20 21:57:45.898233 | aio | INFO [default > idempotence] Executed: Successful 2026-05-20 21:57:45.907614 | aio | INFO [default > side_effect] Executing 2026-05-20 21:57:45.907965 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-20 21:57:45.913011 | aio | INFO [default > verify] Executing 2026-05-20 21:57:46.524531 | aio | 2026-05-20 21:57:46.524776 | aio | PLAY [Verify] ****************************************************************** 2026-05-20 21:57:46.524957 | aio | 2026-05-20 21:57:46.525164 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-20 21:57:46.525349 | aio | Wednesday 20 May 2026 21:57:46 +0000 (0:00:00.006) 0:00:00.006 ********* 2026-05-20 21:57:47.642546 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-20 21:57:47.642612 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-20 21:57:47.642625 | aio | interpreter could change the meaning of that path. See 2026-05-20 21:57:47.642635 | aio | https://docs.ansible.com/ansible- 2026-05-20 21:57:47.642645 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-20 21:57:47.650755 | aio | ok: [aio] 2026-05-20 21:57:47.650797 | aio | 2026-05-20 21:57:47.650814 | aio | TASK [Get cluster health status] *********************************************** 2026-05-20 21:57:47.650826 | aio | Wednesday 20 May 2026 21:57:47 +0000 (0:00:01.125) 0:00:01.132 ********* 2026-05-20 21:57:57.713932 | aio | ok: [aio] 2026-05-20 21:57:57.714220 | aio | 2026-05-20 21:57:57.714258 | aio | TASK [Print cluster health status] ********************************************* 2026-05-20 21:57:57.714336 | aio | Wednesday 20 May 2026 21:57:57 +0000 (0:00:10.063) 0:00:11.195 ********* 2026-05-20 21:57:57.745829 | aio | ok: [aio] => { 2026-05-20 21:57:57.746012 | aio | "_ceph_health": { 2026-05-20 21:57:57.746201 | aio | "changed": false, 2026-05-20 21:57:57.746392 | aio | "cmd": [ 2026-05-20 21:57:57.746581 | aio | "cephadm", 2026-05-20 21:57:57.746772 | aio | "shell", 2026-05-20 21:57:57.746948 | aio | "--", 2026-05-20 21:57:57.747134 | aio | "ceph", 2026-05-20 21:57:57.747318 | aio | "health" 2026-05-20 21:57:57.747501 | aio | ], 2026-05-20 21:57:57.747731 | aio | "delta": "0:00:09.797208", 2026-05-20 21:57:57.747991 | aio | "end": "2026-05-20 21:57:57.679575", 2026-05-20 21:57:57.748186 | aio | "failed": false, 2026-05-20 21:57:57.748370 | aio | "msg": "", 2026-05-20 21:57:57.748556 | aio | "rc": 0, 2026-05-20 21:57:57.748799 | aio | "start": "2026-05-20 21:57:47.882367", 2026-05-20 21:57:57.748981 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-05-20 21:57:57.749157 | aio | "stderr_lines": [ 2026-05-20 21:57:57.749365 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-05-20 21:57:57.749565 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-05-20 21:57:57.749746 | aio | ], 2026-05-20 21:57:57.749937 | aio | "stdout": "HEALTH_OK", 2026-05-20 21:57:57.750122 | aio | "stdout_lines": [ 2026-05-20 21:57:57.750309 | aio | "HEALTH_OK" 2026-05-20 21:57:57.750494 | aio | ] 2026-05-20 21:57:57.750680 | aio | } 2026-05-20 21:57:57.750865 | aio | } 2026-05-20 21:57:57.751040 | aio | 2026-05-20 21:57:57.751236 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-05-20 21:57:57.751434 | aio | Wednesday 20 May 2026 21:57:57 +0000 (0:00:00.032) 0:00:11.228 ********* 2026-05-20 21:57:57.772115 | aio | ok: [aio] => { 2026-05-20 21:57:57.772224 | aio | "changed": false, 2026-05-20 21:57:57.772346 | aio | "msg": "All assertions passed" 2026-05-20 21:57:57.772463 | aio | } 2026-05-20 21:57:57.772572 | aio | 2026-05-20 21:57:57.772715 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-05-20 21:57:57.772828 | aio | Wednesday 20 May 2026 21:57:57 +0000 (0:00:00.026) 0:00:11.254 ********* 2026-05-20 21:58:04.245313 | aio | changed: [aio] 2026-05-20 21:58:04.245442 | aio | 2026-05-20 21:58:04.245657 | aio | TASK [Create a test Ceph key] ************************************************** 2026-05-20 21:58:04.245866 | aio | Wednesday 20 May 2026 21:58:04 +0000 (0:00:06.472) 0:00:17.727 ********* 2026-05-20 21:58:06.270854 | aio | changed: [aio] 2026-05-20 21:58:06.270922 | aio | 2026-05-20 21:58:06.270934 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-05-20 21:58:06.270944 | aio | Wednesday 20 May 2026 21:58:06 +0000 (0:00:02.025) 0:00:19.752 ********* 2026-05-20 21:58:07.278241 | aio | ok: [aio] 2026-05-20 21:58:07.278287 | aio | 2026-05-20 21:58:07.278295 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-05-20 21:58:07.278301 | aio | Wednesday 20 May 2026 21:58:07 +0000 (0:00:01.007) 0:00:20.760 ********* 2026-05-20 21:58:07.319775 | aio | ok: [aio] => { 2026-05-20 21:58:07.319859 | aio | "changed": false, 2026-05-20 21:58:07.320489 | aio | "msg": "All assertions passed" 2026-05-20 21:58:07.320509 | aio | } 2026-05-20 21:58:07.320516 | aio | 2026-05-20 21:58:07.320522 | aio | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-05-20 21:58:07.320528 | aio | Wednesday 20 May 2026 21:58:07 +0000 (0:00:00.042) 0:00:20.802 ********* 2026-05-20 21:58:08.242455 | aio | ok: [aio] 2026-05-20 21:58:08.242532 | aio | 2026-05-20 21:58:08.242863 | aio | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-05-20 21:58:08.242906 | aio | Wednesday 20 May 2026 21:58:08 +0000 (0:00:00.922) 0:00:21.724 ********* 2026-05-20 21:58:08.277744 | aio | ok: [aio] => { 2026-05-20 21:58:08.278118 | aio | "changed": false, 2026-05-20 21:58:08.278139 | aio | "msg": "All assertions passed" 2026-05-20 21:58:08.278150 | aio | } 2026-05-20 21:58:08.278202 | aio | 2026-05-20 21:58:08.278348 | aio | PLAY RECAP ********************************************************************* 2026-05-20 21:58:08.279711 | aio | aio : ok=10 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-05-20 21:58:08.279731 | aio | 2026-05-20 21:58:08.279738 | aio | 2026-05-20 21:58:08.279744 | aio | TASKS RECAP ******************************************************************** 2026-05-20 21:58:08.279750 | aio | Wednesday 20 May 2026 21:58:08 +0000 (0:00:00.035) 0:00:21.760 ********* 2026-05-20 21:58:08.279755 | aio | =============================================================================== 2026-05-20 21:58:08.279761 | aio | Get cluster health status ---------------------------------------------- 10.06s 2026-05-20 21:58:08.279766 | aio | Create a test Ceph pool ------------------------------------------------- 6.47s 2026-05-20 21:58:08.279772 | aio | Create a test Ceph key -------------------------------------------------- 2.03s 2026-05-20 21:58:08.279778 | aio | Gathering Facts --------------------------------------------------------- 1.13s 2026-05-20 21:58:08.279784 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.01s 2026-05-20 21:58:08.279790 | aio | Retrieve info for the test Ceph key using the legacy key module --------- 0.92s 2026-05-20 21:58:08.279796 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-05-20 21:58:08.279803 | aio | Assert that the legacy key module info state returns the correct key ---- 0.04s 2026-05-20 21:58:08.279872 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-05-20 21:58:08.279983 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-05-20 21:58:08.340625 | aio | INFO [default > verify] Executed: Successful 2026-05-20 21:58:08.351668 | aio | INFO [default > cleanup] Executing 2026-05-20 21:58:08.351944 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-20 21:58:08.357011 | aio | INFO [default > destroy] Executing 2026-05-20 21:58:08.357052 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-20 21:58:08.357142 | aio | INFO [default > destroy] Executed: Successful 2026-05-20 21:58:08.357425 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-05-20 21:58:08.659536 | aio | ok: Runtime: 0:11:48.970539 2026-05-20 21:58:08.673688 | 2026-05-20 21:58:08.673855 | PLAY RECAP 2026-05-20 21:58:08.673902 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-20 21:58:08.673924 | 2026-05-20 21:58:08.828050 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-20 21:58:08.832081 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-20 21:58:09.508492 | 2026-05-20 21:58:09.508627 | PLAY [all] 2026-05-20 21:58:09.519713 | 2026-05-20 21:58:09.519792 | TASK [fetch-output : Set log path for multiple nodes] 2026-05-20 21:58:09.564778 | aio | skipping: Conditional result was False 2026-05-20 21:58:09.576689 | 2026-05-20 21:58:09.576859 | TASK [fetch-output : Set log path for single node] 2026-05-20 21:58:09.625248 | aio | ok 2026-05-20 21:58:09.630906 | 2026-05-20 21:58:09.630977 | LOOP [fetch-output : Ensure local output dirs] 2026-05-20 21:58:10.044149 | aio -> localhost | ok: "/var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/logs" 2026-05-20 21:58:10.267606 | aio -> localhost | changed: "/var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/artifacts" 2026-05-20 21:58:10.508532 | aio -> localhost | changed: "/var/lib/zuul/builds/e18c6621d71d44918b9d781f82a56adb/work/docs" 2026-05-20 21:58:10.524460 | 2026-05-20 21:58:10.524558 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-05-20 21:58:11.247998 | aio | ok 2026-05-20 21:58:11.248357 | aio | changed: All items complete 2026-05-20 21:58:11.248406 | 2026-05-20 21:58:11.691602 | aio | changed: .d..t...... ./ 2026-05-20 21:58:12.144436 | aio | changed: .d..t...... ./ 2026-05-20 21:58:12.168600 | 2026-05-20 21:58:12.168773 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-05-20 21:58:12.588533 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.007686 2026-05-20 21:58:12.840323 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008694 2026-05-20 21:58:12.863819 | 2026-05-20 21:58:12.863987 | PLAY [all] 2026-05-20 21:58:12.871349 | 2026-05-20 21:58:12.871422 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-05-20 21:58:13.316701 | aio | changed 2026-05-20 21:58:13.323301 | 2026-05-20 21:58:13.323352 | PLAY RECAP 2026-05-20 21:58:13.323398 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-05-20 21:58:13.323422 | 2026-05-20 21:58:13.465667 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-20 21:58:13.467639 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-05-20 21:58:14.134929 | 2026-05-20 21:58:14.135082 | PLAY [localhost] 2026-05-20 21:58:14.146521 | 2026-05-20 21:58:14.146646 | TASK [Generate Zuul manifest] 2026-05-20 21:58:14.173988 | localhost | ok 2026-05-20 21:58:14.193731 | 2026-05-20 21:58:14.193846 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-05-20 21:58:14.592616 | localhost | changed 2026-05-20 21:58:14.606919 | 2026-05-20 21:58:14.607016 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-05-20 21:58:14.639756 | localhost | ok 2026-05-20 21:58:14.649690 | 2026-05-20 21:58:14.649759 | TASK [Upload logs] 2026-05-20 21:58:14.669232 | localhost | ok 2026-05-20 21:58:14.745022 | 2026-05-20 21:58:14.745181 | TASK [Set zuul-log-path fact] 2026-05-20 21:58:14.778192 | localhost | ok 2026-05-20 21:58:14.798722 | 2026-05-20 21:58:14.798897 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-20 21:58:14.828514 | localhost | ok 2026-05-20 21:58:14.838012 | 2026-05-20 21:58:14.838098 | TASK [upload-logs : Create log directories] 2026-05-20 21:58:15.268865 | localhost | changed 2026-05-20 21:58:15.277887 | 2026-05-20 21:58:15.277971 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-05-20 21:58:15.710467 | localhost -> localhost | ok: Runtime: 0:00:00.004683 2026-05-20 21:58:15.719099 | 2026-05-20 21:58:15.719257 | TASK [upload-logs : Upload logs to log server] 2026-05-20 21:58:16.181054 | localhost | Output suppressed because no_log was given 2026-05-20 21:58:16.186508 | 2026-05-20 21:58:16.186604 | LOOP [upload-logs : Compress console log and json output] 2026-05-20 21:58:16.236024 | localhost | skipping: Conditional result was False 2026-05-20 21:58:16.289271 | localhost | skipping: Conditional result was False 2026-05-20 21:58:16.303547 | 2026-05-20 21:58:16.303721 | LOOP [upload-logs : Upload compressed console log and json output] 2026-05-20 21:58:16.370823 | localhost | skipping: Conditional result was False 2026-05-20 21:58:16.371175 | 2026-05-20 21:58:16.372288 | localhost | skipping: Conditional result was False 2026-05-20 21:58:16.387812 | 2026-05-20 21:58:16.387956 | LOOP [upload-logs : Upload console log and json output]