2026-05-19 23:10:08.800709 | Job console starting 2026-05-19 23:10:08.810844 | Updating git repos 2026-05-19 23:10:08.840395 | Cloning repos into workspace 2026-05-19 23:10:08.879293 | Restoring repo states 2026-05-19 23:10:08.886711 | Merging changes 2026-05-19 23:10:09.171781 | Checking out repos 2026-05-19 23:10:09.200496 | Preparing playbooks 2026-05-19 23:10:10.265615 | Running Ansible setup 2026-05-19 23:10:13.483706 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-19 23:10:14.080644 | 2026-05-19 23:10:14.080793 | PLAY [localhost] 2026-05-19 23:10:14.087838 | 2026-05-19 23:10:14.087907 | TASK [Gathering Facts] 2026-05-19 23:10:14.926001 | localhost | ok 2026-05-19 23:10:14.936118 | 2026-05-19 23:10:14.936193 | TASK [Setup log path fact] 2026-05-19 23:10:14.955661 | localhost | ok 2026-05-19 23:10:14.968226 | 2026-05-19 23:10:14.968290 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-19 23:10:14.994794 | localhost | ok 2026-05-19 23:10:15.000297 | 2026-05-19 23:10:15.000367 | TASK [emit-job-header : Print job information] 2026-05-19 23:10:15.041177 | # Job Information 2026-05-19 23:10:15.041414 | Ansible Version: 2.16.18 2026-05-19 23:10:15.041483 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-05-19 23:10:15.041533 | Pipeline: check 2026-05-19 23:10:15.041578 | Executor: 2d72f0692154 2026-05-19 23:10:15.041621 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-05-19 23:10:15.041672 | Event ID: cea65f80-53d7-11f1-93af-c09ae820fbee 2026-05-19 23:10:15.047885 | 2026-05-19 23:10:15.047953 | LOOP [emit-job-header : Print node information] 2026-05-19 23:10:15.143989 | localhost | ok: 2026-05-19 23:10:15.144141 | localhost | # Node Information 2026-05-19 23:10:15.144170 | localhost | Inventory Hostname: aio 2026-05-19 23:10:15.144192 | localhost | Hostname: np0000175108 2026-05-19 23:10:15.144212 | localhost | Username: zuul 2026-05-19 23:10:15.144236 | localhost | Distro: Ubuntu 22.04 2026-05-19 23:10:15.144257 | localhost | Provider: yul1 2026-05-19 23:10:15.144277 | localhost | Region: ca-ymq-1 2026-05-19 23:10:15.144295 | localhost | Label: ubuntu-jammy 2026-05-19 23:10:15.144313 | localhost | Product Name: OpenStack Nova 2026-05-19 23:10:15.144331 | localhost | Interface IP: 162.253.55.100 2026-05-19 23:10:15.156204 | 2026-05-19 23:10:15.156308 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-05-19 23:10:15.514756 | localhost -> localhost | changed 2026-05-19 23:10:15.524525 | 2026-05-19 23:10:15.524612 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-05-19 23:10:16.287467 | localhost -> localhost | changed 2026-05-19 23:10:16.299309 | 2026-05-19 23:10:16.299376 | PLAY [all] 2026-05-19 23:10:16.306887 | 2026-05-19 23:10:16.306959 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-05-19 23:10:16.523461 | aio -> localhost | ok 2026-05-19 23:10:16.533623 | 2026-05-19 23:10:16.533716 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-05-19 23:10:16.567590 | aio | ok 2026-05-19 23:10:16.584122 | aio | included: /var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-05-19 23:10:16.589367 | 2026-05-19 23:10:16.589427 | TASK [add-build-sshkey : Create Temp SSH key] 2026-05-19 23:10:17.446659 | aio -> localhost | Generating public/private rsa key pair. 2026-05-19 23:10:17.446951 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/58bbe4af7d0e4362816d88b81265bd0b_id_rsa 2026-05-19 23:10:17.447019 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/58bbe4af7d0e4362816d88b81265bd0b_id_rsa.pub 2026-05-19 23:10:17.447078 | aio -> localhost | The key fingerprint is: 2026-05-19 23:10:17.447132 | aio -> localhost | SHA256:Rx3thpZQfMQ+vHkKE9i2AapKtzm5Q4wshwkcJPcnBMA zuul-build-sshkey 2026-05-19 23:10:17.447207 | aio -> localhost | The key's randomart image is: 2026-05-19 23:10:17.447264 | aio -> localhost | +---[RSA 3072]----+ 2026-05-19 23:10:17.447330 | aio -> localhost | |=oo.. oo+. | 2026-05-19 23:10:17.447388 | aio -> localhost | |.E o o...+ | 2026-05-19 23:10:17.447428 | aio -> localhost | |. . o . ..=.B | 2026-05-19 23:10:17.447459 | aio -> localhost | |.. o ... O * | 2026-05-19 23:10:17.447491 | aio -> localhost | | . + o .S .o = + | 2026-05-19 23:10:17.447531 | aio -> localhost | | + = = . + o .| 2026-05-19 23:10:17.447576 | aio -> localhost | | + + + o o | 2026-05-19 23:10:17.447621 | aio -> localhost | | . * . | 2026-05-19 23:10:17.447674 | aio -> localhost | | .+ | 2026-05-19 23:10:17.447724 | aio -> localhost | +----[SHA256]-----+ 2026-05-19 23:10:17.447853 | aio -> localhost | ok: Runtime: 0:00:00.483567 2026-05-19 23:10:17.456268 | 2026-05-19 23:10:17.456361 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-05-19 23:10:17.493274 | aio | ok 2026-05-19 23:10:17.504893 | aio | included: /var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-05-19 23:10:17.512585 | 2026-05-19 23:10:17.512650 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-05-19 23:10:17.539095 | aio | skipping: Conditional result was False 2026-05-19 23:10:17.549552 | 2026-05-19 23:10:17.549657 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-05-19 23:10:17.992131 | aio | changed 2026-05-19 23:10:17.998585 | 2026-05-19 23:10:17.998649 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-05-19 23:10:18.172669 | aio | ok 2026-05-19 23:10:18.180533 | 2026-05-19 23:10:18.180626 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-05-19 23:10:18.629886 | aio | changed 2026-05-19 23:10:18.823660 | 2026-05-19 23:10:18.823835 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-05-19 23:10:19.261601 | aio | changed 2026-05-19 23:10:19.268497 | 2026-05-19 23:10:19.268588 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-05-19 23:10:19.294173 | aio | skipping: Conditional result was False 2026-05-19 23:10:19.304504 | 2026-05-19 23:10:19.304630 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-05-19 23:10:19.644134 | aio -> localhost | changed 2026-05-19 23:10:19.659314 | 2026-05-19 23:10:19.659389 | TASK [add-build-sshkey : Add back temp key] 2026-05-19 23:10:19.946388 | aio -> localhost | Identity added: /var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/58bbe4af7d0e4362816d88b81265bd0b_id_rsa (zuul-build-sshkey) 2026-05-19 23:10:19.946586 | aio -> localhost | ok: Runtime: 0:00:00.014276 2026-05-19 23:10:19.953147 | 2026-05-19 23:10:19.953231 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-05-19 23:10:20.239268 | aio | ok 2026-05-19 23:10:20.244286 | 2026-05-19 23:10:20.244349 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-05-19 23:10:20.267449 | aio | skipping: Conditional result was False 2026-05-19 23:10:20.282187 | 2026-05-19 23:10:20.282250 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-05-19 23:10:20.581535 | aio | ok 2026-05-19 23:10:20.588487 | 2026-05-19 23:10:20.588548 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-05-19 23:10:21.640270 | aio | Output suppressed because no_log was given 2026-05-19 23:10:21.678095 | 2026-05-19 23:10:21.678208 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-05-19 23:10:21.854567 | aio | ok: "logs" 2026-05-19 23:10:21.854791 | aio | ok: All items complete 2026-05-19 23:10:21.854821 | 2026-05-19 23:10:22.005776 | aio | ok: "artifacts" 2026-05-19 23:10:22.160126 | aio | ok: "docs" 2026-05-19 23:10:22.171892 | 2026-05-19 23:10:22.172123 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-05-19 23:10:22.356274 | aio | changed: "logs" 2026-05-19 23:10:22.514435 | aio | changed: "artifacts" 2026-05-19 23:10:22.665958 | aio | changed: "docs" 2026-05-19 23:10:22.688622 | 2026-05-19 23:10:22.688770 | PLAY RECAP 2026-05-19 23:10:22.688820 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-05-19 23:10:22.688859 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 23:10:22.688885 | 2026-05-19 23:10:22.836155 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-19 23:10:22.839992 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-19 23:10:23.428003 | 2026-05-19 23:10:23.428111 | PLAY [all] 2026-05-19 23:10:23.442775 | 2026-05-19 23:10:23.442888 | TASK [setup-uv : Extract archive] 2026-05-19 23:10:25.690393 | aio | changed 2026-05-19 23:10:25.698626 | 2026-05-19 23:10:25.698754 | TASK [setup-uv : Print version] 2026-05-19 23:10:26.283716 | aio | uv 0.8.13 2026-05-19 23:10:26.235773 | aio | ok: Runtime: 0:00:00.020932 2026-05-19 23:10:26.244359 | 2026-05-19 23:10:26.244424 | TASK [Install Ansible collection siblings] 2026-05-19 23:10:26.676517 | aio | ok: 2026-05-19 23:10:26.676659 | aio | Skipping community.general: no checked-out sibling 2026-05-19 23:10:26.676688 | aio | Skipping ansible.utils: no checked-out sibling 2026-05-19 23:10:26.676710 | aio | Skipping vexxhost.containers: no checked-out sibling 2026-05-19 23:10:26.678328 | 2026-05-19 23:10:26.678372 | PLAY RECAP 2026-05-19 23:10:26.678413 | aio | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 23:10:26.678435 | 2026-05-19 23:10:26.772900 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-19 23:10:26.776512 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-19 23:10:27.337443 | 2026-05-19 23:10:27.337571 | PLAY [all] 2026-05-19 23:10:27.350340 | 2026-05-19 23:10:27.350467 | TASK [Copy inventory file for Zuul] 2026-05-19 23:10:28.160275 | aio | changed 2026-05-19 23:10:28.189984 | 2026-05-19 23:10:28.190132 | TASK [Switch "ansible_host" to private IP] 2026-05-19 23:10:28.598269 | aio | changed: 1 replacements made 2026-05-19 23:10:28.603297 | 2026-05-19 23:10:28.603363 | TASK [Run Molecule scenario] 2026-05-19 23:10:29.425542 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-05-19 23:10:30.176461 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-05-19 23:10:30.353432 | aio | Using CPython 3.13.7 2026-05-19 23:10:30.353483 | aio | Creating virtual environment at: .venv 2026-05-19 23:10:30.669186 | aio | Downloading cryptography (4.3MiB) 2026-05-19 23:10:30.669786 | aio | Downloading netaddr (2.2MiB) 2026-05-19 23:10:30.678580 | aio | Downloading pygments (1.2MiB) 2026-05-19 23:10:30.680694 | aio | Downloading ansible-core (2.1MiB) 2026-05-19 23:10:30.848704 | aio | Downloading netaddr 2026-05-19 23:10:30.888954 | aio | Downloading cryptography 2026-05-19 23:10:30.900733 | aio | Downloading pygments 2026-05-19 23:10:31.020667 | aio | Downloading ansible-core 2026-05-19 23:10:31.052181 | aio | Installed 36 packages in 30ms 2026-05-19 23:10:32.175142 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-05-19 23:10:32.175239 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-05-19 23:10:32.796185 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-05-19 23:10:32.796283 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-05-19 23:10:46.580129 | aio | INFO [default > dependency] Executing 2026-05-19 23:10:46.580298 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-05-19 23:10:46.580473 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-05-19 23:10:46.580643 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-05-19 23:10:46.585746 | aio | INFO [default > cleanup] Executing 2026-05-19 23:10:46.586064 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 23:10:46.591216 | aio | INFO [default > destroy] Executing 2026-05-19 23:10:46.591278 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-19 23:10:46.591342 | aio | INFO [default > destroy] Executed: Successful 2026-05-19 23:10:46.596339 | aio | INFO [default > syntax] Executing 2026-05-19 23:10:47.547161 | aio | 2026-05-19 23:10:47.547464 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-05-19 23:10:47.604120 | aio | INFO [default > syntax] Executed: Successful 2026-05-19 23:10:47.613578 | aio | INFO [default > create] Executing 2026-05-19 23:10:47.615397 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 23:10:47.621819 | aio | INFO [default > prepare] Executing 2026-05-19 23:10:48.302817 | aio | 2026-05-19 23:10:48.302933 | aio | PLAY [Prepare] ***************************************************************** 2026-05-19 23:10:48.303155 | aio | 2026-05-19 23:10:48.303499 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:10:48.303734 | aio | Tuesday 19 May 2026 23:10:48 +0000 (0:00:00.030) 0:00:00.030 *********** 2026-05-19 23:10:49.401084 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 23:10:49.401158 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 23:10:49.401232 | aio | interpreter could change the meaning of that path. See 2026-05-19 23:10:49.401319 | aio | https://docs.ansible.com/ansible- 2026-05-19 23:10:49.401416 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 23:10:49.408553 | aio | ok: [aio] 2026-05-19 23:10:49.408690 | aio | 2026-05-19 23:10:49.408820 | aio | TASK [Configure short hostname] ************************************************ 2026-05-19 23:10:49.408966 | aio | Tuesday 19 May 2026 23:10:49 +0000 (0:00:01.106) 0:00:01.137 *********** 2026-05-19 23:10:51.031631 | aio | changed: [aio] 2026-05-19 23:10:51.031758 | aio | 2026-05-19 23:10:51.031972 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-05-19 23:10:51.032178 | aio | Tuesday 19 May 2026 23:10:51 +0000 (0:00:01.622) 0:00:02.759 *********** 2026-05-19 23:10:51.286130 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-05-19 23:10:51.286319 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-05-19 23:10:51.286530 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-05-19 23:10:51.294158 | aio | changed: [aio] 2026-05-19 23:10:51.294338 | aio | 2026-05-19 23:10:51.294537 | aio | TASK [Update apt cache] ******************************************************** 2026-05-19 23:10:51.294747 | aio | Tuesday 19 May 2026 23:10:51 +0000 (0:00:00.262) 0:00:03.022 *********** 2026-05-19 23:10:57.908369 | aio | changed: [aio] 2026-05-19 23:10:57.908614 | aio | 2026-05-19 23:10:57.908629 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-05-19 23:10:57.908639 | aio | 2026-05-19 23:10:57.908705 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:10:57.908832 | aio | Tuesday 19 May 2026 23:10:57 +0000 (0:00:06.614) 0:00:09.637 *********** 2026-05-19 23:10:58.611436 | aio | ok: [aio] 2026-05-19 23:10:58.611620 | aio | 2026-05-19 23:10:58.612105 | aio | TASK [Install depedencies] ***************************************************** 2026-05-19 23:10:58.612359 | aio | Tuesday 19 May 2026 23:10:58 +0000 (0:00:00.702) 0:00:10.339 *********** 2026-05-19 23:11:19.129795 | aio | changed: [aio] 2026-05-19 23:11:19.129977 | aio | 2026-05-19 23:11:19.130184 | aio | TASK [Start up service] ******************************************************** 2026-05-19 23:11:19.130401 | aio | Tuesday 19 May 2026 23:11:19 +0000 (0:00:20.518) 0:00:30.858 *********** 2026-05-19 23:11:19.660149 | aio | ok: [aio] 2026-05-19 23:11:19.660347 | aio | 2026-05-19 23:11:19.660652 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-05-19 23:11:19.660884 | aio | Tuesday 19 May 2026 23:11:19 +0000 (0:00:00.530) 0:00:31.388 *********** 2026-05-19 23:11:19.958890 | aio | ok: [aio] 2026-05-19 23:11:19.959095 | aio | 2026-05-19 23:11:19.959344 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-05-19 23:11:19.959584 | aio | Tuesday 19 May 2026 23:11:19 +0000 (0:00:00.298) 0:00:31.687 *********** 2026-05-19 23:11:20.555054 | aio | changed: [aio] 2026-05-19 23:11:20.555225 | aio | 2026-05-19 23:11:20.555453 | aio | TASK [Get list of all loopback devices] **************************************** 2026-05-19 23:11:20.555673 | aio | Tuesday 19 May 2026 23:11:20 +0000 (0:00:00.596) 0:00:32.283 *********** 2026-05-19 23:11:20.732262 | aio | ok: [aio] 2026-05-19 23:11:20.732459 | aio | 2026-05-19 23:11:20.732744 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-05-19 23:11:20.732970 | aio | Tuesday 19 May 2026 23:11:20 +0000 (0:00:00.177) 0:00:32.460 *********** 2026-05-19 23:11:20.745331 | aio | skipping: [aio] 2026-05-19 23:11:20.745529 | aio | 2026-05-19 23:11:20.745742 | aio | TASK [Create devices for Ceph] ************************************************* 2026-05-19 23:11:20.745955 | aio | Tuesday 19 May 2026 23:11:20 +0000 (0:00:00.013) 0:00:32.474 *********** 2026-05-19 23:11:21.257706 | aio | changed: [aio] => (item=osd0) 2026-05-19 23:11:21.257929 | aio | changed: [aio] => (item=osd1) 2026-05-19 23:11:21.258125 | aio | changed: [aio] => (item=osd2) 2026-05-19 23:11:21.258320 | aio | 2026-05-19 23:11:21.258541 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-05-19 23:11:21.258757 | aio | Tuesday 19 May 2026 23:11:21 +0000 (0:00:00.511) 0:00:32.986 *********** 2026-05-19 23:11:21.886581 | aio | changed: [aio] => (item=osd0) 2026-05-19 23:11:21.886849 | aio | changed: [aio] => (item=osd1) 2026-05-19 23:11:21.887119 | aio | changed: [aio] => (item=osd2) 2026-05-19 23:11:21.887356 | aio | 2026-05-19 23:11:21.887666 | aio | TASK [Start loop devices] ****************************************************** 2026-05-19 23:11:21.887923 | aio | Tuesday 19 May 2026 23:11:21 +0000 (0:00:00.628) 0:00:33.614 *********** 2026-05-19 23:11:22.583365 | aio | changed: [aio] => (item=osd0) 2026-05-19 23:11:22.583570 | aio | changed: [aio] => (item=osd1) 2026-05-19 23:11:22.583838 | aio | changed: [aio] => (item=osd2) 2026-05-19 23:11:22.584004 | aio | 2026-05-19 23:11:22.584216 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-05-19 23:11:22.584435 | aio | Tuesday 19 May 2026 23:11:22 +0000 (0:00:00.697) 0:00:34.311 *********** 2026-05-19 23:11:25.513549 | aio | changed: [aio] => (item=osd0) 2026-05-19 23:11:25.513656 | aio | changed: [aio] => (item=osd1) 2026-05-19 23:11:25.513773 | aio | changed: [aio] => (item=osd2) 2026-05-19 23:11:25.513889 | aio | 2026-05-19 23:11:25.514057 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-05-19 23:11:25.514189 | aio | Tuesday 19 May 2026 23:11:25 +0000 (0:00:02.930) 0:00:37.242 *********** 2026-05-19 23:11:27.334892 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-05-19 23:11:27.335072 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-05-19 23:11:27.335284 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-05-19 23:11:27.335467 | aio | 2026-05-19 23:11:27.335666 | aio | PLAY RECAP ********************************************************************* 2026-05-19 23:11:27.335893 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-05-19 23:11:27.336063 | aio | 2026-05-19 23:11:27.336243 | aio | 2026-05-19 23:11:27.336442 | aio | TASKS RECAP ******************************************************************** 2026-05-19 23:11:27.336714 | aio | Tuesday 19 May 2026 23:11:27 +0000 (0:00:01.820) 0:00:39.062 *********** 2026-05-19 23:11:27.336872 | aio | =============================================================================== 2026-05-19 23:11:27.337071 | aio | Install depedencies ---------------------------------------------------- 20.52s 2026-05-19 23:11:27.337353 | aio | Update apt cache -------------------------------------------------------- 6.61s 2026-05-19 23:11:27.337550 | aio | Create a volume group for each loop device ------------------------------ 2.93s 2026-05-19 23:11:27.337795 | aio | Create a logical volume for each loop device ---------------------------- 1.82s 2026-05-19 23:11:27.337971 | aio | Configure short hostname ------------------------------------------------ 1.62s 2026-05-19 23:11:27.338161 | aio | Gathering Facts --------------------------------------------------------- 1.11s 2026-05-19 23:11:27.338352 | aio | Gathering Facts --------------------------------------------------------- 0.70s 2026-05-19 23:11:27.338538 | aio | Start loop devices ------------------------------------------------------ 0.70s 2026-05-19 23:11:27.338753 | aio | Set permissions on loopback devices ------------------------------------- 0.63s 2026-05-19 23:11:27.338932 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.60s 2026-05-19 23:11:27.339142 | aio | Start up service -------------------------------------------------------- 0.53s 2026-05-19 23:11:27.339320 | aio | Create devices for Ceph ------------------------------------------------- 0.51s 2026-05-19 23:11:27.339512 | aio | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-05-19 23:11:27.339724 | aio | Ensure hostname inside hosts file --------------------------------------- 0.26s 2026-05-19 23:11:27.339902 | aio | Get list of all loopback devices ---------------------------------------- 0.18s 2026-05-19 23:11:27.340097 | aio | Fail if there is any existing loopback devices -------------------------- 0.01s 2026-05-19 23:11:27.403670 | aio | INFO [default > prepare] Executed: Successful 2026-05-19 23:11:27.414459 | aio | INFO [default > converge] Executing 2026-05-19 23:11:28.188550 | aio | 2026-05-19 23:11:28.188759 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-19 23:11:28.188997 | aio | 2026-05-19 23:11:28.189207 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:11:28.189418 | aio | Tuesday 19 May 2026 23:11:28 +0000 (0:00:00.045) 0:00:00.045 *********** 2026-05-19 23:11:29.310699 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 23:11:29.310894 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 23:11:29.311108 | aio | interpreter could change the meaning of that path. See 2026-05-19 23:11:29.311324 | aio | https://docs.ansible.com/ansible- 2026-05-19 23:11:29.311532 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 23:11:29.322304 | aio | ok: [aio] 2026-05-19 23:11:29.322509 | aio | 2026-05-19 23:11:29.322723 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:11:29.322922 | aio | Tuesday 19 May 2026 23:11:29 +0000 (0:00:01.133) 0:00:01.179 *********** 2026-05-19 23:11:29.604994 | aio | ok: [aio] 2026-05-19 23:11:29.605153 | aio | 2026-05-19 23:11:29.605366 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:11:29.605571 | aio | Tuesday 19 May 2026 23:11:29 +0000 (0:00:00.282) 0:00:01.462 *********** 2026-05-19 23:11:29.640201 | aio | skipping: [aio] 2026-05-19 23:11:29.640326 | aio | 2026-05-19 23:11:29.640533 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 23:11:29.640782 | aio | Tuesday 19 May 2026 23:11:29 +0000 (0:00:00.035) 0:00:01.497 *********** 2026-05-19 23:11:29.937744 | aio | changed: [aio] 2026-05-19 23:11:29.937901 | aio | 2026-05-19 23:11:29.938119 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:11:29.938323 | aio | Tuesday 19 May 2026 23:11:29 +0000 (0:00:00.297) 0:00:01.795 *********** 2026-05-19 23:11:30.029089 | aio | ok: [aio] => { 2026-05-19 23:11:30.029276 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 23:11:30.029473 | aio | } 2026-05-19 23:11:30.029704 | aio | 2026-05-19 23:11:30.030069 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:11:30.030323 | aio | Tuesday 19 May 2026 23:11:30 +0000 (0:00:00.091) 0:00:01.886 *********** 2026-05-19 23:11:30.698883 | aio | changed: [aio] 2026-05-19 23:11:30.699075 | aio | 2026-05-19 23:11:30.699306 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:11:30.699513 | aio | Tuesday 19 May 2026 23:11:30 +0000 (0:00:00.669) 0:00:02.556 *********** 2026-05-19 23:11:30.737371 | aio | skipping: [aio] 2026-05-19 23:11:30.737528 | aio | 2026-05-19 23:11:30.737739 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:11:30.737954 | aio | Tuesday 19 May 2026 23:11:30 +0000 (0:00:00.038) 0:00:02.594 *********** 2026-05-19 23:11:30.776343 | aio | skipping: [aio] 2026-05-19 23:11:30.776509 | aio | 2026-05-19 23:11:30.776756 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:11:30.776966 | aio | Tuesday 19 May 2026 23:11:30 +0000 (0:00:00.038) 0:00:02.633 *********** 2026-05-19 23:11:30.966689 | aio | ok: [aio] 2026-05-19 23:11:30.966877 | aio | 2026-05-19 23:11:30.967107 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:11:30.967328 | aio | Tuesday 19 May 2026 23:11:30 +0000 (0:00:00.190) 0:00:02.824 *********** 2026-05-19 23:11:32.071448 | aio | ok: [aio] 2026-05-19 23:11:32.071619 | aio | 2026-05-19 23:11:32.071826 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:11:32.072032 | aio | Tuesday 19 May 2026 23:11:32 +0000 (0:00:01.104) 0:00:03.928 *********** 2026-05-19 23:11:32.145280 | aio | ok: [aio] => { 2026-05-19 23:11:32.145515 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 23:11:32.145786 | aio | } 2026-05-19 23:11:32.145971 | aio | 2026-05-19 23:11:32.146190 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:11:32.146378 | aio | Tuesday 19 May 2026 23:11:32 +0000 (0:00:00.073) 0:00:04.002 *********** 2026-05-19 23:11:32.867683 | aio | changed: [aio] 2026-05-19 23:11:32.867876 | aio | 2026-05-19 23:11:32.868115 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:11:32.868337 | aio | Tuesday 19 May 2026 23:11:32 +0000 (0:00:00.722) 0:00:04.724 *********** 2026-05-19 23:11:35.690677 | aio | changed: [aio] 2026-05-19 23:11:35.691013 | aio | 2026-05-19 23:11:35.691304 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 23:11:35.691577 | aio | Tuesday 19 May 2026 23:11:35 +0000 (0:00:02.823) 0:00:07.548 *********** 2026-05-19 23:11:35.713239 | aio | skipping: [aio] 2026-05-19 23:11:35.713549 | aio | 2026-05-19 23:11:35.713828 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 23:11:35.714092 | aio | Tuesday 19 May 2026 23:11:35 +0000 (0:00:00.021) 0:00:07.569 *********** 2026-05-19 23:11:35.741224 | aio | skipping: [aio] 2026-05-19 23:11:35.741525 | aio | 2026-05-19 23:11:35.741808 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 23:11:35.742074 | aio | Tuesday 19 May 2026 23:11:35 +0000 (0:00:00.027) 0:00:07.596 *********** 2026-05-19 23:11:35.768334 | aio | skipping: [aio] 2026-05-19 23:11:35.768501 | aio | 2026-05-19 23:11:35.768649 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 23:11:35.768777 | aio | Tuesday 19 May 2026 23:11:35 +0000 (0:00:00.027) 0:00:07.624 *********** 2026-05-19 23:11:40.917590 | aio | changed: [aio] 2026-05-19 23:11:40.917793 | aio | 2026-05-19 23:11:40.917806 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 23:11:40.917817 | aio | Tuesday 19 May 2026 23:11:40 +0000 (0:00:05.151) 0:00:12.775 *********** 2026-05-19 23:11:41.442764 | aio | changed: [aio] 2026-05-19 23:11:41.442894 | aio | 2026-05-19 23:11:41.442904 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 23:11:41.443041 | aio | Tuesday 19 May 2026 23:11:41 +0000 (0:00:00.525) 0:00:13.300 *********** 2026-05-19 23:11:42.306333 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 23:11:42.306406 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 23:11:42.306506 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 23:11:42.307000 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 23:11:42.307043 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 23:11:42.307049 | aio | 2026-05-19 23:11:42.307054 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 23:11:42.307059 | aio | Tuesday 19 May 2026 23:11:42 +0000 (0:00:00.863) 0:00:14.164 *********** 2026-05-19 23:11:42.858004 | aio | changed: [aio] 2026-05-19 23:11:42.858126 | aio | 2026-05-19 23:11:42.858139 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 23:11:42.858526 | aio | Tuesday 19 May 2026 23:11:42 +0000 (0:00:00.545) 0:00:14.709 *********** 2026-05-19 23:11:42.858581 | aio | 2026-05-19 23:11:42.858587 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-19 23:11:42.858591 | aio | Tuesday 19 May 2026 23:11:42 +0000 (0:00:00.006) 0:00:14.715 *********** 2026-05-19 23:11:43.819855 | aio | ok: [aio] 2026-05-19 23:11:43.819955 | aio | 2026-05-19 23:11:43.820227 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-05-19 23:11:43.820248 | aio | Tuesday 19 May 2026 23:11:43 +0000 (0:00:00.961) 0:00:15.677 *********** 2026-05-19 23:11:44.246548 | aio | changed: [aio] 2026-05-19 23:11:44.246639 | aio | 2026-05-19 23:11:44.246831 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 23:11:44.246872 | aio | Tuesday 19 May 2026 23:11:44 +0000 (0:00:00.427) 0:00:16.104 *********** 2026-05-19 23:11:44.758435 | aio | changed: [aio] 2026-05-19 23:11:44.758505 | aio | 2026-05-19 23:11:44.758571 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:11:44.758697 | aio | Tuesday 19 May 2026 23:11:44 +0000 (0:00:00.511) 0:00:16.616 *********** 2026-05-19 23:11:44.957363 | aio | ok: [aio] 2026-05-19 23:11:44.957443 | aio | 2026-05-19 23:11:44.957516 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:11:44.957642 | aio | Tuesday 19 May 2026 23:11:44 +0000 (0:00:00.198) 0:00:16.815 *********** 2026-05-19 23:11:45.025597 | aio | ok: [aio] => { 2026-05-19 23:11:45.026268 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 23:11:45.026295 | aio | } 2026-05-19 23:11:45.026302 | aio | 2026-05-19 23:11:45.026309 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:11:45.026315 | aio | Tuesday 19 May 2026 23:11:45 +0000 (0:00:00.068) 0:00:16.883 *********** 2026-05-19 23:11:45.881502 | aio | changed: [aio] 2026-05-19 23:11:45.881596 | aio | 2026-05-19 23:11:45.881629 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:11:45.881738 | aio | Tuesday 19 May 2026 23:11:45 +0000 (0:00:00.856) 0:00:17.739 *********** 2026-05-19 23:11:50.155395 | aio | changed: [aio] 2026-05-19 23:11:50.155438 | aio | 2026-05-19 23:11:50.155444 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 23:11:50.155449 | aio | Tuesday 19 May 2026 23:11:50 +0000 (0:00:04.273) 0:00:22.012 *********** 2026-05-19 23:11:51.153584 | aio | ok: [aio] 2026-05-19 23:11:51.153663 | aio | 2026-05-19 23:11:51.153775 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 23:11:51.153839 | aio | Tuesday 19 May 2026 23:11:51 +0000 (0:00:00.998) 0:00:23.010 *********** 2026-05-19 23:11:51.492192 | aio | changed: [aio] 2026-05-19 23:11:51.492253 | aio | 2026-05-19 23:11:51.492341 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 23:11:51.492463 | aio | Tuesday 19 May 2026 23:11:51 +0000 (0:00:00.338) 0:00:23.349 *********** 2026-05-19 23:11:51.929089 | aio | changed: [aio] 2026-05-19 23:11:51.929153 | aio | 2026-05-19 23:11:51.929250 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 23:11:51.929378 | aio | Tuesday 19 May 2026 23:11:51 +0000 (0:00:00.436) 0:00:23.786 *********** 2026-05-19 23:11:52.477066 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 23:11:52.477128 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 23:11:52.477239 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 23:11:52.477560 | aio | 2026-05-19 23:11:52.477602 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 23:11:52.477608 | aio | Tuesday 19 May 2026 23:11:52 +0000 (0:00:00.547) 0:00:24.334 *********** 2026-05-19 23:11:52.904872 | aio | changed: [aio] 2026-05-19 23:11:52.904940 | aio | 2026-05-19 23:11:52.905034 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 23:11:52.905165 | aio | Tuesday 19 May 2026 23:11:52 +0000 (0:00:00.427) 0:00:24.762 *********** 2026-05-19 23:11:53.352460 | aio | changed: [aio] 2026-05-19 23:11:53.352528 | aio | 2026-05-19 23:11:53.352711 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 23:11:53.352782 | aio | Tuesday 19 May 2026 23:11:53 +0000 (0:00:00.440) 0:00:25.203 *********** 2026-05-19 23:11:53.352798 | aio | 2026-05-19 23:11:53.353028 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-19 23:11:53.353065 | aio | Tuesday 19 May 2026 23:11:53 +0000 (0:00:00.006) 0:00:25.210 *********** 2026-05-19 23:11:54.046782 | aio | ok: [aio] 2026-05-19 23:11:54.046839 | aio | 2026-05-19 23:11:54.046947 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-05-19 23:11:54.047067 | aio | Tuesday 19 May 2026 23:11:54 +0000 (0:00:00.694) 0:00:25.904 *********** 2026-05-19 23:11:54.973574 | aio | changed: [aio] 2026-05-19 23:11:54.973648 | aio | 2026-05-19 23:11:54.973731 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 23:11:54.973847 | aio | Tuesday 19 May 2026 23:11:54 +0000 (0:00:00.926) 0:00:26.831 *********** 2026-05-19 23:11:55.503056 | aio | changed: [aio] 2026-05-19 23:11:55.503113 | aio | 2026-05-19 23:11:55.503354 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 23:11:55.503406 | aio | Tuesday 19 May 2026 23:11:55 +0000 (0:00:00.529) 0:00:27.360 *********** 2026-05-19 23:11:55.548628 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 23:11:55.548702 | aio | 2026-05-19 23:11:55.548887 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 23:11:55.548910 | aio | Tuesday 19 May 2026 23:11:55 +0000 (0:00:00.045) 0:00:27.406 *********** 2026-05-19 23:12:00.296374 | aio | changed: [aio] 2026-05-19 23:12:00.296453 | aio | 2026-05-19 23:12:00.296682 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 23:12:00.296724 | aio | Tuesday 19 May 2026 23:12:00 +0000 (0:00:04.747) 0:00:32.153 *********** 2026-05-19 23:12:00.947328 | aio | ok: [aio] => (item=chronyd) 2026-05-19 23:12:00.947442 | aio | ok: [aio] => (item=sshd) 2026-05-19 23:12:00.947865 | aio | 2026-05-19 23:12:00.948053 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 23:12:00.948063 | aio | Tuesday 19 May 2026 23:12:00 +0000 (0:00:00.651) 0:00:32.804 *********** 2026-05-19 23:12:01.246130 | aio | changed: [aio] 2026-05-19 23:12:01.246203 | aio | 2026-05-19 23:12:01.246285 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 23:12:01.246411 | aio | Tuesday 19 May 2026 23:12:01 +0000 (0:00:00.298) 0:00:33.103 *********** 2026-05-19 23:12:01.438068 | aio | ok: [aio] 2026-05-19 23:12:01.438130 | aio | 2026-05-19 23:12:01.438278 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 23:12:01.438369 | aio | Tuesday 19 May 2026 23:12:01 +0000 (0:00:00.191) 0:00:33.295 *********** 2026-05-19 23:12:01.900404 | aio | changed: [aio] 2026-05-19 23:12:01.900480 | aio | 2026-05-19 23:12:01.900958 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 23:12:01.901006 | aio | Tuesday 19 May 2026 23:12:01 +0000 (0:00:00.462) 0:00:33.757 *********** 2026-05-19 23:12:02.222940 | aio | changed: [aio] 2026-05-19 23:12:02.223005 | aio | 2026-05-19 23:12:02.223088 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-19 23:12:02.223218 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.322) 0:00:34.080 *********** 2026-05-19 23:12:02.364200 | aio | ok: [aio] 2026-05-19 23:12:02.364279 | aio | 2026-05-19 23:12:02.364292 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-19 23:12:02.364424 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.141) 0:00:34.221 *********** 2026-05-19 23:12:02.562368 | aio | ok: [aio] => (item=aio) 2026-05-19 23:12:02.562428 | aio | 2026-05-19 23:12:02.562529 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-19 23:12:02.562656 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.198) 0:00:34.419 *********** 2026-05-19 23:12:02.603357 | aio | ok: [aio] 2026-05-19 23:12:02.603399 | aio | 2026-05-19 23:12:02.603620 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-19 23:12:02.603641 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.040) 0:00:34.460 *********** 2026-05-19 23:12:02.693404 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-05-19 23:12:02.693712 | aio | 2026-05-19 23:12:02.693756 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-05-19 23:12:02.693763 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.090) 0:00:34.550 *********** 2026-05-19 23:12:02.966794 | aio | changed: [aio] 2026-05-19 23:12:02.966860 | aio | 2026-05-19 23:12:02.966952 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-05-19 23:12:02.967092 | aio | Tuesday 19 May 2026 23:12:02 +0000 (0:00:00.273) 0:00:34.824 *********** 2026-05-19 23:12:03.618960 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-05-19 23:12:03.619031 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-05-19 23:12:03.619105 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-05-19 23:12:03.619417 | aio | 2026-05-19 23:12:03.619459 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-05-19 23:12:03.619464 | aio | Tuesday 19 May 2026 23:12:03 +0000 (0:00:00.652) 0:00:35.476 *********** 2026-05-19 23:13:27.901862 | aio | ok: [aio] 2026-05-19 23:13:27.901979 | aio | 2026-05-19 23:13:27.902133 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-05-19 23:13:27.902273 | aio | Tuesday 19 May 2026 23:13:27 +0000 (0:01:24.282) 0:01:59.759 *********** 2026-05-19 23:13:28.104006 | aio | changed: [aio] 2026-05-19 23:13:28.104064 | aio | 2026-05-19 23:13:28.104158 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-05-19 23:13:28.104289 | aio | Tuesday 19 May 2026 23:13:28 +0000 (0:00:00.202) 0:01:59.961 *********** 2026-05-19 23:13:28.139111 | aio | ok: [aio] 2026-05-19 23:13:28.139167 | aio | 2026-05-19 23:13:28.139381 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:13:28.139405 | aio | Tuesday 19 May 2026 23:13:28 +0000 (0:00:00.034) 0:01:59.996 *********** 2026-05-19 23:13:28.205782 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:13:28.205827 | aio | 2026-05-19 23:13:28.205941 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:13:28.206072 | aio | Tuesday 19 May 2026 23:13:28 +0000 (0:00:00.066) 0:02:00.063 *********** 2026-05-19 23:13:34.031970 | aio | ok: [aio] 2026-05-19 23:13:34.032041 | aio | 2026-05-19 23:13:34.032372 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:13:34.032419 | aio | Tuesday 19 May 2026 23:13:34 +0000 (0:00:05.825) 0:02:05.889 *********** 2026-05-19 23:13:34.080825 | aio | ok: [aio] => (item=aio) 2026-05-19 23:13:34.081069 | aio | 2026-05-19 23:13:34.081256 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:13:34.081310 | aio | Tuesday 19 May 2026 23:13:34 +0000 (0:00:00.048) 0:02:05.938 *********** 2026-05-19 23:13:34.422096 | aio | ok: [aio] 2026-05-19 23:13:34.422138 | aio | 2026-05-19 23:13:34.422144 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:13:34.422149 | aio | Tuesday 19 May 2026 23:13:34 +0000 (0:00:00.341) 0:02:06.279 *********** 2026-05-19 23:13:41.726814 | aio | ok: [aio] 2026-05-19 23:13:41.726872 | aio | 2026-05-19 23:13:41.727000 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-19 23:13:41.727054 | aio | Tuesday 19 May 2026 23:13:41 +0000 (0:00:07.304) 0:02:13.584 *********** 2026-05-19 23:13:53.888180 | aio | changed: [aio] 2026-05-19 23:13:53.888224 | aio | 2026-05-19 23:13:53.888229 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-19 23:13:53.888240 | aio | Tuesday 19 May 2026 23:13:53 +0000 (0:00:12.161) 0:02:25.745 *********** 2026-05-19 23:14:07.836961 | aio | ok: [aio] 2026-05-19 23:14:07.837032 | aio | 2026-05-19 23:14:07.837326 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:14:07.837382 | aio | Tuesday 19 May 2026 23:14:07 +0000 (0:00:13.948) 0:02:39.694 *********** 2026-05-19 23:14:07.900212 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:14:07.900356 | aio | 2026-05-19 23:14:07.900374 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:14:07.900451 | aio | Tuesday 19 May 2026 23:14:07 +0000 (0:00:00.063) 0:02:39.757 *********** 2026-05-19 23:14:07.943655 | aio | skipping: [aio] 2026-05-19 23:14:07.943701 | aio | 2026-05-19 23:14:07.943711 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:14:07.943722 | aio | Tuesday 19 May 2026 23:14:07 +0000 (0:00:00.042) 0:02:39.800 *********** 2026-05-19 23:14:07.980510 | aio | skipping: [aio] => (item=aio) 2026-05-19 23:14:07.980620 | aio | skipping: [aio] 2026-05-19 23:14:07.980779 | aio | 2026-05-19 23:14:07.980869 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:14:07.980889 | aio | Tuesday 19 May 2026 23:14:07 +0000 (0:00:00.037) 0:02:39.837 *********** 2026-05-19 23:14:08.257428 | aio | ok: [aio] 2026-05-19 23:14:08.257490 | aio | 2026-05-19 23:14:08.257713 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:14:08.257755 | aio | Tuesday 19 May 2026 23:14:08 +0000 (0:00:00.276) 0:02:40.114 *********** 2026-05-19 23:14:14.561751 | aio | ok: [aio] 2026-05-19 23:14:14.561817 | aio | 2026-05-19 23:14:14.561902 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-19 23:14:14.561999 | aio | Tuesday 19 May 2026 23:14:14 +0000 (0:00:06.305) 0:02:46.419 *********** 2026-05-19 23:14:26.616327 | aio | changed: [aio] 2026-05-19 23:14:26.616410 | aio | 2026-05-19 23:14:26.616673 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-19 23:14:26.616716 | aio | Tuesday 19 May 2026 23:14:26 +0000 (0:00:12.054) 0:02:58.473 *********** 2026-05-19 23:14:32.500105 | aio | ok: [aio] 2026-05-19 23:14:32.500186 | aio | 2026-05-19 23:14:32.500348 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-19 23:14:32.500405 | aio | Tuesday 19 May 2026 23:14:32 +0000 (0:00:05.884) 0:03:04.357 *********** 2026-05-19 23:14:36.755311 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-19 23:14:36.755392 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-19 23:14:36.755439 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-05-19 23:14:36.755547 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-19 23:14:36.755632 | aio | 2026-05-19 23:14:36.755737 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-19 23:14:36.755802 | aio | 2026-05-19 23:14:36.755907 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:14:36.755992 | aio | Tuesday 19 May 2026 23:14:36 +0000 (0:00:04.255) 0:03:08.613 *********** 2026-05-19 23:14:37.616348 | aio | ok: [aio] 2026-05-19 23:14:37.616427 | aio | 2026-05-19 23:14:37.616491 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:14:37.616617 | aio | Tuesday 19 May 2026 23:14:37 +0000 (0:00:00.860) 0:03:09.473 *********** 2026-05-19 23:14:37.832185 | aio | ok: [aio] 2026-05-19 23:14:37.832263 | aio | 2026-05-19 23:14:37.832401 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:14:37.832522 | aio | Tuesday 19 May 2026 23:14:37 +0000 (0:00:00.215) 0:03:09.689 *********** 2026-05-19 23:14:37.870718 | aio | skipping: [aio] 2026-05-19 23:14:37.870786 | aio | 2026-05-19 23:14:37.870930 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 23:14:37.871063 | aio | Tuesday 19 May 2026 23:14:37 +0000 (0:00:00.038) 0:03:09.727 *********** 2026-05-19 23:14:38.081942 | aio | ok: [aio] 2026-05-19 23:14:38.082006 | aio | 2026-05-19 23:14:38.082100 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:14:38.082221 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.211) 0:03:09.939 *********** 2026-05-19 23:14:38.138316 | aio | ok: [aio] => { 2026-05-19 23:14:38.138469 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 23:14:38.138610 | aio | } 2026-05-19 23:14:38.138740 | aio | 2026-05-19 23:14:38.138886 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:14:38.139029 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.056) 0:03:09.995 *********** 2026-05-19 23:14:38.435464 | aio | ok: [aio] 2026-05-19 23:14:38.435524 | aio | 2026-05-19 23:14:38.435611 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:14:38.435729 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.297) 0:03:10.293 *********** 2026-05-19 23:14:38.468203 | aio | skipping: [aio] 2026-05-19 23:14:38.468261 | aio | 2026-05-19 23:14:38.468362 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:14:38.468447 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.033) 0:03:10.326 *********** 2026-05-19 23:14:38.501386 | aio | skipping: [aio] 2026-05-19 23:14:38.501455 | aio | 2026-05-19 23:14:38.501551 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:14:38.501642 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.033) 0:03:10.359 *********** 2026-05-19 23:14:38.696834 | aio | ok: [aio] 2026-05-19 23:14:38.696912 | aio | 2026-05-19 23:14:38.697055 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:14:38.697156 | aio | Tuesday 19 May 2026 23:14:38 +0000 (0:00:00.194) 0:03:10.554 *********** 2026-05-19 23:14:39.846344 | aio | ok: [aio] 2026-05-19 23:14:39.846384 | aio | 2026-05-19 23:14:39.846389 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:14:39.846394 | aio | Tuesday 19 May 2026 23:14:39 +0000 (0:00:01.149) 0:03:11.703 *********** 2026-05-19 23:14:39.909613 | aio | ok: [aio] => { 2026-05-19 23:14:39.909662 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 23:14:39.909670 | aio | } 2026-05-19 23:14:39.909677 | aio | 2026-05-19 23:14:39.909683 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:14:39.909689 | aio | Tuesday 19 May 2026 23:14:39 +0000 (0:00:00.062) 0:03:11.766 *********** 2026-05-19 23:14:40.236166 | aio | ok: [aio] 2026-05-19 23:14:40.236214 | aio | 2026-05-19 23:14:40.236222 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:14:40.236229 | aio | Tuesday 19 May 2026 23:14:40 +0000 (0:00:00.326) 0:03:12.093 *********** 2026-05-19 23:14:42.174890 | aio | ok: [aio] 2026-05-19 23:14:42.174935 | aio | 2026-05-19 23:14:42.174941 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 23:14:42.174946 | aio | Tuesday 19 May 2026 23:14:42 +0000 (0:00:01.938) 0:03:14.031 *********** 2026-05-19 23:14:42.202835 | aio | skipping: [aio] 2026-05-19 23:14:42.202874 | aio | 2026-05-19 23:14:42.202882 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 23:14:42.202888 | aio | Tuesday 19 May 2026 23:14:42 +0000 (0:00:00.028) 0:03:14.059 *********** 2026-05-19 23:14:42.231782 | aio | skipping: [aio] 2026-05-19 23:14:42.231816 | aio | 2026-05-19 23:14:42.231824 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 23:14:42.231830 | aio | Tuesday 19 May 2026 23:14:42 +0000 (0:00:00.029) 0:03:14.089 *********** 2026-05-19 23:14:42.253274 | aio | skipping: [aio] 2026-05-19 23:14:42.253297 | aio | 2026-05-19 23:14:42.253302 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 23:14:42.253307 | aio | Tuesday 19 May 2026 23:14:42 +0000 (0:00:00.021) 0:03:14.110 *********** 2026-05-19 23:14:43.427636 | aio | ok: [aio] 2026-05-19 23:14:43.427731 | aio | 2026-05-19 23:14:43.427875 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 23:14:43.428015 | aio | Tuesday 19 May 2026 23:14:43 +0000 (0:00:01.174) 0:03:15.284 *********** 2026-05-19 23:14:43.842337 | aio | ok: [aio] 2026-05-19 23:14:43.842428 | aio | 2026-05-19 23:14:43.842562 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 23:14:43.842691 | aio | Tuesday 19 May 2026 23:14:43 +0000 (0:00:00.414) 0:03:15.699 *********** 2026-05-19 23:14:44.712124 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 23:14:44.712280 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 23:14:44.712491 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 23:14:44.712831 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 23:14:44.713060 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 23:14:44.713243 | aio | 2026-05-19 23:14:44.713466 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 23:14:44.713667 | aio | Tuesday 19 May 2026 23:14:44 +0000 (0:00:00.869) 0:03:16.569 *********** 2026-05-19 23:14:45.208686 | aio | ok: [aio] 2026-05-19 23:14:45.208811 | aio | 2026-05-19 23:14:45.208984 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 23:14:45.209100 | aio | Tuesday 19 May 2026 23:14:45 +0000 (0:00:00.488) 0:03:17.057 *********** 2026-05-19 23:14:45.209232 | aio | 2026-05-19 23:14:45.209377 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 23:14:45.209494 | aio | Tuesday 19 May 2026 23:14:45 +0000 (0:00:00.008) 0:03:17.066 *********** 2026-05-19 23:14:45.531108 | aio | ok: [aio] 2026-05-19 23:14:45.531180 | aio | 2026-05-19 23:14:45.531268 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:14:45.531354 | aio | Tuesday 19 May 2026 23:14:45 +0000 (0:00:00.322) 0:03:17.388 *********** 2026-05-19 23:14:45.748735 | aio | ok: [aio] 2026-05-19 23:14:45.748811 | aio | 2026-05-19 23:14:45.749012 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:14:45.749053 | aio | Tuesday 19 May 2026 23:14:45 +0000 (0:00:00.217) 0:03:17.606 *********** 2026-05-19 23:14:45.799094 | aio | ok: [aio] => { 2026-05-19 23:14:45.799771 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 23:14:45.799832 | aio | } 2026-05-19 23:14:45.799842 | aio | 2026-05-19 23:14:45.799850 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:14:45.799857 | aio | Tuesday 19 May 2026 23:14:45 +0000 (0:00:00.050) 0:03:17.656 *********** 2026-05-19 23:14:46.121986 | aio | ok: [aio] 2026-05-19 23:14:46.122060 | aio | 2026-05-19 23:14:46.122578 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:14:46.122631 | aio | Tuesday 19 May 2026 23:14:46 +0000 (0:00:00.322) 0:03:17.979 *********** 2026-05-19 23:14:49.110663 | aio | ok: [aio] 2026-05-19 23:14:49.110705 | aio | 2026-05-19 23:14:49.110711 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 23:14:49.110716 | aio | Tuesday 19 May 2026 23:14:49 +0000 (0:00:02.988) 0:03:20.968 *********** 2026-05-19 23:14:50.118723 | aio | ok: [aio] 2026-05-19 23:14:50.118756 | aio | 2026-05-19 23:14:50.118761 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 23:14:50.118766 | aio | Tuesday 19 May 2026 23:14:50 +0000 (0:00:01.008) 0:03:21.976 *********** 2026-05-19 23:14:50.299936 | aio | ok: [aio] 2026-05-19 23:14:50.299981 | aio | 2026-05-19 23:14:50.299988 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 23:14:50.299995 | aio | Tuesday 19 May 2026 23:14:50 +0000 (0:00:00.180) 0:03:22.157 *********** 2026-05-19 23:14:50.705398 | aio | ok: [aio] 2026-05-19 23:14:50.705671 | aio | 2026-05-19 23:14:50.705680 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 23:14:50.705686 | aio | Tuesday 19 May 2026 23:14:50 +0000 (0:00:00.405) 0:03:22.562 *********** 2026-05-19 23:14:51.250520 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 23:14:51.250608 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 23:14:51.251267 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 23:14:51.251314 | aio | 2026-05-19 23:14:51.251321 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 23:14:51.251328 | aio | Tuesday 19 May 2026 23:14:51 +0000 (0:00:00.545) 0:03:23.107 *********** 2026-05-19 23:14:51.658956 | aio | ok: [aio] 2026-05-19 23:14:51.659087 | aio | 2026-05-19 23:14:51.659391 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 23:14:51.659442 | aio | Tuesday 19 May 2026 23:14:51 +0000 (0:00:00.408) 0:03:23.516 *********** 2026-05-19 23:14:52.088017 | aio | ok: [aio] 2026-05-19 23:14:52.088075 | aio | 2026-05-19 23:14:52.088178 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 23:14:52.088569 | aio | Tuesday 19 May 2026 23:14:52 +0000 (0:00:00.423) 0:03:23.939 *********** 2026-05-19 23:14:52.088610 | aio | 2026-05-19 23:14:52.088616 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 23:14:52.088620 | aio | Tuesday 19 May 2026 23:14:52 +0000 (0:00:00.006) 0:03:23.945 *********** 2026-05-19 23:14:52.457795 | aio | ok: [aio] 2026-05-19 23:14:52.457867 | aio | 2026-05-19 23:14:52.457926 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 23:14:52.458061 | aio | Tuesday 19 May 2026 23:14:52 +0000 (0:00:00.369) 0:03:24.315 *********** 2026-05-19 23:14:52.507972 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 23:14:52.508379 | aio | 2026-05-19 23:14:52.508415 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 23:14:52.508426 | aio | Tuesday 19 May 2026 23:14:52 +0000 (0:00:00.050) 0:03:24.365 *********** 2026-05-19 23:14:53.525191 | aio | ok: [aio] 2026-05-19 23:14:53.525268 | aio | 2026-05-19 23:14:53.525544 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 23:14:53.525594 | aio | Tuesday 19 May 2026 23:14:53 +0000 (0:00:01.017) 0:03:25.382 *********** 2026-05-19 23:14:54.159823 | aio | ok: [aio] => (item=chronyd) 2026-05-19 23:14:54.159918 | aio | ok: [aio] => (item=sshd) 2026-05-19 23:14:54.160347 | aio | 2026-05-19 23:14:54.160412 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 23:14:54.160423 | aio | Tuesday 19 May 2026 23:14:54 +0000 (0:00:00.634) 0:03:26.017 *********** 2026-05-19 23:14:54.451605 | aio | ok: [aio] 2026-05-19 23:14:54.451678 | aio | 2026-05-19 23:14:54.452021 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 23:14:54.452068 | aio | Tuesday 19 May 2026 23:14:54 +0000 (0:00:00.291) 0:03:26.309 *********** 2026-05-19 23:14:54.645002 | aio | ok: [aio] 2026-05-19 23:14:54.645085 | aio | 2026-05-19 23:14:54.645189 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 23:14:54.645320 | aio | Tuesday 19 May 2026 23:14:54 +0000 (0:00:00.193) 0:03:26.502 *********** 2026-05-19 23:14:54.878850 | aio | ok: [aio] 2026-05-19 23:14:54.879422 | aio | 2026-05-19 23:14:54.879450 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 23:14:54.879460 | aio | Tuesday 19 May 2026 23:14:54 +0000 (0:00:00.233) 0:03:26.736 *********** 2026-05-19 23:14:55.072916 | aio | ok: [aio] 2026-05-19 23:14:55.072978 | aio | 2026-05-19 23:14:55.073073 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-19 23:14:55.073193 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.194) 0:03:26.930 *********** 2026-05-19 23:14:55.289305 | aio | ok: [aio] => (item=aio) 2026-05-19 23:14:55.289393 | aio | 2026-05-19 23:14:55.289720 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-19 23:14:55.289761 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.216) 0:03:27.146 *********** 2026-05-19 23:14:55.334054 | aio | ok: [aio] 2026-05-19 23:14:55.334491 | aio | 2026-05-19 23:14:55.334518 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:14:55.334527 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.044) 0:03:27.191 *********** 2026-05-19 23:14:55.384186 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:14:55.384233 | aio | 2026-05-19 23:14:55.384357 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:14:55.384463 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.050) 0:03:27.241 *********** 2026-05-19 23:14:55.429979 | aio | skipping: [aio] 2026-05-19 23:14:55.430060 | aio | 2026-05-19 23:14:55.430118 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:14:55.430241 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.045) 0:03:27.287 *********** 2026-05-19 23:14:55.469707 | aio | skipping: [aio] => (item=aio) 2026-05-19 23:14:55.470218 | aio | skipping: [aio] 2026-05-19 23:14:55.470250 | aio | 2026-05-19 23:14:55.470258 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:14:55.470265 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.039) 0:03:27.327 *********** 2026-05-19 23:14:55.711920 | aio | ok: [aio] 2026-05-19 23:14:55.712617 | aio | 2026-05-19 23:14:55.712661 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:14:55.712667 | aio | Tuesday 19 May 2026 23:14:55 +0000 (0:00:00.242) 0:03:27.569 *********** 2026-05-19 23:15:02.104765 | aio | ok: [aio] 2026-05-19 23:15:02.104832 | aio | 2026-05-19 23:15:02.104935 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-19 23:15:02.105034 | aio | Tuesday 19 May 2026 23:15:02 +0000 (0:00:06.392) 0:03:33.962 *********** 2026-05-19 23:15:07.398294 | aio | ok: [aio] 2026-05-19 23:15:07.398501 | aio | 2026-05-19 23:15:07.398727 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-19 23:15:07.398937 | aio | Tuesday 19 May 2026 23:15:07 +0000 (0:00:05.292) 0:03:39.255 *********** 2026-05-19 23:15:21.362037 | aio | ok: [aio] 2026-05-19 23:15:21.362135 | aio | 2026-05-19 23:15:21.362148 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-19 23:15:21.362159 | aio | Tuesday 19 May 2026 23:15:21 +0000 (0:00:13.963) 0:03:53.218 *********** 2026-05-19 23:16:52.316760 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-19 23:16:52.316858 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-19 23:16:52.317011 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-19 23:16:52.317140 | aio | 2026-05-19 23:16:52.317287 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-19 23:16:52.317431 | aio | Tuesday 19 May 2026 23:16:52 +0000 (0:01:30.955) 0:05:24.174 *********** 2026-05-19 23:16:58.398056 | aio | ok: [aio] 2026-05-19 23:16:58.398139 | aio | 2026-05-19 23:16:58.398270 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-19 23:16:58.398391 | aio | Tuesday 19 May 2026 23:16:58 +0000 (0:00:06.081) 0:05:30.255 *********** 2026-05-19 23:17:04.595279 | aio | ok: [aio] 2026-05-19 23:17:04.595461 | aio | 2026-05-19 23:17:04.595700 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-19 23:17:04.595960 | aio | Tuesday 19 May 2026 23:17:04 +0000 (0:00:06.196) 0:05:36.452 *********** 2026-05-19 23:17:04.646394 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-19 23:17:04.646590 | aio | 2026-05-19 23:17:04.646813 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-19 23:17:04.647027 | aio | Tuesday 19 May 2026 23:17:04 +0000 (0:00:00.051) 0:05:36.503 *********** 2026-05-19 23:17:04.682889 | aio | ok: [aio] 2026-05-19 23:17:04.683085 | aio | 2026-05-19 23:17:04.683302 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-19 23:17:04.683516 | aio | Tuesday 19 May 2026 23:17:04 +0000 (0:00:00.036) 0:05:36.540 *********** 2026-05-19 23:17:10.741703 | aio | ok: [aio] 2026-05-19 23:17:10.741784 | aio | 2026-05-19 23:17:10.742045 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-19 23:17:10.742120 | aio | Tuesday 19 May 2026 23:17:10 +0000 (0:00:06.058) 0:05:42.598 *********** 2026-05-19 23:17:10.778088 | aio | ok: [aio] 2026-05-19 23:17:10.778138 | aio | 2026-05-19 23:17:10.778419 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-19 23:17:10.778471 | aio | Tuesday 19 May 2026 23:17:10 +0000 (0:00:00.036) 0:05:42.635 *********** 2026-05-19 23:17:10.818548 | aio | skipping: [aio] => (item=1) 2026-05-19 23:17:10.818596 | aio | skipping: [aio] => (item=1) 2026-05-19 23:17:10.819150 | aio | skipping: [aio] => (item=1) 2026-05-19 23:17:10.819235 | aio | skipping: [aio] 2026-05-19 23:17:10.819241 | aio | 2026-05-19 23:17:10.819246 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-19 23:17:10.819252 | aio | Tuesday 19 May 2026 23:17:10 +0000 (0:00:00.040) 0:05:42.675 *********** 2026-05-19 23:17:10.853463 | aio | skipping: [aio] 2026-05-19 23:17:10.853509 | aio | 2026-05-19 23:17:10.855936 | aio | PLAY RECAP ********************************************************************* 2026-05-19 23:17:10.855962 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-05-19 23:17:10.855968 | aio | 2026-05-19 23:17:10.855973 | aio | 2026-05-19 23:17:10.855977 | aio | TASKS RECAP ******************************************************************** 2026-05-19 23:17:10.855983 | aio | Tuesday 19 May 2026 23:17:10 +0000 (0:00:00.035) 0:05:42.711 *********** 2026-05-19 23:17:10.855988 | aio | =============================================================================== 2026-05-19 23:17:10.855992 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 90.96s 2026-05-19 23:17:10.855997 | aio | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 84.28s 2026-05-19 23:17:10.856001 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.96s 2026-05-19 23:17:10.856005 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 13.95s 2026-05-19 23:17:10.856010 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.16s 2026-05-19 23:17:10.856014 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.05s 2026-05-19 23:17:10.856019 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.30s 2026-05-19 23:17:10.856023 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.39s 2026-05-19 23:17:10.856028 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.30s 2026-05-19 23:17:10.856033 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.20s 2026-05-19 23:17:10.856037 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.08s 2026-05-19 23:17:10.856041 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.06s 2026-05-19 23:17:10.856045 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.88s 2026-05-19 23:17:10.856049 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.83s 2026-05-19 23:17:10.856054 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.29s 2026-05-19 23:17:10.856059 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.15s 2026-05-19 23:17:10.856064 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.75s 2026-05-19 23:17:10.856068 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.27s 2026-05-19 23:17:10.856072 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.26s 2026-05-19 23:17:10.856076 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.99s 2026-05-19 23:17:11.023332 | aio | INFO [default > converge] Executed: Successful 2026-05-19 23:17:11.032373 | aio | INFO [default > idempotence] Executing 2026-05-19 23:17:11.826781 | aio | 2026-05-19 23:17:11.827157 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-19 23:17:11.827419 | aio | 2026-05-19 23:17:11.827732 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:17:11.828014 | aio | Tuesday 19 May 2026 23:17:11 +0000 (0:00:00.047) 0:00:00.047 *********** 2026-05-19 23:17:12.980667 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 23:17:12.980713 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 23:17:12.980723 | aio | interpreter could change the meaning of that path. See 2026-05-19 23:17:12.980881 | aio | https://docs.ansible.com/ansible- 2026-05-19 23:17:12.981018 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 23:17:12.994124 | aio | ok: [aio] 2026-05-19 23:17:12.994235 | aio | 2026-05-19 23:17:12.994366 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:17:12.994492 | aio | Tuesday 19 May 2026 23:17:12 +0000 (0:00:01.167) 0:00:01.214 *********** 2026-05-19 23:17:13.282143 | aio | ok: [aio] 2026-05-19 23:17:13.282325 | aio | 2026-05-19 23:17:13.282550 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:17:13.282765 | aio | Tuesday 19 May 2026 23:17:13 +0000 (0:00:00.287) 0:00:01.502 *********** 2026-05-19 23:17:13.316929 | aio | skipping: [aio] 2026-05-19 23:17:13.317098 | aio | 2026-05-19 23:17:13.317377 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 23:17:13.317584 | aio | Tuesday 19 May 2026 23:17:13 +0000 (0:00:00.035) 0:00:01.537 *********** 2026-05-19 23:17:13.611213 | aio | ok: [aio] 2026-05-19 23:17:13.611385 | aio | 2026-05-19 23:17:13.611614 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:17:13.611826 | aio | Tuesday 19 May 2026 23:17:13 +0000 (0:00:00.293) 0:00:01.831 *********** 2026-05-19 23:17:13.678631 | aio | ok: [aio] => { 2026-05-19 23:17:13.678872 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 23:17:13.679059 | aio | } 2026-05-19 23:17:13.679202 | aio | 2026-05-19 23:17:13.679454 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:17:13.679614 | aio | Tuesday 19 May 2026 23:17:13 +0000 (0:00:00.067) 0:00:01.899 *********** 2026-05-19 23:17:14.089628 | aio | ok: [aio] 2026-05-19 23:17:14.089780 | aio | 2026-05-19 23:17:14.090058 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:17:14.090280 | aio | Tuesday 19 May 2026 23:17:14 +0000 (0:00:00.410) 0:00:02.309 *********** 2026-05-19 23:17:14.130461 | aio | skipping: [aio] 2026-05-19 23:17:14.130672 | aio | 2026-05-19 23:17:14.130901 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:17:14.131062 | aio | Tuesday 19 May 2026 23:17:14 +0000 (0:00:00.041) 0:00:02.351 *********** 2026-05-19 23:17:14.169743 | aio | skipping: [aio] 2026-05-19 23:17:14.169925 | aio | 2026-05-19 23:17:14.170149 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:17:14.170357 | aio | Tuesday 19 May 2026 23:17:14 +0000 (0:00:00.039) 0:00:02.390 *********** 2026-05-19 23:17:14.373226 | aio | ok: [aio] 2026-05-19 23:17:14.373400 | aio | 2026-05-19 23:17:14.373635 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:17:14.373860 | aio | Tuesday 19 May 2026 23:17:14 +0000 (0:00:00.203) 0:00:02.593 *********** 2026-05-19 23:17:15.519400 | aio | ok: [aio] 2026-05-19 23:17:15.519458 | aio | 2026-05-19 23:17:15.519470 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:17:15.519480 | aio | Tuesday 19 May 2026 23:17:15 +0000 (0:00:01.145) 0:00:03.739 *********** 2026-05-19 23:17:15.591730 | aio | ok: [aio] => { 2026-05-19 23:17:15.591771 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 23:17:15.591877 | aio | } 2026-05-19 23:17:15.591962 | aio | 2026-05-19 23:17:15.592140 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:17:15.592155 | aio | Tuesday 19 May 2026 23:17:15 +0000 (0:00:00.073) 0:00:03.812 *********** 2026-05-19 23:17:15.932842 | aio | ok: [aio] 2026-05-19 23:17:15.932907 | aio | 2026-05-19 23:17:15.933012 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:17:15.933115 | aio | Tuesday 19 May 2026 23:17:15 +0000 (0:00:00.340) 0:00:04.153 *********** 2026-05-19 23:17:18.099283 | aio | ok: [aio] 2026-05-19 23:17:18.099358 | aio | 2026-05-19 23:17:18.099562 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 23:17:18.099619 | aio | Tuesday 19 May 2026 23:17:18 +0000 (0:00:02.166) 0:00:06.319 *********** 2026-05-19 23:17:18.129410 | aio | skipping: [aio] 2026-05-19 23:17:18.129464 | aio | 2026-05-19 23:17:18.129693 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 23:17:18.129716 | aio | Tuesday 19 May 2026 23:17:18 +0000 (0:00:00.030) 0:00:06.349 *********** 2026-05-19 23:17:18.160991 | aio | skipping: [aio] 2026-05-19 23:17:18.161067 | aio | 2026-05-19 23:17:18.161296 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 23:17:18.161332 | aio | Tuesday 19 May 2026 23:17:18 +0000 (0:00:00.031) 0:00:06.381 *********** 2026-05-19 23:17:18.192178 | aio | skipping: [aio] 2026-05-19 23:17:18.192304 | aio | 2026-05-19 23:17:18.192316 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 23:17:18.192355 | aio | Tuesday 19 May 2026 23:17:18 +0000 (0:00:00.031) 0:00:06.412 *********** 2026-05-19 23:17:19.203229 | aio | ok: [aio] 2026-05-19 23:17:19.203304 | aio | 2026-05-19 23:17:19.203626 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 23:17:19.203670 | aio | Tuesday 19 May 2026 23:17:19 +0000 (0:00:01.010) 0:00:07.423 *********** 2026-05-19 23:17:19.624999 | aio | ok: [aio] 2026-05-19 23:17:19.625073 | aio | 2026-05-19 23:17:19.625254 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 23:17:19.625412 | aio | Tuesday 19 May 2026 23:17:19 +0000 (0:00:00.422) 0:00:07.845 *********** 2026-05-19 23:17:20.538151 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 23:17:20.538211 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 23:17:20.538956 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 23:17:20.538971 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 23:17:20.538977 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 23:17:20.538982 | aio | 2026-05-19 23:17:20.538986 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 23:17:20.538990 | aio | Tuesday 19 May 2026 23:17:20 +0000 (0:00:00.912) 0:00:08.758 *********** 2026-05-19 23:17:21.046828 | aio | ok: [aio] 2026-05-19 23:17:21.046899 | aio | 2026-05-19 23:17:21.046979 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 23:17:21.047384 | aio | Tuesday 19 May 2026 23:17:21 +0000 (0:00:00.499) 0:00:09.258 *********** 2026-05-19 23:17:21.047424 | aio | 2026-05-19 23:17:21.047430 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 23:17:21.047435 | aio | Tuesday 19 May 2026 23:17:21 +0000 (0:00:00.008) 0:00:09.267 *********** 2026-05-19 23:17:21.626050 | aio | ok: [aio] 2026-05-19 23:17:21.626126 | aio | 2026-05-19 23:17:21.626204 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:17:21.626338 | aio | Tuesday 19 May 2026 23:17:21 +0000 (0:00:00.579) 0:00:09.846 *********** 2026-05-19 23:17:21.827925 | aio | ok: [aio] 2026-05-19 23:17:21.828219 | aio | 2026-05-19 23:17:21.828233 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:17:21.828243 | aio | Tuesday 19 May 2026 23:17:21 +0000 (0:00:00.201) 0:00:10.048 *********** 2026-05-19 23:17:21.892088 | aio | ok: [aio] => { 2026-05-19 23:17:21.892155 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 23:17:21.892555 | aio | } 2026-05-19 23:17:21.892616 | aio | 2026-05-19 23:17:21.892622 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:17:21.892627 | aio | Tuesday 19 May 2026 23:17:21 +0000 (0:00:00.064) 0:00:10.112 *********** 2026-05-19 23:17:22.238835 | aio | ok: [aio] 2026-05-19 23:17:22.238918 | aio | 2026-05-19 23:17:22.238990 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:17:22.239110 | aio | Tuesday 19 May 2026 23:17:22 +0000 (0:00:00.346) 0:00:10.459 *********** 2026-05-19 23:17:25.300230 | aio | ok: [aio] 2026-05-19 23:17:25.300292 | aio | 2026-05-19 23:17:25.300511 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 23:17:25.300555 | aio | Tuesday 19 May 2026 23:17:25 +0000 (0:00:03.061) 0:00:13.520 *********** 2026-05-19 23:17:26.292407 | aio | ok: [aio] 2026-05-19 23:17:26.292476 | aio | 2026-05-19 23:17:26.292551 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 23:17:26.292704 | aio | Tuesday 19 May 2026 23:17:26 +0000 (0:00:00.992) 0:00:14.512 *********** 2026-05-19 23:17:26.578341 | aio | ok: [aio] 2026-05-19 23:17:26.578411 | aio | 2026-05-19 23:17:26.578486 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 23:17:26.578609 | aio | Tuesday 19 May 2026 23:17:26 +0000 (0:00:00.286) 0:00:14.799 *********** 2026-05-19 23:17:27.010120 | aio | ok: [aio] 2026-05-19 23:17:27.010182 | aio | 2026-05-19 23:17:27.010265 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 23:17:27.010389 | aio | Tuesday 19 May 2026 23:17:27 +0000 (0:00:00.431) 0:00:15.230 *********** 2026-05-19 23:17:27.541188 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 23:17:27.541255 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 23:17:27.541351 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 23:17:27.541652 | aio | 2026-05-19 23:17:27.541693 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 23:17:27.541699 | aio | Tuesday 19 May 2026 23:17:27 +0000 (0:00:00.531) 0:00:15.761 *********** 2026-05-19 23:17:27.946579 | aio | ok: [aio] 2026-05-19 23:17:27.946649 | aio | 2026-05-19 23:17:27.946738 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 23:17:27.946870 | aio | Tuesday 19 May 2026 23:17:27 +0000 (0:00:00.405) 0:00:16.167 *********** 2026-05-19 23:17:28.359297 | aio | ok: [aio] 2026-05-19 23:17:28.359410 | aio | 2026-05-19 23:17:28.360063 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 23:17:28.360085 | aio | Tuesday 19 May 2026 23:17:28 +0000 (0:00:00.405) 0:00:16.573 *********** 2026-05-19 23:17:28.360092 | aio | 2026-05-19 23:17:28.360099 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 23:17:28.360104 | aio | Tuesday 19 May 2026 23:17:28 +0000 (0:00:00.006) 0:00:16.579 *********** 2026-05-19 23:17:28.710315 | aio | ok: [aio] 2026-05-19 23:17:28.710371 | aio | 2026-05-19 23:17:28.710492 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 23:17:28.710625 | aio | Tuesday 19 May 2026 23:17:28 +0000 (0:00:00.351) 0:00:16.930 *********** 2026-05-19 23:17:28.761337 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 23:17:28.761377 | aio | 2026-05-19 23:17:28.761631 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 23:17:28.761675 | aio | Tuesday 19 May 2026 23:17:28 +0000 (0:00:00.050) 0:00:16.981 *********** 2026-05-19 23:17:29.863131 | aio | ok: [aio] 2026-05-19 23:17:29.863203 | aio | 2026-05-19 23:17:29.863288 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 23:17:29.863422 | aio | Tuesday 19 May 2026 23:17:29 +0000 (0:00:01.102) 0:00:18.083 *********** 2026-05-19 23:17:30.482616 | aio | ok: [aio] => (item=chronyd) 2026-05-19 23:17:30.482686 | aio | ok: [aio] => (item=sshd) 2026-05-19 23:17:30.482758 | aio | 2026-05-19 23:17:30.482977 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 23:17:30.483019 | aio | Tuesday 19 May 2026 23:17:30 +0000 (0:00:00.619) 0:00:18.703 *********** 2026-05-19 23:17:30.776839 | aio | ok: [aio] 2026-05-19 23:17:30.776901 | aio | 2026-05-19 23:17:30.776990 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 23:17:30.777120 | aio | Tuesday 19 May 2026 23:17:30 +0000 (0:00:00.294) 0:00:18.997 *********** 2026-05-19 23:17:30.969511 | aio | ok: [aio] 2026-05-19 23:17:30.969603 | aio | 2026-05-19 23:17:30.969731 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 23:17:30.969837 | aio | Tuesday 19 May 2026 23:17:30 +0000 (0:00:00.192) 0:00:19.189 *********** 2026-05-19 23:17:31.363256 | aio | ok: [aio] 2026-05-19 23:17:31.363323 | aio | 2026-05-19 23:17:31.363530 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 23:17:31.363568 | aio | Tuesday 19 May 2026 23:17:31 +0000 (0:00:00.393) 0:00:19.583 *********** 2026-05-19 23:17:31.678035 | aio | ok: [aio] 2026-05-19 23:17:31.678098 | aio | 2026-05-19 23:17:31.678316 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-19 23:17:31.678357 | aio | Tuesday 19 May 2026 23:17:31 +0000 (0:00:00.314) 0:00:19.898 *********** 2026-05-19 23:17:31.742231 | aio | ok: [aio] 2026-05-19 23:17:31.742277 | aio | 2026-05-19 23:17:31.742556 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-19 23:17:31.742603 | aio | Tuesday 19 May 2026 23:17:31 +0000 (0:00:00.064) 0:00:19.962 *********** 2026-05-19 23:17:31.957677 | aio | ok: [aio] => (item=aio) 2026-05-19 23:17:31.957753 | aio | 2026-05-19 23:17:31.958032 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-19 23:17:31.958076 | aio | Tuesday 19 May 2026 23:17:31 +0000 (0:00:00.215) 0:00:20.178 *********** 2026-05-19 23:17:32.001311 | aio | ok: [aio] 2026-05-19 23:17:32.001369 | aio | 2026-05-19 23:17:32.001704 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-19 23:17:32.001751 | aio | Tuesday 19 May 2026 23:17:31 +0000 (0:00:00.043) 0:00:20.221 *********** 2026-05-19 23:17:32.042889 | aio | skipping: [aio] 2026-05-19 23:17:32.042995 | aio | 2026-05-19 23:17:32.043120 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:17:32.043324 | aio | Tuesday 19 May 2026 23:17:32 +0000 (0:00:00.042) 0:00:20.263 *********** 2026-05-19 23:17:32.107133 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:17:32.107182 | aio | 2026-05-19 23:17:32.107288 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:17:32.107377 | aio | Tuesday 19 May 2026 23:17:32 +0000 (0:00:00.064) 0:00:20.327 *********** 2026-05-19 23:17:38.154233 | aio | ok: [aio] 2026-05-19 23:17:38.154494 | aio | 2026-05-19 23:17:38.154507 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:17:38.154518 | aio | Tuesday 19 May 2026 23:17:38 +0000 (0:00:06.046) 0:00:26.374 *********** 2026-05-19 23:17:38.205625 | aio | ok: [aio] => (item=aio) 2026-05-19 23:17:38.205737 | aio | 2026-05-19 23:17:38.205997 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:17:38.206044 | aio | Tuesday 19 May 2026 23:17:38 +0000 (0:00:00.050) 0:00:26.425 *********** 2026-05-19 23:17:38.591920 | aio | ok: [aio] 2026-05-19 23:17:38.592001 | aio | 2026-05-19 23:17:38.592065 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:17:38.592189 | aio | Tuesday 19 May 2026 23:17:38 +0000 (0:00:00.386) 0:00:26.812 *********** 2026-05-19 23:17:44.955153 | aio | ok: [aio] 2026-05-19 23:17:44.955236 | aio | 2026-05-19 23:17:44.955432 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-19 23:17:44.955477 | aio | Tuesday 19 May 2026 23:17:44 +0000 (0:00:06.363) 0:00:33.175 *********** 2026-05-19 23:17:51.041880 | aio | ok: [aio] 2026-05-19 23:17:51.041949 | aio | 2026-05-19 23:17:51.042037 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-19 23:17:51.042145 | aio | Tuesday 19 May 2026 23:17:51 +0000 (0:00:06.086) 0:00:39.262 *********** 2026-05-19 23:18:05.091784 | aio | ok: [aio] 2026-05-19 23:18:05.091856 | aio | 2026-05-19 23:18:05.092040 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:18:05.092091 | aio | Tuesday 19 May 2026 23:18:05 +0000 (0:00:14.049) 0:00:53.312 *********** 2026-05-19 23:18:05.153156 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:18:05.153226 | aio | 2026-05-19 23:18:05.153286 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:18:05.153412 | aio | Tuesday 19 May 2026 23:18:05 +0000 (0:00:00.061) 0:00:53.373 *********** 2026-05-19 23:18:05.193134 | aio | skipping: [aio] 2026-05-19 23:18:05.193180 | aio | 2026-05-19 23:18:05.193185 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:18:05.193191 | aio | Tuesday 19 May 2026 23:18:05 +0000 (0:00:00.039) 0:00:53.413 *********** 2026-05-19 23:18:05.237900 | aio | skipping: [aio] => (item=aio) 2026-05-19 23:18:05.237967 | aio | skipping: [aio] 2026-05-19 23:18:05.238246 | aio | 2026-05-19 23:18:05.238263 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:18:05.238268 | aio | Tuesday 19 May 2026 23:18:05 +0000 (0:00:00.045) 0:00:53.458 *********** 2026-05-19 23:18:05.482573 | aio | ok: [aio] 2026-05-19 23:18:05.482635 | aio | 2026-05-19 23:18:05.482736 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:18:05.482855 | aio | Tuesday 19 May 2026 23:18:05 +0000 (0:00:00.244) 0:00:53.703 *********** 2026-05-19 23:18:11.868207 | aio | ok: [aio] 2026-05-19 23:18:11.868285 | aio | 2026-05-19 23:18:11.868366 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-19 23:18:11.868462 | aio | Tuesday 19 May 2026 23:18:11 +0000 (0:00:06.385) 0:01:00.088 *********** 2026-05-19 23:18:17.860262 | aio | ok: [aio] 2026-05-19 23:18:17.860340 | aio | 2026-05-19 23:18:17.860682 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-19 23:18:17.860731 | aio | Tuesday 19 May 2026 23:18:17 +0000 (0:00:05.991) 0:01:06.080 *********** 2026-05-19 23:18:23.791173 | aio | ok: [aio] 2026-05-19 23:18:23.791253 | aio | 2026-05-19 23:18:23.791596 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-19 23:18:23.791642 | aio | Tuesday 19 May 2026 23:18:23 +0000 (0:00:05.930) 0:01:12.011 *********** 2026-05-19 23:18:28.086561 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-19 23:18:28.086633 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-19 23:18:28.087083 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-05-19 23:18:28.087146 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-19 23:18:28.087159 | aio | 2026-05-19 23:18:28.087175 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-19 23:18:28.087185 | aio | 2026-05-19 23:18:28.087338 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:18:28.087358 | aio | Tuesday 19 May 2026 23:18:28 +0000 (0:00:04.295) 0:01:16.307 *********** 2026-05-19 23:18:28.964669 | aio | ok: [aio] 2026-05-19 23:18:28.964742 | aio | 2026-05-19 23:18:28.965051 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:18:28.965093 | aio | Tuesday 19 May 2026 23:18:28 +0000 (0:00:00.877) 0:01:17.184 *********** 2026-05-19 23:18:29.157865 | aio | ok: [aio] 2026-05-19 23:18:29.157930 | aio | 2026-05-19 23:18:29.158023 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:18:29.158155 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.193) 0:01:17.378 *********** 2026-05-19 23:18:29.190486 | aio | skipping: [aio] 2026-05-19 23:18:29.190537 | aio | 2026-05-19 23:18:29.190653 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 23:18:29.190776 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.032) 0:01:17.411 *********** 2026-05-19 23:18:29.394832 | aio | ok: [aio] 2026-05-19 23:18:29.394900 | aio | 2026-05-19 23:18:29.395112 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:18:29.395158 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.204) 0:01:17.615 *********** 2026-05-19 23:18:29.466494 | aio | ok: [aio] => { 2026-05-19 23:18:29.466572 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 23:18:29.466637 | aio | } 2026-05-19 23:18:29.466923 | aio | 2026-05-19 23:18:29.466948 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:18:29.466954 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.071) 0:01:17.687 *********** 2026-05-19 23:18:29.771958 | aio | ok: [aio] 2026-05-19 23:18:29.772069 | aio | 2026-05-19 23:18:29.772373 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:18:29.772418 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.305) 0:01:17.992 *********** 2026-05-19 23:18:29.812725 | aio | skipping: [aio] 2026-05-19 23:18:29.813052 | aio | 2026-05-19 23:18:29.813093 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:18:29.813099 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.040) 0:01:18.033 *********** 2026-05-19 23:18:29.850405 | aio | skipping: [aio] 2026-05-19 23:18:29.850486 | aio | 2026-05-19 23:18:29.850583 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:18:29.850694 | aio | Tuesday 19 May 2026 23:18:29 +0000 (0:00:00.038) 0:01:18.071 *********** 2026-05-19 23:18:30.048559 | aio | ok: [aio] 2026-05-19 23:18:30.048665 | aio | 2026-05-19 23:18:30.048775 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 23:18:30.048866 | aio | Tuesday 19 May 2026 23:18:30 +0000 (0:00:00.198) 0:01:18.269 *********** 2026-05-19 23:18:31.078019 | aio | ok: [aio] 2026-05-19 23:18:31.078083 | aio | 2026-05-19 23:18:31.078165 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:18:31.078263 | aio | Tuesday 19 May 2026 23:18:31 +0000 (0:00:01.029) 0:01:19.298 *********** 2026-05-19 23:18:31.152356 | aio | ok: [aio] => { 2026-05-19 23:18:31.152462 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 23:18:31.152605 | aio | } 2026-05-19 23:18:31.152990 | aio | 2026-05-19 23:18:31.153009 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:18:31.153016 | aio | Tuesday 19 May 2026 23:18:31 +0000 (0:00:00.074) 0:01:19.372 *********** 2026-05-19 23:18:31.491767 | aio | ok: [aio] 2026-05-19 23:18:31.491871 | aio | 2026-05-19 23:18:31.492177 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:18:31.492226 | aio | Tuesday 19 May 2026 23:18:31 +0000 (0:00:00.339) 0:01:19.712 *********** 2026-05-19 23:18:33.454927 | aio | ok: [aio] 2026-05-19 23:18:33.455017 | aio | 2026-05-19 23:18:33.455331 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 23:18:33.455379 | aio | Tuesday 19 May 2026 23:18:33 +0000 (0:00:01.963) 0:01:21.675 *********** 2026-05-19 23:18:33.477055 | aio | skipping: [aio] 2026-05-19 23:18:33.477152 | aio | 2026-05-19 23:18:33.477240 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 23:18:33.477337 | aio | Tuesday 19 May 2026 23:18:33 +0000 (0:00:00.022) 0:01:21.697 *********** 2026-05-19 23:18:33.499252 | aio | skipping: [aio] 2026-05-19 23:18:33.499309 | aio | 2026-05-19 23:18:33.499406 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 23:18:33.499558 | aio | Tuesday 19 May 2026 23:18:33 +0000 (0:00:00.022) 0:01:21.719 *********** 2026-05-19 23:18:33.526347 | aio | skipping: [aio] 2026-05-19 23:18:33.526459 | aio | 2026-05-19 23:18:33.526593 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 23:18:33.526732 | aio | Tuesday 19 May 2026 23:18:33 +0000 (0:00:00.027) 0:01:21.747 *********** 2026-05-19 23:18:34.512240 | aio | ok: [aio] 2026-05-19 23:18:34.512506 | aio | 2026-05-19 23:18:34.512520 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 23:18:34.512531 | aio | Tuesday 19 May 2026 23:18:34 +0000 (0:00:00.985) 0:01:22.732 *********** 2026-05-19 23:18:34.930747 | aio | ok: [aio] 2026-05-19 23:18:34.930817 | aio | 2026-05-19 23:18:34.931019 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 23:18:34.931057 | aio | Tuesday 19 May 2026 23:18:34 +0000 (0:00:00.418) 0:01:23.151 *********** 2026-05-19 23:18:35.797652 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 23:18:35.797722 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 23:18:35.798593 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 23:18:35.798638 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 23:18:35.798647 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 23:18:35.798653 | aio | 2026-05-19 23:18:35.798660 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 23:18:35.798665 | aio | Tuesday 19 May 2026 23:18:35 +0000 (0:00:00.866) 0:01:24.018 *********** 2026-05-19 23:18:36.313879 | aio | ok: [aio] 2026-05-19 23:18:36.313946 | aio | 2026-05-19 23:18:36.314421 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 23:18:36.314467 | aio | Tuesday 19 May 2026 23:18:36 +0000 (0:00:00.509) 0:01:24.527 *********** 2026-05-19 23:18:36.314473 | aio | 2026-05-19 23:18:36.314482 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 23:18:36.314487 | aio | Tuesday 19 May 2026 23:18:36 +0000 (0:00:00.007) 0:01:24.534 *********** 2026-05-19 23:18:36.671403 | aio | ok: [aio] 2026-05-19 23:18:36.671478 | aio | 2026-05-19 23:18:36.671848 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 23:18:36.671896 | aio | Tuesday 19 May 2026 23:18:36 +0000 (0:00:00.357) 0:01:24.891 *********** 2026-05-19 23:18:36.864920 | aio | ok: [aio] 2026-05-19 23:18:36.865002 | aio | 2026-05-19 23:18:36.865263 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 23:18:36.865310 | aio | Tuesday 19 May 2026 23:18:36 +0000 (0:00:00.193) 0:01:25.085 *********** 2026-05-19 23:18:36.928054 | aio | ok: [aio] => { 2026-05-19 23:18:36.928131 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 23:18:36.928667 | aio | } 2026-05-19 23:18:36.928713 | aio | 2026-05-19 23:18:36.928719 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 23:18:36.928757 | aio | Tuesday 19 May 2026 23:18:36 +0000 (0:00:00.063) 0:01:25.148 *********** 2026-05-19 23:18:37.272235 | aio | ok: [aio] 2026-05-19 23:18:37.272308 | aio | 2026-05-19 23:18:37.272669 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 23:18:37.272726 | aio | Tuesday 19 May 2026 23:18:37 +0000 (0:00:00.344) 0:01:25.492 *********** 2026-05-19 23:18:41.327499 | aio | ok: [aio] 2026-05-19 23:18:41.327540 | aio | 2026-05-19 23:18:41.327545 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 23:18:41.327550 | aio | Tuesday 19 May 2026 23:18:41 +0000 (0:00:04.055) 0:01:29.547 *********** 2026-05-19 23:18:42.319569 | aio | ok: [aio] 2026-05-19 23:18:42.319644 | aio | 2026-05-19 23:18:42.319680 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 23:18:42.319820 | aio | Tuesday 19 May 2026 23:18:42 +0000 (0:00:00.992) 0:01:30.540 *********** 2026-05-19 23:18:42.517969 | aio | ok: [aio] 2026-05-19 23:18:42.518039 | aio | 2026-05-19 23:18:42.518119 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 23:18:42.518243 | aio | Tuesday 19 May 2026 23:18:42 +0000 (0:00:00.198) 0:01:30.738 *********** 2026-05-19 23:18:42.925278 | aio | ok: [aio] 2026-05-19 23:18:42.925336 | aio | 2026-05-19 23:18:42.925428 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 23:18:42.925552 | aio | Tuesday 19 May 2026 23:18:42 +0000 (0:00:00.407) 0:01:31.145 *********** 2026-05-19 23:18:43.477354 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 23:18:43.477451 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 23:18:43.478036 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 23:18:43.478241 | aio | 2026-05-19 23:18:43.478251 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 23:18:43.478259 | aio | Tuesday 19 May 2026 23:18:43 +0000 (0:00:00.551) 0:01:31.697 *********** 2026-05-19 23:18:43.882317 | aio | ok: [aio] 2026-05-19 23:18:43.882390 | aio | 2026-05-19 23:18:43.882713 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 23:18:43.882763 | aio | Tuesday 19 May 2026 23:18:43 +0000 (0:00:00.404) 0:01:32.102 *********** 2026-05-19 23:18:44.322156 | aio | ok: [aio] 2026-05-19 23:18:44.322233 | aio | 2026-05-19 23:18:44.322295 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 23:18:44.322686 | aio | Tuesday 19 May 2026 23:18:44 +0000 (0:00:00.432) 0:01:32.535 *********** 2026-05-19 23:18:44.322729 | aio | 2026-05-19 23:18:44.322734 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 23:18:44.322739 | aio | Tuesday 19 May 2026 23:18:44 +0000 (0:00:00.007) 0:01:32.542 *********** 2026-05-19 23:18:44.666185 | aio | ok: [aio] 2026-05-19 23:18:44.666250 | aio | 2026-05-19 23:18:44.666351 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 23:18:44.666491 | aio | Tuesday 19 May 2026 23:18:44 +0000 (0:00:00.344) 0:01:32.886 *********** 2026-05-19 23:18:44.720804 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 23:18:44.720871 | aio | 2026-05-19 23:18:44.721067 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 23:18:44.721113 | aio | Tuesday 19 May 2026 23:18:44 +0000 (0:00:00.054) 0:01:32.940 *********** 2026-05-19 23:18:45.709573 | aio | ok: [aio] 2026-05-19 23:18:45.709679 | aio | 2026-05-19 23:18:45.710020 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 23:18:45.710064 | aio | Tuesday 19 May 2026 23:18:45 +0000 (0:00:00.988) 0:01:33.929 *********** 2026-05-19 23:18:46.346142 | aio | ok: [aio] => (item=chronyd) 2026-05-19 23:18:46.346254 | aio | ok: [aio] => (item=sshd) 2026-05-19 23:18:46.346671 | aio | 2026-05-19 23:18:46.346712 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 23:18:46.346720 | aio | Tuesday 19 May 2026 23:18:46 +0000 (0:00:00.636) 0:01:34.566 *********** 2026-05-19 23:18:46.615643 | aio | ok: [aio] 2026-05-19 23:18:46.615715 | aio | 2026-05-19 23:18:46.616049 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 23:18:46.616097 | aio | Tuesday 19 May 2026 23:18:46 +0000 (0:00:00.269) 0:01:34.836 *********** 2026-05-19 23:18:46.800109 | aio | ok: [aio] 2026-05-19 23:18:46.800178 | aio | 2026-05-19 23:18:46.800499 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 23:18:46.800673 | aio | Tuesday 19 May 2026 23:18:46 +0000 (0:00:00.184) 0:01:35.020 *********** 2026-05-19 23:18:47.029886 | aio | ok: [aio] 2026-05-19 23:18:47.030079 | aio | 2026-05-19 23:18:47.030093 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 23:18:47.030112 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.228) 0:01:35.249 *********** 2026-05-19 23:18:47.227376 | aio | ok: [aio] 2026-05-19 23:18:47.227562 | aio | 2026-05-19 23:18:47.227798 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-19 23:18:47.228084 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.198) 0:01:35.447 *********** 2026-05-19 23:18:47.437790 | aio | ok: [aio] => (item=aio) 2026-05-19 23:18:47.437980 | aio | 2026-05-19 23:18:47.438218 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-19 23:18:47.438463 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.210) 0:01:35.657 *********** 2026-05-19 23:18:47.479589 | aio | ok: [aio] 2026-05-19 23:18:47.479740 | aio | 2026-05-19 23:18:47.479952 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 23:18:47.480161 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.042) 0:01:35.700 *********** 2026-05-19 23:18:47.531593 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 23:18:47.531884 | aio | 2026-05-19 23:18:47.532201 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 23:18:47.532447 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.052) 0:01:35.752 *********** 2026-05-19 23:18:47.569736 | aio | skipping: [aio] 2026-05-19 23:18:47.569942 | aio | 2026-05-19 23:18:47.570167 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 23:18:47.570374 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.037) 0:01:35.790 *********** 2026-05-19 23:18:47.609721 | aio | skipping: [aio] => (item=aio) 2026-05-19 23:18:47.609934 | aio | skipping: [aio] 2026-05-19 23:18:47.610130 | aio | 2026-05-19 23:18:47.610359 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 23:18:47.610613 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.040) 0:01:35.830 *********** 2026-05-19 23:18:47.845561 | aio | ok: [aio] 2026-05-19 23:18:47.845627 | aio | 2026-05-19 23:18:47.845762 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 23:18:47.845882 | aio | Tuesday 19 May 2026 23:18:47 +0000 (0:00:00.235) 0:01:36.065 *********** 2026-05-19 23:18:54.150835 | aio | ok: [aio] 2026-05-19 23:18:54.151053 | aio | 2026-05-19 23:18:54.151300 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-19 23:18:54.151612 | aio | Tuesday 19 May 2026 23:18:54 +0000 (0:00:06.305) 0:01:42.371 *********** 2026-05-19 23:18:59.542710 | aio | ok: [aio] 2026-05-19 23:18:59.542772 | aio | 2026-05-19 23:18:59.542783 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-19 23:18:59.542793 | aio | Tuesday 19 May 2026 23:18:59 +0000 (0:00:05.391) 0:01:47.762 *********** 2026-05-19 23:19:13.582463 | aio | ok: [aio] 2026-05-19 23:19:13.582537 | aio | 2026-05-19 23:19:13.582832 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-19 23:19:13.582876 | aio | Tuesday 19 May 2026 23:19:13 +0000 (0:00:14.040) 0:02:01.802 *********** 2026-05-19 23:19:13.641154 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-19 23:19:13.641731 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-19 23:19:13.641763 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-19 23:19:13.641768 | aio | skipping: [aio] 2026-05-19 23:19:13.641774 | aio | 2026-05-19 23:19:13.641780 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-19 23:19:13.641787 | aio | Tuesday 19 May 2026 23:19:13 +0000 (0:00:00.058) 0:02:01.861 *********** 2026-05-19 23:19:19.668987 | aio | ok: [aio] 2026-05-19 23:19:19.669094 | aio | 2026-05-19 23:19:19.669233 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-19 23:19:19.669367 | aio | Tuesday 19 May 2026 23:19:19 +0000 (0:00:06.027) 0:02:07.889 *********** 2026-05-19 23:19:25.618230 | aio | ok: [aio] 2026-05-19 23:19:25.618414 | aio | 2026-05-19 23:19:25.618640 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-19 23:19:25.618852 | aio | Tuesday 19 May 2026 23:19:25 +0000 (0:00:05.949) 0:02:13.838 *********** 2026-05-19 23:19:25.671853 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-19 23:19:25.672029 | aio | 2026-05-19 23:19:25.672239 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-19 23:19:25.672453 | aio | Tuesday 19 May 2026 23:19:25 +0000 (0:00:00.053) 0:02:13.892 *********** 2026-05-19 23:19:25.709578 | aio | ok: [aio] 2026-05-19 23:19:25.709758 | aio | 2026-05-19 23:19:25.709967 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-19 23:19:25.710171 | aio | Tuesday 19 May 2026 23:19:25 +0000 (0:00:00.037) 0:02:13.930 *********** 2026-05-19 23:19:31.659853 | aio | ok: [aio] 2026-05-19 23:19:31.659917 | aio | 2026-05-19 23:19:31.659929 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-19 23:19:31.659939 | aio | Tuesday 19 May 2026 23:19:31 +0000 (0:00:05.949) 0:02:19.879 *********** 2026-05-19 23:19:31.690983 | aio | ok: [aio] 2026-05-19 23:19:31.691045 | aio | 2026-05-19 23:19:31.691299 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-19 23:19:31.691348 | aio | Tuesday 19 May 2026 23:19:31 +0000 (0:00:00.032) 0:02:19.911 *********** 2026-05-19 23:19:31.735197 | aio | skipping: [aio] => (item=1) 2026-05-19 23:19:31.735281 | aio | skipping: [aio] => (item=1) 2026-05-19 23:19:31.735375 | aio | skipping: [aio] => (item=1) 2026-05-19 23:19:31.735648 | aio | skipping: [aio] 2026-05-19 23:19:31.735719 | aio | 2026-05-19 23:19:31.735738 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-19 23:19:31.735750 | aio | Tuesday 19 May 2026 23:19:31 +0000 (0:00:00.044) 0:02:19.955 *********** 2026-05-19 23:19:31.771239 | aio | skipping: [aio] 2026-05-19 23:19:31.771309 | aio | 2026-05-19 23:19:31.772731 | aio | PLAY RECAP ********************************************************************* 2026-05-19 23:19:31.772805 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-05-19 23:19:31.772817 | aio | 2026-05-19 23:19:31.772827 | aio | 2026-05-19 23:19:31.772836 | aio | TASKS RECAP ******************************************************************** 2026-05-19 23:19:31.772845 | aio | Tuesday 19 May 2026 23:19:31 +0000 (0:00:00.036) 0:02:19.992 *********** 2026-05-19 23:19:31.772854 | aio | =============================================================================== 2026-05-19 23:19:31.772862 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.05s 2026-05-19 23:19:31.772871 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.04s 2026-05-19 23:19:31.772879 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.39s 2026-05-19 23:19:31.772888 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.36s 2026-05-19 23:19:31.772896 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.31s 2026-05-19 23:19:31.772905 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.09s 2026-05-19 23:19:31.772913 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.05s 2026-05-19 23:19:31.772922 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.03s 2026-05-19 23:19:31.772940 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 5.99s 2026-05-19 23:19:31.772949 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.95s 2026-05-19 23:19:31.772958 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.95s 2026-05-19 23:19:31.773025 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.93s 2026-05-19 23:19:31.773117 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.39s 2026-05-19 23:19:31.773212 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.30s 2026-05-19 23:19:31.773302 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.06s 2026-05-19 23:19:31.773388 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s 2026-05-19 23:19:31.773481 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.17s 2026-05-19 23:19:31.773611 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.96s 2026-05-19 23:19:31.773689 | aio | Gathering Facts --------------------------------------------------------- 1.17s 2026-05-19 23:19:31.773780 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.15s 2026-05-19 23:19:31.868815 | aio | INFO [default > idempotence] Executed: Successful 2026-05-19 23:19:31.879523 | aio | INFO [default > side_effect] Executing 2026-05-19 23:19:31.879823 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 23:19:31.885931 | aio | INFO [default > verify] Executing 2026-05-19 23:19:32.487822 | aio | 2026-05-19 23:19:32.488114 | aio | PLAY [Verify] ****************************************************************** 2026-05-19 23:19:32.488319 | aio | 2026-05-19 23:19:32.488704 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 23:19:32.489023 | aio | Tuesday 19 May 2026 23:19:32 +0000 (0:00:00.006) 0:00:00.006 *********** 2026-05-19 23:19:33.595250 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 23:19:33.595407 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 23:19:33.595644 | aio | interpreter could change the meaning of that path. See 2026-05-19 23:19:33.595825 | aio | https://docs.ansible.com/ansible- 2026-05-19 23:19:33.596076 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 23:19:33.604768 | aio | ok: [aio] 2026-05-19 23:19:33.604940 | aio | 2026-05-19 23:19:33.605146 | aio | TASK [Get cluster health status] *********************************************** 2026-05-19 23:19:33.605347 | aio | Tuesday 19 May 2026 23:19:33 +0000 (0:00:01.116) 0:00:01.123 *********** 2026-05-19 23:19:43.639077 | aio | ok: [aio] 2026-05-19 23:19:43.639255 | aio | 2026-05-19 23:19:43.639475 | aio | TASK [Print cluster health status] ********************************************* 2026-05-19 23:19:43.639699 | aio | Tuesday 19 May 2026 23:19:43 +0000 (0:00:10.034) 0:00:11.158 *********** 2026-05-19 23:19:43.668075 | aio | ok: [aio] => { 2026-05-19 23:19:43.668264 | aio | "_ceph_health": { 2026-05-19 23:19:43.668472 | aio | "changed": false, 2026-05-19 23:19:43.668731 | aio | "cmd": [ 2026-05-19 23:19:43.669045 | aio | "cephadm", 2026-05-19 23:19:43.669154 | aio | "shell", 2026-05-19 23:19:43.669362 | aio | "--", 2026-05-19 23:19:43.669541 | aio | "ceph", 2026-05-19 23:19:43.669731 | aio | "health" 2026-05-19 23:19:43.669922 | aio | ], 2026-05-19 23:19:43.670119 | aio | "delta": "0:00:09.770340", 2026-05-19 23:19:43.670362 | aio | "end": "2026-05-19 23:19:43.604778", 2026-05-19 23:19:43.670627 | aio | "failed": false, 2026-05-19 23:19:43.670809 | aio | "msg": "", 2026-05-19 23:19:43.671004 | aio | "rc": 0, 2026-05-19 23:19:43.671198 | aio | "start": "2026-05-19 23:19:33.834438", 2026-05-19 23:19:43.671419 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-05-19 23:19:43.671613 | aio | "stderr_lines": [ 2026-05-19 23:19:43.671813 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-05-19 23:19:43.672015 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-05-19 23:19:43.672201 | aio | ], 2026-05-19 23:19:43.672393 | aio | "stdout": "HEALTH_OK", 2026-05-19 23:19:43.672661 | aio | "stdout_lines": [ 2026-05-19 23:19:43.672841 | aio | "HEALTH_OK" 2026-05-19 23:19:43.673030 | aio | ] 2026-05-19 23:19:43.673209 | aio | } 2026-05-19 23:19:43.673394 | aio | } 2026-05-19 23:19:43.673599 | aio | 2026-05-19 23:19:43.673799 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-05-19 23:19:43.673997 | aio | Tuesday 19 May 2026 23:19:43 +0000 (0:00:00.029) 0:00:11.187 *********** 2026-05-19 23:19:43.694513 | aio | ok: [aio] => { 2026-05-19 23:19:43.694719 | aio | "changed": false, 2026-05-19 23:19:43.694919 | aio | "msg": "All assertions passed" 2026-05-19 23:19:43.695109 | aio | } 2026-05-19 23:19:43.695288 | aio | 2026-05-19 23:19:43.695488 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-05-19 23:19:43.695675 | aio | Tuesday 19 May 2026 23:19:43 +0000 (0:00:00.026) 0:00:11.213 *********** 2026-05-19 23:19:50.183731 | aio | changed: [aio] 2026-05-19 23:19:50.183897 | aio | 2026-05-19 23:19:50.184109 | aio | TASK [Create a test Ceph key] ************************************************** 2026-05-19 23:19:50.184310 | aio | Tuesday 19 May 2026 23:19:50 +0000 (0:00:06.488) 0:00:17.702 *********** 2026-05-19 23:19:52.174890 | aio | changed: [aio] 2026-05-19 23:19:52.174957 | aio | 2026-05-19 23:19:52.175112 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-05-19 23:19:52.175245 | aio | Tuesday 19 May 2026 23:19:52 +0000 (0:00:01.991) 0:00:19.693 *********** 2026-05-19 23:19:53.176711 | aio | ok: [aio] 2026-05-19 23:19:53.177224 | aio | 2026-05-19 23:19:53.177249 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-05-19 23:19:53.177258 | aio | Tuesday 19 May 2026 23:19:53 +0000 (0:00:01.001) 0:00:20.695 *********** 2026-05-19 23:19:53.218933 | aio | ok: [aio] => { 2026-05-19 23:19:53.219013 | aio | "changed": false, 2026-05-19 23:19:53.219443 | aio | "msg": "All assertions passed" 2026-05-19 23:19:53.219457 | aio | } 2026-05-19 23:19:53.219462 | aio | 2026-05-19 23:19:53.219466 | aio | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-05-19 23:19:53.219471 | aio | Tuesday 19 May 2026 23:19:53 +0000 (0:00:00.042) 0:00:20.737 *********** 2026-05-19 23:19:54.115974 | aio | ok: [aio] 2026-05-19 23:19:54.116083 | aio | 2026-05-19 23:19:54.116419 | aio | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-05-19 23:19:54.116468 | aio | Tuesday 19 May 2026 23:19:54 +0000 (0:00:00.897) 0:00:21.635 *********** 2026-05-19 23:19:54.146933 | aio | ok: [aio] => { 2026-05-19 23:19:54.148669 | aio | "changed": false, 2026-05-19 23:19:54.148711 | aio | "msg": "All assertions passed" 2026-05-19 23:19:54.148723 | aio | } 2026-05-19 23:19:54.148733 | aio | 2026-05-19 23:19:54.148742 | aio | PLAY RECAP ********************************************************************* 2026-05-19 23:19:54.148752 | aio | aio : ok=10 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-05-19 23:19:54.148761 | aio | 2026-05-19 23:19:54.148770 | aio | 2026-05-19 23:19:54.148779 | aio | TASKS RECAP ******************************************************************** 2026-05-19 23:19:54.150600 | aio | Tuesday 19 May 2026 23:19:54 +0000 (0:00:00.031) 0:00:21.666 *********** 2026-05-19 23:19:54.150620 | aio | =============================================================================== 2026-05-19 23:19:54.150627 | aio | Get cluster health status ---------------------------------------------- 10.03s 2026-05-19 23:19:54.150632 | aio | Create a test Ceph pool ------------------------------------------------- 6.49s 2026-05-19 23:19:54.150638 | aio | Create a test Ceph key -------------------------------------------------- 1.99s 2026-05-19 23:19:54.150643 | aio | Gathering Facts --------------------------------------------------------- 1.12s 2026-05-19 23:19:54.150649 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.00s 2026-05-19 23:19:54.150654 | aio | Retrieve info for the test Ceph key using the legacy key module --------- 0.90s 2026-05-19 23:19:54.150659 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-05-19 23:19:54.150665 | aio | Assert that the legacy key module info state returns the correct key ---- 0.03s 2026-05-19 23:19:54.150677 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-05-19 23:19:54.150683 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-05-19 23:19:54.226128 | aio | INFO [default > verify] Executed: Successful 2026-05-19 23:19:54.236097 | aio | INFO [default > cleanup] Executing 2026-05-19 23:19:54.236413 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 23:19:54.241404 | aio | INFO [default > destroy] Executing 2026-05-19 23:19:54.241520 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-19 23:19:54.241605 | aio | INFO [default > destroy] Executed: Successful 2026-05-19 23:19:54.241896 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-05-19 23:19:54.526718 | aio | ok: Runtime: 0:09:25.178883 2026-05-19 23:19:54.538183 | 2026-05-19 23:19:54.538239 | PLAY RECAP 2026-05-19 23:19:54.538281 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 23:19:54.538302 | 2026-05-19 23:19:54.642575 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-19 23:19:54.646571 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-19 23:19:55.277724 | 2026-05-19 23:19:55.277835 | PLAY [all] 2026-05-19 23:19:55.288432 | 2026-05-19 23:19:55.288505 | TASK [fetch-output : Set log path for multiple nodes] 2026-05-19 23:19:55.332649 | aio | skipping: Conditional result was False 2026-05-19 23:19:55.341107 | 2026-05-19 23:19:55.341231 | TASK [fetch-output : Set log path for single node] 2026-05-19 23:19:55.375103 | aio | ok 2026-05-19 23:19:55.381825 | 2026-05-19 23:19:55.381897 | LOOP [fetch-output : Ensure local output dirs] 2026-05-19 23:19:55.756674 | aio -> localhost | ok: "/var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/logs" 2026-05-19 23:19:56.003003 | aio -> localhost | changed: "/var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/artifacts" 2026-05-19 23:19:56.208249 | aio -> localhost | changed: "/var/lib/zuul/builds/58bbe4af7d0e4362816d88b81265bd0b/work/docs" 2026-05-19 23:19:56.228210 | 2026-05-19 23:19:56.228333 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-05-19 23:19:56.865530 | aio | ok 2026-05-19 23:19:56.865751 | aio | changed: All items complete 2026-05-19 23:19:56.865790 | 2026-05-19 23:19:57.309703 | aio | changed: .d..t...... ./ 2026-05-19 23:19:57.761663 | aio | changed: .d..t...... ./ 2026-05-19 23:19:57.786935 | 2026-05-19 23:19:57.787089 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-05-19 23:19:58.277381 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.008204 2026-05-19 23:19:58.510916 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008373 2026-05-19 23:19:58.530607 | 2026-05-19 23:19:58.530766 | PLAY [all] 2026-05-19 23:19:58.539229 | 2026-05-19 23:19:58.539302 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-05-19 23:19:58.970675 | aio | changed 2026-05-19 23:19:58.978013 | 2026-05-19 23:19:58.978144 | PLAY RECAP 2026-05-19 23:19:58.978247 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-05-19 23:19:58.978301 | 2026-05-19 23:19:59.098195 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-19 23:19:59.100653 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-05-19 23:19:59.770162 | 2026-05-19 23:19:59.770401 | PLAY [localhost] 2026-05-19 23:19:59.780313 | 2026-05-19 23:19:59.780385 | TASK [Generate Zuul manifest] 2026-05-19 23:19:59.801895 | localhost | ok 2026-05-19 23:19:59.819533 | 2026-05-19 23:19:59.819607 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-05-19 23:20:00.205558 | localhost | changed 2026-05-19 23:20:00.219711 | 2026-05-19 23:20:00.219813 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-05-19 23:20:00.251063 | localhost | ok 2026-05-19 23:20:00.260451 | 2026-05-19 23:20:00.260555 | TASK [Upload logs] 2026-05-19 23:20:00.282294 | localhost | ok 2026-05-19 23:20:00.345417 | 2026-05-19 23:20:00.345551 | TASK [Set zuul-log-path fact] 2026-05-19 23:20:00.366812 | localhost | ok 2026-05-19 23:20:00.381511 | 2026-05-19 23:20:00.381583 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-19 23:20:00.413618 | localhost | ok 2026-05-19 23:20:00.422135 | 2026-05-19 23:20:00.422233 | TASK [upload-logs : Create log directories] 2026-05-19 23:20:00.849751 | localhost | changed 2026-05-19 23:20:00.854867 | 2026-05-19 23:20:00.854933 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-05-19 23:20:01.268359 | localhost -> localhost | ok: Runtime: 0:00:00.005754 2026-05-19 23:20:01.275157 | 2026-05-19 23:20:01.275280 | TASK [upload-logs : Upload logs to log server] 2026-05-19 23:20:01.785028 | localhost | Output suppressed because no_log was given 2026-05-19 23:20:01.789918 | 2026-05-19 23:20:01.789993 | LOOP [upload-logs : Compress console log and json output] 2026-05-19 23:20:01.839116 | localhost | skipping: Conditional result was False 2026-05-19 23:20:01.900861 | localhost | skipping: Conditional result was False 2026-05-19 23:20:01.915821 | 2026-05-19 23:20:01.916243 | LOOP [upload-logs : Upload compressed console log and json output] 2026-05-19 23:20:01.967599 | localhost | skipping: Conditional result was False 2026-05-19 23:20:01.968186 | 2026-05-19 23:20:01.970528 | localhost | skipping: Conditional result was False 2026-05-19 23:20:01.978439 | 2026-05-19 23:20:01.978621 | LOOP [upload-logs : Upload console log and json output]