2026-03-30 17:44:46.078192 | Job console starting 2026-03-30 17:44:46.089175 | Updating git repos 2026-03-30 17:44:46.180312 | Cloning repos into workspace 2026-03-30 17:44:46.227582 | Restoring repo states 2026-03-30 17:44:46.236064 | Merging changes 2026-03-30 17:44:46.503094 | Checking out repos 2026-03-30 17:44:46.585489 | Preparing playbooks 2026-03-30 17:44:47.761143 | Running Ansible setup 2026-03-30 17:44:52.573045 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-30 17:44:53.130849 | 2026-03-30 17:44:53.130984 | PLAY [localhost] 2026-03-30 17:44:53.138538 | 2026-03-30 17:44:53.138609 | TASK [Gathering Facts] 2026-03-30 17:44:54.027912 | localhost | ok 2026-03-30 17:44:54.036688 | 2026-03-30 17:44:54.036774 | TASK [Setup log path fact] 2026-03-30 17:44:54.058959 | localhost | ok 2026-03-30 17:44:54.071700 | 2026-03-30 17:44:54.071787 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-30 17:44:54.104219 | localhost | ok 2026-03-30 17:44:54.113721 | 2026-03-30 17:44:54.113853 | TASK [emit-job-header : Print job information] 2026-03-30 17:44:54.156522 | # Job Information 2026-03-30 17:44:54.156770 | Ansible Version: 2.16.16 2026-03-30 17:44:54.156881 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-03-30 17:44:54.156921 | Pipeline: check 2026-03-30 17:44:54.156974 | Executor: 0a8996d2b663 2026-03-30 17:44:54.157010 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-03-30 17:44:54.157041 | Event ID: d0075c40-2c5d-11f1-83ee-33061e4a1ce2 2026-03-30 17:44:54.161157 | 2026-03-30 17:44:54.161254 | LOOP [emit-job-header : Print node information] 2026-03-30 17:44:54.345497 | localhost | ok: 2026-03-30 17:44:54.345753 | localhost | # Node Information 2026-03-30 17:44:54.345803 | localhost | Inventory Hostname: aio 2026-03-30 17:44:54.345835 | localhost | Hostname: np0000161498 2026-03-30 17:44:54.345865 | localhost | Username: zuul 2026-03-30 17:44:54.345897 | localhost | Distro: Ubuntu 22.04 2026-03-30 17:44:54.345932 | localhost | Provider: yul1 2026-03-30 17:44:54.345966 | localhost | Region: ca-ymq-1 2026-03-30 17:44:54.345994 | localhost | Label: ubuntu-jammy 2026-03-30 17:44:54.346020 | localhost | Product Name: OpenStack Nova 2026-03-30 17:44:54.346046 | localhost | Interface IP: 199.204.45.209 2026-03-30 17:44:54.360017 | 2026-03-30 17:44:54.378829 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-30 17:44:54.819423 | localhost -> localhost | changed 2026-03-30 17:44:54.826864 | 2026-03-30 17:44:54.826974 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-30 17:44:55.962579 | localhost -> localhost | changed 2026-03-30 17:44:55.972770 | 2026-03-30 17:44:55.972891 | PLAY [all] 2026-03-30 17:44:55.981316 | 2026-03-30 17:44:55.981398 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-30 17:44:56.241766 | aio -> localhost | ok 2026-03-30 17:44:56.250688 | 2026-03-30 17:44:56.250788 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-30 17:44:56.274569 | aio | ok 2026-03-30 17:44:56.294639 | aio | included: /var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-30 17:44:56.303719 | 2026-03-30 17:44:56.303874 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-30 17:44:57.326521 | aio -> localhost | Generating public/private rsa key pair. 2026-03-30 17:44:57.326752 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/81b463004d8749f5a2f21d0ad5184dbb_id_rsa 2026-03-30 17:44:57.326794 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/81b463004d8749f5a2f21d0ad5184dbb_id_rsa.pub 2026-03-30 17:44:57.326827 | aio -> localhost | The key fingerprint is: 2026-03-30 17:44:57.326857 | aio -> localhost | SHA256:lMuy0auoEfpW24X3m/+vjasdLDZ8zCjkbS7wragMqAE zuul-build-sshkey 2026-03-30 17:44:57.326905 | aio -> localhost | The key's randomart image is: 2026-03-30 17:44:57.326936 | aio -> localhost | +---[RSA 3072]----+ 2026-03-30 17:44:57.326993 | aio -> localhost | | | 2026-03-30 17:44:57.327060 | aio -> localhost | | . | 2026-03-30 17:44:57.327102 | aio -> localhost | | o | 2026-03-30 17:44:57.327133 | aio -> localhost | | + . | 2026-03-30 17:44:57.327160 | aio -> localhost | |E . o.S . | 2026-03-30 17:44:57.327188 | aio -> localhost | |.. o. .+++ o = | 2026-03-30 17:44:57.327215 | aio -> localhost | |o o..o.o.+o.O * | 2026-03-30 17:44:57.327243 | aio -> localhost | | +...+.. .+*.= + | 2026-03-30 17:44:57.327274 | aio -> localhost | |..o.. +.. +=+o*+o| 2026-03-30 17:44:57.327301 | aio -> localhost | +----[SHA256]-----+ 2026-03-30 17:44:57.327366 | aio -> localhost | ok: Runtime: 0:00:00.570514 2026-03-30 17:44:57.334752 | 2026-03-30 17:44:57.334844 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-30 17:44:57.369029 | aio | ok 2026-03-30 17:44:57.380766 | aio | included: /var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-30 17:44:57.389827 | 2026-03-30 17:44:57.389899 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-30 17:44:57.416660 | aio | skipping: Conditional result was False 2026-03-30 17:44:57.426609 | 2026-03-30 17:44:57.426706 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-30 17:44:57.869662 | aio | changed 2026-03-30 17:44:57.877678 | 2026-03-30 17:44:57.877971 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-30 17:44:58.069867 | aio | ok 2026-03-30 17:44:58.078478 | 2026-03-30 17:44:58.078559 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-30 17:44:58.577269 | aio | changed 2026-03-30 17:44:58.584544 | 2026-03-30 17:44:58.584704 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-30 17:44:59.043649 | aio | changed 2026-03-30 17:44:59.048889 | 2026-03-30 17:44:59.048976 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-30 17:44:59.073706 | aio | skipping: Conditional result was False 2026-03-30 17:44:59.083829 | 2026-03-30 17:44:59.083969 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-30 17:44:59.569848 | aio -> localhost | changed 2026-03-30 17:44:59.583055 | 2026-03-30 17:44:59.583127 | TASK [add-build-sshkey : Add back temp key] 2026-03-30 17:44:59.920187 | aio -> localhost | Identity added: /var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/81b463004d8749f5a2f21d0ad5184dbb_id_rsa (zuul-build-sshkey) 2026-03-30 17:44:59.920394 | aio -> localhost | ok: Runtime: 0:00:00.016799 2026-03-30 17:44:59.925448 | 2026-03-30 17:44:59.925515 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-30 17:45:00.268553 | aio | ok 2026-03-30 17:45:00.278805 | 2026-03-30 17:45:00.278902 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-30 17:45:00.304349 | aio | skipping: Conditional result was False 2026-03-30 17:45:00.369884 | 2026-03-30 17:45:00.370030 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-30 17:45:00.687005 | aio | ok 2026-03-30 17:45:00.695691 | 2026-03-30 17:45:00.695855 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-30 17:45:01.515699 | aio | Output suppressed because no_log was given 2026-03-30 17:45:01.556454 | 2026-03-30 17:45:01.556590 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-30 17:45:01.747218 | aio | ok: "logs" 2026-03-30 17:45:01.747539 | aio | ok: All items complete 2026-03-30 17:45:01.747582 | 2026-03-30 17:45:01.902710 | aio | ok: "artifacts" 2026-03-30 17:45:02.050939 | aio | ok: "docs" 2026-03-30 17:45:02.066227 | 2026-03-30 17:45:02.066373 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-30 17:45:02.327347 | aio | changed: "logs" 2026-03-30 17:45:02.401157 | aio | changed: "artifacts" 2026-03-30 17:45:02.578292 | aio | changed: "docs" 2026-03-30 17:45:02.596496 | 2026-03-30 17:45:02.596648 | PLAY RECAP 2026-03-30 17:45:02.596720 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-30 17:45:02.596762 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-30 17:45:02.596792 | 2026-03-30 17:45:02.782201 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-30 17:45:02.784329 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-30 17:45:03.391108 | 2026-03-30 17:45:03.391276 | PLAY [all] 2026-03-30 17:45:03.405046 | 2026-03-30 17:45:03.405157 | TASK [setup-uv : Extract archive] 2026-03-30 17:45:05.717822 | aio | changed 2026-03-30 17:45:05.724983 | 2026-03-30 17:45:05.725085 | TASK [setup-uv : Print version] 2026-03-30 17:45:05.964852 | aio | uv 0.8.13 2026-03-30 17:45:06.261697 | aio | ok: Runtime: 0:00:00.011715 2026-03-30 17:45:06.269087 | 2026-03-30 17:45:06.269147 | PLAY RECAP 2026-03-30 17:45:06.269198 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-30 17:45:06.269223 | 2026-03-30 17:45:06.405562 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-30 17:45:06.408774 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-30 17:45:08.744212 | 2026-03-30 17:45:08.744396 | PLAY [all] 2026-03-30 17:45:08.758283 | 2026-03-30 17:45:08.758415 | TASK [Copy inventory file for Zuul] 2026-03-30 17:45:09.602809 | aio | changed 2026-03-30 17:45:09.611149 | 2026-03-30 17:45:09.611221 | TASK [Switch "ansible_host" to private IP] 2026-03-30 17:45:09.880007 | aio | changed: 1 replacements made 2026-03-30 17:45:09.887826 | 2026-03-30 17:45:09.887962 | TASK [Run Molecule scenario] 2026-03-30 17:45:10.407412 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-30 17:45:11.035995 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-30 17:45:11.225563 | aio | Using CPython 3.13.7 2026-03-30 17:45:11.225678 | aio | Creating virtual environment at: .venv 2026-03-30 17:45:11.458711 | aio | Downloading cryptography (4.3MiB) 2026-03-30 17:45:11.459275 | aio | Downloading ansible-core (2.1MiB) 2026-03-30 17:45:11.459655 | aio | Downloading netaddr (2.2MiB) 2026-03-30 17:45:11.461226 | aio | Downloading pygments (1.2MiB) 2026-03-30 17:45:11.635357 | aio | Downloading netaddr 2026-03-30 17:45:11.644432 | aio | Downloading cryptography 2026-03-30 17:45:11.699537 | aio | Downloading pygments 2026-03-30 17:45:11.798074 | aio | Downloading ansible-core 2026-03-30 17:45:11.822455 | aio | Installed 36 packages in 23ms 2026-03-30 17:45:12.941467 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-30 17:45:12.941563 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-30 17:45:13.545665 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-30 17:45:13.545808 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-30 17:45:29.579521 | aio | INFO [default > dependency] Executing 2026-03-30 17:45:29.579709 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-30 17:45:29.579907 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-30 17:45:29.580038 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-30 17:45:29.585368 | aio | INFO [default > cleanup] Executing 2026-03-30 17:45:29.585708 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-30 17:45:29.590905 | aio | INFO [default > destroy] Executing 2026-03-30 17:45:29.590965 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-30 17:45:29.591039 | aio | INFO [default > destroy] Executed: Successful 2026-03-30 17:45:29.596093 | aio | INFO [default > syntax] Executing 2026-03-30 17:45:30.655673 | aio | 2026-03-30 17:45:30.655975 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-30 17:45:30.717010 | aio | INFO [default > syntax] Executed: Successful 2026-03-30 17:45:30.727416 | aio | INFO [default > create] Executing 2026-03-30 17:45:30.728798 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-30 17:45:30.734667 | aio | INFO [default > prepare] Executing 2026-03-30 17:45:31.424706 | aio | 2026-03-30 17:45:31.424827 | aio | PLAY [Prepare] ***************************************************************** 2026-03-30 17:45:31.425057 | aio | 2026-03-30 17:45:31.425321 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:45:31.425553 | aio | Monday 30 March 2026 17:45:31 +0000 (0:00:00.029) 0:00:00.030 ********** 2026-03-30 17:45:32.561792 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-30 17:45:32.562020 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-30 17:45:32.562278 | aio | interpreter could change the meaning of that path. See 2026-03-30 17:45:32.562574 | aio | https://docs.ansible.com/ansible- 2026-03-30 17:45:32.562806 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-30 17:45:32.568330 | aio | ok: [aio] 2026-03-30 17:45:32.568471 | aio | 2026-03-30 17:45:32.568675 | aio | TASK [Configure short hostname] ************************************************ 2026-03-30 17:45:32.568877 | aio | Monday 30 March 2026 17:45:32 +0000 (0:00:01.144) 0:00:01.174 ********** 2026-03-30 17:45:33.240913 | aio | changed: [aio] 2026-03-30 17:45:33.241100 | aio | 2026-03-30 17:45:33.241336 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-30 17:45:33.241571 | aio | Monday 30 March 2026 17:45:33 +0000 (0:00:00.672) 0:00:01.846 ********** 2026-03-30 17:45:33.523034 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-30 17:45:33.523302 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-30 17:45:33.523543 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-30 17:45:33.532029 | aio | changed: [aio] 2026-03-30 17:45:33.532221 | aio | 2026-03-30 17:45:33.532423 | aio | TASK [Update apt cache] ******************************************************** 2026-03-30 17:45:33.532633 | aio | Monday 30 March 2026 17:45:33 +0000 (0:00:00.290) 0:00:02.138 ********** 2026-03-30 17:45:46.756519 | aio | changed: [aio] 2026-03-30 17:45:46.756772 | aio | 2026-03-30 17:45:46.756902 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-30 17:45:46.757098 | aio | 2026-03-30 17:45:46.757315 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:45:46.757523 | aio | Monday 30 March 2026 17:45:46 +0000 (0:00:13.224) 0:00:15.362 ********** 2026-03-30 17:45:47.496501 | aio | ok: [aio] 2026-03-30 17:45:47.496704 | aio | 2026-03-30 17:45:47.496945 | aio | TASK [Install depedencies] ***************************************************** 2026-03-30 17:45:47.497308 | aio | Monday 30 March 2026 17:45:47 +0000 (0:00:00.739) 0:00:16.102 ********** 2026-03-30 17:46:08.152085 | aio | changed: [aio] 2026-03-30 17:46:08.152268 | aio | 2026-03-30 17:46:08.152528 | aio | TASK [Start up service] ******************************************************** 2026-03-30 17:46:08.152756 | aio | Monday 30 March 2026 17:46:08 +0000 (0:00:20.655) 0:00:36.758 ********** 2026-03-30 17:46:08.695964 | aio | ok: [aio] 2026-03-30 17:46:08.696075 | aio | 2026-03-30 17:46:08.696274 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-30 17:46:08.696420 | aio | Monday 30 March 2026 17:46:08 +0000 (0:00:00.544) 0:00:37.302 ********** 2026-03-30 17:46:09.006597 | aio | ok: [aio] 2026-03-30 17:46:09.006949 | aio | 2026-03-30 17:46:09.007167 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-30 17:46:09.007380 | aio | Monday 30 March 2026 17:46:09 +0000 (0:00:00.308) 0:00:37.611 ********** 2026-03-30 17:46:09.660869 | aio | changed: [aio] 2026-03-30 17:46:09.661076 | aio | 2026-03-30 17:46:09.661295 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-30 17:46:09.661507 | aio | Monday 30 March 2026 17:46:09 +0000 (0:00:00.655) 0:00:38.266 ********** 2026-03-30 17:46:09.853437 | aio | ok: [aio] 2026-03-30 17:46:09.853625 | aio | 2026-03-30 17:46:09.853850 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-30 17:46:09.854138 | aio | Monday 30 March 2026 17:46:09 +0000 (0:00:00.192) 0:00:38.459 ********** 2026-03-30 17:46:09.868569 | aio | skipping: [aio] 2026-03-30 17:46:09.868802 | aio | 2026-03-30 17:46:09.869005 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-30 17:46:09.869224 | aio | Monday 30 March 2026 17:46:09 +0000 (0:00:00.015) 0:00:38.475 ********** 2026-03-30 17:46:10.399197 | aio | changed: [aio] => (item=osd0) 2026-03-30 17:46:10.399415 | aio | changed: [aio] => (item=osd1) 2026-03-30 17:46:10.399658 | aio | changed: [aio] => (item=osd2) 2026-03-30 17:46:10.399874 | aio | 2026-03-30 17:46:10.400109 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-30 17:46:10.400338 | aio | Monday 30 March 2026 17:46:10 +0000 (0:00:00.529) 0:00:39.004 ********** 2026-03-30 17:46:11.019906 | aio | changed: [aio] => (item=osd0) 2026-03-30 17:46:11.020024 | aio | changed: [aio] => (item=osd1) 2026-03-30 17:46:11.020167 | aio | changed: [aio] => (item=osd2) 2026-03-30 17:46:11.020300 | aio | 2026-03-30 17:46:11.020444 | aio | TASK [Start loop devices] ****************************************************** 2026-03-30 17:46:11.020587 | aio | Monday 30 March 2026 17:46:11 +0000 (0:00:00.621) 0:00:39.626 ********** 2026-03-30 17:46:11.742448 | aio | changed: [aio] => (item=osd0) 2026-03-30 17:46:11.742635 | aio | changed: [aio] => (item=osd1) 2026-03-30 17:46:11.742856 | aio | changed: [aio] => (item=osd2) 2026-03-30 17:46:11.743028 | aio | 2026-03-30 17:46:11.743234 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-30 17:46:11.743436 | aio | Monday 30 March 2026 17:46:11 +0000 (0:00:00.721) 0:00:40.348 ********** 2026-03-30 17:46:14.862512 | aio | changed: [aio] => (item=osd0) 2026-03-30 17:46:14.862643 | aio | changed: [aio] => (item=osd1) 2026-03-30 17:46:14.862796 | aio | changed: [aio] => (item=osd2) 2026-03-30 17:46:14.862942 | aio | 2026-03-30 17:46:14.863097 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-30 17:46:14.863248 | aio | Monday 30 March 2026 17:46:14 +0000 (0:00:03.120) 0:00:43.468 ********** 2026-03-30 17:46:16.753483 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-30 17:46:16.753698 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-30 17:46:16.753923 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-30 17:46:16.754138 | aio | 2026-03-30 17:46:16.754409 | aio | PLAY RECAP ********************************************************************* 2026-03-30 17:46:16.754683 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-30 17:46:16.754878 | aio | 2026-03-30 17:46:16.755072 | aio | 2026-03-30 17:46:16.755292 | aio | TASKS RECAP ******************************************************************** 2026-03-30 17:46:16.755518 | aio | Monday 30 March 2026 17:46:16 +0000 (0:00:01.891) 0:00:45.360 ********** 2026-03-30 17:46:16.755725 | aio | =============================================================================== 2026-03-30 17:46:16.755944 | aio | Install depedencies ---------------------------------------------------- 20.66s 2026-03-30 17:46:16.756160 | aio | Update apt cache ------------------------------------------------------- 13.22s 2026-03-30 17:46:16.756447 | aio | Create a volume group for each loop device ------------------------------ 3.12s 2026-03-30 17:46:16.756658 | aio | Create a logical volume for each loop device ---------------------------- 1.89s 2026-03-30 17:46:16.756865 | aio | Gathering Facts --------------------------------------------------------- 1.14s 2026-03-30 17:46:16.757082 | aio | Gathering Facts --------------------------------------------------------- 0.74s 2026-03-30 17:46:16.757293 | aio | Start loop devices ------------------------------------------------------ 0.72s 2026-03-30 17:46:16.757500 | aio | Configure short hostname ------------------------------------------------ 0.67s 2026-03-30 17:46:16.757770 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s 2026-03-30 17:46:16.758044 | aio | Set permissions on loopback devices ------------------------------------- 0.62s 2026-03-30 17:46:16.758261 | aio | Start up service -------------------------------------------------------- 0.54s 2026-03-30 17:46:16.758518 | aio | Create devices for Ceph ------------------------------------------------- 0.53s 2026-03-30 17:46:16.758737 | aio | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-03-30 17:46:16.758962 | aio | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-03-30 17:46:16.759181 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-30 17:46:16.759407 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-30 17:46:16.821481 | aio | INFO [default > prepare] Executed: Successful 2026-03-30 17:46:16.830089 | aio | INFO [default > converge] Executing 2026-03-30 17:46:17.627658 | aio | 2026-03-30 17:46:17.627863 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-30 17:46:17.628048 | aio | 2026-03-30 17:46:17.628260 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:46:17.628501 | aio | Monday 30 March 2026 17:46:17 +0000 (0:00:00.046) 0:00:00.046 ********** 2026-03-30 17:46:18.789222 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-30 17:46:18.789454 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-30 17:46:18.789686 | aio | interpreter could change the meaning of that path. See 2026-03-30 17:46:18.789948 | aio | https://docs.ansible.com/ansible- 2026-03-30 17:46:18.790188 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-30 17:46:18.802647 | aio | ok: [aio] 2026-03-30 17:46:18.802874 | aio | 2026-03-30 17:46:18.803120 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:46:18.803330 | aio | Monday 30 March 2026 17:46:18 +0000 (0:00:01.175) 0:00:01.221 ********** 2026-03-30 17:46:19.101396 | aio | ok: [aio] 2026-03-30 17:46:19.101464 | aio | 2026-03-30 17:46:19.101570 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:46:19.101671 | aio | Monday 30 March 2026 17:46:19 +0000 (0:00:00.298) 0:00:01.520 ********** 2026-03-30 17:46:19.136656 | aio | skipping: [aio] 2026-03-30 17:46:19.136863 | aio | 2026-03-30 17:46:19.137125 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-30 17:46:19.137374 | aio | Monday 30 March 2026 17:46:19 +0000 (0:00:00.035) 0:00:01.555 ********** 2026-03-30 17:46:19.471688 | aio | changed: [aio] 2026-03-30 17:46:19.471871 | aio | 2026-03-30 17:46:19.472101 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:46:19.472321 | aio | Monday 30 March 2026 17:46:19 +0000 (0:00:00.335) 0:00:01.890 ********** 2026-03-30 17:46:19.573219 | aio | ok: [aio] => { 2026-03-30 17:46:19.573373 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-30 17:46:19.573688 | aio | } 2026-03-30 17:46:19.573980 | aio | 2026-03-30 17:46:19.574312 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:46:19.574557 | aio | Monday 30 March 2026 17:46:19 +0000 (0:00:00.101) 0:00:01.992 ********** 2026-03-30 17:46:20.361657 | aio | changed: [aio] 2026-03-30 17:46:20.361856 | aio | 2026-03-30 17:46:20.362100 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:46:20.362425 | aio | Monday 30 March 2026 17:46:20 +0000 (0:00:00.788) 0:00:02.780 ********** 2026-03-30 17:46:20.407104 | aio | skipping: [aio] 2026-03-30 17:46:20.407193 | aio | 2026-03-30 17:46:20.407334 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:46:20.407468 | aio | Monday 30 March 2026 17:46:20 +0000 (0:00:00.045) 0:00:02.826 ********** 2026-03-30 17:46:20.447559 | aio | skipping: [aio] 2026-03-30 17:46:20.447739 | aio | 2026-03-30 17:46:20.447951 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:46:20.448155 | aio | Monday 30 March 2026 17:46:20 +0000 (0:00:00.040) 0:00:02.866 ********** 2026-03-30 17:46:20.657058 | aio | ok: [aio] 2026-03-30 17:46:20.657268 | aio | 2026-03-30 17:46:20.657511 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:46:20.657739 | aio | Monday 30 March 2026 17:46:20 +0000 (0:00:00.209) 0:00:03.076 ********** 2026-03-30 17:46:21.804548 | aio | ok: [aio] 2026-03-30 17:46:21.804782 | aio | 2026-03-30 17:46:21.805066 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:46:21.805380 | aio | Monday 30 March 2026 17:46:21 +0000 (0:00:01.147) 0:00:04.223 ********** 2026-03-30 17:46:21.880490 | aio | ok: [aio] => { 2026-03-30 17:46:21.880705 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-30 17:46:21.880926 | aio | } 2026-03-30 17:46:21.881138 | aio | 2026-03-30 17:46:21.881386 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:46:21.881628 | aio | Monday 30 March 2026 17:46:21 +0000 (0:00:00.076) 0:00:04.299 ********** 2026-03-30 17:46:22.745782 | aio | changed: [aio] 2026-03-30 17:46:22.745956 | aio | 2026-03-30 17:46:22.746178 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:46:22.746463 | aio | Monday 30 March 2026 17:46:22 +0000 (0:00:00.865) 0:00:05.164 ********** 2026-03-30 17:46:25.673089 | aio | changed: [aio] 2026-03-30 17:46:25.673240 | aio | 2026-03-30 17:46:25.673450 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-30 17:46:25.673659 | aio | Monday 30 March 2026 17:46:25 +0000 (0:00:02.927) 0:00:08.092 ********** 2026-03-30 17:46:25.698239 | aio | skipping: [aio] 2026-03-30 17:46:25.698472 | aio | 2026-03-30 17:46:25.698703 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-30 17:46:25.698893 | aio | Monday 30 March 2026 17:46:25 +0000 (0:00:00.025) 0:00:08.117 ********** 2026-03-30 17:46:25.719392 | aio | skipping: [aio] 2026-03-30 17:46:25.719584 | aio | 2026-03-30 17:46:25.719803 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-30 17:46:25.720004 | aio | Monday 30 March 2026 17:46:25 +0000 (0:00:00.021) 0:00:08.138 ********** 2026-03-30 17:46:25.744170 | aio | skipping: [aio] 2026-03-30 17:46:25.744306 | aio | 2026-03-30 17:46:25.744473 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-30 17:46:25.744678 | aio | Monday 30 March 2026 17:46:25 +0000 (0:00:00.024) 0:00:08.163 ********** 2026-03-30 17:46:30.924184 | aio | changed: [aio] 2026-03-30 17:46:30.924289 | aio | 2026-03-30 17:46:30.924434 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-30 17:46:30.924572 | aio | Monday 30 March 2026 17:46:30 +0000 (0:00:05.180) 0:00:13.343 ********** 2026-03-30 17:46:31.472411 | aio | changed: [aio] 2026-03-30 17:46:31.472525 | aio | 2026-03-30 17:46:31.472682 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-30 17:46:31.472828 | aio | Monday 30 March 2026 17:46:31 +0000 (0:00:00.548) 0:00:13.891 ********** 2026-03-30 17:46:32.386664 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-30 17:46:32.386981 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-30 17:46:32.387261 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-30 17:46:32.387564 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-30 17:46:32.387848 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-30 17:46:32.388087 | aio | 2026-03-30 17:46:32.388350 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-30 17:46:32.388609 | aio | Monday 30 March 2026 17:46:32 +0000 (0:00:00.914) 0:00:14.805 ********** 2026-03-30 17:46:32.943330 | aio | changed: [aio] 2026-03-30 17:46:32.943440 | aio | 2026-03-30 17:46:32.943604 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-30 17:46:32.943765 | aio | Monday 30 March 2026 17:46:32 +0000 (0:00:00.548) 0:00:15.353 ********** 2026-03-30 17:46:32.943906 | aio | 2026-03-30 17:46:32.944064 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-30 17:46:32.944219 | aio | Monday 30 March 2026 17:46:32 +0000 (0:00:00.008) 0:00:15.362 ********** 2026-03-30 17:46:33.883378 | aio | ok: [aio] 2026-03-30 17:46:33.883581 | aio | 2026-03-30 17:46:33.883603 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-30 17:46:33.883614 | aio | Monday 30 March 2026 17:46:33 +0000 (0:00:00.939) 0:00:16.301 ********** 2026-03-30 17:46:34.315537 | aio | changed: [aio] 2026-03-30 17:46:34.315597 | aio | 2026-03-30 17:46:34.315603 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-30 17:46:34.315608 | aio | Monday 30 March 2026 17:46:34 +0000 (0:00:00.432) 0:00:16.734 ********** 2026-03-30 17:46:34.866431 | aio | changed: [aio] 2026-03-30 17:46:34.866493 | aio | 2026-03-30 17:46:34.866587 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:46:34.866684 | aio | Monday 30 March 2026 17:46:34 +0000 (0:00:00.551) 0:00:17.285 ********** 2026-03-30 17:46:35.076787 | aio | ok: [aio] 2026-03-30 17:46:35.076845 | aio | 2026-03-30 17:46:35.076933 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:46:35.077063 | aio | Monday 30 March 2026 17:46:35 +0000 (0:00:00.210) 0:00:17.496 ********** 2026-03-30 17:46:35.141608 | aio | ok: [aio] => { 2026-03-30 17:46:35.141691 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-30 17:46:35.141765 | aio | } 2026-03-30 17:46:35.142040 | aio | 2026-03-30 17:46:35.142082 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:46:35.142087 | aio | Monday 30 March 2026 17:46:35 +0000 (0:00:00.064) 0:00:17.560 ********** 2026-03-30 17:46:36.002746 | aio | changed: [aio] 2026-03-30 17:46:36.002816 | aio | 2026-03-30 17:46:36.003087 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:46:36.003166 | aio | Monday 30 March 2026 17:46:35 +0000 (0:00:00.860) 0:00:18.421 ********** 2026-03-30 17:46:40.400194 | aio | changed: [aio] 2026-03-30 17:46:40.400267 | aio | 2026-03-30 17:46:40.400622 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-30 17:46:40.400678 | aio | Monday 30 March 2026 17:46:40 +0000 (0:00:04.397) 0:00:22.819 ********** 2026-03-30 17:46:41.377272 | aio | ok: [aio] 2026-03-30 17:46:41.377319 | aio | 2026-03-30 17:46:41.377326 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-30 17:46:41.377333 | aio | Monday 30 March 2026 17:46:41 +0000 (0:00:00.976) 0:00:23.795 ********** 2026-03-30 17:46:41.728708 | aio | changed: [aio] 2026-03-30 17:46:41.728787 | aio | 2026-03-30 17:46:41.729024 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-30 17:46:41.729103 | aio | Monday 30 March 2026 17:46:41 +0000 (0:00:00.351) 0:00:24.147 ********** 2026-03-30 17:46:42.178188 | aio | changed: [aio] 2026-03-30 17:46:42.178380 | aio | 2026-03-30 17:46:42.178725 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-30 17:46:42.178862 | aio | Monday 30 March 2026 17:46:42 +0000 (0:00:00.449) 0:00:24.597 ********** 2026-03-30 17:46:42.734885 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-30 17:46:42.734957 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-30 17:46:42.735439 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-30 17:46:42.735486 | aio | 2026-03-30 17:46:42.735491 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-30 17:46:42.735496 | aio | Monday 30 March 2026 17:46:42 +0000 (0:00:00.556) 0:00:25.154 ********** 2026-03-30 17:46:43.176132 | aio | changed: [aio] 2026-03-30 17:46:43.176223 | aio | 2026-03-30 17:46:43.176517 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-30 17:46:43.176539 | aio | Monday 30 March 2026 17:46:43 +0000 (0:00:00.441) 0:00:25.595 ********** 2026-03-30 17:46:43.610620 | aio | changed: [aio] 2026-03-30 17:46:43.610697 | aio | 2026-03-30 17:46:43.610763 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-30 17:46:43.611153 | aio | Monday 30 March 2026 17:46:43 +0000 (0:00:00.426) 0:00:26.022 ********** 2026-03-30 17:46:43.611195 | aio | 2026-03-30 17:46:43.611200 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-30 17:46:43.611205 | aio | Monday 30 March 2026 17:46:43 +0000 (0:00:00.007) 0:00:26.029 ********** 2026-03-30 17:46:44.331513 | aio | ok: [aio] 2026-03-30 17:46:44.331589 | aio | 2026-03-30 17:46:44.331660 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-30 17:46:44.331789 | aio | Monday 30 March 2026 17:46:44 +0000 (0:00:00.720) 0:00:26.750 ********** 2026-03-30 17:46:45.621032 | aio | changed: [aio] 2026-03-30 17:46:45.621123 | aio | 2026-03-30 17:46:45.621451 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-30 17:46:45.621509 | aio | Monday 30 March 2026 17:46:45 +0000 (0:00:01.289) 0:00:28.040 ********** 2026-03-30 17:46:46.158498 | aio | changed: [aio] 2026-03-30 17:46:46.158571 | aio | 2026-03-30 17:46:46.158772 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-30 17:46:46.158817 | aio | Monday 30 March 2026 17:46:46 +0000 (0:00:00.537) 0:00:28.577 ********** 2026-03-30 17:46:46.201312 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-30 17:46:46.201394 | aio | 2026-03-30 17:46:46.201475 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-30 17:46:46.201569 | aio | Monday 30 March 2026 17:46:46 +0000 (0:00:00.042) 0:00:28.620 ********** 2026-03-30 17:46:50.963067 | aio | changed: [aio] 2026-03-30 17:46:50.963144 | aio | 2026-03-30 17:46:50.963501 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-30 17:46:50.963556 | aio | Monday 30 March 2026 17:46:50 +0000 (0:00:04.761) 0:00:33.381 ********** 2026-03-30 17:46:51.615989 | aio | ok: [aio] => (item=chronyd) 2026-03-30 17:46:51.616065 | aio | ok: [aio] => (item=sshd) 2026-03-30 17:46:51.616488 | aio | 2026-03-30 17:46:51.616538 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-30 17:46:51.616546 | aio | Monday 30 March 2026 17:46:51 +0000 (0:00:00.653) 0:00:34.035 ********** 2026-03-30 17:46:51.898939 | aio | changed: [aio] 2026-03-30 17:46:51.899011 | aio | 2026-03-30 17:46:51.899087 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-30 17:46:51.899220 | aio | Monday 30 March 2026 17:46:51 +0000 (0:00:00.282) 0:00:34.318 ********** 2026-03-30 17:46:52.093030 | aio | ok: [aio] 2026-03-30 17:46:52.093150 | aio | 2026-03-30 17:46:52.093244 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-30 17:46:52.093963 | aio | Monday 30 March 2026 17:46:52 +0000 (0:00:00.193) 0:00:34.512 ********** 2026-03-30 17:46:52.605105 | aio | changed: [aio] 2026-03-30 17:46:52.605159 | aio | 2026-03-30 17:46:52.605164 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-30 17:46:52.605169 | aio | Monday 30 March 2026 17:46:52 +0000 (0:00:00.511) 0:00:35.023 ********** 2026-03-30 17:46:52.938379 | aio | changed: [aio] 2026-03-30 17:46:52.938608 | aio | 2026-03-30 17:46:52.938621 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-30 17:46:52.938631 | aio | Monday 30 March 2026 17:46:52 +0000 (0:00:00.333) 0:00:35.357 ********** 2026-03-30 17:46:53.086397 | aio | ok: [aio] 2026-03-30 17:46:53.086476 | aio | 2026-03-30 17:46:53.086491 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-30 17:46:53.086646 | aio | Monday 30 March 2026 17:46:53 +0000 (0:00:00.147) 0:00:35.505 ********** 2026-03-30 17:46:53.330967 | aio | ok: [aio] => (item=aio) 2026-03-30 17:46:53.331047 | aio | 2026-03-30 17:46:53.331379 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-30 17:46:53.331436 | aio | Monday 30 March 2026 17:46:53 +0000 (0:00:00.244) 0:00:35.749 ********** 2026-03-30 17:46:53.373384 | aio | ok: [aio] 2026-03-30 17:46:53.373462 | aio | 2026-03-30 17:46:53.373520 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-30 17:46:53.373647 | aio | Monday 30 March 2026 17:46:53 +0000 (0:00:00.042) 0:00:35.792 ********** 2026-03-30 17:46:53.476091 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-30 17:46:53.476161 | aio | 2026-03-30 17:46:53.476180 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-30 17:46:53.476278 | aio | Monday 30 March 2026 17:46:53 +0000 (0:00:00.102) 0:00:35.895 ********** 2026-03-30 17:46:53.753963 | aio | changed: [aio] 2026-03-30 17:46:53.754038 | aio | 2026-03-30 17:46:53.754102 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-30 17:46:53.754265 | aio | Monday 30 March 2026 17:46:53 +0000 (0:00:00.277) 0:00:36.172 ********** 2026-03-30 17:46:54.400210 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-30 17:46:54.400292 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-30 17:46:54.400365 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-30 17:46:54.400657 | aio | 2026-03-30 17:46:54.400703 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-30 17:46:54.400709 | aio | Monday 30 March 2026 17:46:54 +0000 (0:00:00.646) 0:00:36.819 ********** 2026-03-30 17:48:22.411680 | aio | ok: [aio] 2026-03-30 17:48:22.411760 | aio | 2026-03-30 17:48:22.412105 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-30 17:48:22.412156 | aio | Monday 30 March 2026 17:48:22 +0000 (0:01:28.011) 0:02:04.830 ********** 2026-03-30 17:48:22.637943 | aio | changed: [aio] 2026-03-30 17:48:22.638003 | aio | 2026-03-30 17:48:22.638012 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-30 17:48:22.638019 | aio | Monday 30 March 2026 17:48:22 +0000 (0:00:00.225) 0:02:05.056 ********** 2026-03-30 17:48:22.674201 | aio | ok: [aio] 2026-03-30 17:48:22.674254 | aio | 2026-03-30 17:48:22.674262 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:48:22.674270 | aio | Monday 30 March 2026 17:48:22 +0000 (0:00:00.036) 0:02:05.092 ********** 2026-03-30 17:48:22.744887 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:48:22.744936 | aio | 2026-03-30 17:48:22.744941 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:48:22.744946 | aio | Monday 30 March 2026 17:48:22 +0000 (0:00:00.071) 0:02:05.164 ********** 2026-03-30 17:48:28.304747 | aio | ok: [aio] 2026-03-30 17:48:28.305168 | aio | 2026-03-30 17:48:28.305203 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:48:28.305215 | aio | Monday 30 March 2026 17:48:28 +0000 (0:00:05.559) 0:02:10.723 ********** 2026-03-30 17:48:28.354724 | aio | ok: [aio] => (item=aio) 2026-03-30 17:48:28.354791 | aio | 2026-03-30 17:48:28.354896 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:48:28.354997 | aio | Monday 30 March 2026 17:48:28 +0000 (0:00:00.050) 0:02:10.773 ********** 2026-03-30 17:48:28.695335 | aio | ok: [aio] 2026-03-30 17:48:28.695406 | aio | 2026-03-30 17:48:28.695719 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:48:28.695764 | aio | Monday 30 March 2026 17:48:28 +0000 (0:00:00.340) 0:02:11.114 ********** 2026-03-30 17:48:36.085291 | aio | ok: [aio] 2026-03-30 17:48:36.085359 | aio | 2026-03-30 17:48:36.085569 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-30 17:48:36.085615 | aio | Monday 30 March 2026 17:48:36 +0000 (0:00:07.390) 0:02:18.504 ********** 2026-03-30 17:49:26.155677 | aio | changed: [aio] 2026-03-30 17:49:26.155763 | aio | 2026-03-30 17:49:26.155878 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-30 17:49:26.156032 | aio | Monday 30 March 2026 17:49:26 +0000 (0:00:50.070) 0:03:08.574 ********** 2026-03-30 17:49:40.175260 | aio | ok: [aio] 2026-03-30 17:49:40.175328 | aio | 2026-03-30 17:49:40.175538 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:49:40.175589 | aio | Monday 30 March 2026 17:49:40 +0000 (0:00:14.019) 0:03:22.594 ********** 2026-03-30 17:49:40.248401 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:49:40.248466 | aio | 2026-03-30 17:49:40.248679 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:49:40.248726 | aio | Monday 30 March 2026 17:49:40 +0000 (0:00:00.073) 0:03:22.667 ********** 2026-03-30 17:49:40.288125 | aio | skipping: [aio] 2026-03-30 17:49:40.288277 | aio | 2026-03-30 17:49:40.288452 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:49:40.288663 | aio | Monday 30 March 2026 17:49:40 +0000 (0:00:00.040) 0:03:22.707 ********** 2026-03-30 17:49:40.331222 | aio | skipping: [aio] => (item=aio) 2026-03-30 17:49:40.331301 | aio | skipping: [aio] 2026-03-30 17:49:40.331723 | aio | 2026-03-30 17:49:40.331777 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:49:40.331785 | aio | Monday 30 March 2026 17:49:40 +0000 (0:00:00.042) 0:03:22.750 ********** 2026-03-30 17:49:40.572913 | aio | ok: [aio] 2026-03-30 17:49:40.572998 | aio | 2026-03-30 17:49:40.573269 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:49:40.573321 | aio | Monday 30 March 2026 17:49:40 +0000 (0:00:00.241) 0:03:22.992 ********** 2026-03-30 17:49:46.960796 | aio | ok: [aio] 2026-03-30 17:49:46.960861 | aio | 2026-03-30 17:49:46.960869 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-30 17:49:46.960875 | aio | Monday 30 March 2026 17:49:46 +0000 (0:00:06.387) 0:03:29.379 ********** 2026-03-30 17:49:59.587603 | aio | changed: [aio] 2026-03-30 17:49:59.587687 | aio | 2026-03-30 17:49:59.587702 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-30 17:49:59.587838 | aio | Monday 30 March 2026 17:49:59 +0000 (0:00:12.627) 0:03:42.006 ********** 2026-03-30 17:50:05.539095 | aio | ok: [aio] 2026-03-30 17:50:05.539167 | aio | 2026-03-30 17:50:05.539376 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-30 17:50:05.539393 | aio | Monday 30 March 2026 17:50:05 +0000 (0:00:05.951) 0:03:47.958 ********** 2026-03-30 17:50:13.498118 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-30 17:50:13.498174 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-30 17:50:13.498283 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-30 17:50:13.498392 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-30 17:50:13.498478 | aio | 2026-03-30 17:50:13.498574 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-30 17:50:13.498652 | aio | 2026-03-30 17:50:13.498744 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:50:13.498837 | aio | Monday 30 March 2026 17:50:13 +0000 (0:00:07.959) 0:03:55.917 ********** 2026-03-30 17:50:14.380643 | aio | ok: [aio] 2026-03-30 17:50:14.380731 | aio | 2026-03-30 17:50:14.380793 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:50:14.380910 | aio | Monday 30 March 2026 17:50:14 +0000 (0:00:00.881) 0:03:56.799 ********** 2026-03-30 17:50:14.585491 | aio | ok: [aio] 2026-03-30 17:50:14.585557 | aio | 2026-03-30 17:50:14.585647 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:50:14.585735 | aio | Monday 30 March 2026 17:50:14 +0000 (0:00:00.205) 0:03:57.004 ********** 2026-03-30 17:50:14.621216 | aio | skipping: [aio] 2026-03-30 17:50:14.621282 | aio | 2026-03-30 17:50:14.621388 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-30 17:50:14.621511 | aio | Monday 30 March 2026 17:50:14 +0000 (0:00:00.035) 0:03:57.040 ********** 2026-03-30 17:50:14.832666 | aio | ok: [aio] 2026-03-30 17:50:14.832733 | aio | 2026-03-30 17:50:14.832811 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:50:14.832914 | aio | Monday 30 March 2026 17:50:14 +0000 (0:00:00.211) 0:03:57.251 ********** 2026-03-30 17:50:14.883156 | aio | ok: [aio] => { 2026-03-30 17:50:14.883241 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-30 17:50:14.883384 | aio | } 2026-03-30 17:50:14.883498 | aio | 2026-03-30 17:50:14.883634 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:50:14.883768 | aio | Monday 30 March 2026 17:50:14 +0000 (0:00:00.050) 0:03:57.302 ********** 2026-03-30 17:50:15.184928 | aio | ok: [aio] 2026-03-30 17:50:15.185017 | aio | 2026-03-30 17:50:15.185367 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:50:15.185423 | aio | Monday 30 March 2026 17:50:15 +0000 (0:00:00.301) 0:03:57.603 ********** 2026-03-30 17:50:15.223579 | aio | skipping: [aio] 2026-03-30 17:50:15.223658 | aio | 2026-03-30 17:50:15.223884 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:50:15.223916 | aio | Monday 30 March 2026 17:50:15 +0000 (0:00:00.039) 0:03:57.642 ********** 2026-03-30 17:50:15.263581 | aio | skipping: [aio] 2026-03-30 17:50:15.263645 | aio | 2026-03-30 17:50:15.263751 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:50:15.263884 | aio | Monday 30 March 2026 17:50:15 +0000 (0:00:00.039) 0:03:57.682 ********** 2026-03-30 17:50:15.463371 | aio | ok: [aio] 2026-03-30 17:50:15.463414 | aio | 2026-03-30 17:50:15.463420 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:50:15.463425 | aio | Monday 30 March 2026 17:50:15 +0000 (0:00:00.199) 0:03:57.882 ********** 2026-03-30 17:50:16.611077 | aio | ok: [aio] 2026-03-30 17:50:16.611120 | aio | 2026-03-30 17:50:16.611125 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:50:16.611130 | aio | Monday 30 March 2026 17:50:16 +0000 (0:00:01.147) 0:03:59.030 ********** 2026-03-30 17:50:16.676023 | aio | ok: [aio] => { 2026-03-30 17:50:16.676065 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-30 17:50:16.676070 | aio | } 2026-03-30 17:50:16.676074 | aio | 2026-03-30 17:50:16.676078 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:50:16.676083 | aio | Monday 30 March 2026 17:50:16 +0000 (0:00:00.064) 0:03:59.094 ********** 2026-03-30 17:50:17.006395 | aio | ok: [aio] 2026-03-30 17:50:17.006441 | aio | 2026-03-30 17:50:17.006446 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:50:17.006451 | aio | Monday 30 March 2026 17:50:16 +0000 (0:00:00.330) 0:03:59.425 ********** 2026-03-30 17:50:18.960295 | aio | ok: [aio] 2026-03-30 17:50:18.960349 | aio | 2026-03-30 17:50:18.960357 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-30 17:50:18.960363 | aio | Monday 30 March 2026 17:50:18 +0000 (0:00:01.953) 0:04:01.379 ********** 2026-03-30 17:50:18.985850 | aio | skipping: [aio] 2026-03-30 17:50:18.985890 | aio | 2026-03-30 17:50:18.985896 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-30 17:50:18.985902 | aio | Monday 30 March 2026 17:50:18 +0000 (0:00:00.025) 0:04:01.404 ********** 2026-03-30 17:50:19.009770 | aio | skipping: [aio] 2026-03-30 17:50:19.009810 | aio | 2026-03-30 17:50:19.009815 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-30 17:50:19.009820 | aio | Monday 30 March 2026 17:50:19 +0000 (0:00:00.024) 0:04:01.428 ********** 2026-03-30 17:50:19.042412 | aio | skipping: [aio] 2026-03-30 17:50:19.042530 | aio | 2026-03-30 17:50:19.042545 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-30 17:50:19.042645 | aio | Monday 30 March 2026 17:50:19 +0000 (0:00:00.032) 0:04:01.461 ********** 2026-03-30 17:50:20.225850 | aio | ok: [aio] 2026-03-30 17:50:20.225892 | aio | 2026-03-30 17:50:20.225897 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-30 17:50:20.225902 | aio | Monday 30 March 2026 17:50:20 +0000 (0:00:01.183) 0:04:02.644 ********** 2026-03-30 17:50:20.634795 | aio | ok: [aio] 2026-03-30 17:50:20.634834 | aio | 2026-03-30 17:50:20.634839 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-30 17:50:20.634844 | aio | Monday 30 March 2026 17:50:20 +0000 (0:00:00.408) 0:04:03.053 ********** 2026-03-30 17:50:21.563872 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-30 17:50:21.564848 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-30 17:50:21.564874 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-30 17:50:21.564882 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-30 17:50:21.564888 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-30 17:50:21.564907 | aio | 2026-03-30 17:50:21.564913 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-30 17:50:21.564919 | aio | Monday 30 March 2026 17:50:21 +0000 (0:00:00.928) 0:04:03.982 ********** 2026-03-30 17:50:22.069187 | aio | ok: [aio] 2026-03-30 17:50:22.069235 | aio | 2026-03-30 17:50:22.069241 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-30 17:50:22.069245 | aio | Monday 30 March 2026 17:50:22 +0000 (0:00:00.498) 0:04:04.481 ********** 2026-03-30 17:50:22.069250 | aio | 2026-03-30 17:50:22.069254 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-30 17:50:22.069258 | aio | Monday 30 March 2026 17:50:22 +0000 (0:00:00.006) 0:04:04.487 ********** 2026-03-30 17:50:22.418991 | aio | ok: [aio] 2026-03-30 17:50:22.419057 | aio | 2026-03-30 17:50:22.419149 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:50:22.419251 | aio | Monday 30 March 2026 17:50:22 +0000 (0:00:00.350) 0:04:04.838 ********** 2026-03-30 17:50:22.618766 | aio | ok: [aio] 2026-03-30 17:50:22.618827 | aio | 2026-03-30 17:50:22.618926 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:50:22.619028 | aio | Monday 30 March 2026 17:50:22 +0000 (0:00:00.199) 0:04:05.038 ********** 2026-03-30 17:50:22.670594 | aio | ok: [aio] => { 2026-03-30 17:50:22.670736 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-30 17:50:22.671229 | aio | } 2026-03-30 17:50:22.671249 | aio | 2026-03-30 17:50:22.671257 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:50:22.671263 | aio | Monday 30 March 2026 17:50:22 +0000 (0:00:00.051) 0:04:05.089 ********** 2026-03-30 17:50:23.012371 | aio | ok: [aio] 2026-03-30 17:50:23.012437 | aio | 2026-03-30 17:50:23.012837 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:50:23.012889 | aio | Monday 30 March 2026 17:50:23 +0000 (0:00:00.341) 0:04:05.431 ********** 2026-03-30 17:50:26.074051 | aio | ok: [aio] 2026-03-30 17:50:26.074120 | aio | 2026-03-30 17:50:26.074242 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-30 17:50:26.074393 | aio | Monday 30 March 2026 17:50:26 +0000 (0:00:03.061) 0:04:08.493 ********** 2026-03-30 17:50:27.164872 | aio | ok: [aio] 2026-03-30 17:50:27.164946 | aio | 2026-03-30 17:50:27.165024 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-30 17:50:27.165150 | aio | Monday 30 March 2026 17:50:27 +0000 (0:00:01.090) 0:04:09.584 ********** 2026-03-30 17:50:27.355033 | aio | ok: [aio] 2026-03-30 17:50:27.355108 | aio | 2026-03-30 17:50:27.355181 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-30 17:50:27.355301 | aio | Monday 30 March 2026 17:50:27 +0000 (0:00:00.189) 0:04:09.774 ********** 2026-03-30 17:50:27.783620 | aio | ok: [aio] 2026-03-30 17:50:27.783666 | aio | 2026-03-30 17:50:27.783672 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-30 17:50:27.783677 | aio | Monday 30 March 2026 17:50:27 +0000 (0:00:00.428) 0:04:10.202 ********** 2026-03-30 17:50:28.353174 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-30 17:50:28.353918 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-30 17:50:28.353973 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-30 17:50:28.353982 | aio | 2026-03-30 17:50:28.353989 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-30 17:50:28.353996 | aio | Monday 30 March 2026 17:50:28 +0000 (0:00:00.569) 0:04:10.772 ********** 2026-03-30 17:50:28.768155 | aio | ok: [aio] 2026-03-30 17:50:28.768226 | aio | 2026-03-30 17:50:28.768543 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-30 17:50:28.768583 | aio | Monday 30 March 2026 17:50:28 +0000 (0:00:00.415) 0:04:11.187 ********** 2026-03-30 17:50:29.183092 | aio | ok: [aio] 2026-03-30 17:50:29.183160 | aio | 2026-03-30 17:50:29.183242 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-30 17:50:29.183634 | aio | Monday 30 March 2026 17:50:29 +0000 (0:00:00.410) 0:04:11.597 ********** 2026-03-30 17:50:29.183676 | aio | 2026-03-30 17:50:29.183681 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-30 17:50:29.183686 | aio | Monday 30 March 2026 17:50:29 +0000 (0:00:00.004) 0:04:11.602 ********** 2026-03-30 17:50:29.526346 | aio | ok: [aio] 2026-03-30 17:50:29.526418 | aio | 2026-03-30 17:50:29.526608 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-30 17:50:29.526658 | aio | Monday 30 March 2026 17:50:29 +0000 (0:00:00.343) 0:04:11.945 ********** 2026-03-30 17:50:29.566470 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-30 17:50:29.566533 | aio | 2026-03-30 17:50:29.566800 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-30 17:50:29.566848 | aio | Monday 30 March 2026 17:50:29 +0000 (0:00:00.040) 0:04:11.985 ********** 2026-03-30 17:50:30.524776 | aio | ok: [aio] 2026-03-30 17:50:30.525222 | aio | 2026-03-30 17:50:30.525270 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-30 17:50:30.525276 | aio | Monday 30 March 2026 17:50:30 +0000 (0:00:00.957) 0:04:12.943 ********** 2026-03-30 17:50:31.198141 | aio | ok: [aio] => (item=chronyd) 2026-03-30 17:50:31.198223 | aio | ok: [aio] => (item=sshd) 2026-03-30 17:50:31.198272 | aio | 2026-03-30 17:50:31.198433 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-30 17:50:31.198507 | aio | Monday 30 March 2026 17:50:31 +0000 (0:00:00.673) 0:04:13.617 ********** 2026-03-30 17:50:31.478405 | aio | ok: [aio] 2026-03-30 17:50:31.478460 | aio | 2026-03-30 17:50:31.478626 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-30 17:50:31.478783 | aio | Monday 30 March 2026 17:50:31 +0000 (0:00:00.280) 0:04:13.897 ********** 2026-03-30 17:50:31.671917 | aio | ok: [aio] 2026-03-30 17:50:31.671984 | aio | 2026-03-30 17:50:31.672064 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-30 17:50:31.672196 | aio | Monday 30 March 2026 17:50:31 +0000 (0:00:00.193) 0:04:14.091 ********** 2026-03-30 17:50:31.933939 | aio | ok: [aio] 2026-03-30 17:50:31.934047 | aio | 2026-03-30 17:50:31.934059 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-30 17:50:31.934174 | aio | Monday 30 March 2026 17:50:31 +0000 (0:00:00.261) 0:04:14.353 ********** 2026-03-30 17:50:32.135795 | aio | ok: [aio] 2026-03-30 17:50:32.135859 | aio | 2026-03-30 17:50:32.135944 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-30 17:50:32.136061 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.202) 0:04:14.555 ********** 2026-03-30 17:50:32.350706 | aio | ok: [aio] => (item=aio) 2026-03-30 17:50:32.350765 | aio | 2026-03-30 17:50:32.350872 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-30 17:50:32.351035 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.214) 0:04:14.769 ********** 2026-03-30 17:50:32.393548 | aio | ok: [aio] 2026-03-30 17:50:32.393633 | aio | 2026-03-30 17:50:32.394060 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:50:32.394103 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.042) 0:04:14.812 ********** 2026-03-30 17:50:32.444044 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:50:32.444100 | aio | 2026-03-30 17:50:32.444298 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:50:32.444348 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.050) 0:04:14.863 ********** 2026-03-30 17:50:32.489413 | aio | skipping: [aio] 2026-03-30 17:50:32.489501 | aio | 2026-03-30 17:50:32.489851 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:50:32.489912 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.045) 0:04:14.908 ********** 2026-03-30 17:50:32.527707 | aio | skipping: [aio] => (item=aio) 2026-03-30 17:50:32.528258 | aio | skipping: [aio] 2026-03-30 17:50:32.528310 | aio | 2026-03-30 17:50:32.528318 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:50:32.528325 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.038) 0:04:14.946 ********** 2026-03-30 17:50:32.769148 | aio | ok: [aio] 2026-03-30 17:50:32.770069 | aio | 2026-03-30 17:50:32.770123 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:50:32.770132 | aio | Monday 30 March 2026 17:50:32 +0000 (0:00:00.241) 0:04:15.188 ********** 2026-03-30 17:50:39.137010 | aio | ok: [aio] 2026-03-30 17:50:39.137077 | aio | 2026-03-30 17:50:39.137276 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-30 17:50:39.137291 | aio | Monday 30 March 2026 17:50:39 +0000 (0:00:06.368) 0:04:21.556 ********** 2026-03-30 17:50:44.409125 | aio | ok: [aio] 2026-03-30 17:50:44.409203 | aio | 2026-03-30 17:50:44.409407 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-30 17:50:44.409450 | aio | Monday 30 March 2026 17:50:44 +0000 (0:00:05.272) 0:04:26.828 ********** 2026-03-30 17:50:58.238719 | aio | ok: [aio] 2026-03-30 17:50:58.238805 | aio | 2026-03-30 17:50:58.238876 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-30 17:50:58.239002 | aio | Monday 30 March 2026 17:50:58 +0000 (0:00:13.829) 0:04:40.658 ********** 2026-03-30 17:52:35.157098 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-30 17:52:35.157177 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-30 17:52:35.157265 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-30 17:52:35.157358 | aio | 2026-03-30 17:52:35.157461 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-30 17:52:35.157561 | aio | Monday 30 March 2026 17:52:35 +0000 (0:01:36.918) 0:06:17.576 ********** 2026-03-30 17:52:41.106077 | aio | ok: [aio] 2026-03-30 17:52:41.106145 | aio | 2026-03-30 17:52:41.106165 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-30 17:52:41.106334 | aio | Monday 30 March 2026 17:52:41 +0000 (0:00:05.948) 0:06:23.524 ********** 2026-03-30 17:52:47.106425 | aio | ok: [aio] 2026-03-30 17:52:47.106488 | aio | 2026-03-30 17:52:47.106500 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-30 17:52:47.106528 | aio | Monday 30 March 2026 17:52:47 +0000 (0:00:06.000) 0:06:29.524 ********** 2026-03-30 17:52:47.152426 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-30 17:52:47.152465 | aio | 2026-03-30 17:52:47.152718 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-30 17:52:47.152763 | aio | Monday 30 March 2026 17:52:47 +0000 (0:00:00.046) 0:06:29.571 ********** 2026-03-30 17:52:47.188800 | aio | ok: [aio] 2026-03-30 17:52:47.188882 | aio | 2026-03-30 17:52:47.189026 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-30 17:52:47.189161 | aio | Monday 30 March 2026 17:52:47 +0000 (0:00:00.036) 0:06:29.608 ********** 2026-03-30 17:52:53.199796 | aio | ok: [aio] 2026-03-30 17:52:53.199921 | aio | 2026-03-30 17:52:53.200244 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-30 17:52:53.200310 | aio | Monday 30 March 2026 17:52:53 +0000 (0:00:06.010) 0:06:35.618 ********** 2026-03-30 17:52:53.244951 | aio | ok: [aio] 2026-03-30 17:52:53.245012 | aio | 2026-03-30 17:52:53.245256 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-30 17:52:53.245297 | aio | Monday 30 March 2026 17:52:53 +0000 (0:00:00.045) 0:06:35.664 ********** 2026-03-30 17:52:53.294529 | aio | skipping: [aio] => (item=1) 2026-03-30 17:52:53.294610 | aio | skipping: [aio] => (item=1) 2026-03-30 17:52:53.294621 | aio | skipping: [aio] => (item=1) 2026-03-30 17:52:53.294657 | aio | skipping: [aio] 2026-03-30 17:52:53.294686 | aio | 2026-03-30 17:52:53.294715 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-30 17:52:53.294791 | aio | Monday 30 March 2026 17:52:53 +0000 (0:00:00.048) 0:06:35.712 ********** 2026-03-30 17:52:53.323533 | aio | skipping: [aio] 2026-03-30 17:52:53.323674 | aio | 2026-03-30 17:52:53.323906 | aio | PLAY RECAP ********************************************************************* 2026-03-30 17:52:53.324219 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-30 17:52:53.324540 | aio | 2026-03-30 17:52:53.324792 | aio | 2026-03-30 17:52:53.325033 | aio | TASKS RECAP ******************************************************************** 2026-03-30 17:52:53.325231 | aio | Monday 30 March 2026 17:52:53 +0000 (0:00:00.029) 0:06:35.742 ********** 2026-03-30 17:52:53.325442 | aio | =============================================================================== 2026-03-30 17:52:53.325658 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 96.92s 2026-03-30 17:52:53.325888 | aio | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 88.01s 2026-03-30 17:52:53.326094 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 50.07s 2026-03-30 17:52:53.326325 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.02s 2026-03-30 17:52:53.326548 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.83s 2026-03-30 17:52:53.326783 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.63s 2026-03-30 17:52:53.326985 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.96s 2026-03-30 17:52:53.327226 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.39s 2026-03-30 17:52:53.327496 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.39s 2026-03-30 17:52:53.327659 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.37s 2026-03-30 17:52:53.327837 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.01s 2026-03-30 17:52:53.328069 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.00s 2026-03-30 17:52:53.328258 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.95s 2026-03-30 17:52:53.328559 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.95s 2026-03-30 17:52:53.328830 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.56s 2026-03-30 17:52:53.329075 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.27s 2026-03-30 17:52:53.329312 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.18s 2026-03-30 17:52:53.329549 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.76s 2026-03-30 17:52:53.329767 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.40s 2026-03-30 17:52:53.330003 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s 2026-03-30 17:52:53.442203 | aio | INFO [default > converge] Executed: Successful 2026-03-30 17:52:53.450772 | aio | INFO [default > idempotence] Executing 2026-03-30 17:52:54.335118 | aio | 2026-03-30 17:52:54.335442 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-30 17:52:54.335654 | aio | 2026-03-30 17:52:54.335999 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:52:54.336302 | aio | Monday 30 March 2026 17:52:54 +0000 (0:00:00.063) 0:00:00.063 ********** 2026-03-30 17:52:55.637249 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-30 17:52:55.637500 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-30 17:52:55.637697 | aio | interpreter could change the meaning of that path. See 2026-03-30 17:52:55.637925 | aio | https://docs.ansible.com/ansible- 2026-03-30 17:52:55.638125 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-30 17:52:55.648398 | aio | ok: [aio] 2026-03-30 17:52:55.648594 | aio | 2026-03-30 17:52:55.648791 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:52:55.648992 | aio | Monday 30 March 2026 17:52:55 +0000 (0:00:01.313) 0:00:01.376 ********** 2026-03-30 17:52:55.935026 | aio | ok: [aio] 2026-03-30 17:52:55.935112 | aio | 2026-03-30 17:52:55.935251 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:52:55.935406 | aio | Monday 30 March 2026 17:52:55 +0000 (0:00:00.286) 0:00:01.662 ********** 2026-03-30 17:52:55.973186 | aio | skipping: [aio] 2026-03-30 17:52:55.973339 | aio | 2026-03-30 17:52:55.973455 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-30 17:52:55.973588 | aio | Monday 30 March 2026 17:52:55 +0000 (0:00:00.038) 0:00:01.701 ********** 2026-03-30 17:52:56.296897 | aio | ok: [aio] 2026-03-30 17:52:56.297172 | aio | 2026-03-30 17:52:56.297478 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:52:56.297864 | aio | Monday 30 March 2026 17:52:56 +0000 (0:00:00.323) 0:00:02.024 ********** 2026-03-30 17:52:56.371110 | aio | ok: [aio] => { 2026-03-30 17:52:56.371227 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-30 17:52:56.371393 | aio | } 2026-03-30 17:52:56.371549 | aio | 2026-03-30 17:52:56.371712 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:52:56.371871 | aio | Monday 30 March 2026 17:52:56 +0000 (0:00:00.074) 0:00:02.098 ********** 2026-03-30 17:52:56.816568 | aio | ok: [aio] 2026-03-30 17:52:56.816770 | aio | 2026-03-30 17:52:56.817018 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:52:56.818179 | aio | Monday 30 March 2026 17:52:56 +0000 (0:00:00.445) 0:00:02.544 ********** 2026-03-30 17:52:56.856659 | aio | skipping: [aio] 2026-03-30 17:52:56.856830 | aio | 2026-03-30 17:52:56.857084 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:52:56.857320 | aio | Monday 30 March 2026 17:52:56 +0000 (0:00:00.040) 0:00:02.584 ********** 2026-03-30 17:52:56.892494 | aio | skipping: [aio] 2026-03-30 17:52:56.892615 | aio | 2026-03-30 17:52:56.892815 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:52:56.893046 | aio | Monday 30 March 2026 17:52:56 +0000 (0:00:00.035) 0:00:02.620 ********** 2026-03-30 17:52:57.090763 | aio | ok: [aio] 2026-03-30 17:52:57.091029 | aio | 2026-03-30 17:52:57.091268 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:52:57.091526 | aio | Monday 30 March 2026 17:52:57 +0000 (0:00:00.197) 0:00:02.818 ********** 2026-03-30 17:52:58.245128 | aio | ok: [aio] 2026-03-30 17:52:58.245303 | aio | 2026-03-30 17:52:58.245517 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:52:58.245723 | aio | Monday 30 March 2026 17:52:58 +0000 (0:00:01.154) 0:00:03.973 ********** 2026-03-30 17:52:58.318207 | aio | ok: [aio] => { 2026-03-30 17:52:58.318439 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-30 17:52:58.318627 | aio | } 2026-03-30 17:52:58.318768 | aio | 2026-03-30 17:52:58.318941 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:52:58.319093 | aio | Monday 30 March 2026 17:52:58 +0000 (0:00:00.073) 0:00:04.046 ********** 2026-03-30 17:52:58.660269 | aio | ok: [aio] 2026-03-30 17:52:58.660451 | aio | 2026-03-30 17:52:58.660691 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:52:58.660901 | aio | Monday 30 March 2026 17:52:58 +0000 (0:00:00.341) 0:00:04.388 ********** 2026-03-30 17:53:00.913861 | aio | ok: [aio] 2026-03-30 17:53:00.914128 | aio | 2026-03-30 17:53:00.914580 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-30 17:53:00.914851 | aio | Monday 30 March 2026 17:53:00 +0000 (0:00:02.253) 0:00:06.641 ********** 2026-03-30 17:53:00.945487 | aio | skipping: [aio] 2026-03-30 17:53:00.945689 | aio | 2026-03-30 17:53:00.945939 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-30 17:53:00.946213 | aio | Monday 30 March 2026 17:53:00 +0000 (0:00:00.031) 0:00:06.673 ********** 2026-03-30 17:53:00.974815 | aio | skipping: [aio] 2026-03-30 17:53:00.975095 | aio | 2026-03-30 17:53:00.975421 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-30 17:53:00.975715 | aio | Monday 30 March 2026 17:53:00 +0000 (0:00:00.028) 0:00:06.702 ********** 2026-03-30 17:53:01.002888 | aio | skipping: [aio] 2026-03-30 17:53:01.003176 | aio | 2026-03-30 17:53:01.003440 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-30 17:53:01.003655 | aio | Monday 30 March 2026 17:53:00 +0000 (0:00:00.028) 0:00:06.730 ********** 2026-03-30 17:53:02.029802 | aio | ok: [aio] 2026-03-30 17:53:02.030100 | aio | 2026-03-30 17:53:02.030118 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-30 17:53:02.030348 | aio | Monday 30 March 2026 17:53:02 +0000 (0:00:01.027) 0:00:07.757 ********** 2026-03-30 17:53:02.461119 | aio | ok: [aio] 2026-03-30 17:53:02.461302 | aio | 2026-03-30 17:53:02.461534 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-30 17:53:02.461906 | aio | Monday 30 March 2026 17:53:02 +0000 (0:00:00.431) 0:00:08.189 ********** 2026-03-30 17:53:03.396795 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-30 17:53:03.396893 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-30 17:53:03.396903 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-30 17:53:03.396910 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-30 17:53:03.396916 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-30 17:53:03.396924 | aio | 2026-03-30 17:53:03.396930 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-30 17:53:03.396936 | aio | Monday 30 March 2026 17:53:03 +0000 (0:00:00.934) 0:00:09.123 ********** 2026-03-30 17:53:03.876257 | aio | ok: [aio] 2026-03-30 17:53:03.876320 | aio | 2026-03-30 17:53:03.876411 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-30 17:53:03.876807 | aio | Monday 30 March 2026 17:53:03 +0000 (0:00:00.472) 0:00:09.596 ********** 2026-03-30 17:53:03.876849 | aio | 2026-03-30 17:53:03.876855 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-30 17:53:03.876859 | aio | Monday 30 March 2026 17:53:03 +0000 (0:00:00.008) 0:00:09.604 ********** 2026-03-30 17:53:04.510525 | aio | ok: [aio] 2026-03-30 17:53:04.510596 | aio | 2026-03-30 17:53:04.510673 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:53:04.510763 | aio | Monday 30 March 2026 17:53:04 +0000 (0:00:00.634) 0:00:10.238 ********** 2026-03-30 17:53:04.708418 | aio | ok: [aio] 2026-03-30 17:53:04.708591 | aio | 2026-03-30 17:53:04.708800 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:53:04.709000 | aio | Monday 30 March 2026 17:53:04 +0000 (0:00:00.197) 0:00:10.436 ********** 2026-03-30 17:53:04.779371 | aio | ok: [aio] => { 2026-03-30 17:53:04.779605 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-30 17:53:04.779811 | aio | } 2026-03-30 17:53:04.780009 | aio | 2026-03-30 17:53:04.780233 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:53:04.780451 | aio | Monday 30 March 2026 17:53:04 +0000 (0:00:00.070) 0:00:10.507 ********** 2026-03-30 17:53:05.117203 | aio | ok: [aio] 2026-03-30 17:53:05.117460 | aio | 2026-03-30 17:53:05.117731 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:53:05.117999 | aio | Monday 30 March 2026 17:53:05 +0000 (0:00:00.337) 0:00:10.845 ********** 2026-03-30 17:53:08.206703 | aio | ok: [aio] 2026-03-30 17:53:08.206810 | aio | 2026-03-30 17:53:08.206956 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-30 17:53:08.207100 | aio | Monday 30 March 2026 17:53:08 +0000 (0:00:03.089) 0:00:13.934 ********** 2026-03-30 17:53:09.257502 | aio | ok: [aio] 2026-03-30 17:53:09.257568 | aio | 2026-03-30 17:53:09.257577 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-30 17:53:09.257584 | aio | Monday 30 March 2026 17:53:09 +0000 (0:00:01.050) 0:00:14.984 ********** 2026-03-30 17:53:09.535106 | aio | ok: [aio] 2026-03-30 17:53:09.535187 | aio | 2026-03-30 17:53:09.535313 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-30 17:53:09.535459 | aio | Monday 30 March 2026 17:53:09 +0000 (0:00:00.278) 0:00:15.263 ********** 2026-03-30 17:53:10.004670 | aio | ok: [aio] 2026-03-30 17:53:10.004800 | aio | 2026-03-30 17:53:10.005122 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-30 17:53:10.005171 | aio | Monday 30 March 2026 17:53:10 +0000 (0:00:00.469) 0:00:15.732 ********** 2026-03-30 17:53:10.569342 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-30 17:53:10.569414 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-30 17:53:10.569794 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-30 17:53:10.569846 | aio | 2026-03-30 17:53:10.569852 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-30 17:53:10.569857 | aio | Monday 30 March 2026 17:53:10 +0000 (0:00:00.564) 0:00:16.297 ********** 2026-03-30 17:53:10.976767 | aio | ok: [aio] 2026-03-30 17:53:10.976830 | aio | 2026-03-30 17:53:10.976839 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-30 17:53:10.976846 | aio | Monday 30 March 2026 17:53:10 +0000 (0:00:00.407) 0:00:16.704 ********** 2026-03-30 17:53:11.422226 | aio | ok: [aio] 2026-03-30 17:53:11.422292 | aio | 2026-03-30 17:53:11.423067 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-30 17:53:11.423126 | aio | Monday 30 March 2026 17:53:11 +0000 (0:00:00.435) 0:00:17.140 ********** 2026-03-30 17:53:11.423135 | aio | 2026-03-30 17:53:11.423142 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-30 17:53:11.423148 | aio | Monday 30 March 2026 17:53:11 +0000 (0:00:00.010) 0:00:17.150 ********** 2026-03-30 17:53:12.807886 | aio | ok: [aio] 2026-03-30 17:53:12.807960 | aio | 2026-03-30 17:53:12.808031 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-30 17:53:12.808127 | aio | Monday 30 March 2026 17:53:12 +0000 (0:00:01.385) 0:00:18.536 ********** 2026-03-30 17:53:12.857301 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-30 17:53:12.857379 | aio | 2026-03-30 17:53:12.857443 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-30 17:53:12.857613 | aio | Monday 30 March 2026 17:53:12 +0000 (0:00:00.048) 0:00:18.584 ********** 2026-03-30 17:53:13.897322 | aio | ok: [aio] 2026-03-30 17:53:13.897406 | aio | 2026-03-30 17:53:13.897413 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-30 17:53:13.897420 | aio | Monday 30 March 2026 17:53:13 +0000 (0:00:01.039) 0:00:19.624 ********** 2026-03-30 17:53:14.577169 | aio | ok: [aio] => (item=chronyd) 2026-03-30 17:53:14.577246 | aio | ok: [aio] => (item=sshd) 2026-03-30 17:53:14.577305 | aio | 2026-03-30 17:53:14.577531 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-30 17:53:14.577706 | aio | Monday 30 March 2026 17:53:14 +0000 (0:00:00.680) 0:00:20.305 ********** 2026-03-30 17:53:14.851856 | aio | ok: [aio] 2026-03-30 17:53:14.851929 | aio | 2026-03-30 17:53:14.852013 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-30 17:53:14.852147 | aio | Monday 30 March 2026 17:53:14 +0000 (0:00:00.274) 0:00:20.580 ********** 2026-03-30 17:53:15.047782 | aio | ok: [aio] 2026-03-30 17:53:15.047846 | aio | 2026-03-30 17:53:15.047945 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-30 17:53:15.048102 | aio | Monday 30 March 2026 17:53:15 +0000 (0:00:00.195) 0:00:20.776 ********** 2026-03-30 17:53:15.451671 | aio | ok: [aio] 2026-03-30 17:53:15.451781 | aio | 2026-03-30 17:53:15.452133 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-30 17:53:15.452188 | aio | Monday 30 March 2026 17:53:15 +0000 (0:00:00.403) 0:00:21.179 ********** 2026-03-30 17:53:15.784038 | aio | ok: [aio] 2026-03-30 17:53:15.784137 | aio | 2026-03-30 17:53:15.784203 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-30 17:53:15.784326 | aio | Monday 30 March 2026 17:53:15 +0000 (0:00:00.332) 0:00:21.512 ********** 2026-03-30 17:53:15.860886 | aio | ok: [aio] 2026-03-30 17:53:15.860944 | aio | 2026-03-30 17:53:15.861179 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-30 17:53:15.861231 | aio | Monday 30 March 2026 17:53:15 +0000 (0:00:00.076) 0:00:21.588 ********** 2026-03-30 17:53:16.078771 | aio | ok: [aio] => (item=aio) 2026-03-30 17:53:16.079322 | aio | 2026-03-30 17:53:16.079352 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-30 17:53:16.079363 | aio | Monday 30 March 2026 17:53:16 +0000 (0:00:00.217) 0:00:21.806 ********** 2026-03-30 17:53:16.122529 | aio | ok: [aio] 2026-03-30 17:53:16.123030 | aio | 2026-03-30 17:53:16.123057 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-30 17:53:16.123067 | aio | Monday 30 March 2026 17:53:16 +0000 (0:00:00.043) 0:00:21.850 ********** 2026-03-30 17:53:16.160855 | aio | skipping: [aio] 2026-03-30 17:53:16.160915 | aio | 2026-03-30 17:53:16.161000 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:53:16.161101 | aio | Monday 30 March 2026 17:53:16 +0000 (0:00:00.038) 0:00:21.888 ********** 2026-03-30 17:53:16.224126 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:53:16.224203 | aio | 2026-03-30 17:53:16.224218 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:53:16.224358 | aio | Monday 30 March 2026 17:53:16 +0000 (0:00:00.063) 0:00:21.952 ********** 2026-03-30 17:53:22.282367 | aio | ok: [aio] 2026-03-30 17:53:22.282462 | aio | 2026-03-30 17:53:22.282740 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:53:22.282783 | aio | Monday 30 March 2026 17:53:22 +0000 (0:00:06.058) 0:00:28.010 ********** 2026-03-30 17:53:22.335952 | aio | ok: [aio] => (item=aio) 2026-03-30 17:53:22.336028 | aio | 2026-03-30 17:53:22.336248 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:53:22.336295 | aio | Monday 30 March 2026 17:53:22 +0000 (0:00:00.053) 0:00:28.064 ********** 2026-03-30 17:53:22.728564 | aio | ok: [aio] 2026-03-30 17:53:22.728634 | aio | 2026-03-30 17:53:22.728836 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:53:22.728878 | aio | Monday 30 March 2026 17:53:22 +0000 (0:00:00.392) 0:00:28.456 ********** 2026-03-30 17:53:29.148595 | aio | ok: [aio] 2026-03-30 17:53:29.148684 | aio | 2026-03-30 17:53:29.148775 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-30 17:53:29.148904 | aio | Monday 30 March 2026 17:53:29 +0000 (0:00:06.420) 0:00:34.876 ********** 2026-03-30 17:53:35.474902 | aio | ok: [aio] 2026-03-30 17:53:35.474987 | aio | 2026-03-30 17:53:35.475047 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-30 17:53:35.475165 | aio | Monday 30 March 2026 17:53:35 +0000 (0:00:06.326) 0:00:41.203 ********** 2026-03-30 17:53:49.576084 | aio | ok: [aio] 2026-03-30 17:53:49.576187 | aio | 2026-03-30 17:53:49.576200 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:53:49.576290 | aio | Monday 30 March 2026 17:53:49 +0000 (0:00:14.101) 0:00:55.304 ********** 2026-03-30 17:53:49.642063 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:53:49.642140 | aio | 2026-03-30 17:53:49.642203 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:53:49.642339 | aio | Monday 30 March 2026 17:53:49 +0000 (0:00:00.066) 0:00:55.370 ********** 2026-03-30 17:53:49.685779 | aio | skipping: [aio] 2026-03-30 17:53:49.685851 | aio | 2026-03-30 17:53:49.686177 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:53:49.686218 | aio | Monday 30 March 2026 17:53:49 +0000 (0:00:00.043) 0:00:55.413 ********** 2026-03-30 17:53:49.724962 | aio | skipping: [aio] => (item=aio) 2026-03-30 17:53:49.725011 | aio | skipping: [aio] 2026-03-30 17:53:49.725323 | aio | 2026-03-30 17:53:49.725370 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:53:49.725376 | aio | Monday 30 March 2026 17:53:49 +0000 (0:00:00.039) 0:00:55.453 ********** 2026-03-30 17:53:49.974929 | aio | ok: [aio] 2026-03-30 17:53:49.975035 | aio | 2026-03-30 17:53:49.975325 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:53:49.975348 | aio | Monday 30 March 2026 17:53:49 +0000 (0:00:00.249) 0:00:55.703 ********** 2026-03-30 17:53:56.590634 | aio | ok: [aio] 2026-03-30 17:53:56.590691 | aio | 2026-03-30 17:53:56.590699 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-30 17:53:56.590706 | aio | Monday 30 March 2026 17:53:56 +0000 (0:00:06.615) 0:01:02.318 ********** 2026-03-30 17:54:02.745481 | aio | ok: [aio] 2026-03-30 17:54:02.745608 | aio | 2026-03-30 17:54:02.745616 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-30 17:54:02.745735 | aio | Monday 30 March 2026 17:54:02 +0000 (0:00:06.155) 0:01:08.473 ********** 2026-03-30 17:54:08.943706 | aio | ok: [aio] 2026-03-30 17:54:08.944125 | aio | 2026-03-30 17:54:08.944150 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-30 17:54:08.944158 | aio | Monday 30 March 2026 17:54:08 +0000 (0:00:06.198) 0:01:14.671 ********** 2026-03-30 17:54:17.047991 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-30 17:54:17.048044 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-30 17:54:17.048050 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-30 17:54:17.048054 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-30 17:54:17.048058 | aio | 2026-03-30 17:54:17.048062 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-30 17:54:17.048067 | aio | 2026-03-30 17:54:17.048071 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:54:17.048075 | aio | Monday 30 March 2026 17:54:17 +0000 (0:00:08.103) 0:01:22.775 ********** 2026-03-30 17:54:17.935140 | aio | ok: [aio] 2026-03-30 17:54:17.935222 | aio | 2026-03-30 17:54:17.935286 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:54:17.935404 | aio | Monday 30 March 2026 17:54:17 +0000 (0:00:00.887) 0:01:23.663 ********** 2026-03-30 17:54:18.138060 | aio | ok: [aio] 2026-03-30 17:54:18.138132 | aio | 2026-03-30 17:54:18.138366 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:54:18.138417 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.202) 0:01:23.866 ********** 2026-03-30 17:54:18.172561 | aio | skipping: [aio] 2026-03-30 17:54:18.172638 | aio | 2026-03-30 17:54:18.172875 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-30 17:54:18.172922 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.034) 0:01:23.900 ********** 2026-03-30 17:54:18.369243 | aio | ok: [aio] 2026-03-30 17:54:18.369320 | aio | 2026-03-30 17:54:18.369597 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:54:18.369652 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.196) 0:01:24.097 ********** 2026-03-30 17:54:18.445364 | aio | ok: [aio] => { 2026-03-30 17:54:18.446123 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-30 17:54:18.446147 | aio | } 2026-03-30 17:54:18.446155 | aio | 2026-03-30 17:54:18.446161 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:54:18.446168 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.076) 0:01:24.173 ********** 2026-03-30 17:54:18.752983 | aio | ok: [aio] 2026-03-30 17:54:18.753033 | aio | 2026-03-30 17:54:18.753041 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:54:18.753047 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.307) 0:01:24.480 ********** 2026-03-30 17:54:18.790766 | aio | skipping: [aio] 2026-03-30 17:54:18.790810 | aio | 2026-03-30 17:54:18.790816 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:54:18.790820 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.038) 0:01:24.518 ********** 2026-03-30 17:54:18.826486 | aio | skipping: [aio] 2026-03-30 17:54:18.826552 | aio | 2026-03-30 17:54:18.826561 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:54:18.826702 | aio | Monday 30 March 2026 17:54:18 +0000 (0:00:00.035) 0:01:24.554 ********** 2026-03-30 17:54:19.029975 | aio | ok: [aio] 2026-03-30 17:54:19.030054 | aio | 2026-03-30 17:54:19.030131 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-30 17:54:19.030234 | aio | Monday 30 March 2026 17:54:19 +0000 (0:00:00.203) 0:01:24.758 ********** 2026-03-30 17:54:20.091683 | aio | ok: [aio] 2026-03-30 17:54:20.091745 | aio | 2026-03-30 17:54:20.091859 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:54:20.091982 | aio | Monday 30 March 2026 17:54:20 +0000 (0:00:01.061) 0:01:25.820 ********** 2026-03-30 17:54:20.163948 | aio | ok: [aio] => { 2026-03-30 17:54:20.164045 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-30 17:54:20.164422 | aio | } 2026-03-30 17:54:20.164464 | aio | 2026-03-30 17:54:20.164469 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:54:20.164475 | aio | Monday 30 March 2026 17:54:20 +0000 (0:00:00.071) 0:01:25.891 ********** 2026-03-30 17:54:20.503562 | aio | ok: [aio] 2026-03-30 17:54:20.503634 | aio | 2026-03-30 17:54:20.503721 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:54:20.503849 | aio | Monday 30 March 2026 17:54:20 +0000 (0:00:00.340) 0:01:26.231 ********** 2026-03-30 17:54:22.456186 | aio | ok: [aio] 2026-03-30 17:54:22.456268 | aio | 2026-03-30 17:54:22.456331 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-30 17:54:22.456447 | aio | Monday 30 March 2026 17:54:22 +0000 (0:00:01.952) 0:01:28.184 ********** 2026-03-30 17:54:22.481302 | aio | skipping: [aio] 2026-03-30 17:54:22.481684 | aio | 2026-03-30 17:54:22.481736 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-30 17:54:22.481744 | aio | Monday 30 March 2026 17:54:22 +0000 (0:00:00.024) 0:01:28.209 ********** 2026-03-30 17:54:22.511536 | aio | skipping: [aio] 2026-03-30 17:54:22.511628 | aio | 2026-03-30 17:54:22.511906 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-30 17:54:22.511990 | aio | Monday 30 March 2026 17:54:22 +0000 (0:00:00.029) 0:01:28.239 ********** 2026-03-30 17:54:22.539540 | aio | skipping: [aio] 2026-03-30 17:54:22.540057 | aio | 2026-03-30 17:54:22.540106 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-30 17:54:22.540115 | aio | Monday 30 March 2026 17:54:22 +0000 (0:00:00.027) 0:01:28.267 ********** 2026-03-30 17:54:23.505436 | aio | ok: [aio] 2026-03-30 17:54:23.505553 | aio | 2026-03-30 17:54:23.505706 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-30 17:54:23.505841 | aio | Monday 30 March 2026 17:54:23 +0000 (0:00:00.966) 0:01:29.233 ********** 2026-03-30 17:54:23.944076 | aio | ok: [aio] 2026-03-30 17:54:23.944275 | aio | 2026-03-30 17:54:23.944530 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-30 17:54:23.944869 | aio | Monday 30 March 2026 17:54:23 +0000 (0:00:00.438) 0:01:29.671 ********** 2026-03-30 17:54:24.899439 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-30 17:54:24.899653 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-30 17:54:24.899877 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-30 17:54:24.900110 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-30 17:54:24.900332 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-30 17:54:24.900522 | aio | 2026-03-30 17:54:24.900807 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-30 17:54:24.901021 | aio | Monday 30 March 2026 17:54:24 +0000 (0:00:00.954) 0:01:30.626 ********** 2026-03-30 17:54:25.379968 | aio | ok: [aio] 2026-03-30 17:54:25.380217 | aio | 2026-03-30 17:54:25.380546 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-30 17:54:25.380856 | aio | Monday 30 March 2026 17:54:25 +0000 (0:00:00.475) 0:01:31.102 ********** 2026-03-30 17:54:25.381114 | aio | 2026-03-30 17:54:25.381343 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-30 17:54:25.381543 | aio | Monday 30 March 2026 17:54:25 +0000 (0:00:00.005) 0:01:31.107 ********** 2026-03-30 17:54:25.733707 | aio | ok: [aio] 2026-03-30 17:54:25.733884 | aio | 2026-03-30 17:54:25.734129 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-30 17:54:25.734403 | aio | Monday 30 March 2026 17:54:25 +0000 (0:00:00.353) 0:01:31.461 ********** 2026-03-30 17:54:25.934859 | aio | ok: [aio] 2026-03-30 17:54:25.935049 | aio | 2026-03-30 17:54:25.935299 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-30 17:54:25.935617 | aio | Monday 30 March 2026 17:54:25 +0000 (0:00:00.201) 0:01:31.662 ********** 2026-03-30 17:54:26.013024 | aio | ok: [aio] => { 2026-03-30 17:54:26.013263 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-30 17:54:26.013480 | aio | } 2026-03-30 17:54:26.013843 | aio | 2026-03-30 17:54:26.013928 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-30 17:54:26.014211 | aio | Monday 30 March 2026 17:54:26 +0000 (0:00:00.078) 0:01:31.740 ********** 2026-03-30 17:54:26.375408 | aio | ok: [aio] 2026-03-30 17:54:26.375598 | aio | 2026-03-30 17:54:26.375846 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-30 17:54:26.376141 | aio | Monday 30 March 2026 17:54:26 +0000 (0:00:00.362) 0:01:32.103 ********** 2026-03-30 17:54:29.523707 | aio | ok: [aio] 2026-03-30 17:54:29.523810 | aio | 2026-03-30 17:54:29.523826 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-30 17:54:29.523841 | aio | Monday 30 March 2026 17:54:29 +0000 (0:00:03.147) 0:01:35.250 ********** 2026-03-30 17:54:30.519914 | aio | ok: [aio] 2026-03-30 17:54:30.520027 | aio | 2026-03-30 17:54:30.520035 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-30 17:54:30.520186 | aio | Monday 30 March 2026 17:54:30 +0000 (0:00:00.997) 0:01:36.248 ********** 2026-03-30 17:54:30.723008 | aio | ok: [aio] 2026-03-30 17:54:30.723090 | aio | 2026-03-30 17:54:30.723098 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-30 17:54:30.723105 | aio | Monday 30 March 2026 17:54:30 +0000 (0:00:00.201) 0:01:36.450 ********** 2026-03-30 17:54:31.174159 | aio | ok: [aio] 2026-03-30 17:54:31.174223 | aio | 2026-03-30 17:54:31.174440 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-30 17:54:31.174505 | aio | Monday 30 March 2026 17:54:31 +0000 (0:00:00.452) 0:01:36.902 ********** 2026-03-30 17:54:31.761431 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-30 17:54:31.762170 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-30 17:54:31.762221 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-30 17:54:31.762228 | aio | 2026-03-30 17:54:31.762235 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-30 17:54:31.762241 | aio | Monday 30 March 2026 17:54:31 +0000 (0:00:00.587) 0:01:37.489 ********** 2026-03-30 17:54:32.168324 | aio | ok: [aio] 2026-03-30 17:54:32.168390 | aio | 2026-03-30 17:54:32.168469 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-30 17:54:32.168604 | aio | Monday 30 March 2026 17:54:32 +0000 (0:00:00.407) 0:01:37.896 ********** 2026-03-30 17:54:32.595601 | aio | ok: [aio] 2026-03-30 17:54:32.595670 | aio | 2026-03-30 17:54:32.596172 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-30 17:54:32.596218 | aio | Monday 30 March 2026 17:54:32 +0000 (0:00:00.421) 0:01:38.318 ********** 2026-03-30 17:54:32.596223 | aio | 2026-03-30 17:54:32.596228 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-30 17:54:32.596232 | aio | Monday 30 March 2026 17:54:32 +0000 (0:00:00.005) 0:01:38.323 ********** 2026-03-30 17:54:32.951639 | aio | ok: [aio] 2026-03-30 17:54:32.951709 | aio | 2026-03-30 17:54:32.951787 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-30 17:54:32.951950 | aio | Monday 30 March 2026 17:54:32 +0000 (0:00:00.355) 0:01:38.679 ********** 2026-03-30 17:54:32.996734 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-30 17:54:32.997172 | aio | 2026-03-30 17:54:32.997211 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-30 17:54:32.997218 | aio | Monday 30 March 2026 17:54:32 +0000 (0:00:00.044) 0:01:38.724 ********** 2026-03-30 17:54:33.949730 | aio | ok: [aio] 2026-03-30 17:54:33.949839 | aio | 2026-03-30 17:54:33.950101 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-30 17:54:33.950142 | aio | Monday 30 March 2026 17:54:33 +0000 (0:00:00.953) 0:01:39.677 ********** 2026-03-30 17:54:34.566617 | aio | ok: [aio] => (item=chronyd) 2026-03-30 17:54:34.566689 | aio | ok: [aio] => (item=sshd) 2026-03-30 17:54:34.567040 | aio | 2026-03-30 17:54:34.567089 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-30 17:54:34.567095 | aio | Monday 30 March 2026 17:54:34 +0000 (0:00:00.616) 0:01:40.294 ********** 2026-03-30 17:54:34.841848 | aio | ok: [aio] 2026-03-30 17:54:34.841897 | aio | 2026-03-30 17:54:34.841902 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-30 17:54:34.841907 | aio | Monday 30 March 2026 17:54:34 +0000 (0:00:00.275) 0:01:40.569 ********** 2026-03-30 17:54:35.029372 | aio | ok: [aio] 2026-03-30 17:54:35.029459 | aio | 2026-03-30 17:54:35.029791 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-30 17:54:35.030029 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.187) 0:01:40.757 ********** 2026-03-30 17:54:35.259994 | aio | ok: [aio] 2026-03-30 17:54:35.260448 | aio | 2026-03-30 17:54:35.260497 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-30 17:54:35.260505 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.230) 0:01:40.988 ********** 2026-03-30 17:54:35.454512 | aio | ok: [aio] 2026-03-30 17:54:35.454594 | aio | 2026-03-30 17:54:35.454802 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-30 17:54:35.454847 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.194) 0:01:41.182 ********** 2026-03-30 17:54:35.663836 | aio | ok: [aio] => (item=aio) 2026-03-30 17:54:35.663903 | aio | 2026-03-30 17:54:35.663998 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-30 17:54:35.664132 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.209) 0:01:41.392 ********** 2026-03-30 17:54:35.705256 | aio | ok: [aio] 2026-03-30 17:54:35.705323 | aio | 2026-03-30 17:54:35.705403 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-30 17:54:35.705533 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.041) 0:01:41.433 ********** 2026-03-30 17:54:35.756662 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-30 17:54:35.756740 | aio | 2026-03-30 17:54:35.756798 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-30 17:54:35.756952 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.051) 0:01:41.484 ********** 2026-03-30 17:54:35.794882 | aio | skipping: [aio] 2026-03-30 17:54:35.794964 | aio | 2026-03-30 17:54:35.795196 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-30 17:54:35.795242 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.038) 0:01:41.523 ********** 2026-03-30 17:54:35.833111 | aio | skipping: [aio] => (item=aio) 2026-03-30 17:54:35.833687 | aio | skipping: [aio] 2026-03-30 17:54:35.833739 | aio | 2026-03-30 17:54:35.833748 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-30 17:54:35.833754 | aio | Monday 30 March 2026 17:54:35 +0000 (0:00:00.038) 0:01:41.561 ********** 2026-03-30 17:54:36.092600 | aio | ok: [aio] 2026-03-30 17:54:36.092678 | aio | 2026-03-30 17:54:36.093174 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-30 17:54:36.093232 | aio | Monday 30 March 2026 17:54:36 +0000 (0:00:00.259) 0:01:41.820 ********** 2026-03-30 17:54:42.576144 | aio | ok: [aio] 2026-03-30 17:54:42.576228 | aio | 2026-03-30 17:54:42.576314 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-30 17:54:42.576460 | aio | Monday 30 March 2026 17:54:42 +0000 (0:00:06.483) 0:01:48.304 ********** 2026-03-30 17:54:48.013744 | aio | ok: [aio] 2026-03-30 17:54:48.013806 | aio | 2026-03-30 17:54:48.013902 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-30 17:54:48.014050 | aio | Monday 30 March 2026 17:54:48 +0000 (0:00:05.437) 0:01:53.742 ********** 2026-03-30 17:55:02.199307 | aio | ok: [aio] 2026-03-30 17:55:02.199729 | aio | 2026-03-30 17:55:02.199779 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-30 17:55:02.199787 | aio | Monday 30 March 2026 17:55:02 +0000 (0:00:14.185) 0:02:07.927 ********** 2026-03-30 17:55:02.261774 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-30 17:55:02.262453 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-30 17:55:02.262514 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-30 17:55:02.262521 | aio | skipping: [aio] 2026-03-30 17:55:02.262527 | aio | 2026-03-30 17:55:02.262539 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-30 17:55:02.262656 | aio | Monday 30 March 2026 17:55:02 +0000 (0:00:00.061) 0:02:07.989 ********** 2026-03-30 17:55:09.177906 | aio | ok: [aio] 2026-03-30 17:55:09.177973 | aio | 2026-03-30 17:55:09.178098 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-30 17:55:09.178235 | aio | Monday 30 March 2026 17:55:09 +0000 (0:00:06.916) 0:02:14.906 ********** 2026-03-30 17:55:15.233228 | aio | ok: [aio] 2026-03-30 17:55:15.233317 | aio | 2026-03-30 17:55:15.233407 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-30 17:55:15.233548 | aio | Monday 30 March 2026 17:55:15 +0000 (0:00:06.055) 0:02:20.961 ********** 2026-03-30 17:55:15.285848 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-30 17:55:15.285885 | aio | 2026-03-30 17:55:15.285890 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-30 17:55:15.285900 | aio | Monday 30 March 2026 17:55:15 +0000 (0:00:00.052) 0:02:21.013 ********** 2026-03-30 17:55:15.328024 | aio | ok: [aio] 2026-03-30 17:55:15.328072 | aio | 2026-03-30 17:55:15.328314 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-30 17:55:15.328376 | aio | Monday 30 March 2026 17:55:15 +0000 (0:00:00.042) 0:02:21.056 ********** 2026-03-30 17:55:21.355478 | aio | ok: [aio] 2026-03-30 17:55:21.355610 | aio | 2026-03-30 17:55:21.355623 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-30 17:55:21.355737 | aio | Monday 30 March 2026 17:55:21 +0000 (0:00:06.027) 0:02:27.083 ********** 2026-03-30 17:55:21.397740 | aio | ok: [aio] 2026-03-30 17:55:21.398197 | aio | 2026-03-30 17:55:21.398261 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-30 17:55:21.398270 | aio | Monday 30 March 2026 17:55:21 +0000 (0:00:00.041) 0:02:27.125 ********** 2026-03-30 17:55:21.439937 | aio | skipping: [aio] => (item=1) 2026-03-30 17:55:21.440062 | aio | skipping: [aio] => (item=1) 2026-03-30 17:55:21.440074 | aio | skipping: [aio] => (item=1) 2026-03-30 17:55:21.440086 | aio | skipping: [aio] 2026-03-30 17:55:21.440379 | aio | 2026-03-30 17:55:21.440405 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-30 17:55:21.440411 | aio | Monday 30 March 2026 17:55:21 +0000 (0:00:00.042) 0:02:27.168 ********** 2026-03-30 17:55:21.475063 | aio | skipping: [aio] 2026-03-30 17:55:21.475174 | aio | 2026-03-30 17:55:21.477636 | aio | PLAY RECAP ********************************************************************* 2026-03-30 17:55:21.477687 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-30 17:55:21.477694 | aio | 2026-03-30 17:55:21.477698 | aio | 2026-03-30 17:55:21.477702 | aio | TASKS RECAP ******************************************************************** 2026-03-30 17:55:21.477707 | aio | Monday 30 March 2026 17:55:21 +0000 (0:00:00.034) 0:02:27.203 ********** 2026-03-30 17:55:21.477711 | aio | =============================================================================== 2026-03-30 17:55:21.477715 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.19s 2026-03-30 17:55:21.477719 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.10s 2026-03-30 17:55:21.477723 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.10s 2026-03-30 17:55:21.477728 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.92s 2026-03-30 17:55:21.477732 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.62s 2026-03-30 17:55:21.477736 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.48s 2026-03-30 17:55:21.477740 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.42s 2026-03-30 17:55:21.477744 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.33s 2026-03-30 17:55:21.477748 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.20s 2026-03-30 17:55:21.477753 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.16s 2026-03-30 17:55:21.477757 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.06s 2026-03-30 17:55:21.477761 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.06s 2026-03-30 17:55:21.477765 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.03s 2026-03-30 17:55:21.477769 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.44s 2026-03-30 17:55:21.477773 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s 2026-03-30 17:55:21.477778 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-03-30 17:55:21.477781 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.25s 2026-03-30 17:55:21.477785 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.95s 2026-03-30 17:55:21.477789 | aio | vexxhost.containers.docker : Enable and start service ------------------- 1.39s 2026-03-30 17:55:21.477794 | aio | Gathering Facts --------------------------------------------------------- 1.31s 2026-03-30 17:55:21.581963 | aio | INFO [default > idempotence] Executed: Successful 2026-03-30 17:55:21.590226 | aio | INFO [default > side_effect] Executing 2026-03-30 17:55:21.591800 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-30 17:55:21.598125 | aio | INFO [default > verify] Executing 2026-03-30 17:55:22.207330 | aio | 2026-03-30 17:55:22.207683 | aio | PLAY [Verify] ****************************************************************** 2026-03-30 17:55:22.207991 | aio | 2026-03-30 17:55:22.208274 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-30 17:55:22.208547 | aio | Monday 30 March 2026 17:55:22 +0000 (0:00:00.008) 0:00:00.008 ********** 2026-03-30 17:55:23.319536 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-30 17:55:23.319590 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-30 17:55:23.319597 | aio | interpreter could change the meaning of that path. See 2026-03-30 17:55:23.319604 | aio | https://docs.ansible.com/ansible- 2026-03-30 17:55:23.319609 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-30 17:55:23.328939 | aio | ok: [aio] 2026-03-30 17:55:23.329059 | aio | 2026-03-30 17:55:23.329456 | aio | TASK [Get cluster health status] *********************************************** 2026-03-30 17:55:23.329487 | aio | Monday 30 March 2026 17:55:23 +0000 (0:00:01.120) 0:00:01.129 ********** 2026-03-30 17:55:33.596217 | aio | ok: [aio] 2026-03-30 17:55:33.596280 | aio | 2026-03-30 17:55:33.596287 | aio | TASK [Print cluster health status] ********************************************* 2026-03-30 17:55:33.596478 | aio | Monday 30 March 2026 17:55:33 +0000 (0:00:10.267) 0:00:11.396 ********** 2026-03-30 17:55:33.626353 | aio | ok: [aio] => { 2026-03-30 17:55:33.626428 | aio | "_ceph_health": { 2026-03-30 17:55:33.626583 | aio | "changed": false, 2026-03-30 17:55:33.626702 | aio | "cmd": [ 2026-03-30 17:55:33.626823 | aio | "cephadm", 2026-03-30 17:55:33.626943 | aio | "shell", 2026-03-30 17:55:33.627052 | aio | "--", 2026-03-30 17:55:33.627181 | aio | "ceph", 2026-03-30 17:55:33.627312 | aio | "health" 2026-03-30 17:55:33.627434 | aio | ], 2026-03-30 17:55:33.627554 | aio | "delta": "0:00:10.002036", 2026-03-30 17:55:33.627675 | aio | "end": "2026-03-30 17:55:33.561503", 2026-03-30 17:55:33.627792 | aio | "failed": false, 2026-03-30 17:55:33.627913 | aio | "msg": "", 2026-03-30 17:55:33.628029 | aio | "rc": 0, 2026-03-30 17:55:33.628150 | aio | "start": "2026-03-30 17:55:23.559467", 2026-03-30 17:55:33.628287 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-30 17:55:33.628410 | aio | "stderr_lines": [ 2026-03-30 17:55:33.628534 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-30 17:55:33.628665 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-30 17:55:33.628782 | aio | ], 2026-03-30 17:55:33.628902 | aio | "stdout": "HEALTH_OK", 2026-03-30 17:55:33.629020 | aio | "stdout_lines": [ 2026-03-30 17:55:33.629136 | aio | "HEALTH_OK" 2026-03-30 17:55:33.629252 | aio | ] 2026-03-30 17:55:33.629368 | aio | } 2026-03-30 17:55:33.629526 | aio | } 2026-03-30 17:55:33.629646 | aio | 2026-03-30 17:55:33.629770 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-30 17:55:33.629894 | aio | Monday 30 March 2026 17:55:33 +0000 (0:00:00.031) 0:00:11.427 ********** 2026-03-30 17:55:33.651695 | aio | ok: [aio] => { 2026-03-30 17:55:33.651832 | aio | "changed": false, 2026-03-30 17:55:33.651968 | aio | "msg": "All assertions passed" 2026-03-30 17:55:33.652098 | aio | } 2026-03-30 17:55:33.652220 | aio | 2026-03-30 17:55:33.652357 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-30 17:55:33.652478 | aio | Monday 30 March 2026 17:55:33 +0000 (0:00:00.025) 0:00:11.452 ********** 2026-03-30 17:55:40.748146 | aio | changed: [aio] 2026-03-30 17:55:40.748356 | aio | 2026-03-30 17:55:40.748612 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-30 17:55:40.748916 | aio | Monday 30 March 2026 17:55:40 +0000 (0:00:07.096) 0:00:18.549 ********** 2026-03-30 17:55:43.754980 | aio | changed: [aio] 2026-03-30 17:55:43.755173 | aio | 2026-03-30 17:55:43.755456 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-30 17:55:43.755776 | aio | Monday 30 March 2026 17:55:43 +0000 (0:00:03.006) 0:00:21.555 ********** 2026-03-30 17:55:45.076552 | aio | ok: [aio] 2026-03-30 17:55:45.076628 | aio | 2026-03-30 17:55:45.076640 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-30 17:55:45.076650 | aio | Monday 30 March 2026 17:55:45 +0000 (0:00:01.320) 0:00:22.876 ********** 2026-03-30 17:55:45.104052 | aio | ok: [aio] => { 2026-03-30 17:55:45.105315 | aio | "changed": false, 2026-03-30 17:55:45.105381 | aio | "msg": "All assertions passed" 2026-03-30 17:55:45.105390 | aio | } 2026-03-30 17:55:45.105397 | aio | 2026-03-30 17:55:45.105404 | aio | PLAY RECAP ********************************************************************* 2026-03-30 17:55:45.105411 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-30 17:55:45.105452 | aio | 2026-03-30 17:55:45.106437 | aio | 2026-03-30 17:55:45.106499 | aio | TASKS RECAP ******************************************************************** 2026-03-30 17:55:45.106510 | aio | Monday 30 March 2026 17:55:45 +0000 (0:00:00.029) 0:00:22.905 ********** 2026-03-30 17:55:45.106519 | aio | =============================================================================== 2026-03-30 17:55:45.106535 | aio | Get cluster health status ---------------------------------------------- 10.27s 2026-03-30 17:55:45.106654 | aio | Create a test Ceph pool ------------------------------------------------- 7.10s 2026-03-30 17:55:45.106968 | aio | Create a test Ceph key -------------------------------------------------- 3.01s 2026-03-30 17:55:45.107292 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.32s 2026-03-30 17:55:45.107562 | aio | Gathering Facts --------------------------------------------------------- 1.12s 2026-03-30 17:55:45.107825 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-03-30 17:55:45.108087 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-30 17:55:45.108280 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-30 17:55:45.181254 | aio | INFO [default > verify] Executed: Successful 2026-03-30 17:55:45.191013 | aio | INFO [default > cleanup] Executing 2026-03-30 17:55:45.191451 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-30 17:55:45.198819 | aio | INFO [default > destroy] Executing 2026-03-30 17:55:45.198951 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-30 17:55:45.199069 | aio | INFO [default > destroy] Executed: Successful 2026-03-30 17:55:45.199394 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-30 17:55:45.659037 | aio | ok: Runtime: 0:10:35.112772 2026-03-30 17:55:45.672997 | 2026-03-30 17:55:45.673060 | PLAY RECAP 2026-03-30 17:55:45.673136 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-30 17:55:45.673160 | 2026-03-30 17:55:45.808318 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-30 17:55:45.811937 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-30 17:55:46.489391 | 2026-03-30 17:55:46.489521 | PLAY [all] 2026-03-30 17:55:46.500552 | 2026-03-30 17:55:46.500629 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-30 17:55:46.545581 | aio | skipping: Conditional result was False 2026-03-30 17:55:46.555849 | 2026-03-30 17:55:46.555959 | TASK [fetch-output : Set log path for single node] 2026-03-30 17:55:46.599807 | aio | ok 2026-03-30 17:55:46.604449 | 2026-03-30 17:55:46.604517 | LOOP [fetch-output : Ensure local output dirs] 2026-03-30 17:55:47.561670 | aio -> localhost | ok: "/var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/logs" 2026-03-30 17:55:47.771527 | aio -> localhost | changed: "/var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/artifacts" 2026-03-30 17:55:47.980797 | aio -> localhost | changed: "/var/lib/zuul/builds/81b463004d8749f5a2f21d0ad5184dbb/work/docs" 2026-03-30 17:55:48.005510 | 2026-03-30 17:55:48.005737 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-30 17:55:48.690979 | aio | ok 2026-03-30 17:55:48.691177 | aio | changed: All items complete 2026-03-30 17:55:48.691205 | 2026-03-30 17:55:49.150734 | aio | changed: .d..t...... ./ 2026-03-30 17:55:49.625247 | aio | changed: .d..t...... ./ 2026-03-30 17:55:49.651371 | 2026-03-30 17:55:49.651550 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-30 17:55:50.074801 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.009371 2026-03-30 17:55:50.300994 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007137 2026-03-30 17:55:50.326563 | 2026-03-30 17:55:50.326726 | PLAY [all] 2026-03-30 17:55:50.334166 | 2026-03-30 17:55:50.334247 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-30 17:55:50.763801 | aio | changed 2026-03-30 17:55:50.770641 | 2026-03-30 17:55:50.770689 | PLAY RECAP 2026-03-30 17:55:50.770737 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-30 17:55:50.770758 | 2026-03-30 17:55:50.899791 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-30 17:55:50.902223 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-30 17:55:51.560251 | 2026-03-30 17:55:51.560377 | PLAY [localhost] 2026-03-30 17:55:51.570135 | 2026-03-30 17:55:51.570205 | TASK [Generate Zuul manifest] 2026-03-30 17:55:51.591250 | localhost | ok 2026-03-30 17:55:51.632675 | 2026-03-30 17:55:51.632808 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-30 17:55:51.968843 | localhost | changed 2026-03-30 17:55:51.979557 | 2026-03-30 17:55:51.979634 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-30 17:55:52.113486 | localhost | ok 2026-03-30 17:55:52.123735 | 2026-03-30 17:55:52.123830 | TASK [Upload logs] 2026-03-30 17:55:52.145389 | localhost | ok 2026-03-30 17:55:52.223784 | 2026-03-30 17:55:52.223913 | TASK [Set zuul-log-path fact] 2026-03-30 17:55:52.255204 | localhost | ok 2026-03-30 17:55:52.268323 | 2026-03-30 17:55:52.268395 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-30 17:55:52.301030 | localhost | ok 2026-03-30 17:55:52.309848 | 2026-03-30 17:55:52.309941 | TASK [upload-logs : Create log directories] 2026-03-30 17:55:52.737554 | localhost | changed 2026-03-30 17:55:52.744681 | 2026-03-30 17:55:52.744775 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-30 17:55:53.161677 | localhost -> localhost | ok: Runtime: 0:00:00.006515 2026-03-30 17:55:53.167017 | 2026-03-30 17:55:53.167079 | TASK [upload-logs : Upload logs to log server] 2026-03-30 17:55:54.007414 | localhost | Output suppressed because no_log was given 2026-03-30 17:55:54.012566 | 2026-03-30 17:55:54.012637 | LOOP [upload-logs : Compress console log and json output] 2026-03-30 17:55:54.057501 | localhost | skipping: Conditional result was False 2026-03-30 17:55:54.065794 | localhost | skipping: Conditional result was False 2026-03-30 17:55:54.077389 | 2026-03-30 17:55:54.077618 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-30 17:55:54.124172 | localhost | skipping: Conditional result was False 2026-03-30 17:55:54.124564 | 2026-03-30 17:55:54.127691 | localhost | skipping: Conditional result was False 2026-03-30 17:55:54.143871 | 2026-03-30 17:55:54.144020 | LOOP [upload-logs : Upload console log and json output]