2026-03-05 16:31:15.191863 | Job console starting 2026-03-05 16:31:15.201641 | Updating git repos 2026-03-05 16:31:15.229069 | Cloning repos into workspace 2026-03-05 16:31:15.286471 | Restoring repo states 2026-03-05 16:31:15.294805 | Merging changes 2026-03-05 16:31:15.558691 | Checking out repos 2026-03-05 16:31:15.621449 | Preparing playbooks 2026-03-05 16:31:16.717642 | Running Ansible setup 2026-03-05 16:31:20.115901 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:20.681298 | 2026-03-05 16:31:20.681412 | PLAY [localhost] 2026-03-05 16:31:20.688603 | 2026-03-05 16:31:20.688673 | TASK [Gathering Facts] 2026-03-05 16:31:21.691822 | localhost | ok 2026-03-05 16:31:21.705804 | 2026-03-05 16:31:21.705973 | TASK [Setup log path fact] 2026-03-05 16:31:21.727791 | localhost | ok 2026-03-05 16:31:21.746552 | 2026-03-05 16:31:21.746664 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:31:21.788949 | localhost | ok 2026-03-05 16:31:21.797863 | 2026-03-05 16:31:21.797960 | TASK [emit-job-header : Print job information] 2026-03-05 16:31:21.838793 | # Job Information 2026-03-05 16:31:21.838994 | Ansible Version: 2.16.16 2026-03-05 16:31:21.839065 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-03-05 16:31:21.839115 | Pipeline: check 2026-03-05 16:31:21.839160 | Executor: 0a8996d2b663 2026-03-05 16:31:21.839204 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/93 2026-03-05 16:31:21.839253 | Event ID: 6c11fb90-18ae-11f1-8dd1-418c053b88bb 2026-03-05 16:31:21.843807 | 2026-03-05 16:31:21.843891 | LOOP [emit-job-header : Print node information] 2026-03-05 16:31:21.959212 | localhost | ok: 2026-03-05 16:31:21.959443 | localhost | # Node Information 2026-03-05 16:31:21.959484 | localhost | Inventory Hostname: aio 2026-03-05 16:31:21.959519 | localhost | Hostname: np0000157924 2026-03-05 16:31:21.959559 | localhost | Username: zuul 2026-03-05 16:31:21.959597 | localhost | Distro: Ubuntu 22.04 2026-03-05 16:31:21.959631 | localhost | Provider: yul1 2026-03-05 16:31:21.959664 | localhost | Region: ca-ymq-1 2026-03-05 16:31:21.959696 | localhost | Label: ubuntu-jammy 2026-03-05 16:31:21.959728 | localhost | Product Name: OpenStack Nova 2026-03-05 16:31:21.959760 | localhost | Interface IP: 162.253.55.74 2026-03-05 16:31:21.971585 | 2026-03-05 16:31:21.971706 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 16:31:22.361237 | localhost -> localhost | changed 2026-03-05 16:31:22.368143 | 2026-03-05 16:31:22.368250 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 16:31:23.190949 | localhost -> localhost | changed 2026-03-05 16:31:23.200239 | 2026-03-05 16:31:23.200346 | PLAY [all] 2026-03-05 16:31:23.208943 | 2026-03-05 16:31:23.209041 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 16:31:23.484062 | aio -> localhost | ok 2026-03-05 16:31:23.494485 | 2026-03-05 16:31:23.494587 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 16:31:23.529249 | aio | ok 2026-03-05 16:31:23.617991 | aio | included: /var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:31:23.625644 | 2026-03-05 16:31:23.625707 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 16:31:24.327069 | aio -> localhost | Generating public/private rsa key pair. 2026-03-05 16:31:24.327469 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/cffb314f5a8d49c6a37bd209106ccaa8_id_rsa 2026-03-05 16:31:24.327548 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/cffb314f5a8d49c6a37bd209106ccaa8_id_rsa.pub 2026-03-05 16:31:24.327604 | aio -> localhost | The key fingerprint is: 2026-03-05 16:31:24.327657 | aio -> localhost | SHA256:tS0SB/hCyjicf4IkkqSsQZt2usPfFzAwpK5gWm8Xwpw zuul-build-sshkey 2026-03-05 16:31:24.327728 | aio -> localhost | The key's randomart image is: 2026-03-05 16:31:24.327780 | aio -> localhost | +---[RSA 3072]----+ 2026-03-05 16:31:24.327836 | aio -> localhost | | .. .. | 2026-03-05 16:31:24.327888 | aio -> localhost | | o.o o . | 2026-03-05 16:31:24.327940 | aio -> localhost | |=+o+oo .. o | 2026-03-05 16:31:24.327995 | aio -> localhost | |B=*+o+. .+ o | 2026-03-05 16:31:24.328049 | aio -> localhost | |=*++E +.S o . | 2026-03-05 16:31:24.328098 | aio -> localhost | |*o..o..o . . | 2026-03-05 16:31:24.328123 | aio -> localhost | |+ . oo. . | 2026-03-05 16:31:24.328147 | aio -> localhost | | + ... . | 2026-03-05 16:31:24.328170 | aio -> localhost | | o. .. | 2026-03-05 16:31:24.328191 | aio -> localhost | +----[SHA256]-----+ 2026-03-05 16:31:24.328237 | aio -> localhost | ok: Runtime: 0:00:00.307824 2026-03-05 16:31:24.333468 | 2026-03-05 16:31:24.333531 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 16:31:24.368003 | aio | ok 2026-03-05 16:31:24.378742 | aio | included: /var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:31:24.386299 | 2026-03-05 16:31:24.386359 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 16:31:24.410166 | aio | skipping: Conditional result was False 2026-03-05 16:31:24.420906 | 2026-03-05 16:31:24.421044 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 16:31:24.852515 | aio | changed 2026-03-05 16:31:24.859683 | 2026-03-05 16:31:24.859779 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 16:31:25.045780 | aio | ok 2026-03-05 16:31:25.052528 | 2026-03-05 16:31:25.052620 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 16:31:25.523675 | aio | changed 2026-03-05 16:31:25.531259 | 2026-03-05 16:31:25.531421 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 16:31:25.989053 | aio | changed 2026-03-05 16:31:25.995712 | 2026-03-05 16:31:25.995797 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 16:31:26.020154 | aio | skipping: Conditional result was False 2026-03-05 16:31:26.028190 | 2026-03-05 16:31:26.028278 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 16:31:26.366443 | aio -> localhost | changed 2026-03-05 16:31:26.380867 | 2026-03-05 16:31:26.380975 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 16:31:26.656807 | aio -> localhost | Identity added: /var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/cffb314f5a8d49c6a37bd209106ccaa8_id_rsa (zuul-build-sshkey) 2026-03-05 16:31:26.657030 | aio -> localhost | ok: Runtime: 0:00:00.015214 2026-03-05 16:31:26.663598 | 2026-03-05 16:31:26.663681 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 16:31:26.960428 | aio | ok 2026-03-05 16:31:26.968361 | 2026-03-05 16:31:26.968454 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 16:31:26.993409 | aio | skipping: Conditional result was False 2026-03-05 16:31:27.009555 | 2026-03-05 16:31:27.009646 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 16:31:27.316300 | aio | ok 2026-03-05 16:31:27.323600 | 2026-03-05 16:31:27.323671 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 16:31:30.868689 | aio | Output suppressed because no_log was given 2026-03-05 16:31:30.882528 | 2026-03-05 16:31:30.882638 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 16:31:31.069830 | aio | ok: "logs" 2026-03-05 16:31:31.089958 | aio | ok: All items complete 2026-03-05 16:31:31.090052 | 2026-03-05 16:31:31.226405 | aio | ok: "artifacts" 2026-03-05 16:31:31.370357 | aio | ok: "docs" 2026-03-05 16:31:31.384124 | 2026-03-05 16:31:31.384345 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 16:31:31.605934 | aio | changed: "logs" 2026-03-05 16:31:31.747852 | aio | changed: "artifacts" 2026-03-05 16:31:31.910613 | aio | changed: "docs" 2026-03-05 16:31:31.940390 | 2026-03-05 16:31:31.940533 | PLAY RECAP 2026-03-05 16:31:31.940600 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:31:31.940640 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:31:31.940668 | 2026-03-05 16:31:32.108047 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:32.114379 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:31:32.740657 | 2026-03-05 16:31:32.740874 | PLAY [all] 2026-03-05 16:31:32.755010 | 2026-03-05 16:31:32.755120 | TASK [setup-uv : Extract archive] 2026-03-05 16:31:34.953998 | aio | changed 2026-03-05 16:31:34.960794 | 2026-03-05 16:31:34.960869 | TASK [setup-uv : Print version] 2026-03-05 16:31:35.127480 | aio | uv 0.8.13 2026-03-05 16:31:35.493670 | aio | ok: Runtime: 0:00:00.008686 2026-03-05 16:31:35.502430 | 2026-03-05 16:31:35.502486 | PLAY RECAP 2026-03-05 16:31:35.502535 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:31:35.502560 | 2026-03-05 16:31:35.616667 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:31:35.618828 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:31:36.215381 | 2026-03-05 16:31:36.215506 | PLAY [all] 2026-03-05 16:31:36.226814 | 2026-03-05 16:31:36.226885 | TASK [Copy inventory file for Zuul] 2026-03-05 16:31:37.085695 | aio | changed 2026-03-05 16:31:37.093465 | 2026-03-05 16:31:37.093536 | TASK [Switch "ansible_host" to private IP] 2026-03-05 16:31:37.368836 | aio | changed: 1 replacements made 2026-03-05 16:31:37.468910 | 2026-03-05 16:31:37.469047 | TASK [Run Molecule scenario] 2026-03-05 16:31:37.891096 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 16:31:38.649510 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 16:31:38.819546 | aio | Using CPython 3.13.7 2026-03-05 16:31:38.819625 | aio | Creating virtual environment at: .venv 2026-03-05 16:31:39.117381 | aio | Downloading netaddr (2.2MiB) 2026-03-05 16:31:39.117486 | aio | Downloading pygments (1.2MiB) 2026-03-05 16:31:39.144995 | aio | Downloading ansible-core (2.1MiB) 2026-03-05 16:31:39.145255 | aio | Downloading cryptography (4.3MiB) 2026-03-05 16:31:39.286116 | aio | Downloading netaddr 2026-03-05 16:31:39.319420 | aio | Downloading cryptography 2026-03-05 16:31:39.351015 | aio | Downloading pygments 2026-03-05 16:31:39.481693 | aio | Downloading ansible-core 2026-03-05 16:31:39.519994 | aio | Installed 36 packages in 37ms 2026-03-05 16:31:40.663964 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 16:31:40.664101 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 16:31:41.273592 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 16:31:41.273799 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 16:31:53.994579 | aio | INFO [default > dependency] Executing 2026-03-05 16:31:53.994896 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 16:31:53.995116 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 16:31:53.995265 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 16:31:54.000603 | aio | INFO [default > cleanup] Executing 2026-03-05 16:31:54.001073 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:31:54.006184 | aio | INFO [default > destroy] Executing 2026-03-05 16:31:54.006282 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:31:54.006369 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 16:31:54.012016 | aio | INFO [default > syntax] Executing 2026-03-05 16:31:54.940312 | aio | 2026-03-05 16:31:54.940941 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 16:31:54.990936 | aio | INFO [default > syntax] Executed: Successful 2026-03-05 16:31:55.002783 | aio | INFO [default > create] Executing 2026-03-05 16:31:55.004159 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:31:55.009200 | aio | INFO [default > prepare] Executing 2026-03-05 16:31:55.681268 | aio | 2026-03-05 16:31:55.681676 | aio | PLAY [Prepare] ***************************************************************** 2026-03-05 16:31:55.681975 | aio | 2026-03-05 16:31:55.682286 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:31:55.682638 | aio | Thursday 05 March 2026 16:31:55 +0000 (0:00:00.031) 0:00:00.031 ******** 2026-03-05 16:31:56.812337 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:31:56.812766 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:31:56.813079 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:31:56.813354 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:31:56.813635 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:31:56.819750 | aio | ok: [aio] 2026-03-05 16:31:56.820119 | aio | 2026-03-05 16:31:56.820507 | aio | TASK [Configure short hostname] ************************************************ 2026-03-05 16:31:56.820806 | aio | Thursday 05 March 2026 16:31:56 +0000 (0:00:01.139) 0:00:01.170 ******** 2026-03-05 16:31:57.515010 | aio | changed: [aio] 2026-03-05 16:31:57.515355 | aio | 2026-03-05 16:31:57.515650 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 16:31:57.515938 | aio | Thursday 05 March 2026 16:31:57 +0000 (0:00:00.694) 0:00:01.865 ******** 2026-03-05 16:31:57.775003 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 16:31:57.775369 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 16:31:57.775662 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 16:31:57.782904 | aio | changed: [aio] 2026-03-05 16:31:57.783239 | aio | 2026-03-05 16:31:57.783549 | aio | TASK [Update apt cache] ******************************************************** 2026-03-05 16:31:57.783846 | aio | Thursday 05 March 2026 16:31:57 +0000 (0:00:00.268) 0:00:02.133 ******** 2026-03-05 16:32:04.830647 | aio | changed: [aio] 2026-03-05 16:32:04.831002 | aio | 2026-03-05 16:32:04.831275 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 16:32:04.831513 | aio | 2026-03-05 16:32:04.831768 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:04.832025 | aio | Thursday 05 March 2026 16:32:04 +0000 (0:00:07.047) 0:00:09.181 ******** 2026-03-05 16:32:05.520181 | aio | ok: [aio] 2026-03-05 16:32:05.520511 | aio | 2026-03-05 16:32:05.520795 | aio | TASK [Install depedencies] ***************************************************** 2026-03-05 16:32:05.521067 | aio | Thursday 05 March 2026 16:32:05 +0000 (0:00:00.689) 0:00:09.870 ******** 2026-03-05 16:32:24.526078 | aio | changed: [aio] 2026-03-05 16:32:24.526149 | aio | 2026-03-05 16:32:24.526160 | aio | TASK [Start up service] ******************************************************** 2026-03-05 16:32:24.526169 | aio | Thursday 05 March 2026 16:32:24 +0000 (0:00:19.005) 0:00:28.876 ******** 2026-03-05 16:32:25.050636 | aio | ok: [aio] 2026-03-05 16:32:25.050795 | aio | 2026-03-05 16:32:25.051007 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 16:32:25.051211 | aio | Thursday 05 March 2026 16:32:25 +0000 (0:00:00.525) 0:00:29.401 ******** 2026-03-05 16:32:25.351049 | aio | ok: [aio] 2026-03-05 16:32:25.351203 | aio | 2026-03-05 16:32:25.351416 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 16:32:25.351624 | aio | Thursday 05 March 2026 16:32:25 +0000 (0:00:00.300) 0:00:29.701 ******** 2026-03-05 16:32:25.974561 | aio | changed: [aio] 2026-03-05 16:32:25.974668 | aio | 2026-03-05 16:32:25.974780 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-05 16:32:25.974904 | aio | Thursday 05 March 2026 16:32:25 +0000 (0:00:00.623) 0:00:30.324 ******** 2026-03-05 16:32:26.159088 | aio | ok: [aio] 2026-03-05 16:32:26.159261 | aio | 2026-03-05 16:32:26.159511 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 16:32:26.159743 | aio | Thursday 05 March 2026 16:32:26 +0000 (0:00:00.184) 0:00:30.509 ******** 2026-03-05 16:32:26.175871 | aio | skipping: [aio] 2026-03-05 16:32:26.176077 | aio | 2026-03-05 16:32:26.176294 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-05 16:32:26.176511 | aio | Thursday 05 March 2026 16:32:26 +0000 (0:00:00.017) 0:00:30.526 ******** 2026-03-05 16:32:27.761548 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:27.761716 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:27.761946 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:27.762142 | aio | 2026-03-05 16:32:27.762339 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 16:32:27.762567 | aio | Thursday 05 March 2026 16:32:27 +0000 (0:00:01.585) 0:00:32.111 ******** 2026-03-05 16:32:28.392346 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:28.392441 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:28.392570 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:28.392687 | aio | 2026-03-05 16:32:28.392812 | aio | TASK [Start loop devices] ****************************************************** 2026-03-05 16:32:28.392940 | aio | Thursday 05 March 2026 16:32:28 +0000 (0:00:00.631) 0:00:32.743 ******** 2026-03-05 16:32:29.111707 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:29.111824 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:29.111989 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:29.112133 | aio | 2026-03-05 16:32:29.112301 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 16:32:29.112466 | aio | Thursday 05 March 2026 16:32:29 +0000 (0:00:00.719) 0:00:33.462 ******** 2026-03-05 16:32:32.231044 | aio | changed: [aio] => (item=osd0) 2026-03-05 16:32:32.231283 | aio | changed: [aio] => (item=osd1) 2026-03-05 16:32:32.231525 | aio | changed: [aio] => (item=osd2) 2026-03-05 16:32:32.231759 | aio | 2026-03-05 16:32:32.232047 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 16:32:32.232313 | aio | Thursday 05 March 2026 16:32:32 +0000 (0:00:03.117) 0:00:36.580 ******** 2026-03-05 16:32:34.050499 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-05 16:32:34.050719 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-05 16:32:34.050974 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-05 16:32:34.051193 | aio | 2026-03-05 16:32:34.051412 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:32:34.051681 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 16:32:34.051885 | aio | 2026-03-05 16:32:34.052081 | aio | 2026-03-05 16:32:34.052298 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:32:34.052523 | aio | Thursday 05 March 2026 16:32:34 +0000 (0:00:01.820) 0:00:38.401 ******** 2026-03-05 16:32:34.052746 | aio | =============================================================================== 2026-03-05 16:32:34.052967 | aio | Install depedencies ---------------------------------------------------- 19.01s 2026-03-05 16:32:34.053173 | aio | Update apt cache -------------------------------------------------------- 7.05s 2026-03-05 16:32:34.053388 | aio | Create a volume group for each loop device ------------------------------ 3.12s 2026-03-05 16:32:34.053612 | aio | Create a logical volume for each loop device ---------------------------- 1.82s 2026-03-05 16:32:34.053875 | aio | Create devices for Ceph ------------------------------------------------- 1.59s 2026-03-05 16:32:34.054098 | aio | Gathering Facts --------------------------------------------------------- 1.14s 2026-03-05 16:32:34.054309 | aio | Start loop devices ------------------------------------------------------ 0.72s 2026-03-05 16:32:34.054565 | aio | Configure short hostname ------------------------------------------------ 0.69s 2026-03-05 16:32:34.054818 | aio | Gathering Facts --------------------------------------------------------- 0.69s 2026-03-05 16:32:34.055035 | aio | Set permissions on loopback devices ------------------------------------- 0.63s 2026-03-05 16:32:34.055251 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s 2026-03-05 16:32:34.055464 | aio | Start up service -------------------------------------------------------- 0.53s 2026-03-05 16:32:34.055685 | aio | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-03-05 16:32:34.055915 | aio | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-03-05 16:32:34.056133 | aio | Get list of all loopback devices ---------------------------------------- 0.18s 2026-03-05 16:32:34.056356 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 16:32:34.121839 | aio | INFO [default > prepare] Executed: Successful 2026-03-05 16:32:34.127758 | aio | INFO [default > converge] Executing 2026-03-05 16:32:34.935079 | aio | 2026-03-05 16:32:34.935230 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:32:34.935428 | aio | 2026-03-05 16:32:34.935633 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:34.935837 | aio | Thursday 05 March 2026 16:32:34 +0000 (0:00:00.049) 0:00:00.049 ******** 2026-03-05 16:32:36.084811 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:32:36.084958 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:32:36.085136 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:32:36.085306 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:32:36.085479 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:36.098800 | aio | ok: [aio] 2026-03-05 16:32:36.098965 | aio | 2026-03-05 16:32:36.099159 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:32:36.099345 | aio | Thursday 05 March 2026 16:32:36 +0000 (0:00:01.163) 0:00:01.212 ******** 2026-03-05 16:32:36.403079 | aio | ok: [aio] 2026-03-05 16:32:36.403254 | aio | 2026-03-05 16:32:36.403493 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:36.403713 | aio | Thursday 05 March 2026 16:32:36 +0000 (0:00:00.304) 0:00:01.517 ******** 2026-03-05 16:32:36.440269 | aio | skipping: [aio] 2026-03-05 16:32:36.440444 | aio | 2026-03-05 16:32:36.440656 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:32:36.440912 | aio | Thursday 05 March 2026 16:32:36 +0000 (0:00:00.037) 0:00:01.554 ******** 2026-03-05 16:32:36.762724 | aio | changed: [aio] 2026-03-05 16:32:36.762873 | aio | 2026-03-05 16:32:36.763086 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:32:36.763286 | aio | Thursday 05 March 2026 16:32:36 +0000 (0:00:00.322) 0:00:01.876 ******** 2026-03-05 16:32:36.856955 | aio | ok: [aio] => { 2026-03-05 16:32:36.857230 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:32:36.857543 | aio | } 2026-03-05 16:32:36.857732 | aio | 2026-03-05 16:32:36.857943 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:32:36.858263 | aio | Thursday 05 March 2026 16:32:36 +0000 (0:00:00.093) 0:00:01.970 ******** 2026-03-05 16:32:37.516805 | aio | changed: [aio] 2026-03-05 16:32:37.516987 | aio | 2026-03-05 16:32:37.517287 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:32:37.517547 | aio | Thursday 05 March 2026 16:32:37 +0000 (0:00:00.660) 0:00:02.630 ******** 2026-03-05 16:32:37.555087 | aio | skipping: [aio] 2026-03-05 16:32:37.555157 | aio | 2026-03-05 16:32:37.555314 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:37.555431 | aio | Thursday 05 March 2026 16:32:37 +0000 (0:00:00.038) 0:00:02.669 ******** 2026-03-05 16:32:37.596721 | aio | skipping: [aio] 2026-03-05 16:32:37.596812 | aio | 2026-03-05 16:32:37.597054 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:32:37.597260 | aio | Thursday 05 March 2026 16:32:37 +0000 (0:00:00.041) 0:00:02.711 ******** 2026-03-05 16:32:37.783923 | aio | ok: [aio] 2026-03-05 16:32:37.784094 | aio | 2026-03-05 16:32:37.784338 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:32:37.784575 | aio | Thursday 05 March 2026 16:32:37 +0000 (0:00:00.187) 0:00:02.898 ******** 2026-03-05 16:32:38.974650 | aio | ok: [aio] 2026-03-05 16:32:38.974841 | aio | 2026-03-05 16:32:38.975057 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:32:38.975312 | aio | Thursday 05 March 2026 16:32:38 +0000 (0:00:01.190) 0:00:04.088 ******** 2026-03-05 16:32:39.046018 | aio | ok: [aio] => { 2026-03-05 16:32:39.046206 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:32:39.046581 | aio | } 2026-03-05 16:32:39.046797 | aio | 2026-03-05 16:32:39.047030 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:32:39.047217 | aio | Thursday 05 March 2026 16:32:39 +0000 (0:00:00.071) 0:00:04.160 ******** 2026-03-05 16:32:39.780369 | aio | changed: [aio] 2026-03-05 16:32:39.780540 | aio | 2026-03-05 16:32:39.780761 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:32:39.780984 | aio | Thursday 05 March 2026 16:32:39 +0000 (0:00:00.734) 0:00:04.894 ******** 2026-03-05 16:32:42.623287 | aio | changed: [aio] 2026-03-05 16:32:42.623440 | aio | 2026-03-05 16:32:42.623657 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:32:42.623867 | aio | Thursday 05 March 2026 16:32:42 +0000 (0:00:02.842) 0:00:07.737 ******** 2026-03-05 16:32:42.640336 | aio | skipping: [aio] 2026-03-05 16:32:42.640491 | aio | 2026-03-05 16:32:42.640690 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:32:42.640887 | aio | Thursday 05 March 2026 16:32:42 +0000 (0:00:00.017) 0:00:07.754 ******** 2026-03-05 16:32:42.668722 | aio | skipping: [aio] 2026-03-05 16:32:42.668984 | aio | 2026-03-05 16:32:42.669232 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:32:42.669426 | aio | Thursday 05 March 2026 16:32:42 +0000 (0:00:00.028) 0:00:07.783 ******** 2026-03-05 16:32:42.686621 | aio | skipping: [aio] 2026-03-05 16:32:42.686809 | aio | 2026-03-05 16:32:42.687071 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:32:42.687282 | aio | Thursday 05 March 2026 16:32:42 +0000 (0:00:00.017) 0:00:07.801 ******** 2026-03-05 16:32:47.667068 | aio | changed: [aio] 2026-03-05 16:32:47.667261 | aio | 2026-03-05 16:32:47.667787 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:32:47.668057 | aio | Thursday 05 March 2026 16:32:47 +0000 (0:00:04.979) 0:00:12.780 ******** 2026-03-05 16:32:48.200977 | aio | changed: [aio] 2026-03-05 16:32:48.201075 | aio | 2026-03-05 16:32:48.201220 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:32:48.201357 | aio | Thursday 05 March 2026 16:32:48 +0000 (0:00:00.534) 0:00:13.315 ******** 2026-03-05 16:32:49.100094 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:32:49.100154 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:32:49.100167 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:32:49.100177 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:32:49.100186 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:32:49.100196 | aio | 2026-03-05 16:32:49.100206 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:32:49.100215 | aio | Thursday 05 March 2026 16:32:49 +0000 (0:00:00.897) 0:00:14.212 ******** 2026-03-05 16:32:49.620572 | aio | changed: [aio] 2026-03-05 16:32:49.620636 | aio | 2026-03-05 16:32:49.620756 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:32:49.621167 | aio | Thursday 05 March 2026 16:32:49 +0000 (0:00:00.514) 0:00:14.727 ******** 2026-03-05 16:32:49.621326 | aio | 2026-03-05 16:32:49.621332 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:32:49.621336 | aio | Thursday 05 March 2026 16:32:49 +0000 (0:00:00.007) 0:00:14.734 ******** 2026-03-05 16:32:50.541869 | aio | ok: [aio] 2026-03-05 16:32:50.541950 | aio | 2026-03-05 16:32:50.542263 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:32:50.542306 | aio | Thursday 05 March 2026 16:32:50 +0000 (0:00:00.921) 0:00:15.656 ******** 2026-03-05 16:32:50.974048 | aio | changed: [aio] 2026-03-05 16:32:50.974126 | aio | 2026-03-05 16:32:50.974186 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:32:50.974318 | aio | Thursday 05 March 2026 16:32:50 +0000 (0:00:00.432) 0:00:16.088 ******** 2026-03-05 16:32:51.485664 | aio | changed: [aio] 2026-03-05 16:32:51.485737 | aio | 2026-03-05 16:32:51.485795 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:32:51.485920 | aio | Thursday 05 March 2026 16:32:51 +0000 (0:00:00.511) 0:00:16.600 ******** 2026-03-05 16:32:51.678561 | aio | ok: [aio] 2026-03-05 16:32:51.678624 | aio | 2026-03-05 16:32:51.678840 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:32:51.678897 | aio | Thursday 05 March 2026 16:32:51 +0000 (0:00:00.192) 0:00:16.792 ******** 2026-03-05 16:32:51.747811 | aio | ok: [aio] => { 2026-03-05 16:32:51.747885 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:32:51.748030 | aio | } 2026-03-05 16:32:51.748415 | aio | 2026-03-05 16:32:51.748448 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:32:51.748456 | aio | Thursday 05 March 2026 16:32:51 +0000 (0:00:00.069) 0:00:16.862 ******** 2026-03-05 16:32:52.689585 | aio | changed: [aio] 2026-03-05 16:32:52.689698 | aio | 2026-03-05 16:32:52.690072 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:32:52.690125 | aio | Thursday 05 March 2026 16:32:52 +0000 (0:00:00.941) 0:00:17.803 ******** 2026-03-05 16:32:56.950064 | aio | changed: [aio] 2026-03-05 16:32:56.950123 | aio | 2026-03-05 16:32:56.950236 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:32:56.950349 | aio | Thursday 05 March 2026 16:32:56 +0000 (0:00:04.260) 0:00:22.064 ******** 2026-03-05 16:32:57.949874 | aio | ok: [aio] 2026-03-05 16:32:57.950345 | aio | 2026-03-05 16:32:57.950415 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:32:57.950424 | aio | Thursday 05 March 2026 16:32:57 +0000 (0:00:00.999) 0:00:23.064 ******** 2026-03-05 16:32:58.289507 | aio | changed: [aio] 2026-03-05 16:32:58.289590 | aio | 2026-03-05 16:32:58.289901 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:32:58.289962 | aio | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.339) 0:00:23.403 ******** 2026-03-05 16:32:58.744412 | aio | changed: [aio] 2026-03-05 16:32:58.745082 | aio | 2026-03-05 16:32:58.745281 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:32:58.745297 | aio | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.454) 0:00:23.858 ******** 2026-03-05 16:32:59.295368 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:32:59.295479 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:32:59.296013 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:32:59.296060 | aio | 2026-03-05 16:32:59.296069 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:32:59.296076 | aio | Thursday 05 March 2026 16:32:59 +0000 (0:00:00.551) 0:00:24.409 ******** 2026-03-05 16:32:59.713788 | aio | changed: [aio] 2026-03-05 16:32:59.713828 | aio | 2026-03-05 16:32:59.713835 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:32:59.713842 | aio | Thursday 05 March 2026 16:32:59 +0000 (0:00:00.417) 0:00:24.827 ******** 2026-03-05 16:33:00.141284 | aio | changed: [aio] 2026-03-05 16:33:00.141361 | aio | 2026-03-05 16:33:00.141419 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:33:00.141797 | aio | Thursday 05 March 2026 16:33:00 +0000 (0:00:00.420) 0:00:25.247 ******** 2026-03-05 16:33:00.141841 | aio | 2026-03-05 16:33:00.141847 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:00.141851 | aio | Thursday 05 March 2026 16:33:00 +0000 (0:00:00.007) 0:00:25.255 ******** 2026-03-05 16:33:00.817167 | aio | ok: [aio] 2026-03-05 16:33:00.817236 | aio | 2026-03-05 16:33:00.817324 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:33:00.817464 | aio | Thursday 05 March 2026 16:33:00 +0000 (0:00:00.675) 0:00:25.931 ******** 2026-03-05 16:33:01.709823 | aio | changed: [aio] 2026-03-05 16:33:01.709910 | aio | 2026-03-05 16:33:01.710278 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:33:01.710363 | aio | Thursday 05 March 2026 16:33:01 +0000 (0:00:00.892) 0:00:26.823 ******** 2026-03-05 16:33:02.267333 | aio | changed: [aio] 2026-03-05 16:33:02.267409 | aio | 2026-03-05 16:33:02.267760 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:33:02.267815 | aio | Thursday 05 March 2026 16:33:02 +0000 (0:00:00.557) 0:00:27.381 ******** 2026-03-05 16:33:02.321181 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:33:02.321596 | aio | 2026-03-05 16:33:02.321662 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:33:02.321672 | aio | Thursday 05 March 2026 16:33:02 +0000 (0:00:00.053) 0:00:27.435 ******** 2026-03-05 16:33:07.313603 | aio | changed: [aio] 2026-03-05 16:33:07.313675 | aio | 2026-03-05 16:33:07.313948 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:33:07.313969 | aio | Thursday 05 March 2026 16:33:07 +0000 (0:00:04.992) 0:00:32.427 ******** 2026-03-05 16:33:07.950322 | aio | ok: [aio] => (item=chronyd) 2026-03-05 16:33:07.950369 | aio | ok: [aio] => (item=sshd) 2026-03-05 16:33:07.950377 | aio | 2026-03-05 16:33:07.950383 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:33:07.950407 | aio | Thursday 05 March 2026 16:33:07 +0000 (0:00:00.636) 0:00:33.063 ******** 2026-03-05 16:33:08.547103 | aio | changed: [aio] 2026-03-05 16:33:08.547177 | aio | 2026-03-05 16:33:08.547463 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:33:08.547509 | aio | Thursday 05 March 2026 16:33:08 +0000 (0:00:00.597) 0:00:33.661 ******** 2026-03-05 16:33:08.742790 | aio | ok: [aio] 2026-03-05 16:33:08.743291 | aio | 2026-03-05 16:33:08.743347 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:33:08.743358 | aio | Thursday 05 March 2026 16:33:08 +0000 (0:00:00.195) 0:00:33.856 ******** 2026-03-05 16:33:09.202688 | aio | changed: [aio] 2026-03-05 16:33:09.202751 | aio | 2026-03-05 16:33:09.202979 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:33:09.203029 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.460) 0:00:34.317 ******** 2026-03-05 16:33:09.551372 | aio | changed: [aio] 2026-03-05 16:33:09.551437 | aio | 2026-03-05 16:33:09.551531 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:33:09.551664 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.348) 0:00:34.665 ******** 2026-03-05 16:33:09.699899 | aio | ok: [aio] 2026-03-05 16:33:09.699963 | aio | 2026-03-05 16:33:09.700147 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:33:09.700190 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.148) 0:00:34.814 ******** 2026-03-05 16:33:09.904619 | aio | ok: [aio] => (item=aio) 2026-03-05 16:33:09.904677 | aio | 2026-03-05 16:33:09.904863 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:33:09.905032 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.204) 0:00:35.018 ******** 2026-03-05 16:33:09.946253 | aio | ok: [aio] 2026-03-05 16:33:09.946338 | aio | 2026-03-05 16:33:09.946594 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:33:09.946625 | aio | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.041) 0:00:35.060 ******** 2026-03-05 16:33:10.051968 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-05 16:33:10.052008 | aio | 2026-03-05 16:33:10.052221 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 16:33:10.052281 | aio | Thursday 05 March 2026 16:33:10 +0000 (0:00:00.105) 0:00:35.166 ******** 2026-03-05 16:33:10.345079 | aio | changed: [aio] 2026-03-05 16:33:10.345145 | aio | 2026-03-05 16:33:10.345478 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 16:33:10.345527 | aio | Thursday 05 March 2026 16:33:10 +0000 (0:00:00.292) 0:00:35.459 ******** 2026-03-05 16:33:11.011348 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 16:33:11.011397 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 16:33:11.011416 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 16:33:11.011423 | aio | 2026-03-05 16:33:11.011429 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 16:33:11.011435 | aio | Thursday 05 March 2026 16:33:11 +0000 (0:00:00.665) 0:00:36.124 ******** 2026-03-05 16:35:15.103264 | aio | ok: [aio] 2026-03-05 16:35:15.103342 | aio | 2026-03-05 16:35:15.103400 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 16:35:15.103513 | aio | Thursday 05 March 2026 16:35:15 +0000 (0:02:04.092) 0:02:40.217 ******** 2026-03-05 16:35:15.292270 | aio | changed: [aio] 2026-03-05 16:35:15.292304 | aio | 2026-03-05 16:35:15.292310 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 16:35:15.292315 | aio | Thursday 05 March 2026 16:35:15 +0000 (0:00:00.188) 0:02:40.406 ******** 2026-03-05 16:35:15.328900 | aio | ok: [aio] 2026-03-05 16:35:15.328923 | aio | 2026-03-05 16:35:15.328928 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:35:15.328932 | aio | Thursday 05 March 2026 16:35:15 +0000 (0:00:00.037) 0:02:40.443 ******** 2026-03-05 16:35:15.392894 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:35:15.392925 | aio | 2026-03-05 16:35:15.392931 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:35:15.392937 | aio | Thursday 05 March 2026 16:35:15 +0000 (0:00:00.063) 0:02:40.507 ******** 2026-03-05 16:35:21.938002 | aio | ok: [aio] 2026-03-05 16:35:21.938050 | aio | 2026-03-05 16:35:21.938056 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:35:21.938061 | aio | Thursday 05 March 2026 16:35:21 +0000 (0:00:06.544) 0:02:47.052 ******** 2026-03-05 16:35:21.986896 | aio | ok: [aio] => (item=aio) 2026-03-05 16:35:21.986935 | aio | 2026-03-05 16:35:21.986941 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:35:21.986946 | aio | Thursday 05 March 2026 16:35:21 +0000 (0:00:00.048) 0:02:47.101 ******** 2026-03-05 16:35:22.328229 | aio | ok: [aio] 2026-03-05 16:35:22.328335 | aio | 2026-03-05 16:35:22.328647 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:35:22.328693 | aio | Thursday 05 March 2026 16:35:22 +0000 (0:00:00.341) 0:02:47.442 ******** 2026-03-05 16:35:28.956532 | aio | ok: [aio] 2026-03-05 16:35:28.956595 | aio | 2026-03-05 16:35:28.956673 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:35:28.956787 | aio | Thursday 05 March 2026 16:35:28 +0000 (0:00:06.628) 0:02:54.070 ******** 2026-03-05 16:35:41.297137 | aio | changed: [aio] 2026-03-05 16:35:41.297207 | aio | 2026-03-05 16:35:41.297284 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:35:41.297415 | aio | Thursday 05 March 2026 16:35:41 +0000 (0:00:12.340) 0:03:06.411 ******** 2026-03-05 16:35:55.423431 | aio | ok: [aio] 2026-03-05 16:35:55.423473 | aio | 2026-03-05 16:35:55.423479 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:35:55.423484 | aio | Thursday 05 March 2026 16:35:55 +0000 (0:00:14.125) 0:03:20.537 ******** 2026-03-05 16:35:55.478404 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:35:55.478487 | aio | 2026-03-05 16:35:55.478726 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:35:55.478769 | aio | Thursday 05 March 2026 16:35:55 +0000 (0:00:00.055) 0:03:20.592 ******** 2026-03-05 16:35:55.521533 | aio | skipping: [aio] 2026-03-05 16:35:55.521615 | aio | 2026-03-05 16:35:55.521852 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:35:55.521897 | aio | Thursday 05 March 2026 16:35:55 +0000 (0:00:00.042) 0:03:20.635 ******** 2026-03-05 16:35:55.560792 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:35:55.560889 | aio | skipping: [aio] 2026-03-05 16:35:55.561014 | aio | 2026-03-05 16:35:55.561308 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:35:55.561331 | aio | Thursday 05 March 2026 16:35:55 +0000 (0:00:00.039) 0:03:20.675 ******** 2026-03-05 16:35:55.808929 | aio | ok: [aio] 2026-03-05 16:35:55.809011 | aio | 2026-03-05 16:35:55.809084 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:35:55.809212 | aio | Thursday 05 March 2026 16:35:55 +0000 (0:00:00.248) 0:03:20.923 ******** 2026-03-05 16:36:02.400457 | aio | ok: [aio] 2026-03-05 16:36:02.400655 | aio | 2026-03-05 16:36:02.400662 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:36:02.400666 | aio | Thursday 05 March 2026 16:36:02 +0000 (0:00:06.591) 0:03:27.514 ******** 2026-03-05 16:36:14.423890 | aio | changed: [aio] 2026-03-05 16:36:14.423958 | aio | 2026-03-05 16:36:14.424038 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:36:14.424130 | aio | Thursday 05 March 2026 16:36:14 +0000 (0:00:12.023) 0:03:39.538 ******** 2026-03-05 16:36:20.509305 | aio | ok: [aio] 2026-03-05 16:36:20.509376 | aio | 2026-03-05 16:36:20.509586 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:36:20.509627 | aio | Thursday 05 March 2026 16:36:20 +0000 (0:00:06.085) 0:03:45.623 ******** 2026-03-05 16:36:28.124957 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:36:28.125004 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 16:36:28.125010 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-05 16:36:28.125015 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 16:36:28.125019 | aio | 2026-03-05 16:36:28.125024 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:36:28.125028 | aio | 2026-03-05 16:36:28.125033 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:36:28.125037 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:07.615) 0:03:53.238 ******** 2026-03-05 16:36:28.980552 | aio | ok: [aio] 2026-03-05 16:36:28.980597 | aio | 2026-03-05 16:36:28.980603 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:36:28.980608 | aio | Thursday 05 March 2026 16:36:28 +0000 (0:00:00.855) 0:03:54.094 ******** 2026-03-05 16:36:29.168562 | aio | ok: [aio] 2026-03-05 16:36:29.168604 | aio | 2026-03-05 16:36:29.168609 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:36:29.168614 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.188) 0:03:54.282 ******** 2026-03-05 16:36:29.194940 | aio | skipping: [aio] 2026-03-05 16:36:29.194962 | aio | 2026-03-05 16:36:29.194967 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:36:29.194971 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.026) 0:03:54.309 ******** 2026-03-05 16:36:29.388461 | aio | ok: [aio] 2026-03-05 16:36:29.388502 | aio | 2026-03-05 16:36:29.388509 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:36:29.388514 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.193) 0:03:54.502 ******** 2026-03-05 16:36:29.442239 | aio | ok: [aio] => { 2026-03-05 16:36:29.442268 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:36:29.442274 | aio | } 2026-03-05 16:36:29.442279 | aio | 2026-03-05 16:36:29.442283 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:36:29.442288 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.053) 0:03:54.556 ******** 2026-03-05 16:36:29.730951 | aio | ok: [aio] 2026-03-05 16:36:29.730992 | aio | 2026-03-05 16:36:29.730998 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:36:29.731003 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.288) 0:03:54.845 ******** 2026-03-05 16:36:29.770202 | aio | skipping: [aio] 2026-03-05 16:36:29.770230 | aio | 2026-03-05 16:36:29.770235 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:36:29.770239 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.039) 0:03:54.884 ******** 2026-03-05 16:36:29.809194 | aio | skipping: [aio] 2026-03-05 16:36:29.809210 | aio | 2026-03-05 16:36:29.809215 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:36:29.809219 | aio | Thursday 05 March 2026 16:36:29 +0000 (0:00:00.038) 0:03:54.923 ******** 2026-03-05 16:36:30.010680 | aio | ok: [aio] 2026-03-05 16:36:30.010722 | aio | 2026-03-05 16:36:30.010727 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:36:30.010732 | aio | Thursday 05 March 2026 16:36:30 +0000 (0:00:00.201) 0:03:55.124 ******** 2026-03-05 16:36:31.108859 | aio | ok: [aio] 2026-03-05 16:36:31.109044 | aio | 2026-03-05 16:36:31.109051 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:36:31.109055 | aio | Thursday 05 March 2026 16:36:31 +0000 (0:00:01.098) 0:03:56.223 ******** 2026-03-05 16:36:31.168570 | aio | ok: [aio] => { 2026-03-05 16:36:31.168619 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:36:31.168626 | aio | } 2026-03-05 16:36:31.168633 | aio | 2026-03-05 16:36:31.168639 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:36:31.168645 | aio | Thursday 05 March 2026 16:36:31 +0000 (0:00:00.059) 0:03:56.282 ******** 2026-03-05 16:36:31.492704 | aio | ok: [aio] 2026-03-05 16:36:31.492745 | aio | 2026-03-05 16:36:31.492750 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:36:31.492755 | aio | Thursday 05 March 2026 16:36:31 +0000 (0:00:00.324) 0:03:56.606 ******** 2026-03-05 16:36:33.394303 | aio | ok: [aio] 2026-03-05 16:36:33.394344 | aio | 2026-03-05 16:36:33.394350 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:36:33.394354 | aio | Thursday 05 March 2026 16:36:33 +0000 (0:00:01.901) 0:03:58.508 ******** 2026-03-05 16:36:33.417118 | aio | skipping: [aio] 2026-03-05 16:36:33.417153 | aio | 2026-03-05 16:36:33.417160 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:36:33.417167 | aio | Thursday 05 March 2026 16:36:33 +0000 (0:00:00.022) 0:03:58.531 ******** 2026-03-05 16:36:33.446619 | aio | skipping: [aio] 2026-03-05 16:36:33.446658 | aio | 2026-03-05 16:36:33.446664 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:36:33.446669 | aio | Thursday 05 March 2026 16:36:33 +0000 (0:00:00.029) 0:03:58.560 ******** 2026-03-05 16:36:33.470315 | aio | skipping: [aio] 2026-03-05 16:36:33.470350 | aio | 2026-03-05 16:36:33.470358 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:36:33.470364 | aio | Thursday 05 March 2026 16:36:33 +0000 (0:00:00.023) 0:03:58.584 ******** 2026-03-05 16:36:34.562959 | aio | ok: [aio] 2026-03-05 16:36:34.563007 | aio | 2026-03-05 16:36:34.563015 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:36:34.563021 | aio | Thursday 05 March 2026 16:36:34 +0000 (0:00:01.092) 0:03:59.676 ******** 2026-03-05 16:36:34.976277 | aio | ok: [aio] 2026-03-05 16:36:34.976325 | aio | 2026-03-05 16:36:34.976333 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:36:34.976341 | aio | Thursday 05 March 2026 16:36:34 +0000 (0:00:00.413) 0:04:00.090 ******** 2026-03-05 16:36:35.864230 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:36:35.864279 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:36:35.864286 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:36:35.864291 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:36:35.864295 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:36:35.864309 | aio | 2026-03-05 16:36:35.864314 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:36:35.864318 | aio | Thursday 05 March 2026 16:36:35 +0000 (0:00:00.887) 0:04:00.977 ******** 2026-03-05 16:36:36.343223 | aio | ok: [aio] 2026-03-05 16:36:36.343259 | aio | 2026-03-05 16:36:36.343265 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:36:36.343270 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:00.472) 0:04:01.450 ******** 2026-03-05 16:36:36.343274 | aio | 2026-03-05 16:36:36.343278 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:36:36.343282 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:00.006) 0:04:01.457 ******** 2026-03-05 16:36:36.666481 | aio | ok: [aio] 2026-03-05 16:36:36.666523 | aio | 2026-03-05 16:36:36.666529 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:36:36.666534 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:00.323) 0:04:01.780 ******** 2026-03-05 16:36:36.857328 | aio | ok: [aio] 2026-03-05 16:36:36.857366 | aio | 2026-03-05 16:36:36.857372 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:36:36.857377 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:00.190) 0:04:01.971 ******** 2026-03-05 16:36:36.901948 | aio | ok: [aio] => { 2026-03-05 16:36:36.901968 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:36:36.901974 | aio | } 2026-03-05 16:36:36.901978 | aio | 2026-03-05 16:36:36.901982 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:36:36.901987 | aio | Thursday 05 March 2026 16:36:36 +0000 (0:00:00.044) 0:04:02.016 ******** 2026-03-05 16:36:37.227267 | aio | ok: [aio] 2026-03-05 16:36:37.227309 | aio | 2026-03-05 16:36:37.227314 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:36:37.227319 | aio | Thursday 05 March 2026 16:36:37 +0000 (0:00:00.325) 0:04:02.341 ******** 2026-03-05 16:36:40.204698 | aio | ok: [aio] 2026-03-05 16:36:40.204743 | aio | 2026-03-05 16:36:40.204749 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:36:40.204754 | aio | Thursday 05 March 2026 16:36:40 +0000 (0:00:02.977) 0:04:05.318 ******** 2026-03-05 16:36:41.353541 | aio | ok: [aio] 2026-03-05 16:36:41.353590 | aio | 2026-03-05 16:36:41.353598 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:36:41.353605 | aio | Thursday 05 March 2026 16:36:41 +0000 (0:00:01.148) 0:04:06.467 ******** 2026-03-05 16:36:41.538461 | aio | ok: [aio] 2026-03-05 16:36:41.538640 | aio | 2026-03-05 16:36:41.538646 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:36:41.538651 | aio | Thursday 05 March 2026 16:36:41 +0000 (0:00:00.185) 0:04:06.652 ******** 2026-03-05 16:36:41.956573 | aio | ok: [aio] 2026-03-05 16:36:41.956613 | aio | 2026-03-05 16:36:41.956619 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:36:41.956624 | aio | Thursday 05 March 2026 16:36:41 +0000 (0:00:00.418) 0:04:07.070 ******** 2026-03-05 16:36:42.480260 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:36:42.480298 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:36:42.480303 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:36:42.480308 | aio | 2026-03-05 16:36:42.480329 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:36:42.480334 | aio | Thursday 05 March 2026 16:36:42 +0000 (0:00:00.523) 0:04:07.594 ******** 2026-03-05 16:36:42.880538 | aio | ok: [aio] 2026-03-05 16:36:42.880578 | aio | 2026-03-05 16:36:42.880583 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:36:42.880588 | aio | Thursday 05 March 2026 16:36:42 +0000 (0:00:00.400) 0:04:07.994 ******** 2026-03-05 16:36:43.298198 | aio | ok: [aio] 2026-03-05 16:36:43.298237 | aio | 2026-03-05 16:36:43.298243 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:36:43.298248 | aio | Thursday 05 March 2026 16:36:43 +0000 (0:00:00.411) 0:04:08.406 ******** 2026-03-05 16:36:43.298252 | aio | 2026-03-05 16:36:43.298256 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:36:43.298260 | aio | Thursday 05 March 2026 16:36:43 +0000 (0:00:00.005) 0:04:08.412 ******** 2026-03-05 16:36:43.631455 | aio | ok: [aio] 2026-03-05 16:36:43.631500 | aio | 2026-03-05 16:36:43.631505 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:36:43.631515 | aio | Thursday 05 March 2026 16:36:43 +0000 (0:00:00.333) 0:04:08.745 ******** 2026-03-05 16:36:43.678029 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:36:43.678075 | aio | 2026-03-05 16:36:43.678083 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:36:43.678090 | aio | Thursday 05 March 2026 16:36:43 +0000 (0:00:00.046) 0:04:08.791 ******** 2026-03-05 16:36:44.821867 | aio | ok: [aio] 2026-03-05 16:36:44.821916 | aio | 2026-03-05 16:36:44.821923 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:36:44.821930 | aio | Thursday 05 March 2026 16:36:44 +0000 (0:00:01.143) 0:04:09.935 ******** 2026-03-05 16:36:45.459335 | aio | ok: [aio] => (item=chronyd) 2026-03-05 16:36:45.459388 | aio | ok: [aio] => (item=sshd) 2026-03-05 16:36:45.459396 | aio | 2026-03-05 16:36:45.459402 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:36:45.459409 | aio | Thursday 05 March 2026 16:36:45 +0000 (0:00:00.637) 0:04:10.572 ******** 2026-03-05 16:36:45.725701 | aio | ok: [aio] 2026-03-05 16:36:45.725741 | aio | 2026-03-05 16:36:45.725747 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:36:45.725752 | aio | Thursday 05 March 2026 16:36:45 +0000 (0:00:00.267) 0:04:10.839 ******** 2026-03-05 16:36:45.917988 | aio | ok: [aio] 2026-03-05 16:36:45.918036 | aio | 2026-03-05 16:36:45.918044 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:36:45.918051 | aio | Thursday 05 March 2026 16:36:45 +0000 (0:00:00.191) 0:04:11.031 ******** 2026-03-05 16:36:46.158851 | aio | ok: [aio] 2026-03-05 16:36:46.158902 | aio | 2026-03-05 16:36:46.158909 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:36:46.158916 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.240) 0:04:11.272 ******** 2026-03-05 16:36:46.354464 | aio | ok: [aio] 2026-03-05 16:36:46.354662 | aio | 2026-03-05 16:36:46.354669 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:36:46.354674 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.195) 0:04:11.468 ******** 2026-03-05 16:36:46.562366 | aio | ok: [aio] => (item=aio) 2026-03-05 16:36:46.562429 | aio | 2026-03-05 16:36:46.562435 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:36:46.562440 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.207) 0:04:11.676 ******** 2026-03-05 16:36:46.604006 | aio | ok: [aio] 2026-03-05 16:36:46.604051 | aio | 2026-03-05 16:36:46.604060 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:46.604067 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.041) 0:04:11.717 ******** 2026-03-05 16:36:46.656105 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:36:46.656129 | aio | 2026-03-05 16:36:46.656135 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:46.656140 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.052) 0:04:11.770 ******** 2026-03-05 16:36:46.701129 | aio | skipping: [aio] 2026-03-05 16:36:46.701173 | aio | 2026-03-05 16:36:46.701181 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:46.701200 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.044) 0:04:11.815 ******** 2026-03-05 16:36:46.739464 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:36:46.739497 | aio | skipping: [aio] 2026-03-05 16:36:46.739504 | aio | 2026-03-05 16:36:46.739510 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:46.739516 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.038) 0:04:11.853 ******** 2026-03-05 16:36:46.977226 | aio | ok: [aio] 2026-03-05 16:36:46.977275 | aio | 2026-03-05 16:36:46.977283 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:36:46.977290 | aio | Thursday 05 March 2026 16:36:46 +0000 (0:00:00.237) 0:04:12.090 ******** 2026-03-05 16:36:59.777543 | aio | ok: [aio] 2026-03-05 16:36:59.777625 | aio | 2026-03-05 16:36:59.777682 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:36:59.777781 | aio | Thursday 05 March 2026 16:36:59 +0000 (0:00:12.801) 0:04:24.892 ******** 2026-03-05 16:37:04.901990 | aio | ok: [aio] 2026-03-05 16:37:04.902077 | aio | 2026-03-05 16:37:04.902319 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:37:04.902368 | aio | Thursday 05 March 2026 16:37:04 +0000 (0:00:05.124) 0:04:30.016 ******** 2026-03-05 16:37:19.177275 | aio | ok: [aio] 2026-03-05 16:37:19.177322 | aio | 2026-03-05 16:37:19.177328 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:37:19.177332 | aio | Thursday 05 March 2026 16:37:19 +0000 (0:00:14.274) 0:04:44.291 ******** 2026-03-05 16:38:55.364098 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 16:38:55.364155 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 16:38:55.364161 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 16:38:55.364165 | aio | 2026-03-05 16:38:55.364170 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:38:55.364175 | aio | Thursday 05 March 2026 16:38:55 +0000 (0:01:36.186) 0:06:20.477 ******** 2026-03-05 16:39:01.296712 | aio | ok: [aio] 2026-03-05 16:39:01.296753 | aio | 2026-03-05 16:39:01.296759 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:39:01.296765 | aio | Thursday 05 March 2026 16:39:01 +0000 (0:00:05.932) 0:06:26.410 ******** 2026-03-05 16:39:07.463441 | aio | ok: [aio] 2026-03-05 16:39:07.463517 | aio | 2026-03-05 16:39:07.463832 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:39:07.463895 | aio | Thursday 05 March 2026 16:39:07 +0000 (0:00:06.166) 0:06:32.577 ******** 2026-03-05 16:39:07.509436 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 16:39:07.509514 | aio | 2026-03-05 16:39:07.509573 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:39:07.509659 | aio | Thursday 05 March 2026 16:39:07 +0000 (0:00:00.045) 0:06:32.623 ******** 2026-03-05 16:39:07.547006 | aio | ok: [aio] 2026-03-05 16:39:07.547176 | aio | 2026-03-05 16:39:07.547388 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:39:07.547594 | aio | Thursday 05 March 2026 16:39:07 +0000 (0:00:00.037) 0:06:32.661 ******** 2026-03-05 16:39:13.677789 | aio | ok: [aio] 2026-03-05 16:39:13.677944 | aio | 2026-03-05 16:39:13.678167 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:39:13.678412 | aio | Thursday 05 March 2026 16:39:13 +0000 (0:00:06.130) 0:06:38.791 ******** 2026-03-05 16:39:13.715020 | aio | ok: [aio] 2026-03-05 16:39:13.715093 | aio | 2026-03-05 16:39:13.715316 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:39:13.715525 | aio | Thursday 05 March 2026 16:39:13 +0000 (0:00:00.037) 0:06:38.829 ******** 2026-03-05 16:39:13.757429 | aio | skipping: [aio] => (item=1) 2026-03-05 16:39:13.757567 | aio | skipping: [aio] => (item=1) 2026-03-05 16:39:13.757766 | aio | skipping: [aio] => (item=1) 2026-03-05 16:39:13.757959 | aio | skipping: [aio] 2026-03-05 16:39:13.758141 | aio | 2026-03-05 16:39:13.758355 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:39:13.758588 | aio | Thursday 05 March 2026 16:39:13 +0000 (0:00:00.042) 0:06:38.871 ******** 2026-03-05 16:39:13.788244 | aio | skipping: [aio] 2026-03-05 16:39:13.788314 | aio | 2026-03-05 16:39:13.788514 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:39:13.788745 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-05 16:39:13.788924 | aio | 2026-03-05 16:39:13.789094 | aio | 2026-03-05 16:39:13.789359 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:39:13.789569 | aio | Thursday 05 March 2026 16:39:13 +0000 (0:00:00.030) 0:06:38.902 ******** 2026-03-05 16:39:13.789752 | aio | =============================================================================== 2026-03-05 16:39:13.789954 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 124.09s 2026-03-05 16:39:13.790157 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 96.19s 2026-03-05 16:39:13.790380 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.27s 2026-03-05 16:39:13.790626 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.13s 2026-03-05 16:39:13.790921 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 12.80s 2026-03-05 16:39:13.791133 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.34s 2026-03-05 16:39:13.791334 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.02s 2026-03-05 16:39:13.791548 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.62s 2026-03-05 16:39:13.791751 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.63s 2026-03-05 16:39:13.791946 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.59s 2026-03-05 16:39:13.792147 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.54s 2026-03-05 16:39:13.792338 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.17s 2026-03-05 16:39:13.792534 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.13s 2026-03-05 16:39:13.792729 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.09s 2026-03-05 16:39:13.792922 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.93s 2026-03-05 16:39:13.793121 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.12s 2026-03-05 16:39:13.793344 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.99s 2026-03-05 16:39:13.793544 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 4.98s 2026-03-05 16:39:13.793740 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.26s 2026-03-05 16:39:13.793935 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s 2026-03-05 16:39:13.876846 | aio | INFO [default > converge] Executed: Successful 2026-03-05 16:39:13.885225 | aio | INFO [default > idempotence] Executing 2026-03-05 16:39:14.736682 | aio | 2026-03-05 16:39:14.736881 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:39:14.737054 | aio | 2026-03-05 16:39:14.737257 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:39:14.737462 | aio | Thursday 05 March 2026 16:39:14 +0000 (0:00:00.047) 0:00:00.047 ******** 2026-03-05 16:39:15.894188 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:39:15.894377 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:39:15.894712 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:39:15.894906 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:39:15.895103 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:39:15.906242 | aio | ok: [aio] 2026-03-05 16:39:15.906486 | aio | 2026-03-05 16:39:15.906712 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:39:15.906918 | aio | Thursday 05 March 2026 16:39:15 +0000 (0:00:01.169) 0:00:01.217 ******** 2026-03-05 16:39:16.182605 | aio | ok: [aio] 2026-03-05 16:39:16.182824 | aio | 2026-03-05 16:39:16.183065 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:39:16.183283 | aio | Thursday 05 March 2026 16:39:16 +0000 (0:00:00.276) 0:00:01.493 ******** 2026-03-05 16:39:16.215347 | aio | skipping: [aio] 2026-03-05 16:39:16.215517 | aio | 2026-03-05 16:39:16.215726 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:39:16.215925 | aio | Thursday 05 March 2026 16:39:16 +0000 (0:00:00.032) 0:00:01.526 ******** 2026-03-05 16:39:16.514634 | aio | ok: [aio] 2026-03-05 16:39:16.514797 | aio | 2026-03-05 16:39:16.515073 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:39:16.515287 | aio | Thursday 05 March 2026 16:39:16 +0000 (0:00:00.298) 0:00:01.825 ******** 2026-03-05 16:39:16.583584 | aio | ok: [aio] => { 2026-03-05 16:39:16.583815 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:39:16.583967 | aio | } 2026-03-05 16:39:16.584276 | aio | 2026-03-05 16:39:16.584510 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:39:16.584719 | aio | Thursday 05 March 2026 16:39:16 +0000 (0:00:00.068) 0:00:01.894 ******** 2026-03-05 16:39:16.978013 | aio | ok: [aio] 2026-03-05 16:39:16.978177 | aio | 2026-03-05 16:39:16.978407 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:39:16.978644 | aio | Thursday 05 March 2026 16:39:16 +0000 (0:00:00.394) 0:00:02.289 ******** 2026-03-05 16:39:17.020197 | aio | skipping: [aio] 2026-03-05 16:39:17.020369 | aio | 2026-03-05 16:39:17.020589 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:39:17.020791 | aio | Thursday 05 March 2026 16:39:17 +0000 (0:00:00.042) 0:00:02.331 ******** 2026-03-05 16:39:17.065990 | aio | skipping: [aio] 2026-03-05 16:39:17.066198 | aio | 2026-03-05 16:39:17.066573 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:39:17.066855 | aio | Thursday 05 March 2026 16:39:17 +0000 (0:00:00.045) 0:00:02.377 ******** 2026-03-05 16:39:17.262786 | aio | ok: [aio] 2026-03-05 16:39:17.262959 | aio | 2026-03-05 16:39:17.263179 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:39:17.263422 | aio | Thursday 05 March 2026 16:39:17 +0000 (0:00:00.196) 0:00:02.573 ******** 2026-03-05 16:39:18.351518 | aio | ok: [aio] 2026-03-05 16:39:18.351773 | aio | 2026-03-05 16:39:18.352136 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:39:18.352725 | aio | Thursday 05 March 2026 16:39:18 +0000 (0:00:01.088) 0:00:03.662 ******** 2026-03-05 16:39:18.425123 | aio | ok: [aio] => { 2026-03-05 16:39:18.425345 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:39:18.425547 | aio | } 2026-03-05 16:39:18.425740 | aio | 2026-03-05 16:39:18.425964 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:39:18.426184 | aio | Thursday 05 March 2026 16:39:18 +0000 (0:00:00.073) 0:00:03.736 ******** 2026-03-05 16:39:18.762881 | aio | ok: [aio] 2026-03-05 16:39:18.763036 | aio | 2026-03-05 16:39:18.763247 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:39:18.763454 | aio | Thursday 05 March 2026 16:39:18 +0000 (0:00:00.337) 0:00:04.073 ******** 2026-03-05 16:39:20.955941 | aio | ok: [aio] 2026-03-05 16:39:20.956108 | aio | 2026-03-05 16:39:20.956322 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:39:20.956530 | aio | Thursday 05 March 2026 16:39:20 +0000 (0:00:02.192) 0:00:06.266 ******** 2026-03-05 16:39:20.986327 | aio | skipping: [aio] 2026-03-05 16:39:20.986534 | aio | 2026-03-05 16:39:20.986748 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:39:20.986950 | aio | Thursday 05 March 2026 16:39:20 +0000 (0:00:00.030) 0:00:06.297 ******** 2026-03-05 16:39:21.016099 | aio | skipping: [aio] 2026-03-05 16:39:21.016283 | aio | 2026-03-05 16:39:21.016504 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:39:21.016712 | aio | Thursday 05 March 2026 16:39:21 +0000 (0:00:00.029) 0:00:06.327 ******** 2026-03-05 16:39:21.046327 | aio | skipping: [aio] 2026-03-05 16:39:21.046543 | aio | 2026-03-05 16:39:21.046756 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:39:21.046959 | aio | Thursday 05 March 2026 16:39:21 +0000 (0:00:00.030) 0:00:06.357 ******** 2026-03-05 16:39:22.021453 | aio | ok: [aio] 2026-03-05 16:39:22.021523 | aio | 2026-03-05 16:39:22.021661 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:39:22.021793 | aio | Thursday 05 March 2026 16:39:22 +0000 (0:00:00.975) 0:00:07.332 ******** 2026-03-05 16:39:22.447820 | aio | ok: [aio] 2026-03-05 16:39:22.447981 | aio | 2026-03-05 16:39:22.448197 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:39:22.448400 | aio | Thursday 05 March 2026 16:39:22 +0000 (0:00:00.426) 0:00:07.758 ******** 2026-03-05 16:39:23.350354 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:39:23.350446 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:39:23.350461 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:39:23.350471 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:39:23.350481 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:39:23.350490 | aio | 2026-03-05 16:39:23.350500 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:39:23.350509 | aio | Thursday 05 March 2026 16:39:23 +0000 (0:00:00.900) 0:00:08.659 ******** 2026-03-05 16:39:23.836984 | aio | ok: [aio] 2026-03-05 16:39:23.837063 | aio | 2026-03-05 16:39:23.837508 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:39:23.837540 | aio | Thursday 05 March 2026 16:39:23 +0000 (0:00:00.478) 0:00:09.138 ******** 2026-03-05 16:39:23.837551 | aio | 2026-03-05 16:39:23.837560 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:39:23.837574 | aio | Thursday 05 March 2026 16:39:23 +0000 (0:00:00.009) 0:00:09.148 ******** 2026-03-05 16:39:24.415850 | aio | ok: [aio] 2026-03-05 16:39:24.416005 | aio | 2026-03-05 16:39:24.416221 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:39:24.416427 | aio | Thursday 05 March 2026 16:39:24 +0000 (0:00:00.578) 0:00:09.726 ******** 2026-03-05 16:39:24.615206 | aio | ok: [aio] 2026-03-05 16:39:24.615373 | aio | 2026-03-05 16:39:24.615593 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:39:24.615832 | aio | Thursday 05 March 2026 16:39:24 +0000 (0:00:00.199) 0:00:09.926 ******** 2026-03-05 16:39:24.680374 | aio | ok: [aio] => { 2026-03-05 16:39:24.680576 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:39:24.680763 | aio | } 2026-03-05 16:39:24.680963 | aio | 2026-03-05 16:39:24.681657 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:39:24.681881 | aio | Thursday 05 March 2026 16:39:24 +0000 (0:00:00.065) 0:00:09.991 ******** 2026-03-05 16:39:25.029091 | aio | ok: [aio] 2026-03-05 16:39:25.029158 | aio | 2026-03-05 16:39:25.029249 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:39:25.029348 | aio | Thursday 05 March 2026 16:39:25 +0000 (0:00:00.349) 0:00:10.340 ******** 2026-03-05 16:39:28.062010 | aio | ok: [aio] 2026-03-05 16:39:28.062188 | aio | 2026-03-05 16:39:28.062482 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:39:28.062726 | aio | Thursday 05 March 2026 16:39:28 +0000 (0:00:03.032) 0:00:13.373 ******** 2026-03-05 16:39:29.018026 | aio | ok: [aio] 2026-03-05 16:39:29.018331 | aio | 2026-03-05 16:39:29.018684 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:39:29.018980 | aio | Thursday 05 March 2026 16:39:29 +0000 (0:00:00.955) 0:00:14.328 ******** 2026-03-05 16:39:29.284545 | aio | ok: [aio] 2026-03-05 16:39:29.284743 | aio | 2026-03-05 16:39:29.284989 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:39:29.285207 | aio | Thursday 05 March 2026 16:39:29 +0000 (0:00:00.266) 0:00:14.595 ******** 2026-03-05 16:39:29.704171 | aio | ok: [aio] 2026-03-05 16:39:29.704343 | aio | 2026-03-05 16:39:29.704565 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:39:29.704773 | aio | Thursday 05 March 2026 16:39:29 +0000 (0:00:00.419) 0:00:15.015 ******** 2026-03-05 16:39:30.241922 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:39:30.242036 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:39:30.242179 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:39:30.242304 | aio | 2026-03-05 16:39:30.242459 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:39:30.242599 | aio | Thursday 05 March 2026 16:39:30 +0000 (0:00:00.537) 0:00:15.553 ******** 2026-03-05 16:39:30.646016 | aio | ok: [aio] 2026-03-05 16:39:30.646314 | aio | 2026-03-05 16:39:30.646327 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:39:30.646337 | aio | Thursday 05 March 2026 16:39:30 +0000 (0:00:00.403) 0:00:15.956 ******** 2026-03-05 16:39:31.041614 | aio | ok: [aio] 2026-03-05 16:39:31.041676 | aio | 2026-03-05 16:39:31.041734 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:39:31.042095 | aio | Thursday 05 March 2026 16:39:31 +0000 (0:00:00.389) 0:00:16.346 ******** 2026-03-05 16:39:31.042111 | aio | 2026-03-05 16:39:31.042116 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:39:31.042120 | aio | Thursday 05 March 2026 16:39:31 +0000 (0:00:00.006) 0:00:16.353 ******** 2026-03-05 16:39:31.373899 | aio | ok: [aio] 2026-03-05 16:39:31.373977 | aio | 2026-03-05 16:39:31.374042 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:39:31.374161 | aio | Thursday 05 March 2026 16:39:31 +0000 (0:00:00.332) 0:00:16.685 ******** 2026-03-05 16:39:31.414666 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:39:31.414746 | aio | 2026-03-05 16:39:31.414974 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:39:31.415023 | aio | Thursday 05 March 2026 16:39:31 +0000 (0:00:00.040) 0:00:16.726 ******** 2026-03-05 16:39:32.392760 | aio | ok: [aio] 2026-03-05 16:39:32.392831 | aio | 2026-03-05 16:39:32.393055 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:39:32.393071 | aio | Thursday 05 March 2026 16:39:32 +0000 (0:00:00.977) 0:00:17.704 ******** 2026-03-05 16:39:33.031631 | aio | ok: [aio] => (item=chronyd) 2026-03-05 16:39:33.031699 | aio | ok: [aio] => (item=sshd) 2026-03-05 16:39:33.031792 | aio | 2026-03-05 16:39:33.031986 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:39:33.032024 | aio | Thursday 05 March 2026 16:39:33 +0000 (0:00:00.639) 0:00:18.343 ******** 2026-03-05 16:39:33.300257 | aio | ok: [aio] 2026-03-05 16:39:33.300482 | aio | 2026-03-05 16:39:33.300496 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:39:33.300525 | aio | Thursday 05 March 2026 16:39:33 +0000 (0:00:00.268) 0:00:18.611 ******** 2026-03-05 16:39:33.493755 | aio | ok: [aio] 2026-03-05 16:39:33.493895 | aio | 2026-03-05 16:39:33.494043 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:39:33.494176 | aio | Thursday 05 March 2026 16:39:33 +0000 (0:00:00.193) 0:00:18.804 ******** 2026-03-05 16:39:33.875715 | aio | ok: [aio] 2026-03-05 16:39:33.875879 | aio | 2026-03-05 16:39:33.876101 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:39:33.876306 | aio | Thursday 05 March 2026 16:39:33 +0000 (0:00:00.381) 0:00:19.186 ******** 2026-03-05 16:39:34.229042 | aio | ok: [aio] 2026-03-05 16:39:34.229263 | aio | 2026-03-05 16:39:34.229492 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:39:34.229708 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.353) 0:00:19.540 ******** 2026-03-05 16:39:34.292969 | aio | ok: [aio] 2026-03-05 16:39:34.293143 | aio | 2026-03-05 16:39:34.293489 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:39:34.293698 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.063) 0:00:19.604 ******** 2026-03-05 16:39:34.507809 | aio | ok: [aio] => (item=aio) 2026-03-05 16:39:34.508065 | aio | 2026-03-05 16:39:34.508426 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:39:34.508714 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.214) 0:00:19.819 ******** 2026-03-05 16:39:34.552341 | aio | ok: [aio] 2026-03-05 16:39:34.552518 | aio | 2026-03-05 16:39:34.552727 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:39:34.552932 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.044) 0:00:19.863 ******** 2026-03-05 16:39:34.593791 | aio | skipping: [aio] 2026-03-05 16:39:34.593987 | aio | 2026-03-05 16:39:34.594189 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:39:34.594573 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.041) 0:00:19.905 ******** 2026-03-05 16:39:34.655115 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:39:34.655268 | aio | 2026-03-05 16:39:34.655484 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:39:34.655686 | aio | Thursday 05 March 2026 16:39:34 +0000 (0:00:00.061) 0:00:19.966 ******** 2026-03-05 16:39:40.880792 | aio | ok: [aio] 2026-03-05 16:39:40.880960 | aio | 2026-03-05 16:39:40.881291 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:39:40.881350 | aio | Thursday 05 March 2026 16:39:40 +0000 (0:00:06.225) 0:00:26.191 ******** 2026-03-05 16:39:40.929513 | aio | ok: [aio] => (item=aio) 2026-03-05 16:39:40.929625 | aio | 2026-03-05 16:39:40.929766 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:39:40.929946 | aio | Thursday 05 March 2026 16:39:40 +0000 (0:00:00.049) 0:00:26.240 ******** 2026-03-05 16:39:41.300581 | aio | ok: [aio] 2026-03-05 16:39:41.300653 | aio | 2026-03-05 16:39:41.300864 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:39:41.300909 | aio | Thursday 05 March 2026 16:39:41 +0000 (0:00:00.370) 0:00:26.611 ******** 2026-03-05 16:39:47.820260 | aio | ok: [aio] 2026-03-05 16:39:47.820375 | aio | 2026-03-05 16:39:47.820389 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:39:47.820450 | aio | Thursday 05 March 2026 16:39:47 +0000 (0:00:06.519) 0:00:33.131 ******** 2026-03-05 16:39:54.022695 | aio | ok: [aio] 2026-03-05 16:39:54.022783 | aio | 2026-03-05 16:39:54.022981 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:39:54.023031 | aio | Thursday 05 March 2026 16:39:54 +0000 (0:00:06.202) 0:00:39.334 ******** 2026-03-05 16:40:08.229227 | aio | ok: [aio] 2026-03-05 16:40:08.229317 | aio | 2026-03-05 16:40:08.229332 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:40:08.229477 | aio | Thursday 05 March 2026 16:40:08 +0000 (0:00:14.206) 0:00:53.540 ******** 2026-03-05 16:40:08.292793 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:40:08.292865 | aio | 2026-03-05 16:40:08.292931 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:40:08.293096 | aio | Thursday 05 March 2026 16:40:08 +0000 (0:00:00.063) 0:00:53.604 ******** 2026-03-05 16:40:08.335658 | aio | skipping: [aio] 2026-03-05 16:40:08.335726 | aio | 2026-03-05 16:40:08.335970 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:40:08.336018 | aio | Thursday 05 March 2026 16:40:08 +0000 (0:00:00.042) 0:00:53.647 ******** 2026-03-05 16:40:08.375546 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:40:08.375642 | aio | skipping: [aio] 2026-03-05 16:40:08.375755 | aio | 2026-03-05 16:40:08.376040 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:40:08.376062 | aio | Thursday 05 March 2026 16:40:08 +0000 (0:00:00.040) 0:00:53.687 ******** 2026-03-05 16:40:08.623053 | aio | ok: [aio] 2026-03-05 16:40:08.623122 | aio | 2026-03-05 16:40:08.623339 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:40:08.623380 | aio | Thursday 05 March 2026 16:40:08 +0000 (0:00:00.247) 0:00:53.934 ******** 2026-03-05 16:40:15.169625 | aio | ok: [aio] 2026-03-05 16:40:15.169699 | aio | 2026-03-05 16:40:15.169990 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:40:15.170047 | aio | Thursday 05 March 2026 16:40:15 +0000 (0:00:06.546) 0:01:00.480 ******** 2026-03-05 16:40:21.355160 | aio | ok: [aio] 2026-03-05 16:40:21.355228 | aio | 2026-03-05 16:40:21.355348 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:40:21.355494 | aio | Thursday 05 March 2026 16:40:21 +0000 (0:00:06.185) 0:01:06.666 ******** 2026-03-05 16:40:27.532703 | aio | ok: [aio] 2026-03-05 16:40:27.532770 | aio | 2026-03-05 16:40:27.532981 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:40:27.533027 | aio | Thursday 05 March 2026 16:40:27 +0000 (0:00:06.177) 0:01:12.843 ******** 2026-03-05 16:40:35.729131 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:40:35.729226 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 16:40:35.730099 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-05 16:40:35.730155 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 16:40:35.730163 | aio | 2026-03-05 16:40:35.730169 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:40:35.730175 | aio | 2026-03-05 16:40:35.730181 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:40:35.730187 | aio | Thursday 05 March 2026 16:40:35 +0000 (0:00:08.196) 0:01:21.040 ******** 2026-03-05 16:40:36.630183 | aio | ok: [aio] 2026-03-05 16:40:36.630223 | aio | 2026-03-05 16:40:36.630229 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:36.630234 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.900) 0:01:21.941 ******** 2026-03-05 16:40:36.835483 | aio | ok: [aio] 2026-03-05 16:40:36.835549 | aio | 2026-03-05 16:40:36.835813 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:36.835895 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.205) 0:01:22.146 ******** 2026-03-05 16:40:36.876302 | aio | skipping: [aio] 2026-03-05 16:40:36.876421 | aio | 2026-03-05 16:40:36.876436 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:40:36.876532 | aio | Thursday 05 March 2026 16:40:36 +0000 (0:00:00.041) 0:01:22.187 ******** 2026-03-05 16:40:37.100077 | aio | ok: [aio] 2026-03-05 16:40:37.100155 | aio | 2026-03-05 16:40:37.100434 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:37.100512 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.223) 0:01:22.411 ******** 2026-03-05 16:40:37.176002 | aio | ok: [aio] => { 2026-03-05 16:40:37.176123 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:40:37.176130 | aio | } 2026-03-05 16:40:37.176347 | aio | 2026-03-05 16:40:37.176414 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:37.176434 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.076) 0:01:22.487 ******** 2026-03-05 16:40:37.506262 | aio | ok: [aio] 2026-03-05 16:40:37.506324 | aio | 2026-03-05 16:40:37.506529 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:37.506573 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.329) 0:01:22.817 ******** 2026-03-05 16:40:37.542212 | aio | skipping: [aio] 2026-03-05 16:40:37.542296 | aio | 2026-03-05 16:40:37.542511 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:37.542576 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.036) 0:01:22.853 ******** 2026-03-05 16:40:37.575784 | aio | skipping: [aio] 2026-03-05 16:40:37.575852 | aio | 2026-03-05 16:40:37.575887 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:37.575995 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.033) 0:01:22.887 ******** 2026-03-05 16:40:37.772403 | aio | ok: [aio] 2026-03-05 16:40:37.772456 | aio | 2026-03-05 16:40:37.772553 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:40:37.772684 | aio | Thursday 05 March 2026 16:40:37 +0000 (0:00:00.196) 0:01:23.083 ******** 2026-03-05 16:40:38.722291 | aio | ok: [aio] 2026-03-05 16:40:38.722369 | aio | 2026-03-05 16:40:38.722610 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:38.722816 | aio | Thursday 05 March 2026 16:40:38 +0000 (0:00:00.949) 0:01:24.033 ******** 2026-03-05 16:40:38.788224 | aio | ok: [aio] => { 2026-03-05 16:40:38.788866 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:40:38.788908 | aio | } 2026-03-05 16:40:38.788916 | aio | 2026-03-05 16:40:38.788922 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:38.788929 | aio | Thursday 05 March 2026 16:40:38 +0000 (0:00:00.065) 0:01:24.099 ******** 2026-03-05 16:40:39.126059 | aio | ok: [aio] 2026-03-05 16:40:39.126129 | aio | 2026-03-05 16:40:39.126188 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:39.126312 | aio | Thursday 05 March 2026 16:40:39 +0000 (0:00:00.337) 0:01:24.437 ******** 2026-03-05 16:40:41.048344 | aio | ok: [aio] 2026-03-05 16:40:41.048414 | aio | 2026-03-05 16:40:41.048486 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:40:41.048611 | aio | Thursday 05 March 2026 16:40:41 +0000 (0:00:01.922) 0:01:26.359 ******** 2026-03-05 16:40:41.074274 | aio | skipping: [aio] 2026-03-05 16:40:41.074587 | aio | 2026-03-05 16:40:41.074722 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:40:41.074735 | aio | Thursday 05 March 2026 16:40:41 +0000 (0:00:00.025) 0:01:26.385 ******** 2026-03-05 16:40:41.098934 | aio | skipping: [aio] 2026-03-05 16:40:41.098995 | aio | 2026-03-05 16:40:41.099063 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:40:41.099197 | aio | Thursday 05 March 2026 16:40:41 +0000 (0:00:00.024) 0:01:26.410 ******** 2026-03-05 16:40:41.128261 | aio | skipping: [aio] 2026-03-05 16:40:41.128607 | aio | 2026-03-05 16:40:41.128686 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:40:41.128693 | aio | Thursday 05 March 2026 16:40:41 +0000 (0:00:00.028) 0:01:26.439 ******** 2026-03-05 16:40:42.137061 | aio | ok: [aio] 2026-03-05 16:40:42.137328 | aio | 2026-03-05 16:40:42.137340 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:40:42.137459 | aio | Thursday 05 March 2026 16:40:42 +0000 (0:00:01.009) 0:01:27.448 ******** 2026-03-05 16:40:42.559177 | aio | ok: [aio] 2026-03-05 16:40:42.559241 | aio | 2026-03-05 16:40:42.559340 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:40:42.559474 | aio | Thursday 05 March 2026 16:40:42 +0000 (0:00:00.422) 0:01:27.870 ******** 2026-03-05 16:40:43.478918 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 16:40:43.479040 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:40:43.479894 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:40:43.479978 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:40:43.479989 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:40:43.479997 | aio | 2026-03-05 16:40:43.480004 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:40:43.480011 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:00.919) 0:01:28.789 ******** 2026-03-05 16:40:43.964569 | aio | ok: [aio] 2026-03-05 16:40:43.964666 | aio | 2026-03-05 16:40:43.964679 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:40:43.965077 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:00.478) 0:01:29.268 ******** 2026-03-05 16:40:43.965149 | aio | 2026-03-05 16:40:43.965162 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:40:43.965167 | aio | Thursday 05 March 2026 16:40:43 +0000 (0:00:00.006) 0:01:29.275 ******** 2026-03-05 16:40:44.329549 | aio | ok: [aio] 2026-03-05 16:40:44.329634 | aio | 2026-03-05 16:40:44.329651 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:40:44.329788 | aio | Thursday 05 March 2026 16:40:44 +0000 (0:00:00.364) 0:01:29.640 ******** 2026-03-05 16:40:44.537865 | aio | ok: [aio] 2026-03-05 16:40:44.537934 | aio | 2026-03-05 16:40:44.538224 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:40:44.538246 | aio | Thursday 05 March 2026 16:40:44 +0000 (0:00:00.208) 0:01:29.848 ******** 2026-03-05 16:40:44.601547 | aio | ok: [aio] => { 2026-03-05 16:40:44.601621 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:40:44.601675 | aio | } 2026-03-05 16:40:44.601985 | aio | 2026-03-05 16:40:44.602031 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:40:44.602037 | aio | Thursday 05 March 2026 16:40:44 +0000 (0:00:00.063) 0:01:29.912 ******** 2026-03-05 16:40:44.954821 | aio | ok: [aio] 2026-03-05 16:40:44.954923 | aio | 2026-03-05 16:40:44.955260 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:40:44.955318 | aio | Thursday 05 March 2026 16:40:44 +0000 (0:00:00.353) 0:01:30.266 ******** 2026-03-05 16:40:47.986909 | aio | ok: [aio] 2026-03-05 16:40:47.986988 | aio | 2026-03-05 16:40:47.987179 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:40:47.987222 | aio | Thursday 05 March 2026 16:40:47 +0000 (0:00:03.032) 0:01:33.298 ******** 2026-03-05 16:40:48.944957 | aio | ok: [aio] 2026-03-05 16:40:48.945044 | aio | 2026-03-05 16:40:48.945274 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:40:48.945341 | aio | Thursday 05 March 2026 16:40:48 +0000 (0:00:00.957) 0:01:34.256 ******** 2026-03-05 16:40:49.134102 | aio | ok: [aio] 2026-03-05 16:40:49.134167 | aio | 2026-03-05 16:40:49.134268 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:40:49.134391 | aio | Thursday 05 March 2026 16:40:49 +0000 (0:00:00.189) 0:01:34.445 ******** 2026-03-05 16:40:49.586338 | aio | ok: [aio] 2026-03-05 16:40:49.586828 | aio | 2026-03-05 16:40:49.586842 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:40:49.586848 | aio | Thursday 05 March 2026 16:40:49 +0000 (0:00:00.447) 0:01:34.893 ******** 2026-03-05 16:40:50.156903 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 16:40:50.157039 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:40:50.157622 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:40:50.157680 | aio | 2026-03-05 16:40:50.157688 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:40:50.157695 | aio | Thursday 05 March 2026 16:40:50 +0000 (0:00:00.574) 0:01:35.467 ******** 2026-03-05 16:40:50.570814 | aio | ok: [aio] 2026-03-05 16:40:50.571249 | aio | 2026-03-05 16:40:50.571546 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:40:50.571555 | aio | Thursday 05 March 2026 16:40:50 +0000 (0:00:00.414) 0:01:35.881 ******** 2026-03-05 16:40:51.003812 | aio | ok: [aio] 2026-03-05 16:40:51.003883 | aio | 2026-03-05 16:40:51.004420 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:40:51.004505 | aio | Thursday 05 March 2026 16:40:50 +0000 (0:00:00.427) 0:01:36.309 ******** 2026-03-05 16:40:51.004511 | aio | 2026-03-05 16:40:51.004516 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:40:51.004520 | aio | Thursday 05 March 2026 16:40:51 +0000 (0:00:00.005) 0:01:36.314 ******** 2026-03-05 16:40:51.355362 | aio | ok: [aio] 2026-03-05 16:40:51.355435 | aio | 2026-03-05 16:40:51.355497 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:40:51.355651 | aio | Thursday 05 March 2026 16:40:51 +0000 (0:00:00.351) 0:01:36.666 ******** 2026-03-05 16:40:51.403611 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 16:40:51.404022 | aio | 2026-03-05 16:40:51.404057 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:40:51.404065 | aio | Thursday 05 March 2026 16:40:51 +0000 (0:00:00.048) 0:01:36.714 ******** 2026-03-05 16:40:52.368316 | aio | ok: [aio] 2026-03-05 16:40:52.368423 | aio | 2026-03-05 16:40:52.368439 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:40:52.368592 | aio | Thursday 05 March 2026 16:40:52 +0000 (0:00:00.965) 0:01:37.679 ******** 2026-03-05 16:40:53.006983 | aio | ok: [aio] => (item=chronyd) 2026-03-05 16:40:53.007063 | aio | ok: [aio] => (item=sshd) 2026-03-05 16:40:53.007070 | aio | 2026-03-05 16:40:53.007076 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:40:53.007082 | aio | Thursday 05 March 2026 16:40:53 +0000 (0:00:00.637) 0:01:38.317 ******** 2026-03-05 16:40:53.433065 | aio | ok: [aio] 2026-03-05 16:40:53.433150 | aio | 2026-03-05 16:40:53.433458 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:40:53.433521 | aio | Thursday 05 March 2026 16:40:53 +0000 (0:00:00.426) 0:01:38.744 ******** 2026-03-05 16:40:53.635193 | aio | ok: [aio] 2026-03-05 16:40:53.635279 | aio | 2026-03-05 16:40:53.635295 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:40:53.635444 | aio | Thursday 05 March 2026 16:40:53 +0000 (0:00:00.202) 0:01:38.946 ******** 2026-03-05 16:40:53.872599 | aio | ok: [aio] 2026-03-05 16:40:53.872655 | aio | 2026-03-05 16:40:53.872663 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:40:53.872670 | aio | Thursday 05 March 2026 16:40:53 +0000 (0:00:00.236) 0:01:39.183 ******** 2026-03-05 16:40:54.076641 | aio | ok: [aio] 2026-03-05 16:40:54.076690 | aio | 2026-03-05 16:40:54.076695 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:40:54.076700 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.204) 0:01:39.387 ******** 2026-03-05 16:40:54.293596 | aio | ok: [aio] => (item=aio) 2026-03-05 16:40:54.293659 | aio | 2026-03-05 16:40:54.293903 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:40:54.293981 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.216) 0:01:39.604 ******** 2026-03-05 16:40:54.337760 | aio | ok: [aio] 2026-03-05 16:40:54.337870 | aio | 2026-03-05 16:40:54.338200 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:40:54.338259 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.043) 0:01:39.648 ******** 2026-03-05 16:40:54.396960 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 16:40:54.397002 | aio | 2026-03-05 16:40:54.397242 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:40:54.397294 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.059) 0:01:39.708 ******** 2026-03-05 16:40:54.438780 | aio | skipping: [aio] 2026-03-05 16:40:54.439189 | aio | 2026-03-05 16:40:54.439217 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:40:54.439226 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.041) 0:01:39.749 ******** 2026-03-05 16:40:54.484321 | aio | skipping: [aio] => (item=aio) 2026-03-05 16:40:54.484838 | aio | skipping: [aio] 2026-03-05 16:40:54.484869 | aio | 2026-03-05 16:40:54.484877 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:40:54.484885 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.045) 0:01:39.795 ******** 2026-03-05 16:40:54.744000 | aio | ok: [aio] 2026-03-05 16:40:54.744098 | aio | 2026-03-05 16:40:54.744349 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:40:54.744401 | aio | Thursday 05 March 2026 16:40:54 +0000 (0:00:00.259) 0:01:40.055 ******** 2026-03-05 16:41:01.339175 | aio | ok: [aio] 2026-03-05 16:41:01.339252 | aio | 2026-03-05 16:41:01.339324 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:41:01.339416 | aio | Thursday 05 March 2026 16:41:01 +0000 (0:00:06.595) 0:01:46.650 ******** 2026-03-05 16:41:06.852251 | aio | ok: [aio] 2026-03-05 16:41:06.852302 | aio | 2026-03-05 16:41:06.852307 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:41:06.852313 | aio | Thursday 05 March 2026 16:41:06 +0000 (0:00:05.512) 0:01:52.163 ******** 2026-03-05 16:41:21.260360 | aio | ok: [aio] 2026-03-05 16:41:21.260447 | aio | 2026-03-05 16:41:21.260506 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:41:21.260621 | aio | Thursday 05 March 2026 16:41:21 +0000 (0:00:14.408) 0:02:06.571 ******** 2026-03-05 16:41:21.318661 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 16:41:21.318744 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 16:41:21.319210 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 16:41:21.319231 | aio | skipping: [aio] 2026-03-05 16:41:21.319237 | aio | 2026-03-05 16:41:21.319242 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:41:21.319247 | aio | Thursday 05 March 2026 16:41:21 +0000 (0:00:00.058) 0:02:06.629 ******** 2026-03-05 16:41:27.539721 | aio | ok: [aio] 2026-03-05 16:41:27.539802 | aio | 2026-03-05 16:41:27.540035 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:41:27.540083 | aio | Thursday 05 March 2026 16:41:27 +0000 (0:00:06.221) 0:02:12.850 ******** 2026-03-05 16:41:33.682044 | aio | ok: [aio] 2026-03-05 16:41:33.682125 | aio | 2026-03-05 16:41:33.682187 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:41:33.682300 | aio | Thursday 05 March 2026 16:41:33 +0000 (0:00:06.142) 0:02:18.993 ******** 2026-03-05 16:41:33.733269 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 16:41:33.733344 | aio | 2026-03-05 16:41:33.733566 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:41:33.733618 | aio | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.051) 0:02:19.044 ******** 2026-03-05 16:41:33.771431 | aio | ok: [aio] 2026-03-05 16:41:33.771500 | aio | 2026-03-05 16:41:33.771786 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:41:33.771819 | aio | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.038) 0:02:19.082 ******** 2026-03-05 16:41:39.912053 | aio | ok: [aio] 2026-03-05 16:41:39.912121 | aio | 2026-03-05 16:41:39.912342 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:41:39.912414 | aio | Thursday 05 March 2026 16:41:39 +0000 (0:00:06.140) 0:02:25.223 ******** 2026-03-05 16:41:39.947215 | aio | ok: [aio] 2026-03-05 16:41:39.947296 | aio | 2026-03-05 16:41:39.947524 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:41:39.947571 | aio | Thursday 05 March 2026 16:41:39 +0000 (0:00:00.034) 0:02:25.258 ******** 2026-03-05 16:41:39.991285 | aio | skipping: [aio] => (item=1) 2026-03-05 16:41:39.991351 | aio | skipping: [aio] => (item=1) 2026-03-05 16:41:39.991781 | aio | skipping: [aio] => (item=1) 2026-03-05 16:41:39.991800 | aio | skipping: [aio] 2026-03-05 16:41:39.991805 | aio | 2026-03-05 16:41:39.991810 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:41:39.991815 | aio | Thursday 05 March 2026 16:41:39 +0000 (0:00:00.044) 0:02:25.302 ******** 2026-03-05 16:41:40.021354 | aio | skipping: [aio] 2026-03-05 16:41:40.022526 | aio | 2026-03-05 16:41:40.022563 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:41:40.022575 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-05 16:41:40.022584 | aio | 2026-03-05 16:41:40.022593 | aio | 2026-03-05 16:41:40.022602 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:41:40.022611 | aio | Thursday 05 March 2026 16:41:40 +0000 (0:00:00.030) 0:02:25.332 ******** 2026-03-05 16:41:40.022620 | aio | =============================================================================== 2026-03-05 16:41:40.022628 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.41s 2026-03-05 16:41:40.022637 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.21s 2026-03-05 16:41:40.022646 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.20s 2026-03-05 16:41:40.022654 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.60s 2026-03-05 16:41:40.022663 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.55s 2026-03-05 16:41:40.022677 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.52s 2026-03-05 16:41:40.022688 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.23s 2026-03-05 16:41:40.023812 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.22s 2026-03-05 16:41:40.023881 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.20s 2026-03-05 16:41:40.023893 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.19s 2026-03-05 16:41:40.023902 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.18s 2026-03-05 16:41:40.023911 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.14s 2026-03-05 16:41:40.023920 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.14s 2026-03-05 16:41:40.023929 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.51s 2026-03-05 16:41:40.023938 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-03-05 16:41:40.023947 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-03-05 16:41:40.023956 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.19s 2026-03-05 16:41:40.023972 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.92s 2026-03-05 16:41:40.023981 | aio | Gathering Facts --------------------------------------------------------- 1.17s 2026-03-05 16:41:40.024022 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.09s 2026-03-05 16:41:40.117826 | aio | INFO [default > idempotence] Executed: Successful 2026-03-05 16:41:40.126759 | aio | INFO [default > side_effect] Executing 2026-03-05 16:41:40.127063 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:41:40.132048 | aio | INFO [default > verify] Executing 2026-03-05 16:41:40.715448 | aio | 2026-03-05 16:41:40.715634 | aio | PLAY [Verify] ****************************************************************** 2026-03-05 16:41:40.715850 | aio | 2026-03-05 16:41:40.716156 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:41:40.716513 | aio | Thursday 05 March 2026 16:41:40 +0000 (0:00:00.006) 0:00:00.006 ******** 2026-03-05 16:41:41.827322 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 16:41:41.827552 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 16:41:41.827789 | aio | interpreter could change the meaning of that path. See 2026-03-05 16:41:41.828016 | aio | https://docs.ansible.com/ansible- 2026-03-05 16:41:41.828246 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:41:41.836673 | aio | ok: [aio] 2026-03-05 16:41:41.836869 | aio | 2026-03-05 16:41:41.837139 | aio | TASK [Get cluster health status] *********************************************** 2026-03-05 16:41:41.837336 | aio | Thursday 05 March 2026 16:41:41 +0000 (0:00:01.121) 0:00:01.128 ******** 2026-03-05 16:41:52.104906 | aio | ok: [aio] 2026-03-05 16:41:52.105106 | aio | 2026-03-05 16:41:52.105358 | aio | TASK [Print cluster health status] ********************************************* 2026-03-05 16:41:52.105606 | aio | Thursday 05 March 2026 16:41:52 +0000 (0:00:10.267) 0:00:11.396 ******** 2026-03-05 16:41:52.131917 | aio | ok: [aio] => { 2026-03-05 16:41:52.132097 | aio | "_ceph_health": { 2026-03-05 16:41:52.132408 | aio | "changed": false, 2026-03-05 16:41:52.132630 | aio | "cmd": [ 2026-03-05 16:41:52.132823 | aio | "cephadm", 2026-03-05 16:41:52.133013 | aio | "shell", 2026-03-05 16:41:52.133215 | aio | "--", 2026-03-05 16:41:52.133442 | aio | "ceph", 2026-03-05 16:41:52.133631 | aio | "health" 2026-03-05 16:41:52.133873 | aio | ], 2026-03-05 16:41:52.134071 | aio | "delta": "0:00:10.006128", 2026-03-05 16:41:52.134288 | aio | "end": "2026-03-05 16:41:52.070860", 2026-03-05 16:41:52.134532 | aio | "failed": false, 2026-03-05 16:41:52.134719 | aio | "msg": "", 2026-03-05 16:41:52.134921 | aio | "rc": 0, 2026-03-05 16:41:52.135111 | aio | "start": "2026-03-05 16:41:42.064732", 2026-03-05 16:41:52.135371 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-05 16:41:52.135578 | aio | "stderr_lines": [ 2026-03-05 16:41:52.135776 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 16:41:52.135983 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-05 16:41:52.136170 | aio | ], 2026-03-05 16:41:52.136387 | aio | "stdout": "HEALTH_OK", 2026-03-05 16:41:52.136568 | aio | "stdout_lines": [ 2026-03-05 16:41:52.136750 | aio | "HEALTH_OK" 2026-03-05 16:41:52.136930 | aio | ] 2026-03-05 16:41:52.137240 | aio | } 2026-03-05 16:41:52.137518 | aio | } 2026-03-05 16:41:52.137728 | aio | 2026-03-05 16:41:52.137933 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 16:41:52.138128 | aio | Thursday 05 March 2026 16:41:52 +0000 (0:00:00.027) 0:00:11.423 ******** 2026-03-05 16:41:52.156168 | aio | ok: [aio] => { 2026-03-05 16:41:52.156358 | aio | "changed": false, 2026-03-05 16:41:52.156553 | aio | "msg": "All assertions passed" 2026-03-05 16:41:52.156791 | aio | } 2026-03-05 16:41:52.156983 | aio | 2026-03-05 16:41:52.157184 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 16:41:52.157410 | aio | Thursday 05 March 2026 16:41:52 +0000 (0:00:00.024) 0:00:11.447 ******** 2026-03-05 16:41:58.368634 | aio | changed: [aio] 2026-03-05 16:41:58.368722 | aio | 2026-03-05 16:41:58.368853 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-05 16:41:58.368980 | aio | Thursday 05 March 2026 16:41:58 +0000 (0:00:06.212) 0:00:17.659 ******** 2026-03-05 16:42:00.670894 | aio | changed: [aio] 2026-03-05 16:42:00.671076 | aio | 2026-03-05 16:42:00.671297 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 16:42:00.671505 | aio | Thursday 05 March 2026 16:42:00 +0000 (0:00:02.302) 0:00:19.961 ******** 2026-03-05 16:42:01.804407 | aio | ok: [aio] 2026-03-05 16:42:01.804451 | aio | 2026-03-05 16:42:01.804456 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 16:42:01.804461 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:01.133) 0:00:21.095 ******** 2026-03-05 16:42:01.835314 | aio | ok: [aio] => { 2026-03-05 16:42:01.835522 | aio | "changed": false, 2026-03-05 16:42:01.835708 | aio | "msg": "All assertions passed" 2026-03-05 16:42:01.835896 | aio | } 2026-03-05 16:42:01.836078 | aio | 2026-03-05 16:42:01.836309 | aio | PLAY RECAP ********************************************************************* 2026-03-05 16:42:01.836546 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:42:01.836712 | aio | 2026-03-05 16:42:01.836883 | aio | 2026-03-05 16:42:01.837066 | aio | TASKS RECAP ******************************************************************** 2026-03-05 16:42:01.837265 | aio | Thursday 05 March 2026 16:42:01 +0000 (0:00:00.031) 0:00:21.126 ******** 2026-03-05 16:42:01.837455 | aio | =============================================================================== 2026-03-05 16:42:01.837639 | aio | Get cluster health status ---------------------------------------------- 10.27s 2026-03-05 16:42:01.837843 | aio | Create a test Ceph pool ------------------------------------------------- 6.21s 2026-03-05 16:42:01.838032 | aio | Create a test Ceph key -------------------------------------------------- 2.30s 2026-03-05 16:42:01.838215 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.13s 2026-03-05 16:42:01.838449 | aio | Gathering Facts --------------------------------------------------------- 1.12s 2026-03-05 16:42:01.838649 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 16:42:01.838837 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 16:42:01.839026 | aio | Assert that the cluster status is healthy ------------------------------- 0.02s 2026-03-05 16:42:01.898067 | aio | INFO [default > verify] Executed: Successful 2026-03-05 16:42:01.903696 | aio | INFO [default > cleanup] Executing 2026-03-05 16:42:01.904010 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:42:01.908964 | aio | INFO [default > destroy] Executing 2026-03-05 16:42:01.909001 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:42:01.909076 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 16:42:01.909332 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 16:42:02.308833 | aio | ok: Runtime: 0:10:24.300408 2026-03-05 16:42:02.326485 | 2026-03-05 16:42:02.326686 | PLAY RECAP 2026-03-05 16:42:02.326801 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:42:02.326856 | 2026-03-05 16:42:02.438516 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:42:02.440300 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:42:03.120652 | 2026-03-05 16:42:03.120816 | PLAY [all] 2026-03-05 16:42:03.132656 | 2026-03-05 16:42:03.132736 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 16:42:03.188759 | aio | skipping: Conditional result was False 2026-03-05 16:42:03.201930 | 2026-03-05 16:42:03.202070 | TASK [fetch-output : Set log path for single node] 2026-03-05 16:42:03.245652 | aio | ok 2026-03-05 16:42:03.251455 | 2026-03-05 16:42:03.251528 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 16:42:03.694733 | aio -> localhost | ok: "/var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/logs" 2026-03-05 16:42:03.910569 | aio -> localhost | changed: "/var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/artifacts" 2026-03-05 16:42:04.101783 | aio -> localhost | changed: "/var/lib/zuul/builds/cffb314f5a8d49c6a37bd209106ccaa8/work/docs" 2026-03-05 16:42:04.121150 | 2026-03-05 16:42:04.121332 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 16:42:04.860246 | aio | ok 2026-03-05 16:42:04.860434 | aio | changed: All items complete 2026-03-05 16:42:04.860461 | 2026-03-05 16:42:05.332450 | aio | changed: .d..t...... ./ 2026-03-05 16:42:05.779246 | aio | changed: .d..t...... ./ 2026-03-05 16:42:05.802624 | 2026-03-05 16:42:05.802743 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 16:42:06.181426 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.006605 2026-03-05 16:42:06.423241 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008113 2026-03-05 16:42:06.443165 | 2026-03-05 16:42:06.443298 | PLAY [all] 2026-03-05 16:42:06.451396 | 2026-03-05 16:42:06.451463 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 16:42:06.871128 | aio | changed 2026-03-05 16:42:06.883425 | 2026-03-05 16:42:06.883504 | PLAY RECAP 2026-03-05 16:42:06.883563 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:42:06.883594 | 2026-03-05 16:42:06.999303 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:42:07.002732 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 16:42:07.524910 | 2026-03-05 16:42:07.525032 | PLAY [localhost] 2026-03-05 16:42:07.534289 | 2026-03-05 16:42:07.534362 | TASK [Generate Zuul manifest] 2026-03-05 16:42:07.554394 | localhost | ok 2026-03-05 16:42:07.579065 | 2026-03-05 16:42:07.579292 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 16:42:07.884894 | localhost | changed 2026-03-05 16:42:07.897627 | 2026-03-05 16:42:07.897704 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 16:42:08.020812 | localhost | ok 2026-03-05 16:42:08.027307 | 2026-03-05 16:42:08.027371 | TASK [Upload logs] 2026-03-05 16:42:08.047869 | localhost | ok 2026-03-05 16:42:08.109269 | 2026-03-05 16:42:08.109392 | TASK [Set zuul-log-path fact] 2026-03-05 16:42:08.127606 | localhost | ok 2026-03-05 16:42:08.139845 | 2026-03-05 16:42:08.139910 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:42:08.169765 | localhost | ok 2026-03-05 16:42:08.178787 | 2026-03-05 16:42:08.178872 | TASK [upload-logs : Create log directories] 2026-03-05 16:42:08.620322 | localhost | changed 2026-03-05 16:42:08.626707 | 2026-03-05 16:42:08.626774 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 16:42:09.059267 | localhost -> localhost | ok: Runtime: 0:00:00.004444 2026-03-05 16:42:09.067413 | 2026-03-05 16:42:09.067520 | TASK [upload-logs : Upload logs to log server] 2026-03-05 16:42:09.507410 | localhost | Output suppressed because no_log was given 2026-03-05 16:42:09.513749 | 2026-03-05 16:42:09.513896 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 16:42:09.563222 | localhost | skipping: Conditional result was False 2026-03-05 16:42:09.571429 | localhost | skipping: Conditional result was False 2026-03-05 16:42:09.590810 | 2026-03-05 16:42:09.591017 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 16:42:09.634321 | localhost | skipping: Conditional result was False 2026-03-05 16:42:09.634691 | 2026-03-05 16:42:09.638492 | localhost | skipping: Conditional result was False 2026-03-05 16:42:09.658859 | 2026-03-05 16:42:09.659079 | LOOP [upload-logs : Upload console log and json output]