2026-05-19 14:20:32.131635 | Job console starting 2026-05-19 14:20:32.142817 | Updating git repos 2026-05-19 14:20:32.174925 | Cloning repos into workspace 2026-05-19 14:20:33.143209 | Restoring repo states 2026-05-19 14:20:33.156461 | Merging changes 2026-05-19 14:20:33.813593 | Checking out repos 2026-05-19 14:20:34.031182 | Preparing playbooks 2026-05-19 14:20:39.316833 | Running Ansible setup 2026-05-19 14:20:42.901052 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-19 14:20:43.613771 | 2026-05-19 14:20:43.613925 | PLAY [localhost] 2026-05-19 14:20:43.622113 | 2026-05-19 14:20:43.622191 | TASK [Gathering Facts] 2026-05-19 14:20:44.724918 | localhost | ok 2026-05-19 14:20:44.738069 | 2026-05-19 14:20:44.738188 | TASK [Setup log path fact] 2026-05-19 14:20:44.765018 | localhost | ok 2026-05-19 14:20:44.778640 | 2026-05-19 14:20:44.778914 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-19 14:20:44.807126 | localhost | ok 2026-05-19 14:20:44.814181 | 2026-05-19 14:20:44.814255 | TASK [emit-job-header : Print job information] 2026-05-19 14:20:44.853530 | # Job Information 2026-05-19 14:20:44.853981 | Ansible Version: 2.16.18 2026-05-19 14:20:44.854152 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-05-19 14:20:44.854285 | Pipeline: check 2026-05-19 14:20:44.854408 | Executor: 2d72f0692154 2026-05-19 14:20:44.854644 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/107 2026-05-19 14:20:44.854913 | Event ID: b72b2bf0-538d-11f1-9b1b-15748ebea502 2026-05-19 14:20:44.859103 | 2026-05-19 14:20:44.859177 | LOOP [emit-job-header : Print node information] 2026-05-19 14:20:44.967156 | localhost | ok: 2026-05-19 14:20:44.967358 | localhost | # Node Information 2026-05-19 14:20:44.967386 | localhost | Inventory Hostname: aio 2026-05-19 14:20:44.967409 | localhost | Hostname: np0000174807 2026-05-19 14:20:44.967429 | localhost | Username: zuul 2026-05-19 14:20:44.967453 | localhost | Distro: Ubuntu 22.04 2026-05-19 14:20:44.967472 | localhost | Provider: yul1 2026-05-19 14:20:44.967492 | localhost | Region: ca-ymq-1 2026-05-19 14:20:44.967511 | localhost | Label: ubuntu-jammy 2026-05-19 14:20:44.967529 | localhost | Product Name: OpenStack Nova 2026-05-19 14:20:44.967547 | localhost | Interface IP: 199.204.45.235 2026-05-19 14:20:44.982479 | 2026-05-19 14:20:44.982638 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-05-19 14:20:45.402097 | localhost -> localhost | changed 2026-05-19 14:20:45.407593 | 2026-05-19 14:20:45.407665 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-05-19 14:20:46.731867 | localhost -> localhost | changed 2026-05-19 14:20:46.742929 | 2026-05-19 14:20:46.743029 | PLAY [all] 2026-05-19 14:20:46.754724 | 2026-05-19 14:20:46.754844 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-05-19 14:20:46.993440 | aio -> localhost | ok 2026-05-19 14:20:47.003370 | 2026-05-19 14:20:47.003459 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-05-19 14:20:47.035328 | aio | ok 2026-05-19 14:20:47.692989 | aio | included: /var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-05-19 14:20:47.698907 | 2026-05-19 14:20:47.698973 | TASK [add-build-sshkey : Create Temp SSH key] 2026-05-19 14:20:48.385118 | aio -> localhost | Generating public/private rsa key pair. 2026-05-19 14:20:48.385328 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/8250f3ef21fc481ead896b8fcc2bf21d_id_rsa 2026-05-19 14:20:48.385372 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/8250f3ef21fc481ead896b8fcc2bf21d_id_rsa.pub 2026-05-19 14:20:48.385405 | aio -> localhost | The key fingerprint is: 2026-05-19 14:20:48.385435 | aio -> localhost | SHA256:7lRPEZ9ubA75gL3TJEwSjTvBGEYLWCQrKYSH24FoGNo zuul-build-sshkey 2026-05-19 14:20:48.385481 | aio -> localhost | The key's randomart image is: 2026-05-19 14:20:48.385511 | aio -> localhost | +---[RSA 3072]----+ 2026-05-19 14:20:48.385547 | aio -> localhost | |== .++.++.o. | 2026-05-19 14:20:48.385578 | aio -> localhost | |Ooo..o o..+..o . | 2026-05-19 14:20:48.385606 | aio -> localhost | |++E.. . .oo o | 2026-05-19 14:20:48.385634 | aio -> localhost | |.... o* = | 2026-05-19 14:20:48.385661 | aio -> localhost | | S o.O * | 2026-05-19 14:20:48.385691 | aio -> localhost | | . . o % | 2026-05-19 14:20:48.385725 | aio -> localhost | | o + + | 2026-05-19 14:20:48.385759 | aio -> localhost | | o . | 2026-05-19 14:20:48.385798 | aio -> localhost | | . | 2026-05-19 14:20:48.385834 | aio -> localhost | +----[SHA256]-----+ 2026-05-19 14:20:48.385910 | aio -> localhost | ok: Runtime: 0:00:00.240626 2026-05-19 14:20:48.403932 | 2026-05-19 14:20:48.404012 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-05-19 14:20:48.439843 | aio | ok 2026-05-19 14:20:48.455376 | aio | included: /var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-05-19 14:20:48.463028 | 2026-05-19 14:20:48.463098 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-05-19 14:20:48.488539 | aio | skipping: Conditional result was False 2026-05-19 14:20:48.500847 | 2026-05-19 14:20:48.500935 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-05-19 14:20:48.970982 | aio | changed 2026-05-19 14:20:48.977573 | 2026-05-19 14:20:48.977640 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-05-19 14:20:49.204382 | aio | ok 2026-05-19 14:20:49.211949 | 2026-05-19 14:20:49.212036 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-05-19 14:20:49.686627 | aio | changed 2026-05-19 14:20:49.692671 | 2026-05-19 14:20:49.692739 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-05-19 14:20:50.171990 | aio | changed 2026-05-19 14:20:50.177937 | 2026-05-19 14:20:50.178023 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-05-19 14:20:50.202547 | aio | skipping: Conditional result was False 2026-05-19 14:20:50.210665 | 2026-05-19 14:20:50.210783 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-05-19 14:20:50.630475 | aio -> localhost | changed 2026-05-19 14:20:50.647593 | 2026-05-19 14:20:50.647667 | TASK [add-build-sshkey : Add back temp key] 2026-05-19 14:20:50.942682 | aio -> localhost | Identity added: /var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/8250f3ef21fc481ead896b8fcc2bf21d_id_rsa (zuul-build-sshkey) 2026-05-19 14:20:50.942961 | aio -> localhost | ok: Runtime: 0:00:00.015732 2026-05-19 14:20:50.950128 | 2026-05-19 14:20:50.950204 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-05-19 14:20:51.275154 | aio | ok 2026-05-19 14:20:51.280541 | 2026-05-19 14:20:51.280606 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-05-19 14:20:51.305169 | aio | skipping: Conditional result was False 2026-05-19 14:20:51.321235 | 2026-05-19 14:20:51.321331 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-05-19 14:20:51.687010 | aio | ok 2026-05-19 14:20:51.694798 | 2026-05-19 14:20:51.694931 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-05-19 14:20:52.677105 | aio | Output suppressed because no_log was given 2026-05-19 14:20:52.738272 | 2026-05-19 14:20:52.738414 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-05-19 14:20:52.930398 | aio | ok: "logs" 2026-05-19 14:20:52.930719 | aio | ok: All items complete 2026-05-19 14:20:52.930758 | 2026-05-19 14:20:53.086159 | aio | ok: "artifacts" 2026-05-19 14:20:53.238774 | aio | ok: "docs" 2026-05-19 14:20:53.253533 | 2026-05-19 14:20:53.253699 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-05-19 14:20:53.441410 | aio | changed: "logs" 2026-05-19 14:20:53.590263 | aio | changed: "artifacts" 2026-05-19 14:20:53.747729 | aio | changed: "docs" 2026-05-19 14:20:53.766565 | 2026-05-19 14:20:53.766713 | PLAY RECAP 2026-05-19 14:20:53.766777 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-05-19 14:20:53.766816 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 14:20:53.766846 | 2026-05-19 14:20:53.901499 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-05-19 14:20:53.903207 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-19 14:20:54.514682 | 2026-05-19 14:20:54.514919 | PLAY [all] 2026-05-19 14:20:54.527599 | 2026-05-19 14:20:54.527705 | TASK [setup-uv : Extract archive] 2026-05-19 14:20:56.794483 | aio | changed 2026-05-19 14:20:56.800566 | 2026-05-19 14:20:56.800646 | TASK [setup-uv : Print version] 2026-05-19 14:20:56.066040 | aio | uv 0.8.13 2026-05-19 14:20:57.334411 | aio | ok: Runtime: 0:00:00.010370 2026-05-19 14:20:57.342682 | 2026-05-19 14:20:57.342794 | PLAY RECAP 2026-05-19 14:20:57.342845 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 14:20:57.342871 | 2026-05-19 14:20:57.506495 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-05-19 14:20:57.509710 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-19 14:20:58.120129 | 2026-05-19 14:20:58.120332 | PLAY [all] 2026-05-19 14:20:58.133275 | 2026-05-19 14:20:58.133454 | TASK [Copy inventory file for Zuul] 2026-05-19 14:20:59.023845 | aio | changed 2026-05-19 14:20:59.032416 | 2026-05-19 14:20:59.032524 | TASK [Switch "ansible_host" to private IP] 2026-05-19 14:20:59.371135 | aio | changed: 1 replacements made 2026-05-19 14:20:59.379709 | 2026-05-19 14:20:59.379783 | TASK [Run Molecule scenario] 2026-05-19 14:20:58.900277 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-05-19 14:21:00.746322 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-05-19 14:21:00.993695 | aio | Using CPython 3.13.7 2026-05-19 14:21:00.993797 | aio | Creating virtual environment at: .venv 2026-05-19 14:21:01.251512 | aio | Downloading pygments (1.2MiB) 2026-05-19 14:21:01.260813 | aio | Downloading netaddr (2.2MiB) 2026-05-19 14:21:01.261060 | aio | Downloading ansible-core (2.1MiB) 2026-05-19 14:21:01.261347 | aio | Downloading cryptography (4.3MiB) 2026-05-19 14:21:01.497194 | aio | Downloading pygments 2026-05-19 14:21:01.562162 | aio | Downloading netaddr 2026-05-19 14:21:01.612589 | aio | Downloading cryptography 2026-05-19 14:21:01.672556 | aio | Downloading ansible-core 2026-05-19 14:21:01.700798 | aio | Installed 36 packages in 27ms 2026-05-19 14:21:02.824677 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-05-19 14:21:02.824833 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-05-19 14:21:03.452421 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-05-19 14:21:03.452654 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-05-19 14:21:18.702796 | aio | INFO [default > dependency] Executing 2026-05-19 14:21:18.703127 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-05-19 14:21:18.703365 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-05-19 14:21:18.703514 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-05-19 14:21:18.708615 | aio | INFO [default > cleanup] Executing 2026-05-19 14:21:18.708967 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 14:21:18.713872 | aio | INFO [default > destroy] Executing 2026-05-19 14:21:18.713966 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-19 14:21:18.714071 | aio | INFO [default > destroy] Executed: Successful 2026-05-19 14:21:18.718963 | aio | INFO [default > syntax] Executing 2026-05-19 14:21:19.682127 | aio | 2026-05-19 14:21:19.682593 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-05-19 14:21:19.749291 | aio | INFO [default > syntax] Executed: Successful 2026-05-19 14:21:19.759527 | aio | INFO [default > create] Executing 2026-05-19 14:21:19.760992 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 14:21:19.766090 | aio | INFO [default > prepare] Executing 2026-05-19 14:21:20.458579 | aio | 2026-05-19 14:21:20.458935 | aio | PLAY [Prepare] ***************************************************************** 2026-05-19 14:21:20.459225 | aio | 2026-05-19 14:21:20.459506 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:21:20.459768 | aio | Tuesday 19 May 2026 14:21:20 +0000 (0:00:00.031) 0:00:00.031 *********** 2026-05-19 14:21:21.605696 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 14:21:21.606070 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 14:21:21.606339 | aio | interpreter could change the meaning of that path. See 2026-05-19 14:21:21.606598 | aio | https://docs.ansible.com/ansible- 2026-05-19 14:21:21.606868 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 14:21:21.612906 | aio | ok: [aio] 2026-05-19 14:21:21.613165 | aio | 2026-05-19 14:21:21.613461 | aio | TASK [Configure short hostname] ************************************************ 2026-05-19 14:21:21.613727 | aio | Tuesday 19 May 2026 14:21:21 +0000 (0:00:01.155) 0:00:01.186 *********** 2026-05-19 14:21:22.303094 | aio | changed: [aio] 2026-05-19 14:21:22.304126 | aio | 2026-05-19 14:21:22.304139 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-05-19 14:21:22.304146 | aio | Tuesday 19 May 2026 14:21:22 +0000 (0:00:00.686) 0:00:01.873 *********** 2026-05-19 14:21:22.589720 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-05-19 14:21:22.589934 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-05-19 14:21:22.589950 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-05-19 14:21:22.595592 | aio | changed: [aio] 2026-05-19 14:21:22.595790 | aio | 2026-05-19 14:21:22.595999 | aio | TASK [Update apt cache] ******************************************************** 2026-05-19 14:21:22.596215 | aio | Tuesday 19 May 2026 14:21:22 +0000 (0:00:00.296) 0:00:02.169 *********** 2026-05-19 14:21:29.365481 | aio | changed: [aio] 2026-05-19 14:21:29.365653 | aio | 2026-05-19 14:21:29.365795 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-05-19 14:21:29.365912 | aio | 2026-05-19 14:21:29.366044 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:21:29.366172 | aio | Tuesday 19 May 2026 14:21:29 +0000 (0:00:06.762) 0:00:08.932 *********** 2026-05-19 14:21:30.062522 | aio | ok: [aio] 2026-05-19 14:21:30.062685 | aio | 2026-05-19 14:21:30.062913 | aio | TASK [Install depedencies] ***************************************************** 2026-05-19 14:21:30.063117 | aio | Tuesday 19 May 2026 14:21:30 +0000 (0:00:00.703) 0:00:09.636 *********** 2026-05-19 14:21:50.412284 | aio | changed: [aio] 2026-05-19 14:21:50.412366 | aio | 2026-05-19 14:21:50.412381 | aio | TASK [Start up service] ******************************************************** 2026-05-19 14:21:50.412392 | aio | Tuesday 19 May 2026 14:21:50 +0000 (0:00:20.340) 0:00:29.976 *********** 2026-05-19 14:21:50.947632 | aio | ok: [aio] 2026-05-19 14:21:50.947756 | aio | 2026-05-19 14:21:50.947933 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-05-19 14:21:50.948113 | aio | Tuesday 19 May 2026 14:21:50 +0000 (0:00:00.544) 0:00:30.521 *********** 2026-05-19 14:21:51.251036 | aio | ok: [aio] 2026-05-19 14:21:51.251212 | aio | 2026-05-19 14:21:51.251439 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-05-19 14:21:51.251640 | aio | Tuesday 19 May 2026 14:21:51 +0000 (0:00:00.303) 0:00:30.825 *********** 2026-05-19 14:21:51.874738 | aio | changed: [aio] 2026-05-19 14:21:51.874927 | aio | 2026-05-19 14:21:51.875158 | aio | TASK [Get list of all loopback devices] **************************************** 2026-05-19 14:21:51.875434 | aio | Tuesday 19 May 2026 14:21:51 +0000 (0:00:00.623) 0:00:31.448 *********** 2026-05-19 14:21:52.065668 | aio | ok: [aio] 2026-05-19 14:21:52.065851 | aio | 2026-05-19 14:21:52.066092 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-05-19 14:21:52.066323 | aio | Tuesday 19 May 2026 14:21:52 +0000 (0:00:00.190) 0:00:31.639 *********** 2026-05-19 14:21:52.087569 | aio | skipping: [aio] 2026-05-19 14:21:52.087753 | aio | 2026-05-19 14:21:52.087954 | aio | TASK [Create devices for Ceph] ************************************************* 2026-05-19 14:21:52.088164 | aio | Tuesday 19 May 2026 14:21:52 +0000 (0:00:00.022) 0:00:31.661 *********** 2026-05-19 14:21:52.618502 | aio | changed: [aio] => (item=osd0) 2026-05-19 14:21:52.618709 | aio | changed: [aio] => (item=osd1) 2026-05-19 14:21:52.618949 | aio | changed: [aio] => (item=osd2) 2026-05-19 14:21:52.619138 | aio | 2026-05-19 14:21:52.619423 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-05-19 14:21:52.619632 | aio | Tuesday 19 May 2026 14:21:52 +0000 (0:00:00.530) 0:00:32.192 *********** 2026-05-19 14:21:53.251937 | aio | changed: [aio] => (item=osd0) 2026-05-19 14:21:53.252165 | aio | changed: [aio] => (item=osd1) 2026-05-19 14:21:53.252382 | aio | changed: [aio] => (item=osd2) 2026-05-19 14:21:53.252583 | aio | 2026-05-19 14:21:53.252800 | aio | TASK [Start loop devices] ****************************************************** 2026-05-19 14:21:53.253010 | aio | Tuesday 19 May 2026 14:21:53 +0000 (0:00:00.633) 0:00:32.826 *********** 2026-05-19 14:21:53.973748 | aio | changed: [aio] => (item=osd0) 2026-05-19 14:21:53.973950 | aio | changed: [aio] => (item=osd1) 2026-05-19 14:21:53.974232 | aio | changed: [aio] => (item=osd2) 2026-05-19 14:21:53.974426 | aio | 2026-05-19 14:21:53.974650 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-05-19 14:21:53.974870 | aio | Tuesday 19 May 2026 14:21:53 +0000 (0:00:00.721) 0:00:33.547 *********** 2026-05-19 14:21:56.987898 | aio | changed: [aio] => (item=osd0) 2026-05-19 14:21:56.988134 | aio | changed: [aio] => (item=osd1) 2026-05-19 14:21:56.988377 | aio | changed: [aio] => (item=osd2) 2026-05-19 14:21:56.988591 | aio | 2026-05-19 14:21:56.988807 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-05-19 14:21:56.989029 | aio | Tuesday 19 May 2026 14:21:56 +0000 (0:00:03.012) 0:00:36.559 *********** 2026-05-19 14:21:58.816178 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-05-19 14:21:58.816264 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-05-19 14:21:58.816366 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-05-19 14:21:58.816495 | aio | 2026-05-19 14:21:58.816658 | aio | PLAY RECAP ********************************************************************* 2026-05-19 14:21:58.816811 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-05-19 14:21:58.817010 | aio | 2026-05-19 14:21:58.817045 | aio | 2026-05-19 14:21:58.817180 | aio | TASKS RECAP ******************************************************************** 2026-05-19 14:21:58.817311 | aio | Tuesday 19 May 2026 14:21:58 +0000 (0:00:01.830) 0:00:38.390 *********** 2026-05-19 14:21:58.817434 | aio | =============================================================================== 2026-05-19 14:21:58.817566 | aio | Install depedencies ---------------------------------------------------- 20.34s 2026-05-19 14:21:58.817703 | aio | Update apt cache -------------------------------------------------------- 6.76s 2026-05-19 14:21:58.817819 | aio | Create a volume group for each loop device ------------------------------ 3.01s 2026-05-19 14:21:58.817941 | aio | Create a logical volume for each loop device ---------------------------- 1.83s 2026-05-19 14:21:58.818064 | aio | Gathering Facts --------------------------------------------------------- 1.16s 2026-05-19 14:21:58.818183 | aio | Start loop devices ------------------------------------------------------ 0.72s 2026-05-19 14:21:58.818305 | aio | Gathering Facts --------------------------------------------------------- 0.70s 2026-05-19 14:21:58.818422 | aio | Configure short hostname ------------------------------------------------ 0.69s 2026-05-19 14:21:58.818549 | aio | Set permissions on loopback devices ------------------------------------- 0.63s 2026-05-19 14:21:58.818674 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.62s 2026-05-19 14:21:58.818800 | aio | Start up service -------------------------------------------------------- 0.54s 2026-05-19 14:21:58.818915 | aio | Create devices for Ceph ------------------------------------------------- 0.53s 2026-05-19 14:21:58.819039 | aio | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-05-19 14:21:58.819163 | aio | Ensure hostname inside hosts file --------------------------------------- 0.30s 2026-05-19 14:21:58.819299 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-05-19 14:21:58.819430 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-05-19 14:21:58.888259 | aio | INFO [default > prepare] Executed: Successful 2026-05-19 14:21:58.898714 | aio | INFO [default > converge] Executing 2026-05-19 14:21:59.704609 | aio | 2026-05-19 14:21:59.704860 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-19 14:21:59.705136 | aio | 2026-05-19 14:21:59.705366 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:21:59.705584 | aio | Tuesday 19 May 2026 14:21:59 +0000 (0:00:00.052) 0:00:00.052 *********** 2026-05-19 14:22:00.843737 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 14:22:00.843983 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 14:22:00.844156 | aio | interpreter could change the meaning of that path. See 2026-05-19 14:22:00.844352 | aio | https://docs.ansible.com/ansible- 2026-05-19 14:22:00.844521 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 14:22:00.853303 | aio | ok: [aio] 2026-05-19 14:22:00.853474 | aio | 2026-05-19 14:22:00.853680 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:22:00.853848 | aio | Tuesday 19 May 2026 14:22:00 +0000 (0:00:01.149) 0:00:01.201 *********** 2026-05-19 14:22:01.146528 | aio | ok: [aio] 2026-05-19 14:22:01.146872 | aio | 2026-05-19 14:22:01.147165 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:22:01.147490 | aio | Tuesday 19 May 2026 14:22:01 +0000 (0:00:00.292) 0:00:01.494 *********** 2026-05-19 14:22:01.185139 | aio | skipping: [aio] 2026-05-19 14:22:01.185480 | aio | 2026-05-19 14:22:01.185840 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 14:22:01.186160 | aio | Tuesday 19 May 2026 14:22:01 +0000 (0:00:00.038) 0:00:01.532 *********** 2026-05-19 14:22:01.483099 | aio | changed: [aio] 2026-05-19 14:22:01.483436 | aio | 2026-05-19 14:22:01.483719 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:22:01.484009 | aio | Tuesday 19 May 2026 14:22:01 +0000 (0:00:00.297) 0:00:01.830 *********** 2026-05-19 14:22:01.579145 | aio | ok: [aio] => { 2026-05-19 14:22:01.579527 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 14:22:01.579801 | aio | } 2026-05-19 14:22:01.580062 | aio | 2026-05-19 14:22:01.580382 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:22:01.580666 | aio | Tuesday 19 May 2026 14:22:01 +0000 (0:00:00.096) 0:00:01.927 *********** 2026-05-19 14:22:03.321646 | aio | changed: [aio] 2026-05-19 14:22:03.321897 | aio | 2026-05-19 14:22:03.322097 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:22:03.322289 | aio | Tuesday 19 May 2026 14:22:03 +0000 (0:00:01.742) 0:00:03.669 *********** 2026-05-19 14:22:03.364789 | aio | skipping: [aio] 2026-05-19 14:22:03.365091 | aio | 2026-05-19 14:22:03.365365 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:22:03.365624 | aio | Tuesday 19 May 2026 14:22:03 +0000 (0:00:00.043) 0:00:03.712 *********** 2026-05-19 14:22:03.408265 | aio | skipping: [aio] 2026-05-19 14:22:03.408524 | aio | 2026-05-19 14:22:03.408788 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:22:03.409044 | aio | Tuesday 19 May 2026 14:22:03 +0000 (0:00:00.043) 0:00:03.756 *********** 2026-05-19 14:22:03.630497 | aio | ok: [aio] 2026-05-19 14:22:03.630872 | aio | 2026-05-19 14:22:03.631430 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:22:03.631805 | aio | Tuesday 19 May 2026 14:22:03 +0000 (0:00:00.221) 0:00:03.978 *********** 2026-05-19 14:22:04.731345 | aio | ok: [aio] 2026-05-19 14:22:04.731444 | aio | 2026-05-19 14:22:04.731468 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:22:04.731481 | aio | Tuesday 19 May 2026 14:22:04 +0000 (0:00:01.100) 0:00:05.079 *********** 2026-05-19 14:22:04.810405 | aio | ok: [aio] => { 2026-05-19 14:22:04.810563 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 14:22:04.810757 | aio | } 2026-05-19 14:22:04.810935 | aio | 2026-05-19 14:22:04.811141 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:22:04.811378 | aio | Tuesday 19 May 2026 14:22:04 +0000 (0:00:00.078) 0:00:05.157 *********** 2026-05-19 14:22:05.555180 | aio | changed: [aio] 2026-05-19 14:22:05.555368 | aio | 2026-05-19 14:22:05.555601 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:22:05.555850 | aio | Tuesday 19 May 2026 14:22:05 +0000 (0:00:00.744) 0:00:05.902 *********** 2026-05-19 14:22:08.473966 | aio | changed: [aio] 2026-05-19 14:22:08.474297 | aio | 2026-05-19 14:22:08.474584 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 14:22:08.474852 | aio | Tuesday 19 May 2026 14:22:08 +0000 (0:00:02.918) 0:00:08.821 *********** 2026-05-19 14:22:08.507107 | aio | skipping: [aio] 2026-05-19 14:22:08.507220 | aio | 2026-05-19 14:22:08.507401 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 14:22:08.507597 | aio | Tuesday 19 May 2026 14:22:08 +0000 (0:00:00.033) 0:00:08.854 *********** 2026-05-19 14:22:08.539059 | aio | skipping: [aio] 2026-05-19 14:22:08.539168 | aio | 2026-05-19 14:22:08.539180 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 14:22:08.539258 | aio | Tuesday 19 May 2026 14:22:08 +0000 (0:00:00.032) 0:00:08.886 *********** 2026-05-19 14:22:08.572298 | aio | skipping: [aio] 2026-05-19 14:22:08.572395 | aio | 2026-05-19 14:22:08.572408 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 14:22:08.572482 | aio | Tuesday 19 May 2026 14:22:08 +0000 (0:00:00.033) 0:00:08.919 *********** 2026-05-19 14:22:14.125190 | aio | changed: [aio] 2026-05-19 14:22:14.125347 | aio | 2026-05-19 14:22:14.125481 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 14:22:14.125606 | aio | Tuesday 19 May 2026 14:22:14 +0000 (0:00:05.553) 0:00:14.473 *********** 2026-05-19 14:22:14.649578 | aio | changed: [aio] 2026-05-19 14:22:14.649724 | aio | 2026-05-19 14:22:14.649968 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 14:22:14.650162 | aio | Tuesday 19 May 2026 14:22:14 +0000 (0:00:00.524) 0:00:14.997 *********** 2026-05-19 14:22:15.507500 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 14:22:15.507553 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 14:22:15.507559 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 14:22:15.507563 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 14:22:15.507568 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 14:22:15.507573 | aio | 2026-05-19 14:22:15.507577 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 14:22:15.507581 | aio | Tuesday 19 May 2026 14:22:15 +0000 (0:00:00.857) 0:00:15.854 *********** 2026-05-19 14:22:16.083499 | aio | changed: [aio] 2026-05-19 14:22:16.083587 | aio | 2026-05-19 14:22:16.083648 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 14:22:16.084088 | aio | Tuesday 19 May 2026 14:22:16 +0000 (0:00:00.569) 0:00:16.424 *********** 2026-05-19 14:22:16.084166 | aio | 2026-05-19 14:22:16.084173 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-19 14:22:16.084177 | aio | Tuesday 19 May 2026 14:22:16 +0000 (0:00:00.006) 0:00:16.431 *********** 2026-05-19 14:22:17.009942 | aio | ok: [aio] 2026-05-19 14:22:17.010042 | aio | 2026-05-19 14:22:17.010066 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-05-19 14:22:17.010240 | aio | Tuesday 19 May 2026 14:22:17 +0000 (0:00:00.926) 0:00:17.357 *********** 2026-05-19 14:22:17.464805 | aio | changed: [aio] 2026-05-19 14:22:17.464905 | aio | 2026-05-19 14:22:17.464968 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 14:22:17.465121 | aio | Tuesday 19 May 2026 14:22:17 +0000 (0:00:00.455) 0:00:17.812 *********** 2026-05-19 14:22:18.003075 | aio | changed: [aio] 2026-05-19 14:22:18.003146 | aio | 2026-05-19 14:22:18.003236 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:22:18.003337 | aio | Tuesday 19 May 2026 14:22:18 +0000 (0:00:00.538) 0:00:18.350 *********** 2026-05-19 14:22:18.228033 | aio | ok: [aio] 2026-05-19 14:22:18.228115 | aio | 2026-05-19 14:22:18.228182 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:22:18.228303 | aio | Tuesday 19 May 2026 14:22:18 +0000 (0:00:00.225) 0:00:18.576 *********** 2026-05-19 14:22:18.302211 | aio | ok: [aio] => { 2026-05-19 14:22:18.302930 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 14:22:18.302985 | aio | } 2026-05-19 14:22:18.302990 | aio | 2026-05-19 14:22:18.302995 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:22:18.302999 | aio | Tuesday 19 May 2026 14:22:18 +0000 (0:00:00.073) 0:00:18.649 *********** 2026-05-19 14:22:19.120327 | aio | changed: [aio] 2026-05-19 14:22:19.120424 | aio | 2026-05-19 14:22:19.120440 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:22:19.120552 | aio | Tuesday 19 May 2026 14:22:19 +0000 (0:00:00.818) 0:00:19.468 *********** 2026-05-19 14:22:24.547344 | aio | changed: [aio] 2026-05-19 14:22:24.547430 | aio | 2026-05-19 14:22:24.547442 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 14:22:24.547460 | aio | Tuesday 19 May 2026 14:22:24 +0000 (0:00:05.423) 0:00:24.892 *********** 2026-05-19 14:22:25.669776 | aio | ok: [aio] 2026-05-19 14:22:25.669845 | aio | 2026-05-19 14:22:25.670068 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 14:22:25.670143 | aio | Tuesday 19 May 2026 14:22:25 +0000 (0:00:01.125) 0:00:26.017 *********** 2026-05-19 14:22:26.063453 | aio | changed: [aio] 2026-05-19 14:22:26.063557 | aio | 2026-05-19 14:22:26.063570 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 14:22:26.063709 | aio | Tuesday 19 May 2026 14:22:26 +0000 (0:00:00.393) 0:00:26.411 *********** 2026-05-19 14:22:26.537672 | aio | changed: [aio] 2026-05-19 14:22:26.537767 | aio | 2026-05-19 14:22:26.538051 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 14:22:26.538129 | aio | Tuesday 19 May 2026 14:22:26 +0000 (0:00:00.473) 0:00:26.885 *********** 2026-05-19 14:22:27.116161 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 14:22:27.116250 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 14:22:27.116670 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 14:22:27.116722 | aio | 2026-05-19 14:22:27.116728 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 14:22:27.116733 | aio | Tuesday 19 May 2026 14:22:27 +0000 (0:00:00.578) 0:00:27.463 *********** 2026-05-19 14:22:27.563014 | aio | changed: [aio] 2026-05-19 14:22:27.563069 | aio | 2026-05-19 14:22:27.563128 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 14:22:27.563135 | aio | Tuesday 19 May 2026 14:22:27 +0000 (0:00:00.446) 0:00:27.910 *********** 2026-05-19 14:22:28.041156 | aio | changed: [aio] 2026-05-19 14:22:28.041210 | aio | 2026-05-19 14:22:28.041215 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 14:22:28.041220 | aio | Tuesday 19 May 2026 14:22:28 +0000 (0:00:00.470) 0:00:28.381 *********** 2026-05-19 14:22:28.041224 | aio | 2026-05-19 14:22:28.041228 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-05-19 14:22:28.041232 | aio | Tuesday 19 May 2026 14:22:28 +0000 (0:00:00.007) 0:00:28.388 *********** 2026-05-19 14:22:28.751383 | aio | ok: [aio] 2026-05-19 14:22:28.751469 | aio | 2026-05-19 14:22:28.751493 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-05-19 14:22:28.751503 | aio | Tuesday 19 May 2026 14:22:28 +0000 (0:00:00.710) 0:00:29.099 *********** 2026-05-19 14:22:29.554476 | aio | changed: [aio] 2026-05-19 14:22:29.554527 | aio | 2026-05-19 14:22:29.554533 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 14:22:29.554538 | aio | Tuesday 19 May 2026 14:22:29 +0000 (0:00:00.803) 0:00:29.902 *********** 2026-05-19 14:22:30.136472 | aio | changed: [aio] 2026-05-19 14:22:30.136560 | aio | 2026-05-19 14:22:30.136615 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 14:22:30.136731 | aio | Tuesday 19 May 2026 14:22:30 +0000 (0:00:00.582) 0:00:30.484 *********** 2026-05-19 14:22:30.190817 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 14:22:30.191343 | aio | 2026-05-19 14:22:30.191440 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 14:22:30.191466 | aio | Tuesday 19 May 2026 14:22:30 +0000 (0:00:00.054) 0:00:30.538 *********** 2026-05-19 14:22:35.404976 | aio | changed: [aio] 2026-05-19 14:22:35.405093 | aio | 2026-05-19 14:22:35.405161 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 14:22:35.405299 | aio | Tuesday 19 May 2026 14:22:35 +0000 (0:00:05.214) 0:00:35.752 *********** 2026-05-19 14:22:36.065857 | aio | ok: [aio] => (item=chronyd) 2026-05-19 14:22:36.065953 | aio | ok: [aio] => (item=sshd) 2026-05-19 14:22:36.066405 | aio | 2026-05-19 14:22:36.066597 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 14:22:36.066606 | aio | Tuesday 19 May 2026 14:22:36 +0000 (0:00:00.661) 0:00:36.413 *********** 2026-05-19 14:22:36.365677 | aio | changed: [aio] 2026-05-19 14:22:36.365743 | aio | 2026-05-19 14:22:36.365856 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 14:22:36.365964 | aio | Tuesday 19 May 2026 14:22:36 +0000 (0:00:00.299) 0:00:36.713 *********** 2026-05-19 14:22:36.566915 | aio | ok: [aio] 2026-05-19 14:22:36.567030 | aio | 2026-05-19 14:22:36.567246 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 14:22:36.567440 | aio | Tuesday 19 May 2026 14:22:36 +0000 (0:00:00.201) 0:00:36.914 *********** 2026-05-19 14:22:37.054135 | aio | changed: [aio] 2026-05-19 14:22:37.054227 | aio | 2026-05-19 14:22:37.054568 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 14:22:37.054628 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.487) 0:00:37.401 *********** 2026-05-19 14:22:37.374005 | aio | changed: [aio] 2026-05-19 14:22:37.374040 | aio | 2026-05-19 14:22:37.374046 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-19 14:22:37.374051 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.319) 0:00:37.721 *********** 2026-05-19 14:22:37.526865 | aio | ok: [aio] 2026-05-19 14:22:37.526914 | aio | 2026-05-19 14:22:37.526920 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-19 14:22:37.526924 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.152) 0:00:37.874 *********** 2026-05-19 14:22:37.753883 | aio | ok: [aio] => (item=aio) 2026-05-19 14:22:37.753940 | aio | 2026-05-19 14:22:37.753948 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-19 14:22:37.753954 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.226) 0:00:38.101 *********** 2026-05-19 14:22:37.798790 | aio | ok: [aio] 2026-05-19 14:22:37.798843 | aio | 2026-05-19 14:22:37.798849 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-19 14:22:37.798853 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.045) 0:00:38.146 *********** 2026-05-19 14:22:37.897902 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-05-19 14:22:37.897950 | aio | 2026-05-19 14:22:37.897955 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-05-19 14:22:37.897960 | aio | Tuesday 19 May 2026 14:22:37 +0000 (0:00:00.099) 0:00:38.245 *********** 2026-05-19 14:22:38.180188 | aio | changed: [aio] 2026-05-19 14:22:38.180238 | aio | 2026-05-19 14:22:38.180243 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-05-19 14:22:38.180248 | aio | Tuesday 19 May 2026 14:22:38 +0000 (0:00:00.281) 0:00:38.527 *********** 2026-05-19 14:22:38.839571 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-05-19 14:22:38.839622 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-05-19 14:22:38.839641 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-05-19 14:22:38.839646 | aio | 2026-05-19 14:22:38.839650 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-05-19 14:22:38.839654 | aio | Tuesday 19 May 2026 14:22:38 +0000 (0:00:00.659) 0:00:39.186 *********** 2026-05-19 14:24:04.062609 | aio | ok: [aio] 2026-05-19 14:24:04.062663 | aio | 2026-05-19 14:24:04.062672 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-05-19 14:24:04.062678 | aio | Tuesday 19 May 2026 14:24:04 +0000 (0:01:25.222) 0:02:04.409 *********** 2026-05-19 14:24:04.287218 | aio | changed: [aio] 2026-05-19 14:24:04.287274 | aio | 2026-05-19 14:24:04.287301 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-05-19 14:24:04.287308 | aio | Tuesday 19 May 2026 14:24:04 +0000 (0:00:00.224) 0:02:04.634 *********** 2026-05-19 14:24:04.321793 | aio | ok: [aio] 2026-05-19 14:24:04.322185 | aio | 2026-05-19 14:24:04.322233 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:24:04.322240 | aio | Tuesday 19 May 2026 14:24:04 +0000 (0:00:00.034) 0:02:04.669 *********** 2026-05-19 14:24:04.386479 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:24:04.386548 | aio | 2026-05-19 14:24:04.386598 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:24:04.386715 | aio | Tuesday 19 May 2026 14:24:04 +0000 (0:00:00.065) 0:02:04.734 *********** 2026-05-19 14:24:10.826566 | aio | ok: [aio] 2026-05-19 14:24:10.826609 | aio | 2026-05-19 14:24:10.826615 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:24:10.826620 | aio | Tuesday 19 May 2026 14:24:10 +0000 (0:00:06.439) 0:02:11.174 *********** 2026-05-19 14:24:10.869069 | aio | ok: [aio] => (item=aio) 2026-05-19 14:24:10.869087 | aio | 2026-05-19 14:24:10.869092 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:24:10.869097 | aio | Tuesday 19 May 2026 14:24:10 +0000 (0:00:00.042) 0:02:11.217 *********** 2026-05-19 14:24:11.250644 | aio | ok: [aio] 2026-05-19 14:24:11.250703 | aio | 2026-05-19 14:24:11.250840 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:24:11.250942 | aio | Tuesday 19 May 2026 14:24:11 +0000 (0:00:00.381) 0:02:11.598 *********** 2026-05-19 14:24:17.685371 | aio | ok: [aio] 2026-05-19 14:24:17.685463 | aio | 2026-05-19 14:24:17.685533 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-19 14:24:17.685633 | aio | Tuesday 19 May 2026 14:24:17 +0000 (0:00:06.434) 0:02:18.033 *********** 2026-05-19 14:24:29.870040 | aio | changed: [aio] 2026-05-19 14:24:29.870148 | aio | 2026-05-19 14:24:29.870166 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-19 14:24:29.870284 | aio | Tuesday 19 May 2026 14:24:29 +0000 (0:00:12.182) 0:02:30.215 *********** 2026-05-19 14:24:43.940162 | aio | ok: [aio] 2026-05-19 14:24:43.940333 | aio | 2026-05-19 14:24:43.940577 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:24:43.940852 | aio | Tuesday 19 May 2026 14:24:43 +0000 (0:00:14.072) 0:02:44.287 *********** 2026-05-19 14:24:44.008993 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:24:44.009120 | aio | 2026-05-19 14:24:44.009357 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:24:44.009571 | aio | Tuesday 19 May 2026 14:24:44 +0000 (0:00:00.068) 0:02:44.356 *********** 2026-05-19 14:24:44.048869 | aio | skipping: [aio] 2026-05-19 14:24:44.049161 | aio | 2026-05-19 14:24:44.049421 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:24:44.049809 | aio | Tuesday 19 May 2026 14:24:44 +0000 (0:00:00.039) 0:02:44.396 *********** 2026-05-19 14:24:44.086647 | aio | skipping: [aio] => (item=aio) 2026-05-19 14:24:44.086813 | aio | skipping: [aio] 2026-05-19 14:24:44.086999 | aio | 2026-05-19 14:24:44.087234 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:24:44.087448 | aio | Tuesday 19 May 2026 14:24:44 +0000 (0:00:00.038) 0:02:44.434 *********** 2026-05-19 14:24:44.323993 | aio | ok: [aio] 2026-05-19 14:24:44.324149 | aio | 2026-05-19 14:24:44.324373 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:24:44.324583 | aio | Tuesday 19 May 2026 14:24:44 +0000 (0:00:00.237) 0:02:44.671 *********** 2026-05-19 14:24:50.623905 | aio | ok: [aio] 2026-05-19 14:24:50.623973 | aio | 2026-05-19 14:24:50.623986 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-19 14:24:50.623996 | aio | Tuesday 19 May 2026 14:24:50 +0000 (0:00:06.299) 0:02:50.971 *********** 2026-05-19 14:25:02.172095 | aio | changed: [aio] 2026-05-19 14:25:02.172140 | aio | 2026-05-19 14:25:02.172146 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-19 14:25:02.172151 | aio | Tuesday 19 May 2026 14:25:02 +0000 (0:00:11.548) 0:03:02.519 *********** 2026-05-19 14:25:08.064425 | aio | ok: [aio] 2026-05-19 14:25:08.064504 | aio | 2026-05-19 14:25:08.064565 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-19 14:25:08.064687 | aio | Tuesday 19 May 2026 14:25:08 +0000 (0:00:05.892) 0:03:08.412 *********** 2026-05-19 14:25:12.427253 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-19 14:25:12.427322 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-19 14:25:12.427439 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-05-19 14:25:12.427559 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-19 14:25:12.427608 | aio | 2026-05-19 14:25:12.427708 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-19 14:25:12.427789 | aio | 2026-05-19 14:25:12.427906 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:25:12.427970 | aio | Tuesday 19 May 2026 14:25:12 +0000 (0:00:04.362) 0:03:12.775 *********** 2026-05-19 14:25:13.361379 | aio | ok: [aio] 2026-05-19 14:25:13.361419 | aio | 2026-05-19 14:25:13.361424 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:25:13.361429 | aio | Tuesday 19 May 2026 14:25:13 +0000 (0:00:00.933) 0:03:13.709 *********** 2026-05-19 14:25:13.570692 | aio | ok: [aio] 2026-05-19 14:25:13.570739 | aio | 2026-05-19 14:25:13.570745 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:25:13.570750 | aio | Tuesday 19 May 2026 14:25:13 +0000 (0:00:00.209) 0:03:13.918 *********** 2026-05-19 14:25:13.606741 | aio | skipping: [aio] 2026-05-19 14:25:13.606768 | aio | 2026-05-19 14:25:13.606774 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 14:25:13.606778 | aio | Tuesday 19 May 2026 14:25:13 +0000 (0:00:00.036) 0:03:13.954 *********** 2026-05-19 14:25:13.817763 | aio | ok: [aio] 2026-05-19 14:25:13.817808 | aio | 2026-05-19 14:25:13.817814 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:25:13.817819 | aio | Tuesday 19 May 2026 14:25:13 +0000 (0:00:00.210) 0:03:14.165 *********** 2026-05-19 14:25:13.871491 | aio | ok: [aio] => { 2026-05-19 14:25:13.871537 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 14:25:13.871545 | aio | } 2026-05-19 14:25:13.871552 | aio | 2026-05-19 14:25:13.871558 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:25:13.871564 | aio | Tuesday 19 May 2026 14:25:13 +0000 (0:00:00.053) 0:03:14.218 *********** 2026-05-19 14:25:14.167504 | aio | ok: [aio] 2026-05-19 14:25:14.167551 | aio | 2026-05-19 14:25:14.167558 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:25:14.167565 | aio | Tuesday 19 May 2026 14:25:14 +0000 (0:00:00.296) 0:03:14.514 *********** 2026-05-19 14:25:14.208197 | aio | skipping: [aio] 2026-05-19 14:25:14.208244 | aio | 2026-05-19 14:25:14.208250 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:25:14.208255 | aio | Tuesday 19 May 2026 14:25:14 +0000 (0:00:00.041) 0:03:14.556 *********** 2026-05-19 14:25:14.245181 | aio | skipping: [aio] 2026-05-19 14:25:14.245216 | aio | 2026-05-19 14:25:14.245221 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:25:14.245226 | aio | Tuesday 19 May 2026 14:25:14 +0000 (0:00:00.036) 0:03:14.593 *********** 2026-05-19 14:25:14.459837 | aio | ok: [aio] 2026-05-19 14:25:14.459879 | aio | 2026-05-19 14:25:14.459885 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:25:14.459889 | aio | Tuesday 19 May 2026 14:25:14 +0000 (0:00:00.214) 0:03:14.807 *********** 2026-05-19 14:25:15.703177 | aio | ok: [aio] 2026-05-19 14:25:15.703415 | aio | 2026-05-19 14:25:15.703423 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:25:15.703428 | aio | Tuesday 19 May 2026 14:25:15 +0000 (0:00:01.243) 0:03:16.050 *********** 2026-05-19 14:25:15.762563 | aio | ok: [aio] => { 2026-05-19 14:25:15.762599 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 14:25:15.762611 | aio | } 2026-05-19 14:25:15.762621 | aio | 2026-05-19 14:25:15.762630 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:25:15.762639 | aio | Tuesday 19 May 2026 14:25:15 +0000 (0:00:00.058) 0:03:16.109 *********** 2026-05-19 14:25:16.095719 | aio | ok: [aio] 2026-05-19 14:25:16.095767 | aio | 2026-05-19 14:25:16.095774 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:25:16.095781 | aio | Tuesday 19 May 2026 14:25:16 +0000 (0:00:00.333) 0:03:16.443 *********** 2026-05-19 14:25:18.109228 | aio | ok: [aio] 2026-05-19 14:25:18.109275 | aio | 2026-05-19 14:25:18.109280 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 14:25:18.109285 | aio | Tuesday 19 May 2026 14:25:18 +0000 (0:00:02.013) 0:03:18.456 *********** 2026-05-19 14:25:18.137777 | aio | skipping: [aio] 2026-05-19 14:25:18.137820 | aio | 2026-05-19 14:25:18.137825 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 14:25:18.137830 | aio | Tuesday 19 May 2026 14:25:18 +0000 (0:00:00.028) 0:03:18.485 *********** 2026-05-19 14:25:18.169028 | aio | skipping: [aio] 2026-05-19 14:25:18.169061 | aio | 2026-05-19 14:25:18.169067 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 14:25:18.169072 | aio | Tuesday 19 May 2026 14:25:18 +0000 (0:00:00.031) 0:03:18.517 *********** 2026-05-19 14:25:18.195344 | aio | skipping: [aio] 2026-05-19 14:25:18.195375 | aio | 2026-05-19 14:25:18.195381 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 14:25:18.195385 | aio | Tuesday 19 May 2026 14:25:18 +0000 (0:00:00.025) 0:03:18.542 *********** 2026-05-19 14:25:19.355388 | aio | ok: [aio] 2026-05-19 14:25:19.355460 | aio | 2026-05-19 14:25:19.355472 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 14:25:19.355490 | aio | Tuesday 19 May 2026 14:25:19 +0000 (0:00:01.160) 0:03:19.703 *********** 2026-05-19 14:25:19.820028 | aio | ok: [aio] 2026-05-19 14:25:19.820073 | aio | 2026-05-19 14:25:19.820079 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 14:25:19.820084 | aio | Tuesday 19 May 2026 14:25:19 +0000 (0:00:00.464) 0:03:20.167 *********** 2026-05-19 14:25:20.734125 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 14:25:20.734185 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 14:25:20.734194 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 14:25:20.734200 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 14:25:20.734206 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 14:25:20.734224 | aio | 2026-05-19 14:25:20.734231 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 14:25:20.734237 | aio | Tuesday 19 May 2026 14:25:20 +0000 (0:00:00.913) 0:03:21.080 *********** 2026-05-19 14:25:21.272407 | aio | ok: [aio] 2026-05-19 14:25:21.272487 | aio | 2026-05-19 14:25:21.272551 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 14:25:21.272646 | aio | Tuesday 19 May 2026 14:25:21 +0000 (0:00:00.532) 0:03:21.613 *********** 2026-05-19 14:25:21.272736 | aio | 2026-05-19 14:25:21.273187 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 14:25:21.273302 | aio | Tuesday 19 May 2026 14:25:21 +0000 (0:00:00.006) 0:03:21.619 *********** 2026-05-19 14:25:21.608497 | aio | ok: [aio] 2026-05-19 14:25:21.608537 | aio | 2026-05-19 14:25:21.608542 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:25:21.608547 | aio | Tuesday 19 May 2026 14:25:21 +0000 (0:00:00.336) 0:03:21.956 *********** 2026-05-19 14:25:21.823546 | aio | ok: [aio] 2026-05-19 14:25:21.823574 | aio | 2026-05-19 14:25:21.823579 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:25:21.823584 | aio | Tuesday 19 May 2026 14:25:21 +0000 (0:00:00.215) 0:03:22.171 *********** 2026-05-19 14:25:21.874699 | aio | ok: [aio] => { 2026-05-19 14:25:21.874757 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 14:25:21.874765 | aio | } 2026-05-19 14:25:21.874771 | aio | 2026-05-19 14:25:21.874777 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:25:21.874783 | aio | Tuesday 19 May 2026 14:25:21 +0000 (0:00:00.050) 0:03:22.222 *********** 2026-05-19 14:25:22.214048 | aio | ok: [aio] 2026-05-19 14:25:22.214093 | aio | 2026-05-19 14:25:22.214099 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:25:22.214103 | aio | Tuesday 19 May 2026 14:25:22 +0000 (0:00:00.339) 0:03:22.561 *********** 2026-05-19 14:25:25.244635 | aio | ok: [aio] 2026-05-19 14:25:25.244684 | aio | 2026-05-19 14:25:25.244689 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 14:25:25.244694 | aio | Tuesday 19 May 2026 14:25:25 +0000 (0:00:03.030) 0:03:25.592 *********** 2026-05-19 14:25:26.290624 | aio | ok: [aio] 2026-05-19 14:25:26.290682 | aio | 2026-05-19 14:25:26.290690 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 14:25:26.290696 | aio | Tuesday 19 May 2026 14:25:26 +0000 (0:00:01.045) 0:03:26.637 *********** 2026-05-19 14:25:26.514565 | aio | ok: [aio] 2026-05-19 14:25:26.514656 | aio | 2026-05-19 14:25:26.514858 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 14:25:26.514899 | aio | Tuesday 19 May 2026 14:25:26 +0000 (0:00:00.224) 0:03:26.862 *********** 2026-05-19 14:25:26.947650 | aio | ok: [aio] 2026-05-19 14:25:26.947698 | aio | 2026-05-19 14:25:26.947704 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 14:25:26.947709 | aio | Tuesday 19 May 2026 14:25:26 +0000 (0:00:00.433) 0:03:27.295 *********** 2026-05-19 14:25:27.498024 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 14:25:27.498101 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 14:25:27.498434 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 14:25:27.498489 | aio | 2026-05-19 14:25:27.498497 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 14:25:27.498510 | aio | Tuesday 19 May 2026 14:25:27 +0000 (0:00:00.549) 0:03:27.845 *********** 2026-05-19 14:25:27.929915 | aio | ok: [aio] 2026-05-19 14:25:27.929992 | aio | 2026-05-19 14:25:27.930054 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 14:25:27.930238 | aio | Tuesday 19 May 2026 14:25:27 +0000 (0:00:00.432) 0:03:28.277 *********** 2026-05-19 14:25:28.385702 | aio | ok: [aio] 2026-05-19 14:25:28.385788 | aio | 2026-05-19 14:25:28.385852 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 14:25:28.386257 | aio | Tuesday 19 May 2026 14:25:28 +0000 (0:00:00.450) 0:03:28.728 *********** 2026-05-19 14:25:28.386319 | aio | 2026-05-19 14:25:28.386326 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 14:25:28.386331 | aio | Tuesday 19 May 2026 14:25:28 +0000 (0:00:00.005) 0:03:28.733 *********** 2026-05-19 14:25:28.764118 | aio | ok: [aio] 2026-05-19 14:25:28.764199 | aio | 2026-05-19 14:25:28.764261 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 14:25:28.764394 | aio | Tuesday 19 May 2026 14:25:28 +0000 (0:00:00.378) 0:03:29.112 *********** 2026-05-19 14:25:28.809504 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 14:25:28.809579 | aio | 2026-05-19 14:25:28.809878 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 14:25:28.809925 | aio | Tuesday 19 May 2026 14:25:28 +0000 (0:00:00.045) 0:03:29.157 *********** 2026-05-19 14:25:30.003094 | aio | ok: [aio] 2026-05-19 14:25:30.003175 | aio | 2026-05-19 14:25:30.003525 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 14:25:30.003571 | aio | Tuesday 19 May 2026 14:25:30 +0000 (0:00:01.193) 0:03:30.351 *********** 2026-05-19 14:25:30.684449 | aio | ok: [aio] => (item=chronyd) 2026-05-19 14:25:30.684528 | aio | ok: [aio] => (item=sshd) 2026-05-19 14:25:30.684663 | aio | 2026-05-19 14:25:30.684932 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 14:25:30.685010 | aio | Tuesday 19 May 2026 14:25:30 +0000 (0:00:00.681) 0:03:31.032 *********** 2026-05-19 14:25:30.964999 | aio | ok: [aio] 2026-05-19 14:25:30.965072 | aio | 2026-05-19 14:25:30.965165 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 14:25:30.965299 | aio | Tuesday 19 May 2026 14:25:30 +0000 (0:00:00.280) 0:03:31.313 *********** 2026-05-19 14:25:31.154621 | aio | ok: [aio] 2026-05-19 14:25:31.154695 | aio | 2026-05-19 14:25:31.154762 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 14:25:31.154886 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.189) 0:03:31.502 *********** 2026-05-19 14:25:31.393870 | aio | ok: [aio] 2026-05-19 14:25:31.393929 | aio | 2026-05-19 14:25:31.394171 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 14:25:31.394213 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.238) 0:03:31.741 *********** 2026-05-19 14:25:31.596744 | aio | ok: [aio] 2026-05-19 14:25:31.596808 | aio | 2026-05-19 14:25:31.597027 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-19 14:25:31.597070 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.203) 0:03:31.944 *********** 2026-05-19 14:25:31.815035 | aio | ok: [aio] => (item=aio) 2026-05-19 14:25:31.815321 | aio | 2026-05-19 14:25:31.815387 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-19 14:25:31.815504 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.218) 0:03:32.162 *********** 2026-05-19 14:25:31.855975 | aio | ok: [aio] 2026-05-19 14:25:31.856048 | aio | 2026-05-19 14:25:31.856244 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:25:31.856287 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.041) 0:03:32.203 *********** 2026-05-19 14:25:31.910583 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:25:31.910635 | aio | 2026-05-19 14:25:31.910854 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:25:31.910901 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.054) 0:03:32.258 *********** 2026-05-19 14:25:31.956357 | aio | skipping: [aio] 2026-05-19 14:25:31.956435 | aio | 2026-05-19 14:25:31.956500 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:25:31.956595 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.045) 0:03:32.304 *********** 2026-05-19 14:25:31.994513 | aio | skipping: [aio] => (item=aio) 2026-05-19 14:25:31.994587 | aio | skipping: [aio] 2026-05-19 14:25:31.994901 | aio | 2026-05-19 14:25:31.995109 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:25:31.995117 | aio | Tuesday 19 May 2026 14:25:31 +0000 (0:00:00.038) 0:03:32.342 *********** 2026-05-19 14:25:32.270948 | aio | ok: [aio] 2026-05-19 14:25:32.271640 | aio | 2026-05-19 14:25:32.271688 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:25:32.271694 | aio | Tuesday 19 May 2026 14:25:32 +0000 (0:00:00.276) 0:03:32.618 *********** 2026-05-19 14:25:38.699408 | aio | ok: [aio] 2026-05-19 14:25:38.699488 | aio | 2026-05-19 14:25:38.699705 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-19 14:25:38.699746 | aio | Tuesday 19 May 2026 14:25:38 +0000 (0:00:06.428) 0:03:39.047 *********** 2026-05-19 14:25:43.983741 | aio | ok: [aio] 2026-05-19 14:25:43.983824 | aio | 2026-05-19 14:25:43.984024 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-19 14:25:43.984074 | aio | Tuesday 19 May 2026 14:25:43 +0000 (0:00:05.284) 0:03:44.331 *********** 2026-05-19 14:25:57.843096 | aio | ok: [aio] 2026-05-19 14:25:57.843192 | aio | 2026-05-19 14:25:57.843523 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-19 14:25:57.843546 | aio | Tuesday 19 May 2026 14:25:57 +0000 (0:00:13.859) 0:03:58.191 *********** 2026-05-19 14:27:28.244633 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-19 14:27:28.244698 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-19 14:27:28.244856 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-19 14:27:28.244992 | aio | 2026-05-19 14:27:28.245142 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-19 14:27:28.245286 | aio | Tuesday 19 May 2026 14:27:28 +0000 (0:01:30.401) 0:05:28.592 *********** 2026-05-19 14:27:34.435003 | aio | ok: [aio] 2026-05-19 14:27:34.435068 | aio | 2026-05-19 14:27:34.435075 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-19 14:27:34.435081 | aio | Tuesday 19 May 2026 14:27:34 +0000 (0:00:06.190) 0:05:34.782 *********** 2026-05-19 14:27:40.493054 | aio | ok: [aio] 2026-05-19 14:27:40.493150 | aio | 2026-05-19 14:27:40.493319 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-19 14:27:40.493346 | aio | Tuesday 19 May 2026 14:27:40 +0000 (0:00:06.057) 0:05:40.840 *********** 2026-05-19 14:27:40.553619 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-19 14:27:40.553718 | aio | 2026-05-19 14:27:40.553731 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-19 14:27:40.553827 | aio | Tuesday 19 May 2026 14:27:40 +0000 (0:00:00.060) 0:05:40.901 *********** 2026-05-19 14:27:40.592055 | aio | ok: [aio] 2026-05-19 14:27:40.592486 | aio | 2026-05-19 14:27:40.592546 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-19 14:27:40.592554 | aio | Tuesday 19 May 2026 14:27:40 +0000 (0:00:00.038) 0:05:40.939 *********** 2026-05-19 14:27:46.648581 | aio | ok: [aio] 2026-05-19 14:27:46.648715 | aio | 2026-05-19 14:27:46.649288 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-19 14:27:46.649364 | aio | Tuesday 19 May 2026 14:27:46 +0000 (0:00:06.056) 0:05:46.995 *********** 2026-05-19 14:27:46.691824 | aio | ok: [aio] 2026-05-19 14:27:46.692314 | aio | 2026-05-19 14:27:46.692380 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-19 14:27:46.692388 | aio | Tuesday 19 May 2026 14:27:46 +0000 (0:00:00.043) 0:05:47.039 *********** 2026-05-19 14:27:46.735319 | aio | skipping: [aio] => (item=1) 2026-05-19 14:27:46.735433 | aio | skipping: [aio] => (item=1) 2026-05-19 14:27:46.736094 | aio | skipping: [aio] => (item=1) 2026-05-19 14:27:46.736175 | aio | skipping: [aio] 2026-05-19 14:27:46.736184 | aio | 2026-05-19 14:27:46.736191 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-19 14:27:46.736198 | aio | Tuesday 19 May 2026 14:27:46 +0000 (0:00:00.043) 0:05:47.082 *********** 2026-05-19 14:27:46.769493 | aio | skipping: [aio] 2026-05-19 14:27:46.769549 | aio | 2026-05-19 14:27:46.771382 | aio | PLAY RECAP ********************************************************************* 2026-05-19 14:27:46.771440 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-05-19 14:27:46.771453 | aio | 2026-05-19 14:27:46.771463 | aio | 2026-05-19 14:27:46.771472 | aio | TASKS RECAP ******************************************************************** 2026-05-19 14:27:46.771482 | aio | Tuesday 19 May 2026 14:27:46 +0000 (0:00:00.034) 0:05:47.117 *********** 2026-05-19 14:27:46.771491 | aio | =============================================================================== 2026-05-19 14:27:46.771501 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 90.40s 2026-05-19 14:27:46.771511 | aio | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 85.22s 2026-05-19 14:27:46.771520 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.07s 2026-05-19 14:27:46.771530 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.86s 2026-05-19 14:27:46.771539 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.18s 2026-05-19 14:27:46.771548 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.55s 2026-05-19 14:27:46.771556 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.44s 2026-05-19 14:27:46.771565 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.43s 2026-05-19 14:27:46.771574 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.43s 2026-05-19 14:27:46.771583 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.30s 2026-05-19 14:27:46.771599 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.19s 2026-05-19 14:27:46.771609 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.06s 2026-05-19 14:27:46.771618 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.06s 2026-05-19 14:27:46.771737 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.89s 2026-05-19 14:27:46.771947 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.55s 2026-05-19 14:27:46.772095 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 5.42s 2026-05-19 14:27:46.772224 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.28s 2026-05-19 14:27:46.772349 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.21s 2026-05-19 14:27:46.772491 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.36s 2026-05-19 14:27:46.772616 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-05-19 14:27:46.886253 | aio | INFO [default > converge] Executed: Successful 2026-05-19 14:27:46.895022 | aio | INFO [default > idempotence] Executing 2026-05-19 14:27:47.794803 | aio | 2026-05-19 14:27:47.795311 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-05-19 14:27:47.795685 | aio | 2026-05-19 14:27:47.796053 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:27:47.796378 | aio | Tuesday 19 May 2026 14:27:47 +0000 (0:00:00.058) 0:00:00.058 *********** 2026-05-19 14:27:48.995262 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 14:27:48.995326 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 14:27:48.995338 | aio | interpreter could change the meaning of that path. See 2026-05-19 14:27:48.995348 | aio | https://docs.ansible.com/ansible- 2026-05-19 14:27:48.995375 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 14:27:49.009910 | aio | ok: [aio] 2026-05-19 14:27:49.009944 | aio | 2026-05-19 14:27:49.009956 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:27:49.009967 | aio | Tuesday 19 May 2026 14:27:49 +0000 (0:00:01.214) 0:00:01.273 *********** 2026-05-19 14:27:49.323232 | aio | ok: [aio] 2026-05-19 14:27:49.323299 | aio | 2026-05-19 14:27:49.323311 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:27:49.323332 | aio | Tuesday 19 May 2026 14:27:49 +0000 (0:00:00.312) 0:00:01.586 *********** 2026-05-19 14:27:49.363405 | aio | skipping: [aio] 2026-05-19 14:27:49.363492 | aio | 2026-05-19 14:27:49.363644 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 14:27:49.363858 | aio | Tuesday 19 May 2026 14:27:49 +0000 (0:00:00.041) 0:00:01.627 *********** 2026-05-19 14:27:49.688274 | aio | ok: [aio] 2026-05-19 14:27:49.688464 | aio | 2026-05-19 14:27:49.688797 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:27:49.689116 | aio | Tuesday 19 May 2026 14:27:49 +0000 (0:00:00.324) 0:00:01.952 *********** 2026-05-19 14:27:49.763421 | aio | ok: [aio] => { 2026-05-19 14:27:49.763604 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 14:27:49.763799 | aio | } 2026-05-19 14:27:49.763986 | aio | 2026-05-19 14:27:49.764203 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:27:49.764411 | aio | Tuesday 19 May 2026 14:27:49 +0000 (0:00:00.075) 0:00:02.027 *********** 2026-05-19 14:27:50.169956 | aio | ok: [aio] 2026-05-19 14:27:50.170009 | aio | 2026-05-19 14:27:50.170017 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:27:50.170023 | aio | Tuesday 19 May 2026 14:27:50 +0000 (0:00:00.406) 0:00:02.434 *********** 2026-05-19 14:27:50.214053 | aio | skipping: [aio] 2026-05-19 14:27:50.214116 | aio | 2026-05-19 14:27:50.214460 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:27:50.214545 | aio | Tuesday 19 May 2026 14:27:50 +0000 (0:00:00.044) 0:00:02.478 *********** 2026-05-19 14:27:50.255269 | aio | skipping: [aio] 2026-05-19 14:27:50.255355 | aio | 2026-05-19 14:27:50.255369 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:27:50.255506 | aio | Tuesday 19 May 2026 14:27:50 +0000 (0:00:00.041) 0:00:02.519 *********** 2026-05-19 14:27:50.456229 | aio | ok: [aio] 2026-05-19 14:27:50.456305 | aio | 2026-05-19 14:27:50.456509 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:27:50.456556 | aio | Tuesday 19 May 2026 14:27:50 +0000 (0:00:00.201) 0:00:02.721 *********** 2026-05-19 14:27:51.852767 | aio | ok: [aio] 2026-05-19 14:27:51.853506 | aio | 2026-05-19 14:27:51.853577 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:27:51.853589 | aio | Tuesday 19 May 2026 14:27:51 +0000 (0:00:01.396) 0:00:04.117 *********** 2026-05-19 14:27:51.931376 | aio | ok: [aio] => { 2026-05-19 14:27:51.931877 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 14:27:51.931910 | aio | } 2026-05-19 14:27:51.931916 | aio | 2026-05-19 14:27:51.931920 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:27:51.931925 | aio | Tuesday 19 May 2026 14:27:51 +0000 (0:00:00.078) 0:00:04.196 *********** 2026-05-19 14:27:52.275463 | aio | ok: [aio] 2026-05-19 14:27:52.275533 | aio | 2026-05-19 14:27:52.275791 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:27:52.275813 | aio | Tuesday 19 May 2026 14:27:52 +0000 (0:00:00.343) 0:00:04.540 *********** 2026-05-19 14:27:54.487271 | aio | ok: [aio] 2026-05-19 14:27:54.487415 | aio | 2026-05-19 14:27:54.487517 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 14:27:54.487620 | aio | Tuesday 19 May 2026 14:27:54 +0000 (0:00:02.212) 0:00:06.752 *********** 2026-05-19 14:27:54.517906 | aio | skipping: [aio] 2026-05-19 14:27:54.518090 | aio | 2026-05-19 14:27:54.518332 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 14:27:54.518545 | aio | Tuesday 19 May 2026 14:27:54 +0000 (0:00:00.030) 0:00:06.782 *********** 2026-05-19 14:27:54.541922 | aio | skipping: [aio] 2026-05-19 14:27:54.542100 | aio | 2026-05-19 14:27:54.542315 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 14:27:54.542519 | aio | Tuesday 19 May 2026 14:27:54 +0000 (0:00:00.024) 0:00:06.806 *********** 2026-05-19 14:27:54.570832 | aio | skipping: [aio] 2026-05-19 14:27:54.571078 | aio | 2026-05-19 14:27:54.571446 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 14:27:54.571668 | aio | Tuesday 19 May 2026 14:27:54 +0000 (0:00:00.028) 0:00:06.835 *********** 2026-05-19 14:27:55.555167 | aio | ok: [aio] 2026-05-19 14:27:55.555364 | aio | 2026-05-19 14:27:55.555576 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 14:27:55.555775 | aio | Tuesday 19 May 2026 14:27:55 +0000 (0:00:00.984) 0:00:07.819 *********** 2026-05-19 14:27:56.022493 | aio | ok: [aio] 2026-05-19 14:27:56.022570 | aio | 2026-05-19 14:27:56.022723 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 14:27:56.022863 | aio | Tuesday 19 May 2026 14:27:56 +0000 (0:00:00.467) 0:00:08.286 *********** 2026-05-19 14:27:56.926169 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 14:27:56.926399 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 14:27:56.926640 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 14:27:56.926888 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 14:27:56.927125 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 14:27:56.927411 | aio | 2026-05-19 14:27:56.927659 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 14:27:56.927882 | aio | Tuesday 19 May 2026 14:27:56 +0000 (0:00:00.903) 0:00:09.190 *********** 2026-05-19 14:27:57.434728 | aio | ok: [aio] 2026-05-19 14:27:57.434801 | aio | 2026-05-19 14:27:57.434869 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 14:27:57.434970 | aio | Tuesday 19 May 2026 14:27:57 +0000 (0:00:00.500) 0:00:09.691 *********** 2026-05-19 14:27:57.435056 | aio | 2026-05-19 14:27:57.435157 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 14:27:57.435310 | aio | Tuesday 19 May 2026 14:27:57 +0000 (0:00:00.008) 0:00:09.699 *********** 2026-05-19 14:27:58.026147 | aio | ok: [aio] 2026-05-19 14:27:58.026213 | aio | 2026-05-19 14:27:58.026225 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:27:58.026235 | aio | Tuesday 19 May 2026 14:27:58 +0000 (0:00:00.590) 0:00:10.289 *********** 2026-05-19 14:27:58.222350 | aio | ok: [aio] 2026-05-19 14:27:58.222415 | aio | 2026-05-19 14:27:58.222503 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:27:58.222640 | aio | Tuesday 19 May 2026 14:27:58 +0000 (0:00:00.197) 0:00:10.487 *********** 2026-05-19 14:27:58.290190 | aio | ok: [aio] => { 2026-05-19 14:27:58.290278 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 14:27:58.290295 | aio | } 2026-05-19 14:27:58.290380 | aio | 2026-05-19 14:27:58.290599 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:27:58.290650 | aio | Tuesday 19 May 2026 14:27:58 +0000 (0:00:00.067) 0:00:10.555 *********** 2026-05-19 14:27:58.646024 | aio | ok: [aio] 2026-05-19 14:27:58.646070 | aio | 2026-05-19 14:27:58.646081 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:27:58.646086 | aio | Tuesday 19 May 2026 14:27:58 +0000 (0:00:00.355) 0:00:10.910 *********** 2026-05-19 14:28:01.788758 | aio | ok: [aio] 2026-05-19 14:28:01.788831 | aio | 2026-05-19 14:28:01.789175 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 14:28:01.789235 | aio | Tuesday 19 May 2026 14:28:01 +0000 (0:00:03.142) 0:00:14.053 *********** 2026-05-19 14:28:02.814837 | aio | ok: [aio] 2026-05-19 14:28:02.814940 | aio | 2026-05-19 14:28:02.814960 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 14:28:02.815106 | aio | Tuesday 19 May 2026 14:28:02 +0000 (0:00:01.026) 0:00:15.079 *********** 2026-05-19 14:28:03.118871 | aio | ok: [aio] 2026-05-19 14:28:03.118962 | aio | 2026-05-19 14:28:03.118984 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 14:28:03.119147 | aio | Tuesday 19 May 2026 14:28:03 +0000 (0:00:00.303) 0:00:15.383 *********** 2026-05-19 14:28:03.545671 | aio | ok: [aio] 2026-05-19 14:28:03.545755 | aio | 2026-05-19 14:28:03.546107 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 14:28:03.546157 | aio | Tuesday 19 May 2026 14:28:03 +0000 (0:00:00.427) 0:00:15.810 *********** 2026-05-19 14:28:04.135248 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 14:28:04.136131 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 14:28:04.136160 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 14:28:04.136170 | aio | 2026-05-19 14:28:04.136179 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 14:28:04.136188 | aio | Tuesday 19 May 2026 14:28:04 +0000 (0:00:00.589) 0:00:16.399 *********** 2026-05-19 14:28:04.540389 | aio | ok: [aio] 2026-05-19 14:28:04.540462 | aio | 2026-05-19 14:28:04.540784 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 14:28:04.540806 | aio | Tuesday 19 May 2026 14:28:04 +0000 (0:00:00.405) 0:00:16.805 *********** 2026-05-19 14:28:04.993631 | aio | ok: [aio] 2026-05-19 14:28:04.993708 | aio | 2026-05-19 14:28:04.994198 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 14:28:04.994253 | aio | Tuesday 19 May 2026 14:28:04 +0000 (0:00:00.446) 0:00:17.251 *********** 2026-05-19 14:28:04.994260 | aio | 2026-05-19 14:28:04.994265 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 14:28:04.994269 | aio | Tuesday 19 May 2026 14:28:04 +0000 (0:00:00.006) 0:00:17.258 *********** 2026-05-19 14:28:05.355180 | aio | ok: [aio] 2026-05-19 14:28:05.355295 | aio | 2026-05-19 14:28:05.355552 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 14:28:05.355606 | aio | Tuesday 19 May 2026 14:28:05 +0000 (0:00:00.361) 0:00:17.619 *********** 2026-05-19 14:28:05.402042 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 14:28:05.402122 | aio | 2026-05-19 14:28:05.402184 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 14:28:05.402318 | aio | Tuesday 19 May 2026 14:28:05 +0000 (0:00:00.046) 0:00:17.666 *********** 2026-05-19 14:28:06.549705 | aio | ok: [aio] 2026-05-19 14:28:06.550167 | aio | 2026-05-19 14:28:06.550220 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 14:28:06.550229 | aio | Tuesday 19 May 2026 14:28:06 +0000 (0:00:01.147) 0:00:18.814 *********** 2026-05-19 14:28:07.178881 | aio | ok: [aio] => (item=chronyd) 2026-05-19 14:28:07.178965 | aio | ok: [aio] => (item=sshd) 2026-05-19 14:28:07.179478 | aio | 2026-05-19 14:28:07.179537 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 14:28:07.179545 | aio | Tuesday 19 May 2026 14:28:07 +0000 (0:00:00.629) 0:00:19.443 *********** 2026-05-19 14:28:07.615900 | aio | ok: [aio] 2026-05-19 14:28:07.615961 | aio | 2026-05-19 14:28:07.616053 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 14:28:07.616201 | aio | Tuesday 19 May 2026 14:28:07 +0000 (0:00:00.437) 0:00:19.880 *********** 2026-05-19 14:28:07.806010 | aio | ok: [aio] 2026-05-19 14:28:07.806099 | aio | 2026-05-19 14:28:07.806166 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 14:28:07.806314 | aio | Tuesday 19 May 2026 14:28:07 +0000 (0:00:00.190) 0:00:20.070 *********** 2026-05-19 14:28:08.237367 | aio | ok: [aio] 2026-05-19 14:28:08.237445 | aio | 2026-05-19 14:28:08.237503 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 14:28:08.237644 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.431) 0:00:20.502 *********** 2026-05-19 14:28:08.579911 | aio | ok: [aio] 2026-05-19 14:28:08.579987 | aio | 2026-05-19 14:28:08.580001 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-05-19 14:28:08.580141 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.342) 0:00:20.844 *********** 2026-05-19 14:28:08.665037 | aio | ok: [aio] 2026-05-19 14:28:08.665121 | aio | 2026-05-19 14:28:08.665181 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-05-19 14:28:08.665318 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.085) 0:00:20.929 *********** 2026-05-19 14:28:08.912382 | aio | ok: [aio] => (item=aio) 2026-05-19 14:28:08.912455 | aio | 2026-05-19 14:28:08.912762 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-05-19 14:28:08.912813 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.247) 0:00:21.177 *********** 2026-05-19 14:28:08.956910 | aio | ok: [aio] 2026-05-19 14:28:08.956969 | aio | 2026-05-19 14:28:08.957197 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-05-19 14:28:08.957214 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.044) 0:00:21.221 *********** 2026-05-19 14:28:08.997595 | aio | skipping: [aio] 2026-05-19 14:28:08.997674 | aio | 2026-05-19 14:28:08.997988 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:28:08.998038 | aio | Tuesday 19 May 2026 14:28:08 +0000 (0:00:00.040) 0:00:21.262 *********** 2026-05-19 14:28:09.067699 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:28:09.067746 | aio | 2026-05-19 14:28:09.067997 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:28:09.068048 | aio | Tuesday 19 May 2026 14:28:09 +0000 (0:00:00.070) 0:00:21.332 *********** 2026-05-19 14:28:15.131872 | aio | ok: [aio] 2026-05-19 14:28:15.131963 | aio | 2026-05-19 14:28:15.132156 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:28:15.132205 | aio | Tuesday 19 May 2026 14:28:15 +0000 (0:00:06.064) 0:00:27.396 *********** 2026-05-19 14:28:15.181290 | aio | ok: [aio] => (item=aio) 2026-05-19 14:28:15.181337 | aio | 2026-05-19 14:28:15.181597 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:28:15.181653 | aio | Tuesday 19 May 2026 14:28:15 +0000 (0:00:00.049) 0:00:27.446 *********** 2026-05-19 14:28:15.566541 | aio | ok: [aio] 2026-05-19 14:28:15.566617 | aio | 2026-05-19 14:28:15.566832 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:28:15.566903 | aio | Tuesday 19 May 2026 14:28:15 +0000 (0:00:00.385) 0:00:27.831 *********** 2026-05-19 14:28:22.083480 | aio | ok: [aio] 2026-05-19 14:28:22.083577 | aio | 2026-05-19 14:28:22.083590 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-05-19 14:28:22.083762 | aio | Tuesday 19 May 2026 14:28:22 +0000 (0:00:06.516) 0:00:34.347 *********** 2026-05-19 14:28:28.386147 | aio | ok: [aio] 2026-05-19 14:28:28.386248 | aio | 2026-05-19 14:28:28.386260 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-05-19 14:28:28.386407 | aio | Tuesday 19 May 2026 14:28:28 +0000 (0:00:06.303) 0:00:40.651 *********** 2026-05-19 14:28:42.534384 | aio | ok: [aio] 2026-05-19 14:28:42.534475 | aio | 2026-05-19 14:28:42.534490 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:28:42.534647 | aio | Tuesday 19 May 2026 14:28:42 +0000 (0:00:14.147) 0:00:54.799 *********** 2026-05-19 14:28:42.602584 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:28:42.602682 | aio | 2026-05-19 14:28:42.602698 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:28:42.602775 | aio | Tuesday 19 May 2026 14:28:42 +0000 (0:00:00.067) 0:00:54.866 *********** 2026-05-19 14:28:42.653691 | aio | skipping: [aio] 2026-05-19 14:28:42.653769 | aio | 2026-05-19 14:28:42.653977 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:28:42.654034 | aio | Tuesday 19 May 2026 14:28:42 +0000 (0:00:00.051) 0:00:54.918 *********** 2026-05-19 14:28:42.700293 | aio | skipping: [aio] => (item=aio) 2026-05-19 14:28:42.700349 | aio | skipping: [aio] 2026-05-19 14:28:42.700687 | aio | 2026-05-19 14:28:42.700749 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:28:42.700755 | aio | Tuesday 19 May 2026 14:28:42 +0000 (0:00:00.046) 0:00:54.964 *********** 2026-05-19 14:28:42.975122 | aio | ok: [aio] 2026-05-19 14:28:42.975181 | aio | 2026-05-19 14:28:42.975217 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:28:42.975224 | aio | Tuesday 19 May 2026 14:28:42 +0000 (0:00:00.274) 0:00:55.239 *********** 2026-05-19 14:28:49.461500 | aio | ok: [aio] 2026-05-19 14:28:49.461596 | aio | 2026-05-19 14:28:49.461684 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-05-19 14:28:49.461788 | aio | Tuesday 19 May 2026 14:28:49 +0000 (0:00:06.486) 0:01:01.726 *********** 2026-05-19 14:28:55.486898 | aio | ok: [aio] 2026-05-19 14:28:55.486994 | aio | 2026-05-19 14:28:55.487066 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-05-19 14:28:55.487264 | aio | Tuesday 19 May 2026 14:28:55 +0000 (0:00:06.025) 0:01:07.751 *********** 2026-05-19 14:29:01.594773 | aio | ok: [aio] 2026-05-19 14:29:01.594868 | aio | 2026-05-19 14:29:01.594930 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-05-19 14:29:01.595064 | aio | Tuesday 19 May 2026 14:29:01 +0000 (0:00:06.107) 0:01:13.859 *********** 2026-05-19 14:29:06.391279 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-05-19 14:29:06.391387 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-05-19 14:29:06.391400 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-05-19 14:29:06.392107 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-05-19 14:29:06.392172 | aio | 2026-05-19 14:29:06.392178 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-05-19 14:29:06.392183 | aio | 2026-05-19 14:29:06.392187 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:29:06.392192 | aio | Tuesday 19 May 2026 14:29:06 +0000 (0:00:04.796) 0:01:18.655 *********** 2026-05-19 14:29:07.274274 | aio | ok: [aio] 2026-05-19 14:29:07.274368 | aio | 2026-05-19 14:29:07.274383 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:29:07.274545 | aio | Tuesday 19 May 2026 14:29:07 +0000 (0:00:00.882) 0:01:19.538 *********** 2026-05-19 14:29:07.474455 | aio | ok: [aio] 2026-05-19 14:29:07.474534 | aio | 2026-05-19 14:29:07.474787 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:29:07.474847 | aio | Tuesday 19 May 2026 14:29:07 +0000 (0:00:00.200) 0:01:19.739 *********** 2026-05-19 14:29:07.509380 | aio | skipping: [aio] 2026-05-19 14:29:07.509453 | aio | 2026-05-19 14:29:07.509683 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-05-19 14:29:07.509730 | aio | Tuesday 19 May 2026 14:29:07 +0000 (0:00:00.034) 0:01:19.774 *********** 2026-05-19 14:29:07.730576 | aio | ok: [aio] 2026-05-19 14:29:07.730666 | aio | 2026-05-19 14:29:07.730680 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:29:07.730838 | aio | Tuesday 19 May 2026 14:29:07 +0000 (0:00:00.221) 0:01:19.995 *********** 2026-05-19 14:29:07.806122 | aio | ok: [aio] => { 2026-05-19 14:29:07.806226 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-05-19 14:29:07.806771 | aio | } 2026-05-19 14:29:07.806832 | aio | 2026-05-19 14:29:07.806840 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:29:07.806847 | aio | Tuesday 19 May 2026 14:29:07 +0000 (0:00:00.075) 0:01:20.070 *********** 2026-05-19 14:29:08.151557 | aio | ok: [aio] 2026-05-19 14:29:08.151643 | aio | 2026-05-19 14:29:08.151946 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:29:08.152010 | aio | Tuesday 19 May 2026 14:29:08 +0000 (0:00:00.345) 0:01:20.416 *********** 2026-05-19 14:29:08.195600 | aio | skipping: [aio] 2026-05-19 14:29:08.195687 | aio | 2026-05-19 14:29:08.195749 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:29:08.195885 | aio | Tuesday 19 May 2026 14:29:08 +0000 (0:00:00.044) 0:01:20.460 *********** 2026-05-19 14:29:08.234900 | aio | skipping: [aio] 2026-05-19 14:29:08.234985 | aio | 2026-05-19 14:29:08.235043 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:29:08.235180 | aio | Tuesday 19 May 2026 14:29:08 +0000 (0:00:00.039) 0:01:20.499 *********** 2026-05-19 14:29:08.443811 | aio | ok: [aio] 2026-05-19 14:29:08.443899 | aio | 2026-05-19 14:29:08.443959 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-05-19 14:29:08.444099 | aio | Tuesday 19 May 2026 14:29:08 +0000 (0:00:00.208) 0:01:20.708 *********** 2026-05-19 14:29:09.541928 | aio | ok: [aio] 2026-05-19 14:29:09.542030 | aio | 2026-05-19 14:29:09.542051 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:29:09.542197 | aio | Tuesday 19 May 2026 14:29:09 +0000 (0:00:01.098) 0:01:21.806 *********** 2026-05-19 14:29:09.628239 | aio | ok: [aio] => { 2026-05-19 14:29:09.628953 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-05-19 14:29:09.629017 | aio | } 2026-05-19 14:29:09.629024 | aio | 2026-05-19 14:29:09.629031 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:29:09.629037 | aio | Tuesday 19 May 2026 14:29:09 +0000 (0:00:00.085) 0:01:21.892 *********** 2026-05-19 14:29:10.003568 | aio | ok: [aio] 2026-05-19 14:29:10.003641 | aio | 2026-05-19 14:29:10.003988 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:29:10.004046 | aio | Tuesday 19 May 2026 14:29:10 +0000 (0:00:00.375) 0:01:22.268 *********** 2026-05-19 14:29:11.988718 | aio | ok: [aio] 2026-05-19 14:29:11.988771 | aio | 2026-05-19 14:29:11.988776 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-05-19 14:29:11.988781 | aio | Tuesday 19 May 2026 14:29:11 +0000 (0:00:01.985) 0:01:24.253 *********** 2026-05-19 14:29:12.016381 | aio | skipping: [aio] 2026-05-19 14:29:12.016436 | aio | 2026-05-19 14:29:12.016442 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-05-19 14:29:12.016447 | aio | Tuesday 19 May 2026 14:29:12 +0000 (0:00:00.027) 0:01:24.281 *********** 2026-05-19 14:29:12.046405 | aio | skipping: [aio] 2026-05-19 14:29:12.046484 | aio | 2026-05-19 14:29:12.046497 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-05-19 14:29:12.046518 | aio | Tuesday 19 May 2026 14:29:12 +0000 (0:00:00.029) 0:01:24.310 *********** 2026-05-19 14:29:12.073054 | aio | skipping: [aio] 2026-05-19 14:29:12.073131 | aio | 2026-05-19 14:29:12.073309 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-05-19 14:29:12.073348 | aio | Tuesday 19 May 2026 14:29:12 +0000 (0:00:00.027) 0:01:24.337 *********** 2026-05-19 14:29:13.065970 | aio | ok: [aio] 2026-05-19 14:29:13.066049 | aio | 2026-05-19 14:29:13.066247 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-05-19 14:29:13.066311 | aio | Tuesday 19 May 2026 14:29:13 +0000 (0:00:00.992) 0:01:25.329 *********** 2026-05-19 14:29:13.493466 | aio | ok: [aio] 2026-05-19 14:29:13.493535 | aio | 2026-05-19 14:29:13.493834 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-05-19 14:29:13.493856 | aio | Tuesday 19 May 2026 14:29:13 +0000 (0:00:00.428) 0:01:25.758 *********** 2026-05-19 14:29:14.400853 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-05-19 14:29:14.400975 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-05-19 14:29:14.401036 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-05-19 14:29:14.401517 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-05-19 14:29:14.401568 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-05-19 14:29:14.401574 | aio | 2026-05-19 14:29:14.401580 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-05-19 14:29:14.401584 | aio | Tuesday 19 May 2026 14:29:14 +0000 (0:00:00.907) 0:01:26.665 *********** 2026-05-19 14:29:14.896064 | aio | ok: [aio] 2026-05-19 14:29:14.896146 | aio | 2026-05-19 14:29:14.896161 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-05-19 14:29:14.896629 | aio | Tuesday 19 May 2026 14:29:14 +0000 (0:00:00.488) 0:01:27.154 *********** 2026-05-19 14:29:14.896687 | aio | 2026-05-19 14:29:14.896698 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-05-19 14:29:14.896703 | aio | Tuesday 19 May 2026 14:29:14 +0000 (0:00:00.006) 0:01:27.160 *********** 2026-05-19 14:29:15.253713 | aio | ok: [aio] 2026-05-19 14:29:15.253771 | aio | 2026-05-19 14:29:15.253776 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-05-19 14:29:15.253782 | aio | Tuesday 19 May 2026 14:29:15 +0000 (0:00:00.357) 0:01:27.518 *********** 2026-05-19 14:29:15.461850 | aio | ok: [aio] 2026-05-19 14:29:15.462077 | aio | 2026-05-19 14:29:15.462084 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-05-19 14:29:15.462088 | aio | Tuesday 19 May 2026 14:29:15 +0000 (0:00:00.207) 0:01:27.726 *********** 2026-05-19 14:29:15.526732 | aio | ok: [aio] => { 2026-05-19 14:29:15.527362 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-05-19 14:29:15.527437 | aio | } 2026-05-19 14:29:15.527445 | aio | 2026-05-19 14:29:15.527451 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-05-19 14:29:15.527457 | aio | Tuesday 19 May 2026 14:29:15 +0000 (0:00:00.065) 0:01:27.791 *********** 2026-05-19 14:29:15.880688 | aio | ok: [aio] 2026-05-19 14:29:15.880762 | aio | 2026-05-19 14:29:15.880950 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-05-19 14:29:15.880967 | aio | Tuesday 19 May 2026 14:29:15 +0000 (0:00:00.354) 0:01:28.145 *********** 2026-05-19 14:29:18.961089 | aio | ok: [aio] 2026-05-19 14:29:18.961178 | aio | 2026-05-19 14:29:18.961240 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-05-19 14:29:18.961374 | aio | Tuesday 19 May 2026 14:29:18 +0000 (0:00:03.080) 0:01:31.225 *********** 2026-05-19 14:29:20.095738 | aio | ok: [aio] 2026-05-19 14:29:20.095851 | aio | 2026-05-19 14:29:20.095915 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-05-19 14:29:20.096052 | aio | Tuesday 19 May 2026 14:29:20 +0000 (0:00:01.134) 0:01:32.360 *********** 2026-05-19 14:29:20.282717 | aio | ok: [aio] 2026-05-19 14:29:20.282796 | aio | 2026-05-19 14:29:20.283142 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-05-19 14:29:20.283221 | aio | Tuesday 19 May 2026 14:29:20 +0000 (0:00:00.186) 0:01:32.547 *********** 2026-05-19 14:29:20.714568 | aio | ok: [aio] 2026-05-19 14:29:20.715144 | aio | 2026-05-19 14:29:20.715175 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-05-19 14:29:20.715224 | aio | Tuesday 19 May 2026 14:29:20 +0000 (0:00:00.431) 0:01:32.979 *********** 2026-05-19 14:29:21.257711 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-05-19 14:29:21.257782 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-05-19 14:29:21.257792 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-05-19 14:29:21.257799 | aio | 2026-05-19 14:29:21.257804 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-05-19 14:29:21.257810 | aio | Tuesday 19 May 2026 14:29:21 +0000 (0:00:00.542) 0:01:33.521 *********** 2026-05-19 14:29:21.689220 | aio | ok: [aio] 2026-05-19 14:29:21.689303 | aio | 2026-05-19 14:29:21.689509 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-05-19 14:29:21.689569 | aio | Tuesday 19 May 2026 14:29:21 +0000 (0:00:00.431) 0:01:33.953 *********** 2026-05-19 14:29:22.131803 | aio | ok: [aio] 2026-05-19 14:29:22.131874 | aio | 2026-05-19 14:29:22.132308 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-05-19 14:29:22.132323 | aio | Tuesday 19 May 2026 14:29:22 +0000 (0:00:00.438) 0:01:34.391 *********** 2026-05-19 14:29:22.132329 | aio | 2026-05-19 14:29:22.132333 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-05-19 14:29:22.132337 | aio | Tuesday 19 May 2026 14:29:22 +0000 (0:00:00.005) 0:01:34.396 *********** 2026-05-19 14:29:22.480465 | aio | ok: [aio] 2026-05-19 14:29:22.480541 | aio | 2026-05-19 14:29:22.480748 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-05-19 14:29:22.480796 | aio | Tuesday 19 May 2026 14:29:22 +0000 (0:00:00.348) 0:01:34.745 *********** 2026-05-19 14:29:22.528204 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-05-19 14:29:22.528285 | aio | 2026-05-19 14:29:22.528548 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-05-19 14:29:22.528580 | aio | Tuesday 19 May 2026 14:29:22 +0000 (0:00:00.047) 0:01:34.792 *********** 2026-05-19 14:29:23.656674 | aio | ok: [aio] 2026-05-19 14:29:23.656911 | aio | 2026-05-19 14:29:23.656925 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-05-19 14:29:23.656935 | aio | Tuesday 19 May 2026 14:29:23 +0000 (0:00:01.128) 0:01:35.921 *********** 2026-05-19 14:29:24.286607 | aio | ok: [aio] => (item=chronyd) 2026-05-19 14:29:24.286700 | aio | ok: [aio] => (item=sshd) 2026-05-19 14:29:24.287105 | aio | 2026-05-19 14:29:24.287126 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-05-19 14:29:24.287133 | aio | Tuesday 19 May 2026 14:29:24 +0000 (0:00:00.629) 0:01:36.551 *********** 2026-05-19 14:29:24.565884 | aio | ok: [aio] 2026-05-19 14:29:24.566373 | aio | 2026-05-19 14:29:24.566397 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-05-19 14:29:24.566405 | aio | Tuesday 19 May 2026 14:29:24 +0000 (0:00:00.279) 0:01:36.830 *********** 2026-05-19 14:29:24.769475 | aio | ok: [aio] 2026-05-19 14:29:24.769559 | aio | 2026-05-19 14:29:24.769764 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-05-19 14:29:24.769812 | aio | Tuesday 19 May 2026 14:29:24 +0000 (0:00:00.203) 0:01:37.034 *********** 2026-05-19 14:29:25.010979 | aio | ok: [aio] 2026-05-19 14:29:25.011035 | aio | 2026-05-19 14:29:25.011043 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-05-19 14:29:25.011050 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.240) 0:01:37.275 *********** 2026-05-19 14:29:25.229640 | aio | ok: [aio] 2026-05-19 14:29:25.229712 | aio | 2026-05-19 14:29:25.229920 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-05-19 14:29:25.229978 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.219) 0:01:37.494 *********** 2026-05-19 14:29:25.453568 | aio | ok: [aio] => (item=aio) 2026-05-19 14:29:25.453654 | aio | 2026-05-19 14:29:25.453957 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-05-19 14:29:25.454014 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.223) 0:01:37.718 *********** 2026-05-19 14:29:25.497297 | aio | ok: [aio] 2026-05-19 14:29:25.497752 | aio | 2026-05-19 14:29:25.497812 | aio | TASK [Install Ceph host] ******************************************************* 2026-05-19 14:29:25.497820 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.043) 0:01:37.761 *********** 2026-05-19 14:29:25.548224 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-05-19 14:29:25.548313 | aio | 2026-05-19 14:29:25.548324 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-05-19 14:29:25.548445 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.051) 0:01:37.813 *********** 2026-05-19 14:29:25.589558 | aio | skipping: [aio] 2026-05-19 14:29:25.590225 | aio | 2026-05-19 14:29:25.590297 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-05-19 14:29:25.590309 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.041) 0:01:37.854 *********** 2026-05-19 14:29:25.632225 | aio | skipping: [aio] => (item=aio) 2026-05-19 14:29:25.632353 | aio | skipping: [aio] 2026-05-19 14:29:25.632367 | aio | 2026-05-19 14:29:25.632399 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-05-19 14:29:25.632504 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.042) 0:01:37.896 *********** 2026-05-19 14:29:25.898090 | aio | ok: [aio] 2026-05-19 14:29:25.898169 | aio | 2026-05-19 14:29:25.898330 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-05-19 14:29:25.898347 | aio | Tuesday 19 May 2026 14:29:25 +0000 (0:00:00.266) 0:01:38.162 *********** 2026-05-19 14:29:32.245095 | aio | ok: [aio] 2026-05-19 14:29:32.245176 | aio | 2026-05-19 14:29:32.245394 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-05-19 14:29:32.245449 | aio | Tuesday 19 May 2026 14:29:32 +0000 (0:00:06.347) 0:01:44.510 *********** 2026-05-19 14:29:37.699027 | aio | ok: [aio] 2026-05-19 14:29:37.699361 | aio | 2026-05-19 14:29:37.699378 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-05-19 14:29:37.699388 | aio | Tuesday 19 May 2026 14:29:37 +0000 (0:00:05.453) 0:01:49.963 *********** 2026-05-19 14:29:51.707766 | aio | ok: [aio] 2026-05-19 14:29:51.707860 | aio | 2026-05-19 14:29:51.708082 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-05-19 14:29:51.708135 | aio | Tuesday 19 May 2026 14:29:51 +0000 (0:00:14.008) 0:02:03.972 *********** 2026-05-19 14:29:51.777910 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-05-19 14:29:51.777999 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-05-19 14:29:51.778648 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-05-19 14:29:51.778668 | aio | skipping: [aio] 2026-05-19 14:29:51.778675 | aio | 2026-05-19 14:29:51.778682 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-05-19 14:29:51.778688 | aio | Tuesday 19 May 2026 14:29:51 +0000 (0:00:00.069) 0:02:04.042 *********** 2026-05-19 14:29:57.883313 | aio | ok: [aio] 2026-05-19 14:29:57.883403 | aio | 2026-05-19 14:29:57.883721 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-05-19 14:29:57.883779 | aio | Tuesday 19 May 2026 14:29:57 +0000 (0:00:06.105) 0:02:10.147 *********** 2026-05-19 14:30:03.909322 | aio | ok: [aio] 2026-05-19 14:30:03.909412 | aio | 2026-05-19 14:30:03.909672 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-05-19 14:30:03.909739 | aio | Tuesday 19 May 2026 14:30:03 +0000 (0:00:06.025) 0:02:16.173 *********** 2026-05-19 14:30:03.964804 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-05-19 14:30:03.964894 | aio | 2026-05-19 14:30:03.964906 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-05-19 14:30:03.965036 | aio | Tuesday 19 May 2026 14:30:03 +0000 (0:00:00.055) 0:02:16.229 *********** 2026-05-19 14:30:04.008114 | aio | ok: [aio] 2026-05-19 14:30:04.008180 | aio | 2026-05-19 14:30:04.008443 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-05-19 14:30:04.008520 | aio | Tuesday 19 May 2026 14:30:04 +0000 (0:00:00.042) 0:02:16.272 *********** 2026-05-19 14:30:10.000840 | aio | ok: [aio] 2026-05-19 14:30:10.000900 | aio | 2026-05-19 14:30:10.000908 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-05-19 14:30:10.000914 | aio | Tuesday 19 May 2026 14:30:09 +0000 (0:00:05.993) 0:02:22.265 *********** 2026-05-19 14:30:10.040800 | aio | ok: [aio] 2026-05-19 14:30:10.040851 | aio | 2026-05-19 14:30:10.040857 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-05-19 14:30:10.040862 | aio | Tuesday 19 May 2026 14:30:10 +0000 (0:00:00.040) 0:02:22.305 *********** 2026-05-19 14:30:10.080162 | aio | skipping: [aio] => (item=1) 2026-05-19 14:30:10.080197 | aio | skipping: [aio] => (item=1) 2026-05-19 14:30:10.080203 | aio | skipping: [aio] => (item=1) 2026-05-19 14:30:10.080209 | aio | skipping: [aio] 2026-05-19 14:30:10.080215 | aio | 2026-05-19 14:30:10.080221 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-05-19 14:30:10.080227 | aio | Tuesday 19 May 2026 14:30:10 +0000 (0:00:00.038) 0:02:22.344 *********** 2026-05-19 14:30:10.114115 | aio | skipping: [aio] 2026-05-19 14:30:10.114170 | aio | 2026-05-19 14:30:10.114176 | aio | PLAY RECAP ********************************************************************* 2026-05-19 14:30:10.114181 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-05-19 14:30:10.114185 | aio | 2026-05-19 14:30:10.114189 | aio | 2026-05-19 14:30:10.114194 | aio | TASKS RECAP ******************************************************************** 2026-05-19 14:30:10.114200 | aio | Tuesday 19 May 2026 14:30:10 +0000 (0:00:00.032) 0:02:22.376 *********** 2026-05-19 14:30:10.114205 | aio | =============================================================================== 2026-05-19 14:30:10.114210 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.15s 2026-05-19 14:30:10.114215 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.01s 2026-05-19 14:30:10.114221 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.52s 2026-05-19 14:30:10.114226 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.49s 2026-05-19 14:30:10.114232 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.35s 2026-05-19 14:30:10.114237 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.30s 2026-05-19 14:30:10.114241 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.11s 2026-05-19 14:30:10.114244 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.11s 2026-05-19 14:30:10.114248 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.06s 2026-05-19 14:30:10.114252 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.03s 2026-05-19 14:30:10.114256 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.03s 2026-05-19 14:30:10.114260 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.99s 2026-05-19 14:30:10.114264 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.45s 2026-05-19 14:30:10.114268 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.80s 2026-05-19 14:30:10.114271 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s 2026-05-19 14:30:10.114275 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s 2026-05-19 14:30:10.114279 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.21s 2026-05-19 14:30:10.114283 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.99s 2026-05-19 14:30:10.114286 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.40s 2026-05-19 14:30:10.114290 | aio | Gathering Facts --------------------------------------------------------- 1.21s 2026-05-19 14:30:10.215262 | aio | INFO [default > idempotence] Executed: Successful 2026-05-19 14:30:10.223529 | aio | INFO [default > side_effect] Executing 2026-05-19 14:30:10.223921 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 14:30:10.229632 | aio | INFO [default > verify] Executing 2026-05-19 14:30:10.831630 | aio | 2026-05-19 14:30:10.831855 | aio | PLAY [Verify] ****************************************************************** 2026-05-19 14:30:10.832065 | aio | 2026-05-19 14:30:10.832293 | aio | TASK [Gathering Facts] ********************************************************* 2026-05-19 14:30:10.832515 | aio | Tuesday 19 May 2026 14:30:10 +0000 (0:00:00.006) 0:00:00.006 *********** 2026-05-19 14:30:11.984366 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-05-19 14:30:11.984446 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-05-19 14:30:11.984515 | aio | interpreter could change the meaning of that path. See 2026-05-19 14:30:11.984611 | aio | https://docs.ansible.com/ansible- 2026-05-19 14:30:11.984703 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-05-19 14:30:11.992283 | aio | ok: [aio] 2026-05-19 14:30:11.992456 | aio | 2026-05-19 14:30:11.992661 | aio | TASK [Get cluster health status] *********************************************** 2026-05-19 14:30:11.992875 | aio | Tuesday 19 May 2026 14:30:11 +0000 (0:00:01.160) 0:00:01.167 *********** 2026-05-19 14:30:22.062593 | aio | ok: [aio] 2026-05-19 14:30:22.062673 | aio | 2026-05-19 14:30:22.062795 | aio | TASK [Print cluster health status] ********************************************* 2026-05-19 14:30:22.062933 | aio | Tuesday 19 May 2026 14:30:22 +0000 (0:00:10.069) 0:00:11.237 *********** 2026-05-19 14:30:22.093753 | aio | ok: [aio] => { 2026-05-19 14:30:22.094001 | aio | "_ceph_health": { 2026-05-19 14:30:22.094304 | aio | "changed": false, 2026-05-19 14:30:22.094608 | aio | "cmd": [ 2026-05-19 14:30:22.094835 | aio | "cephadm", 2026-05-19 14:30:22.095057 | aio | "shell", 2026-05-19 14:30:22.095351 | aio | "--", 2026-05-19 14:30:22.095726 | aio | "ceph", 2026-05-19 14:30:22.095994 | aio | "health" 2026-05-19 14:30:22.096279 | aio | ], 2026-05-19 14:30:22.096551 | aio | "delta": "0:00:09.796367", 2026-05-19 14:30:22.096875 | aio | "end": "2026-05-19 14:30:22.028400", 2026-05-19 14:30:22.097147 | aio | "failed": false, 2026-05-19 14:30:22.097361 | aio | "msg": "", 2026-05-19 14:30:22.097570 | aio | "rc": 0, 2026-05-19 14:30:22.097828 | aio | "start": "2026-05-19 14:30:12.232033", 2026-05-19 14:30:22.098225 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-05-19 14:30:22.098442 | aio | "stderr_lines": [ 2026-05-19 14:30:22.098745 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-05-19 14:30:22.098996 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-05-19 14:30:22.099253 | aio | ], 2026-05-19 14:30:22.099480 | aio | "stdout": "HEALTH_OK", 2026-05-19 14:30:22.099694 | aio | "stdout_lines": [ 2026-05-19 14:30:22.099904 | aio | "HEALTH_OK" 2026-05-19 14:30:22.100141 | aio | ] 2026-05-19 14:30:22.100348 | aio | } 2026-05-19 14:30:22.100553 | aio | } 2026-05-19 14:30:22.100751 | aio | 2026-05-19 14:30:22.100973 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-05-19 14:30:22.101189 | aio | Tuesday 19 May 2026 14:30:22 +0000 (0:00:00.031) 0:00:11.269 *********** 2026-05-19 14:30:22.121867 | aio | ok: [aio] => { 2026-05-19 14:30:22.122197 | aio | "changed": false, 2026-05-19 14:30:22.122529 | aio | "msg": "All assertions passed" 2026-05-19 14:30:22.122850 | aio | } 2026-05-19 14:30:22.123156 | aio | 2026-05-19 14:30:22.123535 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-05-19 14:30:22.123859 | aio | Tuesday 19 May 2026 14:30:22 +0000 (0:00:00.028) 0:00:11.297 *********** 2026-05-19 14:30:28.384486 | aio | changed: [aio] 2026-05-19 14:30:28.384637 | aio | 2026-05-19 14:30:28.384929 | aio | TASK [Create a test Ceph key] ************************************************** 2026-05-19 14:30:28.385156 | aio | Tuesday 19 May 2026 14:30:28 +0000 (0:00:06.262) 0:00:17.559 *********** 2026-05-19 14:30:30.306892 | aio | changed: [aio] 2026-05-19 14:30:30.306966 | aio | 2026-05-19 14:30:30.306978 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-05-19 14:30:30.306988 | aio | Tuesday 19 May 2026 14:30:30 +0000 (0:00:01.922) 0:00:19.481 *********** 2026-05-19 14:30:31.269132 | aio | ok: [aio] 2026-05-19 14:30:31.269203 | aio | 2026-05-19 14:30:31.269495 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-05-19 14:30:31.269515 | aio | Tuesday 19 May 2026 14:30:31 +0000 (0:00:00.963) 0:00:20.444 *********** 2026-05-19 14:30:31.303368 | aio | ok: [aio] => { 2026-05-19 14:30:31.303430 | aio | "changed": false, 2026-05-19 14:30:31.303446 | aio | "msg": "All assertions passed" 2026-05-19 14:30:31.303460 | aio | } 2026-05-19 14:30:31.303472 | aio | 2026-05-19 14:30:31.303492 | aio | PLAY RECAP ********************************************************************* 2026-05-19 14:30:31.304750 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-05-19 14:30:31.304783 | aio | 2026-05-19 14:30:31.304795 | aio | 2026-05-19 14:30:31.304805 | aio | TASKS RECAP ******************************************************************** 2026-05-19 14:30:31.304848 | aio | Tuesday 19 May 2026 14:30:31 +0000 (0:00:00.033) 0:00:20.478 *********** 2026-05-19 14:30:31.304857 | aio | =============================================================================== 2026-05-19 14:30:31.305837 | aio | Get cluster health status ---------------------------------------------- 10.07s 2026-05-19 14:30:31.305857 | aio | Create a test Ceph pool ------------------------------------------------- 6.26s 2026-05-19 14:30:31.305864 | aio | Create a test Ceph key -------------------------------------------------- 1.92s 2026-05-19 14:30:31.305870 | aio | Gathering Facts --------------------------------------------------------- 1.16s 2026-05-19 14:30:31.305875 | aio | Retrieve info for the test Ceph key ------------------------------------- 0.96s 2026-05-19 14:30:31.305881 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-05-19 14:30:31.305886 | aio | Print cluster health status --------------------------------------------- 0.03s 2026-05-19 14:30:31.305891 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-05-19 14:30:31.362941 | aio | INFO [default > verify] Executed: Successful 2026-05-19 14:30:31.374539 | aio | INFO [default > cleanup] Executing 2026-05-19 14:30:31.374936 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-05-19 14:30:31.380157 | aio | INFO [default > destroy] Executing 2026-05-19 14:30:31.380258 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-05-19 14:30:31.380360 | aio | INFO [default > destroy] Executed: Successful 2026-05-19 14:30:31.380625 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-05-19 14:30:31.783482 | aio | ok: Runtime: 0:09:32.822104 2026-05-19 14:30:31.797016 | 2026-05-19 14:30:31.797083 | PLAY RECAP 2026-05-19 14:30:31.797130 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-05-19 14:30:31.797153 | 2026-05-19 14:30:31.919048 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-05-19 14:30:31.923315 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-19 14:30:32.519543 | 2026-05-19 14:30:32.519716 | PLAY [all] 2026-05-19 14:30:32.531528 | 2026-05-19 14:30:32.531678 | TASK [fetch-output : Set log path for multiple nodes] 2026-05-19 14:30:32.577345 | aio | skipping: Conditional result was False 2026-05-19 14:30:32.586765 | 2026-05-19 14:30:32.586885 | TASK [fetch-output : Set log path for single node] 2026-05-19 14:30:32.632318 | aio | ok 2026-05-19 14:30:32.637588 | 2026-05-19 14:30:32.637656 | LOOP [fetch-output : Ensure local output dirs] 2026-05-19 14:30:33.071866 | aio -> localhost | ok: "/var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/logs" 2026-05-19 14:30:33.299812 | aio -> localhost | changed: "/var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/artifacts" 2026-05-19 14:30:33.512084 | aio -> localhost | changed: "/var/lib/zuul/builds/8250f3ef21fc481ead896b8fcc2bf21d/work/docs" 2026-05-19 14:30:33.529363 | 2026-05-19 14:30:33.529880 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-05-19 14:30:34.151016 | aio | changed: .d..t...... ./ 2026-05-19 14:30:34.151295 | aio | changed: All items complete 2026-05-19 14:30:34.151333 | 2026-05-19 14:30:34.592442 | aio | changed: .d..t...... ./ 2026-05-19 14:30:35.043860 | aio | changed: .d..t...... ./ 2026-05-19 14:30:35.069001 | 2026-05-19 14:30:35.069099 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-05-19 14:30:35.658663 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.008577 2026-05-19 14:30:35.884969 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008412 2026-05-19 14:30:35.904741 | 2026-05-19 14:30:35.905099 | PLAY [all] 2026-05-19 14:30:35.911412 | 2026-05-19 14:30:35.911481 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-05-19 14:30:36.326456 | aio | changed 2026-05-19 14:30:36.332130 | 2026-05-19 14:30:36.332178 | PLAY RECAP 2026-05-19 14:30:36.332244 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-05-19 14:30:36.332268 | 2026-05-19 14:30:36.469657 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-05-19 14:30:36.472395 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-05-19 14:30:37.122138 | 2026-05-19 14:30:37.122361 | PLAY [localhost] 2026-05-19 14:30:37.134857 | 2026-05-19 14:30:37.135045 | TASK [Generate Zuul manifest] 2026-05-19 14:30:37.155652 | localhost | ok 2026-05-19 14:30:37.175854 | 2026-05-19 14:30:37.176016 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-05-19 14:30:38.100823 | localhost | changed 2026-05-19 14:30:38.115372 | 2026-05-19 14:30:38.115455 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-05-19 14:30:38.206197 | localhost | ok 2026-05-19 14:30:38.213934 | 2026-05-19 14:30:38.214007 | TASK [Upload logs] 2026-05-19 14:30:38.238443 | localhost | ok 2026-05-19 14:30:38.301807 | 2026-05-19 14:30:38.301970 | TASK [Set zuul-log-path fact] 2026-05-19 14:30:38.324889 | localhost | ok 2026-05-19 14:30:38.337061 | 2026-05-19 14:30:38.337137 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-05-19 14:30:38.368348 | localhost | ok 2026-05-19 14:30:38.377445 | 2026-05-19 14:30:38.377513 | TASK [upload-logs : Create log directories] 2026-05-19 14:30:38.845065 | localhost | changed 2026-05-19 14:30:38.852078 | 2026-05-19 14:30:38.852181 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-05-19 14:30:39.263223 | localhost -> localhost | ok: Runtime: 0:00:00.006273 2026-05-19 14:30:39.270751 | 2026-05-19 14:30:39.270824 | TASK [upload-logs : Upload logs to log server] 2026-05-19 14:30:39.899997 | localhost | Output suppressed because no_log was given 2026-05-19 14:30:39.905336 | 2026-05-19 14:30:39.905407 | LOOP [upload-logs : Compress console log and json output] 2026-05-19 14:30:39.955372 | localhost | skipping: Conditional result was False 2026-05-19 14:30:40.005602 | localhost | skipping: Conditional result was False 2026-05-19 14:30:40.018403 | 2026-05-19 14:30:40.018505 | LOOP [upload-logs : Upload compressed console log and json output] 2026-05-19 14:30:40.063362 | localhost | skipping: Conditional result was False 2026-05-19 14:30:40.063807 | 2026-05-19 14:30:40.067449 | localhost | skipping: Conditional result was False 2026-05-19 14:30:40.083896 | 2026-05-19 14:30:40.084056 | LOOP [upload-logs : Upload console log and json output]