2026-03-29 01:44:45.954801 | Job console starting
2026-03-29 01:44:45.965704 | Updating git repos
2026-03-29 01:44:46.427514 | Cloning repos into workspace
2026-03-29 01:44:46.469334 | Restoring repo states
2026-03-29 01:44:46.476530 | Merging changes
2026-03-29 01:44:46.768284 | Checking out repos
2026-03-29 01:44:46.858195 | Preparing playbooks
2026-03-29 01:44:48.523698 | Running Ansible setup
2026-03-29 01:44:51.802484 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-29 01:44:52.357902 | 
2026-03-29 01:44:52.358039 | PLAY [localhost]
2026-03-29 01:44:52.365554 | 
2026-03-29 01:44:52.365625 | TASK [Gathering Facts]
2026-03-29 01:44:53.234284 | localhost | ok
2026-03-29 01:44:53.245464 | 
2026-03-29 01:44:53.245560 | TASK [Setup log path fact]
2026-03-29 01:44:53.265149 | localhost | ok
2026-03-29 01:44:53.277229 | 
2026-03-29 01:44:53.277290 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-29 01:44:53.306604 | localhost | ok
2026-03-29 01:44:53.315200 | 
2026-03-29 01:44:53.315283 | TASK [emit-job-header : Print job information]
2026-03-29 01:44:53.356315 | # Job Information
2026-03-29 01:44:53.356625 | Ansible Version: 2.16.16
2026-03-29 01:44:53.356697 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy
2026-03-29 01:44:53.356794 | Pipeline: check
2026-03-29 01:44:53.356846 | Executor: 0a8996d2b663
2026-03-29 01:44:53.356888 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/91
2026-03-29 01:44:53.356938 | Event ID: 950a7e00-293e-11f1-8411-6d21c09dd037
2026-03-29 01:44:53.360699 | 
2026-03-29 01:44:53.360814 | LOOP [emit-job-header : Print node information]
2026-03-29 01:44:53.454865 | localhost | ok:
2026-03-29 01:44:53.455099 | localhost | # Node Information
2026-03-29 01:44:53.455158 | localhost | Inventory Hostname: aio
2026-03-29 01:44:53.455204 | localhost | Hostname: np0000161148
2026-03-29 01:44:53.455247 | localhost | Username: zuul
2026-03-29 01:44:53.455296 | localhost | Distro: Ubuntu 22.04
2026-03-29 01:44:53.455339 | localhost | Provider: yul1
2026-03-29 01:44:53.455381 | localhost | Region: ca-ymq-1
2026-03-29 01:44:53.455422 | localhost | Label: ubuntu-jammy
2026-03-29 01:44:53.455462 | localhost | Product Name: OpenStack Nova
2026-03-29 01:44:53.455502 | localhost | Interface IP: 199.19.213.75
2026-03-29 01:44:53.469676 | 
2026-03-29 01:44:53.469743 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-29 01:44:53.871287 | localhost -> localhost | changed
2026-03-29 01:44:53.881149 | 
2026-03-29 01:44:53.881296 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-29 01:45:02.559996 | localhost -> localhost | changed
2026-03-29 01:45:02.571180 | 
2026-03-29 01:45:02.571260 | PLAY [all]
2026-03-29 01:45:02.581795 | 
2026-03-29 01:45:02.581865 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-29 01:45:02.798630 | aio -> localhost | ok
2026-03-29 01:45:02.811044 | 
2026-03-29 01:45:02.811150 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-29 01:45:02.847301 | aio | ok
2026-03-29 01:45:02.863584 | aio | included: /var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-29 01:45:02.869321 | 
2026-03-29 01:45:02.869391 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-29 01:45:04.086750 | aio -> localhost | Generating public/private rsa key pair.
2026-03-29 01:45:04.086962 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/0a2fd496c6df4a75bd4830ac0a81b9db_id_rsa
2026-03-29 01:45:04.087002 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/0a2fd496c6df4a75bd4830ac0a81b9db_id_rsa.pub
2026-03-29 01:45:04.087033 | aio -> localhost | The key fingerprint is:
2026-03-29 01:45:04.087093 | aio -> localhost | SHA256:4d597RskBQ2j3SLHZ5/fSD8Ii9/OpzqR3r8Chytp2JU zuul-build-sshkey
2026-03-29 01:45:04.087142 | aio -> localhost | The key's randomart image is:
2026-03-29 01:45:04.087172 | aio -> localhost | +---[RSA 3072]----+
2026-03-29 01:45:04.087209 | aio -> localhost | |             +o  |
2026-03-29 01:45:04.087238 | aio -> localhost | |            + +. |
2026-03-29 01:45:04.087265 | aio -> localhost | |        .  o = = |
2026-03-29 01:45:04.087292 | aio -> localhost | |       . .  o = o|
2026-03-29 01:45:04.087319 | aio -> localhost | |        S  .+..o.|
2026-03-29 01:45:04.087345 | aio -> localhost | |       . ..Eoo++o|
2026-03-29 01:45:04.087372 | aio -> localhost | |        +.=.B.oo=|
2026-03-29 01:45:04.087398 | aio -> localhost | |       . =.+o+ oo|
2026-03-29 01:45:04.087428 | aio -> localhost | |        . .o+==++|
2026-03-29 01:45:04.087456 | aio -> localhost | +----[SHA256]-----+
2026-03-29 01:45:04.087536 | aio -> localhost | ok: Runtime: 0:00:00.750371
2026-03-29 01:45:04.094442 | 
2026-03-29 01:45:04.094527 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-29 01:45:04.128882 | aio | ok
2026-03-29 01:45:04.139111 | aio | included: /var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-29 01:45:04.146177 | 
2026-03-29 01:45:04.146320 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-29 01:45:04.170325 | aio | skipping: Conditional result was False
2026-03-29 01:45:04.179355 | 
2026-03-29 01:45:04.179438 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-29 01:45:04.649935 | aio | changed
2026-03-29 01:45:04.657999 | 
2026-03-29 01:45:04.658063 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-29 01:45:04.834927 | aio | ok
2026-03-29 01:45:04.841260 | 
2026-03-29 01:45:04.841324 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-29 01:45:05.300219 | aio | changed
2026-03-29 01:45:05.305327 | 
2026-03-29 01:45:05.305392 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-29 01:45:05.753270 | aio | changed
2026-03-29 01:45:05.760279 | 
2026-03-29 01:45:05.760365 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-29 01:45:05.785027 | aio | skipping: Conditional result was False
2026-03-29 01:45:05.795322 | 
2026-03-29 01:45:05.795411 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-29 01:45:06.174169 | aio -> localhost | changed
2026-03-29 01:45:06.188824 | 
2026-03-29 01:45:06.188917 | TASK [add-build-sshkey : Add back temp key]
2026-03-29 01:45:06.455270 | aio -> localhost | Identity added: /var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/0a2fd496c6df4a75bd4830ac0a81b9db_id_rsa (zuul-build-sshkey)
2026-03-29 01:45:06.455537 | aio -> localhost | ok: Runtime: 0:00:00.014350
2026-03-29 01:45:06.462721 | 
2026-03-29 01:45:06.462817 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-29 01:45:06.760605 | aio | ok
2026-03-29 01:45:06.768809 | 
2026-03-29 01:45:06.768896 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-29 01:45:06.793600 | aio | skipping: Conditional result was False
2026-03-29 01:45:06.807894 | 
2026-03-29 01:45:06.807980 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-29 01:45:07.114987 | aio | ok
2026-03-29 01:45:07.122577 | 
2026-03-29 01:45:07.122693 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-29 01:45:07.835707 | aio | Output suppressed because no_log was given
2026-03-29 01:45:07.848468 | 
2026-03-29 01:45:07.848539 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-29 01:45:08.042559 | aio | ok: "logs"
2026-03-29 01:45:08.042803 | aio | ok: All items complete
2026-03-29 01:45:08.042831 | 
2026-03-29 01:45:08.197342 | aio | ok: "artifacts"
2026-03-29 01:45:08.347756 | aio | ok: "docs"
2026-03-29 01:45:08.355784 | 
2026-03-29 01:45:08.355874 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-29 01:45:08.583304 | aio | changed: "logs"
2026-03-29 01:45:08.695212 | aio | changed: "artifacts"
2026-03-29 01:45:08.848687 | aio | changed: "docs"
2026-03-29 01:45:08.862817 | 
2026-03-29 01:45:08.862984 | PLAY RECAP
2026-03-29 01:45:08.863049 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-29 01:45:08.863087 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-29 01:45:08.863115 | 
2026-03-29 01:45:09.002881 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-29 01:45:09.006263 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-29 01:45:09.541729 | 
2026-03-29 01:45:09.541862 | PLAY [all]
2026-03-29 01:45:09.553326 | 
2026-03-29 01:45:09.553417 | TASK [setup-uv : Extract archive]
2026-03-29 01:45:11.857303 | aio | changed
2026-03-29 01:45:11.864280 | 
2026-03-29 01:45:11.864395 | TASK [setup-uv : Print version]
2026-03-29 01:45:12.200267 | aio | uv 0.8.13
2026-03-29 01:45:12.401276 | aio | ok: Runtime: 0:00:00.011410
2026-03-29 01:45:12.411343 | 
2026-03-29 01:45:12.411397 | PLAY RECAP
2026-03-29 01:45:12.411447 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-29 01:45:12.411496 | 
2026-03-29 01:45:12.532898 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-29 01:45:12.536050 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-29 01:45:13.129430 | 
2026-03-29 01:45:13.129942 | PLAY [all]
2026-03-29 01:45:13.142013 | 
2026-03-29 01:45:13.142145 | TASK [Copy inventory file for Zuul]
2026-03-29 01:45:13.995829 | aio | changed
2026-03-29 01:45:14.004021 | 
2026-03-29 01:45:14.004126 | TASK [Switch "ansible_host" to private IP]
2026-03-29 01:45:14.270939 | aio | changed: 1 replacements made
2026-03-29 01:45:14.276152 | 
2026-03-29 01:45:14.276217 | TASK [Run Molecule scenario]
2026-03-29 01:45:14.802925 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-03-29 01:45:15.655112 | aio |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-03-29 01:45:15.839638 | aio | Using CPython 3.13.7
2026-03-29 01:45:15.839696 | aio | Creating virtual environment at: .venv
2026-03-29 01:45:16.161493 | aio | Downloading netaddr (2.2MiB)
2026-03-29 01:45:16.162965 | aio | Downloading pygments (1.2MiB)
2026-03-29 01:45:16.178493 | aio | Downloading cryptography (4.3MiB)
2026-03-29 01:45:16.215188 | aio | Downloading ansible-core (2.1MiB)
2026-03-29 01:45:16.345604 | aio |  Downloading netaddr
2026-03-29 01:45:16.356984 | aio |  Downloading cryptography
2026-03-29 01:45:16.404033 | aio |  Downloading pygments
2026-03-29 01:45:16.522382 | aio |  Downloading ansible-core
2026-03-29 01:45:16.548457 | aio | Installed 36 packages in 25ms
2026-03-29 01:45:17.621490 | aio | INFO     Collection 'vexxhost.ceph' detected.
2026-03-29 01:45:17.621615 | aio | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-29 01:45:18.226309 | aio | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-29 01:45:18.226393 | aio | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-29 01:45:30.890793 | aio | INFO     [default > dependency] Executing
2026-03-29 01:45:30.890912 | aio | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-29 01:45:30.891080 | aio | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-29 01:45:30.891186 | aio | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-29 01:45:30.896322 | aio | INFO     [default > cleanup] Executing
2026-03-29 01:45:30.896606 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-29 01:45:30.901497 | aio | INFO     [default > destroy] Executing
2026-03-29 01:45:30.901546 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-29 01:45:30.901617 | aio | INFO     [default > destroy] Executed: Successful
2026-03-29 01:45:30.906491 | aio | INFO     [default > syntax] Executing
2026-03-29 01:45:31.840396 | aio |
2026-03-29 01:45:31.840686 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-29 01:45:31.892186 | aio | INFO     [default > syntax] Executed: Successful
2026-03-29 01:45:31.902337 | aio | INFO     [default > create] Executing
2026-03-29 01:45:31.903646 | aio | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-29 01:45:31.908612 | aio | INFO     [default > prepare] Executing
2026-03-29 01:45:32.548513 | aio |
2026-03-29 01:45:32.548736 | aio | PLAY [Prepare] *****************************************************************
2026-03-29 01:45:32.548922 | aio |
2026-03-29 01:45:32.549150 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:45:32.549414 | aio | Sunday 29 March 2026  01:45:32 +0000 (0:00:00.029)       0:00:00.029 **********
2026-03-29 01:45:34.161184 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-29 01:45:34.161247 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-29 01:45:34.161306 | aio | interpreter could change the meaning of that path. See
2026-03-29 01:45:34.161394 | aio | https://docs.ansible.com/ansible-
2026-03-29 01:45:34.161491 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-29 01:45:34.167853 | aio | ok: [aio]
2026-03-29 01:45:34.167891 | aio |
2026-03-29 01:45:34.167978 | aio | TASK [Configure short hostname] ************************************************
2026-03-29 01:45:34.168068 | aio | Sunday 29 March 2026  01:45:34 +0000 (0:00:01.620)       0:00:01.649 **********
2026-03-29 01:45:34.843512 | aio | changed: [aio]
2026-03-29 01:45:34.843657 | aio |
2026-03-29 01:45:34.843888 | aio | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-29 01:45:34.844109 | aio | Sunday 29 March 2026  01:45:34 +0000 (0:00:00.674)       0:00:02.324 **********
2026-03-29 01:45:35.095962 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-29 01:45:35.096145 | aio | with a mode of 0700, this may cause issues when running as another user. To
2026-03-29 01:45:35.096357 | aio | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-29 01:45:35.102437 | aio | changed: [aio]
2026-03-29 01:45:35.102604 | aio |
2026-03-29 01:45:35.102830 | aio | TASK [Update apt cache] ********************************************************
2026-03-29 01:45:35.103100 | aio | Sunday 29 March 2026  01:45:35 +0000 (0:00:00.259)       0:00:02.584 **********
2026-03-29 01:45:42.033264 | aio | changed: [aio]
2026-03-29 01:45:42.033396 | aio |
2026-03-29 01:45:42.033703 | aio | PLAY [Create devices for Ceph] *************************************************
2026-03-29 01:45:42.033856 | aio |
2026-03-29 01:45:42.034109 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:45:42.034257 | aio | Sunday 29 March 2026  01:45:42 +0000 (0:00:06.930)       0:00:09.514 **********
2026-03-29 01:45:42.705003 | aio | ok: [aio]
2026-03-29 01:45:42.705185 | aio |
2026-03-29 01:45:42.705414 | aio | TASK [Install depedencies] *****************************************************
2026-03-29 01:45:42.705751 | aio | Sunday 29 March 2026  01:45:42 +0000 (0:00:00.671)       0:00:10.186 **********
2026-03-29 01:46:01.622578 | aio | changed: [aio]
2026-03-29 01:46:01.622724 | aio |
2026-03-29 01:46:01.622934 | aio | TASK [Start up service] ********************************************************
2026-03-29 01:46:01.623142 | aio | Sunday 29 March 2026  01:46:01 +0000 (0:00:18.917)       0:00:29.104 **********
2026-03-29 01:46:02.156221 | aio | ok: [aio]
2026-03-29 01:46:02.156394 | aio |
2026-03-29 01:46:02.156611 | aio | TASK [Generate lvm.conf] *******************************************************
2026-03-29 01:46:02.156818 | aio | Sunday 29 March 2026  01:46:02 +0000 (0:00:00.533)       0:00:29.637 **********
2026-03-29 01:46:02.441125 | aio | ok: [aio]
2026-03-29 01:46:02.441233 | aio |
2026-03-29 01:46:02.441386 | aio | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-29 01:46:02.441561 | aio | Sunday 29 March 2026  01:46:02 +0000 (0:00:00.285)       0:00:29.922 **********
2026-03-29 01:46:03.043471 | aio | changed: [aio]
2026-03-29 01:46:03.043634 | aio |
2026-03-29 01:46:03.043840 | aio | TASK [Get list of all loopback devices] ****************************************
2026-03-29 01:46:03.044042 | aio | Sunday 29 March 2026  01:46:03 +0000 (0:00:00.601)       0:00:30.524 **********
2026-03-29 01:46:03.222292 | aio | ok: [aio]
2026-03-29 01:46:03.222351 | aio |
2026-03-29 01:46:03.222557 | aio | TASK [Fail if there is any existing loopback devices] **************************
2026-03-29 01:46:03.222792 | aio | Sunday 29 March 2026  01:46:03 +0000 (0:00:00.178)       0:00:30.703 **********
2026-03-29 01:46:03.239907 | aio | skipping: [aio]
2026-03-29 01:46:03.240118 | aio |
2026-03-29 01:46:03.240412 | aio | TASK [Create devices for Ceph] *************************************************
2026-03-29 01:46:03.240872 | aio | Sunday 29 March 2026  01:46:03 +0000 (0:00:00.017)       0:00:30.721 **********
2026-03-29 01:46:03.760301 | aio | changed: [aio] => (item=osd0)
2026-03-29 01:46:03.760541 | aio | changed: [aio] => (item=osd1)
2026-03-29 01:46:03.760780 | aio | changed: [aio] => (item=osd2)
2026-03-29 01:46:03.761022 | aio |
2026-03-29 01:46:03.761293 | aio | TASK [Set permissions on loopback devices] *************************************
2026-03-29 01:46:03.761553 | aio | Sunday 29 March 2026  01:46:03 +0000 (0:00:00.520)       0:00:31.241 **********
2026-03-29 01:46:04.366550 | aio | changed: [aio] => (item=osd0)
2026-03-29 01:46:04.366764 | aio | changed: [aio] => (item=osd1)
2026-03-29 01:46:04.366985 | aio | changed: [aio] => (item=osd2)
2026-03-29 01:46:04.367195 | aio |
2026-03-29 01:46:04.367423 | aio | TASK [Start loop devices] ******************************************************
2026-03-29 01:46:04.367648 | aio | Sunday 29 March 2026  01:46:04 +0000 (0:00:00.605)       0:00:31.847 **********
2026-03-29 01:46:05.047671 | aio | changed: [aio] => (item=osd0)
2026-03-29 01:46:05.047851 | aio | changed: [aio] => (item=osd1)
2026-03-29 01:46:05.048112 | aio | changed: [aio] => (item=osd2)
2026-03-29 01:46:05.048246 | aio |
2026-03-29 01:46:05.048459 | aio | TASK [Create a volume group for each loop device] ******************************
2026-03-29 01:46:05.048701 | aio | Sunday 29 March 2026  01:46:05 +0000 (0:00:00.681)       0:00:32.528 **********
2026-03-29 01:46:08.072670 | aio | changed: [aio] => (item=osd0)
2026-03-29 01:46:08.072868 | aio | changed: [aio] => (item=osd1)
2026-03-29 01:46:08.073087 | aio | changed: [aio] => (item=osd2)
2026-03-29 01:46:08.073278 | aio |
2026-03-29 01:46:08.073486 | aio | TASK [Create a logical volume for each loop device] ****************************
2026-03-29 01:46:08.073755 | aio | Sunday 29 March 2026  01:46:08 +0000 (0:00:03.025)       0:00:35.554 **********
2026-03-29 01:46:09.960140 | aio | changed: [aio] => (item=ceph-aio-osd0)
2026-03-29 01:46:09.960334 | aio | changed: [aio] => (item=ceph-aio-osd1)
2026-03-29 01:46:09.960537 | aio | changed: [aio] => (item=ceph-aio-osd2)
2026-03-29 01:46:09.960730 | aio |
2026-03-29 01:46:09.960998 | aio | PLAY RECAP *********************************************************************
2026-03-29 01:46:09.961239 | aio | aio                        : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-29 01:46:09.961419 | aio |
2026-03-29 01:46:09.961650 | aio |
2026-03-29 01:46:09.961923 | aio | TASKS RECAP ********************************************************************
2026-03-29 01:46:09.962053 | aio | Sunday 29 March 2026  01:46:09 +0000 (0:00:01.887)       0:00:37.441 **********
2026-03-29 01:46:09.962263 | aio | ===============================================================================
2026-03-29 01:46:09.962463 | aio | Install depedencies ---------------------------------------------------- 18.92s
2026-03-29 01:46:09.962648 | aio | Update apt cache -------------------------------------------------------- 6.93s
2026-03-29 01:46:09.962844 | aio | Create a volume group for each loop device ------------------------------ 3.03s
2026-03-29 01:46:09.963040 | aio | Create a logical volume for each loop device ---------------------------- 1.89s
2026-03-29 01:46:09.963233 | aio | Gathering Facts --------------------------------------------------------- 1.62s
2026-03-29 01:46:09.963426 | aio | Start loop devices ------------------------------------------------------ 0.68s
2026-03-29 01:46:09.963620 | aio | Configure short hostname ------------------------------------------------ 0.67s
2026-03-29 01:46:09.963810 | aio | Gathering Facts --------------------------------------------------------- 0.67s
2026-03-29 01:46:09.964031 | aio | Set permissions on loopback devices ------------------------------------- 0.61s
2026-03-29 01:46:09.964224 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.60s
2026-03-29 01:46:09.964462 | aio | Start up service -------------------------------------------------------- 0.53s
2026-03-29 01:46:09.964665 | aio | Create devices for Ceph ------------------------------------------------- 0.52s
2026-03-29 01:46:09.964945 | aio | Generate lvm.conf ------------------------------------------------------- 0.29s
2026-03-29 01:46:09.965230 | aio | Ensure hostname inside hosts file --------------------------------------- 0.26s
2026-03-29 01:46:09.965451 | aio | Get list of all loopback devices ---------------------------------------- 0.18s
2026-03-29 01:46:09.965701 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-03-29 01:46:10.025530 | aio | INFO     [default > prepare] Executed: Successful
2026-03-29 01:46:10.034802 | aio | INFO     [default > converge] Executing
2026-03-29 01:46:10.815109 | aio |
2026-03-29 01:46:10.815296 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-29 01:46:10.815484 | aio |
2026-03-29 01:46:10.815725 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:46:10.815932 | aio | Sunday 29 March 2026  01:46:10 +0000 (0:00:00.045)       0:00:00.045 **********
2026-03-29 01:46:11.912504 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-29 01:46:11.912718 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-29 01:46:11.912932 | aio | interpreter could change the meaning of that path. See
2026-03-29 01:46:11.913078 | aio | https://docs.ansible.com/ansible-
2026-03-29 01:46:11.913210 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-29 01:46:11.925986 | aio | ok: [aio]
2026-03-29 01:46:11.926170 | aio |
2026-03-29 01:46:11.926370 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:46:11.926573 | aio | Sunday 29 March 2026  01:46:11 +0000 (0:00:01.110)       0:00:01.156 **********
2026-03-29 01:46:12.211419 | aio | ok: [aio]
2026-03-29 01:46:12.211591 | aio |
2026-03-29 01:46:12.211839 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:46:12.212044 | aio | Sunday 29 March 2026  01:46:12 +0000 (0:00:00.285)       0:00:01.441 **********
2026-03-29 01:46:12.248839 | aio | skipping: [aio]
2026-03-29 01:46:12.249033 | aio |
2026-03-29 01:46:12.249267 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-29 01:46:12.249494 | aio | Sunday 29 March 2026  01:46:12 +0000 (0:00:00.037)       0:00:01.479 **********
2026-03-29 01:46:12.541094 | aio | changed: [aio]
2026-03-29 01:46:12.541282 | aio |
2026-03-29 01:46:12.541495 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:46:12.541730 | aio | Sunday 29 March 2026  01:46:12 +0000 (0:00:00.292)       0:00:01.771 **********
2026-03-29 01:46:12.637979 | aio | ok: [aio] => {
2026-03-29 01:46:12.638207 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-29 01:46:12.638416 | aio | }
2026-03-29 01:46:12.638607 | aio |
2026-03-29 01:46:12.638824 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:46:12.639032 | aio | Sunday 29 March 2026  01:46:12 +0000 (0:00:00.097)       0:00:01.868 **********
2026-03-29 01:46:13.273573 | aio | changed: [aio]
2026-03-29 01:46:13.273773 | aio |
2026-03-29 01:46:13.273992 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:46:13.274211 | aio | Sunday 29 March 2026  01:46:13 +0000 (0:00:00.635)       0:00:02.504 **********
2026-03-29 01:46:13.315977 | aio | skipping: [aio]
2026-03-29 01:46:13.316165 | aio |
2026-03-29 01:46:13.316378 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:46:13.316583 | aio | Sunday 29 March 2026  01:46:13 +0000 (0:00:00.042)       0:00:02.546 **********
2026-03-29 01:46:13.356711 | aio | skipping: [aio]
2026-03-29 01:46:13.356939 | aio |
2026-03-29 01:46:13.357156 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:46:13.357360 | aio | Sunday 29 March 2026  01:46:13 +0000 (0:00:00.040)       0:00:02.587 **********
2026-03-29 01:46:13.540651 | aio | ok: [aio]
2026-03-29 01:46:13.540857 | aio |
2026-03-29 01:46:13.541075 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:46:13.541286 | aio | Sunday 29 March 2026  01:46:13 +0000 (0:00:00.183)       0:00:02.771 **********
2026-03-29 01:46:14.562204 | aio | ok: [aio]
2026-03-29 01:46:14.562413 | aio |
2026-03-29 01:46:14.562643 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:46:14.562867 | aio | Sunday 29 March 2026  01:46:14 +0000 (0:00:01.021)       0:00:03.792 **********
2026-03-29 01:46:14.633409 | aio | ok: [aio] => {
2026-03-29 01:46:14.633497 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-29 01:46:14.633600 | aio | }
2026-03-29 01:46:14.633690 | aio |
2026-03-29 01:46:14.633784 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:46:14.633870 | aio | Sunday 29 March 2026  01:46:14 +0000 (0:00:00.071)       0:00:03.864 **********
2026-03-29 01:46:15.517118 | aio | changed: [aio]
2026-03-29 01:46:15.517281 | aio |
2026-03-29 01:46:15.517504 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:46:15.517772 | aio | Sunday 29 March 2026  01:46:15 +0000 (0:00:00.883)       0:00:04.747 **********
2026-03-29 01:46:18.348603 | aio | changed: [aio]
2026-03-29 01:46:18.348936 | aio |
2026-03-29 01:46:18.349215 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-29 01:46:18.349478 | aio | Sunday 29 March 2026  01:46:18 +0000 (0:00:02.831)       0:00:07.579 **********
2026-03-29 01:46:18.373858 | aio | skipping: [aio]
2026-03-29 01:46:18.373913 | aio |
2026-03-29 01:46:18.373952 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-29 01:46:18.374065 | aio | Sunday 29 March 2026  01:46:18 +0000 (0:00:00.024)       0:00:07.603 **********
2026-03-29 01:46:18.399199 | aio | skipping: [aio]
2026-03-29 01:46:18.399251 | aio |
2026-03-29 01:46:18.399327 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-29 01:46:18.399413 | aio | Sunday 29 March 2026  01:46:18 +0000 (0:00:00.026)       0:00:07.630 **********
2026-03-29 01:46:18.429102 | aio | skipping: [aio]
2026-03-29 01:46:18.429170 | aio |
2026-03-29 01:46:18.429311 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-29 01:46:18.429440 | aio | Sunday 29 March 2026  01:46:18 +0000 (0:00:00.029)       0:00:07.660 **********
2026-03-29 01:46:23.327527 | aio | changed: [aio]
2026-03-29 01:46:23.327605 | aio |
2026-03-29 01:46:23.327811 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-29 01:46:23.327851 | aio | Sunday 29 March 2026  01:46:23 +0000 (0:00:04.898)       0:00:12.558 **********
2026-03-29 01:46:23.850925 | aio | changed: [aio]
2026-03-29 01:46:23.850980 | aio |
2026-03-29 01:46:23.851297 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-29 01:46:23.851345 | aio | Sunday 29 March 2026  01:46:23 +0000 (0:00:00.523)       0:00:13.081 **********
2026-03-29 01:46:24.715765 | aio | changed: [aio] => (item={'path': '/etc/containerd'})
2026-03-29 01:46:24.715874 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-29 01:46:24.716681 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-29 01:46:24.716730 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-29 01:46:24.716738 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-29 01:46:24.716745 | aio |
2026-03-29 01:46:24.716751 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-29 01:46:24.716757 | aio | Sunday 29 March 2026  01:46:24 +0000 (0:00:00.864)       0:00:13.946 **********
2026-03-29 01:46:25.246959 | aio | changed: [aio]
2026-03-29 01:46:25.247024 | aio |
2026-03-29 01:46:25.247120 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-29 01:46:25.247519 | aio | Sunday 29 March 2026  01:46:25 +0000 (0:00:00.523)       0:00:14.469 **********
2026-03-29 01:46:25.247562 | aio |
2026-03-29 01:46:25.247567 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-29 01:46:25.247572 | aio | Sunday 29 March 2026  01:46:25 +0000 (0:00:00.007)       0:00:14.477 **********
2026-03-29 01:46:26.132019 | aio | ok: [aio]
2026-03-29 01:46:26.132087 | aio |
2026-03-29 01:46:26.132403 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-29 01:46:26.132557 | aio | Sunday 29 March 2026  01:46:26 +0000 (0:00:00.884)       0:00:15.362 **********
2026-03-29 01:46:26.570598 | aio | changed: [aio]
2026-03-29 01:46:26.570664 | aio |
2026-03-29 01:46:26.570988 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-29 01:46:26.571039 | aio | Sunday 29 March 2026  01:46:26 +0000 (0:00:00.438)       0:00:15.801 **********
2026-03-29 01:46:27.085973 | aio | changed: [aio]
2026-03-29 01:46:27.086039 | aio |
2026-03-29 01:46:27.086118 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:46:27.086247 | aio | Sunday 29 March 2026  01:46:27 +0000 (0:00:00.515)       0:00:16.316 **********
2026-03-29 01:46:27.289761 | aio | ok: [aio]
2026-03-29 01:46:27.289819 | aio |
2026-03-29 01:46:27.290056 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:46:27.290108 | aio | Sunday 29 March 2026  01:46:27 +0000 (0:00:00.203)       0:00:16.520 **********
2026-03-29 01:46:27.360498 | aio | ok: [aio] => {
2026-03-29 01:46:27.360550 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-29 01:46:27.360923 | aio | }
2026-03-29 01:46:27.360950 | aio |
2026-03-29 01:46:27.360955 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:46:27.360961 | aio | Sunday 29 March 2026  01:46:27 +0000 (0:00:00.070)       0:00:16.591 **********
2026-03-29 01:46:28.602682 | aio | changed: [aio]
2026-03-29 01:46:28.602754 | aio |
2026-03-29 01:46:28.603074 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:46:28.603120 | aio | Sunday 29 March 2026  01:46:28 +0000 (0:00:01.242)       0:00:17.833 **********
2026-03-29 01:46:32.855528 | aio | changed: [aio]
2026-03-29 01:46:32.855592 | aio |
2026-03-29 01:46:32.855678 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-29 01:46:32.855809 | aio | Sunday 29 March 2026  01:46:32 +0000 (0:00:04.253)       0:00:22.086 **********
2026-03-29 01:46:33.772494 | aio | ok: [aio]
2026-03-29 01:46:33.772573 | aio |
2026-03-29 01:46:33.772866 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-29 01:46:33.772912 | aio | Sunday 29 March 2026  01:46:33 +0000 (0:00:00.916)       0:00:23.003 **********
2026-03-29 01:46:34.110873 | aio | changed: [aio]
2026-03-29 01:46:34.110923 | aio |
2026-03-29 01:46:34.111152 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-29 01:46:34.111196 | aio | Sunday 29 March 2026  01:46:34 +0000 (0:00:00.338)       0:00:23.341 **********
2026-03-29 01:46:34.550152 | aio | changed: [aio]
2026-03-29 01:46:34.550566 | aio |
2026-03-29 01:46:34.550613 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-29 01:46:34.550621 | aio | Sunday 29 March 2026  01:46:34 +0000 (0:00:00.439)       0:00:23.780 **********
2026-03-29 01:46:35.084355 | aio | changed: [aio] => (item={'path': '/etc/docker'})
2026-03-29 01:46:35.084399 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-29 01:46:35.084408 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-29 01:46:35.084415 | aio |
2026-03-29 01:46:35.084422 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-29 01:46:35.084429 | aio | Sunday 29 March 2026  01:46:35 +0000 (0:00:00.533)       0:00:24.314 **********
2026-03-29 01:46:35.523205 | aio | changed: [aio]
2026-03-29 01:46:35.523249 | aio |
2026-03-29 01:46:35.523256 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-29 01:46:35.523263 | aio | Sunday 29 March 2026  01:46:35 +0000 (0:00:00.439)       0:00:24.753 **********
2026-03-29 01:46:35.943142 | aio | changed: [aio]
2026-03-29 01:46:35.943179 | aio |
2026-03-29 01:46:35.943184 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-29 01:46:35.943189 | aio | Sunday 29 March 2026  01:46:35 +0000 (0:00:00.411)       0:00:25.165 **********
2026-03-29 01:46:35.943193 | aio |
2026-03-29 01:46:35.943197 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-29 01:46:35.943201 | aio | Sunday 29 March 2026  01:46:35 +0000 (0:00:00.008)       0:00:25.173 **********
2026-03-29 01:46:36.584231 | aio | ok: [aio]
2026-03-29 01:46:36.584301 | aio |
2026-03-29 01:46:36.584316 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-29 01:46:36.584475 | aio | Sunday 29 March 2026  01:46:36 +0000 (0:00:00.641)       0:00:25.815 **********
2026-03-29 01:46:37.537983 | aio | changed: [aio]
2026-03-29 01:46:37.538059 | aio |
2026-03-29 01:46:37.538119 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-29 01:46:37.538255 | aio | Sunday 29 March 2026  01:46:37 +0000 (0:00:00.953)       0:00:26.768 **********
2026-03-29 01:46:38.076084 | aio | changed: [aio]
2026-03-29 01:46:38.076151 | aio |
2026-03-29 01:46:38.076225 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-29 01:46:38.076355 | aio | Sunday 29 March 2026  01:46:38 +0000 (0:00:00.538)       0:00:27.306 **********
2026-03-29 01:46:38.125634 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-29 01:46:38.126059 | aio |
2026-03-29 01:46:38.126092 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-29 01:46:38.126100 | aio | Sunday 29 March 2026  01:46:38 +0000 (0:00:00.049)       0:00:27.356 **********
2026-03-29 01:46:42.765438 | aio | changed: [aio]
2026-03-29 01:46:42.765526 | aio |
2026-03-29 01:46:42.765845 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-29 01:46:42.765898 | aio | Sunday 29 March 2026  01:46:42 +0000 (0:00:04.639)       0:00:31.996 **********
2026-03-29 01:46:43.404864 | aio | ok: [aio] => (item=chronyd)
2026-03-29 01:46:43.404934 | aio | ok: [aio] => (item=sshd)
2026-03-29 01:46:43.404990 | aio |
2026-03-29 01:46:43.405217 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-29 01:46:43.405259 | aio | Sunday 29 March 2026  01:46:43 +0000 (0:00:00.639)       0:00:32.635 **********
2026-03-29 01:46:44.131962 | aio | changed: [aio]
2026-03-29 01:46:44.132036 | aio |
2026-03-29 01:46:44.132115 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-29 01:46:44.132227 | aio | Sunday 29 March 2026  01:46:44 +0000 (0:00:00.727)       0:00:33.362 **********
2026-03-29 01:46:44.326917 | aio | ok: [aio]
2026-03-29 01:46:44.327344 | aio |
2026-03-29 01:46:44.327392 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-29 01:46:44.327400 | aio | Sunday 29 March 2026  01:46:44 +0000 (0:00:00.194)       0:00:33.557 **********
2026-03-29 01:46:44.778011 | aio | changed: [aio]
2026-03-29 01:46:44.778058 | aio |
2026-03-29 01:46:44.778063 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-29 01:46:44.778068 | aio | Sunday 29 March 2026  01:46:44 +0000 (0:00:00.451)       0:00:34.008 **********
2026-03-29 01:46:45.086662 | aio | changed: [aio]
2026-03-29 01:46:45.086722 | aio |
2026-03-29 01:46:45.086814 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-29 01:46:45.086947 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.308)       0:00:34.317 **********
2026-03-29 01:46:45.232052 | aio | ok: [aio]
2026-03-29 01:46:45.232095 | aio |
2026-03-29 01:46:45.232332 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-29 01:46:45.232374 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.145)       0:00:34.462 **********
2026-03-29 01:46:45.429127 | aio | ok: [aio] => (item=aio)
2026-03-29 01:46:45.429190 | aio |
2026-03-29 01:46:45.429332 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-29 01:46:45.429471 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.196)       0:00:34.659 **********
2026-03-29 01:46:45.472299 | aio | ok: [aio]
2026-03-29 01:46:45.472682 | aio |
2026-03-29 01:46:45.472706 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-29 01:46:45.472714 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.043)       0:00:34.702 **********
2026-03-29 01:46:45.559675 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio
2026-03-29 01:46:45.559713 | aio |
2026-03-29 01:46:45.559958 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-03-29 01:46:45.560003 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.087)       0:00:34.790 **********
2026-03-29 01:46:45.835516 | aio | changed: [aio]
2026-03-29 01:46:45.835587 | aio |
2026-03-29 01:46:45.835774 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-03-29 01:46:45.835821 | aio | Sunday 29 March 2026  01:46:45 +0000 (0:00:00.275)       0:00:35.066 **********
2026-03-29 01:46:46.473972 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-03-29 01:46:46.474085 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-03-29 01:46:46.474653 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-03-29 01:46:46.474701 | aio |
2026-03-29 01:46:46.474710 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-03-29 01:46:46.474717 | aio | Sunday 29 March 2026  01:46:46 +0000 (0:00:00.638)       0:00:35.704 **********
2026-03-29 01:48:09.603602 | aio | ok: [aio]
2026-03-29 01:48:09.603690 | aio |
2026-03-29 01:48:09.603770 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-03-29 01:48:09.603926 | aio | Sunday 29 March 2026  01:48:09 +0000 (0:01:23.128)       0:01:58.832 **********
2026-03-29 01:48:09.814991 | aio | changed: [aio]
2026-03-29 01:48:09.815109 | aio |
2026-03-29 01:48:09.815117 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-03-29 01:48:09.815123 | aio | Sunday 29 March 2026  01:48:09 +0000 (0:00:00.212)       0:01:59.045 **********
2026-03-29 01:48:09.847033 | aio | ok: [aio]
2026-03-29 01:48:09.847114 | aio |
2026-03-29 01:48:09.847186 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:48:09.847280 | aio | Sunday 29 March 2026  01:48:09 +0000 (0:00:00.032)       0:01:59.077 **********
2026-03-29 01:48:09.906383 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:48:09.906461 | aio |
2026-03-29 01:48:09.906475 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:48:09.906592 | aio | Sunday 29 March 2026  01:48:09 +0000 (0:00:00.059)       0:01:59.137 **********
2026-03-29 01:48:15.559233 | aio | ok: [aio]
2026-03-29 01:48:15.559275 | aio |
2026-03-29 01:48:15.559281 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:48:15.559286 | aio | Sunday 29 March 2026  01:48:15 +0000 (0:00:05.651)       0:02:04.789 **********
2026-03-29 01:48:15.599224 | aio | ok: [aio] => (item=aio)
2026-03-29 01:48:15.599301 | aio |
2026-03-29 01:48:15.599540 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:48:15.599590 | aio | Sunday 29 March 2026  01:48:15 +0000 (0:00:00.040)       0:02:04.830 **********
2026-03-29 01:48:15.953172 | aio | ok: [aio]
2026-03-29 01:48:15.953243 | aio |
2026-03-29 01:48:15.953438 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:48:15.953494 | aio | Sunday 29 March 2026  01:48:15 +0000 (0:00:00.353)       0:02:05.184 **********
2026-03-29 01:48:23.391302 | aio | ok: [aio]
2026-03-29 01:48:23.391373 | aio |
2026-03-29 01:48:23.391488 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-29 01:48:23.391596 | aio | Sunday 29 March 2026  01:48:23 +0000 (0:00:07.437)       0:02:12.621 **********
2026-03-29 01:49:16.539634 | aio | changed: [aio]
2026-03-29 01:49:16.539708 | aio |
2026-03-29 01:49:16.539854 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-29 01:49:16.540020 | aio | Sunday 29 March 2026  01:49:16 +0000 (0:00:53.148)       0:03:05.770 **********
2026-03-29 01:49:30.470522 | aio | ok: [aio]
2026-03-29 01:49:30.470612 | aio |
2026-03-29 01:49:30.470725 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:49:30.470844 | aio | Sunday 29 March 2026  01:49:30 +0000 (0:00:13.931)       0:03:19.701 **********
2026-03-29 01:49:30.535126 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:49:30.535171 | aio |
2026-03-29 01:49:30.535177 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:49:30.535182 | aio | Sunday 29 March 2026  01:49:30 +0000 (0:00:00.064)       0:03:19.765 **********
2026-03-29 01:49:30.575217 | aio | skipping: [aio]
2026-03-29 01:49:30.575243 | aio |
2026-03-29 01:49:30.575250 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:49:30.575256 | aio | Sunday 29 March 2026  01:49:30 +0000 (0:00:00.040)       0:03:19.805 **********
2026-03-29 01:49:30.620477 | aio | skipping: [aio] => (item=aio)
2026-03-29 01:49:30.620517 | aio | skipping: [aio]
2026-03-29 01:49:30.620524 | aio |
2026-03-29 01:49:30.620531 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:49:30.620537 | aio | Sunday 29 March 2026  01:49:30 +0000 (0:00:00.045)       0:03:19.851 **********
2026-03-29 01:49:30.866487 | aio | ok: [aio]
2026-03-29 01:49:30.866559 | aio |
2026-03-29 01:49:30.866652 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:49:30.866785 | aio | Sunday 29 March 2026  01:49:30 +0000 (0:00:00.246)       0:03:20.097 **********
2026-03-29 01:49:37.201472 | aio | ok: [aio]
2026-03-29 01:49:37.201560 | aio |
2026-03-29 01:49:37.201789 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-29 01:49:37.201839 | aio | Sunday 29 March 2026  01:49:37 +0000 (0:00:06.334)       0:03:26.432 **********
2026-03-29 01:49:49.084749 | aio | changed: [aio]
2026-03-29 01:49:49.084824 | aio |
2026-03-29 01:49:49.085059 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-29 01:49:49.085116 | aio | Sunday 29 March 2026  01:49:49 +0000 (0:00:11.883)       0:03:38.315 **********
2026-03-29 01:49:54.980191 | aio | ok: [aio]
2026-03-29 01:49:54.980258 | aio |
2026-03-29 01:49:54.980337 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-29 01:49:54.980470 | aio | Sunday 29 March 2026  01:49:54 +0000 (0:00:05.895)       0:03:44.211 **********
2026-03-29 01:50:00.236799 | aio | changed: [aio] => (item={'name': 'diskprediction_local'})
2026-03-29 01:50:00.236882 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-29 01:50:00.236947 | aio | changed: [aio] => (item={'name': 'prometheus'})
2026-03-29 01:50:00.237042 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-29 01:50:00.237128 | aio |
2026-03-29 01:50:00.237225 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-29 01:50:00.237303 | aio |
2026-03-29 01:50:00.237397 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:50:00.237493 | aio | Sunday 29 March 2026  01:50:00 +0000 (0:00:05.256)       0:03:49.467 **********
2026-03-29 01:50:01.097337 | aio | ok: [aio]
2026-03-29 01:50:01.097440 | aio |
2026-03-29 01:50:01.097483 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:50:01.097615 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.860)       0:03:50.328 **********
2026-03-29 01:50:01.289045 | aio | ok: [aio]
2026-03-29 01:50:01.289130 | aio |
2026-03-29 01:50:01.289144 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:50:01.289157 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.190)       0:03:50.518 **********
2026-03-29 01:50:01.320482 | aio | skipping: [aio]
2026-03-29 01:50:01.320548 | aio |
2026-03-29 01:50:01.320638 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-29 01:50:01.320740 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.032)       0:03:50.551 **********
2026-03-29 01:50:01.513195 | aio | ok: [aio]
2026-03-29 01:50:01.513250 | aio |
2026-03-29 01:50:01.513351 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:50:01.513441 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.192)       0:03:50.744 **********
2026-03-29 01:50:01.563031 | aio | ok: [aio] => {
2026-03-29 01:50:01.563098 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-29 01:50:01.563112 | aio | }
2026-03-29 01:50:01.563206 | aio |
2026-03-29 01:50:01.563297 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:50:01.563388 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.049)       0:03:50.794 **********
2026-03-29 01:50:01.850500 | aio | ok: [aio]
2026-03-29 01:50:01.850566 | aio |
2026-03-29 01:50:01.850627 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:50:01.850726 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.287)       0:03:51.081 **********
2026-03-29 01:50:01.885196 | aio | skipping: [aio]
2026-03-29 01:50:01.885266 | aio |
2026-03-29 01:50:01.885355 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:50:01.885452 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.034)       0:03:51.116 **********
2026-03-29 01:50:01.922088 | aio | skipping: [aio]
2026-03-29 01:50:01.922145 | aio |
2026-03-29 01:50:01.922255 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:50:01.922346 | aio | Sunday 29 March 2026  01:50:01 +0000 (0:00:00.036)       0:03:51.153 **********
2026-03-29 01:50:02.114380 | aio | ok: [aio]
2026-03-29 01:50:02.114468 | aio |
2026-03-29 01:50:02.114621 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:50:02.114767 | aio | Sunday 29 March 2026  01:50:02 +0000 (0:00:00.191)       0:03:51.345 **********
2026-03-29 01:50:03.096230 | aio | ok: [aio]
2026-03-29 01:50:03.096284 | aio |
2026-03-29 01:50:03.096396 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:50:03.096494 | aio | Sunday 29 March 2026  01:50:03 +0000 (0:00:00.982)       0:03:52.327 **********
2026-03-29 01:50:03.158228 | aio | ok: [aio] => {
2026-03-29 01:50:03.158298 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-29 01:50:03.158369 | aio | }
2026-03-29 01:50:03.158452 | aio |
2026-03-29 01:50:03.158555 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:50:03.158650 | aio | Sunday 29 March 2026  01:50:03 +0000 (0:00:00.061)       0:03:52.389 **********
2026-03-29 01:50:03.471337 | aio | ok: [aio]
2026-03-29 01:50:03.471397 | aio |
2026-03-29 01:50:03.471484 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:50:03.471584 | aio | Sunday 29 March 2026  01:50:03 +0000 (0:00:00.313)       0:03:52.702 **********
2026-03-29 01:50:05.378044 | aio | ok: [aio]
2026-03-29 01:50:05.378114 | aio |
2026-03-29 01:50:05.378178 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-29 01:50:05.378275 | aio | Sunday 29 March 2026  01:50:05 +0000 (0:00:01.906)       0:03:54.608 **********
2026-03-29 01:50:05.409553 | aio | skipping: [aio]
2026-03-29 01:50:05.409769 | aio |
2026-03-29 01:50:05.409979 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-29 01:50:05.410209 | aio | Sunday 29 March 2026  01:50:05 +0000 (0:00:00.031)       0:03:54.640 **********
2026-03-29 01:50:05.441874 | aio | skipping: [aio]
2026-03-29 01:50:05.441911 | aio |
2026-03-29 01:50:05.442021 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-29 01:50:05.442112 | aio | Sunday 29 March 2026  01:50:05 +0000 (0:00:00.032)       0:03:54.672 **********
2026-03-29 01:50:05.469498 | aio | skipping: [aio]
2026-03-29 01:50:05.469603 | aio |
2026-03-29 01:50:05.469743 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-29 01:50:05.469871 | aio | Sunday 29 March 2026  01:50:05 +0000 (0:00:00.027)       0:03:54.700 **********
2026-03-29 01:50:06.491351 | aio | ok: [aio]
2026-03-29 01:50:06.491506 | aio |
2026-03-29 01:50:06.491621 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-29 01:50:06.491779 | aio | Sunday 29 March 2026  01:50:06 +0000 (0:00:01.021)       0:03:55.722 **********
2026-03-29 01:50:06.882611 | aio | ok: [aio]
2026-03-29 01:50:06.882680 | aio |
2026-03-29 01:50:06.882829 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-29 01:50:06.882958 | aio | Sunday 29 March 2026  01:50:06 +0000 (0:00:00.391)       0:03:56.113 **********
2026-03-29 01:50:07.754786 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-29 01:50:07.754891 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-29 01:50:07.755021 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-29 01:50:07.755164 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-29 01:50:07.755303 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-29 01:50:07.755424 | aio |
2026-03-29 01:50:07.755553 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-29 01:50:07.755688 | aio | Sunday 29 March 2026  01:50:07 +0000 (0:00:00.872)       0:03:56.985 **********
2026-03-29 01:50:08.230241 | aio | ok: [aio]
2026-03-29 01:50:08.230308 | aio |
2026-03-29 01:50:08.230458 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-29 01:50:08.230588 | aio | Sunday 29 March 2026  01:50:08 +0000 (0:00:00.468)       0:03:57.453 **********
2026-03-29 01:50:08.230718 | aio |
2026-03-29 01:50:08.230825 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-29 01:50:08.230906 | aio | Sunday 29 March 2026  01:50:08 +0000 (0:00:00.007)       0:03:57.460 **********
2026-03-29 01:50:08.580024 | aio | ok: [aio]
2026-03-29 01:50:08.580068 | aio |
2026-03-29 01:50:08.580267 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:50:08.580352 | aio | Sunday 29 March 2026  01:50:08 +0000 (0:00:00.349)       0:03:57.810 **********
2026-03-29 01:50:08.787733 | aio | ok: [aio]
2026-03-29 01:50:08.787776 | aio |
2026-03-29 01:50:08.787881 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:50:08.787977 | aio | Sunday 29 March 2026  01:50:08 +0000 (0:00:00.207)       0:03:58.018 **********
2026-03-29 01:50:08.839325 | aio | ok: [aio] => {
2026-03-29 01:50:08.839364 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-29 01:50:08.839464 | aio | }
2026-03-29 01:50:08.839536 | aio |
2026-03-29 01:50:08.839629 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:50:08.839727 | aio | Sunday 29 March 2026  01:50:08 +0000 (0:00:00.051)       0:03:58.070 **********
2026-03-29 01:50:09.172996 | aio | ok: [aio]
2026-03-29 01:50:09.173067 | aio |
2026-03-29 01:50:09.173381 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:50:09.173433 | aio | Sunday 29 March 2026  01:50:09 +0000 (0:00:00.333)       0:03:58.403 **********
2026-03-29 01:50:12.169602 | aio | ok: [aio]
2026-03-29 01:50:12.169676 | aio |
2026-03-29 01:50:12.169902 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-29 01:50:12.169952 | aio | Sunday 29 March 2026  01:50:12 +0000 (0:00:02.996)       0:04:01.400 **********
2026-03-29 01:50:13.132741 | aio | ok: [aio]
2026-03-29 01:50:13.132805 | aio |
2026-03-29 01:50:13.132938 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-29 01:50:13.133070 | aio | Sunday 29 March 2026  01:50:13 +0000 (0:00:00.962)       0:04:02.363 **********
2026-03-29 01:50:13.322403 | aio | ok: [aio]
2026-03-29 01:50:13.322443 | aio |
2026-03-29 01:50:13.322448 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-29 01:50:13.322453 | aio | Sunday 29 March 2026  01:50:13 +0000 (0:00:00.189)       0:04:02.552 **********
2026-03-29 01:50:13.759947 | aio | ok: [aio]
2026-03-29 01:50:13.760013 | aio |
2026-03-29 01:50:13.760357 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-29 01:50:13.760405 | aio | Sunday 29 March 2026  01:50:13 +0000 (0:00:00.438)       0:04:02.990 **********
2026-03-29 01:50:14.308225 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-29 01:50:14.308293 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-29 01:50:14.308388 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-29 01:50:14.308477 | aio |
2026-03-29 01:50:14.308584 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-29 01:50:14.308682 | aio | Sunday 29 March 2026  01:50:14 +0000 (0:00:00.548)       0:04:03.539 **********
2026-03-29 01:50:14.704047 | aio | ok: [aio]
2026-03-29 01:50:14.704109 | aio |
2026-03-29 01:50:14.704194 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-29 01:50:14.704327 | aio | Sunday 29 March 2026  01:50:14 +0000 (0:00:00.395)       0:04:03.934 **********
2026-03-29 01:50:15.109319 | aio | ok: [aio]
2026-03-29 01:50:15.109389 | aio |
2026-03-29 01:50:15.109462 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-29 01:50:15.109639 | aio | Sunday 29 March 2026  01:50:15 +0000 (0:00:00.399)       0:04:04.334 **********
2026-03-29 01:50:15.109714 | aio |
2026-03-29 01:50:15.109752 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-29 01:50:15.109880 | aio | Sunday 29 March 2026  01:50:15 +0000 (0:00:00.005)       0:04:04.340 **********
2026-03-29 01:50:15.458544 | aio | ok: [aio]
2026-03-29 01:50:15.458600 | aio |
2026-03-29 01:50:15.458640 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-29 01:50:15.458750 | aio | Sunday 29 March 2026  01:50:15 +0000 (0:00:00.349)       0:04:04.689 **********
2026-03-29 01:50:15.502828 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-29 01:50:15.502936 | aio |
2026-03-29 01:50:15.503101 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-29 01:50:15.503243 | aio | Sunday 29 March 2026  01:50:15 +0000 (0:00:00.044)       0:04:04.733 **********
2026-03-29 01:50:16.433254 | aio | ok: [aio]
2026-03-29 01:50:16.433356 | aio |
2026-03-29 01:50:16.433579 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-29 01:50:16.433691 | aio | Sunday 29 March 2026  01:50:16 +0000 (0:00:00.930)       0:04:05.663 **********
2026-03-29 01:50:17.067453 | aio | ok: [aio] => (item=chronyd)
2026-03-29 01:50:17.067530 | aio | ok: [aio] => (item=sshd)
2026-03-29 01:50:17.068084 | aio |
2026-03-29 01:50:17.068133 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-29 01:50:17.068141 | aio | Sunday 29 March 2026  01:50:17 +0000 (0:00:00.634)       0:04:06.298 **********
2026-03-29 01:50:17.676101 | aio | ok: [aio]
2026-03-29 01:50:17.676175 | aio |
2026-03-29 01:50:17.676360 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-29 01:50:17.676408 | aio | Sunday 29 March 2026  01:50:17 +0000 (0:00:00.608)       0:04:06.906 **********
2026-03-29 01:50:17.868722 | aio | ok: [aio]
2026-03-29 01:50:17.868793 | aio |
2026-03-29 01:50:17.868999 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-29 01:50:17.869045 | aio | Sunday 29 March 2026  01:50:17 +0000 (0:00:00.192)       0:04:07.099 **********
2026-03-29 01:50:18.099245 | aio | ok: [aio]
2026-03-29 01:50:18.099345 | aio |
2026-03-29 01:50:18.099620 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-29 01:50:18.099642 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.230)       0:04:07.329 **********
2026-03-29 01:50:18.289317 | aio | ok: [aio]
2026-03-29 01:50:18.289389 | aio |
2026-03-29 01:50:18.289477 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-29 01:50:18.289597 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.190)       0:04:07.520 **********
2026-03-29 01:50:18.499168 | aio | ok: [aio] => (item=aio)
2026-03-29 01:50:18.499264 | aio |
2026-03-29 01:50:18.499567 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-29 01:50:18.499619 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.209)       0:04:07.729 **********
2026-03-29 01:50:18.544006 | aio | ok: [aio]
2026-03-29 01:50:18.544079 | aio |
2026-03-29 01:50:18.544290 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:50:18.544310 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.045)       0:04:07.774 **********
2026-03-29 01:50:18.599767 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:50:18.599826 | aio |
2026-03-29 01:50:18.599935 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:50:18.600050 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.055)       0:04:07.830 **********
2026-03-29 01:50:18.645665 | aio | skipping: [aio]
2026-03-29 01:50:18.645781 | aio |
2026-03-29 01:50:18.645938 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:50:18.646074 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.045)       0:04:07.876 **********
2026-03-29 01:50:18.684594 | aio | skipping: [aio] => (item=aio)
2026-03-29 01:50:18.684828 | aio | skipping: [aio]
2026-03-29 01:50:18.685026 | aio |
2026-03-29 01:50:18.685255 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:50:18.685473 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.038)       0:04:07.915 **********
2026-03-29 01:50:18.924181 | aio | ok: [aio]
2026-03-29 01:50:18.924880 | aio |
2026-03-29 01:50:18.925114 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:50:18.925326 | aio | Sunday 29 March 2026  01:50:18 +0000 (0:00:00.239)       0:04:08.154 **********
2026-03-29 01:50:25.133329 | aio | ok: [aio]
2026-03-29 01:50:25.133409 | aio |
2026-03-29 01:50:25.133626 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-29 01:50:25.133707 | aio | Sunday 29 March 2026  01:50:25 +0000 (0:00:06.209)       0:04:14.364 **********
2026-03-29 01:50:30.419245 | aio | ok: [aio]
2026-03-29 01:50:30.419318 | aio |
2026-03-29 01:50:30.419402 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-29 01:50:30.419539 | aio | Sunday 29 March 2026  01:50:30 +0000 (0:00:05.285)       0:04:19.650 **********
2026-03-29 01:50:44.212442 | aio | ok: [aio]
2026-03-29 01:50:44.212506 | aio |
2026-03-29 01:50:44.212703 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-29 01:50:44.212724 | aio | Sunday 29 March 2026  01:50:44 +0000 (0:00:13.793)       0:04:33.443 **********
2026-03-29 01:52:12.054429 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-29 01:52:12.054499 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-29 01:52:12.054597 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-29 01:52:12.054691 | aio |
2026-03-29 01:52:12.054797 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-29 01:52:12.054900 | aio | Sunday 29 March 2026  01:52:12 +0000 (0:01:27.842)       0:06:01.285 **********
2026-03-29 01:52:17.699566 | aio | ok: [aio]
2026-03-29 01:52:17.699652 | aio |
2026-03-29 01:52:17.699715 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-29 01:52:17.699810 | aio | Sunday 29 March 2026  01:52:17 +0000 (0:00:05.645)       0:06:06.930 **********
2026-03-29 01:52:23.623679 | aio | ok: [aio]
2026-03-29 01:52:23.623728 | aio |
2026-03-29 01:52:23.623734 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-29 01:52:23.623743 | aio | Sunday 29 March 2026  01:52:23 +0000 (0:00:05.923)       0:06:12.854 **********
2026-03-29 01:52:23.676537 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-29 01:52:23.676558 | aio |
2026-03-29 01:52:23.676563 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-29 01:52:23.676567 | aio | Sunday 29 March 2026  01:52:23 +0000 (0:00:00.053)       0:06:12.907 **********
2026-03-29 01:52:23.713664 | aio | ok: [aio]
2026-03-29 01:52:23.713727 | aio |
2026-03-29 01:52:23.713745 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-29 01:52:23.713822 | aio | Sunday 29 March 2026  01:52:23 +0000 (0:00:00.036)       0:06:12.944 **********
2026-03-29 01:52:29.635085 | aio | ok: [aio]
2026-03-29 01:52:29.635171 | aio |
2026-03-29 01:52:29.635231 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-29 01:52:29.635353 | aio | Sunday 29 March 2026  01:52:29 +0000 (0:00:05.921)       0:06:18.865 **********
2026-03-29 01:52:29.672539 | aio | ok: [aio]
2026-03-29 01:52:29.672636 | aio |
2026-03-29 01:52:29.672878 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-29 01:52:29.672917 | aio | Sunday 29 March 2026  01:52:29 +0000 (0:00:00.037)       0:06:18.903 **********
2026-03-29 01:52:29.714032 | aio | skipping: [aio] => (item=1)
2026-03-29 01:52:29.714104 | aio | skipping: [aio] => (item=1)
2026-03-29 01:52:29.714673 | aio | skipping: [aio] => (item=1)
2026-03-29 01:52:29.714747 | aio | skipping: [aio]
2026-03-29 01:52:29.714753 | aio |
2026-03-29 01:52:29.714758 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-29 01:52:29.714762 | aio | Sunday 29 March 2026  01:52:29 +0000 (0:00:00.041)       0:06:18.944 **********
2026-03-29 01:52:29.739509 | aio | skipping: [aio]
2026-03-29 01:52:29.739572 | aio |
2026-03-29 01:52:29.739676 | aio | PLAY RECAP *********************************************************************
2026-03-29 01:52:29.741109 | aio | aio                        : ok=106  changed=29   unreachable=0    failed=0    skipped=18   rescued=0    ignored=0
2026-03-29 01:52:29.741129 | aio |
2026-03-29 01:52:29.741135 | aio |
2026-03-29 01:52:29.741139 | aio | TASKS RECAP ********************************************************************
2026-03-29 01:52:29.741144 | aio | Sunday 29 March 2026  01:52:29 +0000 (0:00:00.025)       0:06:18.970 **********
2026-03-29 01:52:29.741148 | aio | ===============================================================================
2026-03-29 01:52:29.741152 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 87.84s
2026-03-29 01:52:29.741156 | aio | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 83.13s
2026-03-29 01:52:29.741160 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 53.15s
2026-03-29 01:52:29.741164 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 13.93s
2026-03-29 01:52:29.741168 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.79s
2026-03-29 01:52:29.741172 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.88s
2026-03-29 01:52:29.741177 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.44s
2026-03-29 01:52:29.741181 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.33s
2026-03-29 01:52:29.741185 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.21s
2026-03-29 01:52:29.742168 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.92s
2026-03-29 01:52:29.742181 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.92s
2026-03-29 01:52:29.742186 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.90s
2026-03-29 01:52:29.742190 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.65s
2026-03-29 01:52:29.742194 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.65s
2026-03-29 01:52:29.742198 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.29s
2026-03-29 01:52:29.742202 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.26s
2026-03-29 01:52:29.742206 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 4.90s
2026-03-29 01:52:29.742210 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.64s
2026-03-29 01:52:29.742214 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.25s
2026-03-29 01:52:29.742217 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.00s
2026-03-29 01:52:29.853753 | aio | INFO     [default > converge] Executed: Successful
2026-03-29 01:52:29.862797 | aio | INFO     [default > idempotence] Executing
2026-03-29 01:52:30.654080 | aio |
2026-03-29 01:52:30.654429 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-29 01:52:30.654685 | aio |
2026-03-29 01:52:30.654955 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:52:30.655226 | aio | Sunday 29 March 2026  01:52:30 +0000 (0:00:00.046)       0:00:00.046 **********
2026-03-29 01:52:31.785632 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-29 01:52:31.785829 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-29 01:52:31.785922 | aio | interpreter could change the meaning of that path. See
2026-03-29 01:52:31.786138 | aio | https://docs.ansible.com/ansible-
2026-03-29 01:52:31.786358 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-29 01:52:31.798642 | aio | ok: [aio]
2026-03-29 01:52:31.798817 | aio |
2026-03-29 01:52:31.799021 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:52:31.799218 | aio | Sunday 29 March 2026  01:52:31 +0000 (0:00:01.144)       0:00:01.191 **********
2026-03-29 01:52:32.068559 | aio | ok: [aio]
2026-03-29 01:52:32.068714 | aio |
2026-03-29 01:52:32.068929 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:52:32.069143 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.269)       0:00:01.461 **********
2026-03-29 01:52:32.100260 | aio | skipping: [aio]
2026-03-29 01:52:32.100441 | aio |
2026-03-29 01:52:32.100654 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-29 01:52:32.100864 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.031)       0:00:01.493 **********
2026-03-29 01:52:32.399557 | aio | ok: [aio]
2026-03-29 01:52:32.399727 | aio |
2026-03-29 01:52:32.399940 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:52:32.400143 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.299)       0:00:01.792 **********
2026-03-29 01:52:32.468347 | aio | ok: [aio] => {
2026-03-29 01:52:32.468550 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-29 01:52:32.468741 | aio | }
2026-03-29 01:52:32.468920 | aio |
2026-03-29 01:52:32.469127 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:52:32.469328 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.068)       0:00:01.861 **********
2026-03-29 01:52:32.862773 | aio | ok: [aio]
2026-03-29 01:52:32.863029 | aio |
2026-03-29 01:52:32.863262 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:52:32.863424 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.393)       0:00:02.254 **********
2026-03-29 01:52:32.896302 | aio | skipping: [aio]
2026-03-29 01:52:32.896433 | aio |
2026-03-29 01:52:32.896688 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:52:32.896849 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.034)       0:00:02.289 **********
2026-03-29 01:52:32.929698 | aio | skipping: [aio]
2026-03-29 01:52:32.929836 | aio |
2026-03-29 01:52:32.930089 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:52:32.930248 | aio | Sunday 29 March 2026  01:52:32 +0000 (0:00:00.033)       0:00:02.322 **********
2026-03-29 01:52:33.124428 | aio | ok: [aio]
2026-03-29 01:52:33.124594 | aio |
2026-03-29 01:52:33.124805 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:52:33.125010 | aio | Sunday 29 March 2026  01:52:33 +0000 (0:00:00.194)       0:00:02.517 **********
2026-03-29 01:52:34.161677 | aio | ok: [aio]
2026-03-29 01:52:34.161889 | aio |
2026-03-29 01:52:34.162165 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:52:34.162376 | aio | Sunday 29 March 2026  01:52:34 +0000 (0:00:01.037)       0:00:03.554 **********
2026-03-29 01:52:34.237496 | aio | ok: [aio] => {
2026-03-29 01:52:34.237752 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-29 01:52:34.237961 | aio | }
2026-03-29 01:52:34.238162 | aio |
2026-03-29 01:52:34.238388 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:52:34.238592 | aio | Sunday 29 March 2026  01:52:34 +0000 (0:00:00.075)       0:00:03.629 **********
2026-03-29 01:52:34.567690 | aio | ok: [aio]
2026-03-29 01:52:34.567863 | aio |
2026-03-29 01:52:34.568085 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:52:34.568298 | aio | Sunday 29 March 2026  01:52:34 +0000 (0:00:00.330)       0:00:03.960 **********
2026-03-29 01:52:36.666710 | aio | ok: [aio]
2026-03-29 01:52:36.666767 | aio |
2026-03-29 01:52:36.666779 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-29 01:52:36.666806 | aio | Sunday 29 March 2026  01:52:36 +0000 (0:00:02.098)       0:00:06.058 **********
2026-03-29 01:52:36.689462 | aio | skipping: [aio]
2026-03-29 01:52:36.689572 | aio |
2026-03-29 01:52:36.689882 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-29 01:52:36.689936 | aio | Sunday 29 March 2026  01:52:36 +0000 (0:00:00.023)       0:00:06.081 **********
2026-03-29 01:52:36.716410 | aio | skipping: [aio]
2026-03-29 01:52:36.716475 | aio |
2026-03-29 01:52:36.716562 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-29 01:52:36.716653 | aio | Sunday 29 March 2026  01:52:36 +0000 (0:00:00.027)       0:00:06.109 **********
2026-03-29 01:52:36.738947 | aio | skipping: [aio]
2026-03-29 01:52:36.739057 | aio |
2026-03-29 01:52:36.739194 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-29 01:52:36.739344 | aio | Sunday 29 March 2026  01:52:36 +0000 (0:00:00.022)       0:00:06.131 **********
2026-03-29 01:52:37.689567 | aio | ok: [aio]
2026-03-29 01:52:37.689639 | aio |
2026-03-29 01:52:37.689675 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-29 01:52:37.689806 | aio | Sunday 29 March 2026  01:52:37 +0000 (0:00:00.950)       0:00:07.082 **********
2026-03-29 01:52:38.094466 | aio | ok: [aio]
2026-03-29 01:52:38.094528 | aio |
2026-03-29 01:52:38.094618 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-29 01:52:38.094751 | aio | Sunday 29 March 2026  01:52:38 +0000 (0:00:00.404)       0:00:07.487 **********
2026-03-29 01:52:38.971445 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-29 01:52:38.971522 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-29 01:52:38.972122 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-29 01:52:38.972165 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-29 01:52:38.972171 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-29 01:52:38.972176 | aio |
2026-03-29 01:52:38.972181 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-29 01:52:38.972186 | aio | Sunday 29 March 2026  01:52:38 +0000 (0:00:00.876)       0:00:08.364 **********
2026-03-29 01:52:39.447368 | aio | ok: [aio]
2026-03-29 01:52:39.447474 | aio |
2026-03-29 01:52:39.447954 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-29 01:52:39.447999 | aio | Sunday 29 March 2026  01:52:39 +0000 (0:00:00.468)       0:00:08.832 **********
2026-03-29 01:52:39.448005 | aio |
2026-03-29 01:52:39.448009 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-29 01:52:39.448013 | aio | Sunday 29 March 2026  01:52:39 +0000 (0:00:00.007)       0:00:08.839 **********
2026-03-29 01:52:40.002678 | aio | ok: [aio]
2026-03-29 01:52:40.002746 | aio |
2026-03-29 01:52:40.002833 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:52:40.002962 | aio | Sunday 29 March 2026  01:52:39 +0000 (0:00:00.555)       0:00:09.395 **********
2026-03-29 01:52:40.191063 | aio | ok: [aio]
2026-03-29 01:52:40.191108 | aio |
2026-03-29 01:52:40.191113 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:52:40.191118 | aio | Sunday 29 March 2026  01:52:40 +0000 (0:00:00.188)       0:00:09.583 **********
2026-03-29 01:52:40.253232 | aio | ok: [aio] => {
2026-03-29 01:52:40.253309 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-29 01:52:40.253674 | aio | }
2026-03-29 01:52:40.253735 | aio |
2026-03-29 01:52:40.254200 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:52:40.254245 | aio | Sunday 29 March 2026  01:52:40 +0000 (0:00:00.062)       0:00:09.645 **********
2026-03-29 01:52:40.595843 | aio | ok: [aio]
2026-03-29 01:52:40.595909 | aio |
2026-03-29 01:52:40.596096 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:52:40.596113 | aio | Sunday 29 March 2026  01:52:40 +0000 (0:00:00.342)       0:00:09.988 **********
2026-03-29 01:52:43.593991 | aio | ok: [aio]
2026-03-29 01:52:43.594058 | aio |
2026-03-29 01:52:43.594172 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-29 01:52:43.594309 | aio | Sunday 29 March 2026  01:52:43 +0000 (0:00:02.998)       0:00:12.986 **********
2026-03-29 01:52:44.531207 | aio | ok: [aio]
2026-03-29 01:52:44.531282 | aio |
2026-03-29 01:52:44.531473 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-29 01:52:44.531519 | aio | Sunday 29 March 2026  01:52:44 +0000 (0:00:00.936)       0:00:13.923 **********
2026-03-29 01:52:44.790089 | aio | ok: [aio]
2026-03-29 01:52:44.790146 | aio |
2026-03-29 01:52:44.790255 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-29 01:52:44.790392 | aio | Sunday 29 March 2026  01:52:44 +0000 (0:00:00.259)       0:00:14.182 **********
2026-03-29 01:52:45.183111 | aio | ok: [aio]
2026-03-29 01:52:45.183209 | aio |
2026-03-29 01:52:45.183588 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-29 01:52:45.183638 | aio | Sunday 29 March 2026  01:52:45 +0000 (0:00:00.392)       0:00:14.575 **********
2026-03-29 01:52:45.928667 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-29 01:52:45.928732 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-29 01:52:45.929175 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-29 01:52:45.929222 | aio |
2026-03-29 01:52:45.929228 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-29 01:52:45.929234 | aio | Sunday 29 March 2026  01:52:45 +0000 (0:00:00.745)       0:00:15.321 **********
2026-03-29 01:52:46.328214 | aio | ok: [aio]
2026-03-29 01:52:46.328293 | aio |
2026-03-29 01:52:46.328485 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-29 01:52:46.328625 | aio | Sunday 29 March 2026  01:52:46 +0000 (0:00:00.399)       0:00:15.721 **********
2026-03-29 01:52:46.741151 | aio | ok: [aio]
2026-03-29 01:52:46.741211 | aio |
2026-03-29 01:52:46.741327 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-29 01:52:46.741636 | aio | Sunday 29 March 2026  01:52:46 +0000 (0:00:00.405)       0:00:16.126 **********
2026-03-29 01:52:46.741704 | aio |
2026-03-29 01:52:46.741722 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-29 01:52:46.741735 | aio | Sunday 29 March 2026  01:52:46 +0000 (0:00:00.007)       0:00:16.133 **********
2026-03-29 01:52:47.089329 | aio | ok: [aio]
2026-03-29 01:52:47.089396 | aio |
2026-03-29 01:52:47.089465 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-29 01:52:47.089602 | aio | Sunday 29 March 2026  01:52:47 +0000 (0:00:00.348)       0:00:16.482 **********
2026-03-29 01:52:47.134659 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-29 01:52:47.134728 | aio |
2026-03-29 01:52:47.134827 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-29 01:52:47.134946 | aio | Sunday 29 March 2026  01:52:47 +0000 (0:00:00.045)       0:00:16.527 **********
2026-03-29 01:52:48.069414 | aio | ok: [aio]
2026-03-29 01:52:48.069488 | aio |
2026-03-29 01:52:48.069581 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-29 01:52:48.069684 | aio | Sunday 29 March 2026  01:52:48 +0000 (0:00:00.934)       0:00:17.462 **********
2026-03-29 01:52:48.686430 | aio | ok: [aio] => (item=chronyd)
2026-03-29 01:52:48.686622 | aio | ok: [aio] => (item=sshd)
2026-03-29 01:52:48.686814 | aio |
2026-03-29 01:52:48.687035 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-29 01:52:48.687246 | aio | Sunday 29 March 2026  01:52:48 +0000 (0:00:00.616)       0:00:18.078 **********
2026-03-29 01:52:49.288957 | aio | ok: [aio]
2026-03-29 01:52:49.289146 | aio |
2026-03-29 01:52:49.289407 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-29 01:52:49.289727 | aio | Sunday 29 March 2026  01:52:49 +0000 (0:00:00.602)       0:00:18.681 **********
2026-03-29 01:52:49.479917 | aio | ok: [aio]
2026-03-29 01:52:49.480070 | aio |
2026-03-29 01:52:49.480453 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-29 01:52:49.480701 | aio | Sunday 29 March 2026  01:52:49 +0000 (0:00:00.191)       0:00:18.872 **********
2026-03-29 01:52:49.870341 | aio | ok: [aio]
2026-03-29 01:52:49.870397 | aio |
2026-03-29 01:52:49.870409 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-29 01:52:49.870420 | aio | Sunday 29 March 2026  01:52:49 +0000 (0:00:00.389)       0:00:19.262 **********
2026-03-29 01:52:50.180455 | aio | ok: [aio]
2026-03-29 01:52:50.180489 | aio |
2026-03-29 01:52:50.180495 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-29 01:52:50.180499 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.310)       0:00:19.572 **********
2026-03-29 01:52:50.245645 | aio | ok: [aio]
2026-03-29 01:52:50.245713 | aio |
2026-03-29 01:52:50.245721 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-29 01:52:50.245727 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.065)       0:00:19.638 **********
2026-03-29 01:52:50.457899 | aio | ok: [aio] => (item=aio)
2026-03-29 01:52:50.457981 | aio |
2026-03-29 01:52:50.458044 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-29 01:52:50.458164 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.212)       0:00:19.850 **********
2026-03-29 01:52:50.504738 | aio | ok: [aio]
2026-03-29 01:52:50.504818 | aio |
2026-03-29 01:52:50.505040 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-29 01:52:50.505089 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.046)       0:00:19.897 **********
2026-03-29 01:52:50.543045 | aio | skipping: [aio]
2026-03-29 01:52:50.543133 | aio |
2026-03-29 01:52:50.543146 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:52:50.543284 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.038)       0:00:19.935 **********
2026-03-29 01:52:50.603541 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:52:50.603618 | aio |
2026-03-29 01:52:50.603858 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:52:50.603905 | aio | Sunday 29 March 2026  01:52:50 +0000 (0:00:00.060)       0:00:19.996 **********
2026-03-29 01:52:56.627389 | aio | ok: [aio]
2026-03-29 01:52:56.627435 | aio |
2026-03-29 01:52:56.627441 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:52:56.627447 | aio | Sunday 29 March 2026  01:52:56 +0000 (0:00:06.023)       0:00:26.019 **********
2026-03-29 01:52:56.671651 | aio | ok: [aio] => (item=aio)
2026-03-29 01:52:56.671711 | aio |
2026-03-29 01:52:56.671819 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:52:56.671962 | aio | Sunday 29 March 2026  01:52:56 +0000 (0:00:00.044)       0:00:26.064 **********
2026-03-29 01:52:57.046077 | aio | ok: [aio]
2026-03-29 01:52:57.046150 | aio |
2026-03-29 01:52:57.046236 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:52:57.046370 | aio | Sunday 29 March 2026  01:52:57 +0000 (0:00:00.374)       0:00:26.438 **********
2026-03-29 01:53:03.338890 | aio | ok: [aio]
2026-03-29 01:53:03.338928 | aio |
2026-03-29 01:53:03.338934 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-29 01:53:03.338939 | aio | Sunday 29 March 2026  01:53:03 +0000 (0:00:06.292)       0:00:32.731 **********
2026-03-29 01:53:09.559332 | aio | ok: [aio]
2026-03-29 01:53:09.559422 | aio |
2026-03-29 01:53:09.559438 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-29 01:53:09.559582 | aio | Sunday 29 March 2026  01:53:09 +0000 (0:00:06.220)       0:00:38.952 **********
2026-03-29 01:53:23.571512 | aio | ok: [aio]
2026-03-29 01:53:23.571585 | aio |
2026-03-29 01:53:23.571657 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:53:23.571790 | aio | Sunday 29 March 2026  01:53:23 +0000 (0:00:14.012)       0:00:52.964 **********
2026-03-29 01:53:23.631106 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:53:23.631189 | aio |
2026-03-29 01:53:23.631425 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:53:23.631471 | aio | Sunday 29 March 2026  01:53:23 +0000 (0:00:00.059)       0:00:53.023 **********
2026-03-29 01:53:23.668267 | aio | skipping: [aio]
2026-03-29 01:53:23.668344 | aio |
2026-03-29 01:53:23.668589 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:53:23.668637 | aio | Sunday 29 March 2026  01:53:23 +0000 (0:00:00.037)       0:00:53.060 **********
2026-03-29 01:53:23.715306 | aio | skipping: [aio] => (item=aio)
2026-03-29 01:53:23.715837 | aio | skipping: [aio]
2026-03-29 01:53:23.715887 | aio |
2026-03-29 01:53:23.715895 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:53:23.715902 | aio | Sunday 29 March 2026  01:53:23 +0000 (0:00:00.046)       0:00:53.107 **********
2026-03-29 01:53:23.965962 | aio | ok: [aio]
2026-03-29 01:53:23.966026 | aio |
2026-03-29 01:53:23.966229 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:53:23.966277 | aio | Sunday 29 March 2026  01:53:23 +0000 (0:00:00.250)       0:00:53.358 **********
2026-03-29 01:53:30.319889 | aio | ok: [aio]
2026-03-29 01:53:30.319934 | aio |
2026-03-29 01:53:30.319940 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-29 01:53:30.319944 | aio | Sunday 29 March 2026  01:53:30 +0000 (0:00:06.353)       0:00:59.712 **********
2026-03-29 01:53:36.389923 | aio | ok: [aio]
2026-03-29 01:53:36.389979 | aio |
2026-03-29 01:53:36.389987 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-29 01:53:36.389995 | aio | Sunday 29 March 2026  01:53:36 +0000 (0:00:06.069)       0:01:05.781 **********
2026-03-29 01:53:42.301613 | aio | ok: [aio]
2026-03-29 01:53:42.301682 | aio |
2026-03-29 01:53:42.301912 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-29 01:53:42.301960 | aio | Sunday 29 March 2026  01:53:42 +0000 (0:00:05.912)       0:01:11.694 **********
2026-03-29 01:53:46.719204 | aio | ok: [aio] => (item={'name': 'diskprediction_local'})
2026-03-29 01:53:46.719277 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-29 01:53:46.719384 | aio | ok: [aio] => (item={'name': 'prometheus'})
2026-03-29 01:53:46.719482 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-29 01:53:46.719578 | aio |
2026-03-29 01:53:46.719676 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-29 01:53:46.719760 | aio |
2026-03-29 01:53:46.719853 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:53:46.719950 | aio | Sunday 29 March 2026  01:53:46 +0000 (0:00:04.417)       0:01:16.112 **********
2026-03-29 01:53:47.610476 | aio | ok: [aio]
2026-03-29 01:53:47.610652 | aio |
2026-03-29 01:53:47.610870 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:53:47.611075 | aio | Sunday 29 March 2026  01:53:47 +0000 (0:00:00.890)       0:01:17.002 **********
2026-03-29 01:53:47.808452 | aio | ok: [aio]
2026-03-29 01:53:47.808661 | aio |
2026-03-29 01:53:47.808890 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:53:47.809103 | aio | Sunday 29 March 2026  01:53:47 +0000 (0:00:00.198)       0:01:17.201 **********
2026-03-29 01:53:47.840363 | aio | skipping: [aio]
2026-03-29 01:53:47.840568 | aio |
2026-03-29 01:53:47.840793 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-29 01:53:47.840997 | aio | Sunday 29 March 2026  01:53:47 +0000 (0:00:00.032)       0:01:17.233 **********
2026-03-29 01:53:48.036544 | aio | ok: [aio]
2026-03-29 01:53:48.036725 | aio |
2026-03-29 01:53:48.036958 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:53:48.037187 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.195)       0:01:17.429 **********
2026-03-29 01:53:48.105441 | aio | ok: [aio] => {
2026-03-29 01:53:48.105736 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-29 01:53:48.105934 | aio | }
2026-03-29 01:53:48.106084 | aio |
2026-03-29 01:53:48.106347 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:53:48.106505 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.069)       0:01:17.498 **********
2026-03-29 01:53:48.405564 | aio | ok: [aio]
2026-03-29 01:53:48.405637 | aio |
2026-03-29 01:53:48.405740 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:53:48.405869 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.299)       0:01:17.798 **********
2026-03-29 01:53:48.447401 | aio | skipping: [aio]
2026-03-29 01:53:48.447566 | aio |
2026-03-29 01:53:48.447783 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:53:48.447994 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.041)       0:01:17.839 **********
2026-03-29 01:53:48.488014 | aio | skipping: [aio]
2026-03-29 01:53:48.488143 | aio |
2026-03-29 01:53:48.488373 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:53:48.488697 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.040)       0:01:17.880 **********
2026-03-29 01:53:48.692681 | aio | ok: [aio]
2026-03-29 01:53:48.692859 | aio |
2026-03-29 01:53:48.693082 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-29 01:53:48.693295 | aio | Sunday 29 March 2026  01:53:48 +0000 (0:00:00.204)       0:01:18.085 **********
2026-03-29 01:53:49.653612 | aio | ok: [aio]
2026-03-29 01:53:49.653671 | aio |
2026-03-29 01:53:49.654073 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:53:49.654141 | aio | Sunday 29 March 2026  01:53:49 +0000 (0:00:00.960)       0:01:19.045 **********
2026-03-29 01:53:49.723531 | aio | ok: [aio] => {
2026-03-29 01:53:49.724181 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-29 01:53:49.724441 | aio | }
2026-03-29 01:53:49.724450 | aio |
2026-03-29 01:53:49.724456 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:53:49.724463 | aio | Sunday 29 March 2026  01:53:49 +0000 (0:00:00.070)       0:01:19.116 **********
2026-03-29 01:53:50.052872 | aio | ok: [aio]
2026-03-29 01:53:50.052935 | aio |
2026-03-29 01:53:50.053027 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:53:50.053163 | aio | Sunday 29 March 2026  01:53:50 +0000 (0:00:00.329)       0:01:19.445 **********
2026-03-29 01:53:51.991977 | aio | ok: [aio]
2026-03-29 01:53:51.992058 | aio |
2026-03-29 01:53:51.992123 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-29 01:53:51.992249 | aio | Sunday 29 March 2026  01:53:51 +0000 (0:00:01.939)       0:01:21.384 **********
2026-03-29 01:53:52.020300 | aio | skipping: [aio]
2026-03-29 01:53:52.020711 | aio |
2026-03-29 01:53:52.020736 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-29 01:53:52.020744 | aio | Sunday 29 March 2026  01:53:52 +0000 (0:00:00.028)       0:01:21.412 **********
2026-03-29 01:53:52.046707 | aio | skipping: [aio]
2026-03-29 01:53:52.046788 | aio |
2026-03-29 01:53:52.047020 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-29 01:53:52.047067 | aio | Sunday 29 March 2026  01:53:52 +0000 (0:00:00.026)       0:01:21.439 **********
2026-03-29 01:53:52.075191 | aio | skipping: [aio]
2026-03-29 01:53:52.075255 | aio |
2026-03-29 01:53:52.075358 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-29 01:53:52.075456 | aio | Sunday 29 March 2026  01:53:52 +0000 (0:00:00.028)       0:01:21.468 **********
2026-03-29 01:53:53.086807 | aio | ok: [aio]
2026-03-29 01:53:53.087327 | aio |
2026-03-29 01:53:53.087353 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-29 01:53:53.087363 | aio | Sunday 29 March 2026  01:53:53 +0000 (0:00:01.011)       0:01:22.479 **********
2026-03-29 01:53:53.500162 | aio | ok: [aio]
2026-03-29 01:53:53.500223 | aio |
2026-03-29 01:53:53.500340 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-29 01:53:53.500475 | aio | Sunday 29 March 2026  01:53:53 +0000 (0:00:00.413)       0:01:22.892 **********
2026-03-29 01:53:54.389799 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-29 01:53:54.390775 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-29 01:53:54.390824 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-29 01:53:54.390832 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-29 01:53:54.390838 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-29 01:53:54.390845 | aio |
2026-03-29 01:53:54.390851 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-29 01:53:54.390857 | aio | Sunday 29 March 2026  01:53:54 +0000 (0:00:00.889)       0:01:23.782 **********
2026-03-29 01:53:54.856847 | aio | ok: [aio]
2026-03-29 01:53:54.856910 | aio |
2026-03-29 01:53:54.857335 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-29 01:53:54.857350 | aio | Sunday 29 March 2026  01:53:54 +0000 (0:00:00.461)       0:01:24.244 **********
2026-03-29 01:53:54.857355 | aio |
2026-03-29 01:53:54.857365 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-29 01:53:54.857369 | aio | Sunday 29 March 2026  01:53:54 +0000 (0:00:00.005)       0:01:24.249 **********
2026-03-29 01:53:55.194066 | aio | ok: [aio]
2026-03-29 01:53:55.194120 | aio |
2026-03-29 01:53:55.194224 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-29 01:53:55.194370 | aio | Sunday 29 March 2026  01:53:55 +0000 (0:00:00.337)       0:01:24.586 **********
2026-03-29 01:53:55.386613 | aio | ok: [aio]
2026-03-29 01:53:55.386676 | aio |
2026-03-29 01:53:55.386909 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-29 01:53:55.386959 | aio | Sunday 29 March 2026  01:53:55 +0000 (0:00:00.192)       0:01:24.779 **********
2026-03-29 01:53:55.455487 | aio | ok: [aio] => {
2026-03-29 01:53:55.455580 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-29 01:53:55.455947 | aio | }
2026-03-29 01:53:55.455978 | aio |
2026-03-29 01:53:55.455983 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-29 01:53:55.455988 | aio | Sunday 29 March 2026  01:53:55 +0000 (0:00:00.068)       0:01:24.847 **********
2026-03-29 01:53:55.796891 | aio | ok: [aio]
2026-03-29 01:53:55.796960 | aio |
2026-03-29 01:53:55.797017 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-29 01:53:55.797137 | aio | Sunday 29 March 2026  01:53:55 +0000 (0:00:00.341)       0:01:25.189 **********
2026-03-29 01:53:58.834716 | aio | ok: [aio]
2026-03-29 01:53:58.834787 | aio |
2026-03-29 01:53:58.835060 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-29 01:53:58.835109 | aio | Sunday 29 March 2026  01:53:58 +0000 (0:00:03.037)       0:01:28.227 **********
2026-03-29 01:53:59.789840 | aio | ok: [aio]
2026-03-29 01:53:59.790181 | aio |
2026-03-29 01:53:59.790196 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-29 01:53:59.790207 | aio | Sunday 29 March 2026  01:53:59 +0000 (0:00:00.955)       0:01:29.182 **********
2026-03-29 01:53:59.981657 | aio | ok: [aio]
2026-03-29 01:53:59.981712 | aio |
2026-03-29 01:53:59.981724 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-29 01:53:59.981741 | aio | Sunday 29 March 2026  01:53:59 +0000 (0:00:00.191)       0:01:29.373 **********
2026-03-29 01:54:00.383604 | aio | ok: [aio]
2026-03-29 01:54:00.383697 | aio |
2026-03-29 01:54:00.383990 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-29 01:54:00.384011 | aio | Sunday 29 March 2026  01:54:00 +0000 (0:00:00.402)       0:01:29.776 **********
2026-03-29 01:54:00.920349 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-29 01:54:00.920452 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-29 01:54:00.921005 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-29 01:54:00.921057 | aio |
2026-03-29 01:54:00.921065 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-29 01:54:00.921072 | aio | Sunday 29 March 2026  01:54:00 +0000 (0:00:00.536)       0:01:30.312 **********
2026-03-29 01:54:01.318889 | aio | ok: [aio]
2026-03-29 01:54:01.318950 | aio |
2026-03-29 01:54:01.319189 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-29 01:54:01.319234 | aio | Sunday 29 March 2026  01:54:01 +0000 (0:00:00.398)       0:01:30.711 **********
2026-03-29 01:54:01.742412 | aio | ok: [aio]
2026-03-29 01:54:01.742473 | aio |
2026-03-29 01:54:01.742575 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-29 01:54:01.742957 | aio | Sunday 29 March 2026  01:54:01 +0000 (0:00:00.417)       0:01:31.128 **********
2026-03-29 01:54:01.742973 | aio |
2026-03-29 01:54:01.742978 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-29 01:54:01.742983 | aio | Sunday 29 March 2026  01:54:01 +0000 (0:00:00.006)       0:01:31.135 **********
2026-03-29 01:54:02.089115 | aio | ok: [aio]
2026-03-29 01:54:02.089172 | aio |
2026-03-29 01:54:02.089267 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-29 01:54:02.089409 | aio | Sunday 29 March 2026  01:54:02 +0000 (0:00:00.346)       0:01:31.481 **********
2026-03-29 01:54:02.136301 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-29 01:54:02.136317 | aio |
2026-03-29 01:54:02.136323 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-29 01:54:02.136327 | aio | Sunday 29 March 2026  01:54:02 +0000 (0:00:00.047)       0:01:31.528 **********
2026-03-29 01:54:03.053085 | aio | ok: [aio]
2026-03-29 01:54:03.053155 | aio |
2026-03-29 01:54:03.053424 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-29 01:54:03.053445 | aio | Sunday 29 March 2026  01:54:03 +0000 (0:00:00.916)       0:01:32.445 **********
2026-03-29 01:54:03.667265 | aio | ok: [aio] => (item=chronyd)
2026-03-29 01:54:03.667327 | aio | ok: [aio] => (item=sshd)
2026-03-29 01:54:03.667407 | aio |
2026-03-29 01:54:03.667575 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-29 01:54:03.667633 | aio | Sunday 29 March 2026  01:54:03 +0000 (0:00:00.614)       0:01:33.060 **********
2026-03-29 01:54:04.304462 | aio | ok: [aio]
2026-03-29 01:54:04.304521 | aio |
2026-03-29 01:54:04.304613 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-29 01:54:04.304713 | aio | Sunday 29 March 2026  01:54:04 +0000 (0:00:00.637)       0:01:33.697 **********
2026-03-29 01:54:04.491925 | aio | ok: [aio]
2026-03-29 01:54:04.492035 | aio |
2026-03-29 01:54:04.492337 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-29 01:54:04.492386 | aio | Sunday 29 March 2026  01:54:04 +0000 (0:00:00.187)       0:01:33.884 **********
2026-03-29 01:54:04.734143 | aio | ok: [aio]
2026-03-29 01:54:04.734214 | aio |
2026-03-29 01:54:04.734427 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-29 01:54:04.734492 | aio | Sunday 29 March 2026  01:54:04 +0000 (0:00:00.242)       0:01:34.126 **********
2026-03-29 01:54:04.932132 | aio | ok: [aio]
2026-03-29 01:54:04.932200 | aio |
2026-03-29 01:54:04.932393 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-29 01:54:04.932434 | aio | Sunday 29 March 2026  01:54:04 +0000 (0:00:00.197)       0:01:34.324 **********
2026-03-29 01:54:05.147675 | aio | ok: [aio] => (item=aio)
2026-03-29 01:54:05.147746 | aio |
2026-03-29 01:54:05.147958 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-29 01:54:05.147975 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.215)       0:01:34.540 **********
2026-03-29 01:54:05.183897 | aio | ok: [aio]
2026-03-29 01:54:05.184014 | aio |
2026-03-29 01:54:05.184149 | aio | TASK [Install Ceph host] *******************************************************
2026-03-29 01:54:05.184298 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.036)       0:01:34.576 **********
2026-03-29 01:54:05.232651 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-29 01:54:05.232733 | aio |
2026-03-29 01:54:05.232835 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-29 01:54:05.232931 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.048)       0:01:34.625 **********
2026-03-29 01:54:05.265959 | aio | skipping: [aio]
2026-03-29 01:54:05.266118 | aio |
2026-03-29 01:54:05.266300 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-29 01:54:05.266508 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.033)       0:01:34.658 **********
2026-03-29 01:54:05.305958 | aio | skipping: [aio] => (item=aio)
2026-03-29 01:54:05.306065 | aio | skipping: [aio]
2026-03-29 01:54:05.306178 | aio |
2026-03-29 01:54:05.306303 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-29 01:54:05.306446 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.040)       0:01:34.698 **********
2026-03-29 01:54:05.538146 | aio | ok: [aio]
2026-03-29 01:54:05.538204 | aio |
2026-03-29 01:54:05.538400 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-29 01:54:05.538445 | aio | Sunday 29 March 2026  01:54:05 +0000 (0:00:00.231)       0:01:34.930 **********
2026-03-29 01:54:11.841706 | aio | ok: [aio]
2026-03-29 01:54:11.841766 | aio |
2026-03-29 01:54:11.841882 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-29 01:54:11.841976 | aio | Sunday 29 March 2026  01:54:11 +0000 (0:00:06.303)       0:01:41.234 **********
2026-03-29 01:54:17.268591 | aio | ok: [aio]
2026-03-29 01:54:17.268664 | aio |
2026-03-29 01:54:17.268678 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-29 01:54:17.268826 | aio | Sunday 29 March 2026  01:54:17 +0000 (0:00:05.426)       0:01:46.661 **********
2026-03-29 01:54:31.177915 | aio | ok: [aio]
2026-03-29 01:54:31.178025 | aio |
2026-03-29 01:54:31.178326 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-29 01:54:31.178392 | aio | Sunday 29 March 2026  01:54:31 +0000 (0:00:13.908)       0:02:00.570 **********
2026-03-29 01:54:31.255064 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-29 01:54:31.255106 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-29 01:54:31.255425 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-29 01:54:31.255534 | aio | skipping: [aio]
2026-03-29 01:54:31.255557 | aio |
2026-03-29 01:54:31.255570 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-29 01:54:31.255709 | aio | Sunday 29 March 2026  01:54:31 +0000 (0:00:00.077)       0:02:00.647 **********
2026-03-29 01:54:37.328971 | aio | ok: [aio]
2026-03-29 01:54:37.329040 | aio |
2026-03-29 01:54:37.329244 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-29 01:54:37.329284 | aio | Sunday 29 March 2026  01:54:37 +0000 (0:00:06.074)       0:02:06.721 **********
2026-03-29 01:54:43.314216 | aio | ok: [aio]
2026-03-29 01:54:43.314292 | aio |
2026-03-29 01:54:43.314611 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-29 01:54:43.314661 | aio | Sunday 29 March 2026  01:54:43 +0000 (0:00:05.984)       0:02:12.706 **********
2026-03-29 01:54:43.369054 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-29 01:54:43.369098 | aio |
2026-03-29 01:54:43.369359 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-29 01:54:43.369408 | aio | Sunday 29 March 2026  01:54:43 +0000 (0:00:00.054)       0:02:12.761 **********
2026-03-29 01:54:43.409993 | aio | ok: [aio]
2026-03-29 01:54:43.410064 | aio |
2026-03-29 01:54:43.410101 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-29 01:54:43.410221 | aio | Sunday 29 March 2026  01:54:43 +0000 (0:00:00.041)       0:02:12.802 **********
2026-03-29 01:54:49.369838 | aio | ok: [aio]
2026-03-29 01:54:49.369954 | aio |
2026-03-29 01:54:49.370275 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-29 01:54:49.370298 | aio | Sunday 29 March 2026  01:54:49 +0000 (0:00:05.959)       0:02:18.762 **********
2026-03-29 01:54:49.410306 | aio | ok: [aio]
2026-03-29 01:54:49.410386 | aio |
2026-03-29 01:54:49.410512 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-29 01:54:49.410600 | aio | Sunday 29 March 2026  01:54:49 +0000 (0:00:00.040)       0:02:18.803 **********
2026-03-29 01:54:49.453635 | aio | skipping: [aio] => (item=1)
2026-03-29 01:54:49.453709 | aio | skipping: [aio] => (item=1)
2026-03-29 01:54:49.453723 | aio | skipping: [aio] => (item=1)
2026-03-29 01:54:49.454123 | aio | skipping: [aio]
2026-03-29 01:54:49.454155 | aio |
2026-03-29 01:54:49.454161 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-29 01:54:49.454167 | aio | Sunday 29 March 2026  01:54:49 +0000 (0:00:00.043)       0:02:18.846 **********
2026-03-29 01:54:49.486739 | aio | skipping: [aio]
2026-03-29 01:54:49.486790 | aio |
2026-03-29 01:54:49.487363 | aio | PLAY RECAP *********************************************************************
2026-03-29 01:54:49.487423 | aio | aio                        : ok=95   changed=0    unreachable=0    failed=0    skipped=20   rescued=0    ignored=0
2026-03-29 01:54:49.487436 | aio |
2026-03-29 01:54:49.487446 | aio |
2026-03-29 01:54:49.487456 | aio | TASKS RECAP ********************************************************************
2026-03-29 01:54:49.487465 | aio | Sunday 29 March 2026  01:54:49 +0000 (0:00:00.033)       0:02:18.879 **********
2026-03-29 01:54:49.487481 | aio | ===============================================================================
2026-03-29 01:54:49.487490 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.01s
2026-03-29 01:54:49.489177 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 13.91s
2026-03-29 01:54:49.489223 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.35s
2026-03-29 01:54:49.489228 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.30s
2026-03-29 01:54:49.489233 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.29s
2026-03-29 01:54:49.489237 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.22s
2026-03-29 01:54:49.489241 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.07s
2026-03-29 01:54:49.489245 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.07s
2026-03-29 01:54:49.489248 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.02s
2026-03-29 01:54:49.489253 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.99s
2026-03-29 01:54:49.489257 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.96s
2026-03-29 01:54:49.489261 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.91s
2026-03-29 01:54:49.489264 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.43s
2026-03-29 01:54:49.489269 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.42s
2026-03-29 01:54:49.489273 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s
2026-03-29 01:54:49.489277 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.00s
2026-03-29 01:54:49.489281 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.10s
2026-03-29 01:54:49.489285 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.94s
2026-03-29 01:54:49.489289 | aio | Gathering Facts --------------------------------------------------------- 1.14s
2026-03-29 01:54:49.489293 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.04s
2026-03-29 01:54:49.598164 | aio | INFO     [default > idempotence] Executed: Successful
2026-03-29 01:54:49.606772 | aio | INFO     [default > side_effect] Executing
2026-03-29 01:54:49.607222 | aio | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-29 01:54:49.613755 | aio | INFO     [default > verify] Executing
2026-03-29 01:54:50.199138 | aio |
2026-03-29 01:54:50.199480 | aio | PLAY [Verify] ******************************************************************
2026-03-29 01:54:50.199762 | aio |
2026-03-29 01:54:50.200026 | aio | TASK [Gathering Facts] *********************************************************
2026-03-29 01:54:50.200290 | aio | Sunday 29 March 2026  01:54:50 +0000 (0:00:00.006)       0:00:00.006 **********
2026-03-29 01:54:51.308385 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-29 01:54:51.308450 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-29 01:54:51.308473 | aio | interpreter could change the meaning of that path. See
2026-03-29 01:54:51.308492 | aio | https://docs.ansible.com/ansible-
2026-03-29 01:54:51.308501 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-29 01:54:51.318226 | aio | ok: [aio]
2026-03-29 01:54:51.318257 | aio |
2026-03-29 01:54:51.318267 | aio | TASK [Get cluster health status] ***********************************************
2026-03-29 01:54:51.318277 | aio | Sunday 29 March 2026  01:54:51 +0000 (0:00:01.118)       0:00:01.125 **********
2026-03-29 01:55:01.621624 | aio | ok: [aio]
2026-03-29 01:55:01.621706 | aio |
2026-03-29 01:55:01.621718 | aio | TASK [Print cluster health status] *********************************************
2026-03-29 01:55:01.621736 | aio | Sunday 29 March 2026  01:55:01 +0000 (0:00:10.303)       0:00:11.428 **********
2026-03-29 01:55:01.655593 | aio | ok: [aio] => {
2026-03-29 01:55:01.655700 | aio |     "_ceph_health": {
2026-03-29 01:55:01.655822 | aio |         "changed": false,
2026-03-29 01:55:01.655943 | aio |         "cmd": [
2026-03-29 01:55:01.656063 | aio |             "cephadm",
2026-03-29 01:55:01.656182 | aio |             "shell",
2026-03-29 01:55:01.656293 | aio |             "--",
2026-03-29 01:55:01.656410 | aio |             "ceph",
2026-03-29 01:55:01.656527 | aio |             "health"
2026-03-29 01:55:01.656644 | aio |         ],
2026-03-29 01:55:01.656779 | aio |         "delta": "0:00:10.031854",
2026-03-29 01:55:01.656917 | aio |         "end": "2026-03-29 01:55:01.585258",
2026-03-29 01:55:01.657038 | aio |         "failed": false,
2026-03-29 01:55:01.657155 | aio |         "msg": "",
2026-03-29 01:55:01.657273 | aio |         "rc": 0,
2026-03-29 01:55:01.657395 | aio |         "start": "2026-03-29 01:54:51.553404",
2026-03-29 01:55:01.657571 | aio |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config",
2026-03-29 01:55:01.657697 | aio |         "stderr_lines": [
2026-03-29 01:55:01.657822 | aio |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-03-29 01:55:01.657974 | aio |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config"
2026-03-29 01:55:01.658093 | aio |         ],
2026-03-29 01:55:01.658214 | aio |         "stdout": "HEALTH_OK",
2026-03-29 01:55:01.658334 | aio |         "stdout_lines": [
2026-03-29 01:55:01.658451 | aio |             "HEALTH_OK"
2026-03-29 01:55:01.658570 | aio |         ]
2026-03-29 01:55:01.658684 | aio |     }
2026-03-29 01:55:01.658800 | aio | }
2026-03-29 01:55:01.658913 | aio |
2026-03-29 01:55:01.659055 | aio | TASK [Assert that the cluster status is healthy] *******************************
2026-03-29 01:55:01.659182 | aio | Sunday 29 March 2026  01:55:01 +0000 (0:00:00.034)       0:00:11.463 **********
2026-03-29 01:55:01.685974 | aio | ok: [aio] => {
2026-03-29 01:55:01.686201 | aio |     "changed": false,
2026-03-29 01:55:01.686403 | aio |     "msg": "All assertions passed"
2026-03-29 01:55:01.686647 | aio | }
2026-03-29 01:55:01.686843 | aio |
2026-03-29 01:55:01.687043 | aio | TASK [Create a test Ceph pool] *************************************************
2026-03-29 01:55:01.687246 | aio | Sunday 29 March 2026  01:55:01 +0000 (0:00:00.029)       0:00:11.492 **********
2026-03-29 01:55:07.700732 | aio | changed: [aio]
2026-03-29 01:55:07.700804 | aio |
2026-03-29 01:55:07.700946 | aio | TASK [Create a test Ceph key] **************************************************
2026-03-29 01:55:07.701072 | aio | Sunday 29 March 2026  01:55:07 +0000 (0:00:06.015)       0:00:17.508 **********
2026-03-29 01:55:09.971094 | aio | changed: [aio]
2026-03-29 01:55:09.971308 | aio |
2026-03-29 01:55:09.971494 | aio | TASK [Retrieve info for the test Ceph key] *************************************
2026-03-29 01:55:09.971699 | aio | Sunday 29 March 2026  01:55:09 +0000 (0:00:02.270)       0:00:19.778 **********
2026-03-29 01:55:11.157049 | aio | ok: [aio]
2026-03-29 01:55:11.157558 | aio |
2026-03-29 01:55:11.157576 | aio | TASK [Assert that key_info returns the correct key] ****************************
2026-03-29 01:55:11.157844 | aio | Sunday 29 March 2026  01:55:11 +0000 (0:00:01.185)       0:00:20.964 **********
2026-03-29 01:55:11.191684 | aio | ok: [aio] => {
2026-03-29 01:55:11.192531 | aio |     "changed": false,
2026-03-29 01:55:11.192589 | aio |     "msg": "All assertions passed"
2026-03-29 01:55:11.192602 | aio | }
2026-03-29 01:55:11.192612 | aio |
2026-03-29 01:55:11.192629 | aio | PLAY RECAP *********************************************************************
2026-03-29 01:55:11.192974 | aio | aio                        : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-29 01:55:11.193072 | aio |
2026-03-29 01:55:11.193638 | aio |
2026-03-29 01:55:11.193694 | aio | TASKS RECAP ********************************************************************
2026-03-29 01:55:11.193707 | aio | Sunday 29 March 2026  01:55:11 +0000 (0:00:00.035)       0:00:20.999 **********
2026-03-29 01:55:11.195388 | aio | ===============================================================================
2026-03-29 01:55:11.195424 | aio | Get cluster health status ---------------------------------------------- 10.30s
2026-03-29 01:55:11.195436 | aio | Create a test Ceph pool ------------------------------------------------- 6.02s
2026-03-29 01:55:11.195445 | aio | Create a test Ceph key -------------------------------------------------- 2.27s
2026-03-29 01:55:11.195454 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.19s
2026-03-29 01:55:11.195463 | aio | Gathering Facts --------------------------------------------------------- 1.12s
2026-03-29 01:55:11.195472 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-03-29 01:55:11.195481 | aio | Print cluster health status --------------------------------------------- 0.03s
2026-03-29 01:55:11.195490 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-03-29 01:55:11.264357 | aio | INFO     [default > verify] Executed: Successful
2026-03-29 01:55:11.275648 | aio | INFO     [default > cleanup] Executing
2026-03-29 01:55:11.276008 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-29 01:55:11.281066 | aio | INFO     [default > destroy] Executing
2026-03-29 01:55:11.281164 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-29 01:55:11.281248 | aio | INFO     [default > destroy] Executed: Successful
2026-03-29 01:55:11.281562 | aio | WARNING  Molecule executed 1 scenario (1 missing files)
2026-03-29 01:55:11.665496 | aio | ok: Runtime: 0:09:56.770865
2026-03-29 01:55:11.679784 | 
2026-03-29 01:55:11.679875 | PLAY RECAP
2026-03-29 01:55:11.679921 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-29 01:55:11.679944 | 
2026-03-29 01:55:11.833641 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-29 01:55:11.837201 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-29 01:55:12.713133 | 
2026-03-29 01:55:12.713325 | PLAY [all]
2026-03-29 01:55:12.728607 | 
2026-03-29 01:55:12.728773 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-29 01:55:12.787984 | aio | skipping: Conditional result was False
2026-03-29 01:55:12.799910 | 
2026-03-29 01:55:12.800116 | TASK [fetch-output : Set log path for single node]
2026-03-29 01:55:12.842754 | aio | ok
2026-03-29 01:55:12.848789 | 
2026-03-29 01:55:12.848928 | LOOP [fetch-output : Ensure local output dirs]
2026-03-29 01:55:13.270058 | aio -> localhost | ok: "/var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/logs"
2026-03-29 01:55:13.491839 | aio -> localhost | changed: "/var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/artifacts"
2026-03-29 01:55:13.712806 | aio -> localhost | changed: "/var/lib/zuul/builds/0a2fd496c6df4a75bd4830ac0a81b9db/work/docs"
2026-03-29 01:55:13.734008 | 
2026-03-29 01:55:13.734189 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-29 01:55:14.368053 | aio | ok
2026-03-29 01:55:14.368354 | aio | changed: All items complete
2026-03-29 01:55:14.368395 | 
2026-03-29 01:55:14.820849 | aio | changed: .d..t...... ./
2026-03-29 01:55:15.295141 | aio | changed: .d..t...... ./
2026-03-29 01:55:15.311312 | 
2026-03-29 01:55:15.311821 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-29 01:55:15.770741 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.009594
2026-03-29 01:55:15.987884 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007609
2026-03-29 01:55:16.005670 | 
2026-03-29 01:55:16.005833 | PLAY [all]
2026-03-29 01:55:16.012432 | 
2026-03-29 01:55:16.012501 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-29 01:55:16.430773 | aio | changed
2026-03-29 01:55:16.439376 | 
2026-03-29 01:55:16.439478 | PLAY RECAP
2026-03-29 01:55:16.439553 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-29 01:55:16.439696 | 
2026-03-29 01:55:16.647936 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-29 01:55:16.651595 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-29 01:55:17.248274 | 
2026-03-29 01:55:17.248422 | PLAY [localhost]
2026-03-29 01:55:17.258501 | 
2026-03-29 01:55:17.258607 | TASK [Generate Zuul manifest]
2026-03-29 01:55:17.278398 | localhost | ok
2026-03-29 01:55:17.300342 | 
2026-03-29 01:55:17.300544 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-29 01:55:17.659934 | localhost | changed
2026-03-29 01:55:17.672334 | 
2026-03-29 01:55:17.672452 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-29 01:55:17.703097 | localhost | ok
2026-03-29 01:55:17.711657 | 
2026-03-29 01:55:17.711722 | TASK [Upload logs]
2026-03-29 01:55:17.732723 | localhost | ok
2026-03-29 01:55:17.828355 | 
2026-03-29 01:55:17.841861 | TASK [Set zuul-log-path fact]
2026-03-29 01:55:17.863455 | localhost | ok
2026-03-29 01:55:17.876561 | 
2026-03-29 01:55:17.876646 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-29 01:55:17.910726 | localhost | ok
2026-03-29 01:55:17.919571 | 
2026-03-29 01:55:17.919670 | TASK [upload-logs : Create log directories]
2026-03-29 01:55:18.348869 | localhost | changed
2026-03-29 01:55:18.353641 | 
2026-03-29 01:55:18.353712 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-29 01:55:18.822317 | localhost -> localhost | ok: Runtime: 0:00:00.041403
2026-03-29 01:55:18.833562 | 
2026-03-29 01:55:18.833784 | TASK [upload-logs : Upload logs to log server]
2026-03-29 01:55:19.390915 | localhost | Output suppressed because no_log was given
2026-03-29 01:55:19.396174 | 
2026-03-29 01:55:19.396280 | LOOP [upload-logs : Compress console log and json output]
2026-03-29 01:55:19.446865 | localhost | skipping: Conditional result was False
2026-03-29 01:55:19.454635 | localhost | skipping: Conditional result was False
2026-03-29 01:55:19.473214 | 
2026-03-29 01:55:19.473394 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-29 01:55:19.530154 | localhost | skipping: Conditional result was False
2026-03-29 01:55:19.530680 | 
2026-03-29 01:55:19.535320 | localhost | skipping: Conditional result was False
2026-03-29 01:55:19.553228 | 
2026-03-29 01:55:19.553467 | LOOP [upload-logs : Upload console log and json output]