2026-03-16 08:42:53.888357 | Job console starting
2026-03-16 08:42:53.907206 | Updating git repos
2026-03-16 08:42:53.930308 | Cloning repos into workspace
2026-03-16 08:42:53.972006 | Restoring repo states
2026-03-16 08:42:53.977518 | Merging changes
2026-03-16 08:42:54.312496 | Checking out repos
2026-03-16 08:42:54.390948 | Preparing playbooks
2026-03-16 08:42:55.632947 | Running Ansible setup
2026-03-16 08:42:59.680329 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-16 08:43:00.345518 | 
2026-03-16 08:43:00.345688 | PLAY [localhost]
2026-03-16 08:43:00.353690 | 
2026-03-16 08:43:00.353800 | TASK [Gathering Facts]
2026-03-16 08:43:02.280016 | localhost | ok
2026-03-16 08:43:02.290929 | 
2026-03-16 08:43:02.291088 | TASK [Setup log path fact]
2026-03-16 08:43:02.311460 | localhost | ok
2026-03-16 08:43:02.322849 | 
2026-03-16 08:43:02.322976 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 08:43:02.349461 | localhost | ok
2026-03-16 08:43:02.357511 | 
2026-03-16 08:43:02.357658 | TASK [emit-job-header : Print job information]
2026-03-16 08:43:02.396697 | # Job Information
2026-03-16 08:43:02.396886 | Ansible Version: 2.16.16
2026-03-16 08:43:02.396934 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy
2026-03-16 08:43:02.397016 | Pipeline: check
2026-03-16 08:43:02.397051 | Executor: 0a8996d2b663
2026-03-16 08:43:02.397080 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96
2026-03-16 08:43:02.397113 | Event ID: aae14020-2113-11f1-9b5e-8ba0967ba405
2026-03-16 08:43:02.401109 | 
2026-03-16 08:43:02.401217 | LOOP [emit-job-header : Print node information]
2026-03-16 08:43:02.494476 | localhost | ok:
2026-03-16 08:43:02.494729 | localhost | # Node Information
2026-03-16 08:43:02.494791 | localhost | Inventory Hostname: aio
2026-03-16 08:43:02.494840 | localhost | Hostname: np0000158901
2026-03-16 08:43:02.494884 | localhost | Username: zuul
2026-03-16 08:43:02.495017 | localhost | Distro: Ubuntu 22.04
2026-03-16 08:43:02.495067 | localhost | Provider: yul1
2026-03-16 08:43:02.495105 | localhost | Region: ca-ymq-1
2026-03-16 08:43:02.495140 | localhost | Label: ubuntu-jammy
2026-03-16 08:43:02.495174 | localhost | Product Name: OpenStack Nova
2026-03-16 08:43:02.495207 | localhost | Interface IP: 199.204.45.138
2026-03-16 08:43:02.513644 | 
2026-03-16 08:43:02.513810 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-16 08:43:02.923541 | localhost -> localhost | changed
2026-03-16 08:43:02.929757 | 
2026-03-16 08:43:02.929888 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-16 08:43:03.867081 | localhost -> localhost | changed
2026-03-16 08:43:03.874972 | 
2026-03-16 08:43:03.875098 | PLAY [all]
2026-03-16 08:43:03.886338 | 
2026-03-16 08:43:03.928793 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-16 08:43:04.184658 | aio -> localhost | ok
2026-03-16 08:43:04.194151 | 
2026-03-16 08:43:04.194338 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-16 08:43:04.241036 | aio | ok
2026-03-16 08:43:04.269645 | aio | included: /var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-16 08:43:04.275333 | 
2026-03-16 08:43:04.275400 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-16 08:43:05.770353 | aio -> localhost | Generating public/private rsa key pair.
2026-03-16 08:43:05.770543 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/8f3b194890574f15a33c079354d46ef0_id_rsa
2026-03-16 08:43:05.770587 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/8f3b194890574f15a33c079354d46ef0_id_rsa.pub
2026-03-16 08:43:05.770623 | aio -> localhost | The key fingerprint is:
2026-03-16 08:43:05.770656 | aio -> localhost | SHA256:O9d+AF73AuAWO4I0bzH25yh+wvJPlAacsG3qNGAt3d4 zuul-build-sshkey
2026-03-16 08:43:05.770701 | aio -> localhost | The key's randomart image is:
2026-03-16 08:43:05.770735 | aio -> localhost | +---[RSA 3072]----+
2026-03-16 08:43:05.770774 | aio -> localhost | |      .          |
2026-03-16 08:43:05.770809 | aio -> localhost | |     oo*+.o      |
2026-03-16 08:43:05.770840 | aio -> localhost | |    +.+=B= +     |
2026-03-16 08:43:05.770872 | aio -> localhost | |   . o.++oB.+ .  |
2026-03-16 08:43:05.770902 | aio -> localhost | |      +.S+EB o . |
2026-03-16 08:43:05.770933 | aio -> localhost | |     o ..+o.o . .|
2026-03-16 08:43:05.770964 | aio -> localhost | |      .oo.o .. . |
2026-03-16 08:43:05.770996 | aio -> localhost | |      . ++..  .  |
2026-03-16 08:43:05.771030 | aio -> localhost | |       o.+. ..   |
2026-03-16 08:43:05.771061 | aio -> localhost | +----[SHA256]-----+
2026-03-16 08:43:05.771127 | aio -> localhost | ok: Runtime: 0:00:00.994773
2026-03-16 08:43:05.778803 | 
2026-03-16 08:43:05.778894 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-16 08:43:05.811277 | aio | ok
2026-03-16 08:43:05.820627 | aio | included: /var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-16 08:43:05.827882 | 
2026-03-16 08:43:05.827943 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-16 08:43:05.850925 | aio | skipping: Conditional result was False
2026-03-16 08:43:05.858892 | 
2026-03-16 08:43:05.858995 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-16 08:43:06.357098 | aio | changed
2026-03-16 08:43:06.364283 | 
2026-03-16 08:43:06.364425 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-16 08:43:06.539144 | aio | ok
2026-03-16 08:43:06.546702 | 
2026-03-16 08:43:06.546843 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-16 08:43:07.016102 | aio | changed
2026-03-16 08:43:07.023529 | 
2026-03-16 08:43:07.023671 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-16 08:43:07.470883 | aio | changed
2026-03-16 08:43:07.478670 | 
2026-03-16 08:43:07.478797 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-16 08:43:07.503064 | aio | skipping: Conditional result was False
2026-03-16 08:43:07.511958 | 
2026-03-16 08:43:07.512149 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-16 08:43:07.911811 | aio -> localhost | changed
2026-03-16 08:43:07.928767 | 
2026-03-16 08:43:07.928899 | TASK [add-build-sshkey : Add back temp key]
2026-03-16 08:43:08.243666 | aio -> localhost | Identity added: /var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/8f3b194890574f15a33c079354d46ef0_id_rsa (zuul-build-sshkey)
2026-03-16 08:43:08.243879 | aio -> localhost | ok: Runtime: 0:00:00.010592
2026-03-16 08:43:08.249510 | 
2026-03-16 08:43:08.249598 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-16 08:43:08.569621 | aio | ok
2026-03-16 08:43:08.578079 | 
2026-03-16 08:43:08.578197 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-16 08:43:08.602263 | aio | skipping: Conditional result was False
2026-03-16 08:43:08.618259 | 
2026-03-16 08:43:08.618386 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-16 08:43:08.984379 | aio | ok
2026-03-16 08:43:09.516230 | 
2026-03-16 08:43:09.516362 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-16 08:43:10.907569 | aio | Output suppressed because no_log was given
2026-03-16 08:43:10.924841 | 
2026-03-16 08:43:10.925113 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-16 08:43:11.107642 | aio | ok: "logs"
2026-03-16 08:43:11.107919 | aio | ok: All items complete
2026-03-16 08:43:11.107964 | 
2026-03-16 08:43:11.262976 | aio | ok: "artifacts"
2026-03-16 08:43:11.426314 | aio | ok: "docs"
2026-03-16 08:43:11.446945 | 
2026-03-16 08:43:11.447116 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-16 08:43:11.695484 | aio | changed: "logs"
2026-03-16 08:43:11.775166 | aio | changed: "artifacts"
2026-03-16 08:43:11.924331 | aio | changed: "docs"
2026-03-16 08:43:11.946377 | 
2026-03-16 08:43:11.946587 | PLAY RECAP
2026-03-16 08:43:11.946675 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-16 08:43:11.946720 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 08:43:11.946758 | 
2026-03-16 08:43:12.221020 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-16 08:43:12.224114 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-16 08:43:12.917345 | 
2026-03-16 08:43:12.917578 | PLAY [all]
2026-03-16 08:43:12.931926 | 
2026-03-16 08:43:12.932160 | TASK [setup-uv : Extract archive]
2026-03-16 08:43:15.186176 | aio | changed
2026-03-16 08:43:15.194517 | 
2026-03-16 08:43:15.194729 | TASK [setup-uv : Print version]
2026-03-16 08:43:15.572134 | aio | uv 0.8.13
2026-03-16 08:43:15.742922 | aio | ok: Runtime: 0:00:00.012151
2026-03-16 08:43:15.750459 | 
2026-03-16 08:43:15.750602 | PLAY RECAP
2026-03-16 08:43:15.750656 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 08:43:15.750681 | 
2026-03-16 08:43:15.985049 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-16 08:43:15.988349 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-16 08:43:16.705344 | 
2026-03-16 08:43:16.705497 | PLAY [all]
2026-03-16 08:43:16.719693 | 
2026-03-16 08:43:16.719840 | TASK [Copy inventory file for Zuul]
2026-03-16 08:43:17.607627 | aio | changed
2026-03-16 08:43:17.617282 | 
2026-03-16 08:43:17.617433 | TASK [Switch "ansible_host" to private IP]
2026-03-16 08:43:17.926867 | aio | changed: 1 replacements made
2026-03-16 08:43:17.932384 | 
2026-03-16 08:43:17.932485 | TASK [Run Molecule scenario]
2026-03-16 08:43:18.575701 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-03-16 08:43:19.365344 | aio |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-03-16 08:43:19.536687 | aio | Using CPython 3.13.7
2026-03-16 08:43:19.536733 | aio | Creating virtual environment at: .venv
2026-03-16 08:43:19.770824 | aio | Downloading pygments (1.2MiB)
2026-03-16 08:43:19.770972 | aio | Downloading netaddr (2.2MiB)
2026-03-16 08:43:19.771721 | aio | Downloading ansible-core (2.1MiB)
2026-03-16 08:43:19.771961 | aio | Downloading cryptography (4.3MiB)
2026-03-16 08:43:19.953858 | aio |  Downloading netaddr
2026-03-16 08:43:19.964051 | aio |  Downloading cryptography
2026-03-16 08:43:20.010095 | aio |  Downloading pygments
2026-03-16 08:43:20.141560 | aio |  Downloading ansible-core
2026-03-16 08:43:20.170270 | aio | Installed 36 packages in 28ms
2026-03-16 08:43:21.274020 | aio | INFO     Collection 'vexxhost.ceph' detected.
2026-03-16 08:43:21.274106 | aio | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-16 08:43:21.866022 | aio | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-16 08:43:21.866155 | aio | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-16 08:43:33.478116 | aio | INFO     [default > dependency] Executing
2026-03-16 08:43:33.478250 | aio | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-16 08:43:33.478508 | aio | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-16 08:43:33.478671 | aio | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-16 08:43:33.484092 | aio | INFO     [default > cleanup] Executing
2026-03-16 08:43:33.484371 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-16 08:43:33.489305 | aio | INFO     [default > destroy] Executing
2026-03-16 08:43:33.489348 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-16 08:43:33.489419 | aio | INFO     [default > destroy] Executed: Successful
2026-03-16 08:43:33.494325 | aio | INFO     [default > syntax] Executing
2026-03-16 08:43:34.396853 | aio |
2026-03-16 08:43:34.397200 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-16 08:43:34.447962 | aio | INFO     [default > syntax] Executed: Successful
2026-03-16 08:43:34.458206 | aio | INFO     [default > create] Executing
2026-03-16 08:43:34.460085 | aio | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-16 08:43:34.465464 | aio | INFO     [default > prepare] Executing
2026-03-16 08:43:35.099307 | aio |
2026-03-16 08:43:35.099434 | aio | PLAY [Prepare] *****************************************************************
2026-03-16 08:43:35.099625 | aio |
2026-03-16 08:43:35.099833 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:43:35.100035 | aio | Monday 16 March 2026  08:43:35 +0000 (0:00:00.029)       0:00:00.029 **********
2026-03-16 08:43:36.231563 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-16 08:43:36.231754 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-16 08:43:36.232093 | aio | interpreter could change the meaning of that path. See
2026-03-16 08:43:36.232218 | aio | https://docs.ansible.com/ansible-
2026-03-16 08:43:36.232640 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-16 08:43:36.238811 | aio | ok: [aio]
2026-03-16 08:43:36.238911 | aio |
2026-03-16 08:43:36.239040 | aio | TASK [Configure short hostname] ************************************************
2026-03-16 08:43:36.239157 | aio | Monday 16 March 2026  08:43:36 +0000 (0:00:01.140)       0:00:01.170 **********
2026-03-16 08:43:36.913073 | aio | changed: [aio]
2026-03-16 08:43:36.913224 | aio |
2026-03-16 08:43:36.913445 | aio | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-16 08:43:36.913660 | aio | Monday 16 March 2026  08:43:36 +0000 (0:00:00.673)       0:00:01.843 **********
2026-03-16 08:43:37.176011 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-16 08:43:37.176097 | aio | with a mode of 0700, this may cause issues when running as another user. To
2026-03-16 08:43:37.176108 | aio | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-16 08:43:37.182551 | aio | changed: [aio]
2026-03-16 08:43:37.182828 | aio |
2026-03-16 08:43:37.183096 | aio | TASK [Update apt cache] ********************************************************
2026-03-16 08:43:37.183409 | aio | Monday 16 March 2026  08:43:37 +0000 (0:00:00.270)       0:00:02.113 **********
2026-03-16 08:43:44.598800 | aio | changed: [aio]
2026-03-16 08:43:44.599047 | aio |
2026-03-16 08:43:44.599061 | aio | PLAY [Create devices for Ceph] *************************************************
2026-03-16 08:43:44.599071 | aio |
2026-03-16 08:43:44.599080 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:43:44.599089 | aio | Monday 16 March 2026  08:43:44 +0000 (0:00:07.415)       0:00:09.528 **********
2026-03-16 08:43:45.312444 | aio | ok: [aio]
2026-03-16 08:43:45.312527 | aio |
2026-03-16 08:43:45.312539 | aio | TASK [Install depedencies] *****************************************************
2026-03-16 08:43:45.312551 | aio | Monday 16 March 2026  08:43:45 +0000 (0:00:00.713)       0:00:10.242 **********
2026-03-16 08:44:06.552800 | aio | changed: [aio]
2026-03-16 08:44:06.552859 | aio |
2026-03-16 08:44:06.552906 | aio | TASK [Start up service] ********************************************************
2026-03-16 08:44:06.553141 | aio | Monday 16 March 2026  08:44:06 +0000 (0:00:21.240)       0:00:31.483 **********
2026-03-16 08:44:07.110535 | aio | ok: [aio]
2026-03-16 08:44:07.110701 | aio |
2026-03-16 08:44:07.110915 | aio | TASK [Generate lvm.conf] *******************************************************
2026-03-16 08:44:07.111141 | aio | Monday 16 March 2026  08:44:07 +0000 (0:00:00.558)       0:00:32.041 **********
2026-03-16 08:44:07.426137 | aio | ok: [aio]
2026-03-16 08:44:07.426231 | aio |
2026-03-16 08:44:07.426480 | aio | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-16 08:44:07.426699 | aio | Monday 16 March 2026  08:44:07 +0000 (0:00:00.315)       0:00:32.357 **********
2026-03-16 08:44:08.068808 | aio | changed: [aio]
2026-03-16 08:44:08.068900 | aio |
2026-03-16 08:44:08.068914 | aio | TASK [Get list of all loopback devices] ****************************************
2026-03-16 08:44:08.069025 | aio | Monday 16 March 2026  08:44:08 +0000 (0:00:00.642)       0:00:32.999 **********
2026-03-16 08:44:08.269971 | aio | ok: [aio]
2026-03-16 08:44:08.270073 | aio |
2026-03-16 08:44:08.270303 | aio | TASK [Fail if there is any existing loopback devices] **************************
2026-03-16 08:44:08.270500 | aio | Monday 16 March 2026  08:44:08 +0000 (0:00:00.200)       0:00:33.200 **********
2026-03-16 08:44:08.293159 | aio | skipping: [aio]
2026-03-16 08:44:08.293295 | aio |
2026-03-16 08:44:08.293488 | aio | TASK [Create devices for Ceph] *************************************************
2026-03-16 08:44:08.293690 | aio | Monday 16 March 2026  08:44:08 +0000 (0:00:00.023)       0:00:33.224 **********
2026-03-16 08:44:08.861393 | aio | changed: [aio] => (item=osd0)
2026-03-16 08:44:08.861563 | aio | changed: [aio] => (item=osd1)
2026-03-16 08:44:08.861758 | aio | changed: [aio] => (item=osd2)
2026-03-16 08:44:08.861945 | aio |
2026-03-16 08:44:08.862158 | aio | TASK [Set permissions on loopback devices] *************************************
2026-03-16 08:44:08.862390 | aio | Monday 16 March 2026  08:44:08 +0000 (0:00:00.567)       0:00:33.792 **********
2026-03-16 08:44:09.540875 | aio | changed: [aio] => (item=osd0)
2026-03-16 08:44:09.540956 | aio | changed: [aio] => (item=osd1)
2026-03-16 08:44:09.541082 | aio | changed: [aio] => (item=osd2)
2026-03-16 08:44:09.541200 | aio |
2026-03-16 08:44:09.541332 | aio | TASK [Start loop devices] ******************************************************
2026-03-16 08:44:09.541462 | aio | Monday 16 March 2026  08:44:09 +0000 (0:00:00.679)       0:00:34.471 **********
2026-03-16 08:44:10.262936 | aio | changed: [aio] => (item=osd0)
2026-03-16 08:44:10.263090 | aio | changed: [aio] => (item=osd1)
2026-03-16 08:44:10.263333 | aio | changed: [aio] => (item=osd2)
2026-03-16 08:44:10.263510 | aio |
2026-03-16 08:44:10.263704 | aio | TASK [Create a volume group for each loop device] ******************************
2026-03-16 08:44:10.263903 | aio | Monday 16 March 2026  08:44:10 +0000 (0:00:00.721)       0:00:35.193 **********
2026-03-16 08:44:13.425131 | aio | changed: [aio] => (item=osd0)
2026-03-16 08:44:13.425311 | aio | changed: [aio] => (item=osd1)
2026-03-16 08:44:13.425480 | aio | changed: [aio] => (item=osd2)
2026-03-16 08:44:13.425640 | aio |
2026-03-16 08:44:13.425808 | aio | TASK [Create a logical volume for each loop device] ****************************
2026-03-16 08:44:13.425981 | aio | Monday 16 March 2026  08:44:13 +0000 (0:00:03.162)       0:00:38.356 **********
2026-03-16 08:44:15.368655 | aio | changed: [aio] => (item=ceph-aio-osd0)
2026-03-16 08:44:15.368758 | aio | changed: [aio] => (item=ceph-aio-osd1)
2026-03-16 08:44:15.368934 | aio | changed: [aio] => (item=ceph-aio-osd2)
2026-03-16 08:44:15.369077 | aio |
2026-03-16 08:44:15.369222 | aio | PLAY RECAP *********************************************************************
2026-03-16 08:44:15.369398 | aio | aio                        : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-16 08:44:15.369544 | aio |
2026-03-16 08:44:15.369686 | aio |
2026-03-16 08:44:15.369835 | aio | TASKS RECAP ********************************************************************
2026-03-16 08:44:15.369986 | aio | Monday 16 March 2026  08:44:15 +0000 (0:00:01.943)       0:00:40.299 **********
2026-03-16 08:44:15.370125 | aio | ===============================================================================
2026-03-16 08:44:15.370281 | aio | Install depedencies ---------------------------------------------------- 21.24s
2026-03-16 08:44:15.370424 | aio | Update apt cache -------------------------------------------------------- 7.42s
2026-03-16 08:44:15.370571 | aio | Create a volume group for each loop device ------------------------------ 3.16s
2026-03-16 08:44:15.370796 | aio | Create a logical volume for each loop device ---------------------------- 1.94s
2026-03-16 08:44:15.370944 | aio | Gathering Facts --------------------------------------------------------- 1.14s
2026-03-16 08:44:15.371092 | aio | Start loop devices ------------------------------------------------------ 0.72s
2026-03-16 08:44:15.371279 | aio | Gathering Facts --------------------------------------------------------- 0.71s
2026-03-16 08:44:15.371434 | aio | Set permissions on loopback devices ------------------------------------- 0.68s
2026-03-16 08:44:15.371607 | aio | Configure short hostname ------------------------------------------------ 0.67s
2026-03-16 08:44:15.371761 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s
2026-03-16 08:44:15.371889 | aio | Create devices for Ceph ------------------------------------------------- 0.57s
2026-03-16 08:44:15.372013 | aio | Start up service -------------------------------------------------------- 0.56s
2026-03-16 08:44:15.372135 | aio | Generate lvm.conf ------------------------------------------------------- 0.32s
2026-03-16 08:44:15.372258 | aio | Ensure hostname inside hosts file --------------------------------------- 0.27s
2026-03-16 08:44:15.372380 | aio | Get list of all loopback devices ---------------------------------------- 0.20s
2026-03-16 08:44:15.372505 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-03-16 08:44:15.450160 | aio | INFO     [default > prepare] Executed: Successful
2026-03-16 08:44:15.459327 | aio | INFO     [default > converge] Executing
2026-03-16 08:44:16.317868 | aio |
2026-03-16 08:44:16.318031 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-16 08:44:16.318215 | aio |
2026-03-16 08:44:16.318426 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:44:16.318645 | aio | Monday 16 March 2026  08:44:16 +0000 (0:00:00.046)       0:00:00.046 **********
2026-03-16 08:44:17.510494 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-16 08:44:17.510664 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-16 08:44:17.510867 | aio | interpreter could change the meaning of that path. See
2026-03-16 08:44:17.511074 | aio | https://docs.ansible.com/ansible-
2026-03-16 08:44:17.511311 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-16 08:44:17.523476 | aio | ok: [aio]
2026-03-16 08:44:17.523688 | aio |
2026-03-16 08:44:17.523910 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:44:17.524158 | aio | Monday 16 March 2026  08:44:17 +0000 (0:00:01.205)       0:00:01.251 **********
2026-03-16 08:44:17.814527 | aio | ok: [aio]
2026-03-16 08:44:17.814695 | aio |
2026-03-16 08:44:17.814931 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:44:17.815248 | aio | Monday 16 March 2026  08:44:17 +0000 (0:00:00.291)       0:00:01.543 **********
2026-03-16 08:44:17.848700 | aio | skipping: [aio]
2026-03-16 08:44:17.848880 | aio |
2026-03-16 08:44:17.849150 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-16 08:44:17.849407 | aio | Monday 16 March 2026  08:44:17 +0000 (0:00:00.034)       0:00:01.577 **********
2026-03-16 08:44:18.159493 | aio | changed: [aio]
2026-03-16 08:44:18.159650 | aio |
2026-03-16 08:44:18.159859 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:44:18.160060 | aio | Monday 16 March 2026  08:44:18 +0000 (0:00:00.310)       0:00:01.887 **********
2026-03-16 08:44:18.261760 | aio | ok: [aio] => {
2026-03-16 08:44:18.262007 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-16 08:44:18.262217 | aio | }
2026-03-16 08:44:18.262402 | aio |
2026-03-16 08:44:18.262639 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:44:18.262820 | aio | Monday 16 March 2026  08:44:18 +0000 (0:00:00.102)       0:00:01.990 **********
2026-03-16 08:44:18.923839 | aio | changed: [aio]
2026-03-16 08:44:18.923979 | aio |
2026-03-16 08:44:18.924205 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:44:18.924430 | aio | Monday 16 March 2026  08:44:18 +0000 (0:00:00.661)       0:00:02.652 **********
2026-03-16 08:44:18.963766 | aio | skipping: [aio]
2026-03-16 08:44:18.963942 | aio |
2026-03-16 08:44:18.964154 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:44:18.964367 | aio | Monday 16 March 2026  08:44:18 +0000 (0:00:00.040)       0:00:02.692 **********
2026-03-16 08:44:19.005533 | aio | skipping: [aio]
2026-03-16 08:44:19.005709 | aio |
2026-03-16 08:44:19.005920 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:44:19.006230 | aio | Monday 16 March 2026  08:44:19 +0000 (0:00:00.041)       0:00:02.734 **********
2026-03-16 08:44:19.204726 | aio | ok: [aio]
2026-03-16 08:44:19.204812 | aio |
2026-03-16 08:44:19.204866 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:44:19.204947 | aio | Monday 16 March 2026  08:44:19 +0000 (0:00:00.199)       0:00:02.933 **********
2026-03-16 08:44:20.362157 | aio | ok: [aio]
2026-03-16 08:44:20.362259 | aio |
2026-03-16 08:44:20.362271 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:44:20.362363 | aio | Monday 16 March 2026  08:44:20 +0000 (0:00:01.157)       0:00:04.090 **********
2026-03-16 08:44:20.434596 | aio | ok: [aio] => {
2026-03-16 08:44:20.434812 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-16 08:44:20.435002 | aio | }
2026-03-16 08:44:20.435209 | aio |
2026-03-16 08:44:20.435428 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:44:20.435626 | aio | Monday 16 March 2026  08:44:20 +0000 (0:00:00.072)       0:00:04.163 **********
2026-03-16 08:44:21.166533 | aio | changed: [aio]
2026-03-16 08:44:21.166630 | aio |
2026-03-16 08:44:21.166752 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:44:21.166933 | aio | Monday 16 March 2026  08:44:21 +0000 (0:00:00.731)       0:00:04.895 **********
2026-03-16 08:44:24.162634 | aio | changed: [aio]
2026-03-16 08:44:24.162733 | aio |
2026-03-16 08:44:24.162746 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-16 08:44:24.162756 | aio | Monday 16 March 2026  08:44:24 +0000 (0:00:02.995)       0:00:07.890 **********
2026-03-16 08:44:24.193559 | aio | skipping: [aio]
2026-03-16 08:44:24.193670 | aio |
2026-03-16 08:44:24.193955 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-16 08:44:24.194005 | aio | Monday 16 March 2026  08:44:24 +0000 (0:00:00.031)       0:00:07.922 **********
2026-03-16 08:44:24.229065 | aio | skipping: [aio]
2026-03-16 08:44:24.229152 | aio |
2026-03-16 08:44:24.229220 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-16 08:44:24.229355 | aio | Monday 16 March 2026  08:44:24 +0000 (0:00:00.035)       0:00:07.957 **********
2026-03-16 08:44:24.261949 | aio | skipping: [aio]
2026-03-16 08:44:24.262050 | aio |
2026-03-16 08:44:24.262316 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-16 08:44:24.262366 | aio | Monday 16 March 2026  08:44:24 +0000 (0:00:00.032)       0:00:07.990 **********
2026-03-16 08:44:33.119197 | aio | changed: [aio]
2026-03-16 08:44:33.119407 | aio |
2026-03-16 08:44:33.119544 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-16 08:44:33.119671 | aio | Monday 16 March 2026  08:44:33 +0000 (0:00:08.849)       0:00:16.839 **********
2026-03-16 08:44:33.675699 | aio | changed: [aio]
2026-03-16 08:44:33.675787 | aio |
2026-03-16 08:44:33.675946 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-16 08:44:33.676301 | aio | Monday 16 March 2026  08:44:33 +0000 (0:00:00.563)       0:00:17.403 **********
2026-03-16 08:44:34.597186 | aio | changed: [aio] => (item={'path': '/etc/containerd'})
2026-03-16 08:44:34.597265 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-16 08:44:34.598176 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-16 08:44:34.598250 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-16 08:44:34.598259 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-16 08:44:34.598267 | aio |
2026-03-16 08:44:34.598274 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-16 08:44:34.598281 | aio | Monday 16 March 2026  08:44:34 +0000 (0:00:00.922)       0:00:18.325 **********
2026-03-16 08:44:35.155258 | aio | changed: [aio]
2026-03-16 08:44:35.155360 | aio |
2026-03-16 08:44:35.155848 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-16 08:44:35.155909 | aio | Monday 16 March 2026  08:44:35 +0000 (0:00:00.551)       0:00:18.877 **********
2026-03-16 08:44:35.155916 | aio |
2026-03-16 08:44:35.155921 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-16 08:44:35.155925 | aio | Monday 16 March 2026  08:44:35 +0000 (0:00:00.006)       0:00:18.884 **********
2026-03-16 08:44:36.079066 | aio | ok: [aio]
2026-03-16 08:44:36.079123 | aio |
2026-03-16 08:44:36.079136 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-16 08:44:36.079154 | aio | Monday 16 March 2026  08:44:36 +0000 (0:00:00.923)       0:00:19.807 **********
2026-03-16 08:44:36.531657 | aio | changed: [aio]
2026-03-16 08:44:36.531761 | aio |
2026-03-16 08:44:36.531774 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-16 08:44:36.531948 | aio | Monday 16 March 2026  08:44:36 +0000 (0:00:00.453)       0:00:20.260 **********
2026-03-16 08:44:37.083791 | aio | changed: [aio]
2026-03-16 08:44:37.083896 | aio |
2026-03-16 08:44:37.083912 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:44:37.084078 | aio | Monday 16 March 2026  08:44:37 +0000 (0:00:00.552)       0:00:20.812 **********
2026-03-16 08:44:37.286993 | aio | ok: [aio]
2026-03-16 08:44:37.287074 | aio |
2026-03-16 08:44:37.287376 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:44:37.287414 | aio | Monday 16 March 2026  08:44:37 +0000 (0:00:00.203)       0:00:21.015 **********
2026-03-16 08:44:37.351087 | aio | ok: [aio] => {
2026-03-16 08:44:37.351200 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-16 08:44:37.351373 | aio | }
2026-03-16 08:44:37.351460 | aio |
2026-03-16 08:44:37.351472 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:44:37.351556 | aio | Monday 16 March 2026  08:44:37 +0000 (0:00:00.064)       0:00:21.080 **********
2026-03-16 08:44:38.221006 | aio | changed: [aio]
2026-03-16 08:44:38.221092 | aio |
2026-03-16 08:44:38.221144 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:44:38.221242 | aio | Monday 16 March 2026  08:44:38 +0000 (0:00:00.869)       0:00:21.950 **********
2026-03-16 08:44:42.647610 | aio | changed: [aio]
2026-03-16 08:44:42.647710 | aio |
2026-03-16 08:44:42.647727 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-16 08:44:42.647829 | aio | Monday 16 March 2026  08:44:42 +0000 (0:00:04.426)       0:00:26.376 **********
2026-03-16 08:44:43.833841 | aio | ok: [aio]
2026-03-16 08:44:43.834002 | aio |
2026-03-16 08:44:43.834263 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-16 08:44:43.834469 | aio | Monday 16 March 2026  08:44:43 +0000 (0:00:01.185)       0:00:27.562 **********
2026-03-16 08:44:44.224098 | aio | changed: [aio]
2026-03-16 08:44:44.224267 | aio |
2026-03-16 08:44:44.224594 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-16 08:44:44.224809 | aio | Monday 16 March 2026  08:44:44 +0000 (0:00:00.390)       0:00:27.952 **********
2026-03-16 08:44:44.694954 | aio | changed: [aio]
2026-03-16 08:44:44.695078 | aio |
2026-03-16 08:44:44.695328 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-16 08:44:44.695619 | aio | Monday 16 March 2026  08:44:44 +0000 (0:00:00.471)       0:00:28.423 **********
2026-03-16 08:44:45.274550 | aio | changed: [aio] => (item={'path': '/etc/docker'})
2026-03-16 08:44:45.274654 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-16 08:44:45.274669 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-16 08:44:45.274680 | aio |
2026-03-16 08:44:45.274691 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-16 08:44:45.274700 | aio | Monday 16 March 2026  08:44:45 +0000 (0:00:00.578)       0:00:29.001 **********
2026-03-16 08:44:45.744701 | aio | changed: [aio]
2026-03-16 08:44:45.744794 | aio |
2026-03-16 08:44:45.745080 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-16 08:44:45.745146 | aio | Monday 16 March 2026  08:44:45 +0000 (0:00:00.471)       0:00:29.473 **********
2026-03-16 08:44:46.203660 | aio | changed: [aio]
2026-03-16 08:44:46.203738 | aio |
2026-03-16 08:44:46.204204 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-16 08:44:46.204273 | aio | Monday 16 March 2026  08:44:46 +0000 (0:00:00.451)       0:00:29.924 **********
2026-03-16 08:44:46.204280 | aio |
2026-03-16 08:44:46.204285 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-16 08:44:46.204289 | aio | Monday 16 March 2026  08:44:46 +0000 (0:00:00.007)       0:00:29.932 **********
2026-03-16 08:44:46.907638 | aio | ok: [aio]
2026-03-16 08:44:46.907711 | aio |
2026-03-16 08:44:46.907890 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-16 08:44:46.907908 | aio | Monday 16 March 2026  08:44:46 +0000 (0:00:00.703)       0:00:30.636 **********
2026-03-16 08:44:47.808719 | aio | changed: [aio]
2026-03-16 08:44:47.808824 | aio |
2026-03-16 08:44:47.808837 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-16 08:44:47.808975 | aio | Monday 16 March 2026  08:44:47 +0000 (0:00:00.901)       0:00:31.537 **********
2026-03-16 08:44:48.362195 | aio | changed: [aio]
2026-03-16 08:44:48.362301 | aio |
2026-03-16 08:44:48.362314 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-16 08:44:48.362475 | aio | Monday 16 March 2026  08:44:48 +0000 (0:00:00.553)       0:00:32.090 **********
2026-03-16 08:44:48.409760 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-16 08:44:48.409850 | aio |
2026-03-16 08:44:48.410099 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-16 08:44:48.410158 | aio | Monday 16 March 2026  08:44:48 +0000 (0:00:00.047)       0:00:32.138 **********
2026-03-16 08:44:53.684195 | aio | changed: [aio]
2026-03-16 08:44:53.684299 | aio |
2026-03-16 08:44:53.684362 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-16 08:44:53.684576 | aio | Monday 16 March 2026  08:44:53 +0000 (0:00:05.274)       0:00:37.412 **********
2026-03-16 08:44:54.374422 | aio | ok: [aio] => (item=chronyd)
2026-03-16 08:44:54.374511 | aio | ok: [aio] => (item=sshd)
2026-03-16 08:44:54.374914 | aio |
2026-03-16 08:44:54.374993 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-16 08:44:54.375002 | aio | Monday 16 March 2026  08:44:54 +0000 (0:00:00.690)       0:00:38.103 **********
2026-03-16 08:44:54.697056 | aio | changed: [aio]
2026-03-16 08:44:54.697162 | aio |
2026-03-16 08:44:54.697175 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-16 08:44:54.697336 | aio | Monday 16 March 2026  08:44:54 +0000 (0:00:00.322)       0:00:38.425 **********
2026-03-16 08:44:54.904081 | aio | ok: [aio]
2026-03-16 08:44:54.904154 | aio |
2026-03-16 08:44:54.904379 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-16 08:44:54.904447 | aio | Monday 16 March 2026  08:44:54 +0000 (0:00:00.206)       0:00:38.632 **********
2026-03-16 08:44:55.409816 | aio | changed: [aio]
2026-03-16 08:44:55.409908 | aio |
2026-03-16 08:44:55.409976 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-16 08:44:55.410108 | aio | Monday 16 March 2026  08:44:55 +0000 (0:00:00.505)       0:00:39.138 **********
2026-03-16 08:44:55.775957 | aio | changed: [aio]
2026-03-16 08:44:55.776062 | aio |
2026-03-16 08:44:55.776075 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-16 08:44:55.776222 | aio | Monday 16 March 2026  08:44:55 +0000 (0:00:00.366)       0:00:39.504 **********
2026-03-16 08:44:55.948177 | aio | ok: [aio]
2026-03-16 08:44:55.948273 | aio |
2026-03-16 08:44:55.948282 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-16 08:44:55.948343 | aio | Monday 16 March 2026  08:44:55 +0000 (0:00:00.171)       0:00:39.676 **********
2026-03-16 08:44:56.165909 | aio | ok: [aio] => (item=aio)
2026-03-16 08:44:56.166000 | aio |
2026-03-16 08:44:56.166257 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-16 08:44:56.166324 | aio | Monday 16 March 2026  08:44:56 +0000 (0:00:00.217)       0:00:39.894 **********
2026-03-16 08:44:56.216855 | aio | ok: [aio]
2026-03-16 08:44:56.216932 | aio |
2026-03-16 08:44:56.216999 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-16 08:44:56.217140 | aio | Monday 16 March 2026  08:44:56 +0000 (0:00:00.050)       0:00:39.945 **********
2026-03-16 08:44:56.337228 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio
2026-03-16 08:44:56.337328 | aio |
2026-03-16 08:44:56.337351 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-03-16 08:44:56.337363 | aio | Monday 16 March 2026  08:44:56 +0000 (0:00:00.120)       0:00:40.065 **********
2026-03-16 08:44:56.635604 | aio | changed: [aio]
2026-03-16 08:44:56.635702 | aio |
2026-03-16 08:44:56.635974 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-03-16 08:44:56.636176 | aio | Monday 16 March 2026  08:44:56 +0000 (0:00:00.298)       0:00:40.364 **********
2026-03-16 08:44:57.297906 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-03-16 08:44:57.298030 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-03-16 08:44:57.298627 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-03-16 08:44:57.298700 | aio |
2026-03-16 08:44:57.298707 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-03-16 08:44:57.298714 | aio | Monday 16 March 2026  08:44:57 +0000 (0:00:00.662)       0:00:41.026 **********
2026-03-16 08:47:08.372252 | aio | ok: [aio]
2026-03-16 08:47:08.372358 | aio |
2026-03-16 08:47:08.372374 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-03-16 08:47:08.372516 | aio | Monday 16 March 2026  08:47:08 +0000 (0:02:11.074)       0:02:52.100 **********
2026-03-16 08:47:08.586337 | aio | changed: [aio]
2026-03-16 08:47:08.586421 | aio |
2026-03-16 08:47:08.586737 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-03-16 08:47:08.586811 | aio | Monday 16 March 2026  08:47:08 +0000 (0:00:00.214)       0:02:52.314 **********
2026-03-16 08:47:08.628370 | aio | ok: [aio]
2026-03-16 08:47:08.628816 | aio |
2026-03-16 08:47:08.628854 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:47:08.628863 | aio | Monday 16 March 2026  08:47:08 +0000 (0:00:00.041)       0:02:52.356 **********
2026-03-16 08:47:08.700413 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:47:08.700496 | aio |
2026-03-16 08:47:08.700733 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:47:08.700768 | aio | Monday 16 March 2026  08:47:08 +0000 (0:00:00.072)       0:02:52.429 **********
2026-03-16 08:47:15.270473 | aio | ok: [aio]
2026-03-16 08:47:15.270567 | aio |
2026-03-16 08:47:15.270609 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:47:15.270707 | aio | Monday 16 March 2026  08:47:15 +0000 (0:00:06.569)       0:02:58.999 **********
2026-03-16 08:47:15.325596 | aio | ok: [aio] => (item=aio)
2026-03-16 08:47:15.325663 | aio |
2026-03-16 08:47:15.325796 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:47:15.325925 | aio | Monday 16 March 2026  08:47:15 +0000 (0:00:00.055)       0:02:59.054 **********
2026-03-16 08:47:15.758330 | aio | ok: [aio]
2026-03-16 08:47:15.758421 | aio |
2026-03-16 08:47:15.758557 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:47:15.758688 | aio | Monday 16 March 2026  08:47:15 +0000 (0:00:00.432)       0:02:59.486 **********
2026-03-16 08:47:22.431089 | aio | ok: [aio]
2026-03-16 08:47:22.431271 | aio |
2026-03-16 08:47:22.431284 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-16 08:47:22.431389 | aio | Monday 16 March 2026  08:47:22 +0000 (0:00:06.672)       0:03:06.159 **********
2026-03-16 08:47:34.975587 | aio | changed: [aio]
2026-03-16 08:47:34.975671 | aio |
2026-03-16 08:47:34.975689 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-16 08:47:34.975800 | aio | Monday 16 March 2026  08:47:34 +0000 (0:00:12.544)       0:03:18.704 **********
2026-03-16 08:47:49.276933 | aio | ok: [aio]
2026-03-16 08:47:49.277005 | aio |
2026-03-16 08:47:49.277169 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:47:49.277186 | aio | Monday 16 March 2026  08:47:49 +0000 (0:00:14.301)       0:03:33.005 **********
2026-03-16 08:47:49.351306 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:47:49.351372 | aio |
2026-03-16 08:47:49.351474 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:47:49.351576 | aio | Monday 16 March 2026  08:47:49 +0000 (0:00:00.074)       0:03:33.080 **********
2026-03-16 08:47:49.393881 | aio | skipping: [aio]
2026-03-16 08:47:49.393999 | aio |
2026-03-16 08:47:49.394163 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:47:49.394380 | aio | Monday 16 March 2026  08:47:49 +0000 (0:00:00.042)       0:03:33.122 **********
2026-03-16 08:47:49.440564 | aio | skipping: [aio] => (item=aio)
2026-03-16 08:47:49.440723 | aio | skipping: [aio]
2026-03-16 08:47:49.440736 | aio |
2026-03-16 08:47:49.440746 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:47:49.440820 | aio | Monday 16 March 2026  08:47:49 +0000 (0:00:00.046)       0:03:33.169 **********
2026-03-16 08:47:49.689661 | aio | ok: [aio]
2026-03-16 08:47:49.689757 | aio |
2026-03-16 08:47:49.689770 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:47:49.689906 | aio | Monday 16 March 2026  08:47:49 +0000 (0:00:00.248)       0:03:33.418 **********
2026-03-16 08:47:56.199842 | aio | ok: [aio]
2026-03-16 08:47:56.199920 | aio |
2026-03-16 08:47:56.200149 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-16 08:47:56.200217 | aio | Monday 16 March 2026  08:47:56 +0000 (0:00:06.509)       0:03:39.928 **********
2026-03-16 08:48:08.266156 | aio | changed: [aio]
2026-03-16 08:48:08.266261 | aio |
2026-03-16 08:48:08.266277 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-16 08:48:08.266385 | aio | Monday 16 March 2026  08:48:08 +0000 (0:00:12.066)       0:03:51.994 **********
2026-03-16 08:48:14.457698 | aio | ok: [aio]
2026-03-16 08:48:14.457773 | aio |
2026-03-16 08:48:14.458005 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-16 08:48:14.458087 | aio | Monday 16 March 2026  08:48:14 +0000 (0:00:06.191)       0:03:58.186 **********
2026-03-16 08:48:21.882376 | aio | changed: [aio] => (item={'name': 'diskprediction_local'})
2026-03-16 08:48:21.882486 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-16 08:48:21.882499 | aio | changed: [aio] => (item={'name': 'prometheus'})
2026-03-16 08:48:21.882585 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-16 08:48:21.882688 | aio |
2026-03-16 08:48:21.882784 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-16 08:48:21.882869 | aio |
2026-03-16 08:48:21.882954 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:48:21.883047 | aio | Monday 16 March 2026  08:48:21 +0000 (0:00:07.424)       0:04:05.611 **********
2026-03-16 08:48:22.794759 | aio | ok: [aio]
2026-03-16 08:48:22.794831 | aio |
2026-03-16 08:48:22.794900 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:48:22.794995 | aio | Monday 16 March 2026  08:48:22 +0000 (0:00:00.912)       0:04:06.523 **********
2026-03-16 08:48:23.000890 | aio | ok: [aio]
2026-03-16 08:48:23.001014 | aio |
2026-03-16 08:48:23.001027 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:48:23.001041 | aio | Monday 16 March 2026  08:48:22 +0000 (0:00:00.205)       0:04:06.729 **********
2026-03-16 08:48:23.036045 | aio | skipping: [aio]
2026-03-16 08:48:23.036131 | aio |
2026-03-16 08:48:23.036172 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-16 08:48:23.036276 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.035)       0:04:06.765 **********
2026-03-16 08:48:23.250683 | aio | ok: [aio]
2026-03-16 08:48:23.250764 | aio |
2026-03-16 08:48:23.250782 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:48:23.250884 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.214)       0:04:06.979 **********
2026-03-16 08:48:23.310742 | aio | ok: [aio] => {
2026-03-16 08:48:23.310821 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-16 08:48:23.310963 | aio | }
2026-03-16 08:48:23.311083 | aio |
2026-03-16 08:48:23.311253 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:48:23.311381 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.060)       0:04:07.039 **********
2026-03-16 08:48:23.635352 | aio | ok: [aio]
2026-03-16 08:48:23.635437 | aio |
2026-03-16 08:48:23.635571 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:48:23.635700 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.323)       0:04:07.363 **********
2026-03-16 08:48:23.676584 | aio | skipping: [aio]
2026-03-16 08:48:23.676706 | aio |
2026-03-16 08:48:23.676719 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:48:23.676755 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.042)       0:04:07.405 **********
2026-03-16 08:48:23.718454 | aio | skipping: [aio]
2026-03-16 08:48:23.718495 | aio |
2026-03-16 08:48:23.718592 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:48:23.718680 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.041)       0:04:07.447 **********
2026-03-16 08:48:23.925463 | aio | ok: [aio]
2026-03-16 08:48:23.925503 | aio |
2026-03-16 08:48:23.925616 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:48:23.925720 | aio | Monday 16 March 2026  08:48:23 +0000 (0:00:00.206)       0:04:07.654 **********
2026-03-16 08:48:25.100881 | aio | ok: [aio]
2026-03-16 08:48:25.100961 | aio |
2026-03-16 08:48:25.101004 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:48:25.101106 | aio | Monday 16 March 2026  08:48:25 +0000 (0:00:01.175)       0:04:08.829 **********
2026-03-16 08:48:25.166249 | aio | ok: [aio] => {
2026-03-16 08:48:25.166348 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-16 08:48:25.166432 | aio | }
2026-03-16 08:48:25.166524 | aio |
2026-03-16 08:48:25.166643 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:48:25.166717 | aio | Monday 16 March 2026  08:48:25 +0000 (0:00:00.065)       0:04:08.895 **********
2026-03-16 08:48:25.546711 | aio | ok: [aio]
2026-03-16 08:48:25.546822 | aio |
2026-03-16 08:48:25.546829 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:48:25.547107 | aio | Monday 16 March 2026  08:48:25 +0000 (0:00:00.379)       0:04:09.274 **********
2026-03-16 08:48:27.518867 | aio | ok: [aio]
2026-03-16 08:48:27.518951 | aio |
2026-03-16 08:48:27.518975 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-16 08:48:27.519081 | aio | Monday 16 March 2026  08:48:27 +0000 (0:00:01.972)       0:04:11.247 **********
2026-03-16 08:48:27.548371 | aio | skipping: [aio]
2026-03-16 08:48:27.548443 | aio |
2026-03-16 08:48:27.548541 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-16 08:48:27.548633 | aio | Monday 16 March 2026  08:48:27 +0000 (0:00:00.030)       0:04:11.277 **********
2026-03-16 08:48:27.582200 | aio | skipping: [aio]
2026-03-16 08:48:27.582277 | aio |
2026-03-16 08:48:27.582378 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-16 08:48:27.582471 | aio | Monday 16 March 2026  08:48:27 +0000 (0:00:00.034)       0:04:11.311 **********
2026-03-16 08:48:27.611092 | aio | skipping: [aio]
2026-03-16 08:48:27.611238 | aio |
2026-03-16 08:48:27.611379 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-16 08:48:27.611510 | aio | Monday 16 March 2026  08:48:27 +0000 (0:00:00.028)       0:04:11.340 **********
2026-03-16 08:48:28.726127 | aio | ok: [aio]
2026-03-16 08:48:28.726213 | aio |
2026-03-16 08:48:28.726256 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-16 08:48:28.726358 | aio | Monday 16 March 2026  08:48:28 +0000 (0:00:01.114)       0:04:12.454 **********
2026-03-16 08:48:29.165984 | aio | ok: [aio]
2026-03-16 08:48:29.166064 | aio |
2026-03-16 08:48:29.166125 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-16 08:48:29.166223 | aio | Monday 16 March 2026  08:48:29 +0000 (0:00:00.440)       0:04:12.894 **********
2026-03-16 08:48:30.053036 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-16 08:48:30.053131 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-16 08:48:30.053220 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-16 08:48:30.053325 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-16 08:48:30.053431 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-16 08:48:30.053553 | aio |
2026-03-16 08:48:30.053646 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-16 08:48:30.053738 | aio | Monday 16 March 2026  08:48:30 +0000 (0:00:00.886)       0:04:13.781 **********
2026-03-16 08:48:30.582456 | aio | ok: [aio]
2026-03-16 08:48:30.582524 | aio |
2026-03-16 08:48:30.582613 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-16 08:48:30.582713 | aio | Monday 16 March 2026  08:48:30 +0000 (0:00:00.523)       0:04:14.304 **********
2026-03-16 08:48:30.582799 | aio |
2026-03-16 08:48:30.582907 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-16 08:48:30.582986 | aio | Monday 16 March 2026  08:48:30 +0000 (0:00:00.006)       0:04:14.311 **********
2026-03-16 08:48:30.933805 | aio | ok: [aio]
2026-03-16 08:48:30.933884 | aio |
2026-03-16 08:48:30.933945 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:48:30.934042 | aio | Monday 16 March 2026  08:48:30 +0000 (0:00:00.351)       0:04:14.662 **********
2026-03-16 08:48:31.149492 | aio | ok: [aio]
2026-03-16 08:48:31.149546 | aio |
2026-03-16 08:48:31.149693 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:48:31.149791 | aio | Monday 16 March 2026  08:48:31 +0000 (0:00:00.215)       0:04:14.878 **********
2026-03-16 08:48:31.206858 | aio | ok: [aio] => {
2026-03-16 08:48:31.206969 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-16 08:48:31.207153 | aio | }
2026-03-16 08:48:31.207238 | aio |
2026-03-16 08:48:31.207436 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:48:31.207516 | aio | Monday 16 March 2026  08:48:31 +0000 (0:00:00.057)       0:04:14.935 **********
2026-03-16 08:48:31.555390 | aio | ok: [aio]
2026-03-16 08:48:31.555466 | aio |
2026-03-16 08:48:31.555623 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:48:31.555760 | aio | Monday 16 March 2026  08:48:31 +0000 (0:00:00.348)       0:04:15.283 **********
2026-03-16 08:48:34.634092 | aio | ok: [aio]
2026-03-16 08:48:34.634184 | aio |
2026-03-16 08:48:34.634215 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-16 08:48:34.634321 | aio | Monday 16 March 2026  08:48:34 +0000 (0:00:03.079)       0:04:18.363 **********
2026-03-16 08:48:35.625353 | aio | ok: [aio]
2026-03-16 08:48:35.625512 | aio |
2026-03-16 08:48:35.625742 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-16 08:48:35.625939 | aio | Monday 16 March 2026  08:48:35 +0000 (0:00:00.990)       0:04:19.353 **********
2026-03-16 08:48:35.825637 | aio | ok: [aio]
2026-03-16 08:48:35.825721 | aio |
2026-03-16 08:48:35.825734 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-16 08:48:35.825745 | aio | Monday 16 March 2026  08:48:35 +0000 (0:00:00.199)       0:04:19.553 **********
2026-03-16 08:48:36.267539 | aio | ok: [aio]
2026-03-16 08:48:36.267618 | aio |
2026-03-16 08:48:36.267718 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-16 08:48:36.267846 | aio | Monday 16 March 2026  08:48:36 +0000 (0:00:00.442)       0:04:19.995 **********
2026-03-16 08:48:36.811969 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-16 08:48:36.812047 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-16 08:48:36.812164 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-16 08:48:36.812278 | aio |
2026-03-16 08:48:36.812418 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-16 08:48:36.812649 | aio | Monday 16 March 2026  08:48:36 +0000 (0:00:00.544)       0:04:20.540 **********
2026-03-16 08:48:37.233620 | aio | ok: [aio]
2026-03-16 08:48:37.233680 | aio |
2026-03-16 08:48:37.233793 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-16 08:48:37.233884 | aio | Monday 16 March 2026  08:48:37 +0000 (0:00:00.421)       0:04:20.962 **********
2026-03-16 08:48:37.665675 | aio | ok: [aio]
2026-03-16 08:48:37.665746 | aio |
2026-03-16 08:48:37.665798 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-16 08:48:37.665905 | aio | Monday 16 March 2026  08:48:37 +0000 (0:00:00.426)       0:04:21.388 **********
2026-03-16 08:48:37.665989 | aio |
2026-03-16 08:48:37.666088 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-16 08:48:37.666177 | aio | Monday 16 March 2026  08:48:37 +0000 (0:00:00.005)       0:04:21.394 **********
2026-03-16 08:48:38.017882 | aio | ok: [aio]
2026-03-16 08:48:38.017981 | aio |
2026-03-16 08:48:38.017994 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-16 08:48:38.018103 | aio | Monday 16 March 2026  08:48:38 +0000 (0:00:00.351)       0:04:21.746 **********
2026-03-16 08:48:38.065945 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-16 08:48:38.066021 | aio |
2026-03-16 08:48:38.066187 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-16 08:48:38.066310 | aio | Monday 16 March 2026  08:48:38 +0000 (0:00:00.048)       0:04:21.794 **********
2026-03-16 08:48:39.389593 | aio | ok: [aio]
2026-03-16 08:48:39.389901 | aio |
2026-03-16 08:48:39.389915 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-16 08:48:39.389926 | aio | Monday 16 March 2026  08:48:39 +0000 (0:00:01.323)       0:04:23.118 **********
2026-03-16 08:48:40.027179 | aio | ok: [aio] => (item=chronyd)
2026-03-16 08:48:40.027261 | aio | ok: [aio] => (item=sshd)
2026-03-16 08:48:40.027311 | aio |
2026-03-16 08:48:40.027407 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-16 08:48:40.027502 | aio | Monday 16 March 2026  08:48:40 +0000 (0:00:00.637)       0:04:23.755 **********
2026-03-16 08:48:40.306351 | aio | ok: [aio]
2026-03-16 08:48:40.306471 | aio |
2026-03-16 08:48:40.306624 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-16 08:48:40.306771 | aio | Monday 16 March 2026  08:48:40 +0000 (0:00:00.279)       0:04:24.035 **********
2026-03-16 08:48:40.500536 | aio | ok: [aio]
2026-03-16 08:48:40.500622 | aio |
2026-03-16 08:48:40.500685 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-16 08:48:40.500781 | aio | Monday 16 March 2026  08:48:40 +0000 (0:00:00.194)       0:04:24.229 **********
2026-03-16 08:48:40.745810 | aio | ok: [aio]
2026-03-16 08:48:40.745892 | aio |
2026-03-16 08:48:40.746036 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-16 08:48:40.746175 | aio | Monday 16 March 2026  08:48:40 +0000 (0:00:00.245)       0:04:24.474 **********
2026-03-16 08:48:40.938053 | aio | ok: [aio]
2026-03-16 08:48:40.938092 | aio |
2026-03-16 08:48:40.938195 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-16 08:48:40.938288 | aio | Monday 16 March 2026  08:48:40 +0000 (0:00:00.192)       0:04:24.666 **********
2026-03-16 08:48:41.147467 | aio | ok: [aio] => (item=aio)
2026-03-16 08:48:41.147535 | aio |
2026-03-16 08:48:41.147616 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-16 08:48:41.147711 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.209)       0:04:24.876 **********
2026-03-16 08:48:41.187680 | aio | ok: [aio]
2026-03-16 08:48:41.187881 | aio |
2026-03-16 08:48:41.188106 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:48:41.188325 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.040)       0:04:24.916 **********
2026-03-16 08:48:41.242477 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:48:41.242668 | aio |
2026-03-16 08:48:41.242927 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:48:41.243142 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.054)       0:04:24.971 **********
2026-03-16 08:48:41.282442 | aio | skipping: [aio]
2026-03-16 08:48:41.282638 | aio |
2026-03-16 08:48:41.282894 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:48:41.283100 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.039)       0:04:25.011 **********
2026-03-16 08:48:41.322329 | aio | skipping: [aio] => (item=aio)
2026-03-16 08:48:41.322548 | aio | skipping: [aio]
2026-03-16 08:48:41.322749 | aio |
2026-03-16 08:48:41.323008 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:48:41.323254 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.039)       0:04:25.051 **********
2026-03-16 08:48:41.576400 | aio | ok: [aio]
2026-03-16 08:48:41.577447 | aio |
2026-03-16 08:48:41.577682 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:48:41.577889 | aio | Monday 16 March 2026  08:48:41 +0000 (0:00:00.253)       0:04:25.304 **********
2026-03-16 08:48:54.838599 | aio | ok: [aio]
2026-03-16 08:48:54.838859 | aio |
2026-03-16 08:48:54.838873 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-16 08:48:54.838884 | aio | Monday 16 March 2026  08:48:54 +0000 (0:00:13.261)       0:04:38.566 **********
2026-03-16 08:49:00.045233 | aio | ok: [aio]
2026-03-16 08:49:00.045309 | aio |
2026-03-16 08:49:00.045368 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-16 08:49:00.045505 | aio | Monday 16 March 2026  08:49:00 +0000 (0:00:05.207)       0:04:43.773 **********
2026-03-16 08:49:14.412192 | aio | ok: [aio]
2026-03-16 08:49:14.412274 | aio |
2026-03-16 08:49:14.412581 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-16 08:49:14.412639 | aio | Monday 16 March 2026  08:49:14 +0000 (0:00:14.366)       0:04:58.140 **********
2026-03-16 08:50:53.796581 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-16 08:50:53.796695 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-16 08:50:53.796833 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-16 08:50:53.796944 | aio |
2026-03-16 08:50:53.797068 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-16 08:50:53.797203 | aio | Monday 16 March 2026  08:50:53 +0000 (0:01:39.384)       0:06:37.525 **********
2026-03-16 08:50:59.831314 | aio | ok: [aio]
2026-03-16 08:50:59.831409 | aio |
2026-03-16 08:50:59.831732 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-16 08:50:59.831801 | aio | Monday 16 March 2026  08:50:59 +0000 (0:00:06.034)       0:06:43.559 **********
2026-03-16 08:51:06.092283 | aio | ok: [aio]
2026-03-16 08:51:06.092384 | aio |
2026-03-16 08:51:06.092400 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-16 08:51:06.092566 | aio | Monday 16 March 2026  08:51:06 +0000 (0:00:06.261)       0:06:49.821 **********
2026-03-16 08:51:06.143042 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-16 08:51:06.143086 | aio |
2026-03-16 08:51:06.143333 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-16 08:51:06.143426 | aio | Monday 16 March 2026  08:51:06 +0000 (0:00:00.050)       0:06:49.871 **********
2026-03-16 08:51:06.184134 | aio | ok: [aio]
2026-03-16 08:51:06.184225 | aio |
2026-03-16 08:51:06.184483 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-16 08:51:06.184555 | aio | Monday 16 March 2026  08:51:06 +0000 (0:00:00.040)       0:06:49.912 **********
2026-03-16 08:51:12.395925 | aio | ok: [aio]
2026-03-16 08:51:12.396022 | aio |
2026-03-16 08:51:12.396084 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-16 08:51:12.396226 | aio | Monday 16 March 2026  08:51:12 +0000 (0:00:06.212)       0:06:56.124 **********
2026-03-16 08:51:12.440315 | aio | ok: [aio]
2026-03-16 08:51:12.440365 | aio |
2026-03-16 08:51:12.440623 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-16 08:51:12.440674 | aio | Monday 16 March 2026  08:51:12 +0000 (0:00:00.044)       0:06:56.169 **********
2026-03-16 08:51:12.476003 | aio | skipping: [aio] => (item=1)
2026-03-16 08:51:12.476103 | aio | skipping: [aio] => (item=1)
2026-03-16 08:51:12.476576 | aio | skipping: [aio] => (item=1)
2026-03-16 08:51:12.476614 | aio | skipping: [aio]
2026-03-16 08:51:12.476620 | aio |
2026-03-16 08:51:12.476625 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-16 08:51:12.476631 | aio | Monday 16 March 2026  08:51:12 +0000 (0:00:00.035)       0:06:56.204 **********
2026-03-16 08:51:12.512653 | aio | skipping: [aio]
2026-03-16 08:51:12.512944 | aio |
2026-03-16 08:51:12.513043 | aio | PLAY RECAP *********************************************************************
2026-03-16 08:51:12.513539 | aio | aio                        : ok=106  changed=29   unreachable=0    failed=0    skipped=18   rescued=0    ignored=0
2026-03-16 08:51:12.513570 | aio |
2026-03-16 08:51:12.513818 | aio |
2026-03-16 08:51:12.513838 | aio | TASKS RECAP ********************************************************************
2026-03-16 08:51:12.514071 | aio | Monday 16 March 2026  08:51:12 +0000 (0:00:00.035)       0:06:56.240 **********
2026-03-16 08:51:12.514272 | aio | ===============================================================================
2026-03-16 08:51:12.515507 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 131.07s
2026-03-16 08:51:12.515531 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 99.38s
2026-03-16 08:51:12.515544 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.37s
2026-03-16 08:51:12.515553 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.30s
2026-03-16 08:51:12.515563 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.26s
2026-03-16 08:51:12.515573 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.54s
2026-03-16 08:51:12.515762 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.07s
2026-03-16 08:51:12.516116 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.85s
2026-03-16 08:51:12.516387 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.42s
2026-03-16 08:51:12.516652 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.67s
2026-03-16 08:51:12.516922 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.57s
2026-03-16 08:51:12.517186 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.51s
2026-03-16 08:51:12.517453 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.26s
2026-03-16 08:51:12.517712 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.21s
2026-03-16 08:51:12.517976 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.19s
2026-03-16 08:51:12.518237 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.03s
2026-03-16 08:51:12.518524 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.27s
2026-03-16 08:51:12.518792 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.21s
2026-03-16 08:51:12.519053 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.43s
2026-03-16 08:51:12.519348 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s
2026-03-16 08:51:12.675326 | aio | INFO     [default > converge] Executed: Successful
2026-03-16 08:51:12.685226 | aio | INFO     [default > idempotence] Executing
2026-03-16 08:51:13.511846 | aio |
2026-03-16 08:51:13.511916 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-16 08:51:13.511924 | aio |
2026-03-16 08:51:13.512077 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:51:13.512093 | aio | Monday 16 March 2026  08:51:13 +0000 (0:00:00.047)       0:00:00.047 **********
2026-03-16 08:51:14.665176 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-16 08:51:14.665236 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-16 08:51:14.665248 | aio | interpreter could change the meaning of that path. See
2026-03-16 08:51:14.665258 | aio | https://docs.ansible.com/ansible-
2026-03-16 08:51:14.665288 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-16 08:51:14.677920 | aio | ok: [aio]
2026-03-16 08:51:14.677950 | aio |
2026-03-16 08:51:14.677961 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:51:14.677970 | aio | Monday 16 March 2026  08:51:14 +0000 (0:00:01.166)       0:00:01.213 **********
2026-03-16 08:51:14.956951 | aio | ok: [aio]
2026-03-16 08:51:14.957037 | aio |
2026-03-16 08:51:14.957056 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:51:14.957290 | aio | Monday 16 March 2026  08:51:14 +0000 (0:00:00.279)       0:00:01.492 **********
2026-03-16 08:51:14.994877 | aio | skipping: [aio]
2026-03-16 08:51:14.995051 | aio |
2026-03-16 08:51:14.995433 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-16 08:51:14.995640 | aio | Monday 16 March 2026  08:51:14 +0000 (0:00:00.038)       0:00:01.530 **********
2026-03-16 08:51:15.301900 | aio | ok: [aio]
2026-03-16 08:51:15.302061 | aio |
2026-03-16 08:51:15.302272 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:51:15.302469 | aio | Monday 16 March 2026  08:51:15 +0000 (0:00:00.306)       0:00:01.837 **********
2026-03-16 08:51:15.369135 | aio | ok: [aio] => {
2026-03-16 08:51:15.369379 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-16 08:51:15.369589 | aio | }
2026-03-16 08:51:15.369768 | aio |
2026-03-16 08:51:15.369972 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:51:15.370175 | aio | Monday 16 March 2026  08:51:15 +0000 (0:00:00.067)       0:00:01.905 **********
2026-03-16 08:51:15.770635 | aio | ok: [aio]
2026-03-16 08:51:15.770771 | aio |
2026-03-16 08:51:15.771000 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:51:15.771244 | aio | Monday 16 March 2026  08:51:15 +0000 (0:00:00.401)       0:00:02.306 **********
2026-03-16 08:51:15.810372 | aio | skipping: [aio]
2026-03-16 08:51:15.810499 | aio |
2026-03-16 08:51:15.810704 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:51:15.810898 | aio | Monday 16 March 2026  08:51:15 +0000 (0:00:00.040)       0:00:02.346 **********
2026-03-16 08:51:15.849826 | aio | skipping: [aio]
2026-03-16 08:51:15.850011 | aio |
2026-03-16 08:51:15.850216 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:51:15.850417 | aio | Monday 16 March 2026  08:51:15 +0000 (0:00:00.039)       0:00:02.385 **********
2026-03-16 08:51:16.047100 | aio | ok: [aio]
2026-03-16 08:51:16.047305 | aio |
2026-03-16 08:51:16.047527 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:51:16.047736 | aio | Monday 16 March 2026  08:51:16 +0000 (0:00:00.197)       0:00:02.583 **********
2026-03-16 08:51:17.108363 | aio | ok: [aio]
2026-03-16 08:51:17.108523 | aio |
2026-03-16 08:51:17.108741 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:51:17.108948 | aio | Monday 16 March 2026  08:51:17 +0000 (0:00:01.061)       0:00:03.644 **********
2026-03-16 08:51:17.179887 | aio | ok: [aio] => {
2026-03-16 08:51:17.180058 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-16 08:51:17.180247 | aio | }
2026-03-16 08:51:17.180422 | aio |
2026-03-16 08:51:17.180625 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:51:17.180822 | aio | Monday 16 March 2026  08:51:17 +0000 (0:00:00.071)       0:00:03.716 **********
2026-03-16 08:51:17.520573 | aio | ok: [aio]
2026-03-16 08:51:17.520700 | aio |
2026-03-16 08:51:17.520959 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:51:17.521168 | aio | Monday 16 March 2026  08:51:17 +0000 (0:00:00.340)       0:00:04.056 **********
2026-03-16 08:51:19.670091 | aio | ok: [aio]
2026-03-16 08:51:19.670164 | aio |
2026-03-16 08:51:19.670176 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-16 08:51:19.670207 | aio | Monday 16 March 2026  08:51:19 +0000 (0:00:02.148)       0:00:06.205 **********
2026-03-16 08:51:19.698573 | aio | skipping: [aio]
2026-03-16 08:51:19.698987 | aio |
2026-03-16 08:51:19.699061 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-16 08:51:19.699069 | aio | Monday 16 March 2026  08:51:19 +0000 (0:00:00.029)       0:00:06.234 **********
2026-03-16 08:51:19.728044 | aio | skipping: [aio]
2026-03-16 08:51:19.728117 | aio |
2026-03-16 08:51:19.728178 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-16 08:51:19.728284 | aio | Monday 16 March 2026  08:51:19 +0000 (0:00:00.029)       0:00:06.264 **********
2026-03-16 08:51:19.758217 | aio | skipping: [aio]
2026-03-16 08:51:19.758249 | aio |
2026-03-16 08:51:19.758482 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-16 08:51:19.758533 | aio | Monday 16 March 2026  08:51:19 +0000 (0:00:00.029)       0:00:06.294 **********
2026-03-16 08:51:20.711837 | aio | ok: [aio]
2026-03-16 08:51:20.711931 | aio |
2026-03-16 08:51:20.711946 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-16 08:51:20.712094 | aio | Monday 16 March 2026  08:51:20 +0000 (0:00:00.953)       0:00:07.247 **********
2026-03-16 08:51:21.133194 | aio | ok: [aio]
2026-03-16 08:51:21.133271 | aio |
2026-03-16 08:51:21.133442 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-16 08:51:21.133459 | aio | Monday 16 March 2026  08:51:21 +0000 (0:00:00.421)       0:00:07.669 **********
2026-03-16 08:51:22.023316 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-16 08:51:22.023406 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-16 08:51:22.023465 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-16 08:51:22.023953 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-16 08:51:22.024177 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-16 08:51:22.024184 | aio |
2026-03-16 08:51:22.024189 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-16 08:51:22.024193 | aio | Monday 16 March 2026  08:51:22 +0000 (0:00:00.889)       0:00:08.559 **********
2026-03-16 08:51:22.488245 | aio | ok: [aio]
2026-03-16 08:51:22.488322 | aio |
2026-03-16 08:51:22.488766 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-16 08:51:22.488829 | aio | Monday 16 March 2026  08:51:22 +0000 (0:00:00.457)       0:00:09.017 **********
2026-03-16 08:51:22.488834 | aio |
2026-03-16 08:51:22.488839 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-16 08:51:22.488843 | aio | Monday 16 March 2026  08:51:22 +0000 (0:00:00.007)       0:00:09.024 **********
2026-03-16 08:51:23.049235 | aio | ok: [aio]
2026-03-16 08:51:23.049337 | aio |
2026-03-16 08:51:23.049359 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:51:23.049521 | aio | Monday 16 March 2026  08:51:23 +0000 (0:00:00.560)       0:00:09.585 **********
2026-03-16 08:51:23.257717 | aio | ok: [aio]
2026-03-16 08:51:23.257790 | aio |
2026-03-16 08:51:23.258016 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:51:23.258087 | aio | Monday 16 March 2026  08:51:23 +0000 (0:00:00.208)       0:00:09.793 **********
2026-03-16 08:51:23.330590 | aio | ok: [aio] => {
2026-03-16 08:51:23.330689 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-16 08:51:23.331217 | aio | }
2026-03-16 08:51:23.331258 | aio |
2026-03-16 08:51:23.331266 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:51:23.331274 | aio | Monday 16 March 2026  08:51:23 +0000 (0:00:00.072)       0:00:09.866 **********
2026-03-16 08:51:23.681851 | aio | ok: [aio]
2026-03-16 08:51:23.681950 | aio |
2026-03-16 08:51:23.682251 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:51:23.682323 | aio | Monday 16 March 2026  08:51:23 +0000 (0:00:00.351)       0:00:10.217 **********
2026-03-16 08:51:26.829775 | aio | ok: [aio]
2026-03-16 08:51:26.829856 | aio |
2026-03-16 08:51:26.829868 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-16 08:51:26.830004 | aio | Monday 16 March 2026  08:51:26 +0000 (0:00:03.148)       0:00:13.365 **********
2026-03-16 08:51:27.779419 | aio | ok: [aio]
2026-03-16 08:51:27.779492 | aio |
2026-03-16 08:51:27.779702 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-16 08:51:27.779763 | aio | Monday 16 March 2026  08:51:27 +0000 (0:00:00.949)       0:00:14.315 **********
2026-03-16 08:51:28.049056 | aio | ok: [aio]
2026-03-16 08:51:28.049139 | aio |
2026-03-16 08:51:28.049154 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-16 08:51:28.049304 | aio | Monday 16 March 2026  08:51:28 +0000 (0:00:00.269)       0:00:14.584 **********
2026-03-16 08:51:28.477009 | aio | ok: [aio]
2026-03-16 08:51:28.477096 | aio |
2026-03-16 08:51:28.477375 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-16 08:51:28.477442 | aio | Monday 16 March 2026  08:51:28 +0000 (0:00:00.427)       0:00:15.012 **********
2026-03-16 08:51:29.035960 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-16 08:51:29.036058 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-16 08:51:29.036124 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-16 08:51:29.036411 | aio |
2026-03-16 08:51:29.036465 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-16 08:51:29.036471 | aio | Monday 16 March 2026  08:51:29 +0000 (0:00:00.558)       0:00:15.571 **********
2026-03-16 08:51:29.438739 | aio | ok: [aio]
2026-03-16 08:51:29.438819 | aio |
2026-03-16 08:51:29.439179 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-16 08:51:29.439244 | aio | Monday 16 March 2026  08:51:29 +0000 (0:00:00.402)       0:00:15.974 **********
2026-03-16 08:51:29.891566 | aio | ok: [aio]
2026-03-16 08:51:29.891926 | aio |
2026-03-16 08:51:29.892010 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-16 08:51:29.892033 | aio | Monday 16 March 2026  08:51:29 +0000 (0:00:00.444)       0:00:16.419 **********
2026-03-16 08:51:29.892412 | aio |
2026-03-16 08:51:29.892441 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-16 08:51:29.892450 | aio | Monday 16 March 2026  08:51:29 +0000 (0:00:00.008)       0:00:16.427 **********
2026-03-16 08:51:30.264252 | aio | ok: [aio]
2026-03-16 08:51:30.264328 | aio |
2026-03-16 08:51:30.264521 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-16 08:51:30.264571 | aio | Monday 16 March 2026  08:51:30 +0000 (0:00:00.372)       0:00:16.800 **********
2026-03-16 08:51:30.305577 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-16 08:51:30.305893 | aio |
2026-03-16 08:51:30.305953 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-16 08:51:30.305959 | aio | Monday 16 March 2026  08:51:30 +0000 (0:00:00.041)       0:00:16.841 **********
2026-03-16 08:51:31.276226 | aio | ok: [aio]
2026-03-16 08:51:31.276300 | aio |
2026-03-16 08:51:31.276509 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-16 08:51:31.276526 | aio | Monday 16 March 2026  08:51:31 +0000 (0:00:00.969)       0:00:17.811 **********
2026-03-16 08:51:31.914276 | aio | ok: [aio] => (item=chronyd)
2026-03-16 08:51:31.914365 | aio | ok: [aio] => (item=sshd)
2026-03-16 08:51:31.914372 | aio |
2026-03-16 08:51:31.914379 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-16 08:51:31.914387 | aio | Monday 16 March 2026  08:51:31 +0000 (0:00:00.637)       0:00:18.449 **********
2026-03-16 08:51:32.201678 | aio | ok: [aio]
2026-03-16 08:51:32.201786 | aio |
2026-03-16 08:51:32.201799 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-16 08:51:32.201896 | aio | Monday 16 March 2026  08:51:32 +0000 (0:00:00.288)       0:00:18.737 **********
2026-03-16 08:51:32.410379 | aio | ok: [aio]
2026-03-16 08:51:32.410449 | aio |
2026-03-16 08:51:32.410456 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-16 08:51:32.410462 | aio | Monday 16 March 2026  08:51:32 +0000 (0:00:00.208)       0:00:18.945 **********
2026-03-16 08:51:32.821336 | aio | ok: [aio]
2026-03-16 08:51:32.821408 | aio |
2026-03-16 08:51:32.821616 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-16 08:51:32.821668 | aio | Monday 16 March 2026  08:51:32 +0000 (0:00:00.411)       0:00:19.357 **********
2026-03-16 08:51:33.150511 | aio | ok: [aio]
2026-03-16 08:51:33.150585 | aio |
2026-03-16 08:51:33.150789 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-03-16 08:51:33.150834 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.329)       0:00:19.686 **********
2026-03-16 08:51:33.217896 | aio | ok: [aio]
2026-03-16 08:51:33.218183 | aio |
2026-03-16 08:51:33.218213 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-03-16 08:51:33.218219 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.067)       0:00:19.753 **********
2026-03-16 08:51:33.443782 | aio | ok: [aio] => (item=aio)
2026-03-16 08:51:33.443847 | aio |
2026-03-16 08:51:33.443955 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-03-16 08:51:33.444075 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.220)       0:00:19.974 **********
2026-03-16 08:51:33.480525 | aio | ok: [aio]
2026-03-16 08:51:33.480725 | aio |
2026-03-16 08:51:33.480953 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-03-16 08:51:33.481219 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.041)       0:00:20.016 **********
2026-03-16 08:51:33.516316 | aio | skipping: [aio]
2026-03-16 08:51:33.516500 | aio |
2026-03-16 08:51:33.516741 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:51:33.516949 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.035)       0:00:20.051 **********
2026-03-16 08:51:33.577036 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:51:33.577216 | aio |
2026-03-16 08:51:33.577419 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:51:33.577620 | aio | Monday 16 March 2026  08:51:33 +0000 (0:00:00.061)       0:00:20.113 **********
2026-03-16 08:51:39.854283 | aio | ok: [aio]
2026-03-16 08:51:39.854372 | aio |
2026-03-16 08:51:39.854503 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:51:39.854631 | aio | Monday 16 March 2026  08:51:39 +0000 (0:00:06.271)       0:00:26.385 **********
2026-03-16 08:51:39.901510 | aio | ok: [aio] => (item=aio)
2026-03-16 08:51:39.901652 | aio |
2026-03-16 08:51:39.901859 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:51:39.902057 | aio | Monday 16 March 2026  08:51:39 +0000 (0:00:00.052)       0:00:26.437 **********
2026-03-16 08:51:40.285013 | aio | ok: [aio]
2026-03-16 08:51:40.285188 | aio |
2026-03-16 08:51:40.285403 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:51:40.285599 | aio | Monday 16 March 2026  08:51:40 +0000 (0:00:00.383)       0:00:26.820 **********
2026-03-16 08:51:46.828261 | aio | ok: [aio]
2026-03-16 08:51:46.828332 | aio |
2026-03-16 08:51:46.828425 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-03-16 08:51:46.828522 | aio | Monday 16 March 2026  08:51:46 +0000 (0:00:06.543)       0:00:33.364 **********
2026-03-16 08:51:53.198296 | aio | ok: [aio]
2026-03-16 08:51:53.198372 | aio |
2026-03-16 08:51:53.198387 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-03-16 08:51:53.198567 | aio | Monday 16 March 2026  08:51:53 +0000 (0:00:06.369)       0:00:39.734 **********
2026-03-16 08:52:07.547314 | aio | ok: [aio]
2026-03-16 08:52:07.547465 | aio |
2026-03-16 08:52:07.547488 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:52:07.547538 | aio | Monday 16 March 2026  08:52:07 +0000 (0:00:14.349)       0:00:54.083 **********
2026-03-16 08:52:07.606353 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:52:07.606394 | aio |
2026-03-16 08:52:07.606630 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:52:07.606690 | aio | Monday 16 March 2026  08:52:07 +0000 (0:00:00.059)       0:00:54.142 **********
2026-03-16 08:52:07.656058 | aio | skipping: [aio]
2026-03-16 08:52:07.656368 | aio |
2026-03-16 08:52:07.656392 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:52:07.656399 | aio | Monday 16 March 2026  08:52:07 +0000 (0:00:00.049)       0:00:54.191 **********
2026-03-16 08:52:07.694559 | aio | skipping: [aio] => (item=aio)
2026-03-16 08:52:07.694599 | aio | skipping: [aio]
2026-03-16 08:52:07.694936 | aio |
2026-03-16 08:52:07.694995 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:52:07.695002 | aio | Monday 16 March 2026  08:52:07 +0000 (0:00:00.038)       0:00:54.230 **********
2026-03-16 08:52:07.948602 | aio | ok: [aio]
2026-03-16 08:52:07.948678 | aio |
2026-03-16 08:52:07.949057 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:52:07.949162 | aio | Monday 16 March 2026  08:52:07 +0000 (0:00:00.253)       0:00:54.483 **********
2026-03-16 08:52:14.520082 | aio | ok: [aio]
2026-03-16 08:52:14.520161 | aio |
2026-03-16 08:52:14.520168 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-03-16 08:52:14.520173 | aio | Monday 16 March 2026  08:52:14 +0000 (0:00:06.571)       0:01:01.055 **********
2026-03-16 08:52:20.698719 | aio | ok: [aio]
2026-03-16 08:52:20.698870 | aio |
2026-03-16 08:52:20.698884 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-03-16 08:52:20.698898 | aio | Monday 16 March 2026  08:52:20 +0000 (0:00:06.179)       0:01:07.234 **********
2026-03-16 08:52:26.915355 | aio | ok: [aio]
2026-03-16 08:52:26.915477 | aio |
2026-03-16 08:52:26.915485 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-03-16 08:52:26.915638 | aio | Monday 16 March 2026  08:52:26 +0000 (0:00:06.216)       0:01:13.451 **********
2026-03-16 08:52:34.980821 | aio | ok: [aio] => (item={'name': 'diskprediction_local'})
2026-03-16 08:52:34.980890 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-03-16 08:52:34.980971 | aio | ok: [aio] => (item={'name': 'prometheus'})
2026-03-16 08:52:34.981589 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-03-16 08:52:34.981851 | aio |
2026-03-16 08:52:34.981858 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-03-16 08:52:34.981863 | aio |
2026-03-16 08:52:34.981867 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:52:34.981872 | aio | Monday 16 March 2026  08:52:34 +0000 (0:00:08.065)       0:01:21.517 **********
2026-03-16 08:52:35.861573 | aio | ok: [aio]
2026-03-16 08:52:35.861677 | aio |
2026-03-16 08:52:35.861963 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:52:35.862199 | aio | Monday 16 March 2026  08:52:35 +0000 (0:00:00.879)       0:01:22.396 **********
2026-03-16 08:52:36.045181 | aio | ok: [aio]
2026-03-16 08:52:36.045270 | aio |
2026-03-16 08:52:36.045342 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:52:36.045471 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.184)       0:01:22.581 **********
2026-03-16 08:52:36.077508 | aio | skipping: [aio]
2026-03-16 08:52:36.077653 | aio |
2026-03-16 08:52:36.077882 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-16 08:52:36.078101 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.032)       0:01:22.613 **********
2026-03-16 08:52:36.278513 | aio | ok: [aio]
2026-03-16 08:52:36.278580 | aio |
2026-03-16 08:52:36.278614 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:52:36.278714 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.201)       0:01:22.814 **********
2026-03-16 08:52:36.344263 | aio | ok: [aio] => {
2026-03-16 08:52:36.344304 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-16 08:52:36.344408 | aio | }
2026-03-16 08:52:36.344495 | aio |
2026-03-16 08:52:36.344579 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:52:36.344669 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.065)       0:01:22.880 **********
2026-03-16 08:52:36.635034 | aio | ok: [aio]
2026-03-16 08:52:36.635109 | aio |
2026-03-16 08:52:36.635124 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:52:36.635255 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.290)       0:01:23.170 **********
2026-03-16 08:52:36.673663 | aio | skipping: [aio]
2026-03-16 08:52:36.673867 | aio |
2026-03-16 08:52:36.674087 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:52:36.674297 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.038)       0:01:23.209 **********
2026-03-16 08:52:36.713211 | aio | skipping: [aio]
2026-03-16 08:52:36.713404 | aio |
2026-03-16 08:52:36.713678 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:52:36.713892 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.039)       0:01:23.249 **********
2026-03-16 08:52:36.909146 | aio | ok: [aio]
2026-03-16 08:52:36.909270 | aio |
2026-03-16 08:52:36.909595 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-16 08:52:36.909780 | aio | Monday 16 March 2026  08:52:36 +0000 (0:00:00.195)       0:01:23.444 **********
2026-03-16 08:52:37.850851 | aio | ok: [aio]
2026-03-16 08:52:37.851259 | aio |
2026-03-16 08:52:37.851269 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:52:37.851276 | aio | Monday 16 March 2026  08:52:37 +0000 (0:00:00.940)       0:01:24.385 **********
2026-03-16 08:52:37.921768 | aio | ok: [aio] => {
2026-03-16 08:52:37.921839 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-16 08:52:37.921955 | aio | }
2026-03-16 08:52:37.922264 | aio |
2026-03-16 08:52:37.922324 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:52:37.922331 | aio | Monday 16 March 2026  08:52:37 +0000 (0:00:00.072)       0:01:24.457 **********
2026-03-16 08:52:38.251475 | aio | ok: [aio]
2026-03-16 08:52:38.251556 | aio |
2026-03-16 08:52:38.251860 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:52:38.251911 | aio | Monday 16 March 2026  08:52:38 +0000 (0:00:00.329)       0:01:24.787 **********
2026-03-16 08:52:40.191366 | aio | ok: [aio]
2026-03-16 08:52:40.191443 | aio |
2026-03-16 08:52:40.191778 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-16 08:52:40.191835 | aio | Monday 16 March 2026  08:52:40 +0000 (0:00:01.939)       0:01:26.727 **********
2026-03-16 08:52:40.221585 | aio | skipping: [aio]
2026-03-16 08:52:40.221956 | aio |
2026-03-16 08:52:40.221982 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-16 08:52:40.221990 | aio | Monday 16 March 2026  08:52:40 +0000 (0:00:00.030)       0:01:26.757 **********
2026-03-16 08:52:40.248495 | aio | skipping: [aio]
2026-03-16 08:52:40.248583 | aio |
2026-03-16 08:52:40.248811 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-16 08:52:40.248858 | aio | Monday 16 March 2026  08:52:40 +0000 (0:00:00.027)       0:01:26.784 **********
2026-03-16 08:52:40.271696 | aio | skipping: [aio]
2026-03-16 08:52:40.271763 | aio |
2026-03-16 08:52:40.271953 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-16 08:52:40.271990 | aio | Monday 16 March 2026  08:52:40 +0000 (0:00:00.023)       0:01:26.807 **********
2026-03-16 08:52:41.228177 | aio | ok: [aio]
2026-03-16 08:52:41.228288 | aio |
2026-03-16 08:52:41.228301 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-16 08:52:41.228363 | aio | Monday 16 March 2026  08:52:41 +0000 (0:00:00.956)       0:01:27.764 **********
2026-03-16 08:52:41.639562 | aio | ok: [aio]
2026-03-16 08:52:41.639660 | aio |
2026-03-16 08:52:41.639677 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-16 08:52:41.639821 | aio | Monday 16 March 2026  08:52:41 +0000 (0:00:00.411)       0:01:28.175 **********
2026-03-16 08:52:42.551934 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-03-16 08:52:42.552028 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-16 08:52:42.552045 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-16 08:52:42.552595 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-16 08:52:42.552654 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-16 08:52:42.552661 | aio |
2026-03-16 08:52:42.552667 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-16 08:52:42.552672 | aio | Monday 16 March 2026  08:52:42 +0000 (0:00:00.912)       0:01:29.087 **********
2026-03-16 08:52:43.042838 | aio | ok: [aio]
2026-03-16 08:52:43.042906 | aio |
2026-03-16 08:52:43.043243 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-16 08:52:43.043297 | aio | Monday 16 March 2026  08:52:43 +0000 (0:00:00.484)       0:01:29.572 **********
2026-03-16 08:52:43.043304 | aio |
2026-03-16 08:52:43.043324 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-16 08:52:43.043404 | aio | Monday 16 March 2026  08:52:43 +0000 (0:00:00.005)       0:01:29.578 **********
2026-03-16 08:52:43.389444 | aio | ok: [aio]
2026-03-16 08:52:43.389519 | aio |
2026-03-16 08:52:43.389713 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-16 08:52:43.389755 | aio | Monday 16 March 2026  08:52:43 +0000 (0:00:00.346)       0:01:29.925 **********
2026-03-16 08:52:43.589864 | aio | ok: [aio]
2026-03-16 08:52:43.589923 | aio |
2026-03-16 08:52:43.590026 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-16 08:52:43.590157 | aio | Monday 16 March 2026  08:52:43 +0000 (0:00:00.200)       0:01:30.125 **********
2026-03-16 08:52:43.658725 | aio | ok: [aio] => {
2026-03-16 08:52:43.659455 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-16 08:52:43.659544 | aio | }
2026-03-16 08:52:43.659552 | aio |
2026-03-16 08:52:43.659559 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-16 08:52:43.659566 | aio | Monday 16 March 2026  08:52:43 +0000 (0:00:00.068)       0:01:30.194 **********
2026-03-16 08:52:44.028218 | aio | ok: [aio]
2026-03-16 08:52:44.028329 | aio |
2026-03-16 08:52:44.028341 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-16 08:52:44.028489 | aio | Monday 16 March 2026  08:52:44 +0000 (0:00:00.370)       0:01:30.564 **********
2026-03-16 08:52:47.043945 | aio | ok: [aio]
2026-03-16 08:52:47.043997 | aio |
2026-03-16 08:52:47.044090 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-16 08:52:47.044223 | aio | Monday 16 March 2026  08:52:47 +0000 (0:00:03.015)       0:01:33.580 **********
2026-03-16 08:52:47.974983 | aio | ok: [aio]
2026-03-16 08:52:47.975062 | aio |
2026-03-16 08:52:47.975203 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-16 08:52:47.975225 | aio | Monday 16 March 2026  08:52:47 +0000 (0:00:00.931)       0:01:34.511 **********
2026-03-16 08:52:48.181669 | aio | ok: [aio]
2026-03-16 08:52:48.181743 | aio |
2026-03-16 08:52:48.182031 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-16 08:52:48.182079 | aio | Monday 16 March 2026  08:52:48 +0000 (0:00:00.206)       0:01:34.717 **********
2026-03-16 08:52:48.616658 | aio | ok: [aio]
2026-03-16 08:52:48.616714 | aio |
2026-03-16 08:52:48.616802 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-16 08:52:48.616904 | aio | Monday 16 March 2026  08:52:48 +0000 (0:00:00.435)       0:01:35.152 **********
2026-03-16 08:52:49.143239 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-03-16 08:52:49.143964 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-16 08:52:49.144016 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-16 08:52:49.144024 | aio |
2026-03-16 08:52:49.144031 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-16 08:52:49.144038 | aio | Monday 16 March 2026  08:52:49 +0000 (0:00:00.526)       0:01:35.679 **********
2026-03-16 08:52:49.539957 | aio | ok: [aio]
2026-03-16 08:52:49.540032 | aio |
2026-03-16 08:52:49.540255 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-16 08:52:49.540537 | aio | Monday 16 March 2026  08:52:49 +0000 (0:00:00.396)       0:01:36.076 **********
2026-03-16 08:52:49.946786 | aio | ok: [aio]
2026-03-16 08:52:49.946849 | aio |
2026-03-16 08:52:49.946969 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-16 08:52:49.947263 | aio | Monday 16 March 2026  08:52:49 +0000 (0:00:00.401)       0:01:36.477 **********
2026-03-16 08:52:49.947309 | aio |
2026-03-16 08:52:49.947329 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-16 08:52:49.947469 | aio | Monday 16 March 2026  08:52:49 +0000 (0:00:00.005)       0:01:36.482 **********
2026-03-16 08:52:50.288959 | aio | ok: [aio]
2026-03-16 08:52:50.289032 | aio |
2026-03-16 08:52:50.289116 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-16 08:52:50.289236 | aio | Monday 16 March 2026  08:52:50 +0000 (0:00:00.342)       0:01:36.825 **********
2026-03-16 08:52:50.333179 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-16 08:52:50.333249 | aio |
2026-03-16 08:52:50.333453 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-16 08:52:50.333479 | aio | Monday 16 March 2026  08:52:50 +0000 (0:00:00.043)       0:01:36.868 **********
2026-03-16 08:52:51.289164 | aio | ok: [aio]
2026-03-16 08:52:51.289237 | aio |
2026-03-16 08:52:51.289435 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-16 08:52:51.289590 | aio | Monday 16 March 2026  08:52:51 +0000 (0:00:00.956)       0:01:37.825 **********
2026-03-16 08:52:51.899627 | aio | ok: [aio] => (item=chronyd)
2026-03-16 08:52:51.899687 | aio | ok: [aio] => (item=sshd)
2026-03-16 08:52:51.900104 | aio |
2026-03-16 08:52:51.900145 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-16 08:52:51.900153 | aio | Monday 16 March 2026  08:52:51 +0000 (0:00:00.610)       0:01:38.435 **********
2026-03-16 08:52:52.171038 | aio | ok: [aio]
2026-03-16 08:52:52.171105 | aio |
2026-03-16 08:52:52.171215 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-03-16 08:52:52.171355 | aio | Monday 16 March 2026  08:52:52 +0000 (0:00:00.271)       0:01:38.707 **********
2026-03-16 08:52:52.358934 | aio | ok: [aio]
2026-03-16 08:52:52.358998 | aio |
2026-03-16 08:52:52.359074 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-03-16 08:52:52.359220 | aio | Monday 16 March 2026  08:52:52 +0000 (0:00:00.187)       0:01:38.895 **********
2026-03-16 08:52:52.586045 | aio | ok: [aio]
2026-03-16 08:52:52.586092 | aio |
2026-03-16 08:52:52.586098 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-03-16 08:52:52.586102 | aio | Monday 16 March 2026  08:52:52 +0000 (0:00:00.226)       0:01:39.121 **********
2026-03-16 08:52:52.772621 | aio | ok: [aio]
2026-03-16 08:52:52.772694 | aio |
2026-03-16 08:52:52.772772 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-03-16 08:52:52.772906 | aio | Monday 16 March 2026  08:52:52 +0000 (0:00:00.187)       0:01:39.308 **********
2026-03-16 08:52:52.984789 | aio | ok: [aio] => (item=aio)
2026-03-16 08:52:52.984852 | aio |
2026-03-16 08:52:52.985067 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-03-16 08:52:52.985113 | aio | Monday 16 March 2026  08:52:52 +0000 (0:00:00.212)       0:01:39.520 **********
2026-03-16 08:52:53.026092 | aio | ok: [aio]
2026-03-16 08:52:53.026177 | aio |
2026-03-16 08:52:53.026387 | aio | TASK [Install Ceph host] *******************************************************
2026-03-16 08:52:53.026411 | aio | Monday 16 March 2026  08:52:53 +0000 (0:00:00.041)       0:01:39.562 **********
2026-03-16 08:52:53.077652 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-03-16 08:52:53.077738 | aio |
2026-03-16 08:52:53.077849 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-03-16 08:52:53.077958 | aio | Monday 16 March 2026  08:52:53 +0000 (0:00:00.051)       0:01:39.613 **********
2026-03-16 08:52:53.114377 | aio | skipping: [aio]
2026-03-16 08:52:53.114499 | aio |
2026-03-16 08:52:53.114798 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-03-16 08:52:53.114832 | aio | Monday 16 March 2026  08:52:53 +0000 (0:00:00.036)       0:01:39.650 **********
2026-03-16 08:52:53.149741 | aio | skipping: [aio] => (item=aio)
2026-03-16 08:52:53.149846 | aio | skipping: [aio]
2026-03-16 08:52:53.150157 | aio |
2026-03-16 08:52:53.150205 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-03-16 08:52:53.150211 | aio | Monday 16 March 2026  08:52:53 +0000 (0:00:00.035)       0:01:39.685 **********
2026-03-16 08:52:53.380462 | aio | ok: [aio]
2026-03-16 08:52:53.380530 | aio |
2026-03-16 08:52:53.380718 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-03-16 08:52:53.380761 | aio | Monday 16 March 2026  08:52:53 +0000 (0:00:00.230)       0:01:39.916 **********
2026-03-16 08:52:59.845382 | aio | ok: [aio]
2026-03-16 08:52:59.845447 | aio |
2026-03-16 08:52:59.845529 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-03-16 08:52:59.845625 | aio | Monday 16 March 2026  08:52:59 +0000 (0:00:06.464)       0:01:46.381 **********
2026-03-16 08:53:05.257806 | aio | ok: [aio]
2026-03-16 08:53:05.257875 | aio |
2026-03-16 08:53:05.258165 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-03-16 08:53:05.258212 | aio | Monday 16 March 2026  08:53:05 +0000 (0:00:05.412)       0:01:51.793 **********
2026-03-16 08:53:19.585024 | aio | ok: [aio]
2026-03-16 08:53:19.585066 | aio |
2026-03-16 08:53:19.585071 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-03-16 08:53:19.585076 | aio | Monday 16 March 2026  08:53:19 +0000 (0:00:14.327)       0:02:06.120 **********
2026-03-16 08:53:19.648175 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-03-16 08:53:19.648230 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-03-16 08:53:19.648713 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-03-16 08:53:19.648759 | aio | skipping: [aio]
2026-03-16 08:53:19.648765 | aio |
2026-03-16 08:53:19.648770 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-03-16 08:53:19.648775 | aio | Monday 16 March 2026  08:53:19 +0000 (0:00:00.063)       0:02:06.184 **********
2026-03-16 08:53:25.842780 | aio | ok: [aio]
2026-03-16 08:53:25.842851 | aio |
2026-03-16 08:53:25.843188 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-03-16 08:53:25.843242 | aio | Monday 16 March 2026  08:53:25 +0000 (0:00:06.194)       0:02:12.378 **********
2026-03-16 08:53:32.012681 | aio | ok: [aio]
2026-03-16 08:53:32.012748 | aio |
2026-03-16 08:53:32.012830 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-03-16 08:53:32.012988 | aio | Monday 16 March 2026  08:53:32 +0000 (0:00:06.170)       0:02:18.548 **********
2026-03-16 08:53:32.062216 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-03-16 08:53:32.062282 | aio |
2026-03-16 08:53:32.062477 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-03-16 08:53:32.062505 | aio | Monday 16 March 2026  08:53:32 +0000 (0:00:00.049)       0:02:18.598 **********
2026-03-16 08:53:32.104043 | aio | ok: [aio]
2026-03-16 08:53:32.104114 | aio |
2026-03-16 08:53:32.104322 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-03-16 08:53:32.104352 | aio | Monday 16 March 2026  08:53:32 +0000 (0:00:00.041)       0:02:18.640 **********
2026-03-16 08:53:38.299533 | aio | ok: [aio]
2026-03-16 08:53:38.299605 | aio |
2026-03-16 08:53:38.299924 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-03-16 08:53:38.299971 | aio | Monday 16 March 2026  08:53:38 +0000 (0:00:06.195)       0:02:24.835 **********
2026-03-16 08:53:38.339236 | aio | ok: [aio]
2026-03-16 08:53:38.339591 | aio |
2026-03-16 08:53:38.339672 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-03-16 08:53:38.339679 | aio | Monday 16 March 2026  08:53:38 +0000 (0:00:00.039)       0:02:24.874 **********
2026-03-16 08:53:38.385505 | aio | skipping: [aio] => (item=1)
2026-03-16 08:53:38.385535 | aio | skipping: [aio] => (item=1)
2026-03-16 08:53:38.385542 | aio | skipping: [aio] => (item=1)
2026-03-16 08:53:38.385548 | aio | skipping: [aio]
2026-03-16 08:53:38.385554 | aio |
2026-03-16 08:53:38.385560 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-03-16 08:53:38.385566 | aio | Monday 16 March 2026  08:53:38 +0000 (0:00:00.045)       0:02:24.920 **********
2026-03-16 08:53:38.415212 | aio | skipping: [aio]
2026-03-16 08:53:38.415240 | aio |
2026-03-16 08:53:38.415248 | aio | PLAY RECAP *********************************************************************
2026-03-16 08:53:38.415256 | aio | aio                        : ok=95   changed=0    unreachable=0    failed=0    skipped=20   rescued=0    ignored=0
2026-03-16 08:53:38.415262 | aio |
2026-03-16 08:53:38.415267 | aio |
2026-03-16 08:53:38.415273 | aio | TASKS RECAP ********************************************************************
2026-03-16 08:53:38.415279 | aio | Monday 16 March 2026  08:53:38 +0000 (0:00:00.028)       0:02:24.949 **********
2026-03-16 08:53:38.415285 | aio | ===============================================================================
2026-03-16 08:53:38.415291 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.35s
2026-03-16 08:53:38.415296 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.33s
2026-03-16 08:53:38.415302 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.07s
2026-03-16 08:53:38.415308 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.57s
2026-03-16 08:53:38.415313 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.54s
2026-03-16 08:53:38.415319 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.46s
2026-03-16 08:53:38.415325 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.37s
2026-03-16 08:53:38.415330 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.27s
2026-03-16 08:53:38.415336 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.22s
2026-03-16 08:53:38.415341 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.20s
2026-03-16 08:53:38.415347 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.19s
2026-03-16 08:53:38.415353 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.18s
2026-03-16 08:53:38.415358 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.17s
2026-03-16 08:53:38.415364 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.41s
2026-03-16 08:53:38.415369 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s
2026-03-16 08:53:38.415374 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.02s
2026-03-16 08:53:38.415380 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.15s
2026-03-16 08:53:38.415390 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.94s
2026-03-16 08:53:38.415396 | aio | Gathering Facts --------------------------------------------------------- 1.17s
2026-03-16 08:53:38.415518 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.06s
2026-03-16 08:53:38.542563 | aio | INFO     [default > idempotence] Executed: Successful
2026-03-16 08:53:38.548624 | aio | INFO     [default > side_effect] Executing
2026-03-16 08:53:38.548945 | aio | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-16 08:53:38.554234 | aio | INFO     [default > verify] Executing
2026-03-16 08:53:39.151360 | aio |
2026-03-16 08:53:39.151582 | aio | PLAY [Verify] ******************************************************************
2026-03-16 08:53:39.151731 | aio |
2026-03-16 08:53:39.151978 | aio | TASK [Gathering Facts] *********************************************************
2026-03-16 08:53:39.152167 | aio | Monday 16 March 2026  08:53:39 +0000 (0:00:00.006)       0:00:00.006 **********
2026-03-16 08:53:40.318973 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-03-16 08:53:40.319141 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-16 08:53:40.319404 | aio | interpreter could change the meaning of that path. See
2026-03-16 08:53:40.319605 | aio | https://docs.ansible.com/ansible-
2026-03-16 08:53:40.319821 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-16 08:53:40.328597 | aio | ok: [aio]
2026-03-16 08:53:40.328817 | aio |
2026-03-16 08:53:40.329010 | aio | TASK [Get cluster health status] ***********************************************
2026-03-16 08:53:40.329209 | aio | Monday 16 March 2026  08:53:40 +0000 (0:00:01.177)       0:00:01.184 **********
2026-03-16 08:53:50.779678 | aio | ok: [aio]
2026-03-16 08:53:50.779728 | aio |
2026-03-16 08:53:50.779830 | aio | TASK [Print cluster health status] *********************************************
2026-03-16 08:53:50.779920 | aio | Monday 16 March 2026  08:53:50 +0000 (0:00:10.451)       0:00:11.635 **********
2026-03-16 08:53:50.801417 | aio | ok: [aio] => {
2026-03-16 08:53:50.801512 | aio |     "_ceph_health": {
2026-03-16 08:53:50.801602 | aio |         "changed": false,
2026-03-16 08:53:50.801690 | aio |         "cmd": [
2026-03-16 08:53:50.801778 | aio |             "cephadm",
2026-03-16 08:53:50.801865 | aio |             "shell",
2026-03-16 08:53:50.801950 | aio |             "--",
2026-03-16 08:53:50.802035 | aio |             "ceph",
2026-03-16 08:53:50.802120 | aio |             "health"
2026-03-16 08:53:50.802205 | aio |         ],
2026-03-16 08:53:50.802292 | aio |         "delta": "0:00:10.158999",
2026-03-16 08:53:50.802382 | aio |         "end": "2026-03-16 08:53:50.742378",
2026-03-16 08:53:50.802469 | aio |         "failed": false,
2026-03-16 08:53:50.802555 | aio |         "msg": "",
2026-03-16 08:53:50.802641 | aio |         "rc": 0,
2026-03-16 08:53:50.802731 | aio |         "start": "2026-03-16 08:53:40.583379",
2026-03-16 08:53:50.802852 | aio |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config",
2026-03-16 08:53:50.802921 | aio |         "stderr_lines": [
2026-03-16 08:53:50.803018 | aio |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-03-16 08:53:50.803131 | aio |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config"
2026-03-16 08:53:50.803242 | aio |         ],
2026-03-16 08:53:50.803329 | aio |         "stdout": "HEALTH_OK",
2026-03-16 08:53:50.803415 | aio |         "stdout_lines": [
2026-03-16 08:53:50.803501 | aio |             "HEALTH_OK"
2026-03-16 08:53:50.803586 | aio |         ]
2026-03-16 08:53:50.803679 | aio |     }
2026-03-16 08:53:50.803760 | aio | }
2026-03-16 08:53:50.803840 | aio |
2026-03-16 08:53:50.803926 | aio | TASK [Assert that the cluster status is healthy] *******************************
2026-03-16 08:53:50.804015 | aio | Monday 16 March 2026  08:53:50 +0000 (0:00:00.021)       0:00:11.657 **********
2026-03-16 08:53:50.828523 | aio | ok: [aio] => {
2026-03-16 08:53:50.828809 | aio |     "changed": false,
2026-03-16 08:53:50.829069 | aio |     "msg": "All assertions passed"
2026-03-16 08:53:50.829331 | aio | }
2026-03-16 08:53:50.829532 | aio |
2026-03-16 08:53:50.829737 | aio | TASK [Create a test Ceph pool] *************************************************
2026-03-16 08:53:50.830069 | aio | Monday 16 March 2026  08:53:50 +0000 (0:00:00.026)       0:00:11.684 **********
2026-03-16 08:53:58.006451 | aio | changed: [aio]
2026-03-16 08:53:58.006544 | aio |
2026-03-16 08:53:58.006676 | aio | TASK [Create a test Ceph key] **************************************************
2026-03-16 08:53:58.006800 | aio | Monday 16 March 2026  08:53:58 +0000 (0:00:07.177)       0:00:18.861 **********
2026-03-16 08:54:00.536347 | aio | changed: [aio]
2026-03-16 08:54:00.536677 | aio |
2026-03-16 08:54:00.536711 | aio | TASK [Retrieve info for the test Ceph key] *************************************
2026-03-16 08:54:00.536722 | aio | Monday 16 March 2026  08:54:00 +0000 (0:00:02.529)       0:00:21.390 **********
2026-03-16 08:54:01.733193 | aio | ok: [aio]
2026-03-16 08:54:01.733245 | aio |
2026-03-16 08:54:01.733253 | aio | TASK [Assert that key_info returns the correct key] ****************************
2026-03-16 08:54:01.733259 | aio | Monday 16 March 2026  08:54:01 +0000 (0:00:01.197)       0:00:22.588 **********
2026-03-16 08:54:01.767332 | aio | ok: [aio] => {
2026-03-16 08:54:01.767405 | aio |     "changed": false,
2026-03-16 08:54:01.767418 | aio |     "msg": "All assertions passed"
2026-03-16 08:54:01.767429 | aio | }
2026-03-16 08:54:01.767439 | aio |
2026-03-16 08:54:01.767450 | aio | PLAY RECAP *********************************************************************
2026-03-16 08:54:01.767460 | aio | aio                        : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-16 08:54:01.767477 | aio |
2026-03-16 08:54:01.767618 | aio |
2026-03-16 08:54:01.767803 | aio | TASKS RECAP ********************************************************************
2026-03-16 08:54:01.767998 | aio | Monday 16 March 2026  08:54:01 +0000 (0:00:00.033)       0:00:22.622 **********
2026-03-16 08:54:01.768184 | aio | ===============================================================================
2026-03-16 08:54:01.768371 | aio | Get cluster health status ---------------------------------------------- 10.45s
2026-03-16 08:54:01.768553 | aio | Create a test Ceph pool ------------------------------------------------- 7.18s
2026-03-16 08:54:01.768741 | aio | Create a test Ceph key -------------------------------------------------- 2.53s
2026-03-16 08:54:01.768933 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.20s
2026-03-16 08:54:01.769224 | aio | Gathering Facts --------------------------------------------------------- 1.18s
2026-03-16 08:54:01.769313 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s
2026-03-16 08:54:01.769500 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-03-16 08:54:01.769692 | aio | Print cluster health status --------------------------------------------- 0.02s
2026-03-16 08:54:01.837859 | aio | INFO     [default > verify] Executed: Successful
2026-03-16 08:54:01.849147 | aio | INFO     [default > cleanup] Executing
2026-03-16 08:54:01.849403 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-16 08:54:01.854313 | aio | INFO     [default > destroy] Executing
2026-03-16 08:54:01.854348 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-16 08:54:01.854396 | aio | INFO     [default > destroy] Executed: Successful
2026-03-16 08:54:01.854663 | aio | WARNING  Molecule executed 1 scenario (1 missing files)
2026-03-16 08:54:01.983730 | aio | ok: Runtime: 0:10:43.597810
2026-03-16 08:54:01.997086 | 
2026-03-16 08:54:01.997141 | PLAY RECAP
2026-03-16 08:54:01.997189 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-16 08:54:01.997211 | 
2026-03-16 08:54:02.136919 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-16 08:54:02.140466 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-16 08:54:02.734227 | 
2026-03-16 08:54:02.734362 | PLAY [all]
2026-03-16 08:54:02.745771 | 
2026-03-16 08:54:02.745844 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-16 08:54:02.781147 | aio | skipping: Conditional result was False
2026-03-16 08:54:02.792936 | 
2026-03-16 08:54:02.793114 | TASK [fetch-output : Set log path for single node]
2026-03-16 08:54:02.835741 | aio | ok
2026-03-16 08:54:02.845655 | 
2026-03-16 08:54:02.845862 | LOOP [fetch-output : Ensure local output dirs]
2026-03-16 08:54:03.212890 | aio -> localhost | ok: "/var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/logs"
2026-03-16 08:54:03.415576 | aio -> localhost | changed: "/var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/artifacts"
2026-03-16 08:54:03.621829 | aio -> localhost | changed: "/var/lib/zuul/builds/8f3b194890574f15a33c079354d46ef0/work/docs"
2026-03-16 08:54:03.635521 | 
2026-03-16 08:54:03.635672 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-16 08:54:04.251459 | aio | ok
2026-03-16 08:54:04.251694 | aio | changed: All items complete
2026-03-16 08:54:04.251722 | 
2026-03-16 08:54:04.698039 | aio | changed: .d..t...... ./
2026-03-16 08:54:05.150801 | aio | changed: .d..t...... ./
2026-03-16 08:54:05.163739 | 
2026-03-16 08:54:05.163857 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-16 08:54:05.553837 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.006277
2026-03-16 08:54:05.793755 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007753
2026-03-16 08:54:05.812549 | 
2026-03-16 08:54:05.812661 | PLAY [all]
2026-03-16 08:54:05.818832 | 
2026-03-16 08:54:05.818893 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-16 08:54:06.257380 | aio | changed
2026-03-16 08:54:06.264635 | 
2026-03-16 08:54:06.264703 | PLAY RECAP
2026-03-16 08:54:06.264763 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-16 08:54:06.264792 | 
2026-03-16 08:54:06.373208 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-16 08:54:06.376676 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-16 08:54:06.963781 | 
2026-03-16 08:54:06.963948 | PLAY [localhost]
2026-03-16 08:54:06.974859 | 
2026-03-16 08:54:06.974939 | TASK [Generate Zuul manifest]
2026-03-16 08:54:06.997767 | localhost | ok
2026-03-16 08:54:07.014909 | 
2026-03-16 08:54:07.014989 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-16 08:54:07.317948 | localhost | changed
2026-03-16 08:54:07.329566 | 
2026-03-16 08:54:07.329644 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-16 08:54:07.363306 | localhost | ok
2026-03-16 08:54:07.373072 | 
2026-03-16 08:54:07.373172 | TASK [Upload logs]
2026-03-16 08:54:07.394730 | localhost | ok
2026-03-16 08:54:07.455104 | 
2026-03-16 08:54:07.455211 | TASK [Set zuul-log-path fact]
2026-03-16 08:54:07.477745 | localhost | ok
2026-03-16 08:54:07.492849 | 
2026-03-16 08:54:07.492927 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-16 08:54:07.524793 | localhost | ok
2026-03-16 08:54:07.535974 | 
2026-03-16 08:54:07.536047 | TASK [upload-logs : Create log directories]
2026-03-16 08:54:07.931159 | localhost | changed
2026-03-16 08:54:07.937373 | 
2026-03-16 08:54:07.937440 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-16 08:54:08.383945 | localhost -> localhost | ok: Runtime: 0:00:00.005757
2026-03-16 08:54:08.390900 | 
2026-03-16 08:54:08.390990 | TASK [upload-logs : Upload logs to log server]
2026-03-16 08:54:08.838609 | localhost | Output suppressed because no_log was given
2026-03-16 08:54:08.844271 | 
2026-03-16 08:54:08.844368 | LOOP [upload-logs : Compress console log and json output]
2026-03-16 08:54:08.887019 | localhost | skipping: Conditional result was False
2026-03-16 08:54:08.893868 | localhost | skipping: Conditional result was False
2026-03-16 08:54:08.907811 | 
2026-03-16 08:54:08.908012 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-16 08:54:08.950014 | localhost | skipping: Conditional result was False
2026-03-16 08:54:08.950428 | 
2026-03-16 08:54:08.954032 | localhost | skipping: Conditional result was False
2026-03-16 08:54:08.972371 | 
2026-03-16 08:54:08.972497 | LOOP [upload-logs : Upload console log and json output]