2026-04-22 09:22:40.760063 | Job console starting
2026-04-22 09:22:40.770310 | Updating git repos
2026-04-22 09:22:40.794589 | Cloning repos into workspace
2026-04-22 09:22:40.826457 | Restoring repo states
2026-04-22 09:22:40.833237 | Merging changes
2026-04-22 09:22:41.106355 | Checking out repos
2026-04-22 09:22:41.136698 | Preparing playbooks
2026-04-22 09:22:42.043767 | Running Ansible setup
2026-04-22 09:22:45.593351 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-22 09:22:46.206912 | 
2026-04-22 09:22:46.207042 | PLAY [localhost]
2026-04-22 09:22:46.214601 | 
2026-04-22 09:22:46.214670 | TASK [Gathering Facts]
2026-04-22 09:22:47.096021 | localhost | ok
2026-04-22 09:22:47.106114 | 
2026-04-22 09:22:47.106189 | TASK [Setup log path fact]
2026-04-22 09:22:47.123188 | localhost | ok
2026-04-22 09:22:47.134891 | 
2026-04-22 09:22:47.134965 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-22 09:22:47.165288 | localhost | ok
2026-04-22 09:22:47.173396 | 
2026-04-22 09:22:47.173472 | TASK [emit-job-header : Print job information]
2026-04-22 09:22:47.214272 | # Job Information
2026-04-22 09:22:47.214421 | Ansible Version: 2.16.16
2026-04-22 09:22:47.214466 | Job: ansible-collection-ceph-molecule-aio-ubuntu-noble
2026-04-22 09:22:47.214497 | Pipeline: check
2026-04-22 09:22:47.214525 | Executor: 0a8996d2b663
2026-04-22 09:22:47.214552 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/105
2026-04-22 09:22:47.214583 | Event ID: bbfeff10-3e2c-11f1-86f2-b239997f8a66
2026-04-22 09:22:47.218234 | 
2026-04-22 09:22:47.218343 | LOOP [emit-job-header : Print node information]
2026-04-22 09:22:47.326136 | localhost | ok:
2026-04-22 09:22:47.326385 | localhost | # Node Information
2026-04-22 09:22:47.326414 | localhost | Inventory Hostname: aio
2026-04-22 09:22:47.326435 | localhost | Hostname: np0000169231
2026-04-22 09:22:47.326454 | localhost | Username: zuul
2026-04-22 09:22:47.326476 | localhost | Distro: Ubuntu 24.04
2026-04-22 09:22:47.326496 | localhost | Provider: yul1
2026-04-22 09:22:47.326515 | localhost | Region: ca-ymq-1
2026-04-22 09:22:47.326534 | localhost | Label: ubuntu-noble
2026-04-22 09:22:47.326552 | localhost | Product Name: OpenStack Nova
2026-04-22 09:22:47.326570 | localhost | Interface IP: 199.19.213.191
2026-04-22 09:22:47.346000 | 
2026-04-22 09:22:47.346220 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-22 09:22:47.756527 | localhost -> localhost | changed
2026-04-22 09:22:47.766261 | 
2026-04-22 09:22:47.766336 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-22 09:22:48.552423 | localhost -> localhost | changed
2026-04-22 09:22:48.563348 | 
2026-04-22 09:22:48.563405 | PLAY [all]
2026-04-22 09:22:48.571377 | 
2026-04-22 09:22:48.571440 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-22 09:22:48.787998 | aio -> localhost | ok
2026-04-22 09:22:48.799082 | 
2026-04-22 09:22:48.799168 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-22 09:22:48.832618 | aio | ok
2026-04-22 09:22:48.845774 | aio | included: /var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-22 09:22:48.851738 | 
2026-04-22 09:22:48.851797 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-22 09:22:49.734475 | aio -> localhost | Generating public/private rsa key pair.
2026-04-22 09:22:49.734666 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/e14b68e80c2345c29645cc0b096ecb38_id_rsa
2026-04-22 09:22:49.734703 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/e14b68e80c2345c29645cc0b096ecb38_id_rsa.pub
2026-04-22 09:22:49.734728 | aio -> localhost | The key fingerprint is:
2026-04-22 09:22:49.734752 | aio -> localhost | SHA256:46M3RlOePTL9HpVTjHns1IHA65IoSSyDZtwNPAvc1tI zuul-build-sshkey
2026-04-22 09:22:49.734788 | aio -> localhost | The key's randomart image is:
2026-04-22 09:22:49.734810 | aio -> localhost | +---[RSA 3072]----+
2026-04-22 09:22:49.734837 | aio -> localhost | |. o o     ... .. |
2026-04-22 09:22:49.734860 | aio -> localhost | | o B E     . . =o|
2026-04-22 09:22:49.734882 | aio -> localhost | |. = B       . o B|
2026-04-22 09:22:49.734903 | aio -> localhost | | = = +    ..   +o|
2026-04-22 09:22:49.734925 | aio -> localhost | |o   + . Soo+   oo|
2026-04-22 09:22:49.734945 | aio -> localhost | |     o oo+=.+  ..|
2026-04-22 09:22:49.734966 | aio -> localhost | |      ..o..o o.  |
2026-04-22 09:22:49.734987 | aio -> localhost | |       .+.    .. |
2026-04-22 09:22:49.735011 | aio -> localhost | |      .o .   ..  |
2026-04-22 09:22:49.735032 | aio -> localhost | +----[SHA256]-----+
2026-04-22 09:22:49.735079 | aio -> localhost | ok: Runtime: 0:00:00.494628
2026-04-22 09:22:49.741481 | 
2026-04-22 09:22:49.741543 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-22 09:22:49.766211 | aio | ok
2026-04-22 09:22:49.776015 | aio | included: /var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-22 09:22:49.786180 | 
2026-04-22 09:22:49.786243 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-22 09:22:49.810707 | aio | skipping: Conditional result was False
2026-04-22 09:22:49.821838 | 
2026-04-22 09:22:49.821902 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-22 09:22:50.374606 | aio | changed
2026-04-22 09:22:50.380617 | 
2026-04-22 09:22:50.380685 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-22 09:22:50.606717 | aio | ok
2026-04-22 09:22:50.613339 | 
2026-04-22 09:22:50.613427 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-22 09:22:51.169297 | aio | changed
2026-04-22 09:22:51.175951 | 
2026-04-22 09:22:51.176014 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-22 09:22:51.724757 | aio | changed
2026-04-22 09:22:51.730727 | 
2026-04-22 09:22:51.730788 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-22 09:22:51.748102 | aio | skipping: Conditional result was False
2026-04-22 09:22:51.755573 | 
2026-04-22 09:22:51.755645 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-22 09:22:52.339479 | aio -> localhost | changed
2026-04-22 09:22:52.355976 | 
2026-04-22 09:22:52.356053 | TASK [add-build-sshkey : Add back temp key]
2026-04-22 09:22:52.684543 | aio -> localhost | Identity added: /var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/e14b68e80c2345c29645cc0b096ecb38_id_rsa (zuul-build-sshkey)
2026-04-22 09:22:52.684764 | aio -> localhost | ok: Runtime: 0:00:00.013442
2026-04-22 09:22:52.690194 | 
2026-04-22 09:22:52.690260 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-22 09:22:53.028584 | aio | ok
2026-04-22 09:22:53.034792 | 
2026-04-22 09:22:53.034862 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-22 09:22:53.060180 | aio | skipping: Conditional result was False
2026-04-22 09:22:53.075839 | 
2026-04-22 09:22:53.076106 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-22 09:22:53.435250 | aio | ok
2026-04-22 09:22:53.462444 | 
2026-04-22 09:22:53.462516 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-22 09:22:54.217683 | aio | Output suppressed because no_log was given
2026-04-22 09:22:54.264053 | 
2026-04-22 09:22:54.264201 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-22 09:22:54.487571 | aio | ok: "logs"
2026-04-22 09:22:54.487882 | aio | ok: All items complete
2026-04-22 09:22:54.487911 | 
2026-04-22 09:22:54.677129 | aio | ok: "artifacts"
2026-04-22 09:22:54.881692 | aio | ok: "docs"
2026-04-22 09:22:54.896943 | 
2026-04-22 09:22:54.897175 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-22 09:22:55.124001 | aio | changed: "logs"
2026-04-22 09:22:55.314894 | aio | changed: "artifacts"
2026-04-22 09:22:55.524277 | aio | changed: "docs"
2026-04-22 09:22:55.535843 | 
2026-04-22 09:22:55.536188 | PLAY RECAP
2026-04-22 09:22:55.536265 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-22 09:22:55.536301 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 09:22:55.536321 | 
2026-04-22 09:22:55.698110 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-22 09:22:55.700220 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-22 09:22:56.272176 | 
2026-04-22 09:22:56.272300 | PLAY [all]
2026-04-22 09:22:56.284267 | 
2026-04-22 09:22:56.284353 | TASK [setup-uv : Extract archive]
2026-04-22 09:22:58.905644 | aio | changed
2026-04-22 09:22:58.916169 | 
2026-04-22 09:22:58.916250 | TASK [setup-uv : Print version]
2026-04-22 09:22:58.723022 | aio | uv 0.8.13
2026-04-22 09:22:59.474932 | aio | ok: Runtime: 0:00:00.015154
2026-04-22 09:22:59.481958 | 
2026-04-22 09:22:59.482008 | PLAY RECAP
2026-04-22 09:22:59.482054 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 09:22:59.482077 | 
2026-04-22 09:22:59.587867 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-22 09:22:59.590132 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-22 09:23:00.140135 | 
2026-04-22 09:23:00.140263 | PLAY [all]
2026-04-22 09:23:00.151408 | 
2026-04-22 09:23:00.151477 | TASK [Copy inventory file for Zuul]
2026-04-22 09:23:01.175712 | aio | changed
2026-04-22 09:23:01.187701 | 
2026-04-22 09:23:01.187871 | TASK [Switch "ansible_host" to private IP]
2026-04-22 09:23:01.472879 | aio | changed: 1 replacements made
2026-04-22 09:23:01.478858 | 
2026-04-22 09:23:01.478932 | TASK [Run Molecule scenario]
2026-04-22 09:23:01.332717 | aio | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-04-22 09:23:01.332841 | aio | Creating virtual environment at: .venv
2026-04-22 09:23:01.684940 | aio | Downloading netaddr (2.2MiB)
2026-04-22 09:23:01.687460 | aio | Downloading cryptography (4.3MiB)
2026-04-22 09:23:01.687924 | aio | Downloading ansible-core (2.3MiB)
2026-04-22 09:23:01.688146 | aio | Downloading pygments (1.2MiB)
2026-04-22 09:23:01.875017 | aio |  Downloading netaddr
2026-04-22 09:23:01.888431 | aio |  Downloading cryptography
2026-04-22 09:23:01.941218 | aio |  Downloading pygments
2026-04-22 09:23:02.124482 | aio |  Downloading ansible-core
2026-04-22 09:23:02.173831 | aio | Installed 37 packages in 48ms
2026-04-22 09:23:03.085540 | aio | INFO     Collection 'vexxhost.ceph' detected.
2026-04-22 09:23:03.085662 | aio | INFO     Scenarios will be used from 'extensions/molecule'
2026-04-22 09:23:04.036262 | aio | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-22 09:23:04.036345 | aio | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-04-22 09:23:22.119620 | aio | INFO     [default > dependency] Executing
2026-04-22 09:23:22.119919 | aio | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-04-22 09:23:22.120269 | aio | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-04-22 09:23:22.120459 | aio | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-22 09:23:22.127039 | aio | INFO     [default > cleanup] Executing
2026-04-22 09:23:22.127426 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-22 09:23:22.133339 | aio | INFO     [default > destroy] Executing
2026-04-22 09:23:22.133406 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-22 09:23:22.133483 | aio | INFO     [default > destroy] Executed: Successful
2026-04-22 09:23:22.141292 | aio | INFO     [default > syntax] Executing
2026-04-22 09:23:23.554579 | aio |
2026-04-22 09:23:23.554959 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-22 09:23:23.651862 | aio | INFO     [default > syntax] Executed: Successful
2026-04-22 09:23:23.663453 | aio | INFO     [default > create] Executing
2026-04-22 09:23:23.665063 | aio | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-22 09:23:23.670712 | aio | INFO     [default > prepare] Executing
2026-04-22 09:23:24.733868 | aio |
2026-04-22 09:23:24.734213 | aio | PLAY [Prepare] *****************************************************************
2026-04-22 09:23:24.734448 | aio |
2026-04-22 09:23:24.734759 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:23:24.735035 | aio | Wednesday 22 April 2026  09:23:24 +0000 (0:00:00.032)       0:00:00.032 *******
2026-04-22 09:23:27.077686 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-04-22 09:23:27.079428 | aio | ok: [aio]
2026-04-22 09:23:27.079664 | aio |
2026-04-22 09:23:27.079892 | aio | TASK [Configure short hostname] ************************************************
2026-04-22 09:23:27.080055 | aio | Wednesday 22 April 2026  09:23:27 +0000 (0:00:02.346)       0:00:02.378 *******
2026-04-22 09:23:27.962490 | aio | changed: [aio]
2026-04-22 09:23:27.962617 | aio |
2026-04-22 09:23:27.962848 | aio | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-22 09:23:27.963041 | aio | Wednesday 22 April 2026  09:23:27 +0000 (0:00:00.882)       0:00:03.261 *******
2026-04-22 09:23:28.382687 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-22 09:23:28.390915 | aio | changed: [aio]
2026-04-22 09:23:28.391311 | aio |
2026-04-22 09:23:28.391620 | aio | TASK [Update apt cache] ********************************************************
2026-04-22 09:23:28.392010 | aio | Wednesday 22 April 2026  09:23:28 +0000 (0:00:00.428)       0:00:03.690 *******
2026-04-22 09:23:34.839034 | aio | changed: [aio]
2026-04-22 09:23:34.839252 | aio |
2026-04-22 09:23:34.839522 | aio | PLAY [Create devices for Ceph] *************************************************
2026-04-22 09:23:34.839829 | aio |
2026-04-22 09:23:34.840095 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:23:34.840355 | aio | Wednesday 22 April 2026  09:23:34 +0000 (0:00:06.447)       0:00:10.138 *******
2026-04-22 09:23:35.754486 | aio | ok: [aio]
2026-04-22 09:23:35.754678 | aio |
2026-04-22 09:23:35.754986 | aio | TASK [Install depedencies] *****************************************************
2026-04-22 09:23:35.755222 | aio | Wednesday 22 April 2026  09:23:35 +0000 (0:00:00.915)       0:00:11.053 *******
2026-04-22 09:24:09.685411 | aio | changed: [aio]
2026-04-22 09:24:09.685588 | aio |
2026-04-22 09:24:09.685911 | aio | TASK [Start up service] ********************************************************
2026-04-22 09:24:09.686159 | aio | Wednesday 22 April 2026  09:24:09 +0000 (0:00:33.930)       0:00:44.984 *******
2026-04-22 09:24:10.413794 | aio | ok: [aio]
2026-04-22 09:24:10.413974 | aio |
2026-04-22 09:24:10.414221 | aio | TASK [Generate lvm.conf] *******************************************************
2026-04-22 09:24:10.414471 | aio | Wednesday 22 April 2026  09:24:10 +0000 (0:00:00.728)       0:00:45.712 *******
2026-04-22 09:24:10.843798 | aio | ok: [aio]
2026-04-22 09:24:10.844038 | aio |
2026-04-22 09:24:10.844398 | aio | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-22 09:24:10.844790 | aio | Wednesday 22 April 2026  09:24:10 +0000 (0:00:00.430)       0:00:46.142 *******
2026-04-22 09:24:11.742666 | aio | changed: [aio]
2026-04-22 09:24:11.742969 | aio |
2026-04-22 09:24:11.743281 | aio | TASK [Get list of all loopback devices] ****************************************
2026-04-22 09:24:11.743664 | aio | Wednesday 22 April 2026  09:24:11 +0000 (0:00:00.899)       0:00:47.041 *******
2026-04-22 09:24:12.047100 | aio | ok: [aio]
2026-04-22 09:24:12.047224 | aio |
2026-04-22 09:24:12.047477 | aio | TASK [Fail if there is any existing loopback devices] **************************
2026-04-22 09:24:12.047739 | aio | Wednesday 22 April 2026  09:24:12 +0000 (0:00:00.304)       0:00:47.346 *******
2026-04-22 09:24:12.075847 | aio | skipping: [aio]
2026-04-22 09:24:12.076090 | aio |
2026-04-22 09:24:12.076356 | aio | TASK [Create devices for Ceph] *************************************************
2026-04-22 09:24:12.076603 | aio | Wednesday 22 April 2026  09:24:12 +0000 (0:00:00.028)       0:00:47.375 *******
2026-04-22 09:24:12.945709 | aio | changed: [aio] => (item=osd0)
2026-04-22 09:24:12.945773 | aio | changed: [aio] => (item=osd1)
2026-04-22 09:24:12.945786 | aio | changed: [aio] => (item=osd2)
2026-04-22 09:24:12.945798 | aio |
2026-04-22 09:24:12.945816 | aio | TASK [Set permissions on loopback devices] *************************************
2026-04-22 09:24:12.945905 | aio | Wednesday 22 April 2026  09:24:12 +0000 (0:00:00.869)       0:00:48.244 *******
2026-04-22 09:24:13.928472 | aio | changed: [aio] => (item=osd0)
2026-04-22 09:24:13.928707 | aio | changed: [aio] => (item=osd1)
2026-04-22 09:24:13.928956 | aio | changed: [aio] => (item=osd2)
2026-04-22 09:24:13.929174 | aio |
2026-04-22 09:24:13.929459 | aio | TASK [Start loop devices] ******************************************************
2026-04-22 09:24:13.929677 | aio | Wednesday 22 April 2026  09:24:13 +0000 (0:00:00.983)       0:00:49.227 *******
2026-04-22 09:24:14.954542 | aio | changed: [aio] => (item=osd0)
2026-04-22 09:24:14.954710 | aio | changed: [aio] => (item=osd1)
2026-04-22 09:24:14.954865 | aio | changed: [aio] => (item=osd2)
2026-04-22 09:24:14.955005 | aio |
2026-04-22 09:24:14.955162 | aio | TASK [Create a volume group for each loop device] ******************************
2026-04-22 09:24:14.955314 | aio | Wednesday 22 April 2026  09:24:14 +0000 (0:00:01.026)       0:00:50.253 *******
2026-04-22 09:24:16.597788 | aio | changed: [aio] => (item=osd0)
2026-04-22 09:24:16.597979 | aio | changed: [aio] => (item=osd1)
2026-04-22 09:24:16.597996 | aio | changed: [aio] => (item=osd2)
2026-04-22 09:24:16.598010 | aio |
2026-04-22 09:24:16.598022 | aio | TASK [Create a logical volume for each loop device] ****************************
2026-04-22 09:24:16.598043 | aio | Wednesday 22 April 2026  09:24:16 +0000 (0:00:01.642)       0:00:51.896 *******
2026-04-22 09:24:18.375759 | aio | changed: [aio] => (item=ceph-aio-osd0)
2026-04-22 09:24:18.376792 | aio | changed: [aio] => (item=ceph-aio-osd1)
2026-04-22 09:24:18.376876 | aio | changed: [aio] => (item=ceph-aio-osd2)
2026-04-22 09:24:18.376883 | aio |
2026-04-22 09:24:18.376888 | aio | PLAY RECAP *********************************************************************
2026-04-22 09:24:18.377704 | aio | aio                        : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-22 09:24:18.377767 | aio |
2026-04-22 09:24:18.377778 | aio |
2026-04-22 09:24:18.377947 | aio | TASKS RECAP ********************************************************************
2026-04-22 09:24:18.378277 | aio | Wednesday 22 April 2026  09:24:18 +0000 (0:00:01.778)       0:00:53.674 *******
2026-04-22 09:24:18.378598 | aio | ===============================================================================
2026-04-22 09:24:18.378972 | aio | Install depedencies ---------------------------------------------------- 33.93s
2026-04-22 09:24:18.379320 | aio | Update apt cache -------------------------------------------------------- 6.45s
2026-04-22 09:24:18.379670 | aio | Gathering Facts --------------------------------------------------------- 2.35s
2026-04-22 09:24:18.380351 | aio | Create a logical volume for each loop device ---------------------------- 1.78s
2026-04-22 09:24:18.380790 | aio | Create a volume group for each loop device ------------------------------ 1.64s
2026-04-22 09:24:18.381138 | aio | Start loop devices ------------------------------------------------------ 1.03s
2026-04-22 09:24:18.381492 | aio | Set permissions on loopback devices ------------------------------------- 0.98s
2026-04-22 09:24:18.381744 | aio | Gathering Facts --------------------------------------------------------- 0.92s
2026-04-22 09:24:18.383229 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.90s
2026-04-22 09:24:18.383255 | aio | Configure short hostname ------------------------------------------------ 0.88s
2026-04-22 09:24:18.383261 | aio | Create devices for Ceph ------------------------------------------------- 0.87s
2026-04-22 09:24:18.383267 | aio | Start up service -------------------------------------------------------- 0.73s
2026-04-22 09:24:18.383273 | aio | Generate lvm.conf ------------------------------------------------------- 0.43s
2026-04-22 09:24:18.383279 | aio | Ensure hostname inside hosts file --------------------------------------- 0.43s
2026-04-22 09:24:18.383284 | aio | Get list of all loopback devices ---------------------------------------- 0.30s
2026-04-22 09:24:18.383290 | aio | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-04-22 09:24:18.475892 | aio | INFO     [default > prepare] Executed: Successful
2026-04-22 09:24:18.485199 | aio | INFO     [default > converge] Executing
2026-04-22 09:24:19.837854 | aio |
2026-04-22 09:24:19.837946 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-22 09:24:19.837963 | aio |
2026-04-22 09:24:19.838117 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:24:19.838435 | aio | Wednesday 22 April 2026  09:24:19 +0000 (0:00:00.059)       0:00:00.059 *******
2026-04-22 09:24:21.153495 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-04-22 09:24:21.164914 | aio | ok: [aio]
2026-04-22 09:24:21.165157 | aio |
2026-04-22 09:24:21.165425 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:24:21.165784 | aio | Wednesday 22 April 2026  09:24:21 +0000 (0:00:01.327)       0:00:01.387 *******
2026-04-22 09:24:21.675261 | aio | ok: [aio]
2026-04-22 09:24:21.675513 | aio |
2026-04-22 09:24:21.675862 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:24:21.676158 | aio | Wednesday 22 April 2026  09:24:21 +0000 (0:00:00.510)       0:00:01.897 *******
2026-04-22 09:24:21.714836 | aio | skipping: [aio]
2026-04-22 09:24:21.715114 | aio |
2026-04-22 09:24:21.715421 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-22 09:24:21.715757 | aio | Wednesday 22 April 2026  09:24:21 +0000 (0:00:00.039)       0:00:01.936 *******
2026-04-22 09:24:22.225599 | aio | changed: [aio]
2026-04-22 09:24:22.225922 | aio |
2026-04-22 09:24:22.226228 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:24:22.226524 | aio | Wednesday 22 April 2026  09:24:22 +0000 (0:00:00.510)       0:00:02.447 *******
2026-04-22 09:24:22.372765 | aio | ok: [aio] => {
2026-04-22 09:24:22.373099 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-22 09:24:22.373385 | aio | }
2026-04-22 09:24:22.373676 | aio |
2026-04-22 09:24:22.373994 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:24:22.374351 | aio | Wednesday 22 April 2026  09:24:22 +0000 (0:00:00.146)       0:00:02.594 *******
2026-04-22 09:24:23.355412 | aio | changed: [aio]
2026-04-22 09:24:23.355439 | aio |
2026-04-22 09:24:23.355454 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:24:23.355458 | aio | Wednesday 22 April 2026  09:24:23 +0000 (0:00:00.981)       0:00:03.576 *******
2026-04-22 09:24:23.395488 | aio | skipping: [aio]
2026-04-22 09:24:23.395539 | aio |
2026-04-22 09:24:23.395553 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:24:23.395565 | aio | Wednesday 22 April 2026  09:24:23 +0000 (0:00:00.039)       0:00:03.615 *******
2026-04-22 09:24:23.440863 | aio | skipping: [aio]
2026-04-22 09:24:23.440895 | aio |
2026-04-22 09:24:23.441053 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:24:23.441381 | aio | Wednesday 22 April 2026  09:24:23 +0000 (0:00:00.045)       0:00:03.661 *******
2026-04-22 09:24:23.887485 | aio | ok: [aio]
2026-04-22 09:24:23.887656 | aio |
2026-04-22 09:24:23.887955 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:24:23.888216 | aio | Wednesday 22 April 2026  09:24:23 +0000 (0:00:00.446)       0:00:04.107 *******
2026-04-22 09:24:25.101559 | aio | ok: [aio]
2026-04-22 09:24:25.101658 | aio |
2026-04-22 09:24:25.101677 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:24:25.101689 | aio | Wednesday 22 April 2026  09:24:25 +0000 (0:00:01.213)       0:00:05.321 *******
2026-04-22 09:24:25.192793 | aio | ok: [aio] => {
2026-04-22 09:24:25.192850 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-22 09:24:25.192863 | aio | }
2026-04-22 09:24:25.192876 | aio |
2026-04-22 09:24:25.192893 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:24:25.192909 | aio | Wednesday 22 April 2026  09:24:25 +0000 (0:00:00.091)       0:00:05.413 *******
2026-04-22 09:24:26.190410 | aio | changed: [aio]
2026-04-22 09:24:26.190480 | aio |
2026-04-22 09:24:26.190496 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:24:26.190508 | aio | Wednesday 22 April 2026  09:24:26 +0000 (0:00:00.996)       0:00:06.410 *******
2026-04-22 09:24:29.467921 | aio | changed: [aio]
2026-04-22 09:24:29.467997 | aio |
2026-04-22 09:24:29.468020 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-22 09:24:29.468307 | aio | Wednesday 22 April 2026  09:24:29 +0000 (0:00:03.278)       0:00:09.688 *******
2026-04-22 09:24:29.505885 | aio | skipping: [aio]
2026-04-22 09:24:29.505918 | aio |
2026-04-22 09:24:29.505931 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-22 09:24:29.505968 | aio | Wednesday 22 April 2026  09:24:29 +0000 (0:00:00.037)       0:00:09.726 *******
2026-04-22 09:24:29.541952 | aio | skipping: [aio]
2026-04-22 09:24:29.541988 | aio |
2026-04-22 09:24:29.541998 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-22 09:24:29.542008 | aio | Wednesday 22 April 2026  09:24:29 +0000 (0:00:00.035)       0:00:09.762 *******
2026-04-22 09:24:29.577771 | aio | skipping: [aio]
2026-04-22 09:24:29.577833 | aio |
2026-04-22 09:24:29.578274 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-22 09:24:29.578306 | aio | Wednesday 22 April 2026  09:24:29 +0000 (0:00:00.036)       0:00:09.798 *******
2026-04-22 09:24:38.010456 | aio | changed: [aio]
2026-04-22 09:24:38.010494 | aio |
2026-04-22 09:24:38.010502 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-22 09:24:38.010510 | aio | Wednesday 22 April 2026  09:24:38 +0000 (0:00:08.432)       0:00:18.231 *******
2026-04-22 09:24:38.865288 | aio | changed: [aio]
2026-04-22 09:24:38.865370 | aio |
2026-04-22 09:24:38.865384 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-22 09:24:38.865397 | aio | Wednesday 22 April 2026  09:24:38 +0000 (0:00:00.854)       0:00:19.085 *******
2026-04-22 09:24:40.317849 | aio | changed: [aio] => (item={'path': '/etc/containerd'})
2026-04-22 09:24:40.317919 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-22 09:24:40.319394 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-22 09:24:40.319435 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-22 09:24:40.319441 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-22 09:24:40.319447 | aio |
2026-04-22 09:24:40.319452 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-22 09:24:40.319762 | aio | Wednesday 22 April 2026  09:24:40 +0000 (0:00:01.453)       0:00:20.539 *******
2026-04-22 09:24:41.177124 | aio | changed: [aio]
2026-04-22 09:24:41.177194 | aio |
2026-04-22 09:24:41.177278 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-22 09:24:41.177390 | aio | Wednesday 22 April 2026  09:24:41 +0000 (0:00:00.851)       0:00:21.391 *******
2026-04-22 09:24:41.177502 | aio |
2026-04-22 09:24:41.177610 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-22 09:24:41.177745 | aio | Wednesday 22 April 2026  09:24:41 +0000 (0:00:00.007)       0:00:21.398 *******
2026-04-22 09:24:42.397506 | aio | ok: [aio]
2026-04-22 09:24:42.397782 | aio |
2026-04-22 09:24:42.398055 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-22 09:24:42.398302 | aio | Wednesday 22 April 2026  09:24:42 +0000 (0:00:01.220)       0:00:22.619 *******
2026-04-22 09:24:43.025137 | aio | changed: [aio]
2026-04-22 09:24:43.025323 | aio |
2026-04-22 09:24:43.025620 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-22 09:24:43.026037 | aio | Wednesday 22 April 2026  09:24:43 +0000 (0:00:00.627)       0:00:23.246 *******
2026-04-22 09:24:43.780288 | aio | changed: [aio]
2026-04-22 09:24:43.780342 | aio |
2026-04-22 09:24:43.780356 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:24:43.780369 | aio | Wednesday 22 April 2026  09:24:43 +0000 (0:00:00.754)       0:00:24.000 *******
2026-04-22 09:24:44.110758 | aio | ok: [aio]
2026-04-22 09:24:44.110815 | aio |
2026-04-22 09:24:44.111232 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:24:44.111281 | aio | Wednesday 22 April 2026  09:24:44 +0000 (0:00:00.331)       0:00:24.332 *******
2026-04-22 09:24:44.196696 | aio | ok: [aio] => {
2026-04-22 09:24:44.196741 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-22 09:24:44.196748 | aio | }
2026-04-22 09:24:44.196754 | aio |
2026-04-22 09:24:44.196759 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:24:44.196782 | aio | Wednesday 22 April 2026  09:24:44 +0000 (0:00:00.084)       0:00:24.416 *******
2026-04-22 09:24:45.224479 | aio | changed: [aio]
2026-04-22 09:24:45.224519 | aio |
2026-04-22 09:24:45.224524 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:24:45.224528 | aio | Wednesday 22 April 2026  09:24:45 +0000 (0:00:01.028)       0:00:25.445 *******
2026-04-22 09:24:49.852193 | aio | changed: [aio]
2026-04-22 09:24:49.852259 | aio |
2026-04-22 09:24:49.852273 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-22 09:24:49.852285 | aio | Wednesday 22 April 2026  09:24:49 +0000 (0:00:04.627)       0:00:30.073 *******
2026-04-22 09:24:50.883824 | aio | ok: [aio]
2026-04-22 09:24:50.883885 | aio |
2026-04-22 09:24:50.883900 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-22 09:24:50.883914 | aio | Wednesday 22 April 2026  09:24:50 +0000 (0:00:01.030)       0:00:31.104 *******
2026-04-22 09:24:53.316697 | aio | changed: [aio]
2026-04-22 09:24:53.317370 | aio |
2026-04-22 09:24:53.317420 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-22 09:24:53.317434 | aio | Wednesday 22 April 2026  09:24:53 +0000 (0:00:02.432)       0:00:33.536 *******
2026-04-22 09:24:54.017283 | aio | changed: [aio]
2026-04-22 09:24:54.017360 | aio |
2026-04-22 09:24:54.017376 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-22 09:24:54.017389 | aio | Wednesday 22 April 2026  09:24:54 +0000 (0:00:00.701)       0:00:34.237 *******
2026-04-22 09:24:54.901731 | aio | changed: [aio] => (item={'path': '/etc/docker'})
2026-04-22 09:24:54.901793 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-22 09:24:54.901807 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-22 09:24:54.901848 | aio |
2026-04-22 09:24:54.901861 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-22 09:24:54.901880 | aio | Wednesday 22 April 2026  09:24:54 +0000 (0:00:00.884)       0:00:35.121 *******
2026-04-22 09:24:55.599469 | aio | changed: [aio]
2026-04-22 09:24:55.599504 | aio |
2026-04-22 09:24:55.599510 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-22 09:24:55.599516 | aio | Wednesday 22 April 2026  09:24:55 +0000 (0:00:00.698)       0:00:35.820 *******
2026-04-22 09:24:56.308385 | aio | changed: [aio]
2026-04-22 09:24:56.309688 | aio |
2026-04-22 09:24:56.309723 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-22 09:24:56.309730 | aio | Wednesday 22 April 2026  09:24:56 +0000 (0:00:00.701)       0:00:36.522 *******
2026-04-22 09:24:56.309735 | aio |
2026-04-22 09:24:56.310202 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-22 09:24:56.310233 | aio | Wednesday 22 April 2026  09:24:56 +0000 (0:00:00.007)       0:00:36.529 *******
2026-04-22 09:24:57.281859 | aio | ok: [aio]
2026-04-22 09:24:57.281952 | aio |
2026-04-22 09:24:57.282036 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-22 09:24:57.282331 | aio | Wednesday 22 April 2026  09:24:57 +0000 (0:00:00.972)       0:00:37.502 *******
2026-04-22 09:24:58.771346 | aio | changed: [aio]
2026-04-22 09:24:58.771419 | aio |
2026-04-22 09:24:58.771440 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-22 09:24:58.771456 | aio | Wednesday 22 April 2026  09:24:58 +0000 (0:00:01.489)       0:00:38.991 *******
2026-04-22 09:24:59.545263 | aio | changed: [aio]
2026-04-22 09:24:59.545321 | aio |
2026-04-22 09:24:59.545335 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-22 09:24:59.545347 | aio | Wednesday 22 April 2026  09:24:59 +0000 (0:00:00.774)       0:00:39.765 *******
2026-04-22 09:24:59.609788 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-04-22 09:24:59.609859 | aio |
2026-04-22 09:24:59.610371 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] ****
2026-04-22 09:24:59.610449 | aio | Wednesday 22 April 2026  09:24:59 +0000 (0:00:00.065)       0:00:39.831 *******
2026-04-22 09:24:59.648841 | aio | skipping: [aio]
2026-04-22 09:24:59.648889 | aio |
2026-04-22 09:24:59.648896 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-22 09:24:59.648903 | aio | Wednesday 22 April 2026  09:24:59 +0000 (0:00:00.039)       0:00:39.870 *******
2026-04-22 09:25:00.742137 | aio | ok: [aio]
2026-04-22 09:25:00.742185 | aio |
2026-04-22 09:25:00.742192 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-22 09:25:00.742198 | aio | Wednesday 22 April 2026  09:25:00 +0000 (0:00:01.092)       0:00:40.962 *******
2026-04-22 09:25:01.669774 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-04-22 09:25:01.669835 | aio | ok: [aio] => (item=ssh)
2026-04-22 09:25:01.669898 | aio |
2026-04-22 09:25:01.670454 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-22 09:25:01.670491 | aio | Wednesday 22 April 2026  09:25:01 +0000 (0:00:00.928)       0:00:41.891 *******
2026-04-22 09:25:02.142162 | aio | changed: [aio]
2026-04-22 09:25:02.142210 | aio |
2026-04-22 09:25:02.142220 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-22 09:25:02.142230 | aio | Wednesday 22 April 2026  09:25:02 +0000 (0:00:00.471)       0:00:42.362 *******
2026-04-22 09:25:02.455313 | aio | ok: [aio]
2026-04-22 09:25:02.455364 | aio |
2026-04-22 09:25:02.455393 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-22 09:25:02.455403 | aio | Wednesday 22 April 2026  09:25:02 +0000 (0:00:00.312)       0:00:42.675 *******
2026-04-22 09:25:03.384043 | aio | changed: [aio]
2026-04-22 09:25:03.384095 | aio |
2026-04-22 09:25:03.384230 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-22 09:25:03.384344 | aio | Wednesday 22 April 2026  09:25:03 +0000 (0:00:00.929)       0:00:43.604 *******
2026-04-22 09:25:03.860281 | aio | changed: [aio]
2026-04-22 09:25:03.860334 | aio |
2026-04-22 09:25:03.860345 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-22 09:25:03.860354 | aio | Wednesday 22 April 2026  09:25:03 +0000 (0:00:00.476)       0:00:44.081 *******
2026-04-22 09:25:04.079247 | aio | ok: [aio]
2026-04-22 09:25:04.079311 | aio |
2026-04-22 09:25:04.079325 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-22 09:25:04.079338 | aio | Wednesday 22 April 2026  09:25:04 +0000 (0:00:00.218)       0:00:44.300 *******
2026-04-22 09:25:04.394793 | aio | ok: [aio] => (item=aio)
2026-04-22 09:25:04.394854 | aio |
2026-04-22 09:25:04.394941 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-22 09:25:04.395211 | aio | Wednesday 22 April 2026  09:25:04 +0000 (0:00:00.315)       0:00:44.615 *******
2026-04-22 09:25:04.448089 | aio | ok: [aio]
2026-04-22 09:25:04.448141 | aio |
2026-04-22 09:25:04.448154 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-22 09:25:04.448167 | aio | Wednesday 22 April 2026  09:25:04 +0000 (0:00:00.053)       0:00:44.668 *******
2026-04-22 09:25:04.531159 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio
2026-04-22 09:25:04.531210 | aio |
2026-04-22 09:25:04.531224 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-04-22 09:25:04.531236 | aio | Wednesday 22 April 2026  09:25:04 +0000 (0:00:00.083)       0:00:44.751 *******
2026-04-22 09:25:04.955743 | aio | changed: [aio]
2026-04-22 09:25:04.955792 | aio |
2026-04-22 09:25:04.956348 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-04-22 09:25:04.956405 | aio | Wednesday 22 April 2026  09:25:04 +0000 (0:00:00.425)       0:00:45.176 *******
2026-04-22 09:25:05.998210 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-04-22 09:25:05.998278 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-04-22 09:25:05.998291 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-04-22 09:25:05.998328 | aio |
2026-04-22 09:25:05.998337 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-04-22 09:25:05.998346 | aio | Wednesday 22 April 2026  09:25:05 +0000 (0:00:01.040)       0:00:46.217 *******
2026-04-22 09:27:34.596100 | aio | ok: [aio]
2026-04-22 09:27:34.596174 | aio |
2026-04-22 09:27:34.596191 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-04-22 09:27:34.596329 | aio | Wednesday 22 April 2026  09:27:34 +0000 (0:02:28.600)       0:03:14.818 *******
2026-04-22 09:27:34.917723 | aio | changed: [aio]
2026-04-22 09:27:34.917786 | aio |
2026-04-22 09:27:34.918425 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-04-22 09:27:34.918486 | aio | Wednesday 22 April 2026  09:27:34 +0000 (0:00:00.320)       0:03:15.138 *******
2026-04-22 09:27:34.963079 | aio | ok: [aio]
2026-04-22 09:27:34.963154 | aio |
2026-04-22 09:27:34.963225 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:27:34.963342 | aio | Wednesday 22 April 2026  09:27:34 +0000 (0:00:00.045)       0:03:15.184 *******
2026-04-22 09:27:35.048706 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:27:35.048765 | aio |
2026-04-22 09:27:35.049069 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:27:35.049446 | aio | Wednesday 22 April 2026  09:27:35 +0000 (0:00:00.085)       0:03:15.269 *******
2026-04-22 09:27:41.904350 | aio | ok: [aio]
2026-04-22 09:27:41.905578 | aio |
2026-04-22 09:27:41.905599 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:27:41.905607 | aio | Wednesday 22 April 2026  09:27:41 +0000 (0:00:06.854)       0:03:22.124 *******
2026-04-22 09:27:41.975725 | aio | ok: [aio] => (item=aio)
2026-04-22 09:27:41.975795 | aio |
2026-04-22 09:27:41.975816 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:27:41.976081 | aio | Wednesday 22 April 2026  09:27:41 +0000 (0:00:00.071)       0:03:22.195 *******
2026-04-22 09:27:42.515429 | aio | ok: [aio]
2026-04-22 09:27:42.516690 | aio |
2026-04-22 09:27:42.516727 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:27:42.516734 | aio | Wednesday 22 April 2026  09:27:42 +0000 (0:00:00.541)       0:03:22.736 *******
2026-04-22 09:27:50.782269 | aio | ok: [aio]
2026-04-22 09:27:50.782484 | aio |
2026-04-22 09:27:50.782789 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-22 09:27:50.783050 | aio | Wednesday 22 April 2026  09:27:50 +0000 (0:00:08.266)       0:03:31.003 *******
2026-04-22 09:28:47.445617 | aio | changed: [aio]
2026-04-22 09:28:47.445927 | aio |
2026-04-22 09:28:47.446311 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-22 09:28:47.446739 | aio | Wednesday 22 April 2026  09:28:47 +0000 (0:00:56.663)       0:04:27.666 *******
2026-04-22 09:29:02.971820 | aio | ok: [aio]
2026-04-22 09:29:02.971900 | aio |
2026-04-22 09:29:02.971915 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:29:02.972051 | aio | Wednesday 22 April 2026  09:29:02 +0000 (0:00:15.526)       0:04:43.193 *******
2026-04-22 09:29:03.060199 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:29:03.060314 | aio |
2026-04-22 09:29:03.060333 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:29:03.060480 | aio | Wednesday 22 April 2026  09:29:03 +0000 (0:00:00.086)       0:04:43.279 *******
2026-04-22 09:29:03.116234 | aio | skipping: [aio]
2026-04-22 09:29:03.116362 | aio |
2026-04-22 09:29:03.116532 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:29:03.117720 | aio | Wednesday 22 April 2026  09:29:03 +0000 (0:00:00.057)       0:04:43.337 *******
2026-04-22 09:29:03.179787 | aio | skipping: [aio] => (item=aio)
2026-04-22 09:29:03.179825 | aio | skipping: [aio]
2026-04-22 09:29:03.179966 | aio |
2026-04-22 09:29:03.180176 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:29:03.180394 | aio | Wednesday 22 April 2026  09:29:03 +0000 (0:00:00.063)       0:04:43.401 *******
2026-04-22 09:29:03.629396 | aio | ok: [aio]
2026-04-22 09:29:03.629508 | aio |
2026-04-22 09:29:03.629720 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:29:03.629889 | aio | Wednesday 22 April 2026  09:29:03 +0000 (0:00:00.449)       0:04:43.850 *******
2026-04-22 09:29:10.952538 | aio | ok: [aio]
2026-04-22 09:29:10.952761 | aio |
2026-04-22 09:29:10.953061 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-22 09:29:10.953319 | aio | Wednesday 22 April 2026  09:29:10 +0000 (0:00:07.323)       0:04:51.174 *******
2026-04-22 09:29:29.353718 | aio | changed: [aio]
2026-04-22 09:29:29.353783 | aio |
2026-04-22 09:29:29.353798 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-22 09:29:29.353817 | aio | Wednesday 22 April 2026  09:29:29 +0000 (0:00:18.400)       0:05:09.574 *******
2026-04-22 09:29:36.417091 | aio | ok: [aio]
2026-04-22 09:29:36.417187 | aio |
2026-04-22 09:29:36.417249 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-04-22 09:29:36.417374 | aio | Wednesday 22 April 2026  09:29:36 +0000 (0:00:07.064)       0:05:16.638 *******
2026-04-22 09:29:44.915409 | aio | changed: [aio] => (item={'name': 'diskprediction_local'})
2026-04-22 09:29:44.915453 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-04-22 09:29:44.915460 | aio | changed: [aio] => (item={'name': 'prometheus'})
2026-04-22 09:29:44.915465 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-04-22 09:29:44.915471 | aio |
2026-04-22 09:29:44.915476 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-22 09:29:44.915482 | aio |
2026-04-22 09:29:44.915487 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:29:44.915492 | aio | Wednesday 22 April 2026  09:29:44 +0000 (0:00:08.495)       0:05:25.134 *******
2026-04-22 09:29:46.972741 | aio | ok: [aio]
2026-04-22 09:29:46.973107 | aio |
2026-04-22 09:29:46.973464 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:29:46.973897 | aio | Wednesday 22 April 2026  09:29:46 +0000 (0:00:02.059)       0:05:27.194 *******
2026-04-22 09:29:47.316330 | aio | ok: [aio]
2026-04-22 09:29:47.316559 | aio |
2026-04-22 09:29:47.316937 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:29:47.317399 | aio | Wednesday 22 April 2026  09:29:47 +0000 (0:00:00.344)       0:05:27.538 *******
2026-04-22 09:29:47.357773 | aio | skipping: [aio]
2026-04-22 09:29:47.358168 | aio |
2026-04-22 09:29:47.358528 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-22 09:29:47.358926 | aio | Wednesday 22 April 2026  09:29:47 +0000 (0:00:00.040)       0:05:27.579 *******
2026-04-22 09:29:47.701227 | aio | ok: [aio]
2026-04-22 09:29:47.701487 | aio |
2026-04-22 09:29:47.701724 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:29:47.701923 | aio | Wednesday 22 April 2026  09:29:47 +0000 (0:00:00.343)       0:05:27.922 *******
2026-04-22 09:29:47.771690 | aio | ok: [aio] => {
2026-04-22 09:29:47.772128 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-22 09:29:47.772551 | aio | }
2026-04-22 09:29:47.773016 | aio |
2026-04-22 09:29:47.773382 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:29:47.773753 | aio | Wednesday 22 April 2026  09:29:47 +0000 (0:00:00.070)       0:05:27.993 *******
2026-04-22 09:29:48.281037 | aio | ok: [aio]
2026-04-22 09:29:48.281451 | aio |
2026-04-22 09:29:48.281855 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:29:48.282216 | aio | Wednesday 22 April 2026  09:29:48 +0000 (0:00:00.508)       0:05:28.501 *******
2026-04-22 09:29:48.338181 | aio | skipping: [aio]
2026-04-22 09:29:48.338554 | aio |
2026-04-22 09:29:48.338937 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:29:48.339368 | aio | Wednesday 22 April 2026  09:29:48 +0000 (0:00:00.057)       0:05:28.559 *******
2026-04-22 09:29:48.439553 | aio | skipping: [aio]
2026-04-22 09:29:48.439662 | aio |
2026-04-22 09:29:48.439677 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:29:48.439688 | aio | Wednesday 22 April 2026  09:29:48 +0000 (0:00:00.100)       0:05:28.660 *******
2026-04-22 09:29:48.789343 | aio | ok: [aio]
2026-04-22 09:29:48.789392 | aio |
2026-04-22 09:29:48.789402 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:29:48.789412 | aio | Wednesday 22 April 2026  09:29:48 +0000 (0:00:00.349)       0:05:29.010 *******
2026-04-22 09:29:49.877869 | aio | ok: [aio]
2026-04-22 09:29:49.877921 | aio |
2026-04-22 09:29:49.877932 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:29:49.877953 | aio | Wednesday 22 April 2026  09:29:49 +0000 (0:00:01.088)       0:05:30.098 *******
2026-04-22 09:29:49.954423 | aio | ok: [aio] => {
2026-04-22 09:29:49.954475 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-22 09:29:49.954486 | aio | }
2026-04-22 09:29:49.954496 | aio |
2026-04-22 09:29:49.954508 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:29:49.954522 | aio | Wednesday 22 April 2026  09:29:49 +0000 (0:00:00.076)       0:05:30.174 *******
2026-04-22 09:29:50.454755 | aio | ok: [aio]
2026-04-22 09:29:50.454794 | aio |
2026-04-22 09:29:50.454803 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:29:50.454811 | aio | Wednesday 22 April 2026  09:29:50 +0000 (0:00:00.501)       0:05:30.675 *******
2026-04-22 09:29:52.834722 | aio | ok: [aio]
2026-04-22 09:29:52.834780 | aio |
2026-04-22 09:29:52.834791 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-22 09:29:52.834952 | aio | Wednesday 22 April 2026  09:29:52 +0000 (0:00:02.379)       0:05:33.055 *******
2026-04-22 09:29:52.876093 | aio | skipping: [aio]
2026-04-22 09:29:52.876332 | aio |
2026-04-22 09:29:52.876663 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-22 09:29:52.876983 | aio | Wednesday 22 April 2026  09:29:52 +0000 (0:00:00.041)       0:05:33.097 *******
2026-04-22 09:29:52.912662 | aio | skipping: [aio]
2026-04-22 09:29:52.912932 | aio |
2026-04-22 09:29:52.913220 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-22 09:29:52.913496 | aio | Wednesday 22 April 2026  09:29:52 +0000 (0:00:00.036)       0:05:33.133 *******
2026-04-22 09:29:52.953833 | aio | skipping: [aio]
2026-04-22 09:29:52.954102 | aio |
2026-04-22 09:29:52.954373 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-22 09:29:52.954708 | aio | Wednesday 22 April 2026  09:29:52 +0000 (0:00:00.041)       0:05:33.175 *******
2026-04-22 09:29:54.337512 | aio | ok: [aio]
2026-04-22 09:29:54.337793 | aio |
2026-04-22 09:29:54.338090 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-22 09:29:54.338467 | aio | Wednesday 22 April 2026  09:29:54 +0000 (0:00:01.383)       0:05:34.558 *******
2026-04-22 09:29:55.064511 | aio | ok: [aio]
2026-04-22 09:29:55.064757 | aio |
2026-04-22 09:29:55.065029 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-22 09:29:55.065298 | aio | Wednesday 22 April 2026  09:29:55 +0000 (0:00:00.727)       0:05:35.286 *******
2026-04-22 09:29:56.584821 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-04-22 09:29:56.584876 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-22 09:29:56.584887 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-22 09:29:56.584904 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-22 09:29:56.585936 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-22 09:29:56.585987 | aio |
2026-04-22 09:29:56.585998 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-22 09:29:56.586043 | aio | Wednesday 22 April 2026  09:29:56 +0000 (0:00:01.518)       0:05:36.805 *******
2026-04-22 09:29:57.408319 | aio | ok: [aio]
2026-04-22 09:29:57.408356 | aio |
2026-04-22 09:29:57.408361 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-22 09:29:57.408365 | aio | Wednesday 22 April 2026  09:29:57 +0000 (0:00:00.814)       0:05:37.620 *******
2026-04-22 09:29:57.408369 | aio |
2026-04-22 09:29:57.408373 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-22 09:29:57.408377 | aio | Wednesday 22 April 2026  09:29:57 +0000 (0:00:00.006)       0:05:37.626 *******
2026-04-22 09:29:57.932156 | aio | ok: [aio]
2026-04-22 09:29:57.932367 | aio |
2026-04-22 09:29:57.932558 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:29:57.932786 | aio | Wednesday 22 April 2026  09:29:57 +0000 (0:00:00.524)       0:05:38.151 *******
2026-04-22 09:29:58.237134 | aio | ok: [aio]
2026-04-22 09:29:58.237392 | aio |
2026-04-22 09:29:58.237683 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:29:58.237899 | aio | Wednesday 22 April 2026  09:29:58 +0000 (0:00:00.307)       0:05:38.459 *******
2026-04-22 09:29:58.303572 | aio | ok: [aio] => {
2026-04-22 09:29:58.303995 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-22 09:29:58.304312 | aio | }
2026-04-22 09:29:58.304601 | aio |
2026-04-22 09:29:58.304960 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:29:58.305303 | aio | Wednesday 22 April 2026  09:29:58 +0000 (0:00:00.066)       0:05:38.525 *******
2026-04-22 09:29:58.781534 | aio | ok: [aio]
2026-04-22 09:29:58.781966 | aio |
2026-04-22 09:29:58.782316 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:29:58.782669 | aio | Wednesday 22 April 2026  09:29:58 +0000 (0:00:00.477)       0:05:39.002 *******
2026-04-22 09:30:02.250490 | aio | ok: [aio]
2026-04-22 09:30:02.250910 | aio |
2026-04-22 09:30:02.251287 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-22 09:30:02.251718 | aio | Wednesday 22 April 2026  09:30:02 +0000 (0:00:03.469)       0:05:42.472 *******
2026-04-22 09:30:03.346941 | aio | ok: [aio]
2026-04-22 09:30:03.347170 | aio |
2026-04-22 09:30:03.347377 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-22 09:30:03.347663 | aio | Wednesday 22 April 2026  09:30:03 +0000 (0:00:01.096)       0:05:43.568 *******
2026-04-22 09:30:03.672172 | aio | ok: [aio]
2026-04-22 09:30:03.672396 | aio |
2026-04-22 09:30:03.672584 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-22 09:30:03.672813 | aio | Wednesday 22 April 2026  09:30:03 +0000 (0:00:00.324)       0:05:43.893 *******
2026-04-22 09:30:04.363194 | aio | ok: [aio]
2026-04-22 09:30:04.363242 | aio |
2026-04-22 09:30:04.363253 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-22 09:30:04.363262 | aio | Wednesday 22 April 2026  09:30:04 +0000 (0:00:00.690)       0:05:44.583 *******
2026-04-22 09:30:05.258772 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-04-22 09:30:05.258822 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-22 09:30:05.258833 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-22 09:30:05.258843 | aio |
2026-04-22 09:30:05.258852 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-22 09:30:05.258861 | aio | Wednesday 22 April 2026  09:30:05 +0000 (0:00:00.894)       0:05:45.478 *******
2026-04-22 09:30:06.128468 | aio | ok: [aio]
2026-04-22 09:30:06.128541 | aio |
2026-04-22 09:30:06.128555 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-22 09:30:06.128568 | aio | Wednesday 22 April 2026  09:30:06 +0000 (0:00:00.869)       0:05:46.348 *******
2026-04-22 09:30:06.820713 | aio | ok: [aio]
2026-04-22 09:30:06.820775 | aio |
2026-04-22 09:30:06.821680 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-22 09:30:06.821726 | aio | Wednesday 22 April 2026  09:30:06 +0000 (0:00:00.686)       0:05:47.034 *******
2026-04-22 09:30:06.821731 | aio |
2026-04-22 09:30:06.821735 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-22 09:30:06.822089 | aio | Wednesday 22 April 2026  09:30:06 +0000 (0:00:00.006)       0:05:47.041 *******
2026-04-22 09:30:07.341776 | aio | ok: [aio]
2026-04-22 09:30:07.341848 | aio |
2026-04-22 09:30:07.341867 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-22 09:30:07.342199 | aio | Wednesday 22 April 2026  09:30:07 +0000 (0:00:00.521)       0:05:47.562 *******
2026-04-22 09:30:07.404121 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-04-22 09:30:07.404196 | aio |
2026-04-22 09:30:07.404255 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] ****
2026-04-22 09:30:07.404378 | aio | Wednesday 22 April 2026  09:30:07 +0000 (0:00:00.063)       0:05:47.626 *******
2026-04-22 09:30:07.447010 | aio | skipping: [aio]
2026-04-22 09:30:07.447120 | aio |
2026-04-22 09:30:07.447255 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-22 09:30:07.447370 | aio | Wednesday 22 April 2026  09:30:07 +0000 (0:00:00.041)       0:05:47.667 *******
2026-04-22 09:30:08.517257 | aio | ok: [aio]
2026-04-22 09:30:08.517336 | aio |
2026-04-22 09:30:08.517348 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-22 09:30:08.517358 | aio | Wednesday 22 April 2026  09:30:08 +0000 (0:00:01.069)       0:05:48.737 *******
2026-04-22 09:30:09.458496 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-04-22 09:30:09.458552 | aio | ok: [aio] => (item=ssh)
2026-04-22 09:30:09.458562 | aio |
2026-04-22 09:30:09.458572 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-22 09:30:09.458581 | aio | Wednesday 22 April 2026  09:30:09 +0000 (0:00:00.941)       0:05:49.678 *******
2026-04-22 09:30:09.941756 | aio | ok: [aio]
2026-04-22 09:30:09.941821 | aio |
2026-04-22 09:30:09.942262 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-22 09:30:09.942304 | aio | Wednesday 22 April 2026  09:30:09 +0000 (0:00:00.483)       0:05:50.162 *******
2026-04-22 09:30:10.260093 | aio | ok: [aio]
2026-04-22 09:30:10.260137 | aio |
2026-04-22 09:30:10.260148 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-22 09:30:10.260157 | aio | Wednesday 22 April 2026  09:30:10 +0000 (0:00:00.317)       0:05:50.479 *******
2026-04-22 09:30:10.629344 | aio | ok: [aio]
2026-04-22 09:30:10.629374 | aio |
2026-04-22 09:30:10.629379 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-22 09:30:10.629384 | aio | Wednesday 22 April 2026  09:30:10 +0000 (0:00:00.369)       0:05:50.849 *******
2026-04-22 09:30:10.947381 | aio | ok: [aio]
2026-04-22 09:30:10.948408 | aio |
2026-04-22 09:30:10.948436 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-22 09:30:10.948467 | aio | Wednesday 22 April 2026  09:30:10 +0000 (0:00:00.318)       0:05:51.168 *******
2026-04-22 09:30:11.300086 | aio | ok: [aio] => (item=aio)
2026-04-22 09:30:11.300154 | aio |
2026-04-22 09:30:11.300276 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-22 09:30:11.300390 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.351)       0:05:51.519 *******
2026-04-22 09:30:11.351240 | aio | ok: [aio]
2026-04-22 09:30:11.351354 | aio |
2026-04-22 09:30:11.351508 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:30:11.351718 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.053)       0:05:51.572 *******
2026-04-22 09:30:11.429246 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:30:11.429297 | aio |
2026-04-22 09:30:11.429307 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:30:11.429317 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.077)       0:05:51.650 *******
2026-04-22 09:30:11.477179 | aio | skipping: [aio]
2026-04-22 09:30:11.477218 | aio |
2026-04-22 09:30:11.477229 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:30:11.477238 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.047)       0:05:51.697 *******
2026-04-22 09:30:11.529765 | aio | skipping: [aio] => (item=aio)
2026-04-22 09:30:11.529839 | aio | skipping: [aio]
2026-04-22 09:30:11.529853 | aio |
2026-04-22 09:30:11.530330 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:30:11.530373 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.052)       0:05:51.750 *******
2026-04-22 09:30:11.954309 | aio | ok: [aio]
2026-04-22 09:30:11.954359 | aio |
2026-04-22 09:30:11.954370 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:30:11.954380 | aio | Wednesday 22 April 2026  09:30:11 +0000 (0:00:00.423)       0:05:52.174 *******
2026-04-22 09:30:25.406750 | aio | ok: [aio]
2026-04-22 09:30:25.406844 | aio |
2026-04-22 09:30:25.406970 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-22 09:30:25.407257 | aio | Wednesday 22 April 2026  09:30:25 +0000 (0:00:13.454)       0:06:05.628 *******
2026-04-22 09:30:30.977815 | aio | ok: [aio]
2026-04-22 09:30:30.977876 | aio |
2026-04-22 09:30:30.977893 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-22 09:30:30.978141 | aio | Wednesday 22 April 2026  09:30:30 +0000 (0:00:05.570)       0:06:11.198 *******
2026-04-22 09:30:47.887188 | aio | ok: [aio]
2026-04-22 09:30:47.887243 | aio |
2026-04-22 09:30:47.887252 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-22 09:30:47.887260 | aio | Wednesday 22 April 2026  09:30:47 +0000 (0:00:16.909)       0:06:28.108 *******
2026-04-22 09:33:56.216744 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-04-22 09:33:56.216862 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-04-22 09:33:56.217799 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-04-22 09:33:56.217868 | aio |
2026-04-22 09:33:56.217883 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-22 09:33:56.218075 | aio | Wednesday 22 April 2026  09:33:56 +0000 (0:03:08.329)       0:09:36.437 *******
2026-04-22 09:34:04.509982 | aio | ok: [aio]
2026-04-22 09:34:04.510337 | aio |
2026-04-22 09:34:04.510910 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-22 09:34:04.511321 | aio | Wednesday 22 April 2026  09:34:04 +0000 (0:00:08.293)       0:09:44.731 *******
2026-04-22 09:34:11.056345 | aio | ok: [aio]
2026-04-22 09:34:11.056411 | aio |
2026-04-22 09:34:11.056424 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-22 09:34:11.056449 | aio | Wednesday 22 April 2026  09:34:11 +0000 (0:00:06.545)       0:09:51.276 *******
2026-04-22 09:34:11.129971 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-04-22 09:34:11.130025 | aio |
2026-04-22 09:34:11.130037 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-22 09:34:11.130047 | aio | Wednesday 22 April 2026  09:34:11 +0000 (0:00:00.073)       0:09:51.350 *******
2026-04-22 09:34:11.180794 | aio | ok: [aio]
2026-04-22 09:34:11.180872 | aio |
2026-04-22 09:34:11.180893 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-22 09:34:11.181122 | aio | Wednesday 22 April 2026  09:34:11 +0000 (0:00:00.051)       0:09:51.402 *******
2026-04-22 09:34:22.845915 | aio | ok: [aio]
2026-04-22 09:34:22.846187 | aio |
2026-04-22 09:34:22.846514 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-22 09:34:22.846890 | aio | Wednesday 22 April 2026  09:34:22 +0000 (0:00:11.664)       0:10:03.066 *******
2026-04-22 09:34:22.904699 | aio | ok: [aio]
2026-04-22 09:34:22.904786 | aio |
2026-04-22 09:34:22.904956 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-22 09:34:22.905084 | aio | Wednesday 22 April 2026  09:34:22 +0000 (0:00:00.060)       0:10:03.126 *******
2026-04-22 09:34:22.954981 | aio | skipping: [aio] => (item=1)
2026-04-22 09:34:22.955090 | aio | skipping: [aio] => (item=1)
2026-04-22 09:34:22.955286 | aio | skipping: [aio] => (item=1)
2026-04-22 09:34:22.955447 | aio | skipping: [aio]
2026-04-22 09:34:22.955613 | aio |
2026-04-22 09:34:22.955801 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-22 09:34:22.956002 | aio | Wednesday 22 April 2026  09:34:22 +0000 (0:00:00.049)       0:10:03.176 *******
2026-04-22 09:34:22.991270 | aio | skipping: [aio]
2026-04-22 09:34:22.991444 | aio |
2026-04-22 09:34:22.991768 | aio | PLAY RECAP *********************************************************************
2026-04-22 09:34:22.992252 | aio | aio                        : ok=106  changed=28   unreachable=0    failed=0    skipped=20   rescued=0    ignored=0
2026-04-22 09:34:22.992509 | aio |
2026-04-22 09:34:22.992760 | aio |
2026-04-22 09:34:22.993031 | aio | TASKS RECAP ********************************************************************
2026-04-22 09:34:22.993296 | aio | Wednesday 22 April 2026  09:34:22 +0000 (0:00:00.037)       0:10:03.213 *******
2026-04-22 09:34:22.993586 | aio | ===============================================================================
2026-04-22 09:34:22.993846 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 188.33s
2026-04-22 09:34:22.994113 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 148.60s
2026-04-22 09:34:22.994380 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 56.66s
2026-04-22 09:34:22.994660 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 18.40s
2026-04-22 09:34:22.995024 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 16.91s
2026-04-22 09:34:22.995290 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 15.53s
2026-04-22 09:34:22.995581 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.45s
2026-04-22 09:34:22.996025 | aio | vexxhost.ceph.osd : Get `ceph orch ps` --------------------------------- 11.66s
2026-04-22 09:34:22.996348 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.50s
2026-04-22 09:34:22.996638 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.43s
2026-04-22 09:34:22.996923 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 8.29s
2026-04-22 09:34:22.997277 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.27s
2026-04-22 09:34:22.997748 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.32s
2026-04-22 09:34:22.997998 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 7.06s
2026-04-22 09:34:22.998273 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.85s
2026-04-22 09:34:22.998569 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.55s
2026-04-22 09:34:22.998833 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.57s
2026-04-22 09:34:22.999085 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.63s
2026-04-22 09:34:22.999361 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.47s
2026-04-22 09:34:22.999613 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.28s
2026-04-22 09:34:23.152678 | aio | INFO     [default > converge] Executed: Successful
2026-04-22 09:34:23.161978 | aio | INFO     [default > idempotence] Executing
2026-04-22 09:34:24.576305 | aio |
2026-04-22 09:34:24.576519 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-22 09:34:24.576771 | aio |
2026-04-22 09:34:24.577112 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:34:24.577356 | aio | Wednesday 22 April 2026  09:34:24 +0000 (0:00:00.059)       0:00:00.059 *******
2026-04-22 09:34:26.068336 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-04-22 09:34:26.081548 | aio | ok: [aio]
2026-04-22 09:34:26.081869 | aio |
2026-04-22 09:34:26.082088 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:34:26.082347 | aio | Wednesday 22 April 2026  09:34:26 +0000 (0:00:01.505)       0:00:01.565 *******
2026-04-22 09:34:26.617817 | aio | ok: [aio]
2026-04-22 09:34:26.617978 | aio |
2026-04-22 09:34:26.618241 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:34:26.618494 | aio | Wednesday 22 April 2026  09:34:26 +0000 (0:00:00.535)       0:00:02.101 *******
2026-04-22 09:34:26.667775 | aio | skipping: [aio]
2026-04-22 09:34:26.667980 | aio |
2026-04-22 09:34:26.668362 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-22 09:34:26.668685 | aio | Wednesday 22 April 2026  09:34:26 +0000 (0:00:00.049)       0:00:02.151 *******
2026-04-22 09:34:27.202223 | aio | ok: [aio]
2026-04-22 09:34:27.202444 | aio |
2026-04-22 09:34:27.202748 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:34:27.203000 | aio | Wednesday 22 April 2026  09:34:27 +0000 (0:00:00.535)       0:00:02.686 *******
2026-04-22 09:34:27.321268 | aio | ok: [aio] => {
2026-04-22 09:34:27.321541 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-22 09:34:27.321834 | aio | }
2026-04-22 09:34:27.322079 | aio |
2026-04-22 09:34:27.322356 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:34:27.322660 | aio | Wednesday 22 April 2026  09:34:27 +0000 (0:00:00.118)       0:00:02.804 *******
2026-04-22 09:34:27.998588 | aio | ok: [aio]
2026-04-22 09:34:27.998869 | aio |
2026-04-22 09:34:27.999133 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:34:27.999389 | aio | Wednesday 22 April 2026  09:34:27 +0000 (0:00:00.677)       0:00:03.482 *******
2026-04-22 09:34:28.051795 | aio | skipping: [aio]
2026-04-22 09:34:28.051988 | aio |
2026-04-22 09:34:28.052247 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:34:28.052524 | aio | Wednesday 22 April 2026  09:34:28 +0000 (0:00:00.053)       0:00:03.535 *******
2026-04-22 09:34:28.104440 | aio | skipping: [aio]
2026-04-22 09:34:28.104811 | aio |
2026-04-22 09:34:28.105135 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:34:28.105402 | aio | Wednesday 22 April 2026  09:34:28 +0000 (0:00:00.052)       0:00:03.588 *******
2026-04-22 09:34:28.520098 | aio | ok: [aio]
2026-04-22 09:34:28.520213 | aio |
2026-04-22 09:34:28.520229 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:34:28.520361 | aio | Wednesday 22 April 2026  09:34:28 +0000 (0:00:00.415)       0:00:04.003 *******
2026-04-22 09:34:29.855230 | aio | ok: [aio]
2026-04-22 09:34:29.855477 | aio |
2026-04-22 09:34:29.855814 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:34:29.856093 | aio | Wednesday 22 April 2026  09:34:29 +0000 (0:00:01.334)       0:00:05.338 *******
2026-04-22 09:34:29.950398 | aio | ok: [aio] => {
2026-04-22 09:34:29.950816 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-22 09:34:29.951070 | aio | }
2026-04-22 09:34:29.951406 | aio |
2026-04-22 09:34:29.951669 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:34:29.951943 | aio | Wednesday 22 April 2026  09:34:29 +0000 (0:00:00.095)       0:00:05.434 *******
2026-04-22 09:34:30.472953 | aio | ok: [aio]
2026-04-22 09:34:30.473359 | aio |
2026-04-22 09:34:30.473797 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:34:30.474040 | aio | Wednesday 22 April 2026  09:34:30 +0000 (0:00:00.522)       0:00:05.956 *******
2026-04-22 09:34:33.163140 | aio | ok: [aio]
2026-04-22 09:34:33.163431 | aio |
2026-04-22 09:34:33.164237 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-22 09:34:33.164310 | aio | Wednesday 22 April 2026  09:34:33 +0000 (0:00:02.690)       0:00:08.646 *******
2026-04-22 09:34:33.206820 | aio | skipping: [aio]
2026-04-22 09:34:33.206895 | aio |
2026-04-22 09:34:33.206906 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-22 09:34:33.206916 | aio | Wednesday 22 April 2026  09:34:33 +0000 (0:00:00.041)       0:00:08.688 *******
2026-04-22 09:34:33.247237 | aio | skipping: [aio]
2026-04-22 09:34:33.247268 | aio |
2026-04-22 09:34:33.247278 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-22 09:34:33.247288 | aio | Wednesday 22 April 2026  09:34:33 +0000 (0:00:00.041)       0:00:08.730 *******
2026-04-22 09:34:33.287817 | aio | skipping: [aio]
2026-04-22 09:34:33.287881 | aio |
2026-04-22 09:34:33.287893 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-22 09:34:33.287944 | aio | Wednesday 22 April 2026  09:34:33 +0000 (0:00:00.040)       0:00:08.770 *******
2026-04-22 09:34:34.321058 | aio | ok: [aio]
2026-04-22 09:34:34.321118 | aio |
2026-04-22 09:34:34.321243 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-22 09:34:34.321358 | aio | Wednesday 22 April 2026  09:34:34 +0000 (0:00:01.033)       0:00:09.804 *******
2026-04-22 09:34:34.996275 | aio | ok: [aio]
2026-04-22 09:34:34.996326 | aio |
2026-04-22 09:34:34.996337 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-22 09:34:34.996347 | aio | Wednesday 22 April 2026  09:34:34 +0000 (0:00:00.674)       0:00:10.479 *******
2026-04-22 09:34:36.705686 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-04-22 09:34:36.705723 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-22 09:34:36.705728 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-22 09:34:36.705732 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-22 09:34:36.705736 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-22 09:34:36.705740 | aio |
2026-04-22 09:34:36.705747 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-22 09:34:36.706006 | aio | Wednesday 22 April 2026  09:34:36 +0000 (0:00:01.708)       0:00:12.187 *******
2026-04-22 09:34:37.585087 | aio | ok: [aio]
2026-04-22 09:34:37.585148 | aio |
2026-04-22 09:34:37.585252 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-22 09:34:37.585747 | aio | Wednesday 22 April 2026  09:34:37 +0000 (0:00:00.873)       0:00:13.061 *******
2026-04-22 09:34:37.585781 | aio |
2026-04-22 09:34:37.585786 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-22 09:34:37.585790 | aio | Wednesday 22 April 2026  09:34:37 +0000 (0:00:00.007)       0:00:13.069 *******
2026-04-22 09:34:38.338788 | aio | ok: [aio]
2026-04-22 09:34:38.338835 | aio |
2026-04-22 09:34:38.339359 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:34:38.339401 | aio | Wednesday 22 April 2026  09:34:38 +0000 (0:00:00.752)       0:00:13.821 *******
2026-04-22 09:34:38.687076 | aio | ok: [aio]
2026-04-22 09:34:38.687158 | aio |
2026-04-22 09:34:38.687255 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:34:38.687386 | aio | Wednesday 22 April 2026  09:34:38 +0000 (0:00:00.348)       0:00:14.170 *******
2026-04-22 09:34:38.769087 | aio | ok: [aio] => {
2026-04-22 09:34:38.769149 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-22 09:34:38.769166 | aio | }
2026-04-22 09:34:38.769181 | aio |
2026-04-22 09:34:38.769196 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:34:38.769212 | aio | Wednesday 22 April 2026  09:34:38 +0000 (0:00:00.080)       0:00:14.250 *******
2026-04-22 09:34:39.322862 | aio | ok: [aio]
2026-04-22 09:34:39.322946 | aio |
2026-04-22 09:34:39.322960 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:34:39.323001 | aio | Wednesday 22 April 2026  09:34:39 +0000 (0:00:00.554)       0:00:14.805 *******
2026-04-22 09:34:43.861829 | aio | ok: [aio]
2026-04-22 09:34:43.861946 | aio |
2026-04-22 09:34:43.862600 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-22 09:34:43.862707 | aio | Wednesday 22 April 2026  09:34:43 +0000 (0:00:04.539)       0:00:19.344 *******
2026-04-22 09:34:45.026613 | aio | ok: [aio]
2026-04-22 09:34:45.026715 | aio |
2026-04-22 09:34:45.026726 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-22 09:34:45.026736 | aio | Wednesday 22 April 2026  09:34:45 +0000 (0:00:01.163)       0:00:20.508 *******
2026-04-22 09:34:45.496158 | aio | ok: [aio]
2026-04-22 09:34:45.496249 | aio |
2026-04-22 09:34:45.496394 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-22 09:34:45.496553 | aio | Wednesday 22 April 2026  09:34:45 +0000 (0:00:00.470)       0:00:20.978 *******
2026-04-22 09:34:46.249780 | aio | ok: [aio]
2026-04-22 09:34:46.249895 | aio |
2026-04-22 09:34:46.250052 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-22 09:34:46.250227 | aio | Wednesday 22 April 2026  09:34:46 +0000 (0:00:00.755)       0:00:21.733 *******
2026-04-22 09:34:47.266742 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-04-22 09:34:47.266832 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-22 09:34:47.267790 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-22 09:34:47.267871 | aio |
2026-04-22 09:34:47.267884 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-22 09:34:47.267895 | aio | Wednesday 22 April 2026  09:34:47 +0000 (0:00:01.014)       0:00:22.748 *******
2026-04-22 09:34:47.993598 | aio | ok: [aio]
2026-04-22 09:34:47.993760 | aio |
2026-04-22 09:34:47.993784 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-22 09:34:47.993798 | aio | Wednesday 22 April 2026  09:34:47 +0000 (0:00:00.726)       0:00:23.475 *******
2026-04-22 09:34:48.707787 | aio | ok: [aio]
2026-04-22 09:34:48.707836 | aio |
2026-04-22 09:34:48.707845 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-22 09:34:48.707870 | aio | Wednesday 22 April 2026  09:34:48 +0000 (0:00:00.705)       0:00:24.181 *******
2026-04-22 09:34:48.707878 | aio |
2026-04-22 09:34:48.707886 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-22 09:34:48.707900 | aio | Wednesday 22 April 2026  09:34:48 +0000 (0:00:00.008)       0:00:24.189 *******
2026-04-22 09:34:50.275197 | aio | ok: [aio]
2026-04-22 09:34:50.275261 | aio |
2026-04-22 09:34:50.275267 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-22 09:34:50.275272 | aio | Wednesday 22 April 2026  09:34:50 +0000 (0:00:01.565)       0:00:25.755 *******
2026-04-22 09:34:50.347576 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-04-22 09:34:50.347829 | aio |
2026-04-22 09:34:50.348131 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] ****
2026-04-22 09:34:50.348388 | aio | Wednesday 22 April 2026  09:34:50 +0000 (0:00:00.066)       0:00:25.822 *******
2026-04-22 09:34:50.386473 | aio | skipping: [aio]
2026-04-22 09:34:50.386664 | aio |
2026-04-22 09:34:50.386981 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-22 09:34:50.387263 | aio | Wednesday 22 April 2026  09:34:50 +0000 (0:00:00.047)       0:00:25.869 *******
2026-04-22 09:34:51.668449 | aio | ok: [aio]
2026-04-22 09:34:51.668545 | aio |
2026-04-22 09:34:51.668762 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-22 09:34:51.668927 | aio | Wednesday 22 April 2026  09:34:51 +0000 (0:00:01.282)       0:00:27.152 *******
2026-04-22 09:34:52.664190 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-04-22 09:34:52.664449 | aio | ok: [aio] => (item=ssh)
2026-04-22 09:34:52.664728 | aio |
2026-04-22 09:34:52.665043 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-22 09:34:52.665310 | aio | Wednesday 22 April 2026  09:34:52 +0000 (0:00:00.995)       0:00:28.147 *******
2026-04-22 09:34:53.138605 | aio | ok: [aio]
2026-04-22 09:34:53.138741 | aio |
2026-04-22 09:34:53.138870 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-22 09:34:53.139034 | aio | Wednesday 22 April 2026  09:34:53 +0000 (0:00:00.475)       0:00:28.622 *******
2026-04-22 09:34:53.478775 | aio | ok: [aio]
2026-04-22 09:34:53.478902 | aio |
2026-04-22 09:34:53.479223 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-22 09:34:53.479499 | aio | Wednesday 22 April 2026  09:34:53 +0000 (0:00:00.339)       0:00:28.961 *******
2026-04-22 09:34:54.075875 | aio | ok: [aio]
2026-04-22 09:34:54.076050 | aio |
2026-04-22 09:34:54.076337 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-22 09:34:54.076603 | aio | Wednesday 22 April 2026  09:34:54 +0000 (0:00:00.596)       0:00:29.558 *******
2026-04-22 09:34:54.541354 | aio | ok: [aio]
2026-04-22 09:34:54.541411 | aio |
2026-04-22 09:34:54.541418 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-04-22 09:34:54.541424 | aio | Wednesday 22 April 2026  09:34:54 +0000 (0:00:00.465)       0:00:30.024 *******
2026-04-22 09:34:54.727719 | aio | ok: [aio]
2026-04-22 09:34:54.727780 | aio |
2026-04-22 09:34:54.727791 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-04-22 09:34:54.727801 | aio | Wednesday 22 April 2026  09:34:54 +0000 (0:00:00.185)       0:00:30.209 *******
2026-04-22 09:34:55.127547 | aio | ok: [aio] => (item=aio)
2026-04-22 09:34:55.127608 | aio |
2026-04-22 09:34:55.127619 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-04-22 09:34:55.127661 | aio | Wednesday 22 April 2026  09:34:55 +0000 (0:00:00.400)       0:00:30.610 *******
2026-04-22 09:34:55.184330 | aio | ok: [aio]
2026-04-22 09:34:55.184359 | aio |
2026-04-22 09:34:55.184366 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-04-22 09:34:55.184373 | aio | Wednesday 22 April 2026  09:34:55 +0000 (0:00:00.057)       0:00:30.668 *******
2026-04-22 09:34:55.228904 | aio | skipping: [aio]
2026-04-22 09:34:55.229014 | aio |
2026-04-22 09:34:55.229024 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:34:55.229034 | aio | Wednesday 22 April 2026  09:34:55 +0000 (0:00:00.043)       0:00:30.711 *******
2026-04-22 09:34:55.313068 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:34:55.313179 | aio |
2026-04-22 09:34:55.313473 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:34:55.313763 | aio | Wednesday 22 April 2026  09:34:55 +0000 (0:00:00.085)       0:00:30.796 *******
2026-04-22 09:35:09.513182 | aio | ok: [aio]
2026-04-22 09:35:09.513528 | aio |
2026-04-22 09:35:09.513782 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:35:09.514013 | aio | Wednesday 22 April 2026  09:35:09 +0000 (0:00:14.199)       0:00:44.996 *******
2026-04-22 09:35:09.584675 | aio | ok: [aio] => (item=aio)
2026-04-22 09:35:09.584950 | aio |
2026-04-22 09:35:09.585233 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:35:09.585515 | aio | Wednesday 22 April 2026  09:35:09 +0000 (0:00:00.070)       0:00:45.067 *******
2026-04-22 09:35:10.232192 | aio | ok: [aio]
2026-04-22 09:35:10.232262 | aio |
2026-04-22 09:35:10.232418 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:35:10.232518 | aio | Wednesday 22 April 2026  09:35:10 +0000 (0:00:00.646)       0:00:45.714 *******
2026-04-22 09:35:20.204841 | aio | ok: [aio]
2026-04-22 09:35:20.205019 | aio |
2026-04-22 09:35:20.205331 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-04-22 09:35:20.205672 | aio | Wednesday 22 April 2026  09:35:20 +0000 (0:00:09.973)       0:00:55.687 *******
2026-04-22 09:35:28.174008 | aio | ok: [aio]
2026-04-22 09:35:28.174218 | aio |
2026-04-22 09:35:28.174523 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-04-22 09:35:28.174918 | aio | Wednesday 22 April 2026  09:35:28 +0000 (0:00:07.969)       0:01:03.657 *******
2026-04-22 09:35:53.365247 | aio | ok: [aio]
2026-04-22 09:35:53.366402 | aio |
2026-04-22 09:35:53.366437 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:35:53.366453 | aio | Wednesday 22 April 2026  09:35:53 +0000 (0:00:25.191)       0:01:28.848 *******
2026-04-22 09:35:53.449880 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:35:53.449962 | aio |
2026-04-22 09:35:53.449976 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:35:53.450113 | aio | Wednesday 22 April 2026  09:35:53 +0000 (0:00:00.084)       0:01:28.933 *******
2026-04-22 09:35:53.502544 | aio | skipping: [aio]
2026-04-22 09:35:53.502842 | aio |
2026-04-22 09:35:53.503132 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:35:53.503394 | aio | Wednesday 22 April 2026  09:35:53 +0000 (0:00:00.053)       0:01:28.986 *******
2026-04-22 09:35:53.559922 | aio | skipping: [aio] => (item=aio)
2026-04-22 09:35:53.560092 | aio | skipping: [aio]
2026-04-22 09:35:53.560328 | aio |
2026-04-22 09:35:53.560594 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:35:53.560956 | aio | Wednesday 22 April 2026  09:35:53 +0000 (0:00:00.056)       0:01:29.043 *******
2026-04-22 09:35:54.005076 | aio | ok: [aio]
2026-04-22 09:35:54.005287 | aio |
2026-04-22 09:35:54.005564 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:35:54.005875 | aio | Wednesday 22 April 2026  09:35:54 +0000 (0:00:00.445)       0:01:29.488 *******
2026-04-22 09:36:04.568714 | aio | ok: [aio]
2026-04-22 09:36:04.569386 | aio |
2026-04-22 09:36:04.569770 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-04-22 09:36:04.570067 | aio | Wednesday 22 April 2026  09:36:04 +0000 (0:00:10.562)       0:01:40.051 *******
2026-04-22 09:36:18.883825 | aio | ok: [aio]
2026-04-22 09:36:18.884020 | aio |
2026-04-22 09:36:18.884329 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-04-22 09:36:18.884720 | aio | Wednesday 22 April 2026  09:36:18 +0000 (0:00:14.315)       0:01:54.366 *******
2026-04-22 09:36:25.507672 | aio | ok: [aio]
2026-04-22 09:36:25.507719 | aio |
2026-04-22 09:36:25.507978 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-04-22 09:36:25.508323 | aio | Wednesday 22 April 2026  09:36:25 +0000 (0:00:06.624)       0:02:00.990 *******
2026-04-22 09:36:35.478166 | aio | ok: [aio] => (item={'name': 'diskprediction_local'})
2026-04-22 09:36:35.478399 | aio | ok: [aio] => (item={'name': 'dashboard'})
2026-04-22 09:36:35.478762 | aio | ok: [aio] => (item={'name': 'prometheus'})
2026-04-22 09:36:35.479046 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-04-22 09:36:35.479299 | aio |
2026-04-22 09:36:35.479570 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-04-22 09:36:35.479882 | aio |
2026-04-22 09:36:35.480161 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:36:35.480433 | aio | Wednesday 22 April 2026  09:36:35 +0000 (0:00:09.961)       0:02:10.951 *******
2026-04-22 09:36:36.539542 | aio | ok: [aio]
2026-04-22 09:36:36.539859 | aio |
2026-04-22 09:36:36.540133 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:36:36.540412 | aio | Wednesday 22 April 2026  09:36:36 +0000 (0:00:01.070)       0:02:12.022 *******
2026-04-22 09:36:36.861922 | aio | ok: [aio]
2026-04-22 09:36:36.862096 | aio |
2026-04-22 09:36:36.862361 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:36:36.862656 | aio | Wednesday 22 April 2026  09:36:36 +0000 (0:00:00.322)       0:02:12.345 *******
2026-04-22 09:36:36.908198 | aio | skipping: [aio]
2026-04-22 09:36:36.908394 | aio |
2026-04-22 09:36:36.908715 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-22 09:36:36.908975 | aio | Wednesday 22 April 2026  09:36:36 +0000 (0:00:00.046)       0:02:12.392 *******
2026-04-22 09:36:37.263436 | aio | ok: [aio]
2026-04-22 09:36:37.263646 | aio |
2026-04-22 09:36:37.263952 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:36:37.264245 | aio | Wednesday 22 April 2026  09:36:37 +0000 (0:00:00.354)       0:02:12.746 *******
2026-04-22 09:36:37.349033 | aio | ok: [aio] => {
2026-04-22 09:36:37.349298 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-22 09:36:37.349541 | aio | }
2026-04-22 09:36:37.349804 | aio |
2026-04-22 09:36:37.350061 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:36:37.350254 | aio | Wednesday 22 April 2026  09:36:37 +0000 (0:00:00.085)       0:02:12.832 *******
2026-04-22 09:36:37.846863 | aio | ok: [aio]
2026-04-22 09:36:37.847054 | aio |
2026-04-22 09:36:37.847315 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:36:37.847574 | aio | Wednesday 22 April 2026  09:36:37 +0000 (0:00:00.497)       0:02:13.330 *******
2026-04-22 09:36:37.902470 | aio | skipping: [aio]
2026-04-22 09:36:37.902812 | aio |
2026-04-22 09:36:37.903206 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:36:37.903593 | aio | Wednesday 22 April 2026  09:36:37 +0000 (0:00:00.055)       0:02:13.386 *******
2026-04-22 09:36:37.954591 | aio | skipping: [aio]
2026-04-22 09:36:37.954696 | aio |
2026-04-22 09:36:37.954817 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:36:37.954929 | aio | Wednesday 22 April 2026  09:36:37 +0000 (0:00:00.052)       0:02:13.438 *******
2026-04-22 09:36:38.308017 | aio | ok: [aio]
2026-04-22 09:36:38.308252 | aio |
2026-04-22 09:36:38.308726 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-22 09:36:38.309091 | aio | Wednesday 22 April 2026  09:36:38 +0000 (0:00:00.353)       0:02:13.791 *******
2026-04-22 09:36:39.757686 | aio | ok: [aio]
2026-04-22 09:36:39.757726 | aio |
2026-04-22 09:36:39.757732 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:36:39.757737 | aio | Wednesday 22 April 2026  09:36:39 +0000 (0:00:01.449)       0:02:15.240 *******
2026-04-22 09:36:39.919679 | aio | ok: [aio] => {
2026-04-22 09:36:39.919855 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-04-22 09:36:39.920022 | aio | }
2026-04-22 09:36:39.920180 | aio |
2026-04-22 09:36:39.920384 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:36:39.920544 | aio | Wednesday 22 April 2026  09:36:39 +0000 (0:00:00.162)       0:02:15.403 *******
2026-04-22 09:36:40.494053 | aio | ok: [aio]
2026-04-22 09:36:40.494182 | aio |
2026-04-22 09:36:40.494354 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:36:40.494519 | aio | Wednesday 22 April 2026  09:36:40 +0000 (0:00:00.574)       0:02:15.977 *******
2026-04-22 09:36:42.975805 | aio | ok: [aio]
2026-04-22 09:36:42.975882 | aio |
2026-04-22 09:36:42.975904 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-22 09:36:42.976229 | aio | Wednesday 22 April 2026  09:36:42 +0000 (0:00:02.480)       0:02:18.458 *******
2026-04-22 09:36:43.016692 | aio | skipping: [aio]
2026-04-22 09:36:43.017599 | aio |
2026-04-22 09:36:43.017656 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-22 09:36:43.017676 | aio | Wednesday 22 April 2026  09:36:43 +0000 (0:00:00.041)       0:02:18.500 *******
2026-04-22 09:36:43.056468 | aio | skipping: [aio]
2026-04-22 09:36:43.056793 | aio |
2026-04-22 09:36:43.057101 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-22 09:36:43.057414 | aio | Wednesday 22 April 2026  09:36:43 +0000 (0:00:00.038)       0:02:18.538 *******
2026-04-22 09:36:43.090394 | aio | skipping: [aio]
2026-04-22 09:36:43.090576 | aio |
2026-04-22 09:36:43.090755 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-22 09:36:43.090940 | aio | Wednesday 22 April 2026  09:36:43 +0000 (0:00:00.034)       0:02:18.572 *******
2026-04-22 09:36:44.527838 | aio | ok: [aio]
2026-04-22 09:36:44.527922 | aio |
2026-04-22 09:36:44.527933 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-22 09:36:44.527943 | aio | Wednesday 22 April 2026  09:36:44 +0000 (0:00:01.436)       0:02:20.009 *******
2026-04-22 09:36:45.255249 | aio | ok: [aio]
2026-04-22 09:36:45.255361 | aio |
2026-04-22 09:36:45.255478 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-22 09:36:45.255729 | aio | Wednesday 22 April 2026  09:36:45 +0000 (0:00:00.728)       0:02:20.737 *******
2026-04-22 09:36:46.810796 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-04-22 09:36:46.811774 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-22 09:36:46.811907 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-22 09:36:46.811927 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-22 09:36:46.811945 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-22 09:36:46.812684 | aio |
2026-04-22 09:36:46.812734 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-22 09:36:46.813028 | aio | Wednesday 22 April 2026  09:36:46 +0000 (0:00:01.556)       0:02:22.293 *******
2026-04-22 09:36:47.772351 | aio | ok: [aio]
2026-04-22 09:36:47.772647 | aio |
2026-04-22 09:36:47.772886 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-22 09:36:47.773142 | aio | Wednesday 22 April 2026  09:36:47 +0000 (0:00:00.954)       0:02:23.248 *******
2026-04-22 09:36:47.773360 | aio |
2026-04-22 09:36:47.773600 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-22 09:36:47.773845 | aio | Wednesday 22 April 2026  09:36:47 +0000 (0:00:00.007)       0:02:23.256 *******
2026-04-22 09:36:49.421449 | aio | ok: [aio]
2026-04-22 09:36:49.421542 | aio |
2026-04-22 09:36:49.421556 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-22 09:36:49.421570 | aio | Wednesday 22 April 2026  09:36:49 +0000 (0:00:01.648)       0:02:24.904 *******
2026-04-22 09:36:49.777212 | aio | ok: [aio]
2026-04-22 09:36:49.777271 | aio |
2026-04-22 09:36:49.777286 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-22 09:36:49.777299 | aio | Wednesday 22 April 2026  09:36:49 +0000 (0:00:00.355)       0:02:25.259 *******
2026-04-22 09:36:49.870299 | aio | ok: [aio] => {
2026-04-22 09:36:49.870388 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-22 09:36:49.870403 | aio | }
2026-04-22 09:36:49.870415 | aio |
2026-04-22 09:36:49.870429 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-22 09:36:49.870442 | aio | Wednesday 22 April 2026  09:36:49 +0000 (0:00:00.092)       0:02:25.351 *******
2026-04-22 09:36:50.421501 | aio | ok: [aio]
2026-04-22 09:36:50.421578 | aio |
2026-04-22 09:36:50.421592 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-22 09:36:50.421605 | aio | Wednesday 22 April 2026  09:36:50 +0000 (0:00:00.551)       0:02:25.903 *******
2026-04-22 09:36:54.027823 | aio | ok: [aio]
2026-04-22 09:36:54.027932 | aio |
2026-04-22 09:36:54.027947 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-22 09:36:54.027969 | aio | Wednesday 22 April 2026  09:36:54 +0000 (0:00:03.606)       0:02:29.510 *******
2026-04-22 09:36:55.291407 | aio | ok: [aio]
2026-04-22 09:36:55.291552 | aio |
2026-04-22 09:36:55.291881 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-22 09:36:55.292170 | aio | Wednesday 22 April 2026  09:36:55 +0000 (0:00:01.263)       0:02:30.774 *******
2026-04-22 09:36:55.639093 | aio | ok: [aio]
2026-04-22 09:36:55.639242 | aio |
2026-04-22 09:36:55.639487 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-22 09:36:55.639728 | aio | Wednesday 22 April 2026  09:36:55 +0000 (0:00:00.347)       0:02:31.122 *******
2026-04-22 09:36:56.396203 | aio | ok: [aio]
2026-04-22 09:36:56.396273 | aio |
2026-04-22 09:36:56.396284 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-22 09:36:56.396294 | aio | Wednesday 22 April 2026  09:36:56 +0000 (0:00:00.756)       0:02:31.878 *******
2026-04-22 09:36:57.359941 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-04-22 09:36:57.360016 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-22 09:36:57.360026 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-22 09:36:57.360036 | aio |
2026-04-22 09:36:57.360045 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-22 09:36:57.360054 | aio | Wednesday 22 April 2026  09:36:57 +0000 (0:00:00.961)       0:02:32.840 *******
2026-04-22 09:36:58.074354 | aio | ok: [aio]
2026-04-22 09:36:58.074420 | aio |
2026-04-22 09:36:58.074431 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-22 09:36:58.074441 | aio | Wednesday 22 April 2026  09:36:58 +0000 (0:00:00.715)       0:02:33.556 *******
2026-04-22 09:36:58.806764 | aio | ok: [aio]
2026-04-22 09:36:58.806824 | aio |
2026-04-22 09:36:58.806836 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-22 09:36:58.806847 | aio | Wednesday 22 April 2026  09:36:58 +0000 (0:00:00.725)       0:02:34.281 *******
2026-04-22 09:36:58.806856 | aio |
2026-04-22 09:36:58.806873 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-22 09:36:58.807223 | aio | Wednesday 22 April 2026  09:36:58 +0000 (0:00:00.006)       0:02:34.288 *******
2026-04-22 09:36:59.372676 | aio | ok: [aio]
2026-04-22 09:36:59.372761 | aio |
2026-04-22 09:36:59.373112 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-22 09:36:59.373161 | aio | Wednesday 22 April 2026  09:36:59 +0000 (0:00:00.566)       0:02:34.855 *******
2026-04-22 09:36:59.443721 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-04-22 09:36:59.444534 | aio |
2026-04-22 09:36:59.444587 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] ****
2026-04-22 09:36:59.444598 | aio | Wednesday 22 April 2026  09:36:59 +0000 (0:00:00.070)       0:02:34.926 *******
2026-04-22 09:36:59.485062 | aio | skipping: [aio]
2026-04-22 09:36:59.485096 | aio |
2026-04-22 09:36:59.485103 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-22 09:36:59.485110 | aio | Wednesday 22 April 2026  09:36:59 +0000 (0:00:00.040)       0:02:34.966 *******
2026-04-22 09:37:00.783805 | aio | ok: [aio]
2026-04-22 09:37:00.783882 | aio |
2026-04-22 09:37:00.783896 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-22 09:37:00.783916 | aio | Wednesday 22 April 2026  09:37:00 +0000 (0:00:01.299)       0:02:36.266 *******
2026-04-22 09:37:01.805147 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-04-22 09:37:01.805236 | aio | ok: [aio] => (item=ssh)
2026-04-22 09:37:01.805295 | aio |
2026-04-22 09:37:01.805423 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-22 09:37:01.805536 | aio | Wednesday 22 April 2026  09:37:01 +0000 (0:00:01.022)       0:02:37.288 *******
2026-04-22 09:37:02.455158 | aio | ok: [aio]
2026-04-22 09:37:02.455342 | aio |
2026-04-22 09:37:02.455563 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-04-22 09:37:02.455797 | aio | Wednesday 22 April 2026  09:37:02 +0000 (0:00:00.649)       0:02:37.937 *******
2026-04-22 09:37:02.796385 | aio | ok: [aio]
2026-04-22 09:37:02.796453 | aio |
2026-04-22 09:37:02.796467 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-04-22 09:37:02.796480 | aio | Wednesday 22 April 2026  09:37:02 +0000 (0:00:00.340)       0:02:38.278 *******
2026-04-22 09:37:03.214743 | aio | ok: [aio]
2026-04-22 09:37:03.214804 | aio |
2026-04-22 09:37:03.214810 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-04-22 09:37:03.214816 | aio | Wednesday 22 April 2026  09:37:03 +0000 (0:00:00.418)       0:02:38.697 *******
2026-04-22 09:37:03.547185 | aio | ok: [aio]
2026-04-22 09:37:03.547282 | aio |
2026-04-22 09:37:03.547298 | aio | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-04-22 09:37:03.547443 | aio | Wednesday 22 April 2026  09:37:03 +0000 (0:00:00.332)       0:02:39.030 *******
2026-04-22 09:37:03.924522 | aio | ok: [aio] => (item=aio)
2026-04-22 09:37:03.924594 | aio |
2026-04-22 09:37:03.924605 | aio | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-04-22 09:37:03.924615 | aio | Wednesday 22 April 2026  09:37:03 +0000 (0:00:00.374)       0:02:39.404 *******
2026-04-22 09:37:03.985030 | aio | ok: [aio]
2026-04-22 09:37:03.985135 | aio |
2026-04-22 09:37:03.985146 | aio | TASK [Install Ceph host] *******************************************************
2026-04-22 09:37:03.985156 | aio | Wednesday 22 April 2026  09:37:03 +0000 (0:00:00.062)       0:02:39.467 *******
2026-04-22 09:37:04.062877 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-04-22 09:37:04.062926 | aio |
2026-04-22 09:37:04.062934 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-04-22 09:37:04.062941 | aio | Wednesday 22 April 2026  09:37:04 +0000 (0:00:00.078)       0:02:39.545 *******
2026-04-22 09:37:04.114576 | aio | skipping: [aio]
2026-04-22 09:37:04.114604 | aio |
2026-04-22 09:37:04.114611 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-04-22 09:37:04.114617 | aio | Wednesday 22 April 2026  09:37:04 +0000 (0:00:00.051)       0:02:39.597 *******
2026-04-22 09:37:04.171384 | aio | skipping: [aio] => (item=aio)
2026-04-22 09:37:04.171434 | aio | skipping: [aio]
2026-04-22 09:37:04.171446 | aio |
2026-04-22 09:37:04.171455 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-04-22 09:37:04.171465 | aio | Wednesday 22 April 2026  09:37:04 +0000 (0:00:00.056)       0:02:39.653 *******
2026-04-22 09:37:04.598787 | aio | ok: [aio]
2026-04-22 09:37:04.598827 | aio |
2026-04-22 09:37:04.598832 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-04-22 09:37:04.598837 | aio | Wednesday 22 April 2026  09:37:04 +0000 (0:00:00.425)       0:02:40.079 *******
2026-04-22 09:37:11.893310 | aio | ok: [aio]
2026-04-22 09:37:11.893375 | aio |
2026-04-22 09:37:11.893389 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-04-22 09:37:11.893402 | aio | Wednesday 22 April 2026  09:37:11 +0000 (0:00:07.296)       0:02:47.376 *******
2026-04-22 09:37:17.724389 | aio | ok: [aio]
2026-04-22 09:37:17.724467 | aio |
2026-04-22 09:37:17.724481 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-04-22 09:37:17.724494 | aio | Wednesday 22 April 2026  09:37:17 +0000 (0:00:05.830)       0:02:53.206 *******
2026-04-22 09:37:32.405823 | aio | ok: [aio]
2026-04-22 09:37:32.405894 | aio |
2026-04-22 09:37:32.405901 | aio | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-04-22 09:37:32.405908 | aio | Wednesday 22 April 2026  09:37:32 +0000 (0:00:14.682)       0:03:07.888 *******
2026-04-22 09:37:32.486049 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-04-22 09:37:32.486125 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-04-22 09:37:32.486137 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-04-22 09:37:32.486149 | aio | skipping: [aio]
2026-04-22 09:37:32.486161 | aio |
2026-04-22 09:37:32.486173 | aio | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-04-22 09:37:32.486185 | aio | Wednesday 22 April 2026  09:37:32 +0000 (0:00:00.078)       0:03:07.967 *******
2026-04-22 09:37:39.527838 | aio | ok: [aio]
2026-04-22 09:37:39.527926 | aio |
2026-04-22 09:37:39.528479 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-04-22 09:37:39.528547 | aio | Wednesday 22 April 2026  09:37:39 +0000 (0:00:07.043)       0:03:15.010 *******
2026-04-22 09:37:46.183762 | aio | ok: [aio]
2026-04-22 09:37:46.183836 | aio |
2026-04-22 09:37:46.184279 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-04-22 09:37:46.184342 | aio | Wednesday 22 April 2026  09:37:46 +0000 (0:00:06.656)       0:03:21.666 *******
2026-04-22 09:37:46.258253 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio
2026-04-22 09:37:46.258314 | aio |
2026-04-22 09:37:46.258326 | aio | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-04-22 09:37:46.258336 | aio | Wednesday 22 April 2026  09:37:46 +0000 (0:00:00.074)       0:03:21.740 *******
2026-04-22 09:37:46.306184 | aio | ok: [aio]
2026-04-22 09:37:46.306243 | aio |
2026-04-22 09:37:46.306254 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-04-22 09:37:46.306264 | aio | Wednesday 22 April 2026  09:37:46 +0000 (0:00:00.048)       0:03:21.788 *******
2026-04-22 09:37:52.968155 | aio | ok: [aio]
2026-04-22 09:37:52.968234 | aio |
2026-04-22 09:37:52.968248 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-04-22 09:37:52.968260 | aio | Wednesday 22 April 2026  09:37:52 +0000 (0:00:06.660)       0:03:28.449 *******
2026-04-22 09:37:53.020306 | aio | ok: [aio]
2026-04-22 09:37:53.020371 | aio |
2026-04-22 09:37:53.020386 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-04-22 09:37:53.020400 | aio | Wednesday 22 April 2026  09:37:53 +0000 (0:00:00.052)       0:03:28.502 *******
2026-04-22 09:37:53.070693 | aio | skipping: [aio] => (item=1)
2026-04-22 09:37:53.070727 | aio | skipping: [aio] => (item=1)
2026-04-22 09:37:53.070839 | aio | skipping: [aio] => (item=1)
2026-04-22 09:37:53.071166 | aio | skipping: [aio]
2026-04-22 09:37:53.071476 | aio |
2026-04-22 09:37:53.071850 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-04-22 09:37:53.072191 | aio | Wednesday 22 April 2026  09:37:53 +0000 (0:00:00.050)       0:03:28.552 *******
2026-04-22 09:37:53.113226 | aio | skipping: [aio]
2026-04-22 09:37:53.113555 | aio |
2026-04-22 09:37:53.113904 | aio | PLAY RECAP *********************************************************************
2026-04-22 09:37:53.114277 | aio | aio                        : ok=95   changed=0    unreachable=0    failed=0    skipped=22   rescued=0    ignored=0
2026-04-22 09:37:53.114570 | aio |
2026-04-22 09:37:53.116665 | aio |
2026-04-22 09:37:53.116694 | aio | TASKS RECAP ********************************************************************
2026-04-22 09:37:53.116707 | aio | Wednesday 22 April 2026  09:37:53 +0000 (0:00:00.044)       0:03:28.596 *******
2026-04-22 09:37:53.116718 | aio | ===============================================================================
2026-04-22 09:37:53.116730 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 25.19s
2026-04-22 09:37:53.116741 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.68s
2026-04-22 09:37:53.116752 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 14.32s
2026-04-22 09:37:53.116763 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 14.20s
2026-04-22 09:37:53.117007 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.56s
2026-04-22 09:37:53.117316 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.97s
2026-04-22 09:37:53.117655 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 9.96s
2026-04-22 09:37:53.117981 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 7.97s
2026-04-22 09:37:53.118330 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.30s
2026-04-22 09:37:53.118673 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 7.04s
2026-04-22 09:37:53.118991 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.66s
2026-04-22 09:37:53.119298 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.66s
2026-04-22 09:37:53.119609 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.62s
2026-04-22 09:37:53.119951 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.83s
2026-04-22 09:37:53.120262 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.54s
2026-04-22 09:37:53.120599 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.61s
2026-04-22 09:37:53.120950 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.69s
2026-04-22 09:37:53.121265 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.48s
2026-04-22 09:37:53.121567 | aio | vexxhost.containers.containerd : Create folders for configuration ------- 1.71s
2026-04-22 09:37:53.121902 | aio | vexxhost.containers.containerd : Enable and start service --------------- 1.65s
2026-04-22 09:37:53.406271 | aio | INFO     [default > idempotence] Executed: Successful
2026-04-22 09:37:53.419352 | aio | INFO     [default > side_effect] Executing
2026-04-22 09:37:53.419751 | aio | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-22 09:37:53.425621 | aio | INFO     [default > verify] Executing
2026-04-22 09:37:54.495115 | aio |
2026-04-22 09:37:54.495554 | aio | PLAY [Verify] ******************************************************************
2026-04-22 09:37:54.495894 | aio |
2026-04-22 09:37:54.496509 | aio | TASK [Gathering Facts] *********************************************************
2026-04-22 09:37:54.496981 | aio | Wednesday 22 April 2026  09:37:54 +0000 (0:00:00.010)       0:00:00.010 *******
2026-04-22 09:37:55.771962 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.12', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information.
2026-04-22 09:37:55.779053 | aio | ok: [aio]
2026-04-22 09:37:55.779805 | aio |
2026-04-22 09:37:55.779834 | aio | TASK [Get cluster health status] ***********************************************
2026-04-22 09:37:55.780148 | aio | Wednesday 22 April 2026  09:37:55 +0000 (0:00:01.283)       0:00:01.294 *******
2026-04-22 09:38:06.956038 | aio | ok: [aio]
2026-04-22 09:38:06.956210 | aio |
2026-04-22 09:38:06.956471 | aio | TASK [Print cluster health status] *********************************************
2026-04-22 09:38:06.956761 | aio | Wednesday 22 April 2026  09:38:06 +0000 (0:00:11.176)       0:00:12.471 *******
2026-04-22 09:38:07.003142 | aio | ok: [aio] => {
2026-04-22 09:38:07.003249 | aio |     "_ceph_health": {
2026-04-22 09:38:07.003263 | aio |         "changed": false,
2026-04-22 09:38:07.003318 | aio |         "cmd": [
2026-04-22 09:38:07.003444 | aio |             "cephadm",
2026-04-22 09:38:07.003544 | aio |             "shell",
2026-04-22 09:38:07.003651 | aio |             "--",
2026-04-22 09:38:07.003770 | aio |             "ceph",
2026-04-22 09:38:07.003913 | aio |             "health"
2026-04-22 09:38:07.004023 | aio |         ],
2026-04-22 09:38:07.004133 | aio |         "delta": "0:00:10.736794",
2026-04-22 09:38:07.004240 | aio |         "end": "2026-04-22 09:38:06.902936",
2026-04-22 09:38:07.004348 | aio |         "failed": false,
2026-04-22 09:38:07.004455 | aio |         "msg": "",
2026-04-22 09:38:07.004559 | aio |         "rc": 0,
2026-04-22 09:38:07.004687 | aio |         "start": "2026-04-22 09:37:56.166142",
2026-04-22 09:38:07.004811 | aio |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config",
2026-04-22 09:38:07.004935 | aio |         "stderr_lines": [
2026-04-22 09:38:07.005048 | aio |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-04-22 09:38:07.005170 | aio |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config"
2026-04-22 09:38:07.005274 | aio |         ],
2026-04-22 09:38:07.005383 | aio |         "stdout": "HEALTH_OK",
2026-04-22 09:38:07.005490 | aio |         "stdout_lines": [
2026-04-22 09:38:07.005596 | aio |             "HEALTH_OK"
2026-04-22 09:38:07.005760 | aio |         ]
2026-04-22 09:38:07.005855 | aio |     }
2026-04-22 09:38:07.005967 | aio | }
2026-04-22 09:38:07.006079 | aio |
2026-04-22 09:38:07.006182 | aio | TASK [Assert that the cluster status is healthy] *******************************
2026-04-22 09:38:07.006294 | aio | Wednesday 22 April 2026  09:38:06 +0000 (0:00:00.047)       0:00:12.518 *******
2026-04-22 09:38:07.033735 | aio | ok: [aio] => {
2026-04-22 09:38:07.033837 | aio |     "changed": false,
2026-04-22 09:38:07.034194 | aio |     "msg": "All assertions passed"
2026-04-22 09:38:07.034344 | aio | }
2026-04-22 09:38:07.034587 | aio |
2026-04-22 09:38:07.034851 | aio | TASK [Create a test Ceph pool] *************************************************
2026-04-22 09:38:07.035094 | aio | Wednesday 22 April 2026  09:38:07 +0000 (0:00:00.030)       0:00:12.549 *******
2026-04-22 09:38:14.018207 | aio | changed: [aio]
2026-04-22 09:38:14.018348 | aio |
2026-04-22 09:38:14.018363 | aio | TASK [Create a test Ceph key] **************************************************
2026-04-22 09:38:14.018376 | aio | Wednesday 22 April 2026  09:38:14 +0000 (0:00:06.983)       0:00:19.533 *******
2026-04-22 09:38:16.979007 | aio | changed: [aio]
2026-04-22 09:38:16.979275 | aio |
2026-04-22 09:38:16.979293 | aio | TASK [Retrieve info for the test Ceph key] *************************************
2026-04-22 09:38:16.979309 | aio | Wednesday 22 April 2026  09:38:16 +0000 (0:00:02.958)       0:00:22.491 *******
2026-04-22 09:38:18.511678 | aio | ok: [aio]
2026-04-22 09:38:18.511742 | aio |
2026-04-22 09:38:18.511751 | aio | TASK [Assert that key_info returns the correct key] ****************************
2026-04-22 09:38:18.511759 | aio | Wednesday 22 April 2026  09:38:18 +0000 (0:00:01.533)       0:00:24.025 *******
2026-04-22 09:38:18.559246 | aio | ok: [aio] => {
2026-04-22 09:38:18.559357 | aio |     "changed": false,
2026-04-22 09:38:18.559582 | aio |     "msg": "All assertions passed"
2026-04-22 09:38:18.559697 | aio | }
2026-04-22 09:38:18.559914 | aio |
2026-04-22 09:38:18.559988 | aio | PLAY RECAP *********************************************************************
2026-04-22 09:38:18.560193 | aio | aio                        : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-22 09:38:18.560318 | aio |
2026-04-22 09:38:18.560477 | aio |
2026-04-22 09:38:18.560658 | aio | TASKS RECAP ********************************************************************
2026-04-22 09:38:18.560850 | aio | Wednesday 22 April 2026  09:38:18 +0000 (0:00:00.048)       0:00:24.073 *******
2026-04-22 09:38:18.560998 | aio | ===============================================================================
2026-04-22 09:38:18.561150 | aio | Get cluster health status ---------------------------------------------- 11.18s
2026-04-22 09:38:18.561300 | aio | Create a test Ceph pool ------------------------------------------------- 6.98s
2026-04-22 09:38:18.561458 | aio | Create a test Ceph key -------------------------------------------------- 2.96s
2026-04-22 09:38:18.564687 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.53s
2026-04-22 09:38:18.564891 | aio | Gathering Facts --------------------------------------------------------- 1.28s
2026-04-22 09:38:18.565065 | aio | Assert that key_info returns the correct key ---------------------------- 0.05s
2026-04-22 09:38:18.565226 | aio | Print cluster health status --------------------------------------------- 0.05s
2026-04-22 09:38:18.565388 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-04-22 09:38:18.678515 | aio | INFO     [default > verify] Executed: Successful
2026-04-22 09:38:18.683953 | aio | INFO     [default > cleanup] Executing
2026-04-22 09:38:18.684279 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-22 09:38:18.690008 | aio | INFO     [default > destroy] Executing
2026-04-22 09:38:18.690061 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-22 09:38:18.690220 | aio | INFO     [default > destroy] Executed: Successful
2026-04-22 09:38:18.690450 | aio | WARNING  Molecule executed 1 scenario (1 missing files)
2026-04-22 09:38:19.160923 | aio | ok: Runtime: 0:15:17.513713
2026-04-22 09:38:19.175299 | 
2026-04-22 09:38:19.175351 | PLAY RECAP
2026-04-22 09:38:19.175398 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-22 09:38:19.175420 | 
2026-04-22 09:38:19.309873 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-22 09:38:19.313830 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-22 09:38:19.920076 | 
2026-04-22 09:38:19.920227 | PLAY [all]
2026-04-22 09:38:19.932538 | 
2026-04-22 09:38:19.932635 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-22 09:38:19.978752 | aio | skipping: Conditional result was False
2026-04-22 09:38:19.992108 | 
2026-04-22 09:38:19.992191 | TASK [fetch-output : Set log path for single node]
2026-04-22 09:38:20.037847 | aio | ok
2026-04-22 09:38:20.043383 | 
2026-04-22 09:38:20.043449 | LOOP [fetch-output : Ensure local output dirs]
2026-04-22 09:38:20.456070 | aio -> localhost | ok: "/var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/logs"
2026-04-22 09:38:20.674670 | aio -> localhost | changed: "/var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/artifacts"
2026-04-22 09:38:20.887520 | aio -> localhost | changed: "/var/lib/zuul/builds/e14b68e80c2345c29645cc0b096ecb38/work/docs"
2026-04-22 09:38:20.906727 | 
2026-04-22 09:38:20.906913 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-22 09:38:21.599786 | aio | changed: .d..t...... ./
2026-04-22 09:38:21.600027 | aio | changed: All items complete
2026-04-22 09:38:21.600067 | 
2026-04-22 09:38:22.090213 | aio | changed: .d..t...... ./
2026-04-22 09:38:22.573817 | aio | changed: .d..t...... ./
2026-04-22 09:38:22.590419 | 
2026-04-22 09:38:22.590585 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-22 09:38:23.041750 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.008462
2026-04-22 09:38:23.272694 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.009669
2026-04-22 09:38:23.286832 | 
2026-04-22 09:38:23.287060 | PLAY [all]
2026-04-22 09:38:23.293887 | 
2026-04-22 09:38:23.293963 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-22 09:38:23.797911 | aio | changed
2026-04-22 09:38:23.804199 | 
2026-04-22 09:38:23.804253 | PLAY RECAP
2026-04-22 09:38:23.804302 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-22 09:38:23.804324 | 
2026-04-22 09:38:23.968819 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-22 09:38:23.974012 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-22 09:38:24.512902 | 
2026-04-22 09:38:24.513035 | PLAY [localhost]
2026-04-22 09:38:24.522511 | 
2026-04-22 09:38:24.522582 | TASK [Generate Zuul manifest]
2026-04-22 09:38:24.540651 | localhost | ok
2026-04-22 09:38:24.554892 | 
2026-04-22 09:38:24.554968 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-22 09:38:25.082068 | localhost | changed
2026-04-22 09:38:25.094468 | 
2026-04-22 09:38:25.094543 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-22 09:38:25.392537 | localhost | ok
2026-04-22 09:38:25.401237 | 
2026-04-22 09:38:25.401322 | TASK [Upload logs]
2026-04-22 09:38:25.421263 | localhost | ok
2026-04-22 09:38:25.480295 | 
2026-04-22 09:38:25.480402 | TASK [Set zuul-log-path fact]
2026-04-22 09:38:25.502534 | localhost | ok
2026-04-22 09:38:25.517272 | 
2026-04-22 09:38:25.517343 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-22 09:38:25.550600 | localhost | ok
2026-04-22 09:38:25.560228 | 
2026-04-22 09:38:25.560301 | TASK [upload-logs : Create log directories]
2026-04-22 09:38:25.984937 | localhost | changed
2026-04-22 09:38:25.989614 | 
2026-04-22 09:38:25.989681 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-22 09:38:26.405012 | localhost -> localhost | ok: Runtime: 0:00:00.005365
2026-04-22 09:38:26.409704 | 
2026-04-22 09:38:26.409768 | TASK [upload-logs : Upload logs to log server]
2026-04-22 09:38:26.885753 | localhost | Output suppressed because no_log was given
2026-04-22 09:38:26.890665 | 
2026-04-22 09:38:26.890755 | LOOP [upload-logs : Compress console log and json output]
2026-04-22 09:38:26.942012 | localhost | skipping: Conditional result was False
2026-04-22 09:38:26.949654 | localhost | skipping: Conditional result was False
2026-04-22 09:38:26.965382 | 
2026-04-22 09:38:26.965555 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-22 09:38:27.007238 | localhost | skipping: Conditional result was False
2026-04-22 09:38:27.007641 | 
2026-04-22 09:38:27.011691 | localhost | skipping: Conditional result was False
2026-04-22 09:38:27.019438 | 
2026-04-22 09:38:27.019583 | LOOP [upload-logs : Upload console log and json output]