2026-03-05 20:57:47.149688 | Job console starting 2026-03-05 20:57:47.158872 | Updating git repos 2026-03-05 20:57:47.186716 | Cloning repos into workspace 2026-03-05 20:57:47.248442 | Restoring repo states 2026-03-05 20:57:47.256220 | Merging changes 2026-03-05 20:57:47.537207 | Checking out repos 2026-03-05 20:57:47.580861 | Preparing playbooks 2026-03-05 20:57:48.758247 | Running Ansible setup 2026-03-05 20:57:52.093965 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:57:52.659051 | 2026-03-05 20:57:52.659180 | PLAY [localhost] 2026-03-05 20:57:52.666814 | 2026-03-05 20:57:52.666884 | TASK [Gathering Facts] 2026-03-05 20:57:53.568907 | localhost | ok 2026-03-05 20:57:53.579415 | 2026-03-05 20:57:53.579551 | TASK [Setup log path fact] 2026-03-05 20:57:53.602039 | localhost | ok 2026-03-05 20:57:53.617460 | 2026-03-05 20:57:53.617593 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 20:57:53.647932 | localhost | ok 2026-03-05 20:57:53.657289 | 2026-03-05 20:57:53.657416 | TASK [emit-job-header : Print job information] 2026-03-05 20:57:53.699628 | # Job Information 2026-03-05 20:57:53.699881 | Ansible Version: 2.16.16 2026-03-05 20:57:53.699954 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-03-05 20:57:53.700003 | Pipeline: check 2026-03-05 20:57:53.700048 | Executor: 0a8996d2b663 2026-03-05 20:57:53.700091 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-03-05 20:57:53.700139 | Event ID: d6e15bb0-18d5-11f1-98b1-d42532538547 2026-03-05 20:57:53.706152 | 2026-03-05 20:57:53.706225 | LOOP [emit-job-header : Print node information] 2026-03-05 20:57:53.807364 | localhost | ok: 2026-03-05 20:57:53.807567 | localhost | # Node Information 2026-03-05 20:57:53.807607 | localhost | Inventory Hostname: aio 2026-03-05 20:57:53.807639 | localhost | Hostname: np0000157940 2026-03-05 20:57:53.807667 | localhost | Username: zuul 2026-03-05 20:57:53.807699 | localhost | Distro: Ubuntu 22.04 2026-03-05 20:57:53.807728 | localhost | Provider: yul1 2026-03-05 20:57:53.807756 | localhost | Region: ca-ymq-1 2026-03-05 20:57:53.807870 | localhost | Label: ubuntu-jammy 2026-03-05 20:57:53.807928 | localhost | Product Name: OpenStack Nova 2026-03-05 20:57:53.807961 | localhost | Interface IP: 162.253.55.140 2026-03-05 20:57:53.826268 | 2026-03-05 20:57:53.826390 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 20:57:54.198351 | localhost -> localhost | changed 2026-03-05 20:57:54.205848 | 2026-03-05 20:57:54.205944 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 20:57:55.047208 | localhost -> localhost | changed 2026-03-05 20:57:55.057829 | 2026-03-05 20:57:55.057904 | PLAY [all] 2026-03-05 20:57:55.070459 | 2026-03-05 20:57:55.070592 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 20:57:55.288841 | aio -> localhost | ok 2026-03-05 20:57:55.298434 | 2026-03-05 20:57:55.298501 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 20:57:55.333255 | aio | ok 2026-03-05 20:57:55.349265 | aio | included: /var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 20:57:55.354920 | 2026-03-05 20:57:55.354981 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 20:57:56.218897 | aio -> localhost | Generating public/private rsa key pair. 2026-03-05 20:57:56.219111 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/a5d16f02d37c4c94ac51ba8918eac8e4_id_rsa 2026-03-05 20:57:56.219156 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/a5d16f02d37c4c94ac51ba8918eac8e4_id_rsa.pub 2026-03-05 20:57:56.219191 | aio -> localhost | The key fingerprint is: 2026-03-05 20:57:56.219223 | aio -> localhost | SHA256:72muys7KcQ+pi8BW6fClQTFIFsa/6U8pPPlG75z9Ryw zuul-build-sshkey 2026-03-05 20:57:56.219269 | aio -> localhost | The key's randomart image is: 2026-03-05 20:57:56.219301 | aio -> localhost | +---[RSA 3072]----+ 2026-03-05 20:57:56.219337 | aio -> localhost | |o=oo | 2026-03-05 20:57:56.219471 | aio -> localhost | |oo o | 2026-03-05 20:57:56.219558 | aio -> localhost | | .. | 2026-03-05 20:57:56.219700 | aio -> localhost | | ... | 2026-03-05 20:57:56.219762 | aio -> localhost | | . +o. S . | 2026-03-05 20:57:56.219797 | aio -> localhost | |. *o=... . E o | 2026-03-05 20:57:56.219829 | aio -> localhost | |.o.Ooo= . o | 2026-03-05 20:57:56.219860 | aio -> localhost | |.. +=B.+o... . | 2026-03-05 20:57:56.219893 | aio -> localhost | | . B**=o==.. | 2026-03-05 20:57:56.219923 | aio -> localhost | +----[SHA256]-----+ 2026-03-05 20:57:56.220011 | aio -> localhost | ok: Runtime: 0:00:00.449721 2026-03-05 20:57:56.228153 | 2026-03-05 20:57:56.228379 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 20:57:56.265086 | aio | ok 2026-03-05 20:57:56.279533 | aio | included: /var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 20:57:56.290461 | 2026-03-05 20:57:56.290525 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 20:57:56.316352 | aio | skipping: Conditional result was False 2026-03-05 20:57:56.326830 | 2026-03-05 20:57:56.326900 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 20:57:56.772004 | aio | changed 2026-03-05 20:57:56.778481 | 2026-03-05 20:57:56.778565 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 20:57:56.974243 | aio | ok 2026-03-05 20:57:56.980929 | 2026-03-05 20:57:56.981039 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 20:57:57.447305 | aio | changed 2026-03-05 20:57:57.453983 | 2026-03-05 20:57:57.454066 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 20:57:57.891807 | aio | changed 2026-03-05 20:57:57.897142 | 2026-03-05 20:57:57.897216 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 20:57:57.921285 | aio | skipping: Conditional result was False 2026-03-05 20:57:57.931504 | 2026-03-05 20:57:57.931591 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 20:57:58.349917 | aio -> localhost | changed 2026-03-05 20:57:58.364785 | 2026-03-05 20:57:58.364868 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 20:57:58.632928 | aio -> localhost | Identity added: /var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/a5d16f02d37c4c94ac51ba8918eac8e4_id_rsa (zuul-build-sshkey) 2026-03-05 20:57:58.633286 | aio -> localhost | ok: Runtime: 0:00:00.015281 2026-03-05 20:57:58.641285 | 2026-03-05 20:57:58.641350 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 20:57:58.968888 | aio | ok 2026-03-05 20:57:58.976823 | 2026-03-05 20:57:58.976912 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 20:57:59.012122 | aio | skipping: Conditional result was False 2026-03-05 20:57:59.037447 | 2026-03-05 20:57:59.037612 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 20:57:59.357535 | aio | ok 2026-03-05 20:57:59.364919 | 2026-03-05 20:57:59.365036 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 20:58:00.098922 | aio | Output suppressed because no_log was given 2026-03-05 20:58:00.116172 | 2026-03-05 20:58:00.116331 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 20:58:00.298571 | aio | ok: "logs" 2026-03-05 20:58:00.298851 | aio | ok: All items complete 2026-03-05 20:58:00.298890 | 2026-03-05 20:58:00.456168 | aio | ok: "artifacts" 2026-03-05 20:58:00.614728 | aio | ok: "docs" 2026-03-05 20:58:00.630842 | 2026-03-05 20:58:00.631022 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 20:58:00.866429 | aio | changed: "logs" 2026-03-05 20:58:01.019104 | aio | changed: "artifacts" 2026-03-05 20:58:01.171536 | aio | changed: "docs" 2026-03-05 20:58:01.183568 | 2026-03-05 20:58:01.184132 | PLAY RECAP 2026-03-05 20:58:01.184206 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 20:58:01.184239 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:01.184263 | 2026-03-05 20:58:01.363847 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:58:01.367348 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:01.955799 | 2026-03-05 20:58:01.955997 | PLAY [all] 2026-03-05 20:58:01.968863 | 2026-03-05 20:58:01.968953 | TASK [setup-uv : Extract archive] 2026-03-05 20:58:04.105782 | aio | changed 2026-03-05 20:58:04.114960 | 2026-03-05 20:58:04.115089 | TASK [setup-uv : Print version] 2026-03-05 20:58:03.564886 | aio | uv 0.8.13 2026-03-05 20:58:04.650194 | aio | ok: Runtime: 0:00:00.012743 2026-03-05 20:58:04.659314 | 2026-03-05 20:58:04.659379 | PLAY RECAP 2026-03-05 20:58:04.659427 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:04.659454 | 2026-03-05 20:58:04.796379 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:04.798923 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 20:58:05.438374 | 2026-03-05 20:58:05.438562 | PLAY [all] 2026-03-05 20:58:05.456623 | 2026-03-05 20:58:05.456816 | TASK [Copy inventory file for Zuul] 2026-03-05 20:58:06.250368 | aio | changed 2026-03-05 20:58:06.256954 | 2026-03-05 20:58:06.262831 | TASK [Switch "ansible_host" to private IP] 2026-03-05 20:58:06.528795 | aio | changed: 1 replacements made 2026-03-05 20:58:06.536500 | 2026-03-05 20:58:06.536592 | TASK [Run Molecule scenario] 2026-03-05 20:58:06.249702 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 20:58:07.012481 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 20:58:07.194239 | aio | Using CPython 3.13.7 2026-03-05 20:58:07.194282 | aio | Creating virtual environment at: .venv 2026-03-05 20:58:07.460398 | aio | Downloading pygments (1.2MiB) 2026-03-05 20:58:07.461383 | aio | Downloading cryptography (4.3MiB) 2026-03-05 20:58:07.465322 | aio | Downloading ansible-core (2.1MiB) 2026-03-05 20:58:07.465933 | aio | Downloading netaddr (2.2MiB) 2026-03-05 20:58:07.626632 | aio | Downloading netaddr 2026-03-05 20:58:07.636031 | aio | Downloading cryptography 2026-03-05 20:58:07.677126 | aio | Downloading pygments 2026-03-05 20:58:07.796744 | aio | Downloading ansible-core 2026-03-05 20:58:07.824240 | aio | Installed 36 packages in 26ms 2026-03-05 20:58:08.933874 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 20:58:08.933956 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 20:58:09.536660 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 20:58:09.536722 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 20:58:22.352988 | aio | INFO [default > dependency] Executing 2026-03-05 20:58:22.353087 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 20:58:22.353323 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 20:58:22.353373 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 20:58:22.358418 | aio | INFO [default > cleanup] Executing 2026-03-05 20:58:22.358691 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:58:22.363684 | aio | INFO [default > destroy] Executing 2026-03-05 20:58:22.363753 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 20:58:22.363772 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 20:58:22.368667 | aio | INFO [default > syntax] Executing 2026-03-05 20:58:23.291032 | aio | 2026-03-05 20:58:23.291330 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 20:58:23.343534 | aio | INFO [default > syntax] Executed: Successful 2026-03-05 20:58:23.353955 | aio | INFO [default > create] Executing 2026-03-05 20:58:23.355391 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:58:23.360140 | aio | INFO [default > prepare] Executing 2026-03-05 20:58:24.017161 | aio | 2026-03-05 20:58:24.017499 | aio | PLAY [Prepare] ***************************************************************** 2026-03-05 20:58:24.017624 | aio | 2026-03-05 20:58:24.017892 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:58:24.018062 | aio | Thursday 05 March 2026 20:58:24 +0000 (0:00:00.036) 0:00:00.036 ******** 2026-03-05 20:58:25.144997 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 20:58:25.145229 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 20:58:25.145448 | aio | interpreter could change the meaning of that path. See 2026-03-05 20:58:25.145657 | aio | https://docs.ansible.com/ansible- 2026-03-05 20:58:25.145879 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:58:25.153304 | aio | ok: [aio] 2026-03-05 20:58:25.153524 | aio | 2026-03-05 20:58:25.153753 | aio | TASK [Configure short hostname] ************************************************ 2026-03-05 20:58:25.153978 | aio | Thursday 05 March 2026 20:58:25 +0000 (0:00:01.136) 0:00:01.173 ******** 2026-03-05 20:58:25.837258 | aio | changed: [aio] 2026-03-05 20:58:25.837339 | aio | 2026-03-05 20:58:25.837490 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 20:58:25.837632 | aio | Thursday 05 March 2026 20:58:25 +0000 (0:00:00.683) 0:00:01.857 ******** 2026-03-05 20:58:26.113833 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 20:58:26.113902 | aio | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 20:58:26.113909 | aio | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 20:58:26.121061 | aio | changed: [aio] 2026-03-05 20:58:26.121258 | aio | 2026-03-05 20:58:26.121465 | aio | TASK [Update apt cache] ******************************************************** 2026-03-05 20:58:26.121683 | aio | Thursday 05 March 2026 20:58:26 +0000 (0:00:00.284) 0:00:02.141 ******** 2026-03-05 20:58:32.770513 | aio | changed: [aio] 2026-03-05 20:58:32.770587 | aio | 2026-03-05 20:58:32.770680 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 20:58:32.770792 | aio | 2026-03-05 20:58:32.770941 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:58:32.771075 | aio | Thursday 05 March 2026 20:58:32 +0000 (0:00:06.639) 0:00:08.781 ******** 2026-03-05 20:58:33.429913 | aio | ok: [aio] 2026-03-05 20:58:33.430036 | aio | 2026-03-05 20:58:33.430187 | aio | TASK [Install depedencies] ***************************************************** 2026-03-05 20:58:33.430336 | aio | Thursday 05 March 2026 20:58:33 +0000 (0:00:00.669) 0:00:09.450 ******** 2026-03-05 20:59:04.223565 | aio | changed: [aio] 2026-03-05 20:59:04.223757 | aio | 2026-03-05 20:59:04.223909 | aio | TASK [Start up service] ******************************************************** 2026-03-05 20:59:04.224115 | aio | Thursday 05 March 2026 20:59:04 +0000 (0:00:30.793) 0:00:40.243 ******** 2026-03-05 20:59:04.753731 | aio | ok: [aio] 2026-03-05 20:59:04.753797 | aio | 2026-03-05 20:59:04.753947 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 20:59:04.754072 | aio | Thursday 05 March 2026 20:59:04 +0000 (0:00:00.530) 0:00:40.774 ******** 2026-03-05 20:59:05.055238 | aio | ok: [aio] 2026-03-05 20:59:05.055403 | aio | 2026-03-05 20:59:05.055638 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 20:59:05.055854 | aio | Thursday 05 March 2026 20:59:05 +0000 (0:00:00.301) 0:00:41.075 ******** 2026-03-05 20:59:05.689773 | aio | changed: [aio] 2026-03-05 20:59:05.689954 | aio | 2026-03-05 20:59:05.690160 | aio | TASK [Get list of all loopback devices] **************************************** 2026-03-05 20:59:05.690362 | aio | Thursday 05 March 2026 20:59:05 +0000 (0:00:00.634) 0:00:41.710 ******** 2026-03-05 20:59:05.879082 | aio | ok: [aio] 2026-03-05 20:59:05.879240 | aio | 2026-03-05 20:59:05.879450 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 20:59:05.879680 | aio | Thursday 05 March 2026 20:59:05 +0000 (0:00:00.189) 0:00:41.899 ******** 2026-03-05 20:59:05.904105 | aio | skipping: [aio] 2026-03-05 20:59:05.904301 | aio | 2026-03-05 20:59:05.904513 | aio | TASK [Create devices for Ceph] ************************************************* 2026-03-05 20:59:05.904767 | aio | Thursday 05 March 2026 20:59:05 +0000 (0:00:00.025) 0:00:41.924 ******** 2026-03-05 20:59:06.449395 | aio | changed: [aio] => (item=osd0) 2026-03-05 20:59:06.449479 | aio | changed: [aio] => (item=osd1) 2026-03-05 20:59:06.449536 | aio | changed: [aio] => (item=osd2) 2026-03-05 20:59:06.449607 | aio | 2026-03-05 20:59:06.449709 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 20:59:06.449799 | aio | Thursday 05 March 2026 20:59:06 +0000 (0:00:00.545) 0:00:42.470 ******** 2026-03-05 20:59:07.066007 | aio | changed: [aio] => (item=osd0) 2026-03-05 20:59:07.066192 | aio | changed: [aio] => (item=osd1) 2026-03-05 20:59:07.066422 | aio | changed: [aio] => (item=osd2) 2026-03-05 20:59:07.066599 | aio | 2026-03-05 20:59:07.066798 | aio | TASK [Start loop devices] ****************************************************** 2026-03-05 20:59:07.066998 | aio | Thursday 05 March 2026 20:59:07 +0000 (0:00:00.616) 0:00:43.086 ******** 2026-03-05 20:59:07.780375 | aio | changed: [aio] => (item=osd0) 2026-03-05 20:59:07.780718 | aio | changed: [aio] => (item=osd1) 2026-03-05 20:59:07.781024 | aio | changed: [aio] => (item=osd2) 2026-03-05 20:59:07.781249 | aio | 2026-03-05 20:59:07.781522 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 20:59:07.781839 | aio | Thursday 05 March 2026 20:59:07 +0000 (0:00:00.714) 0:00:43.800 ******** 2026-03-05 20:59:10.828256 | aio | changed: [aio] => (item=osd0) 2026-03-05 20:59:10.828325 | aio | changed: [aio] => (item=osd1) 2026-03-05 20:59:10.828418 | aio | changed: [aio] => (item=osd2) 2026-03-05 20:59:10.828535 | aio | 2026-03-05 20:59:10.828642 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 20:59:10.828750 | aio | Thursday 05 March 2026 20:59:10 +0000 (0:00:03.048) 0:00:46.848 ******** 2026-03-05 20:59:12.701281 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-03-05 20:59:12.701492 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-03-05 20:59:12.701923 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-03-05 20:59:12.701936 | aio | 2026-03-05 20:59:12.702494 | aio | PLAY RECAP ********************************************************************* 2026-03-05 20:59:12.702509 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 20:59:12.702521 | aio | 2026-03-05 20:59:12.702698 | aio | 2026-03-05 20:59:12.702897 | aio | TASKS RECAP ******************************************************************** 2026-03-05 20:59:12.703100 | aio | Thursday 05 March 2026 20:59:12 +0000 (0:00:01.873) 0:00:48.721 ******** 2026-03-05 20:59:12.703301 | aio | =============================================================================== 2026-03-05 20:59:12.703489 | aio | Install depedencies ---------------------------------------------------- 30.79s 2026-03-05 20:59:12.703680 | aio | Update apt cache -------------------------------------------------------- 6.64s 2026-03-05 20:59:12.703881 | aio | Create a volume group for each loop device ------------------------------ 3.05s 2026-03-05 20:59:12.704074 | aio | Create a logical volume for each loop device ---------------------------- 1.87s 2026-03-05 20:59:12.704269 | aio | Gathering Facts --------------------------------------------------------- 1.14s 2026-03-05 20:59:12.704572 | aio | Start loop devices ------------------------------------------------------ 0.71s 2026-03-05 20:59:12.704795 | aio | Configure short hostname ------------------------------------------------ 0.68s 2026-03-05 20:59:12.705006 | aio | Gathering Facts --------------------------------------------------------- 0.67s 2026-03-05 20:59:12.705199 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.63s 2026-03-05 20:59:12.705394 | aio | Set permissions on loopback devices ------------------------------------- 0.62s 2026-03-05 20:59:12.705585 | aio | Create devices for Ceph ------------------------------------------------- 0.55s 2026-03-05 20:59:12.705774 | aio | Start up service -------------------------------------------------------- 0.53s 2026-03-05 20:59:12.705963 | aio | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-03-05 20:59:12.706157 | aio | Ensure hostname inside hosts file --------------------------------------- 0.28s 2026-03-05 20:59:12.706350 | aio | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-05 20:59:12.706543 | aio | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-05 20:59:12.794286 | aio | INFO [default > prepare] Executed: Successful 2026-03-05 20:59:12.803365 | aio | INFO [default > converge] Executing 2026-03-05 20:59:13.602328 | aio | 2026-03-05 20:59:13.602464 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 20:59:13.602696 | aio | 2026-03-05 20:59:13.602855 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:59:13.603100 | aio | Thursday 05 March 2026 20:59:13 +0000 (0:00:00.049) 0:00:00.049 ******** 2026-03-05 20:59:14.755696 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 20:59:14.755765 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 20:59:14.755892 | aio | interpreter could change the meaning of that path. See 2026-03-05 20:59:14.756016 | aio | https://docs.ansible.com/ansible- 2026-03-05 20:59:14.756136 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:59:14.764577 | aio | ok: [aio] 2026-03-05 20:59:14.764686 | aio | 2026-03-05 20:59:14.764812 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:14.764978 | aio | Thursday 05 March 2026 20:59:14 +0000 (0:00:01.162) 0:00:01.211 ******** 2026-03-05 20:59:15.050703 | aio | ok: [aio] 2026-03-05 20:59:15.050875 | aio | 2026-03-05 20:59:15.051087 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:15.051285 | aio | Thursday 05 March 2026 20:59:15 +0000 (0:00:00.285) 0:00:01.497 ******** 2026-03-05 20:59:15.086107 | aio | skipping: [aio] 2026-03-05 20:59:15.086245 | aio | 2026-03-05 20:59:15.086443 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 20:59:15.086649 | aio | Thursday 05 March 2026 20:59:15 +0000 (0:00:00.035) 0:00:01.533 ******** 2026-03-05 20:59:15.396864 | aio | changed: [aio] 2026-03-05 20:59:15.397041 | aio | 2026-03-05 20:59:15.397259 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:15.397465 | aio | Thursday 05 March 2026 20:59:15 +0000 (0:00:00.310) 0:00:01.843 ******** 2026-03-05 20:59:15.492275 | aio | ok: [aio] => { 2026-03-05 20:59:15.492511 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 20:59:15.492710 | aio | } 2026-03-05 20:59:15.492906 | aio | 2026-03-05 20:59:15.493127 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:15.493327 | aio | Thursday 05 March 2026 20:59:15 +0000 (0:00:00.095) 0:00:01.939 ******** 2026-03-05 20:59:16.246666 | aio | changed: [aio] 2026-03-05 20:59:16.246847 | aio | 2026-03-05 20:59:16.247075 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:16.247291 | aio | Thursday 05 March 2026 20:59:16 +0000 (0:00:00.753) 0:00:02.692 ******** 2026-03-05 20:59:16.289395 | aio | skipping: [aio] 2026-03-05 20:59:16.289582 | aio | 2026-03-05 20:59:16.289792 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:16.290002 | aio | Thursday 05 March 2026 20:59:16 +0000 (0:00:00.043) 0:00:02.736 ******** 2026-03-05 20:59:16.328711 | aio | skipping: [aio] 2026-03-05 20:59:16.328909 | aio | 2026-03-05 20:59:16.329119 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:16.329317 | aio | Thursday 05 March 2026 20:59:16 +0000 (0:00:00.039) 0:00:02.775 ******** 2026-03-05 20:59:16.533363 | aio | ok: [aio] 2026-03-05 20:59:16.533421 | aio | 2026-03-05 20:59:16.533505 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:16.533600 | aio | Thursday 05 March 2026 20:59:16 +0000 (0:00:00.204) 0:00:02.980 ******** 2026-03-05 20:59:17.817000 | aio | ok: [aio] 2026-03-05 20:59:17.817176 | aio | 2026-03-05 20:59:17.817393 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:17.817594 | aio | Thursday 05 March 2026 20:59:17 +0000 (0:00:01.283) 0:00:04.263 ******** 2026-03-05 20:59:17.885920 | aio | ok: [aio] => { 2026-03-05 20:59:17.886137 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 20:59:17.886323 | aio | } 2026-03-05 20:59:17.886499 | aio | 2026-03-05 20:59:17.886701 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:17.886898 | aio | Thursday 05 March 2026 20:59:17 +0000 (0:00:00.069) 0:00:04.333 ******** 2026-03-05 20:59:18.726927 | aio | changed: [aio] 2026-03-05 20:59:18.727144 | aio | 2026-03-05 20:59:18.727309 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:18.727516 | aio | Thursday 05 March 2026 20:59:18 +0000 (0:00:00.840) 0:00:05.173 ******** 2026-03-05 20:59:21.649362 | aio | changed: [aio] 2026-03-05 20:59:21.649443 | aio | 2026-03-05 20:59:21.649632 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 20:59:21.649681 | aio | Thursday 05 March 2026 20:59:21 +0000 (0:00:02.922) 0:00:08.096 ******** 2026-03-05 20:59:21.675729 | aio | skipping: [aio] 2026-03-05 20:59:21.675814 | aio | 2026-03-05 20:59:21.676050 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 20:59:21.676095 | aio | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.026) 0:00:08.122 ******** 2026-03-05 20:59:21.708012 | aio | skipping: [aio] 2026-03-05 20:59:21.708136 | aio | 2026-03-05 20:59:21.708444 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 20:59:21.708487 | aio | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.032) 0:00:08.154 ******** 2026-03-05 20:59:21.737905 | aio | skipping: [aio] 2026-03-05 20:59:21.738058 | aio | 2026-03-05 20:59:21.738335 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 20:59:21.738359 | aio | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.029) 0:00:08.184 ******** 2026-03-05 20:59:27.077055 | aio | changed: [aio] 2026-03-05 20:59:27.077139 | aio | 2026-03-05 20:59:27.077154 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 20:59:27.077293 | aio | Thursday 05 March 2026 20:59:27 +0000 (0:00:05.339) 0:00:13.524 ******** 2026-03-05 20:59:27.593061 | aio | changed: [aio] 2026-03-05 20:59:27.593102 | aio | 2026-03-05 20:59:27.593108 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 20:59:27.593114 | aio | Thursday 05 March 2026 20:59:27 +0000 (0:00:00.515) 0:00:14.039 ******** 2026-03-05 20:59:28.486414 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 20:59:28.486477 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 20:59:28.486491 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 20:59:28.486938 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 20:59:28.486956 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 20:59:28.486962 | aio | 2026-03-05 20:59:28.486968 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 20:59:28.486972 | aio | Thursday 05 March 2026 20:59:28 +0000 (0:00:00.893) 0:00:14.933 ******** 2026-03-05 20:59:29.023595 | aio | changed: [aio] 2026-03-05 20:59:29.023656 | aio | 2026-03-05 20:59:29.024129 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 20:59:29.024144 | aio | Thursday 05 March 2026 20:59:29 +0000 (0:00:00.530) 0:00:15.464 ******** 2026-03-05 20:59:29.024150 | aio | 2026-03-05 20:59:29.024154 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 20:59:29.024159 | aio | Thursday 05 March 2026 20:59:29 +0000 (0:00:00.006) 0:00:15.470 ******** 2026-03-05 20:59:29.913633 | aio | ok: [aio] 2026-03-05 20:59:29.913705 | aio | 2026-03-05 20:59:29.913935 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 20:59:29.914003 | aio | Thursday 05 March 2026 20:59:29 +0000 (0:00:00.889) 0:00:16.360 ******** 2026-03-05 20:59:30.363723 | aio | changed: [aio] 2026-03-05 20:59:30.363854 | aio | 2026-03-05 20:59:30.363867 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 20:59:30.364029 | aio | Thursday 05 March 2026 20:59:30 +0000 (0:00:00.450) 0:00:16.810 ******** 2026-03-05 20:59:30.908527 | aio | changed: [aio] 2026-03-05 20:59:30.908646 | aio | 2026-03-05 20:59:30.908659 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:30.908770 | aio | Thursday 05 March 2026 20:59:30 +0000 (0:00:00.544) 0:00:17.355 ******** 2026-03-05 20:59:31.117056 | aio | ok: [aio] 2026-03-05 20:59:31.117124 | aio | 2026-03-05 20:59:31.117140 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:31.117334 | aio | Thursday 05 March 2026 20:59:31 +0000 (0:00:00.208) 0:00:17.563 ******** 2026-03-05 20:59:31.185771 | aio | ok: [aio] => { 2026-03-05 20:59:31.186482 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 20:59:31.186551 | aio | } 2026-03-05 20:59:31.186560 | aio | 2026-03-05 20:59:31.186567 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:31.186574 | aio | Thursday 05 March 2026 20:59:31 +0000 (0:00:00.068) 0:00:17.632 ******** 2026-03-05 20:59:32.296024 | aio | changed: [aio] 2026-03-05 20:59:32.296087 | aio | 2026-03-05 20:59:32.296147 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:32.296266 | aio | Thursday 05 March 2026 20:59:32 +0000 (0:00:01.110) 0:00:18.743 ******** 2026-03-05 20:59:36.696473 | aio | changed: [aio] 2026-03-05 20:59:36.696582 | aio | 2026-03-05 20:59:36.696639 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 20:59:36.696764 | aio | Thursday 05 March 2026 20:59:36 +0000 (0:00:04.400) 0:00:23.143 ******** 2026-03-05 20:59:37.659031 | aio | ok: [aio] 2026-03-05 20:59:37.659112 | aio | 2026-03-05 20:59:37.659177 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 20:59:37.659337 | aio | Thursday 05 March 2026 20:59:37 +0000 (0:00:00.961) 0:00:24.105 ******** 2026-03-05 20:59:38.020633 | aio | changed: [aio] 2026-03-05 20:59:38.020712 | aio | 2026-03-05 20:59:38.020769 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 20:59:38.020883 | aio | Thursday 05 March 2026 20:59:38 +0000 (0:00:00.362) 0:00:24.467 ******** 2026-03-05 20:59:38.469939 | aio | changed: [aio] 2026-03-05 20:59:38.469995 | aio | 2026-03-05 20:59:38.470343 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 20:59:38.470402 | aio | Thursday 05 March 2026 20:59:38 +0000 (0:00:00.449) 0:00:24.916 ******** 2026-03-05 20:59:39.039848 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 20:59:39.039925 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 20:59:39.039986 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 20:59:39.040329 | aio | 2026-03-05 20:59:39.040369 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 20:59:39.040376 | aio | Thursday 05 March 2026 20:59:39 +0000 (0:00:00.570) 0:00:25.486 ******** 2026-03-05 20:59:39.495487 | aio | changed: [aio] 2026-03-05 20:59:39.495556 | aio | 2026-03-05 20:59:39.495746 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 20:59:39.495788 | aio | Thursday 05 March 2026 20:59:39 +0000 (0:00:00.455) 0:00:25.942 ******** 2026-03-05 20:59:39.969239 | aio | changed: [aio] 2026-03-05 20:59:39.969310 | aio | 2026-03-05 20:59:39.969804 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 20:59:39.969849 | aio | Thursday 05 March 2026 20:59:39 +0000 (0:00:00.466) 0:00:26.409 ******** 2026-03-05 20:59:39.969855 | aio | 2026-03-05 20:59:39.969860 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 20:59:39.969864 | aio | Thursday 05 March 2026 20:59:39 +0000 (0:00:00.006) 0:00:26.416 ******** 2026-03-05 20:59:40.661150 | aio | ok: [aio] 2026-03-05 20:59:40.661221 | aio | 2026-03-05 20:59:40.661237 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 20:59:40.661383 | aio | Thursday 05 March 2026 20:59:40 +0000 (0:00:00.691) 0:00:27.108 ******** 2026-03-05 20:59:41.766109 | aio | changed: [aio] 2026-03-05 20:59:41.766179 | aio | 2026-03-05 20:59:41.766236 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 20:59:41.766372 | aio | Thursday 05 March 2026 20:59:41 +0000 (0:00:01.104) 0:00:28.213 ******** 2026-03-05 20:59:42.308238 | aio | changed: [aio] 2026-03-05 20:59:42.308304 | aio | 2026-03-05 20:59:42.308403 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 20:59:42.308546 | aio | Thursday 05 March 2026 20:59:42 +0000 (0:00:00.542) 0:00:28.755 ******** 2026-03-05 20:59:42.352537 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 20:59:42.352879 | aio | 2026-03-05 20:59:42.352932 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 20:59:42.352939 | aio | Thursday 05 March 2026 20:59:42 +0000 (0:00:00.044) 0:00:28.799 ******** 2026-03-05 20:59:46.975046 | aio | changed: [aio] 2026-03-05 20:59:46.975292 | aio | 2026-03-05 20:59:46.975305 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 20:59:46.975315 | aio | Thursday 05 March 2026 20:59:46 +0000 (0:00:04.622) 0:00:33.422 ******** 2026-03-05 20:59:47.599476 | aio | ok: [aio] => (item=chronyd) 2026-03-05 20:59:47.599523 | aio | ok: [aio] => (item=sshd) 2026-03-05 20:59:47.599528 | aio | 2026-03-05 20:59:47.599533 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 20:59:47.599538 | aio | Thursday 05 March 2026 20:59:47 +0000 (0:00:00.624) 0:00:34.046 ******** 2026-03-05 20:59:48.027444 | aio | changed: [aio] 2026-03-05 20:59:48.027519 | aio | 2026-03-05 20:59:48.027857 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 20:59:48.027910 | aio | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.428) 0:00:34.474 ******** 2026-03-05 20:59:48.222064 | aio | ok: [aio] 2026-03-05 20:59:48.222124 | aio | 2026-03-05 20:59:48.222338 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 20:59:48.222386 | aio | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.194) 0:00:34.669 ******** 2026-03-05 20:59:48.692893 | aio | changed: [aio] 2026-03-05 20:59:48.692956 | aio | 2026-03-05 20:59:48.693305 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 20:59:48.693354 | aio | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.470) 0:00:35.139 ******** 2026-03-05 20:59:49.028816 | aio | changed: [aio] 2026-03-05 20:59:49.028905 | aio | 2026-03-05 20:59:49.028921 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 20:59:49.029057 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.336) 0:00:35.475 ******** 2026-03-05 20:59:49.174781 | aio | ok: [aio] 2026-03-05 20:59:49.174823 | aio | 2026-03-05 20:59:49.175041 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 20:59:49.175076 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.145) 0:00:35.621 ******** 2026-03-05 20:59:49.391818 | aio | ok: [aio] => (item=aio) 2026-03-05 20:59:49.391887 | aio | 2026-03-05 20:59:49.392093 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 20:59:49.392255 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.216) 0:00:35.838 ******** 2026-03-05 20:59:49.434054 | aio | ok: [aio] 2026-03-05 20:59:49.434478 | aio | 2026-03-05 20:59:49.434507 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 20:59:49.434515 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.042) 0:00:35.880 ******** 2026-03-05 20:59:49.531184 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-03-05 20:59:49.531260 | aio | 2026-03-05 20:59:49.531488 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 20:59:49.531539 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.097) 0:00:35.978 ******** 2026-03-05 20:59:49.798886 | aio | changed: [aio] 2026-03-05 20:59:49.798946 | aio | 2026-03-05 20:59:49.799272 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 20:59:49.799330 | aio | Thursday 05 March 2026 20:59:49 +0000 (0:00:00.267) 0:00:36.245 ******** 2026-03-05 20:59:50.414969 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 20:59:50.415032 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 20:59:50.415439 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 20:59:50.415484 | aio | 2026-03-05 20:59:50.415490 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 20:59:50.415495 | aio | Thursday 05 March 2026 20:59:50 +0000 (0:00:00.616) 0:00:36.862 ******** 2026-03-05 21:01:56.428331 | aio | ok: [aio] 2026-03-05 21:01:56.428396 | aio | 2026-03-05 21:01:56.428629 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:01:56.428700 | aio | Thursday 05 March 2026 21:01:56 +0000 (0:02:06.013) 0:02:42.875 ******** 2026-03-05 21:01:56.617799 | aio | changed: [aio] 2026-03-05 21:01:56.617849 | aio | 2026-03-05 21:01:56.617856 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:01:56.617861 | aio | Thursday 05 March 2026 21:01:56 +0000 (0:00:00.189) 0:02:43.064 ******** 2026-03-05 21:01:56.652708 | aio | ok: [aio] 2026-03-05 21:01:56.652825 | aio | 2026-03-05 21:01:56.652838 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:01:56.652850 | aio | Thursday 05 March 2026 21:01:56 +0000 (0:00:00.035) 0:02:43.099 ******** 2026-03-05 21:01:56.716686 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:01:56.716824 | aio | 2026-03-05 21:01:56.716837 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:01:56.716908 | aio | Thursday 05 March 2026 21:01:56 +0000 (0:00:00.064) 0:02:43.163 ******** 2026-03-05 21:02:03.306734 | aio | ok: [aio] 2026-03-05 21:02:03.306777 | aio | 2026-03-05 21:02:03.306783 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:02:03.306788 | aio | Thursday 05 March 2026 21:02:03 +0000 (0:00:06.589) 0:02:49.753 ******** 2026-03-05 21:02:03.360721 | aio | ok: [aio] => (item=aio) 2026-03-05 21:02:03.360876 | aio | 2026-03-05 21:02:03.360996 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:02:03.361143 | aio | Thursday 05 March 2026 21:02:03 +0000 (0:00:00.054) 0:02:49.807 ******** 2026-03-05 21:02:03.721231 | aio | ok: [aio] 2026-03-05 21:02:03.721304 | aio | 2026-03-05 21:02:03.721316 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:02:03.721327 | aio | Thursday 05 March 2026 21:02:03 +0000 (0:00:00.359) 0:02:50.167 ******** 2026-03-05 21:02:10.239923 | aio | ok: [aio] 2026-03-05 21:02:10.239997 | aio | 2026-03-05 21:02:10.240067 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:02:10.240157 | aio | Thursday 05 March 2026 21:02:10 +0000 (0:00:06.519) 0:02:56.687 ******** 2026-03-05 21:02:22.721490 | aio | changed: [aio] 2026-03-05 21:02:22.721565 | aio | 2026-03-05 21:02:22.721813 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:02:22.721895 | aio | Thursday 05 March 2026 21:02:22 +0000 (0:00:12.481) 0:03:09.168 ******** 2026-03-05 21:02:36.874141 | aio | ok: [aio] 2026-03-05 21:02:36.874759 | aio | 2026-03-05 21:02:36.874812 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:02:36.874825 | aio | Thursday 05 March 2026 21:02:36 +0000 (0:00:14.152) 0:03:23.320 ******** 2026-03-05 21:02:36.938025 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:02:36.938063 | aio | 2026-03-05 21:02:36.938263 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:02:36.938289 | aio | Thursday 05 March 2026 21:02:36 +0000 (0:00:00.064) 0:03:23.385 ******** 2026-03-05 21:02:36.978247 | aio | skipping: [aio] 2026-03-05 21:02:36.978402 | aio | 2026-03-05 21:02:36.978547 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:02:36.978702 | aio | Thursday 05 March 2026 21:02:36 +0000 (0:00:00.040) 0:03:23.425 ******** 2026-03-05 21:02:37.018465 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:02:37.018550 | aio | skipping: [aio] 2026-03-05 21:02:37.018956 | aio | 2026-03-05 21:02:37.019005 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:02:37.019013 | aio | Thursday 05 March 2026 21:02:37 +0000 (0:00:00.039) 0:03:23.465 ******** 2026-03-05 21:02:37.266991 | aio | ok: [aio] 2026-03-05 21:02:37.267042 | aio | 2026-03-05 21:02:37.267353 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:02:37.267418 | aio | Thursday 05 March 2026 21:02:37 +0000 (0:00:00.248) 0:03:23.713 ******** 2026-03-05 21:02:43.715366 | aio | ok: [aio] 2026-03-05 21:02:43.715443 | aio | 2026-03-05 21:02:43.715522 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:02:43.715643 | aio | Thursday 05 March 2026 21:02:43 +0000 (0:00:06.448) 0:03:30.162 ******** 2026-03-05 21:02:55.667971 | aio | changed: [aio] 2026-03-05 21:02:55.668033 | aio | 2026-03-05 21:02:55.668093 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:02:55.668185 | aio | Thursday 05 March 2026 21:02:55 +0000 (0:00:11.952) 0:03:42.115 ******** 2026-03-05 21:03:01.736559 | aio | ok: [aio] 2026-03-05 21:03:01.736622 | aio | 2026-03-05 21:03:01.736635 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:03:01.736652 | aio | Thursday 05 March 2026 21:03:01 +0000 (0:00:06.067) 0:03:48.182 ******** 2026-03-05 21:03:09.702965 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:03:09.703008 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 21:03:09.703014 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-03-05 21:03:09.703019 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 21:03:09.703023 | aio | 2026-03-05 21:03:09.703028 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:03:09.703033 | aio | 2026-03-05 21:03:09.703037 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:03:09.703041 | aio | Thursday 05 March 2026 21:03:09 +0000 (0:00:07.966) 0:03:56.149 ******** 2026-03-05 21:03:10.561661 | aio | ok: [aio] 2026-03-05 21:03:10.561717 | aio | 2026-03-05 21:03:10.561725 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:10.561732 | aio | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.858) 0:03:57.008 ******** 2026-03-05 21:03:10.752620 | aio | ok: [aio] 2026-03-05 21:03:10.752663 | aio | 2026-03-05 21:03:10.752668 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:10.752673 | aio | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.191) 0:03:57.199 ******** 2026-03-05 21:03:10.783352 | aio | skipping: [aio] 2026-03-05 21:03:10.783378 | aio | 2026-03-05 21:03:10.783385 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:03:10.783392 | aio | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.030) 0:03:57.230 ******** 2026-03-05 21:03:10.974430 | aio | ok: [aio] 2026-03-05 21:03:10.974481 | aio | 2026-03-05 21:03:10.974490 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:10.974497 | aio | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.190) 0:03:57.421 ******** 2026-03-05 21:03:11.025523 | aio | ok: [aio] => { 2026-03-05 21:03:11.025560 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:03:11.025568 | aio | } 2026-03-05 21:03:11.025574 | aio | 2026-03-05 21:03:11.025580 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:11.025586 | aio | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.051) 0:03:57.472 ******** 2026-03-05 21:03:11.299606 | aio | ok: [aio] 2026-03-05 21:03:11.299651 | aio | 2026-03-05 21:03:11.299659 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:11.299666 | aio | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.274) 0:03:57.746 ******** 2026-03-05 21:03:11.338396 | aio | skipping: [aio] 2026-03-05 21:03:11.338478 | aio | 2026-03-05 21:03:11.338681 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:11.338726 | aio | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.039) 0:03:57.785 ******** 2026-03-05 21:03:11.378052 | aio | skipping: [aio] 2026-03-05 21:03:11.378139 | aio | 2026-03-05 21:03:11.378345 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:11.378367 | aio | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.039) 0:03:57.825 ******** 2026-03-05 21:03:11.569272 | aio | ok: [aio] 2026-03-05 21:03:11.569329 | aio | 2026-03-05 21:03:11.569391 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:11.569483 | aio | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.191) 0:03:58.016 ******** 2026-03-05 21:03:12.634289 | aio | ok: [aio] 2026-03-05 21:03:12.634352 | aio | 2026-03-05 21:03:12.634479 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:12.634604 | aio | Thursday 05 March 2026 21:03:12 +0000 (0:00:01.064) 0:03:59.081 ******** 2026-03-05 21:03:12.695675 | aio | ok: [aio] => { 2026-03-05 21:03:12.695720 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:03:12.695815 | aio | } 2026-03-05 21:03:12.695893 | aio | 2026-03-05 21:03:12.695980 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:12.696081 | aio | Thursday 05 March 2026 21:03:12 +0000 (0:00:00.061) 0:03:59.142 ******** 2026-03-05 21:03:13.008712 | aio | ok: [aio] 2026-03-05 21:03:13.008773 | aio | 2026-03-05 21:03:13.008845 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:13.008935 | aio | Thursday 05 March 2026 21:03:13 +0000 (0:00:00.313) 0:03:59.455 ******** 2026-03-05 21:03:14.873378 | aio | ok: [aio] 2026-03-05 21:03:14.873440 | aio | 2026-03-05 21:03:14.873528 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:03:14.873620 | aio | Thursday 05 March 2026 21:03:14 +0000 (0:00:01.864) 0:04:01.320 ******** 2026-03-05 21:03:14.896104 | aio | skipping: [aio] 2026-03-05 21:03:14.896214 | aio | 2026-03-05 21:03:14.896345 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:03:14.896503 | aio | Thursday 05 March 2026 21:03:14 +0000 (0:00:00.022) 0:04:01.343 ******** 2026-03-05 21:03:14.922766 | aio | skipping: [aio] 2026-03-05 21:03:14.922821 | aio | 2026-03-05 21:03:14.922925 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:03:14.923023 | aio | Thursday 05 March 2026 21:03:14 +0000 (0:00:00.026) 0:04:01.370 ******** 2026-03-05 21:03:14.949282 | aio | skipping: [aio] 2026-03-05 21:03:14.949356 | aio | 2026-03-05 21:03:14.949451 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:03:14.949544 | aio | Thursday 05 March 2026 21:03:14 +0000 (0:00:00.026) 0:04:01.396 ******** 2026-03-05 21:03:15.977005 | aio | ok: [aio] 2026-03-05 21:03:15.977077 | aio | 2026-03-05 21:03:15.977230 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:03:15.977376 | aio | Thursday 05 March 2026 21:03:15 +0000 (0:00:01.027) 0:04:02.423 ******** 2026-03-05 21:03:16.393426 | aio | ok: [aio] 2026-03-05 21:03:16.393488 | aio | 2026-03-05 21:03:16.393570 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:03:16.393662 | aio | Thursday 05 March 2026 21:03:16 +0000 (0:00:00.416) 0:04:02.840 ******** 2026-03-05 21:03:17.279210 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:03:17.279307 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:03:17.279441 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:03:17.279598 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:03:17.279735 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:03:17.279856 | aio | 2026-03-05 21:03:17.279988 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:03:17.280110 | aio | Thursday 05 March 2026 21:03:17 +0000 (0:00:00.885) 0:04:03.725 ******** 2026-03-05 21:03:17.729679 | aio | ok: [aio] 2026-03-05 21:03:17.729750 | aio | 2026-03-05 21:03:17.729830 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:03:17.729925 | aio | Thursday 05 March 2026 21:03:17 +0000 (0:00:00.443) 0:04:04.169 ******** 2026-03-05 21:03:17.730009 | aio | 2026-03-05 21:03:17.730106 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:03:17.730194 | aio | Thursday 05 March 2026 21:03:17 +0000 (0:00:00.006) 0:04:04.176 ******** 2026-03-05 21:03:18.064515 | aio | ok: [aio] 2026-03-05 21:03:18.064618 | aio | 2026-03-05 21:03:18.064743 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:18.064860 | aio | Thursday 05 March 2026 21:03:18 +0000 (0:00:00.335) 0:04:04.511 ******** 2026-03-05 21:03:18.261774 | aio | ok: [aio] 2026-03-05 21:03:18.261832 | aio | 2026-03-05 21:03:18.261925 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:18.262025 | aio | Thursday 05 March 2026 21:03:18 +0000 (0:00:00.197) 0:04:04.708 ******** 2026-03-05 21:03:18.311465 | aio | ok: [aio] => { 2026-03-05 21:03:18.311801 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:03:18.312110 | aio | } 2026-03-05 21:03:18.312390 | aio | 2026-03-05 21:03:18.312889 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:18.313180 | aio | Thursday 05 March 2026 21:03:18 +0000 (0:00:00.049) 0:04:04.758 ******** 2026-03-05 21:03:18.651113 | aio | ok: [aio] 2026-03-05 21:03:18.651169 | aio | 2026-03-05 21:03:18.651277 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:18.651375 | aio | Thursday 05 March 2026 21:03:18 +0000 (0:00:00.340) 0:04:05.098 ******** 2026-03-05 21:03:21.658046 | aio | ok: [aio] 2026-03-05 21:03:21.658232 | aio | 2026-03-05 21:03:21.658458 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:03:21.658674 | aio | Thursday 05 March 2026 21:03:21 +0000 (0:00:03.006) 0:04:08.104 ******** 2026-03-05 21:03:22.739828 | aio | ok: [aio] 2026-03-05 21:03:22.740042 | aio | 2026-03-05 21:03:22.740051 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:03:22.740057 | aio | Thursday 05 March 2026 21:03:22 +0000 (0:00:01.081) 0:04:09.186 ******** 2026-03-05 21:03:22.918286 | aio | ok: [aio] 2026-03-05 21:03:22.918348 | aio | 2026-03-05 21:03:22.918514 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:03:22.918600 | aio | Thursday 05 March 2026 21:03:22 +0000 (0:00:00.178) 0:04:09.365 ******** 2026-03-05 21:03:23.328863 | aio | ok: [aio] 2026-03-05 21:03:23.328954 | aio | 2026-03-05 21:03:23.329091 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:03:23.329224 | aio | Thursday 05 March 2026 21:03:23 +0000 (0:00:00.410) 0:04:09.775 ******** 2026-03-05 21:03:23.849933 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:03:23.850036 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:03:23.850183 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:03:23.850293 | aio | 2026-03-05 21:03:23.850431 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:03:23.850561 | aio | Thursday 05 March 2026 21:03:23 +0000 (0:00:00.521) 0:04:10.296 ******** 2026-03-05 21:03:24.245375 | aio | ok: [aio] 2026-03-05 21:03:24.245459 | aio | 2026-03-05 21:03:24.245606 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:03:24.245732 | aio | Thursday 05 March 2026 21:03:24 +0000 (0:00:00.395) 0:04:10.692 ******** 2026-03-05 21:03:24.651079 | aio | ok: [aio] 2026-03-05 21:03:24.651138 | aio | 2026-03-05 21:03:24.651183 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:03:24.651278 | aio | Thursday 05 March 2026 21:03:24 +0000 (0:00:00.399) 0:04:11.091 ******** 2026-03-05 21:03:24.651359 | aio | 2026-03-05 21:03:24.651453 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:03:24.651553 | aio | Thursday 05 March 2026 21:03:24 +0000 (0:00:00.006) 0:04:11.098 ******** 2026-03-05 21:03:24.988724 | aio | ok: [aio] 2026-03-05 21:03:24.988762 | aio | 2026-03-05 21:03:24.988768 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:03:24.988778 | aio | Thursday 05 March 2026 21:03:24 +0000 (0:00:00.337) 0:04:11.435 ******** 2026-03-05 21:03:25.034872 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:03:25.034891 | aio | 2026-03-05 21:03:25.034897 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:03:25.034901 | aio | Thursday 05 March 2026 21:03:25 +0000 (0:00:00.046) 0:04:11.482 ******** 2026-03-05 21:03:26.088270 | aio | ok: [aio] 2026-03-05 21:03:26.088307 | aio | 2026-03-05 21:03:26.088314 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:03:26.088321 | aio | Thursday 05 March 2026 21:03:26 +0000 (0:00:01.052) 0:04:12.534 ******** 2026-03-05 21:03:26.706316 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:03:26.706360 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:03:26.706367 | aio | 2026-03-05 21:03:26.706374 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:03:26.706380 | aio | Thursday 05 March 2026 21:03:26 +0000 (0:00:00.617) 0:04:13.152 ******** 2026-03-05 21:03:27.115894 | aio | ok: [aio] 2026-03-05 21:03:27.115928 | aio | 2026-03-05 21:03:27.115934 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:03:27.115939 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.409) 0:04:13.562 ******** 2026-03-05 21:03:27.310239 | aio | ok: [aio] 2026-03-05 21:03:27.310283 | aio | 2026-03-05 21:03:27.310290 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:03:27.310297 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.193) 0:04:13.756 ******** 2026-03-05 21:03:27.537915 | aio | ok: [aio] 2026-03-05 21:03:27.537954 | aio | 2026-03-05 21:03:27.537961 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:03:27.537968 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.227) 0:04:13.984 ******** 2026-03-05 21:03:27.736998 | aio | ok: [aio] 2026-03-05 21:03:27.737036 | aio | 2026-03-05 21:03:27.737042 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:03:27.737047 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.199) 0:04:14.183 ******** 2026-03-05 21:03:27.934575 | aio | ok: [aio] => (item=aio) 2026-03-05 21:03:27.934619 | aio | 2026-03-05 21:03:27.934627 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:03:27.934634 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.197) 0:04:14.381 ******** 2026-03-05 21:03:27.974346 | aio | ok: [aio] 2026-03-05 21:03:27.974372 | aio | 2026-03-05 21:03:27.974379 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:03:27.974385 | aio | Thursday 05 March 2026 21:03:27 +0000 (0:00:00.040) 0:04:14.421 ******** 2026-03-05 21:03:28.022573 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:03:28.022592 | aio | 2026-03-05 21:03:28.022597 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:03:28.022602 | aio | Thursday 05 March 2026 21:03:28 +0000 (0:00:00.048) 0:04:14.469 ******** 2026-03-05 21:03:28.065122 | aio | skipping: [aio] 2026-03-05 21:03:28.065144 | aio | 2026-03-05 21:03:28.065151 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:03:28.065168 | aio | Thursday 05 March 2026 21:03:28 +0000 (0:00:00.042) 0:04:14.512 ******** 2026-03-05 21:03:28.105927 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:03:28.105943 | aio | skipping: [aio] 2026-03-05 21:03:28.105947 | aio | 2026-03-05 21:03:28.105952 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:03:28.105956 | aio | Thursday 05 March 2026 21:03:28 +0000 (0:00:00.040) 0:04:14.552 ******** 2026-03-05 21:03:28.329837 | aio | ok: [aio] 2026-03-05 21:03:28.329861 | aio | 2026-03-05 21:03:28.329868 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:03:28.329874 | aio | Thursday 05 March 2026 21:03:28 +0000 (0:00:00.224) 0:04:14.776 ******** 2026-03-05 21:03:40.626906 | aio | ok: [aio] 2026-03-05 21:03:40.626978 | aio | 2026-03-05 21:03:40.627056 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:03:40.627164 | aio | Thursday 05 March 2026 21:03:40 +0000 (0:00:12.297) 0:04:27.073 ******** 2026-03-05 21:03:45.793086 | aio | ok: [aio] 2026-03-05 21:03:45.793163 | aio | 2026-03-05 21:03:45.793220 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:03:45.793351 | aio | Thursday 05 March 2026 21:03:45 +0000 (0:00:05.166) 0:04:32.240 ******** 2026-03-05 21:04:00.199254 | aio | ok: [aio] 2026-03-05 21:04:00.199343 | aio | 2026-03-05 21:04:00.199400 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:04:00.199526 | aio | Thursday 05 March 2026 21:04:00 +0000 (0:00:14.406) 0:04:46.646 ******** 2026-03-05 21:05:37.531047 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 21:05:37.531111 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 21:05:37.531118 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 21:05:37.531125 | aio | 2026-03-05 21:05:37.531132 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:05:37.531143 | aio | Thursday 05 March 2026 21:05:37 +0000 (0:01:37.330) 0:06:23.976 ******** 2026-03-05 21:05:43.577130 | aio | ok: [aio] 2026-03-05 21:05:43.577187 | aio | 2026-03-05 21:05:43.577193 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:05:43.577198 | aio | Thursday 05 March 2026 21:05:43 +0000 (0:00:06.046) 0:06:30.023 ******** 2026-03-05 21:05:49.791069 | aio | ok: [aio] 2026-03-05 21:05:49.791175 | aio | 2026-03-05 21:05:49.791577 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:05:49.791621 | aio | Thursday 05 March 2026 21:05:49 +0000 (0:00:06.213) 0:06:36.237 ******** 2026-03-05 21:05:49.843242 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 21:05:49.843341 | aio | 2026-03-05 21:05:49.843506 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:05:49.843641 | aio | Thursday 05 March 2026 21:05:49 +0000 (0:00:00.052) 0:06:36.290 ******** 2026-03-05 21:05:49.885696 | aio | ok: [aio] 2026-03-05 21:05:49.885734 | aio | 2026-03-05 21:05:49.885823 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:05:49.885916 | aio | Thursday 05 March 2026 21:05:49 +0000 (0:00:00.042) 0:06:36.333 ******** 2026-03-05 21:05:56.047651 | aio | ok: [aio] 2026-03-05 21:05:56.047747 | aio | 2026-03-05 21:05:56.047759 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:05:56.047907 | aio | Thursday 05 March 2026 21:05:56 +0000 (0:00:06.161) 0:06:42.494 ******** 2026-03-05 21:05:56.088502 | aio | ok: [aio] 2026-03-05 21:05:56.088568 | aio | 2026-03-05 21:05:56.088771 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:05:56.088805 | aio | Thursday 05 March 2026 21:05:56 +0000 (0:00:00.040) 0:06:42.535 ******** 2026-03-05 21:05:56.124613 | aio | skipping: [aio] => (item=1) 2026-03-05 21:05:56.124708 | aio | skipping: [aio] => (item=1) 2026-03-05 21:05:56.125173 | aio | skipping: [aio] => (item=1) 2026-03-05 21:05:56.125214 | aio | skipping: [aio] 2026-03-05 21:05:56.125225 | aio | 2026-03-05 21:05:56.125235 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:05:56.125248 | aio | Thursday 05 March 2026 21:05:56 +0000 (0:00:00.035) 0:06:42.571 ******** 2026-03-05 21:05:56.156313 | aio | skipping: [aio] 2026-03-05 21:05:56.156524 | aio | 2026-03-05 21:05:56.156733 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:05:56.156958 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=18 rescued=0 ignored=0 2026-03-05 21:05:56.157140 | aio | 2026-03-05 21:05:56.157312 | aio | 2026-03-05 21:05:56.157502 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:05:56.157701 | aio | Thursday 05 March 2026 21:05:56 +0000 (0:00:00.032) 0:06:42.603 ******** 2026-03-05 21:05:56.157887 | aio | =============================================================================== 2026-03-05 21:05:56.158084 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 126.01s 2026-03-05 21:05:56.158281 | aio | vexxhost.ceph.osd : Install OSDs --------------------------------------- 97.33s 2026-03-05 21:05:56.158478 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.41s 2026-03-05 21:05:56.158677 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.15s 2026-03-05 21:05:56.158876 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.48s 2026-03-05 21:05:56.159072 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 12.30s 2026-03-05 21:05:56.159271 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.95s 2026-03-05 21:05:56.159513 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.97s 2026-03-05 21:05:56.159717 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.59s 2026-03-05 21:05:56.159910 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.52s 2026-03-05 21:05:56.160104 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.45s 2026-03-05 21:05:56.160299 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.21s 2026-03-05 21:05:56.160507 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.16s 2026-03-05 21:05:56.160727 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.07s 2026-03-05 21:05:56.160924 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.05s 2026-03-05 21:05:56.161123 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.34s 2026-03-05 21:05:56.161323 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.17s 2026-03-05 21:05:56.161518 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.62s 2026-03-05 21:05:56.161715 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.40s 2026-03-05 21:05:56.161910 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.01s 2026-03-05 21:05:56.249049 | aio | INFO [default > converge] Executed: Successful 2026-03-05 21:05:56.258660 | aio | INFO [default > idempotence] Executing 2026-03-05 21:05:57.042926 | aio | 2026-03-05 21:05:57.043071 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:05:57.043303 | aio | 2026-03-05 21:05:57.043516 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:05:57.043767 | aio | Thursday 05 March 2026 21:05:57 +0000 (0:00:00.046) 0:00:00.046 ******** 2026-03-05 21:05:58.169845 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:05:58.170027 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:05:58.170302 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:05:58.170427 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:05:58.170625 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:05:58.180983 | aio | ok: [aio] 2026-03-05 21:05:58.181187 | aio | 2026-03-05 21:05:58.181403 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:05:58.181611 | aio | Thursday 05 March 2026 21:05:58 +0000 (0:00:01.138) 0:00:01.184 ******** 2026-03-05 21:05:58.468691 | aio | ok: [aio] 2026-03-05 21:05:58.468879 | aio | 2026-03-05 21:05:58.469100 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:05:58.469372 | aio | Thursday 05 March 2026 21:05:58 +0000 (0:00:00.287) 0:00:01.472 ******** 2026-03-05 21:05:58.504309 | aio | skipping: [aio] 2026-03-05 21:05:58.504538 | aio | 2026-03-05 21:05:58.504762 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:05:58.504972 | aio | Thursday 05 March 2026 21:05:58 +0000 (0:00:00.035) 0:00:01.507 ******** 2026-03-05 21:05:58.794174 | aio | ok: [aio] 2026-03-05 21:05:58.794415 | aio | 2026-03-05 21:05:58.794653 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:05:58.794872 | aio | Thursday 05 March 2026 21:05:58 +0000 (0:00:00.289) 0:00:01.797 ******** 2026-03-05 21:05:58.859465 | aio | ok: [aio] => { 2026-03-05 21:05:58.859700 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:05:58.859904 | aio | } 2026-03-05 21:05:58.860094 | aio | 2026-03-05 21:05:58.860307 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:05:58.860552 | aio | Thursday 05 March 2026 21:05:58 +0000 (0:00:00.065) 0:00:01.863 ******** 2026-03-05 21:05:59.261233 | aio | ok: [aio] 2026-03-05 21:05:59.261401 | aio | 2026-03-05 21:05:59.261620 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:05:59.261831 | aio | Thursday 05 March 2026 21:05:59 +0000 (0:00:00.401) 0:00:02.264 ******** 2026-03-05 21:05:59.306988 | aio | skipping: [aio] 2026-03-05 21:05:59.307057 | aio | 2026-03-05 21:05:59.307062 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:05:59.307068 | aio | Thursday 05 March 2026 21:05:59 +0000 (0:00:00.043) 0:00:02.308 ******** 2026-03-05 21:05:59.347032 | aio | skipping: [aio] 2026-03-05 21:05:59.347085 | aio | 2026-03-05 21:05:59.347197 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:05:59.347290 | aio | Thursday 05 March 2026 21:05:59 +0000 (0:00:00.042) 0:00:02.351 ******** 2026-03-05 21:05:59.546354 | aio | ok: [aio] 2026-03-05 21:05:59.546501 | aio | 2026-03-05 21:05:59.546710 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:05:59.546913 | aio | Thursday 05 March 2026 21:05:59 +0000 (0:00:00.199) 0:00:02.550 ******** 2026-03-05 21:06:00.613101 | aio | ok: [aio] 2026-03-05 21:06:00.613334 | aio | 2026-03-05 21:06:00.613626 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:06:00.613878 | aio | Thursday 05 March 2026 21:06:00 +0000 (0:00:01.066) 0:00:03.616 ******** 2026-03-05 21:06:00.684280 | aio | ok: [aio] => { 2026-03-05 21:06:00.684586 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:06:00.684843 | aio | } 2026-03-05 21:06:00.685109 | aio | 2026-03-05 21:06:00.685389 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:06:00.685660 | aio | Thursday 05 March 2026 21:06:00 +0000 (0:00:00.071) 0:00:03.688 ******** 2026-03-05 21:06:01.021013 | aio | ok: [aio] 2026-03-05 21:06:01.021185 | aio | 2026-03-05 21:06:01.021431 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:06:01.021665 | aio | Thursday 05 March 2026 21:06:01 +0000 (0:00:00.336) 0:00:04.024 ******** 2026-03-05 21:06:03.165847 | aio | ok: [aio] 2026-03-05 21:06:03.165923 | aio | 2026-03-05 21:06:03.165935 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:06:03.165964 | aio | Thursday 05 March 2026 21:06:03 +0000 (0:00:02.144) 0:00:06.168 ******** 2026-03-05 21:06:03.191908 | aio | skipping: [aio] 2026-03-05 21:06:03.191993 | aio | 2026-03-05 21:06:03.192007 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:06:03.192131 | aio | Thursday 05 March 2026 21:06:03 +0000 (0:00:00.027) 0:00:06.195 ******** 2026-03-05 21:06:03.221728 | aio | skipping: [aio] 2026-03-05 21:06:03.221795 | aio | 2026-03-05 21:06:03.221897 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:06:03.221987 | aio | Thursday 05 March 2026 21:06:03 +0000 (0:00:00.030) 0:00:06.225 ******** 2026-03-05 21:06:03.249122 | aio | skipping: [aio] 2026-03-05 21:06:03.249234 | aio | 2026-03-05 21:06:03.249366 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:06:03.249540 | aio | Thursday 05 March 2026 21:06:03 +0000 (0:00:00.027) 0:00:06.253 ******** 2026-03-05 21:06:04.233802 | aio | ok: [aio] 2026-03-05 21:06:04.233852 | aio | 2026-03-05 21:06:04.233858 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:06:04.233863 | aio | Thursday 05 March 2026 21:06:04 +0000 (0:00:00.984) 0:00:07.237 ******** 2026-03-05 21:06:04.644257 | aio | ok: [aio] 2026-03-05 21:06:04.644316 | aio | 2026-03-05 21:06:04.644321 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:06:04.644326 | aio | Thursday 05 March 2026 21:06:04 +0000 (0:00:00.410) 0:00:07.647 ******** 2026-03-05 21:06:05.527333 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:06:05.527426 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:06:05.527446 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:06:05.527471 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:06:05.527925 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:06:05.527948 | aio | 2026-03-05 21:06:05.527955 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:06:05.527962 | aio | Thursday 05 March 2026 21:06:05 +0000 (0:00:00.882) 0:00:08.530 ******** 2026-03-05 21:06:05.985251 | aio | ok: [aio] 2026-03-05 21:06:05.985331 | aio | 2026-03-05 21:06:05.985390 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:06:05.985776 | aio | Thursday 05 March 2026 21:06:05 +0000 (0:00:00.450) 0:00:08.981 ******** 2026-03-05 21:06:05.985829 | aio | 2026-03-05 21:06:05.985835 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:06:05.985840 | aio | Thursday 05 March 2026 21:06:05 +0000 (0:00:00.007) 0:00:08.989 ******** 2026-03-05 21:06:06.569894 | aio | ok: [aio] 2026-03-05 21:06:06.569975 | aio | 2026-03-05 21:06:06.570034 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:06:06.570166 | aio | Thursday 05 March 2026 21:06:06 +0000 (0:00:00.584) 0:00:09.573 ******** 2026-03-05 21:06:06.766039 | aio | ok: [aio] 2026-03-05 21:06:06.766128 | aio | 2026-03-05 21:06:06.766145 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:06:06.766305 | aio | Thursday 05 March 2026 21:06:06 +0000 (0:00:00.196) 0:00:09.769 ******** 2026-03-05 21:06:06.831907 | aio | ok: [aio] => { 2026-03-05 21:06:06.831992 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:06:06.832378 | aio | } 2026-03-05 21:06:06.832421 | aio | 2026-03-05 21:06:06.832427 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:06:06.832432 | aio | Thursday 05 March 2026 21:06:06 +0000 (0:00:00.065) 0:00:09.835 ******** 2026-03-05 21:06:07.174712 | aio | ok: [aio] 2026-03-05 21:06:07.174799 | aio | 2026-03-05 21:06:07.174821 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:06:07.174876 | aio | Thursday 05 March 2026 21:06:07 +0000 (0:00:00.342) 0:00:10.178 ******** 2026-03-05 21:06:10.201455 | aio | ok: [aio] 2026-03-05 21:06:10.201534 | aio | 2026-03-05 21:06:10.201736 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:06:10.201797 | aio | Thursday 05 March 2026 21:06:10 +0000 (0:00:03.026) 0:00:13.205 ******** 2026-03-05 21:06:11.226771 | aio | ok: [aio] 2026-03-05 21:06:11.226858 | aio | 2026-03-05 21:06:11.226871 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:06:11.227001 | aio | Thursday 05 March 2026 21:06:11 +0000 (0:00:01.025) 0:00:14.230 ******** 2026-03-05 21:06:11.505755 | aio | ok: [aio] 2026-03-05 21:06:11.505826 | aio | 2026-03-05 21:06:11.506050 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:06:11.506105 | aio | Thursday 05 March 2026 21:06:11 +0000 (0:00:00.279) 0:00:14.509 ******** 2026-03-05 21:06:11.913628 | aio | ok: [aio] 2026-03-05 21:06:11.913699 | aio | 2026-03-05 21:06:11.914028 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:06:11.914091 | aio | Thursday 05 March 2026 21:06:11 +0000 (0:00:00.407) 0:00:14.917 ******** 2026-03-05 21:06:12.465872 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:06:12.465944 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:06:12.466327 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:06:12.466385 | aio | 2026-03-05 21:06:12.466391 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:06:12.466397 | aio | Thursday 05 March 2026 21:06:12 +0000 (0:00:00.552) 0:00:15.469 ******** 2026-03-05 21:06:12.873753 | aio | ok: [aio] 2026-03-05 21:06:12.873835 | aio | 2026-03-05 21:06:12.874031 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:06:12.874084 | aio | Thursday 05 March 2026 21:06:12 +0000 (0:00:00.408) 0:00:15.877 ******** 2026-03-05 21:06:13.293787 | aio | ok: [aio] 2026-03-05 21:06:13.293861 | aio | 2026-03-05 21:06:13.293924 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:06:13.294306 | aio | Thursday 05 March 2026 21:06:13 +0000 (0:00:00.412) 0:00:16.290 ******** 2026-03-05 21:06:13.294359 | aio | 2026-03-05 21:06:13.294365 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:06:13.294370 | aio | Thursday 05 March 2026 21:06:13 +0000 (0:00:00.007) 0:00:16.297 ******** 2026-03-05 21:06:13.645819 | aio | ok: [aio] 2026-03-05 21:06:13.645869 | aio | 2026-03-05 21:06:13.645875 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:06:13.645880 | aio | Thursday 05 March 2026 21:06:13 +0000 (0:00:00.351) 0:00:16.649 ******** 2026-03-05 21:06:13.691592 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:06:13.691615 | aio | 2026-03-05 21:06:13.691623 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:06:13.691629 | aio | Thursday 05 March 2026 21:06:13 +0000 (0:00:00.045) 0:00:16.695 ******** 2026-03-05 21:06:14.611235 | aio | ok: [aio] 2026-03-05 21:06:14.611297 | aio | 2026-03-05 21:06:14.611305 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:06:14.611312 | aio | Thursday 05 March 2026 21:06:14 +0000 (0:00:00.919) 0:00:17.614 ******** 2026-03-05 21:06:15.243430 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:06:15.243801 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:06:15.243815 | aio | 2026-03-05 21:06:15.243825 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:06:15.243880 | aio | Thursday 05 March 2026 21:06:15 +0000 (0:00:00.632) 0:00:18.247 ******** 2026-03-05 21:06:15.695014 | aio | ok: [aio] 2026-03-05 21:06:15.695092 | aio | 2026-03-05 21:06:15.695341 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:06:15.695410 | aio | Thursday 05 March 2026 21:06:15 +0000 (0:00:00.451) 0:00:18.698 ******** 2026-03-05 21:06:15.892499 | aio | ok: [aio] 2026-03-05 21:06:15.892969 | aio | 2026-03-05 21:06:15.893035 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:06:15.893043 | aio | Thursday 05 March 2026 21:06:15 +0000 (0:00:00.197) 0:00:18.896 ******** 2026-03-05 21:06:16.290473 | aio | ok: [aio] 2026-03-05 21:06:16.290544 | aio | 2026-03-05 21:06:16.290746 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:06:16.290807 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.398) 0:00:19.294 ******** 2026-03-05 21:06:16.604729 | aio | ok: [aio] 2026-03-05 21:06:16.604803 | aio | 2026-03-05 21:06:16.605035 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:06:16.605096 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.314) 0:00:19.608 ******** 2026-03-05 21:06:16.669008 | aio | ok: [aio] 2026-03-05 21:06:16.669090 | aio | 2026-03-05 21:06:16.669327 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:06:16.669390 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.064) 0:00:19.672 ******** 2026-03-05 21:06:16.882502 | aio | ok: [aio] => (item=aio) 2026-03-05 21:06:16.882574 | aio | 2026-03-05 21:06:16.882791 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:06:16.882851 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.213) 0:00:19.886 ******** 2026-03-05 21:06:16.927474 | aio | ok: [aio] 2026-03-05 21:06:16.927943 | aio | 2026-03-05 21:06:16.928016 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:06:16.928033 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.044) 0:00:19.931 ******** 2026-03-05 21:06:16.963439 | aio | skipping: [aio] 2026-03-05 21:06:16.963521 | aio | 2026-03-05 21:06:16.963766 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:06:16.963845 | aio | Thursday 05 March 2026 21:06:16 +0000 (0:00:00.036) 0:00:19.967 ******** 2026-03-05 21:06:17.027846 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:06:17.027890 | aio | 2026-03-05 21:06:17.028017 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:06:17.028152 | aio | Thursday 05 March 2026 21:06:17 +0000 (0:00:00.064) 0:00:20.031 ******** 2026-03-05 21:06:23.283055 | aio | ok: [aio] 2026-03-05 21:06:23.283142 | aio | 2026-03-05 21:06:23.283203 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:06:23.283346 | aio | Thursday 05 March 2026 21:06:23 +0000 (0:00:06.254) 0:00:26.286 ******** 2026-03-05 21:06:23.338532 | aio | ok: [aio] => (item=aio) 2026-03-05 21:06:23.338613 | aio | 2026-03-05 21:06:23.338855 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:06:23.338913 | aio | Thursday 05 March 2026 21:06:23 +0000 (0:00:00.055) 0:00:26.342 ******** 2026-03-05 21:06:23.717190 | aio | ok: [aio] 2026-03-05 21:06:23.717274 | aio | 2026-03-05 21:06:23.717545 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:06:23.717610 | aio | Thursday 05 March 2026 21:06:23 +0000 (0:00:00.378) 0:00:26.720 ******** 2026-03-05 21:06:30.310681 | aio | ok: [aio] 2026-03-05 21:06:30.310760 | aio | 2026-03-05 21:06:30.310817 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:06:30.310915 | aio | Thursday 05 March 2026 21:06:30 +0000 (0:00:06.593) 0:00:33.314 ******** 2026-03-05 21:06:36.625576 | aio | ok: [aio] 2026-03-05 21:06:36.625670 | aio | 2026-03-05 21:06:36.625683 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:06:36.625824 | aio | Thursday 05 March 2026 21:06:36 +0000 (0:00:06.315) 0:00:39.629 ******** 2026-03-05 21:06:50.930974 | aio | ok: [aio] 2026-03-05 21:06:50.931106 | aio | 2026-03-05 21:06:50.931120 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:06:50.931161 | aio | Thursday 05 March 2026 21:06:50 +0000 (0:00:14.305) 0:00:53.934 ******** 2026-03-05 21:06:50.994228 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:06:50.994283 | aio | 2026-03-05 21:06:50.994373 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:06:50.994514 | aio | Thursday 05 March 2026 21:06:50 +0000 (0:00:00.063) 0:00:53.998 ******** 2026-03-05 21:06:51.042152 | aio | skipping: [aio] 2026-03-05 21:06:51.042575 | aio | 2026-03-05 21:06:51.042608 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:06:51.042617 | aio | Thursday 05 March 2026 21:06:51 +0000 (0:00:00.047) 0:00:54.045 ******** 2026-03-05 21:06:51.085451 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:06:51.085587 | aio | skipping: [aio] 2026-03-05 21:06:51.085600 | aio | 2026-03-05 21:06:51.085614 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:06:51.085767 | aio | Thursday 05 March 2026 21:06:51 +0000 (0:00:00.043) 0:00:54.089 ******** 2026-03-05 21:06:51.356003 | aio | ok: [aio] 2026-03-05 21:06:51.356085 | aio | 2026-03-05 21:06:51.356342 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:06:51.356365 | aio | Thursday 05 March 2026 21:06:51 +0000 (0:00:00.270) 0:00:54.359 ******** 2026-03-05 21:06:57.922144 | aio | ok: [aio] 2026-03-05 21:06:57.922223 | aio | 2026-03-05 21:06:57.922279 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:06:57.922401 | aio | Thursday 05 March 2026 21:06:57 +0000 (0:00:06.566) 0:01:00.925 ******** 2026-03-05 21:07:04.068430 | aio | ok: [aio] 2026-03-05 21:07:04.068540 | aio | 2026-03-05 21:07:04.068761 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:07:04.068813 | aio | Thursday 05 March 2026 21:07:04 +0000 (0:00:06.146) 0:01:07.072 ******** 2026-03-05 21:07:10.274155 | aio | ok: [aio] 2026-03-05 21:07:10.274237 | aio | 2026-03-05 21:07:10.274535 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:07:10.274586 | aio | Thursday 05 March 2026 21:07:10 +0000 (0:00:06.205) 0:01:13.277 ******** 2026-03-05 21:07:18.604795 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:07:18.604890 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-03-05 21:07:18.604904 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-03-05 21:07:18.604986 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-03-05 21:07:18.605066 | aio | 2026-03-05 21:07:18.605160 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:07:18.605242 | aio | 2026-03-05 21:07:18.605333 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:07:18.605426 | aio | Thursday 05 March 2026 21:07:18 +0000 (0:00:08.330) 0:01:21.608 ******** 2026-03-05 21:07:19.502797 | aio | ok: [aio] 2026-03-05 21:07:19.502979 | aio | 2026-03-05 21:07:19.503238 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:19.503458 | aio | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.897) 0:01:22.506 ******** 2026-03-05 21:07:19.711391 | aio | ok: [aio] 2026-03-05 21:07:19.711579 | aio | 2026-03-05 21:07:19.711806 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:19.712011 | aio | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.208) 0:01:22.714 ******** 2026-03-05 21:07:19.747698 | aio | skipping: [aio] 2026-03-05 21:07:19.747901 | aio | 2026-03-05 21:07:19.748124 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:07:19.748331 | aio | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.036) 0:01:22.751 ******** 2026-03-05 21:07:19.953908 | aio | ok: [aio] 2026-03-05 21:07:19.954094 | aio | 2026-03-05 21:07:19.954313 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:19.954524 | aio | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.205) 0:01:22.957 ******** 2026-03-05 21:07:20.031543 | aio | ok: [aio] => { 2026-03-05 21:07:20.031745 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:07:20.031938 | aio | } 2026-03-05 21:07:20.032118 | aio | 2026-03-05 21:07:20.032325 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:20.032595 | aio | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.078) 0:01:23.035 ******** 2026-03-05 21:07:20.353072 | aio | ok: [aio] 2026-03-05 21:07:20.353286 | aio | 2026-03-05 21:07:20.353512 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:20.353725 | aio | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.320) 0:01:23.356 ******** 2026-03-05 21:07:20.394072 | aio | skipping: [aio] 2026-03-05 21:07:20.394284 | aio | 2026-03-05 21:07:20.394527 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:20.394788 | aio | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.041) 0:01:23.397 ******** 2026-03-05 21:07:20.430756 | aio | skipping: [aio] 2026-03-05 21:07:20.430967 | aio | 2026-03-05 21:07:20.431181 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:20.431342 | aio | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.036) 0:01:23.434 ******** 2026-03-05 21:07:20.633314 | aio | ok: [aio] 2026-03-05 21:07:20.633355 | aio | 2026-03-05 21:07:20.633468 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:20.633571 | aio | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.202) 0:01:23.636 ******** 2026-03-05 21:07:21.784032 | aio | ok: [aio] 2026-03-05 21:07:21.784144 | aio | 2026-03-05 21:07:21.784156 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:21.784167 | aio | Thursday 05 March 2026 21:07:21 +0000 (0:00:01.150) 0:01:24.786 ******** 2026-03-05 21:07:21.848985 | aio | ok: [aio] => { 2026-03-05 21:07:21.849679 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:07:21.849740 | aio | } 2026-03-05 21:07:21.849748 | aio | 2026-03-05 21:07:21.849755 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:21.849763 | aio | Thursday 05 March 2026 21:07:21 +0000 (0:00:00.065) 0:01:24.852 ******** 2026-03-05 21:07:22.186395 | aio | ok: [aio] 2026-03-05 21:07:22.186461 | aio | 2026-03-05 21:07:22.186658 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:22.186708 | aio | Thursday 05 March 2026 21:07:22 +0000 (0:00:00.337) 0:01:25.190 ******** 2026-03-05 21:07:24.129289 | aio | ok: [aio] 2026-03-05 21:07:24.129367 | aio | 2026-03-05 21:07:24.129432 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:07:24.129565 | aio | Thursday 05 March 2026 21:07:24 +0000 (0:00:01.943) 0:01:27.133 ******** 2026-03-05 21:07:24.154757 | aio | skipping: [aio] 2026-03-05 21:07:24.154841 | aio | 2026-03-05 21:07:24.154942 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:07:24.155035 | aio | Thursday 05 March 2026 21:07:24 +0000 (0:00:00.025) 0:01:27.158 ******** 2026-03-05 21:07:24.181604 | aio | skipping: [aio] 2026-03-05 21:07:24.181684 | aio | 2026-03-05 21:07:24.181775 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:07:24.181866 | aio | Thursday 05 March 2026 21:07:24 +0000 (0:00:00.027) 0:01:27.185 ******** 2026-03-05 21:07:24.208023 | aio | skipping: [aio] 2026-03-05 21:07:24.208101 | aio | 2026-03-05 21:07:24.208194 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:07:24.208285 | aio | Thursday 05 March 2026 21:07:24 +0000 (0:00:00.026) 0:01:27.212 ******** 2026-03-05 21:07:25.341670 | aio | ok: [aio] 2026-03-05 21:07:25.341867 | aio | 2026-03-05 21:07:25.342089 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:07:25.342296 | aio | Thursday 05 March 2026 21:07:25 +0000 (0:00:01.133) 0:01:28.345 ******** 2026-03-05 21:07:25.764040 | aio | ok: [aio] 2026-03-05 21:07:25.764226 | aio | 2026-03-05 21:07:25.764452 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:07:25.764716 | aio | Thursday 05 March 2026 21:07:25 +0000 (0:00:00.422) 0:01:28.767 ******** 2026-03-05 21:07:26.662042 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-03-05 21:07:26.662099 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:07:26.662107 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:07:26.662114 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:07:26.662121 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:07:26.662128 | aio | 2026-03-05 21:07:26.662134 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:07:26.662140 | aio | Thursday 05 March 2026 21:07:26 +0000 (0:00:00.897) 0:01:29.664 ******** 2026-03-05 21:07:27.139564 | aio | ok: [aio] 2026-03-05 21:07:27.139629 | aio | 2026-03-05 21:07:27.139718 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:07:27.140113 | aio | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.473) 0:01:30.138 ******** 2026-03-05 21:07:27.140153 | aio | 2026-03-05 21:07:27.140164 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:07:27.140169 | aio | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.005) 0:01:30.143 ******** 2026-03-05 21:07:27.491529 | aio | ok: [aio] 2026-03-05 21:07:27.491590 | aio | 2026-03-05 21:07:27.491803 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:27.492051 | aio | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.351) 0:01:30.495 ******** 2026-03-05 21:07:27.680477 | aio | ok: [aio] 2026-03-05 21:07:27.680565 | aio | 2026-03-05 21:07:27.680653 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:27.680785 | aio | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.188) 0:01:30.684 ******** 2026-03-05 21:07:27.745540 | aio | ok: [aio] => { 2026-03-05 21:07:27.746188 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:07:27.746213 | aio | } 2026-03-05 21:07:27.746220 | aio | 2026-03-05 21:07:27.746227 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:27.746234 | aio | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.064) 0:01:30.749 ******** 2026-03-05 21:07:28.081858 | aio | ok: [aio] 2026-03-05 21:07:28.081932 | aio | 2026-03-05 21:07:28.082263 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:28.082285 | aio | Thursday 05 March 2026 21:07:28 +0000 (0:00:00.336) 0:01:31.085 ******** 2026-03-05 21:07:31.115986 | aio | ok: [aio] 2026-03-05 21:07:31.116039 | aio | 2026-03-05 21:07:31.116180 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:07:31.116320 | aio | Thursday 05 March 2026 21:07:31 +0000 (0:00:03.034) 0:01:34.120 ******** 2026-03-05 21:07:32.053879 | aio | ok: [aio] 2026-03-05 21:07:32.053944 | aio | 2026-03-05 21:07:32.054006 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:07:32.054122 | aio | Thursday 05 March 2026 21:07:32 +0000 (0:00:00.937) 0:01:35.057 ******** 2026-03-05 21:07:32.229299 | aio | ok: [aio] 2026-03-05 21:07:32.229405 | aio | 2026-03-05 21:07:32.229672 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:07:32.229693 | aio | Thursday 05 March 2026 21:07:32 +0000 (0:00:00.175) 0:01:35.232 ******** 2026-03-05 21:07:32.641051 | aio | ok: [aio] 2026-03-05 21:07:32.641117 | aio | 2026-03-05 21:07:32.641177 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:07:32.641352 | aio | Thursday 05 March 2026 21:07:32 +0000 (0:00:00.411) 0:01:35.644 ******** 2026-03-05 21:07:33.169543 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-03-05 21:07:33.169661 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:07:33.170224 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:07:33.170284 | aio | 2026-03-05 21:07:33.170291 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:07:33.170296 | aio | Thursday 05 March 2026 21:07:33 +0000 (0:00:00.528) 0:01:36.173 ******** 2026-03-05 21:07:33.580175 | aio | ok: [aio] 2026-03-05 21:07:33.580569 | aio | 2026-03-05 21:07:33.580640 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:07:33.580874 | aio | Thursday 05 March 2026 21:07:33 +0000 (0:00:00.409) 0:01:36.582 ******** 2026-03-05 21:07:33.996411 | aio | ok: [aio] 2026-03-05 21:07:33.996514 | aio | 2026-03-05 21:07:33.996638 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:07:33.996733 | aio | Thursday 05 March 2026 21:07:33 +0000 (0:00:00.412) 0:01:36.995 ******** 2026-03-05 21:07:33.996822 | aio | 2026-03-05 21:07:33.996916 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:07:33.997013 | aio | Thursday 05 March 2026 21:07:33 +0000 (0:00:00.005) 0:01:37.000 ******** 2026-03-05 21:07:34.344266 | aio | ok: [aio] 2026-03-05 21:07:34.344431 | aio | 2026-03-05 21:07:34.344682 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:07:34.344883 | aio | Thursday 05 March 2026 21:07:34 +0000 (0:00:00.347) 0:01:37.347 ******** 2026-03-05 21:07:34.386992 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:07:34.387197 | aio | 2026-03-05 21:07:34.387425 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:07:34.387648 | aio | Thursday 05 March 2026 21:07:34 +0000 (0:00:00.042) 0:01:37.390 ******** 2026-03-05 21:07:35.332554 | aio | ok: [aio] 2026-03-05 21:07:35.332717 | aio | 2026-03-05 21:07:35.332933 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:07:35.333142 | aio | Thursday 05 March 2026 21:07:35 +0000 (0:00:00.945) 0:01:38.336 ******** 2026-03-05 21:07:35.975779 | aio | ok: [aio] => (item=chronyd) 2026-03-05 21:07:35.975957 | aio | ok: [aio] => (item=sshd) 2026-03-05 21:07:35.976140 | aio | 2026-03-05 21:07:35.976346 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:07:35.976606 | aio | Thursday 05 March 2026 21:07:35 +0000 (0:00:00.643) 0:01:38.979 ******** 2026-03-05 21:07:36.483076 | aio | ok: [aio] 2026-03-05 21:07:36.483143 | aio | 2026-03-05 21:07:36.483154 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:07:36.483165 | aio | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.506) 0:01:39.485 ******** 2026-03-05 21:07:36.677096 | aio | ok: [aio] 2026-03-05 21:07:36.677155 | aio | 2026-03-05 21:07:36.677385 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:07:36.677424 | aio | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.195) 0:01:39.680 ******** 2026-03-05 21:07:36.907300 | aio | ok: [aio] 2026-03-05 21:07:36.907378 | aio | 2026-03-05 21:07:36.907613 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:07:36.907658 | aio | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.230) 0:01:39.911 ******** 2026-03-05 21:07:37.108553 | aio | ok: [aio] 2026-03-05 21:07:37.108655 | aio | 2026-03-05 21:07:37.108907 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:07:37.108959 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.201) 0:01:40.112 ******** 2026-03-05 21:07:37.320255 | aio | ok: [aio] => (item=aio) 2026-03-05 21:07:37.320319 | aio | 2026-03-05 21:07:37.320425 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:07:37.320690 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.211) 0:01:40.324 ******** 2026-03-05 21:07:37.358301 | aio | ok: [aio] 2026-03-05 21:07:37.358474 | aio | 2026-03-05 21:07:37.358803 | aio | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:07:37.359130 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.038) 0:01:40.362 ******** 2026-03-05 21:07:37.406146 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-03-05 21:07:37.406395 | aio | 2026-03-05 21:07:37.406699 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:07:37.406982 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.047) 0:01:40.410 ******** 2026-03-05 21:07:37.441097 | aio | skipping: [aio] 2026-03-05 21:07:37.441262 | aio | 2026-03-05 21:07:37.441490 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:07:37.441687 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.034) 0:01:40.444 ******** 2026-03-05 21:07:37.472198 | aio | skipping: [aio] => (item=aio) 2026-03-05 21:07:37.472389 | aio | skipping: [aio] 2026-03-05 21:07:37.472597 | aio | 2026-03-05 21:07:37.472801 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:07:37.472998 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.031) 0:01:40.476 ******** 2026-03-05 21:07:37.702516 | aio | ok: [aio] 2026-03-05 21:07:37.702735 | aio | 2026-03-05 21:07:37.702992 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:07:37.703208 | aio | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.229) 0:01:40.706 ******** 2026-03-05 21:07:44.181427 | aio | ok: [aio] 2026-03-05 21:07:44.181501 | aio | 2026-03-05 21:07:44.181513 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:07:44.181523 | aio | Thursday 05 March 2026 21:07:44 +0000 (0:00:06.478) 0:01:47.184 ******** 2026-03-05 21:07:49.610202 | aio | ok: [aio] 2026-03-05 21:07:49.610267 | aio | 2026-03-05 21:07:49.610351 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:07:49.610480 | aio | Thursday 05 March 2026 21:07:49 +0000 (0:00:05.429) 0:01:52.614 ******** 2026-03-05 21:08:04.024414 | aio | ok: [aio] 2026-03-05 21:08:04.024694 | aio | 2026-03-05 21:08:04.024711 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:08:04.024722 | aio | Thursday 05 March 2026 21:08:04 +0000 (0:00:14.413) 0:02:07.027 ******** 2026-03-05 21:08:04.094865 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-03-05 21:08:04.095437 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-03-05 21:08:04.095485 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-03-05 21:08:04.095491 | aio | skipping: [aio] 2026-03-05 21:08:04.095496 | aio | 2026-03-05 21:08:04.095501 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:08:04.095506 | aio | Thursday 05 March 2026 21:08:04 +0000 (0:00:00.070) 0:02:07.098 ******** 2026-03-05 21:08:10.351082 | aio | ok: [aio] 2026-03-05 21:08:10.351191 | aio | 2026-03-05 21:08:10.351468 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:08:10.351489 | aio | Thursday 05 March 2026 21:08:10 +0000 (0:00:06.256) 0:02:13.354 ******** 2026-03-05 21:08:16.474912 | aio | ok: [aio] 2026-03-05 21:08:16.474986 | aio | 2026-03-05 21:08:16.475306 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:08:16.475353 | aio | Thursday 05 March 2026 21:08:16 +0000 (0:00:06.123) 0:02:19.478 ******** 2026-03-05 21:08:16.526678 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-03-05 21:08:16.526741 | aio | 2026-03-05 21:08:16.526853 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:08:16.526903 | aio | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.051) 0:02:19.530 ******** 2026-03-05 21:08:16.563422 | aio | ok: [aio] 2026-03-05 21:08:16.563492 | aio | 2026-03-05 21:08:16.563760 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:08:16.563792 | aio | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.036) 0:02:19.567 ******** 2026-03-05 21:08:22.672957 | aio | ok: [aio] 2026-03-05 21:08:22.673040 | aio | 2026-03-05 21:08:22.673342 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:08:22.673385 | aio | Thursday 05 March 2026 21:08:22 +0000 (0:00:06.109) 0:02:25.676 ******** 2026-03-05 21:08:22.715490 | aio | ok: [aio] 2026-03-05 21:08:22.715520 | aio | 2026-03-05 21:08:22.715777 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:08:22.715800 | aio | Thursday 05 March 2026 21:08:22 +0000 (0:00:00.042) 0:02:25.719 ******** 2026-03-05 21:08:22.750782 | aio | skipping: [aio] => (item=1) 2026-03-05 21:08:22.750838 | aio | skipping: [aio] => (item=1) 2026-03-05 21:08:22.750931 | aio | skipping: [aio] => (item=1) 2026-03-05 21:08:22.751018 | aio | skipping: [aio] 2026-03-05 21:08:22.751301 | aio | 2026-03-05 21:08:22.751319 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:08:22.751325 | aio | Thursday 05 March 2026 21:08:22 +0000 (0:00:00.035) 0:02:25.754 ******** 2026-03-05 21:08:22.776386 | aio | skipping: [aio] 2026-03-05 21:08:22.776574 | aio | 2026-03-05 21:08:22.779856 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:08:22.779872 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-03-05 21:08:22.779878 | aio | 2026-03-05 21:08:22.779882 | aio | 2026-03-05 21:08:22.779886 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:08:22.779890 | aio | Thursday 05 March 2026 21:08:22 +0000 (0:00:00.025) 0:02:25.780 ******** 2026-03-05 21:08:22.779895 | aio | =============================================================================== 2026-03-05 21:08:22.779899 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 14.41s 2026-03-05 21:08:22.779903 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.31s 2026-03-05 21:08:22.779907 | aio | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.33s 2026-03-05 21:08:22.779911 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.59s 2026-03-05 21:08:22.779915 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.57s 2026-03-05 21:08:22.779920 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.48s 2026-03-05 21:08:22.779924 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.32s 2026-03-05 21:08:22.779928 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.26s 2026-03-05 21:08:22.779932 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.25s 2026-03-05 21:08:22.779936 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.21s 2026-03-05 21:08:22.779940 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.15s 2026-03-05 21:08:22.779944 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.12s 2026-03-05 21:08:22.779948 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.11s 2026-03-05 21:08:22.779952 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.43s 2026-03-05 21:08:22.779956 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-03-05 21:08:22.779960 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s 2026-03-05 21:08:22.779965 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.14s 2026-03-05 21:08:22.779969 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 1.94s 2026-03-05 21:08:22.779973 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.15s 2026-03-05 21:08:22.779977 | aio | Gathering Facts --------------------------------------------------------- 1.14s 2026-03-05 21:08:22.871645 | aio | INFO [default > idempotence] Executed: Successful 2026-03-05 21:08:22.881471 | aio | INFO [default > side_effect] Executing 2026-03-05 21:08:22.881804 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:08:22.886753 | aio | INFO [default > verify] Executing 2026-03-05 21:08:23.498287 | aio | 2026-03-05 21:08:23.498335 | aio | PLAY [Verify] ****************************************************************** 2026-03-05 21:08:23.498340 | aio | 2026-03-05 21:08:23.498344 | aio | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:08:23.498349 | aio | Thursday 05 March 2026 21:08:23 +0000 (0:00:00.006) 0:00:00.006 ******** 2026-03-05 21:08:24.606784 | aio | [WARNING]: Platform linux on host aio is using the discovered Python 2026-03-05 21:08:24.606854 | aio | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:08:24.606867 | aio | interpreter could change the meaning of that path. See 2026-03-05 21:08:24.606876 | aio | https://docs.ansible.com/ansible- 2026-03-05 21:08:24.606886 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:08:24.615653 | aio | ok: [aio] 2026-03-05 21:08:24.615685 | aio | 2026-03-05 21:08:24.615696 | aio | TASK [Get cluster health status] *********************************************** 2026-03-05 21:08:24.615706 | aio | Thursday 05 March 2026 21:08:24 +0000 (0:00:01.116) 0:00:01.123 ******** 2026-03-05 21:08:34.906986 | aio | ok: [aio] 2026-03-05 21:08:34.907051 | aio | 2026-03-05 21:08:34.907063 | aio | TASK [Print cluster health status] ********************************************* 2026-03-05 21:08:34.907073 | aio | Thursday 05 March 2026 21:08:34 +0000 (0:00:10.291) 0:00:11.414 ******** 2026-03-05 21:08:34.944026 | aio | ok: [aio] => { 2026-03-05 21:08:34.944049 | aio | "_ceph_health": { 2026-03-05 21:08:34.944056 | aio | "changed": false, 2026-03-05 21:08:34.944062 | aio | "cmd": [ 2026-03-05 21:08:34.944068 | aio | "cephadm", 2026-03-05 21:08:34.944073 | aio | "shell", 2026-03-05 21:08:34.944079 | aio | "--", 2026-03-05 21:08:34.944085 | aio | "ceph", 2026-03-05 21:08:34.944090 | aio | "health" 2026-03-05 21:08:34.944096 | aio | ], 2026-03-05 21:08:34.944101 | aio | "delta": "0:00:10.013007", 2026-03-05 21:08:34.944108 | aio | "end": "2026-03-05 21:08:34.869394", 2026-03-05 21:08:34.944113 | aio | "failed": false, 2026-03-05 21:08:34.944119 | aio | "msg": "", 2026-03-05 21:08:34.944124 | aio | "rc": 0, 2026-03-05 21:08:34.944130 | aio | "start": "2026-03-05 21:08:24.856387", 2026-03-05 21:08:34.944136 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-03-05 21:08:34.944143 | aio | "stderr_lines": [ 2026-03-05 21:08:34.944149 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:08:34.944154 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-03-05 21:08:34.944160 | aio | ], 2026-03-05 21:08:34.944166 | aio | "stdout": "HEALTH_OK", 2026-03-05 21:08:34.944172 | aio | "stdout_lines": [ 2026-03-05 21:08:34.944177 | aio | "HEALTH_OK" 2026-03-05 21:08:34.944183 | aio | ] 2026-03-05 21:08:34.944189 | aio | } 2026-03-05 21:08:34.944194 | aio | } 2026-03-05 21:08:34.944200 | aio | 2026-03-05 21:08:34.944206 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:08:34.944211 | aio | Thursday 05 March 2026 21:08:34 +0000 (0:00:00.035) 0:00:11.449 ******** 2026-03-05 21:08:34.972351 | aio | ok: [aio] => { 2026-03-05 21:08:34.972386 | aio | "changed": false, 2026-03-05 21:08:34.972397 | aio | "msg": "All assertions passed" 2026-03-05 21:08:34.972406 | aio | } 2026-03-05 21:08:34.972415 | aio | 2026-03-05 21:08:34.972425 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:08:34.972434 | aio | Thursday 05 March 2026 21:08:34 +0000 (0:00:00.030) 0:00:11.480 ******** 2026-03-05 21:08:43.652380 | aio | changed: [aio] 2026-03-05 21:08:43.652453 | aio | 2026-03-05 21:08:43.652512 | aio | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:08:43.652526 | aio | Thursday 05 March 2026 21:08:43 +0000 (0:00:08.679) 0:00:20.160 ******** 2026-03-05 21:08:46.050385 | aio | changed: [aio] 2026-03-05 21:08:46.050457 | aio | 2026-03-05 21:08:46.050470 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:08:46.050481 | aio | Thursday 05 March 2026 21:08:46 +0000 (0:00:02.398) 0:00:22.558 ******** 2026-03-05 21:08:47.219208 | aio | ok: [aio] 2026-03-05 21:08:47.219291 | aio | 2026-03-05 21:08:47.219768 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:08:47.219829 | aio | Thursday 05 March 2026 21:08:47 +0000 (0:00:01.169) 0:00:23.727 ******** 2026-03-05 21:08:47.251266 | aio | ok: [aio] => { 2026-03-05 21:08:47.252502 | aio | "changed": false, 2026-03-05 21:08:47.252521 | aio | "msg": "All assertions passed" 2026-03-05 21:08:47.252527 | aio | } 2026-03-05 21:08:47.252532 | aio | 2026-03-05 21:08:47.252538 | aio | PLAY RECAP ********************************************************************* 2026-03-05 21:08:47.252543 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:08:47.254830 | aio | 2026-03-05 21:08:47.254867 | aio | 2026-03-05 21:08:47.254878 | aio | TASKS RECAP ******************************************************************** 2026-03-05 21:08:47.254889 | aio | Thursday 05 March 2026 21:08:47 +0000 (0:00:00.032) 0:00:23.760 ******** 2026-03-05 21:08:47.254898 | aio | =============================================================================== 2026-03-05 21:08:47.254907 | aio | Get cluster health status ---------------------------------------------- 10.29s 2026-03-05 21:08:47.254916 | aio | Create a test Ceph pool ------------------------------------------------- 8.68s 2026-03-05 21:08:47.254925 | aio | Create a test Ceph key -------------------------------------------------- 2.40s 2026-03-05 21:08:47.254934 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.17s 2026-03-05 21:08:47.254942 | aio | Gathering Facts --------------------------------------------------------- 1.12s 2026-03-05 21:08:47.254951 | aio | Print cluster health status --------------------------------------------- 0.04s 2026-03-05 21:08:47.254960 | aio | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 21:08:47.254969 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 21:08:47.315291 | aio | INFO [default > verify] Executed: Successful 2026-03-05 21:08:47.325694 | aio | INFO [default > cleanup] Executing 2026-03-05 21:08:47.326004 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:08:47.330912 | aio | INFO [default > destroy] Executing 2026-03-05 21:08:47.331002 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:08:47.331101 | aio | INFO [default > destroy] Executed: Successful 2026-03-05 21:08:47.331364 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:08:47.491641 | aio | ok: Runtime: 0:10:41.374529 2026-03-05 21:08:47.508670 | 2026-03-05 21:08:47.508730 | PLAY RECAP 2026-03-05 21:08:47.508774 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:08:47.508796 | 2026-03-05 21:08:47.606923 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:08:47.610217 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:08:48.275394 | 2026-03-05 21:08:48.275541 | PLAY [all] 2026-03-05 21:08:48.286903 | 2026-03-05 21:08:48.287004 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:08:48.331392 | aio | skipping: Conditional result was False 2026-03-05 21:08:48.341912 | 2026-03-05 21:08:48.342043 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:08:48.385400 | aio | ok 2026-03-05 21:08:48.391355 | 2026-03-05 21:08:48.391425 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:08:48.758404 | aio -> localhost | ok: "/var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/logs" 2026-03-05 21:08:48.957589 | aio -> localhost | changed: "/var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/artifacts" 2026-03-05 21:08:49.178897 | aio -> localhost | changed: "/var/lib/zuul/builds/a5d16f02d37c4c94ac51ba8918eac8e4/work/docs" 2026-03-05 21:08:49.199112 | 2026-03-05 21:08:49.199321 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:08:49.814870 | aio | changed: .d..t...... ./ 2026-03-05 21:08:49.815109 | aio | changed: All items complete 2026-03-05 21:08:49.815142 | 2026-03-05 21:08:50.252653 | aio | changed: .d..t...... ./ 2026-03-05 21:08:50.692126 | aio | changed: .d..t...... ./ 2026-03-05 21:08:50.716369 | 2026-03-05 21:08:50.716522 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:08:51.176304 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.005266 2026-03-05 21:08:51.411001 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.007279 2026-03-05 21:08:51.428788 | 2026-03-05 21:08:51.428903 | PLAY [all] 2026-03-05 21:08:51.435463 | 2026-03-05 21:08:51.438908 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:08:51.852917 | aio | changed 2026-03-05 21:08:51.861802 | 2026-03-05 21:08:51.861968 | PLAY RECAP 2026-03-05 21:08:51.862075 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:08:51.862129 | 2026-03-05 21:08:51.993058 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:08:51.997017 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:08:52.593314 | 2026-03-05 21:08:52.593492 | PLAY [localhost] 2026-03-05 21:08:52.604016 | 2026-03-05 21:08:52.604108 | TASK [Generate Zuul manifest] 2026-03-05 21:08:52.624819 | localhost | ok 2026-03-05 21:08:52.643903 | 2026-03-05 21:08:52.644017 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:08:52.990066 | localhost | changed 2026-03-05 21:08:53.003524 | 2026-03-05 21:08:53.003697 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:08:53.036708 | localhost | ok 2026-03-05 21:08:53.043763 | 2026-03-05 21:08:53.043886 | TASK [Upload logs] 2026-03-05 21:08:53.066329 | localhost | ok 2026-03-05 21:08:53.129270 | 2026-03-05 21:08:53.129439 | TASK [Set zuul-log-path fact] 2026-03-05 21:08:53.150645 | localhost | ok 2026-03-05 21:08:53.163184 | 2026-03-05 21:08:53.163330 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:08:53.197216 | localhost | ok 2026-03-05 21:08:53.206665 | 2026-03-05 21:08:53.206773 | TASK [upload-logs : Create log directories] 2026-03-05 21:08:53.655227 | localhost | changed 2026-03-05 21:08:53.661758 | 2026-03-05 21:08:53.661852 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:08:54.050305 | localhost -> localhost | ok: Runtime: 0:00:00.006994 2026-03-05 21:08:54.058052 | 2026-03-05 21:08:54.058140 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:08:54.902044 | localhost | Output suppressed because no_log was given 2026-03-05 21:08:54.907744 | 2026-03-05 21:08:54.907835 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:08:54.952090 | localhost | skipping: Conditional result was False 2026-03-05 21:08:54.959327 | localhost | skipping: Conditional result was False 2026-03-05 21:08:54.972577 | 2026-03-05 21:08:54.972738 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:08:55.026859 | localhost | skipping: Conditional result was False 2026-03-05 21:08:55.027734 | 2026-03-05 21:08:55.033354 | localhost | skipping: Conditional result was False 2026-03-05 21:08:55.048324 | 2026-03-05 21:08:55.048490 | LOOP [upload-logs : Upload console log and json output]