2026-03-26 18:11:45.005331 | Job console starting 2026-03-26 18:11:45.388350 | Updating git repos 2026-03-26 18:11:45.420374 | Cloning repos into workspace 2026-03-26 18:11:46.272115 | Restoring repo states 2026-03-26 18:11:46.283822 | Merging changes 2026-03-26 18:11:46.588349 | Checking out repos 2026-03-26 18:11:46.705898 | Preparing playbooks 2026-03-26 18:11:48.638702 | Running Ansible setup 2026-03-26 18:11:54.457069 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-26 18:11:55.073245 | 2026-03-26 18:11:55.073402 | PLAY [localhost] 2026-03-26 18:11:55.082123 | 2026-03-26 18:11:55.082201 | TASK [Gathering Facts] 2026-03-26 18:11:56.004451 | localhost | ok 2026-03-26 18:11:56.014034 | 2026-03-26 18:11:56.014144 | TASK [Setup log path fact] 2026-03-26 18:11:56.033033 | localhost | ok 2026-03-26 18:11:56.048112 | 2026-03-26 18:11:56.048197 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-26 18:11:56.079015 | localhost | ok 2026-03-26 18:11:56.088951 | 2026-03-26 18:11:56.089098 | TASK [emit-job-header : Print job information] 2026-03-26 18:11:56.127972 | # Job Information 2026-03-26 18:11:56.128170 | Ansible Version: 2.16.16 2026-03-26 18:11:56.128204 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-26 18:11:56.128226 | Pipeline: check 2026-03-26 18:11:56.128247 | Executor: 0a8996d2b663 2026-03-26 18:11:56.128267 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/91 2026-03-26 18:11:56.128289 | Event ID: 950a7e00-293e-11f1-8411-6d21c09dd037 2026-03-26 18:11:56.131167 | 2026-03-26 18:11:56.131241 | LOOP [emit-job-header : Print node information] 2026-03-26 18:11:56.231313 | localhost | ok: 2026-03-26 18:11:56.231598 | localhost | # Node Information 2026-03-26 18:11:56.231641 | localhost | Inventory Hostname: mon1 2026-03-26 18:11:56.231681 | localhost | Hostname: np0000161101 2026-03-26 18:11:56.231728 | localhost | Username: zuul 2026-03-26 18:11:56.231784 | localhost | Distro: Ubuntu 24.04 2026-03-26 18:11:56.231817 | localhost | Provider: yul1 2026-03-26 18:11:56.231844 | localhost | Region: ca-ymq-1 2026-03-26 18:11:56.231870 | localhost | Label: ubuntu-noble 2026-03-26 18:11:56.231931 | localhost | Product Name: OpenStack Nova 2026-03-26 18:11:56.231958 | localhost | Interface IP: 199.19.213.133 2026-03-26 18:11:56.284647 | localhost | ok: 2026-03-26 18:11:56.284767 | localhost | # Node Information 2026-03-26 18:11:56.284799 | localhost | Inventory Hostname: osd1 2026-03-26 18:11:56.284823 | localhost | Hostname: np0000161102 2026-03-26 18:11:56.284847 | localhost | Username: zuul 2026-03-26 18:11:56.284869 | localhost | Distro: Ubuntu 24.04 2026-03-26 18:11:56.284891 | localhost | Provider: yul1 2026-03-26 18:11:56.284912 | localhost | Region: ca-ymq-1 2026-03-26 18:11:56.284933 | localhost | Label: ubuntu-noble 2026-03-26 18:11:56.284976 | localhost | Product Name: OpenStack Nova 2026-03-26 18:11:56.285002 | localhost | Interface IP: 199.19.213.215 2026-03-26 18:11:56.300913 | 2026-03-26 18:11:56.301134 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-26 18:11:56.702542 | localhost -> localhost | changed 2026-03-26 18:11:56.710823 | 2026-03-26 18:11:56.710922 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-26 18:11:57.670027 | localhost -> localhost | changed 2026-03-26 18:11:57.679139 | 2026-03-26 18:11:57.679331 | PLAY [all] 2026-03-26 18:11:57.695819 | 2026-03-26 18:11:57.696036 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-26 18:11:57.944608 | mon1 -> localhost | ok 2026-03-26 18:11:57.957538 | 2026-03-26 18:11:57.957613 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-26 18:11:57.990589 | mon1 | ok 2026-03-26 18:11:57.996687 | osd1 | ok 2026-03-26 18:11:58.015816 | mon1 | included: /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-26 18:11:58.015911 | osd1 | included: /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-26 18:11:58.022844 | 2026-03-26 18:11:58.022911 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-26 18:11:59.850053 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-26 18:11:59.850284 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/98b947063c6b42a2aa36b0630f879e08_id_rsa 2026-03-26 18:11:59.850329 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/98b947063c6b42a2aa36b0630f879e08_id_rsa.pub 2026-03-26 18:11:59.850364 | mon1 -> localhost | The key fingerprint is: 2026-03-26 18:11:59.850396 | mon1 -> localhost | SHA256:qCkaUQiLd2YcDSfTO0juT3SuFYN5qXp2JBSm5TEsEec zuul-build-sshkey 2026-03-26 18:11:59.850426 | mon1 -> localhost | The key's randomart image is: 2026-03-26 18:11:59.850455 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-26 18:11:59.850483 | mon1 -> localhost | |. BBo | 2026-03-26 18:11:59.850513 | mon1 -> localhost | |oo .oBX | 2026-03-26 18:11:59.850542 | mon1 -> localhost | |+ oo=BEB . | 2026-03-26 18:11:59.850571 | mon1 -> localhost | | o ++ O.* | 2026-03-26 18:11:59.850600 | mon1 -> localhost | |. . o.*So | 2026-03-26 18:11:59.850628 | mon1 -> localhost | | . .o+ + | 2026-03-26 18:11:59.850656 | mon1 -> localhost | |. . o+ = | 2026-03-26 18:11:59.850683 | mon1 -> localhost | | o .. = . | 2026-03-26 18:11:59.850710 | mon1 -> localhost | |. o . | 2026-03-26 18:11:59.850737 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-26 18:11:59.850800 | mon1 -> localhost | ok: Runtime: 0:00:01.417190 2026-03-26 18:11:59.863397 | 2026-03-26 18:11:59.869087 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-26 18:11:59.901791 | mon1 | ok 2026-03-26 18:11:59.909694 | osd1 | ok 2026-03-26 18:11:59.932909 | mon1 | included: /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-26 18:11:59.933078 | osd1 | included: /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-26 18:11:59.945041 | 2026-03-26 18:11:59.945178 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-26 18:11:59.972869 | mon1 | skipping: Conditional result was False 2026-03-26 18:11:59.985003 | osd1 | skipping: Conditional result was False 2026-03-26 18:11:59.996734 | 2026-03-26 18:11:59.996801 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-26 18:12:00.526509 | mon1 | changed 2026-03-26 18:12:00.547253 | osd1 | changed 2026-03-26 18:12:00.555650 | 2026-03-26 18:12:00.555794 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-26 18:12:00.780315 | mon1 | ok 2026-03-26 18:12:00.785608 | osd1 | ok 2026-03-26 18:12:00.792113 | 2026-03-26 18:12:00.792225 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-26 18:12:01.376617 | osd1 | changed 2026-03-26 18:12:01.383747 | mon1 | changed 2026-03-26 18:12:01.391757 | 2026-03-26 18:12:01.391886 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-26 18:12:02.024590 | osd1 | changed 2026-03-26 18:12:02.029711 | mon1 | changed 2026-03-26 18:12:02.035476 | 2026-03-26 18:12:02.035551 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-26 18:12:02.064889 | mon1 | skipping: Conditional result was False 2026-03-26 18:12:02.076724 | osd1 | skipping: Conditional result was False 2026-03-26 18:12:02.088486 | 2026-03-26 18:12:02.088642 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-26 18:12:02.429977 | mon1 -> localhost | changed 2026-03-26 18:12:02.453887 | 2026-03-26 18:12:02.454051 | TASK [add-build-sshkey : Add back temp key] 2026-03-26 18:12:02.772047 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/98b947063c6b42a2aa36b0630f879e08_id_rsa (zuul-build-sshkey) 2026-03-26 18:12:02.772322 | mon1 -> localhost | ok: Runtime: 0:00:00.016850 2026-03-26 18:12:02.780213 | 2026-03-26 18:12:02.780305 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-26 18:12:03.095020 | osd1 | ok 2026-03-26 18:12:03.101131 | mon1 | ok 2026-03-26 18:12:03.106173 | 2026-03-26 18:12:03.106241 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-26 18:12:03.132942 | mon1 | skipping: Conditional result was False 2026-03-26 18:12:03.144416 | osd1 | skipping: Conditional result was False 2026-03-26 18:12:03.168230 | 2026-03-26 18:12:03.168362 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-26 18:12:03.484418 | mon1 | ok 2026-03-26 18:12:03.489060 | osd1 | ok 2026-03-26 18:12:03.495006 | 2026-03-26 18:12:03.495090 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-26 18:12:04.334283 | osd1 | Output suppressed because no_log was given 2026-03-26 18:12:04.366099 | mon1 | Output suppressed because no_log was given 2026-03-26 18:12:04.613832 | 2026-03-26 18:12:04.613957 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-26 18:12:04.857369 | osd1 | ok: "logs" 2026-03-26 18:12:04.857743 | osd1 | ok: All items complete 2026-03-26 18:12:04.857794 | 2026-03-26 18:12:04.863298 | mon1 | ok: "logs" 2026-03-26 18:12:05.052531 | osd1 | ok: "artifacts" 2026-03-26 18:12:05.073929 | mon1 | ok: "artifacts" 2026-03-26 18:12:05.248732 | osd1 | ok: "docs" 2026-03-26 18:12:05.271697 | mon1 | ok: "docs" 2026-03-26 18:12:05.288699 | 2026-03-26 18:12:05.288871 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-26 18:12:05.506657 | mon1 | changed: "logs" 2026-03-26 18:12:05.506956 | mon1 | ok: All items complete 2026-03-26 18:12:05.506999 | 2026-03-26 18:12:05.530203 | osd1 | changed: "logs" 2026-03-26 18:12:05.692880 | mon1 | changed: "artifacts" 2026-03-26 18:12:05.730533 | osd1 | changed: "artifacts" 2026-03-26 18:12:05.916423 | mon1 | changed: "docs" 2026-03-26 18:12:05.938816 | osd1 | changed: "docs" 2026-03-26 18:12:05.969332 | 2026-03-26 18:12:05.969900 | PLAY RECAP 2026-03-26 18:12:05.969969 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-26 18:12:05.970003 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-26 18:12:05.970029 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-26 18:12:05.970047 | 2026-03-26 18:12:06.144695 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-26 18:12:06.150016 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-26 18:12:06.771402 | 2026-03-26 18:12:06.771784 | PLAY [all] 2026-03-26 18:12:06.784652 | 2026-03-26 18:12:06.784761 | TASK [setup-uv : Extract archive] 2026-03-26 18:12:09.344620 | mon1 | changed 2026-03-26 18:12:09.375672 | osd1 | changed 2026-03-26 18:12:09.382372 | 2026-03-26 18:12:09.382551 | TASK [setup-uv : Print version] 2026-03-26 18:12:09.806381 | mon1 | uv 0.8.13 2026-03-26 18:12:09.833876 | osd1 | uv 0.8.13 2026-03-26 18:12:09.948393 | mon1 | ok: Runtime: 0:00:00.013923 2026-03-26 18:12:09.962546 | osd1 | ok: Runtime: 0:00:00.013443 2026-03-26 18:12:09.975945 | 2026-03-26 18:12:09.976071 | PLAY RECAP 2026-03-26 18:12:09.976137 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-26 18:12:09.976179 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-26 18:12:09.976209 | 2026-03-26 18:12:10.104282 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-26 18:12:10.109728 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-26 18:12:10.727409 | 2026-03-26 18:12:10.727709 | PLAY [all] 2026-03-26 18:12:10.741287 | 2026-03-26 18:12:10.741391 | TASK [Copy inventory file for Zuul] 2026-03-26 18:12:11.736204 | mon1 | changed 2026-03-26 18:12:11.743631 | 2026-03-26 18:12:11.743706 | TASK [Switch "ansible_host" to private IP] 2026-03-26 18:12:12.163068 | mon1 | changed: 2 replacements made 2026-03-26 18:12:12.172149 | 2026-03-26 18:12:12.172295 | TASK [Run Molecule scenario] 2026-03-26 18:12:12.654156 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-26 18:12:12.654309 | mon1 | Creating virtual environment at: .venv 2026-03-26 18:12:12.935970 | mon1 | Downloading pygments (1.2MiB) 2026-03-26 18:12:12.936125 | mon1 | Downloading netaddr (2.2MiB) 2026-03-26 18:12:12.936357 | mon1 | Downloading cryptography (4.3MiB) 2026-03-26 18:12:12.937935 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-26 18:12:13.126649 | mon1 | Downloading netaddr 2026-03-26 18:12:13.138136 | mon1 | Downloading cryptography 2026-03-26 18:12:13.204486 | mon1 | Downloading pygments 2026-03-26 18:12:13.401521 | mon1 | Downloading ansible-core 2026-03-26 18:12:13.445926 | mon1 | Installed 37 packages in 43ms 2026-03-26 18:12:14.211908 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-26 18:12:14.212018 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-26 18:12:14.895406 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-26 18:12:14.895498 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-26 18:12:30.626094 | mon1 | INFO [default > dependency] Executing 2026-03-26 18:12:30.626194 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-26 18:12:30.626206 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-26 18:12:30.626285 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-26 18:12:30.631891 | mon1 | INFO [default > cleanup] Executing 2026-03-26 18:12:30.632189 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-26 18:12:30.637947 | mon1 | INFO [default > destroy] Executing 2026-03-26 18:12:30.637984 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-26 18:12:30.638072 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-26 18:12:30.643631 | mon1 | INFO [default > syntax] Executing 2026-03-26 18:12:31.715841 | mon1 | 2026-03-26 18:12:31.716131 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-26 18:12:31.775322 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-26 18:12:31.784721 | mon1 | INFO [default > create] Executing 2026-03-26 18:12:31.786322 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-26 18:12:31.792471 | mon1 | INFO [default > prepare] Executing 2026-03-26 18:12:32.602274 | mon1 | 2026-03-26 18:12:32.602498 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-26 18:12:32.602720 | mon1 | 2026-03-26 18:12:32.602971 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:12:32.603239 | mon1 | Thursday 26 March 2026 18:12:32 +0000 (0:00:00.032) 0:00:00.032 ******** 2026-03-26 18:12:33.872157 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-26 18:12:33.872298 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:12:33.872579 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:12:33.872813 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:12:33.873099 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:12:33.877018 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-26 18:12:33.877243 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:12:33.877510 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:12:33.877749 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:12:33.877995 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:12:33.884179 | mon1 | ok: [osd1] 2026-03-26 18:12:33.884335 | mon1 | ok: [mon1] 2026-03-26 18:12:33.884477 | mon1 | 2026-03-26 18:12:33.884629 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-26 18:12:33.884780 | mon1 | Thursday 26 March 2026 18:12:33 +0000 (0:00:01.282) 0:00:01.315 ******** 2026-03-26 18:12:34.743434 | mon1 | changed: [osd1] 2026-03-26 18:12:34.743513 | mon1 | changed: [mon1] 2026-03-26 18:12:34.743524 | mon1 | 2026-03-26 18:12:34.743534 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-26 18:12:34.743785 | mon1 | Thursday 26 March 2026 18:12:34 +0000 (0:00:00.857) 0:00:02.172 ******** 2026-03-26 18:12:35.072985 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-26 18:12:35.073044 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-26 18:12:35.073055 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-26 18:12:35.086371 | mon1 | changed: [osd1] 2026-03-26 18:12:35.086449 | mon1 | changed: [mon1] 2026-03-26 18:12:35.086466 | mon1 | 2026-03-26 18:12:35.086481 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-26 18:12:35.086851 | mon1 | Thursday 26 March 2026 18:12:35 +0000 (0:00:00.343) 0:00:02.516 ******** 2026-03-26 18:13:00.540204 | mon1 | changed: [mon1] 2026-03-26 18:13:00.540376 | mon1 | changed: [osd1] 2026-03-26 18:13:00.540458 | mon1 | 2026-03-26 18:13:00.540714 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-26 18:13:00.540921 | mon1 | 2026-03-26 18:13:00.541190 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:13:00.541492 | mon1 | Thursday 26 March 2026 18:13:00 +0000 (0:00:25.454) 0:00:27.970 ******** 2026-03-26 18:13:01.389527 | mon1 | ok: [osd1] 2026-03-26 18:13:01.389733 | mon1 | 2026-03-26 18:13:01.389969 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-26 18:13:01.390246 | mon1 | Thursday 26 March 2026 18:13:01 +0000 (0:00:00.849) 0:00:28.820 ******** 2026-03-26 18:13:28.011374 | mon1 | changed: [osd1] 2026-03-26 18:13:28.011488 | mon1 | 2026-03-26 18:13:28.011503 | mon1 | TASK [Start up service] ******************************************************** 2026-03-26 18:13:28.011525 | mon1 | Thursday 26 March 2026 18:13:28 +0000 (0:00:26.618) 0:00:55.438 ******** 2026-03-26 18:13:28.705357 | mon1 | ok: [osd1] 2026-03-26 18:13:28.705442 | mon1 | 2026-03-26 18:13:28.705456 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-26 18:13:28.705469 | mon1 | Thursday 26 March 2026 18:13:28 +0000 (0:00:00.693) 0:00:56.132 ******** 2026-03-26 18:13:29.067033 | mon1 | ok: [osd1] 2026-03-26 18:13:29.067247 | mon1 | 2026-03-26 18:13:29.067700 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-26 18:13:29.068015 | mon1 | Thursday 26 March 2026 18:13:29 +0000 (0:00:00.365) 0:00:56.497 ******** 2026-03-26 18:13:29.883976 | mon1 | changed: [osd1] 2026-03-26 18:13:29.884067 | mon1 | 2026-03-26 18:13:29.884393 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-26 18:13:29.884663 | mon1 | Thursday 26 March 2026 18:13:29 +0000 (0:00:00.817) 0:00:57.314 ******** 2026-03-26 18:13:30.134350 | mon1 | ok: [osd1] 2026-03-26 18:13:30.134558 | mon1 | 2026-03-26 18:13:30.134880 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-26 18:13:30.135330 | mon1 | Thursday 26 March 2026 18:13:30 +0000 (0:00:00.250) 0:00:57.565 ******** 2026-03-26 18:13:30.162644 | mon1 | skipping: [osd1] 2026-03-26 18:13:30.162872 | mon1 | 2026-03-26 18:13:30.163124 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-26 18:13:30.163433 | mon1 | Thursday 26 March 2026 18:13:30 +0000 (0:00:00.028) 0:00:57.593 ******** 2026-03-26 18:13:30.901127 | mon1 | changed: [osd1] => (item=osd0) 2026-03-26 18:13:30.901284 | mon1 | changed: [osd1] => (item=osd1) 2026-03-26 18:13:30.901651 | mon1 | changed: [osd1] => (item=osd2) 2026-03-26 18:13:30.901963 | mon1 | 2026-03-26 18:13:30.902357 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-26 18:13:30.902760 | mon1 | Thursday 26 March 2026 18:13:30 +0000 (0:00:00.737) 0:00:58.331 ******** 2026-03-26 18:13:31.664276 | mon1 | changed: [osd1] => (item=osd0) 2026-03-26 18:13:31.664409 | mon1 | changed: [osd1] => (item=osd1) 2026-03-26 18:13:31.664547 | mon1 | changed: [osd1] => (item=osd2) 2026-03-26 18:13:31.664674 | mon1 | 2026-03-26 18:13:31.664818 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-26 18:13:31.664960 | mon1 | Thursday 26 March 2026 18:13:31 +0000 (0:00:00.762) 0:00:59.093 ******** 2026-03-26 18:13:32.505012 | mon1 | changed: [osd1] => (item=osd0) 2026-03-26 18:13:32.505127 | mon1 | changed: [osd1] => (item=osd1) 2026-03-26 18:13:32.505386 | mon1 | changed: [osd1] => (item=osd2) 2026-03-26 18:13:32.507816 | mon1 | 2026-03-26 18:13:32.507866 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-26 18:13:32.507877 | mon1 | Thursday 26 March 2026 18:13:32 +0000 (0:00:00.841) 0:00:59.935 ******** 2026-03-26 18:13:34.487912 | mon1 | changed: [osd1] => (item=osd0) 2026-03-26 18:13:34.488016 | mon1 | changed: [osd1] => (item=osd1) 2026-03-26 18:13:34.488331 | mon1 | changed: [osd1] => (item=osd2) 2026-03-26 18:13:34.488567 | mon1 | 2026-03-26 18:13:34.488835 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-26 18:13:34.489046 | mon1 | Thursday 26 March 2026 18:13:34 +0000 (0:00:01.982) 0:01:01.918 ******** 2026-03-26 18:13:35.807525 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-26 18:13:35.807767 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-26 18:13:35.808060 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-26 18:13:35.808353 | mon1 | 2026-03-26 18:13:35.808623 | mon1 | PLAY RECAP ********************************************************************* 2026-03-26 18:13:35.808920 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-26 18:13:35.809173 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-26 18:13:35.809451 | mon1 | 2026-03-26 18:13:35.809685 | mon1 | 2026-03-26 18:13:35.810162 | mon1 | TASKS RECAP ******************************************************************** 2026-03-26 18:13:35.810377 | mon1 | Thursday 26 March 2026 18:13:35 +0000 (0:00:01.320) 0:01:03.238 ******** 2026-03-26 18:13:35.810712 | mon1 | =============================================================================== 2026-03-26 18:13:35.810920 | mon1 | Install depedencies ---------------------------------------------------- 26.62s 2026-03-26 18:13:35.811201 | mon1 | Update apt cache ------------------------------------------------------- 25.45s 2026-03-26 18:13:35.811530 | mon1 | Create a volume group for each loop device ------------------------------ 1.98s 2026-03-26 18:13:35.811850 | mon1 | Create a logical volume for each loop device ---------------------------- 1.32s 2026-03-26 18:13:35.812158 | mon1 | Gathering Facts --------------------------------------------------------- 1.28s 2026-03-26 18:13:35.812536 | mon1 | Configure short hostname ------------------------------------------------ 0.86s 2026-03-26 18:13:35.812851 | mon1 | Gathering Facts --------------------------------------------------------- 0.85s 2026-03-26 18:13:35.813104 | mon1 | Start loop devices ------------------------------------------------------ 0.84s 2026-03-26 18:13:35.813390 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.82s 2026-03-26 18:13:35.813636 | mon1 | Set permissions on loopback devices ------------------------------------- 0.76s 2026-03-26 18:13:35.813883 | mon1 | Create devices for Ceph ------------------------------------------------- 0.74s 2026-03-26 18:13:35.814115 | mon1 | Start up service -------------------------------------------------------- 0.69s 2026-03-26 18:13:35.814390 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.37s 2026-03-26 18:13:35.814636 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.34s 2026-03-26 18:13:35.815018 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-03-26 18:13:35.815335 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-26 18:13:35.913032 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-26 18:13:35.922442 | mon1 | INFO [default > converge] Executing 2026-03-26 18:13:36.898647 | mon1 | 2026-03-26 18:13:36.898822 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-26 18:13:36.898939 | mon1 | 2026-03-26 18:13:36.899159 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:13:36.899365 | mon1 | Thursday 26 March 2026 18:13:36 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-03-26 18:13:37.994028 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-26 18:13:37.994335 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:13:37.994627 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:13:37.994850 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:13:37.995103 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:13:38.008660 | mon1 | ok: [mon1] 2026-03-26 18:13:38.008873 | mon1 | 2026-03-26 18:13:38.009125 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:13:38.009406 | mon1 | Thursday 26 March 2026 18:13:38 +0000 (0:00:01.109) 0:00:01.162 ******** 2026-03-26 18:13:38.364851 | mon1 | ok: [mon1] 2026-03-26 18:13:38.364990 | mon1 | 2026-03-26 18:13:38.365268 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:13:38.365524 | mon1 | Thursday 26 March 2026 18:13:38 +0000 (0:00:00.356) 0:00:01.518 ******** 2026-03-26 18:13:38.410180 | mon1 | skipping: [mon1] 2026-03-26 18:13:38.410472 | mon1 | 2026-03-26 18:13:38.410763 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-26 18:13:38.411107 | mon1 | Thursday 26 March 2026 18:13:38 +0000 (0:00:00.045) 0:00:01.564 ******** 2026-03-26 18:13:38.772863 | mon1 | changed: [mon1] 2026-03-26 18:13:38.772956 | mon1 | 2026-03-26 18:13:38.773268 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:13:38.773593 | mon1 | Thursday 26 March 2026 18:13:38 +0000 (0:00:00.362) 0:00:01.926 ******** 2026-03-26 18:13:38.877084 | mon1 | ok: [mon1] => { 2026-03-26 18:13:38.877342 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-26 18:13:38.877583 | mon1 | } 2026-03-26 18:13:38.877844 | mon1 | 2026-03-26 18:13:38.878125 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:13:38.878450 | mon1 | Thursday 26 March 2026 18:13:38 +0000 (0:00:00.104) 0:00:02.031 ******** 2026-03-26 18:13:39.670584 | mon1 | changed: [mon1] 2026-03-26 18:13:39.670701 | mon1 | 2026-03-26 18:13:39.670714 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:13:39.670732 | mon1 | Thursday 26 March 2026 18:13:39 +0000 (0:00:00.792) 0:00:02.823 ******** 2026-03-26 18:13:39.726418 | mon1 | skipping: [mon1] 2026-03-26 18:13:39.726697 | mon1 | 2026-03-26 18:13:39.726887 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:13:39.727191 | mon1 | Thursday 26 March 2026 18:13:39 +0000 (0:00:00.056) 0:00:02.880 ******** 2026-03-26 18:13:39.787343 | mon1 | skipping: [mon1] 2026-03-26 18:13:39.787543 | mon1 | 2026-03-26 18:13:39.787805 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:13:39.788036 | mon1 | Thursday 26 March 2026 18:13:39 +0000 (0:00:00.061) 0:00:02.941 ******** 2026-03-26 18:13:40.101069 | mon1 | ok: [mon1] 2026-03-26 18:13:40.101230 | mon1 | 2026-03-26 18:13:40.101510 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:13:40.101727 | mon1 | Thursday 26 March 2026 18:13:40 +0000 (0:00:00.313) 0:00:03.255 ******** 2026-03-26 18:13:41.240909 | mon1 | ok: [mon1] 2026-03-26 18:13:41.240995 | mon1 | 2026-03-26 18:13:41.241372 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:13:41.241625 | mon1 | Thursday 26 March 2026 18:13:41 +0000 (0:00:01.139) 0:00:04.394 ******** 2026-03-26 18:13:41.453998 | mon1 | ok: [mon1] => { 2026-03-26 18:13:41.454113 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-26 18:13:41.454309 | mon1 | } 2026-03-26 18:13:41.454443 | mon1 | 2026-03-26 18:13:41.454625 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:13:41.454785 | mon1 | Thursday 26 March 2026 18:13:41 +0000 (0:00:00.212) 0:00:04.607 ******** 2026-03-26 18:13:42.721360 | mon1 | changed: [mon1] 2026-03-26 18:13:42.721526 | mon1 | 2026-03-26 18:13:42.721786 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:13:42.722036 | mon1 | Thursday 26 March 2026 18:13:42 +0000 (0:00:01.267) 0:00:05.875 ******** 2026-03-26 18:13:46.035292 | mon1 | changed: [mon1] 2026-03-26 18:13:46.035361 | mon1 | 2026-03-26 18:13:46.035375 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-26 18:13:46.035443 | mon1 | Thursday 26 March 2026 18:13:46 +0000 (0:00:03.313) 0:00:09.188 ******** 2026-03-26 18:13:46.072354 | mon1 | skipping: [mon1] 2026-03-26 18:13:46.073137 | mon1 | 2026-03-26 18:13:46.073289 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-26 18:13:46.073311 | mon1 | Thursday 26 March 2026 18:13:46 +0000 (0:00:00.036) 0:00:09.225 ******** 2026-03-26 18:13:46.109267 | mon1 | skipping: [mon1] 2026-03-26 18:13:46.109311 | mon1 | 2026-03-26 18:13:46.109320 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-26 18:13:46.109328 | mon1 | Thursday 26 March 2026 18:13:46 +0000 (0:00:00.037) 0:00:09.262 ******** 2026-03-26 18:13:46.146395 | mon1 | skipping: [mon1] 2026-03-26 18:13:46.146459 | mon1 | 2026-03-26 18:13:46.146879 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-26 18:13:46.146930 | mon1 | Thursday 26 March 2026 18:13:46 +0000 (0:00:00.037) 0:00:09.299 ******** 2026-03-26 18:14:18.515844 | mon1 | changed: [mon1] 2026-03-26 18:14:18.515903 | mon1 | 2026-03-26 18:14:18.516117 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-26 18:14:18.516133 | mon1 | Thursday 26 March 2026 18:14:18 +0000 (0:00:32.369) 0:00:41.669 ******** 2026-03-26 18:14:19.190887 | mon1 | changed: [mon1] 2026-03-26 18:14:19.190945 | mon1 | 2026-03-26 18:14:19.190958 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-26 18:14:19.190971 | mon1 | Thursday 26 March 2026 18:14:19 +0000 (0:00:00.674) 0:00:42.343 ******** 2026-03-26 18:14:20.335858 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-26 18:14:20.336896 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-26 18:14:20.336939 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-26 18:14:20.336946 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-26 18:14:20.336953 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-26 18:14:20.336960 | mon1 | 2026-03-26 18:14:20.336967 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-26 18:14:20.336974 | mon1 | Thursday 26 March 2026 18:14:20 +0000 (0:00:01.144) 0:00:43.488 ******** 2026-03-26 18:14:21.073362 | mon1 | changed: [mon1] 2026-03-26 18:14:21.073402 | mon1 | 2026-03-26 18:14:21.073409 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-26 18:14:21.073415 | mon1 | Thursday 26 March 2026 18:14:21 +0000 (0:00:00.722) 0:00:44.210 ******** 2026-03-26 18:14:21.073420 | mon1 | 2026-03-26 18:14:21.073811 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-26 18:14:21.073871 | mon1 | Thursday 26 March 2026 18:14:21 +0000 (0:00:00.014) 0:00:44.225 ******** 2026-03-26 18:14:22.219732 | mon1 | ok: [mon1] 2026-03-26 18:14:22.219821 | mon1 | 2026-03-26 18:14:22.221289 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-26 18:14:22.221356 | mon1 | Thursday 26 March 2026 18:14:22 +0000 (0:00:01.148) 0:00:45.373 ******** 2026-03-26 18:14:22.815092 | mon1 | changed: [mon1] 2026-03-26 18:14:22.815199 | mon1 | 2026-03-26 18:14:22.815239 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-26 18:14:22.815255 | mon1 | Thursday 26 March 2026 18:14:22 +0000 (0:00:00.595) 0:00:45.968 ******** 2026-03-26 18:14:23.499987 | mon1 | changed: [mon1] 2026-03-26 18:14:23.500047 | mon1 | 2026-03-26 18:14:23.500058 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:14:23.500067 | mon1 | Thursday 26 March 2026 18:14:23 +0000 (0:00:00.684) 0:00:46.652 ******** 2026-03-26 18:14:23.761331 | mon1 | ok: [mon1] 2026-03-26 18:14:23.761391 | mon1 | 2026-03-26 18:14:23.761401 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:14:23.761416 | mon1 | Thursday 26 March 2026 18:14:23 +0000 (0:00:00.262) 0:00:46.914 ******** 2026-03-26 18:14:23.842394 | mon1 | ok: [mon1] => { 2026-03-26 18:14:23.842436 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-26 18:14:23.842442 | mon1 | } 2026-03-26 18:14:23.842446 | mon1 | 2026-03-26 18:14:23.842450 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:14:23.842455 | mon1 | Thursday 26 March 2026 18:14:23 +0000 (0:00:00.080) 0:00:46.995 ******** 2026-03-26 18:14:24.946998 | mon1 | changed: [mon1] 2026-03-26 18:14:24.947032 | mon1 | 2026-03-26 18:14:24.947037 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:14:24.947041 | mon1 | Thursday 26 March 2026 18:14:24 +0000 (0:00:01.103) 0:00:48.099 ******** 2026-03-26 18:14:29.534387 | mon1 | changed: [mon1] 2026-03-26 18:14:29.534461 | mon1 | 2026-03-26 18:14:29.535031 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-26 18:14:29.535074 | mon1 | Thursday 26 March 2026 18:14:29 +0000 (0:00:04.588) 0:00:52.688 ******** 2026-03-26 18:14:30.481354 | mon1 | ok: [mon1] 2026-03-26 18:14:30.481421 | mon1 | 2026-03-26 18:14:30.481904 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-26 18:14:30.481949 | mon1 | Thursday 26 March 2026 18:14:30 +0000 (0:00:00.946) 0:00:53.634 ******** 2026-03-26 18:14:30.896376 | mon1 | changed: [mon1] 2026-03-26 18:14:30.896431 | mon1 | 2026-03-26 18:14:30.896731 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-26 18:14:30.896983 | mon1 | Thursday 26 March 2026 18:14:30 +0000 (0:00:00.414) 0:00:54.049 ******** 2026-03-26 18:14:31.470762 | mon1 | changed: [mon1] 2026-03-26 18:14:31.470923 | mon1 | 2026-03-26 18:14:31.471243 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-26 18:14:31.471546 | mon1 | Thursday 26 March 2026 18:14:31 +0000 (0:00:00.575) 0:00:54.624 ******** 2026-03-26 18:14:32.160242 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-26 18:14:32.160362 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-26 18:14:32.160624 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-26 18:14:32.160858 | mon1 | 2026-03-26 18:14:32.161119 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-26 18:14:32.161404 | mon1 | Thursday 26 March 2026 18:14:32 +0000 (0:00:00.688) 0:00:55.313 ******** 2026-03-26 18:14:32.763072 | mon1 | changed: [mon1] 2026-03-26 18:14:32.763132 | mon1 | 2026-03-26 18:14:32.763145 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-26 18:14:32.763156 | mon1 | Thursday 26 March 2026 18:14:32 +0000 (0:00:00.601) 0:00:55.915 ******** 2026-03-26 18:14:33.350346 | mon1 | changed: [mon1] 2026-03-26 18:14:33.350422 | mon1 | 2026-03-26 18:14:33.351321 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-26 18:14:33.351348 | mon1 | Thursday 26 March 2026 18:14:33 +0000 (0:00:00.580) 0:00:56.496 ******** 2026-03-26 18:14:33.351357 | mon1 | 2026-03-26 18:14:33.351601 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-26 18:14:33.351878 | mon1 | Thursday 26 March 2026 18:14:33 +0000 (0:00:00.007) 0:00:56.503 ******** 2026-03-26 18:14:34.222419 | mon1 | ok: [mon1] 2026-03-26 18:14:34.222603 | mon1 | 2026-03-26 18:14:34.223297 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-26 18:14:34.223360 | mon1 | Thursday 26 March 2026 18:14:34 +0000 (0:00:00.872) 0:00:57.376 ******** 2026-03-26 18:14:35.972350 | mon1 | changed: [mon1] 2026-03-26 18:14:35.972417 | mon1 | 2026-03-26 18:14:35.972431 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-26 18:14:35.972509 | mon1 | Thursday 26 March 2026 18:14:35 +0000 (0:00:01.749) 0:00:59.125 ******** 2026-03-26 18:14:36.671619 | mon1 | changed: [mon1] 2026-03-26 18:14:36.671810 | mon1 | 2026-03-26 18:14:36.672078 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-26 18:14:36.672353 | mon1 | Thursday 26 March 2026 18:14:36 +0000 (0:00:00.699) 0:00:59.825 ******** 2026-03-26 18:14:36.728947 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-26 18:14:36.729162 | mon1 | 2026-03-26 18:14:36.729454 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-26 18:14:36.729691 | mon1 | Thursday 26 March 2026 18:14:36 +0000 (0:00:00.057) 0:00:59.883 ******** 2026-03-26 18:14:57.547679 | mon1 | changed: [mon1] 2026-03-26 18:14:57.548436 | mon1 | 2026-03-26 18:14:57.548572 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-26 18:14:57.548597 | mon1 | Thursday 26 March 2026 18:14:57 +0000 (0:00:20.811) 0:01:20.694 ******** 2026-03-26 18:14:58.365885 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-26 18:14:58.365918 | mon1 | ok: [mon1] => (item=ssh) 2026-03-26 18:14:58.365925 | mon1 | 2026-03-26 18:14:58.365934 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-26 18:14:58.366267 | mon1 | Thursday 26 March 2026 18:14:58 +0000 (0:00:00.824) 0:01:21.518 ******** 2026-03-26 18:14:58.743644 | mon1 | changed: [mon1] 2026-03-26 18:14:58.743712 | mon1 | 2026-03-26 18:14:58.743958 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-26 18:14:58.743998 | mon1 | Thursday 26 March 2026 18:14:58 +0000 (0:00:00.378) 0:01:21.897 ******** 2026-03-26 18:14:58.979295 | mon1 | ok: [mon1] 2026-03-26 18:14:58.979350 | mon1 | 2026-03-26 18:14:58.979649 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-26 18:14:58.980001 | mon1 | Thursday 26 March 2026 18:14:58 +0000 (0:00:00.235) 0:01:22.132 ******** 2026-03-26 18:14:59.537585 | mon1 | changed: [mon1] 2026-03-26 18:14:59.537989 | mon1 | 2026-03-26 18:14:59.538714 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-26 18:14:59.538745 | mon1 | Thursday 26 March 2026 18:14:59 +0000 (0:00:00.559) 0:01:22.691 ******** 2026-03-26 18:14:59.914334 | mon1 | changed: [mon1] 2026-03-26 18:14:59.914407 | mon1 | 2026-03-26 18:14:59.914604 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-26 18:14:59.914834 | mon1 | Thursday 26 March 2026 18:14:59 +0000 (0:00:00.376) 0:01:23.068 ******** 2026-03-26 18:15:00.040171 | mon1 | ok: [mon1] 2026-03-26 18:15:00.040379 | mon1 | 2026-03-26 18:15:00.040640 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-26 18:15:00.040892 | mon1 | Thursday 26 March 2026 18:15:00 +0000 (0:00:00.125) 0:01:23.194 ******** 2026-03-26 18:15:00.296779 | mon1 | ok: [mon1] => (item=mon1) 2026-03-26 18:15:00.296981 | mon1 | 2026-03-26 18:15:00.297246 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-26 18:15:00.297530 | mon1 | Thursday 26 March 2026 18:15:00 +0000 (0:00:00.256) 0:01:23.450 ******** 2026-03-26 18:15:00.338730 | mon1 | ok: [mon1] 2026-03-26 18:15:00.338819 | mon1 | 2026-03-26 18:15:00.339001 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-26 18:15:00.339159 | mon1 | Thursday 26 March 2026 18:15:00 +0000 (0:00:00.042) 0:01:23.493 ******** 2026-03-26 18:15:00.446841 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-26 18:15:00.447061 | mon1 | 2026-03-26 18:15:00.447349 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-26 18:15:00.447607 | mon1 | Thursday 26 March 2026 18:15:00 +0000 (0:00:00.107) 0:01:23.601 ******** 2026-03-26 18:15:00.763002 | mon1 | changed: [mon1] 2026-03-26 18:15:00.763204 | mon1 | 2026-03-26 18:15:00.763519 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-26 18:15:00.763787 | mon1 | Thursday 26 March 2026 18:15:00 +0000 (0:00:00.315) 0:01:23.916 ******** 2026-03-26 18:15:01.581406 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-26 18:15:01.581476 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-26 18:15:01.581487 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-26 18:15:01.581496 | mon1 | 2026-03-26 18:15:01.581513 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-26 18:15:01.581742 | mon1 | Thursday 26 March 2026 18:15:01 +0000 (0:00:00.818) 0:01:24.734 ******** 2026-03-26 18:16:56.297055 | mon1 | ok: [mon1] 2026-03-26 18:16:56.297123 | mon1 | 2026-03-26 18:16:56.297137 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-26 18:16:56.297150 | mon1 | Thursday 26 March 2026 18:16:56 +0000 (0:01:54.714) 0:03:19.449 ******** 2026-03-26 18:16:56.563778 | mon1 | changed: [mon1] 2026-03-26 18:16:56.563853 | mon1 | 2026-03-26 18:16:56.564202 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-26 18:16:56.564273 | mon1 | Thursday 26 March 2026 18:16:56 +0000 (0:00:00.266) 0:03:19.716 ******** 2026-03-26 18:16:56.608359 | mon1 | ok: [mon1] 2026-03-26 18:16:56.608410 | mon1 | 2026-03-26 18:16:56.608423 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:16:56.608701 | mon1 | Thursday 26 March 2026 18:16:56 +0000 (0:00:00.045) 0:03:19.761 ******** 2026-03-26 18:16:56.685233 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-26 18:16:56.685279 | mon1 | 2026-03-26 18:16:56.685325 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:16:56.685334 | mon1 | Thursday 26 March 2026 18:16:56 +0000 (0:00:00.076) 0:03:19.837 ******** 2026-03-26 18:17:04.121838 | mon1 | ok: [mon1] 2026-03-26 18:17:04.121909 | mon1 | 2026-03-26 18:17:04.121937 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:17:04.121954 | mon1 | Thursday 26 March 2026 18:17:04 +0000 (0:00:07.436) 0:03:27.274 ******** 2026-03-26 18:17:04.185113 | mon1 | ok: [mon1] => (item=mon1) 2026-03-26 18:17:04.185186 | mon1 | 2026-03-26 18:17:04.185193 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:17:04.185198 | mon1 | Thursday 26 March 2026 18:17:04 +0000 (0:00:00.064) 0:03:27.338 ******** 2026-03-26 18:17:04.671039 | mon1 | ok: [mon1] 2026-03-26 18:17:04.671103 | mon1 | 2026-03-26 18:17:04.671117 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:17:04.671130 | mon1 | Thursday 26 March 2026 18:17:04 +0000 (0:00:00.486) 0:03:27.824 ******** 2026-03-26 18:17:13.733433 | mon1 | ok: [mon1] 2026-03-26 18:17:13.733507 | mon1 | 2026-03-26 18:17:13.733807 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-26 18:17:13.734085 | mon1 | Thursday 26 March 2026 18:17:13 +0000 (0:00:09.062) 0:03:36.887 ******** 2026-03-26 18:18:31.517041 | mon1 | changed: [mon1] 2026-03-26 18:18:31.517119 | mon1 | 2026-03-26 18:18:31.517133 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-26 18:18:31.517145 | mon1 | Thursday 26 March 2026 18:18:31 +0000 (0:01:17.783) 0:04:54.670 ******** 2026-03-26 18:18:46.874329 | mon1 | ok: [mon1] 2026-03-26 18:18:46.875291 | mon1 | 2026-03-26 18:18:46.875361 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:18:46.875381 | mon1 | Thursday 26 March 2026 18:18:46 +0000 (0:00:15.357) 0:05:10.028 ******** 2026-03-26 18:18:46.962786 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-26 18:18:46.962842 | mon1 | 2026-03-26 18:18:46.962853 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:18:46.962863 | mon1 | Thursday 26 March 2026 18:18:46 +0000 (0:00:00.087) 0:05:10.116 ******** 2026-03-26 18:18:47.020810 | mon1 | skipping: [mon1] 2026-03-26 18:18:47.020858 | mon1 | 2026-03-26 18:18:47.020870 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:18:47.020880 | mon1 | Thursday 26 March 2026 18:18:47 +0000 (0:00:00.057) 0:05:10.173 ******** 2026-03-26 18:18:47.064862 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-26 18:18:47.064914 | mon1 | skipping: [mon1] 2026-03-26 18:18:47.064925 | mon1 | 2026-03-26 18:18:47.064934 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:18:47.064943 | mon1 | Thursday 26 March 2026 18:18:47 +0000 (0:00:00.044) 0:05:10.217 ******** 2026-03-26 18:18:47.389121 | mon1 | ok: [mon1] 2026-03-26 18:18:47.389163 | mon1 | 2026-03-26 18:18:47.389169 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:18:47.389175 | mon1 | Thursday 26 March 2026 18:18:47 +0000 (0:00:00.325) 0:05:10.543 ******** 2026-03-26 18:19:00.815360 | mon1 | ok: [mon1] 2026-03-26 18:19:00.815442 | mon1 | 2026-03-26 18:19:00.815805 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-26 18:19:00.815848 | mon1 | Thursday 26 March 2026 18:19:00 +0000 (0:00:13.425) 0:05:23.968 ******** 2026-03-26 18:19:27.098516 | mon1 | changed: [mon1] 2026-03-26 18:19:27.098585 | mon1 | 2026-03-26 18:19:27.098599 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-26 18:19:27.098611 | mon1 | Thursday 26 March 2026 18:19:27 +0000 (0:00:26.283) 0:05:50.251 ******** 2026-03-26 18:19:35.574724 | mon1 | ok: [mon1] 2026-03-26 18:19:35.574789 | mon1 | 2026-03-26 18:19:35.574803 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-26 18:19:35.574816 | mon1 | Thursday 26 March 2026 18:19:35 +0000 (0:00:08.476) 0:05:58.727 ******** 2026-03-26 18:19:58.484563 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-26 18:19:58.484603 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-26 18:19:58.484610 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-26 18:19:58.484615 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-26 18:19:58.484620 | mon1 | 2026-03-26 18:19:58.484626 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-26 18:19:58.484631 | mon1 | 2026-03-26 18:19:58.484637 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:19:58.484642 | mon1 | Thursday 26 March 2026 18:19:58 +0000 (0:00:22.908) 0:06:21.635 ******** 2026-03-26 18:19:59.719378 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-26 18:19:59.719783 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:19:59.720119 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:19:59.720572 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:19:59.720907 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:19:59.731779 | mon1 | ok: [osd1] 2026-03-26 18:19:59.731978 | mon1 | 2026-03-26 18:19:59.732182 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:19:59.732403 | mon1 | Thursday 26 March 2026 18:19:59 +0000 (0:00:01.250) 0:06:22.886 ******** 2026-03-26 18:19:59.996193 | mon1 | ok: [osd1] 2026-03-26 18:19:59.997932 | mon1 | 2026-03-26 18:19:59.998235 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:19:59.999019 | mon1 | Thursday 26 March 2026 18:19:59 +0000 (0:00:00.263) 0:06:23.149 ******** 2026-03-26 18:20:00.032095 | mon1 | skipping: [osd1] 2026-03-26 18:20:00.032381 | mon1 | 2026-03-26 18:20:00.032718 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-26 18:20:00.033039 | mon1 | Thursday 26 March 2026 18:20:00 +0000 (0:00:00.036) 0:06:23.186 ******** 2026-03-26 18:20:00.282858 | mon1 | changed: [osd1] 2026-03-26 18:20:00.283071 | mon1 | 2026-03-26 18:20:00.283440 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:20:00.283694 | mon1 | Thursday 26 March 2026 18:20:00 +0000 (0:00:00.250) 0:06:23.437 ******** 2026-03-26 18:20:00.347174 | mon1 | ok: [osd1] => { 2026-03-26 18:20:00.347502 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-26 18:20:00.347773 | mon1 | } 2026-03-26 18:20:00.348040 | mon1 | 2026-03-26 18:20:00.348341 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:20:00.348610 | mon1 | Thursday 26 March 2026 18:20:00 +0000 (0:00:00.064) 0:06:23.501 ******** 2026-03-26 18:20:01.119155 | mon1 | changed: [osd1] 2026-03-26 18:20:01.119513 | mon1 | 2026-03-26 18:20:01.119877 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:20:01.120234 | mon1 | Thursday 26 March 2026 18:20:01 +0000 (0:00:00.771) 0:06:24.273 ******** 2026-03-26 18:20:01.167164 | mon1 | skipping: [osd1] 2026-03-26 18:20:01.167505 | mon1 | 2026-03-26 18:20:01.167755 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:20:01.168002 | mon1 | Thursday 26 March 2026 18:20:01 +0000 (0:00:00.048) 0:06:24.321 ******** 2026-03-26 18:20:01.220838 | mon1 | skipping: [osd1] 2026-03-26 18:20:01.221037 | mon1 | 2026-03-26 18:20:01.221327 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:20:01.221729 | mon1 | Thursday 26 March 2026 18:20:01 +0000 (0:00:00.053) 0:06:24.375 ******** 2026-03-26 18:20:01.474254 | mon1 | ok: [osd1] 2026-03-26 18:20:01.624677 | mon1 | 2026-03-26 18:20:01.624720 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:20:01.624731 | mon1 | Thursday 26 March 2026 18:20:01 +0000 (0:00:00.253) 0:06:24.628 ******** 2026-03-26 18:20:02.421946 | mon1 | ok: [osd1] 2026-03-26 18:20:02.422143 | mon1 | 2026-03-26 18:20:02.422432 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:20:02.422681 | mon1 | Thursday 26 March 2026 18:20:02 +0000 (0:00:00.947) 0:06:25.576 ******** 2026-03-26 18:20:02.503436 | mon1 | ok: [osd1] => { 2026-03-26 18:20:02.503639 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-26 18:20:02.503875 | mon1 | } 2026-03-26 18:20:02.504097 | mon1 | 2026-03-26 18:20:02.504424 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:20:02.504659 | mon1 | Thursday 26 March 2026 18:20:02 +0000 (0:00:00.081) 0:06:25.657 ******** 2026-03-26 18:20:03.413031 | mon1 | changed: [osd1] 2026-03-26 18:20:03.413245 | mon1 | 2026-03-26 18:20:03.413556 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:20:03.413868 | mon1 | Thursday 26 March 2026 18:20:03 +0000 (0:00:00.909) 0:06:26.566 ******** 2026-03-26 18:20:06.254112 | mon1 | changed: [osd1] 2026-03-26 18:20:06.254342 | mon1 | 2026-03-26 18:20:06.255079 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-26 18:20:06.255116 | mon1 | Thursday 26 March 2026 18:20:06 +0000 (0:00:02.842) 0:06:29.408 ******** 2026-03-26 18:20:06.285965 | mon1 | skipping: [osd1] 2026-03-26 18:20:06.286193 | mon1 | 2026-03-26 18:20:06.286466 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-26 18:20:06.286700 | mon1 | Thursday 26 March 2026 18:20:06 +0000 (0:00:00.031) 0:06:29.440 ******** 2026-03-26 18:20:06.311882 | mon1 | skipping: [osd1] 2026-03-26 18:20:06.312078 | mon1 | 2026-03-26 18:20:06.312378 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-26 18:20:06.312631 | mon1 | Thursday 26 March 2026 18:20:06 +0000 (0:00:00.025) 0:06:29.466 ******** 2026-03-26 18:20:06.343147 | mon1 | skipping: [osd1] 2026-03-26 18:20:06.343275 | mon1 | 2026-03-26 18:20:06.343418 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-26 18:20:06.343556 | mon1 | Thursday 26 March 2026 18:20:06 +0000 (0:00:00.031) 0:06:29.497 ******** 2026-03-26 18:20:21.797052 | mon1 | changed: [osd1] 2026-03-26 18:20:21.797353 | mon1 | 2026-03-26 18:20:21.797630 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-26 18:20:21.797871 | mon1 | Thursday 26 March 2026 18:20:21 +0000 (0:00:15.453) 0:06:44.951 ******** 2026-03-26 18:20:22.386589 | mon1 | changed: [osd1] 2026-03-26 18:20:22.386776 | mon1 | 2026-03-26 18:20:22.387046 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-26 18:20:22.387339 | mon1 | Thursday 26 March 2026 18:20:22 +0000 (0:00:00.588) 0:06:45.540 ******** 2026-03-26 18:20:23.503410 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-26 18:20:23.503665 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-26 18:20:23.503921 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-26 18:20:23.504191 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-26 18:20:23.504494 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-26 18:20:23.504718 | mon1 | 2026-03-26 18:20:23.504992 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-26 18:20:23.505355 | mon1 | Thursday 26 March 2026 18:20:23 +0000 (0:00:01.117) 0:06:46.657 ******** 2026-03-26 18:20:24.177391 | mon1 | changed: [osd1] 2026-03-26 18:20:24.177445 | mon1 | 2026-03-26 18:20:24.177456 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-26 18:20:24.177471 | mon1 | Thursday 26 March 2026 18:20:24 +0000 (0:00:00.665) 0:06:47.322 ******** 2026-03-26 18:20:24.178425 | mon1 | 2026-03-26 18:20:24.178482 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-26 18:20:24.178493 | mon1 | Thursday 26 March 2026 18:20:24 +0000 (0:00:00.008) 0:06:47.330 ******** 2026-03-26 18:20:25.095081 | mon1 | ok: [osd1] 2026-03-26 18:20:25.095121 | mon1 | 2026-03-26 18:20:25.095165 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-26 18:20:25.095170 | mon1 | Thursday 26 March 2026 18:20:25 +0000 (0:00:00.917) 0:06:48.248 ******** 2026-03-26 18:20:25.782371 | mon1 | changed: [osd1] 2026-03-26 18:20:25.782427 | mon1 | 2026-03-26 18:20:25.782497 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-26 18:20:25.782779 | mon1 | Thursday 26 March 2026 18:20:25 +0000 (0:00:00.686) 0:06:48.935 ******** 2026-03-26 18:20:26.496047 | mon1 | changed: [osd1] 2026-03-26 18:20:26.496101 | mon1 | 2026-03-26 18:20:26.496113 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:20:26.496123 | mon1 | Thursday 26 March 2026 18:20:26 +0000 (0:00:00.713) 0:06:49.648 ******** 2026-03-26 18:20:26.768920 | mon1 | ok: [osd1] 2026-03-26 18:20:26.768982 | mon1 | 2026-03-26 18:20:26.768995 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:20:26.769007 | mon1 | Thursday 26 March 2026 18:20:26 +0000 (0:00:00.273) 0:06:49.921 ******** 2026-03-26 18:20:26.830105 | mon1 | ok: [osd1] => { 2026-03-26 18:20:26.830432 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-26 18:20:26.830842 | mon1 | } 2026-03-26 18:20:26.831435 | mon1 | 2026-03-26 18:20:26.831511 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:20:26.831842 | mon1 | Thursday 26 March 2026 18:20:26 +0000 (0:00:00.061) 0:06:49.983 ******** 2026-03-26 18:20:28.150424 | mon1 | changed: [osd1] 2026-03-26 18:20:28.150506 | mon1 | 2026-03-26 18:20:28.150521 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:20:28.150671 | mon1 | Thursday 26 March 2026 18:20:28 +0000 (0:00:01.321) 0:06:51.304 ******** 2026-03-26 18:20:32.982061 | mon1 | changed: [osd1] 2026-03-26 18:20:32.982325 | mon1 | 2026-03-26 18:20:32.982352 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-26 18:20:32.982363 | mon1 | Thursday 26 March 2026 18:20:32 +0000 (0:00:04.830) 0:06:56.134 ******** 2026-03-26 18:20:33.970811 | mon1 | ok: [osd1] 2026-03-26 18:20:33.970872 | mon1 | 2026-03-26 18:20:33.970883 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-26 18:20:33.970892 | mon1 | Thursday 26 March 2026 18:20:33 +0000 (0:00:00.988) 0:06:57.123 ******** 2026-03-26 18:20:34.563824 | mon1 | changed: [osd1] 2026-03-26 18:20:34.563876 | mon1 | 2026-03-26 18:20:34.563887 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-26 18:20:34.563896 | mon1 | Thursday 26 March 2026 18:20:34 +0000 (0:00:00.593) 0:06:57.716 ******** 2026-03-26 18:20:35.154563 | mon1 | changed: [osd1] 2026-03-26 18:20:35.154599 | mon1 | 2026-03-26 18:20:35.154606 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-26 18:20:35.154874 | mon1 | Thursday 26 March 2026 18:20:35 +0000 (0:00:00.590) 0:06:58.307 ******** 2026-03-26 18:20:35.846252 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-26 18:20:35.846299 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-26 18:20:35.846310 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-26 18:20:35.846319 | mon1 | 2026-03-26 18:20:35.846329 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-26 18:20:35.846337 | mon1 | Thursday 26 March 2026 18:20:35 +0000 (0:00:00.691) 0:06:58.999 ******** 2026-03-26 18:20:36.419397 | mon1 | changed: [osd1] 2026-03-26 18:20:36.419471 | mon1 | 2026-03-26 18:20:36.420029 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-26 18:20:36.420072 | mon1 | Thursday 26 March 2026 18:20:36 +0000 (0:00:00.574) 0:06:59.573 ******** 2026-03-26 18:20:36.998637 | mon1 | changed: [osd1] 2026-03-26 18:20:36.998686 | mon1 | 2026-03-26 18:20:36.998699 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-26 18:20:36.998711 | mon1 | Thursday 26 March 2026 18:20:36 +0000 (0:00:00.571) 0:07:00.144 ******** 2026-03-26 18:20:36.998722 | mon1 | 2026-03-26 18:20:36.998731 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-26 18:20:36.998739 | mon1 | Thursday 26 March 2026 18:20:36 +0000 (0:00:00.006) 0:07:00.151 ******** 2026-03-26 18:20:37.899358 | mon1 | ok: [osd1] 2026-03-26 18:20:37.899417 | mon1 | 2026-03-26 18:20:37.899966 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-26 18:20:37.900007 | mon1 | Thursday 26 March 2026 18:20:37 +0000 (0:00:00.901) 0:07:01.052 ******** 2026-03-26 18:20:42.652809 | mon1 | changed: [osd1] 2026-03-26 18:20:42.652950 | mon1 | 2026-03-26 18:20:42.652966 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-26 18:20:42.653135 | mon1 | Thursday 26 March 2026 18:20:42 +0000 (0:00:04.753) 0:07:05.806 ******** 2026-03-26 18:20:43.358509 | mon1 | changed: [osd1] 2026-03-26 18:20:43.358580 | mon1 | 2026-03-26 18:20:43.358587 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-26 18:20:43.358593 | mon1 | Thursday 26 March 2026 18:20:43 +0000 (0:00:00.704) 0:07:06.511 ******** 2026-03-26 18:20:43.411971 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-26 18:20:43.412051 | mon1 | 2026-03-26 18:20:43.412063 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-26 18:20:43.412073 | mon1 | Thursday 26 March 2026 18:20:43 +0000 (0:00:00.053) 0:07:06.564 ******** 2026-03-26 18:20:44.440291 | mon1 | ok: [osd1] 2026-03-26 18:20:44.440341 | mon1 | 2026-03-26 18:20:44.440348 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-26 18:20:44.440358 | mon1 | Thursday 26 March 2026 18:20:44 +0000 (0:00:01.029) 0:07:07.594 ******** 2026-03-26 18:20:45.269321 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-26 18:20:45.269406 | mon1 | ok: [osd1] => (item=ssh) 2026-03-26 18:20:45.269459 | mon1 | 2026-03-26 18:20:45.270009 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-26 18:20:45.270048 | mon1 | Thursday 26 March 2026 18:20:45 +0000 (0:00:00.828) 0:07:08.422 ******** 2026-03-26 18:20:45.679712 | mon1 | changed: [osd1] 2026-03-26 18:20:45.679767 | mon1 | 2026-03-26 18:20:45.679778 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-26 18:20:45.679787 | mon1 | Thursday 26 March 2026 18:20:45 +0000 (0:00:00.409) 0:07:08.832 ******** 2026-03-26 18:20:45.921740 | mon1 | ok: [osd1] 2026-03-26 18:20:45.921785 | mon1 | 2026-03-26 18:20:45.921796 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-26 18:20:45.921806 | mon1 | Thursday 26 March 2026 18:20:45 +0000 (0:00:00.242) 0:07:09.075 ******** 2026-03-26 18:20:46.513353 | mon1 | changed: [osd1] 2026-03-26 18:20:46.513423 | mon1 | 2026-03-26 18:20:46.513437 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-26 18:20:46.513468 | mon1 | Thursday 26 March 2026 18:20:46 +0000 (0:00:00.590) 0:07:09.665 ******** 2026-03-26 18:20:46.791163 | mon1 | changed: [osd1] 2026-03-26 18:20:46.791202 | mon1 | 2026-03-26 18:20:46.791227 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-26 18:20:46.791236 | mon1 | Thursday 26 March 2026 18:20:46 +0000 (0:00:00.279) 0:07:09.945 ******** 2026-03-26 18:20:47.068326 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-26 18:20:47.068387 | mon1 | 2026-03-26 18:20:47.068399 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-26 18:20:47.068408 | mon1 | Thursday 26 March 2026 18:20:47 +0000 (0:00:00.276) 0:07:10.221 ******** 2026-03-26 18:20:47.115126 | mon1 | ok: [osd1] 2026-03-26 18:20:47.115185 | mon1 | 2026-03-26 18:20:47.115199 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:20:47.115255 | mon1 | Thursday 26 March 2026 18:20:47 +0000 (0:00:00.046) 0:07:10.268 ******** 2026-03-26 18:20:47.181763 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-26 18:20:47.181815 | mon1 | 2026-03-26 18:20:47.181826 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:20:47.181836 | mon1 | Thursday 26 March 2026 18:20:47 +0000 (0:00:00.066) 0:07:10.335 ******** 2026-03-26 18:20:54.730774 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:20:54.730832 | mon1 | 2026-03-26 18:20:54.730846 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:20:54.730858 | mon1 | Thursday 26 March 2026 18:20:54 +0000 (0:00:07.548) 0:07:17.883 ******** 2026-03-26 18:20:54.784494 | mon1 | ok: [osd1] => (item=osd1) 2026-03-26 18:20:54.784545 | mon1 | 2026-03-26 18:20:54.784553 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:20:54.784562 | mon1 | Thursday 26 March 2026 18:20:54 +0000 (0:00:00.054) 0:07:17.938 ******** 2026-03-26 18:20:55.126648 | mon1 | changed: [osd1] 2026-03-26 18:20:55.126707 | mon1 | 2026-03-26 18:20:55.126951 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:20:55.126988 | mon1 | Thursday 26 March 2026 18:20:55 +0000 (0:00:00.342) 0:07:18.280 ******** 2026-03-26 18:21:08.302659 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:21:08.302754 | mon1 | 2026-03-26 18:21:08.302814 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-26 18:21:08.302946 | mon1 | Thursday 26 March 2026 18:21:08 +0000 (0:00:13.174) 0:07:31.454 ******** 2026-03-26 18:21:09.953061 | mon1 | ok: [osd1] 2026-03-26 18:21:09.953137 | mon1 | 2026-03-26 18:21:09.953398 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-26 18:21:09.953438 | mon1 | Thursday 26 March 2026 18:21:09 +0000 (0:00:01.652) 0:07:33.107 ******** 2026-03-26 18:22:40.513431 | mon1 | ok: [osd1] 2026-03-26 18:22:40.513514 | mon1 | 2026-03-26 18:22:40.513896 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-26 18:22:40.513973 | mon1 | Thursday 26 March 2026 18:22:40 +0000 (0:01:30.558) 0:09:03.666 ******** 2026-03-26 18:25:04.960423 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-26 18:25:04.960506 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-26 18:25:04.960525 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-26 18:25:04.960547 | mon1 | 2026-03-26 18:25:04.960560 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-26 18:25:04.960706 | mon1 | Thursday 26 March 2026 18:25:04 +0000 (0:02:24.447) 0:11:28.113 ******** 2026-03-26 18:25:11.925325 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:25:11.925391 | mon1 | 2026-03-26 18:25:11.925447 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-26 18:25:11.925760 | mon1 | Thursday 26 March 2026 18:25:11 +0000 (0:00:06.964) 0:11:35.078 ******** 2026-03-26 18:25:20.299726 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:25:20.299845 | mon1 | 2026-03-26 18:25:20.300382 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-26 18:25:20.300485 | mon1 | Thursday 26 March 2026 18:25:20 +0000 (0:00:08.374) 0:11:43.453 ******** 2026-03-26 18:25:20.387998 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-26 18:25:20.388058 | mon1 | 2026-03-26 18:25:20.388072 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-26 18:25:20.388085 | mon1 | Thursday 26 March 2026 18:25:20 +0000 (0:00:00.088) 0:11:43.541 ******** 2026-03-26 18:25:20.435591 | mon1 | ok: [osd1] 2026-03-26 18:25:20.435626 | mon1 | 2026-03-26 18:25:20.435639 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-26 18:25:20.435652 | mon1 | Thursday 26 March 2026 18:25:20 +0000 (0:00:00.047) 0:11:43.588 ******** 2026-03-26 18:25:30.253349 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:25:30.253440 | mon1 | 2026-03-26 18:25:30.253896 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-26 18:25:30.253928 | mon1 | Thursday 26 March 2026 18:25:30 +0000 (0:00:09.818) 0:11:53.407 ******** 2026-03-26 18:25:30.302376 | mon1 | ok: [osd1] 2026-03-26 18:25:30.302420 | mon1 | 2026-03-26 18:25:30.302840 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-26 18:25:30.302899 | mon1 | Thursday 26 March 2026 18:25:30 +0000 (0:00:00.048) 0:11:53.455 ******** 2026-03-26 18:25:30.340489 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:25:30.340527 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:25:30.340545 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:25:30.340769 | mon1 | skipping: [osd1] 2026-03-26 18:25:30.341000 | mon1 | 2026-03-26 18:25:30.341304 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-26 18:25:30.341535 | mon1 | Thursday 26 March 2026 18:25:30 +0000 (0:00:00.038) 0:11:53.494 ******** 2026-03-26 18:25:30.370155 | mon1 | skipping: [osd1] 2026-03-26 18:25:30.370407 | mon1 | 2026-03-26 18:25:30.370679 | mon1 | PLAY RECAP ********************************************************************* 2026-03-26 18:25:30.370934 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-26 18:25:30.371188 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-26 18:25:30.371448 | mon1 | 2026-03-26 18:25:30.371668 | mon1 | 2026-03-26 18:25:30.371909 | mon1 | TASKS RECAP ******************************************************************** 2026-03-26 18:25:30.372175 | mon1 | Thursday 26 March 2026 18:25:30 +0000 (0:00:00.030) 0:11:53.524 ******** 2026-03-26 18:25:30.372468 | mon1 | =============================================================================== 2026-03-26 18:25:30.372709 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 144.45s 2026-03-26 18:25:30.372962 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 114.71s 2026-03-26 18:25:30.373202 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 90.56s 2026-03-26 18:25:30.373474 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 77.78s 2026-03-26 18:25:30.373722 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 32.37s 2026-03-26 18:25:30.373978 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 26.28s 2026-03-26 18:25:30.374250 | mon1 | vexxhost.ceph.mgr : Configure manager modules -------------------------- 22.91s 2026-03-26 18:25:30.374492 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 20.81s 2026-03-26 18:25:30.374735 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 15.45s 2026-03-26 18:25:30.374981 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 15.36s 2026-03-26 18:25:30.375257 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.43s 2026-03-26 18:25:30.375526 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.17s 2026-03-26 18:25:30.375770 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 9.82s 2026-03-26 18:25:30.376021 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.06s 2026-03-26 18:25:30.376400 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 8.48s 2026-03-26 18:25:30.376654 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 8.37s 2026-03-26 18:25:30.376899 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.55s 2026-03-26 18:25:30.377062 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.44s 2026-03-26 18:25:30.377169 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.96s 2026-03-26 18:25:30.377290 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.83s 2026-03-26 18:25:30.454540 | mon1 | INFO [default > converge] Executed: Successful 2026-03-26 18:25:30.464649 | mon1 | INFO [default > idempotence] Executing 2026-03-26 18:25:31.430883 | mon1 | 2026-03-26 18:25:31.431117 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-26 18:25:31.431387 | mon1 | 2026-03-26 18:25:31.431638 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:25:31.431889 | mon1 | Thursday 26 March 2026 18:25:31 +0000 (0:00:00.054) 0:00:00.054 ******** 2026-03-26 18:25:32.723763 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-26 18:25:32.724013 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:25:32.724289 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:25:32.724553 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:25:32.724779 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:25:32.737503 | mon1 | ok: [mon1] 2026-03-26 18:25:32.737732 | mon1 | 2026-03-26 18:25:32.738003 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:25:32.738274 | mon1 | Thursday 26 March 2026 18:25:32 +0000 (0:00:01.306) 0:00:01.361 ******** 2026-03-26 18:25:33.090664 | mon1 | ok: [mon1] 2026-03-26 18:25:33.090839 | mon1 | 2026-03-26 18:25:33.091091 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:25:33.091370 | mon1 | Thursday 26 March 2026 18:25:33 +0000 (0:00:00.352) 0:00:01.714 ******** 2026-03-26 18:25:33.135632 | mon1 | skipping: [mon1] 2026-03-26 18:25:33.135843 | mon1 | 2026-03-26 18:25:33.136100 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-26 18:25:33.136412 | mon1 | Thursday 26 March 2026 18:25:33 +0000 (0:00:00.044) 0:00:01.759 ******** 2026-03-26 18:25:33.506362 | mon1 | ok: [mon1] 2026-03-26 18:25:33.506542 | mon1 | 2026-03-26 18:25:33.506785 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:25:33.507026 | mon1 | Thursday 26 March 2026 18:25:33 +0000 (0:00:00.370) 0:00:02.129 ******** 2026-03-26 18:25:33.583834 | mon1 | ok: [mon1] => { 2026-03-26 18:25:33.584125 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-26 18:25:33.584403 | mon1 | } 2026-03-26 18:25:33.584620 | mon1 | 2026-03-26 18:25:33.584869 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:25:33.585115 | mon1 | Thursday 26 March 2026 18:25:33 +0000 (0:00:00.077) 0:00:02.207 ******** 2026-03-26 18:25:34.075239 | mon1 | ok: [mon1] 2026-03-26 18:25:34.076286 | mon1 | 2026-03-26 18:25:34.076342 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:25:34.076353 | mon1 | Thursday 26 March 2026 18:25:34 +0000 (0:00:00.491) 0:00:02.698 ******** 2026-03-26 18:25:34.130060 | mon1 | skipping: [mon1] 2026-03-26 18:25:34.130119 | mon1 | 2026-03-26 18:25:34.130142 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:25:34.130155 | mon1 | Thursday 26 March 2026 18:25:34 +0000 (0:00:00.053) 0:00:02.752 ******** 2026-03-26 18:25:34.188372 | mon1 | skipping: [mon1] 2026-03-26 18:25:34.188441 | mon1 | 2026-03-26 18:25:34.188725 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:25:34.188961 | mon1 | Thursday 26 March 2026 18:25:34 +0000 (0:00:00.058) 0:00:02.811 ******** 2026-03-26 18:25:34.433919 | mon1 | ok: [mon1] 2026-03-26 18:25:34.434187 | mon1 | 2026-03-26 18:25:34.434567 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:25:34.434865 | mon1 | Thursday 26 March 2026 18:25:34 +0000 (0:00:00.246) 0:00:03.057 ******** 2026-03-26 18:25:35.571254 | mon1 | ok: [mon1] 2026-03-26 18:25:35.571307 | mon1 | 2026-03-26 18:25:35.571336 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:25:35.571346 | mon1 | Thursday 26 March 2026 18:25:35 +0000 (0:00:01.136) 0:00:04.193 ******** 2026-03-26 18:25:35.767391 | mon1 | ok: [mon1] => { 2026-03-26 18:25:35.767498 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-26 18:25:35.767723 | mon1 | } 2026-03-26 18:25:35.767984 | mon1 | 2026-03-26 18:25:35.768276 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:25:35.768658 | mon1 | Thursday 26 March 2026 18:25:35 +0000 (0:00:00.196) 0:00:04.390 ******** 2026-03-26 18:25:36.311110 | mon1 | ok: [mon1] 2026-03-26 18:25:36.311342 | mon1 | 2026-03-26 18:25:36.311601 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:25:36.311857 | mon1 | Thursday 26 March 2026 18:25:36 +0000 (0:00:00.543) 0:00:04.934 ******** 2026-03-26 18:25:38.793096 | mon1 | ok: [mon1] 2026-03-26 18:25:38.793365 | mon1 | 2026-03-26 18:25:38.793738 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-26 18:25:38.794075 | mon1 | Thursday 26 March 2026 18:25:38 +0000 (0:00:02.482) 0:00:07.416 ******** 2026-03-26 18:25:38.829559 | mon1 | skipping: [mon1] 2026-03-26 18:25:38.829759 | mon1 | 2026-03-26 18:25:38.829999 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-26 18:25:38.830298 | mon1 | Thursday 26 March 2026 18:25:38 +0000 (0:00:00.036) 0:00:07.452 ******** 2026-03-26 18:25:38.864365 | mon1 | skipping: [mon1] 2026-03-26 18:25:38.864465 | mon1 | 2026-03-26 18:25:38.864639 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-26 18:25:38.864809 | mon1 | Thursday 26 March 2026 18:25:38 +0000 (0:00:00.034) 0:00:07.487 ******** 2026-03-26 18:25:38.899079 | mon1 | skipping: [mon1] 2026-03-26 18:25:38.899368 | mon1 | 2026-03-26 18:25:38.899628 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-26 18:25:38.899926 | mon1 | Thursday 26 March 2026 18:25:38 +0000 (0:00:00.034) 0:00:07.522 ******** 2026-03-26 18:25:39.929323 | mon1 | ok: [mon1] 2026-03-26 18:25:39.929384 | mon1 | 2026-03-26 18:25:39.929421 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-26 18:25:39.929587 | mon1 | Thursday 26 March 2026 18:25:39 +0000 (0:00:01.029) 0:00:08.552 ******** 2026-03-26 18:25:40.470436 | mon1 | ok: [mon1] 2026-03-26 18:25:40.470632 | mon1 | 2026-03-26 18:25:40.470885 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-26 18:25:40.471153 | mon1 | Thursday 26 March 2026 18:25:40 +0000 (0:00:00.541) 0:00:09.093 ******** 2026-03-26 18:25:41.631335 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-26 18:25:41.632352 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-26 18:25:41.632410 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-26 18:25:41.632420 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-26 18:25:41.632429 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-26 18:25:41.632439 | mon1 | 2026-03-26 18:25:41.632448 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-26 18:25:41.632577 | mon1 | Thursday 26 March 2026 18:25:41 +0000 (0:00:01.161) 0:00:10.255 ******** 2026-03-26 18:25:42.260619 | mon1 | ok: [mon1] 2026-03-26 18:25:42.260679 | mon1 | 2026-03-26 18:25:42.260798 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-26 18:25:42.261239 | mon1 | Thursday 26 March 2026 18:25:42 +0000 (0:00:00.621) 0:00:10.876 ******** 2026-03-26 18:25:42.261256 | mon1 | 2026-03-26 18:25:42.261261 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-26 18:25:42.261265 | mon1 | Thursday 26 March 2026 18:25:42 +0000 (0:00:00.007) 0:00:10.884 ******** 2026-03-26 18:25:42.961341 | mon1 | ok: [mon1] 2026-03-26 18:25:42.961413 | mon1 | 2026-03-26 18:25:42.961423 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:25:42.961433 | mon1 | Thursday 26 March 2026 18:25:42 +0000 (0:00:00.700) 0:00:11.584 ******** 2026-03-26 18:25:43.212337 | mon1 | ok: [mon1] 2026-03-26 18:25:43.212388 | mon1 | 2026-03-26 18:25:43.212749 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:25:43.212791 | mon1 | Thursday 26 March 2026 18:25:43 +0000 (0:00:00.250) 0:00:11.835 ******** 2026-03-26 18:25:43.284300 | mon1 | ok: [mon1] => { 2026-03-26 18:25:43.284341 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-26 18:25:43.284351 | mon1 | } 2026-03-26 18:25:43.285020 | mon1 | 2026-03-26 18:25:43.285045 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:25:43.285055 | mon1 | Thursday 26 March 2026 18:25:43 +0000 (0:00:00.071) 0:00:11.906 ******** 2026-03-26 18:25:43.711732 | mon1 | ok: [mon1] 2026-03-26 18:25:43.714349 | mon1 | 2026-03-26 18:25:43.714412 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:25:43.714424 | mon1 | Thursday 26 March 2026 18:25:43 +0000 (0:00:00.427) 0:00:12.334 ******** 2026-03-26 18:25:48.012025 | mon1 | ok: [mon1] 2026-03-26 18:25:48.012092 | mon1 | 2026-03-26 18:25:48.012104 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-26 18:25:48.012114 | mon1 | Thursday 26 March 2026 18:25:48 +0000 (0:00:04.299) 0:00:16.633 ******** 2026-03-26 18:25:49.009642 | mon1 | ok: [mon1] 2026-03-26 18:25:49.009758 | mon1 | 2026-03-26 18:25:49.010049 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-26 18:25:49.010061 | mon1 | Thursday 26 March 2026 18:25:49 +0000 (0:00:00.998) 0:00:17.632 ******** 2026-03-26 18:25:49.362000 | mon1 | ok: [mon1] 2026-03-26 18:25:49.362054 | mon1 | 2026-03-26 18:25:49.362065 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-26 18:25:49.362074 | mon1 | Thursday 26 March 2026 18:25:49 +0000 (0:00:00.352) 0:00:17.984 ******** 2026-03-26 18:25:49.908738 | mon1 | ok: [mon1] 2026-03-26 18:25:49.909059 | mon1 | 2026-03-26 18:25:49.909814 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-26 18:25:49.909862 | mon1 | Thursday 26 March 2026 18:25:49 +0000 (0:00:00.547) 0:00:18.532 ******** 2026-03-26 18:25:50.607143 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-26 18:25:50.607188 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-26 18:25:50.607195 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-26 18:25:50.607200 | mon1 | 2026-03-26 18:25:50.607206 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-26 18:25:50.607232 | mon1 | Thursday 26 March 2026 18:25:50 +0000 (0:00:00.697) 0:00:19.230 ******** 2026-03-26 18:25:51.146336 | mon1 | ok: [mon1] 2026-03-26 18:25:51.146400 | mon1 | 2026-03-26 18:25:51.146412 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-26 18:25:51.146429 | mon1 | Thursday 26 March 2026 18:25:51 +0000 (0:00:00.539) 0:00:19.769 ******** 2026-03-26 18:25:51.691300 | mon1 | ok: [mon1] 2026-03-26 18:25:51.691357 | mon1 | 2026-03-26 18:25:51.691368 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-26 18:25:51.692280 | mon1 | Thursday 26 March 2026 18:25:51 +0000 (0:00:00.535) 0:00:20.304 ******** 2026-03-26 18:25:51.692323 | mon1 | 2026-03-26 18:25:51.692330 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-26 18:25:51.692518 | mon1 | Thursday 26 March 2026 18:25:51 +0000 (0:00:00.009) 0:00:20.314 ******** 2026-03-26 18:25:52.146765 | mon1 | ok: [mon1] 2026-03-26 18:25:52.146821 | mon1 | 2026-03-26 18:25:52.146832 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-26 18:25:52.146842 | mon1 | Thursday 26 March 2026 18:25:52 +0000 (0:00:00.454) 0:00:20.768 ******** 2026-03-26 18:25:52.200338 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-26 18:25:52.200423 | mon1 | 2026-03-26 18:25:52.200435 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-26 18:25:52.200452 | mon1 | Thursday 26 March 2026 18:25:52 +0000 (0:00:00.054) 0:00:20.823 ******** 2026-03-26 18:25:53.247628 | mon1 | ok: [mon1] 2026-03-26 18:25:53.247681 | mon1 | 2026-03-26 18:25:53.247692 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-26 18:25:53.247701 | mon1 | Thursday 26 March 2026 18:25:53 +0000 (0:00:01.046) 0:00:21.869 ******** 2026-03-26 18:25:54.056984 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-26 18:25:54.057046 | mon1 | ok: [mon1] => (item=ssh) 2026-03-26 18:25:54.057060 | mon1 | 2026-03-26 18:25:54.057072 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-26 18:25:54.057084 | mon1 | Thursday 26 March 2026 18:25:54 +0000 (0:00:00.809) 0:00:22.679 ******** 2026-03-26 18:25:54.472763 | mon1 | ok: [mon1] 2026-03-26 18:25:54.472822 | mon1 | 2026-03-26 18:25:54.472833 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-26 18:25:54.472843 | mon1 | Thursday 26 March 2026 18:25:54 +0000 (0:00:00.416) 0:00:23.095 ******** 2026-03-26 18:25:54.721363 | mon1 | ok: [mon1] 2026-03-26 18:25:54.721428 | mon1 | 2026-03-26 18:25:54.721445 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-26 18:25:54.721659 | mon1 | Thursday 26 March 2026 18:25:54 +0000 (0:00:00.248) 0:00:23.344 ******** 2026-03-26 18:25:55.217743 | mon1 | ok: [mon1] 2026-03-26 18:25:55.217836 | mon1 | 2026-03-26 18:25:55.218193 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-26 18:25:55.218258 | mon1 | Thursday 26 March 2026 18:25:55 +0000 (0:00:00.496) 0:00:23.840 ******** 2026-03-26 18:25:55.561652 | mon1 | ok: [mon1] 2026-03-26 18:25:55.561702 | mon1 | 2026-03-26 18:25:55.561928 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-26 18:25:55.561939 | mon1 | Thursday 26 March 2026 18:25:55 +0000 (0:00:00.344) 0:00:24.184 ******** 2026-03-26 18:25:55.646804 | mon1 | ok: [mon1] 2026-03-26 18:25:55.646843 | mon1 | 2026-03-26 18:25:55.646875 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-26 18:25:55.646884 | mon1 | Thursday 26 March 2026 18:25:55 +0000 (0:00:00.084) 0:00:24.269 ******** 2026-03-26 18:25:55.911759 | mon1 | ok: [mon1] => (item=mon1) 2026-03-26 18:25:55.911813 | mon1 | 2026-03-26 18:25:55.911824 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-26 18:25:55.911833 | mon1 | Thursday 26 March 2026 18:25:55 +0000 (0:00:00.264) 0:00:24.533 ******** 2026-03-26 18:25:55.968714 | mon1 | ok: [mon1] 2026-03-26 18:25:55.968771 | mon1 | 2026-03-26 18:25:55.968782 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-26 18:25:55.968791 | mon1 | Thursday 26 March 2026 18:25:55 +0000 (0:00:00.057) 0:00:24.591 ******** 2026-03-26 18:25:56.013718 | mon1 | skipping: [mon1] 2026-03-26 18:25:56.013768 | mon1 | 2026-03-26 18:25:56.013778 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:25:56.013787 | mon1 | Thursday 26 March 2026 18:25:56 +0000 (0:00:00.044) 0:00:24.636 ******** 2026-03-26 18:25:56.087255 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-26 18:25:56.087296 | mon1 | 2026-03-26 18:25:56.087302 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:25:56.087434 | mon1 | Thursday 26 March 2026 18:25:56 +0000 (0:00:00.074) 0:00:24.710 ******** 2026-03-26 18:26:06.152291 | mon1 | ok: [mon1] 2026-03-26 18:26:06.152341 | mon1 | 2026-03-26 18:26:06.152351 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:26:06.152360 | mon1 | Thursday 26 March 2026 18:26:06 +0000 (0:00:10.064) 0:00:34.774 ******** 2026-03-26 18:26:06.215901 | mon1 | ok: [mon1] => (item=mon1) 2026-03-26 18:26:06.215963 | mon1 | 2026-03-26 18:26:06.215977 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:26:06.215989 | mon1 | Thursday 26 March 2026 18:26:06 +0000 (0:00:00.063) 0:00:34.838 ******** 2026-03-26 18:26:06.686798 | mon1 | ok: [mon1] 2026-03-26 18:26:06.686854 | mon1 | 2026-03-26 18:26:06.686869 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:26:06.686883 | mon1 | Thursday 26 March 2026 18:26:06 +0000 (0:00:00.470) 0:00:35.308 ******** 2026-03-26 18:26:13.614386 | mon1 | ok: [mon1] 2026-03-26 18:26:13.614444 | mon1 | 2026-03-26 18:26:13.614453 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-26 18:26:13.614460 | mon1 | Thursday 26 March 2026 18:26:13 +0000 (0:00:06.928) 0:00:42.237 ******** 2026-03-26 18:26:22.656858 | mon1 | ok: [mon1] 2026-03-26 18:26:22.656926 | mon1 | 2026-03-26 18:26:22.656941 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-26 18:26:22.656954 | mon1 | Thursday 26 March 2026 18:26:22 +0000 (0:00:09.042) 0:00:51.279 ******** 2026-03-26 18:26:41.954808 | mon1 | ok: [mon1] 2026-03-26 18:26:41.954877 | mon1 | 2026-03-26 18:26:41.954893 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:26:41.954905 | mon1 | Thursday 26 March 2026 18:26:41 +0000 (0:00:19.297) 0:01:10.576 ******** 2026-03-26 18:26:42.028878 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-26 18:26:42.028943 | mon1 | 2026-03-26 18:26:42.028957 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:26:42.028970 | mon1 | Thursday 26 March 2026 18:26:42 +0000 (0:00:00.074) 0:01:10.651 ******** 2026-03-26 18:26:42.080340 | mon1 | skipping: [mon1] 2026-03-26 18:26:42.080400 | mon1 | 2026-03-26 18:26:42.080952 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:26:42.081004 | mon1 | Thursday 26 March 2026 18:26:42 +0000 (0:00:00.051) 0:01:10.702 ******** 2026-03-26 18:26:42.125400 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-26 18:26:42.125495 | mon1 | skipping: [mon1] 2026-03-26 18:26:42.125516 | mon1 | 2026-03-26 18:26:42.126041 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:26:42.126087 | mon1 | Thursday 26 March 2026 18:26:42 +0000 (0:00:00.045) 0:01:10.748 ******** 2026-03-26 18:26:42.447413 | mon1 | ok: [mon1] 2026-03-26 18:26:42.447464 | mon1 | 2026-03-26 18:26:42.447470 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:26:42.447476 | mon1 | Thursday 26 March 2026 18:26:42 +0000 (0:00:00.321) 0:01:11.069 ******** 2026-03-26 18:26:50.243244 | mon1 | ok: [mon1] 2026-03-26 18:26:50.243277 | mon1 | 2026-03-26 18:26:50.243284 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-26 18:26:50.243290 | mon1 | Thursday 26 March 2026 18:26:50 +0000 (0:00:07.793) 0:01:18.863 ******** 2026-03-26 18:26:59.429818 | mon1 | ok: [mon1] 2026-03-26 18:26:59.429907 | mon1 | 2026-03-26 18:26:59.429924 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-26 18:26:59.429941 | mon1 | Thursday 26 March 2026 18:26:59 +0000 (0:00:09.188) 0:01:28.051 ******** 2026-03-26 18:27:06.426838 | mon1 | ok: [mon1] 2026-03-26 18:27:06.426908 | mon1 | 2026-03-26 18:27:06.426927 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-26 18:27:06.426944 | mon1 | Thursday 26 March 2026 18:27:06 +0000 (0:00:06.996) 0:01:35.048 ******** 2026-03-26 18:27:18.148314 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-26 18:27:18.148423 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-26 18:27:18.149358 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-26 18:27:18.149418 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-26 18:27:18.149432 | mon1 | 2026-03-26 18:27:18.149444 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-26 18:27:18.149541 | mon1 | 2026-03-26 18:27:18.149832 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:27:18.150072 | mon1 | Thursday 26 March 2026 18:27:18 +0000 (0:00:11.722) 0:01:46.770 ******** 2026-03-26 18:27:20.387134 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-26 18:27:20.387410 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:27:20.387667 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:27:20.387915 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:27:20.388183 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:27:20.401980 | mon1 | ok: [osd1] 2026-03-26 18:27:20.402296 | mon1 | 2026-03-26 18:27:20.402673 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:27:20.403013 | mon1 | Thursday 26 March 2026 18:27:20 +0000 (0:00:02.254) 0:01:49.025 ******** 2026-03-26 18:27:20.655968 | mon1 | ok: [osd1] 2026-03-26 18:27:20.656065 | mon1 | 2026-03-26 18:27:20.656091 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:27:20.656250 | mon1 | Thursday 26 March 2026 18:27:20 +0000 (0:00:00.254) 0:01:49.279 ******** 2026-03-26 18:27:20.697261 | mon1 | skipping: [osd1] 2026-03-26 18:27:20.697482 | mon1 | 2026-03-26 18:27:20.697713 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-26 18:27:20.697957 | mon1 | Thursday 26 March 2026 18:27:20 +0000 (0:00:00.041) 0:01:49.320 ******** 2026-03-26 18:27:20.998075 | mon1 | ok: [osd1] 2026-03-26 18:27:20.998244 | mon1 | 2026-03-26 18:27:20.998623 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:27:20.998839 | mon1 | Thursday 26 March 2026 18:27:20 +0000 (0:00:00.300) 0:01:49.621 ******** 2026-03-26 18:27:21.079977 | mon1 | ok: [osd1] => { 2026-03-26 18:27:21.080366 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-26 18:27:21.080625 | mon1 | } 2026-03-26 18:27:21.080850 | mon1 | 2026-03-26 18:27:21.081113 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:27:21.081427 | mon1 | Thursday 26 March 2026 18:27:21 +0000 (0:00:00.081) 0:01:49.703 ******** 2026-03-26 18:27:21.493345 | mon1 | ok: [osd1] 2026-03-26 18:27:21.493410 | mon1 | 2026-03-26 18:27:21.493427 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:27:21.493669 | mon1 | Thursday 26 March 2026 18:27:21 +0000 (0:00:00.412) 0:01:50.115 ******** 2026-03-26 18:27:21.535830 | mon1 | skipping: [osd1] 2026-03-26 18:27:21.535886 | mon1 | 2026-03-26 18:27:21.536164 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:27:21.536192 | mon1 | Thursday 26 March 2026 18:27:21 +0000 (0:00:00.042) 0:01:50.158 ******** 2026-03-26 18:27:21.582790 | mon1 | skipping: [osd1] 2026-03-26 18:27:21.582852 | mon1 | 2026-03-26 18:27:21.583095 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:27:21.583123 | mon1 | Thursday 26 March 2026 18:27:21 +0000 (0:00:00.047) 0:01:50.206 ******** 2026-03-26 18:27:21.843724 | mon1 | ok: [osd1] 2026-03-26 18:27:21.843775 | mon1 | 2026-03-26 18:27:21.843786 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-26 18:27:21.843796 | mon1 | Thursday 26 March 2026 18:27:21 +0000 (0:00:00.259) 0:01:50.466 ******** 2026-03-26 18:27:22.873566 | mon1 | ok: [osd1] 2026-03-26 18:27:22.873639 | mon1 | 2026-03-26 18:27:22.873656 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:27:22.873671 | mon1 | Thursday 26 March 2026 18:27:22 +0000 (0:00:01.028) 0:01:51.494 ******** 2026-03-26 18:27:23.063542 | mon1 | ok: [osd1] => { 2026-03-26 18:27:23.063653 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-26 18:27:23.063666 | mon1 | } 2026-03-26 18:27:23.063676 | mon1 | 2026-03-26 18:27:23.063686 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:27:23.063707 | mon1 | Thursday 26 March 2026 18:27:23 +0000 (0:00:00.189) 0:01:51.684 ******** 2026-03-26 18:27:23.629746 | mon1 | ok: [osd1] 2026-03-26 18:27:23.629861 | mon1 | 2026-03-26 18:27:23.629883 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:27:23.630037 | mon1 | Thursday 26 March 2026 18:27:23 +0000 (0:00:00.567) 0:01:52.252 ******** 2026-03-26 18:27:25.873675 | mon1 | ok: [osd1] 2026-03-26 18:27:25.873740 | mon1 | 2026-03-26 18:27:25.874105 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-26 18:27:25.874141 | mon1 | Thursday 26 March 2026 18:27:25 +0000 (0:00:02.244) 0:01:54.497 ******** 2026-03-26 18:27:25.908650 | mon1 | skipping: [osd1] 2026-03-26 18:27:25.908692 | mon1 | 2026-03-26 18:27:25.909159 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-26 18:27:25.909279 | mon1 | Thursday 26 March 2026 18:27:25 +0000 (0:00:00.034) 0:01:54.531 ******** 2026-03-26 18:27:25.944426 | mon1 | skipping: [osd1] 2026-03-26 18:27:25.944514 | mon1 | 2026-03-26 18:27:25.945010 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-26 18:27:25.945094 | mon1 | Thursday 26 March 2026 18:27:25 +0000 (0:00:00.035) 0:01:54.566 ******** 2026-03-26 18:27:25.977923 | mon1 | skipping: [osd1] 2026-03-26 18:27:25.979284 | mon1 | 2026-03-26 18:27:25.979332 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-26 18:27:25.979340 | mon1 | Thursday 26 March 2026 18:27:25 +0000 (0:00:00.034) 0:01:54.601 ******** 2026-03-26 18:27:26.939293 | mon1 | ok: [osd1] 2026-03-26 18:27:26.939344 | mon1 | 2026-03-26 18:27:26.939358 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-26 18:27:26.939371 | mon1 | Thursday 26 March 2026 18:27:26 +0000 (0:00:00.960) 0:01:55.561 ******** 2026-03-26 18:27:27.474384 | mon1 | ok: [osd1] 2026-03-26 18:27:27.474434 | mon1 | 2026-03-26 18:27:27.474669 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-26 18:27:27.474901 | mon1 | Thursday 26 March 2026 18:27:27 +0000 (0:00:00.536) 0:01:56.097 ******** 2026-03-26 18:27:28.595415 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-26 18:27:28.595529 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-26 18:27:28.595643 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-26 18:27:28.595822 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-26 18:27:28.596054 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-26 18:27:28.596235 | mon1 | 2026-03-26 18:27:28.596400 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-26 18:27:28.596552 | mon1 | Thursday 26 March 2026 18:27:28 +0000 (0:00:01.121) 0:01:57.219 ******** 2026-03-26 18:27:29.250817 | mon1 | ok: [osd1] 2026-03-26 18:27:29.250882 | mon1 | 2026-03-26 18:27:29.250893 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-26 18:27:29.250903 | mon1 | Thursday 26 March 2026 18:27:29 +0000 (0:00:00.648) 0:01:57.867 ******** 2026-03-26 18:27:29.250912 | mon1 | 2026-03-26 18:27:29.250928 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-26 18:27:29.251101 | mon1 | Thursday 26 March 2026 18:27:29 +0000 (0:00:00.006) 0:01:57.873 ******** 2026-03-26 18:27:29.710429 | mon1 | ok: [osd1] 2026-03-26 18:27:29.710490 | mon1 | 2026-03-26 18:27:29.710503 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-26 18:27:29.710781 | mon1 | Thursday 26 March 2026 18:27:29 +0000 (0:00:00.459) 0:01:58.333 ******** 2026-03-26 18:27:29.968401 | mon1 | ok: [osd1] 2026-03-26 18:27:29.968501 | mon1 | 2026-03-26 18:27:29.968513 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-26 18:27:29.968523 | mon1 | Thursday 26 March 2026 18:27:29 +0000 (0:00:00.257) 0:01:58.591 ******** 2026-03-26 18:27:30.039691 | mon1 | ok: [osd1] => { 2026-03-26 18:27:30.039825 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-26 18:27:30.039900 | mon1 | } 2026-03-26 18:27:30.040042 | mon1 | 2026-03-26 18:27:30.040297 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-26 18:27:30.040402 | mon1 | Thursday 26 March 2026 18:27:30 +0000 (0:00:00.071) 0:01:58.663 ******** 2026-03-26 18:27:30.495743 | mon1 | ok: [osd1] 2026-03-26 18:27:30.495805 | mon1 | 2026-03-26 18:27:30.498399 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-26 18:27:30.498435 | mon1 | Thursday 26 March 2026 18:27:30 +0000 (0:00:00.455) 0:01:59.118 ******** 2026-03-26 18:27:33.800037 | mon1 | ok: [osd1] 2026-03-26 18:27:33.800416 | mon1 | 2026-03-26 18:27:33.800732 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-26 18:27:33.801059 | mon1 | Thursday 26 March 2026 18:27:33 +0000 (0:00:03.304) 0:02:02.423 ******** 2026-03-26 18:27:34.775710 | mon1 | ok: [osd1] 2026-03-26 18:27:34.775919 | mon1 | 2026-03-26 18:27:34.776272 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-26 18:27:34.776608 | mon1 | Thursday 26 March 2026 18:27:34 +0000 (0:00:00.975) 0:02:03.399 ******** 2026-03-26 18:27:35.016894 | mon1 | ok: [osd1] 2026-03-26 18:27:35.016997 | mon1 | 2026-03-26 18:27:35.017157 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-26 18:27:35.017350 | mon1 | Thursday 26 March 2026 18:27:35 +0000 (0:00:00.241) 0:02:03.640 ******** 2026-03-26 18:27:35.561431 | mon1 | ok: [osd1] 2026-03-26 18:27:35.561498 | mon1 | 2026-03-26 18:27:35.561604 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-26 18:27:35.561719 | mon1 | Thursday 26 March 2026 18:27:35 +0000 (0:00:00.544) 0:02:04.185 ******** 2026-03-26 18:27:36.246391 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-26 18:27:36.246457 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-26 18:27:36.247138 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-26 18:27:36.247186 | mon1 | 2026-03-26 18:27:36.247196 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-26 18:27:36.247204 | mon1 | Thursday 26 March 2026 18:27:36 +0000 (0:00:00.684) 0:02:04.870 ******** 2026-03-26 18:27:36.777746 | mon1 | ok: [osd1] 2026-03-26 18:27:36.777819 | mon1 | 2026-03-26 18:27:36.777831 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-26 18:27:36.777841 | mon1 | Thursday 26 March 2026 18:27:36 +0000 (0:00:00.530) 0:02:05.400 ******** 2026-03-26 18:27:37.328608 | mon1 | ok: [osd1] 2026-03-26 18:27:37.328643 | mon1 | 2026-03-26 18:27:37.328649 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-26 18:27:37.328653 | mon1 | Thursday 26 March 2026 18:27:37 +0000 (0:00:00.542) 0:02:05.943 ******** 2026-03-26 18:27:37.328657 | mon1 | 2026-03-26 18:27:37.328661 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-26 18:27:37.328791 | mon1 | Thursday 26 March 2026 18:27:37 +0000 (0:00:00.006) 0:02:05.949 ******** 2026-03-26 18:27:37.789983 | mon1 | ok: [osd1] 2026-03-26 18:27:37.790037 | mon1 | 2026-03-26 18:27:37.790048 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-26 18:27:37.790078 | mon1 | Thursday 26 March 2026 18:27:37 +0000 (0:00:00.462) 0:02:06.412 ******** 2026-03-26 18:27:37.854081 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-26 18:27:37.854189 | mon1 | 2026-03-26 18:27:37.854200 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-26 18:27:37.854210 | mon1 | Thursday 26 March 2026 18:27:37 +0000 (0:00:00.063) 0:02:06.476 ******** 2026-03-26 18:27:39.020347 | mon1 | ok: [osd1] 2026-03-26 18:27:39.020411 | mon1 | 2026-03-26 18:27:39.020829 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-26 18:27:39.020878 | mon1 | Thursday 26 March 2026 18:27:39 +0000 (0:00:01.166) 0:02:07.643 ******** 2026-03-26 18:27:39.835250 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-26 18:27:39.835311 | mon1 | ok: [osd1] => (item=ssh) 2026-03-26 18:27:39.835327 | mon1 | 2026-03-26 18:27:39.835342 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-26 18:27:39.835352 | mon1 | Thursday 26 March 2026 18:27:39 +0000 (0:00:00.813) 0:02:08.456 ******** 2026-03-26 18:27:40.245597 | mon1 | ok: [osd1] 2026-03-26 18:27:40.245658 | mon1 | 2026-03-26 18:27:40.245671 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-26 18:27:40.245682 | mon1 | Thursday 26 March 2026 18:27:40 +0000 (0:00:00.410) 0:02:08.867 ******** 2026-03-26 18:27:40.505880 | mon1 | ok: [osd1] 2026-03-26 18:27:40.505944 | mon1 | 2026-03-26 18:27:40.505962 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-26 18:27:40.505978 | mon1 | Thursday 26 March 2026 18:27:40 +0000 (0:00:00.260) 0:02:09.128 ******** 2026-03-26 18:27:40.867836 | mon1 | ok: [osd1] 2026-03-26 18:27:40.867888 | mon1 | 2026-03-26 18:27:40.867902 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-26 18:27:40.867914 | mon1 | Thursday 26 March 2026 18:27:40 +0000 (0:00:00.361) 0:02:09.489 ******** 2026-03-26 18:27:41.118364 | mon1 | ok: [osd1] 2026-03-26 18:27:41.118427 | mon1 | 2026-03-26 18:27:41.118442 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-26 18:27:41.118468 | mon1 | Thursday 26 March 2026 18:27:41 +0000 (0:00:00.252) 0:02:09.741 ******** 2026-03-26 18:27:41.380665 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-26 18:27:41.380732 | mon1 | 2026-03-26 18:27:41.380962 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-26 18:27:41.380996 | mon1 | Thursday 26 March 2026 18:27:41 +0000 (0:00:00.262) 0:02:10.003 ******** 2026-03-26 18:27:41.435332 | mon1 | ok: [osd1] 2026-03-26 18:27:41.435389 | mon1 | 2026-03-26 18:27:41.435410 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-26 18:27:41.435611 | mon1 | Thursday 26 March 2026 18:27:41 +0000 (0:00:00.053) 0:02:10.057 ******** 2026-03-26 18:27:41.495650 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-26 18:27:41.495740 | mon1 | 2026-03-26 18:27:41.495997 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-26 18:27:41.496044 | mon1 | Thursday 26 March 2026 18:27:41 +0000 (0:00:00.061) 0:02:10.119 ******** 2026-03-26 18:27:48.416611 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:27:48.416700 | mon1 | 2026-03-26 18:27:48.416960 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-26 18:27:48.417100 | mon1 | Thursday 26 March 2026 18:27:48 +0000 (0:00:06.920) 0:02:17.039 ******** 2026-03-26 18:27:48.471412 | mon1 | ok: [osd1] => (item=osd1) 2026-03-26 18:27:48.471467 | mon1 | 2026-03-26 18:27:48.471971 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-26 18:27:48.472029 | mon1 | Thursday 26 March 2026 18:27:48 +0000 (0:00:00.054) 0:02:17.094 ******** 2026-03-26 18:27:48.786351 | mon1 | ok: [osd1] 2026-03-26 18:27:48.786411 | mon1 | 2026-03-26 18:27:48.786792 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-26 18:27:48.786826 | mon1 | Thursday 26 March 2026 18:27:48 +0000 (0:00:00.314) 0:02:17.409 ******** 2026-03-26 18:27:55.889879 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:27:55.889941 | mon1 | 2026-03-26 18:27:55.889955 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-26 18:27:55.889967 | mon1 | Thursday 26 March 2026 18:27:55 +0000 (0:00:07.102) 0:02:24.511 ******** 2026-03-26 18:28:01.468198 | mon1 | ok: [osd1] 2026-03-26 18:28:01.468270 | mon1 | 2026-03-26 18:28:01.468282 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-26 18:28:01.468290 | mon1 | Thursday 26 March 2026 18:28:01 +0000 (0:00:05.579) 0:02:30.091 ******** 2026-03-26 18:28:24.384263 | mon1 | ok: [osd1] 2026-03-26 18:28:24.384318 | mon1 | 2026-03-26 18:28:24.384325 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-26 18:28:24.384332 | mon1 | Thursday 26 March 2026 18:28:24 +0000 (0:00:22.916) 0:02:53.007 ******** 2026-03-26 18:28:24.455341 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-26 18:28:24.455410 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-26 18:28:24.456328 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-26 18:28:24.456365 | mon1 | skipping: [osd1] 2026-03-26 18:28:24.456371 | mon1 | 2026-03-26 18:28:24.456380 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-26 18:28:24.456620 | mon1 | Thursday 26 March 2026 18:28:24 +0000 (0:00:00.070) 0:02:53.077 ******** 2026-03-26 18:28:32.318310 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:28:32.318359 | mon1 | 2026-03-26 18:28:32.318824 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-26 18:28:32.318839 | mon1 | Thursday 26 March 2026 18:28:32 +0000 (0:00:07.863) 0:03:00.941 ******** 2026-03-26 18:28:40.188977 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:28:40.189047 | mon1 | 2026-03-26 18:28:40.189062 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-26 18:28:40.189076 | mon1 | Thursday 26 March 2026 18:28:40 +0000 (0:00:07.869) 0:03:08.810 ******** 2026-03-26 18:28:40.253941 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-26 18:28:40.254001 | mon1 | 2026-03-26 18:28:40.254015 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-26 18:28:40.254027 | mon1 | Thursday 26 March 2026 18:28:40 +0000 (0:00:00.065) 0:03:08.876 ******** 2026-03-26 18:28:40.299649 | mon1 | ok: [osd1] 2026-03-26 18:28:40.299713 | mon1 | 2026-03-26 18:28:40.299727 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-26 18:28:40.299745 | mon1 | Thursday 26 March 2026 18:28:40 +0000 (0:00:00.046) 0:03:08.922 ******** 2026-03-26 18:28:47.920318 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-26 18:28:47.920384 | mon1 | 2026-03-26 18:28:47.920394 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-26 18:28:47.920403 | mon1 | Thursday 26 March 2026 18:28:47 +0000 (0:00:07.620) 0:03:16.542 ******** 2026-03-26 18:28:47.973378 | mon1 | ok: [osd1] 2026-03-26 18:28:47.973442 | mon1 | 2026-03-26 18:28:47.973904 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-26 18:28:47.973943 | mon1 | Thursday 26 March 2026 18:28:47 +0000 (0:00:00.053) 0:03:16.596 ******** 2026-03-26 18:28:48.017265 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:28:48.017327 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:28:48.018364 | mon1 | skipping: [osd1] => (item=1) 2026-03-26 18:28:48.018423 | mon1 | skipping: [osd1] 2026-03-26 18:28:48.018434 | mon1 | 2026-03-26 18:28:48.018444 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-26 18:28:48.018458 | mon1 | Thursday 26 March 2026 18:28:48 +0000 (0:00:00.043) 0:03:16.639 ******** 2026-03-26 18:28:48.059260 | mon1 | skipping: [osd1] 2026-03-26 18:28:48.059297 | mon1 | 2026-03-26 18:28:48.059304 | mon1 | PLAY RECAP ********************************************************************* 2026-03-26 18:28:48.059310 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-26 18:28:48.059316 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-26 18:28:48.059322 | mon1 | 2026-03-26 18:28:48.059327 | mon1 | 2026-03-26 18:28:48.059332 | mon1 | TASKS RECAP ******************************************************************** 2026-03-26 18:28:48.059375 | mon1 | Thursday 26 March 2026 18:28:48 +0000 (0:00:00.040) 0:03:16.680 ******** 2026-03-26 18:28:48.059381 | mon1 | =============================================================================== 2026-03-26 18:28:48.059386 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.92s 2026-03-26 18:28:48.059390 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 19.30s 2026-03-26 18:28:48.059395 | mon1 | vexxhost.ceph.mgr : Configure manager modules -------------------------- 11.72s 2026-03-26 18:28:48.059399 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 10.06s 2026-03-26 18:28:48.059404 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 9.19s 2026-03-26 18:28:48.059461 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 9.04s 2026-03-26 18:28:48.059673 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 7.87s 2026-03-26 18:28:48.059884 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 7.86s 2026-03-26 18:28:48.060092 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.79s 2026-03-26 18:28:48.060317 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 7.62s 2026-03-26 18:28:48.060531 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.10s 2026-03-26 18:28:48.060740 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 7.00s 2026-03-26 18:28:48.060950 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.93s 2026-03-26 18:28:48.061164 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.92s 2026-03-26 18:28:48.061397 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.58s 2026-03-26 18:28:48.061614 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.30s 2026-03-26 18:28:48.061822 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.30s 2026-03-26 18:28:48.062028 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.48s 2026-03-26 18:28:48.062251 | mon1 | Gathering Facts --------------------------------------------------------- 2.25s 2026-03-26 18:28:48.062455 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.24s 2026-03-26 18:28:48.153170 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-26 18:28:48.162109 | mon1 | INFO [default > side_effect] Executing 2026-03-26 18:28:48.162647 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-26 18:28:48.170956 | mon1 | INFO [default > verify] Executing 2026-03-26 18:28:48.918319 | mon1 | 2026-03-26 18:28:48.918871 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-26 18:28:48.919277 | mon1 | 2026-03-26 18:28:48.919614 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-26 18:28:48.920341 | mon1 | Thursday 26 March 2026 18:28:48 +0000 (0:00:00.008) 0:00:00.008 ******** 2026-03-26 18:28:50.180357 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-26 18:28:50.180615 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-26 18:28:50.180763 | mon1 | interpreter could change the meaning of that path. See 2026-03-26 18:28:50.180901 | mon1 | https://docs.ansible.com/ansible- 2026-03-26 18:28:50.181039 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-26 18:28:50.189801 | mon1 | ok: [mon1] 2026-03-26 18:28:50.190136 | mon1 | 2026-03-26 18:28:50.190629 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-26 18:28:50.191006 | mon1 | Thursday 26 March 2026 18:28:50 +0000 (0:00:01.271) 0:00:01.279 ******** 2026-03-26 18:29:02.101131 | mon1 | ok: [mon1] 2026-03-26 18:29:02.101600 | mon1 | 2026-03-26 18:29:02.102006 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-26 18:29:02.102585 | mon1 | Thursday 26 March 2026 18:29:02 +0000 (0:00:11.910) 0:00:13.190 ******** 2026-03-26 18:29:02.134609 | mon1 | ok: [mon1] => { 2026-03-26 18:29:02.135316 | mon1 | "_ceph_health": { 2026-03-26 18:29:02.135712 | mon1 | "changed": false, 2026-03-26 18:29:02.136122 | mon1 | "cmd": [ 2026-03-26 18:29:02.136557 | mon1 | "cephadm", 2026-03-26 18:29:02.137258 | mon1 | "shell", 2026-03-26 18:29:02.137282 | mon1 | "--", 2026-03-26 18:29:02.137544 | mon1 | "ceph", 2026-03-26 18:29:02.137975 | mon1 | "health" 2026-03-26 18:29:02.138431 | mon1 | ], 2026-03-26 18:29:02.138846 | mon1 | "delta": "0:00:11.553310", 2026-03-26 18:29:02.139195 | mon1 | "end": "2026-03-26 18:29:02.052918", 2026-03-26 18:29:02.139503 | mon1 | "failed": false, 2026-03-26 18:29:02.139750 | mon1 | "msg": "", 2026-03-26 18:29:02.140021 | mon1 | "rc": 0, 2026-03-26 18:29:02.140320 | mon1 | "start": "2026-03-26 18:28:50.499608", 2026-03-26 18:29:02.140617 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-26 18:29:02.140894 | mon1 | "stderr_lines": [ 2026-03-26 18:29:02.141168 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-26 18:29:02.141488 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-26 18:29:02.141722 | mon1 | ], 2026-03-26 18:29:02.142017 | mon1 | "stdout": "HEALTH_OK", 2026-03-26 18:29:02.142364 | mon1 | "stdout_lines": [ 2026-03-26 18:29:02.142708 | mon1 | "HEALTH_OK" 2026-03-26 18:29:02.143025 | mon1 | ] 2026-03-26 18:29:02.143349 | mon1 | } 2026-03-26 18:29:02.143685 | mon1 | } 2026-03-26 18:29:02.143927 | mon1 | 2026-03-26 18:29:02.144290 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-26 18:29:02.144637 | mon1 | Thursday 26 March 2026 18:29:02 +0000 (0:00:00.034) 0:00:13.224 ******** 2026-03-26 18:29:02.165263 | mon1 | ok: [mon1] => { 2026-03-26 18:29:02.165314 | mon1 | "changed": false, 2026-03-26 18:29:02.165332 | mon1 | "msg": "All assertions passed" 2026-03-26 18:29:02.165643 | mon1 | } 2026-03-26 18:29:02.165930 | mon1 | 2026-03-26 18:29:02.166174 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-26 18:29:02.166468 | mon1 | Thursday 26 March 2026 18:29:02 +0000 (0:00:00.030) 0:00:13.255 ******** 2026-03-26 18:29:13.199381 | mon1 | changed: [mon1] 2026-03-26 18:29:13.199599 | mon1 | 2026-03-26 18:29:13.199993 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-26 18:29:13.200185 | mon1 | Thursday 26 March 2026 18:29:13 +0000 (0:00:11.034) 0:00:24.289 ******** 2026-03-26 18:29:16.788023 | mon1 | changed: [mon1] 2026-03-26 18:29:16.788242 | mon1 | 2026-03-26 18:29:16.788522 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-26 18:29:16.788816 | mon1 | Thursday 26 March 2026 18:29:16 +0000 (0:00:03.588) 0:00:27.877 ******** 2026-03-26 18:29:18.599402 | mon1 | ok: [mon1] 2026-03-26 18:29:18.599465 | mon1 | 2026-03-26 18:29:18.599474 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-26 18:29:18.599734 | mon1 | Thursday 26 March 2026 18:29:18 +0000 (0:00:01.811) 0:00:29.689 ******** 2026-03-26 18:29:18.646301 | mon1 | ok: [mon1] => { 2026-03-26 18:29:18.646348 | mon1 | "changed": false, 2026-03-26 18:29:18.646354 | mon1 | "msg": "All assertions passed" 2026-03-26 18:29:18.646360 | mon1 | } 2026-03-26 18:29:18.646366 | mon1 | 2026-03-26 18:29:18.646371 | mon1 | PLAY RECAP ********************************************************************* 2026-03-26 18:29:18.647283 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-26 18:29:18.647350 | mon1 | 2026-03-26 18:29:18.647366 | mon1 | 2026-03-26 18:29:18.647651 | mon1 | TASKS RECAP ******************************************************************** 2026-03-26 18:29:18.647936 | mon1 | Thursday 26 March 2026 18:29:18 +0000 (0:00:00.046) 0:00:29.735 ******** 2026-03-26 18:29:18.648121 | mon1 | =============================================================================== 2026-03-26 18:29:18.648338 | mon1 | Get cluster health status ---------------------------------------------- 11.91s 2026-03-26 18:29:18.648532 | mon1 | Create a test Ceph pool ------------------------------------------------ 11.03s 2026-03-26 18:29:18.648722 | mon1 | Create a test Ceph key -------------------------------------------------- 3.59s 2026-03-26 18:29:18.648912 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.81s 2026-03-26 18:29:18.649100 | mon1 | Gathering Facts --------------------------------------------------------- 1.27s 2026-03-26 18:29:18.649312 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.05s 2026-03-26 18:29:18.649504 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-26 18:29:18.649692 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-26 18:29:18.754909 | mon1 | INFO [default > verify] Executed: Successful 2026-03-26 18:29:18.767107 | mon1 | INFO [default > cleanup] Executing 2026-03-26 18:29:18.767681 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-26 18:29:18.775186 | mon1 | INFO [default > destroy] Executing 2026-03-26 18:29:18.775319 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-26 18:29:18.776422 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-26 18:29:18.776487 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-26 18:29:29.001475 | mon1 | ok: Runtime: 0:17:06.269366 2026-03-26 18:29:29.016930 | 2026-03-26 18:29:29.035557 | PLAY RECAP 2026-03-26 18:29:29.035816 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-26 18:29:29.035878 | 2026-03-26 18:29:29.188429 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-26 18:29:29.193024 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-26 18:29:29.841801 | 2026-03-26 18:29:29.842010 | PLAY [all] 2026-03-26 18:29:29.856215 | 2026-03-26 18:29:29.856364 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-26 18:29:29.912918 | mon1 | ok 2026-03-26 18:29:29.917923 | osd1 | ok 2026-03-26 18:29:29.923616 | 2026-03-26 18:29:29.923735 | TASK [fetch-output : Set log path for single node] 2026-03-26 18:29:29.949320 | mon1 | skipping: Conditional result was False 2026-03-26 18:29:29.960855 | osd1 | skipping: Conditional result was False 2026-03-26 18:29:29.971717 | 2026-03-26 18:29:29.971861 | LOOP [fetch-output : Ensure local output dirs] 2026-03-26 18:29:30.362780 | mon1 -> localhost | changed: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/logs/mon1" 2026-03-26 18:29:30.366256 | osd1 -> localhost | changed: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/logs/osd1" 2026-03-26 18:29:30.573985 | osd1 -> localhost | changed: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/artifacts" 2026-03-26 18:29:30.587659 | mon1 -> localhost | ok: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/artifacts" 2026-03-26 18:29:30.805701 | osd1 -> localhost | changed: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/docs" 2026-03-26 18:29:30.840156 | mon1 -> localhost | ok: "/var/lib/zuul/builds/98b947063c6b42a2aa36b0630f879e08/work/docs" 2026-03-26 18:29:30.840352 | mon1 -> localhost | changed: All items complete 2026-03-26 18:29:30.840394 | 2026-03-26 18:29:30.862023 | 2026-03-26 18:29:30.862218 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-26 18:29:31.527146 | mon1 | changed: .d..t...... ./ 2026-03-26 18:29:31.533072 | osd1 | changed: .d..t...... ./ 2026-03-26 18:29:32.014858 | osd1 | changed: .d..t...... ./ 2026-03-26 18:29:32.029505 | mon1 | ok 2026-03-26 18:29:32.499028 | osd1 | changed: .d..t...... ./ 2026-03-26 18:29:32.527203 | mon1 | ok 2026-03-26 18:29:32.527506 | mon1 | changed: All items complete 2026-03-26 18:29:32.527535 | 2026-03-26 18:29:32.549824 | 2026-03-26 18:29:32.550340 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-26 18:29:33.086415 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006277 2026-03-26 18:29:33.349486 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008079 2026-03-26 18:29:33.378186 | 2026-03-26 18:29:33.378332 | PLAY [all] 2026-03-26 18:29:33.385563 | 2026-03-26 18:29:33.385668 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-26 18:29:33.890875 | mon1 | changed 2026-03-26 18:29:34.065130 | osd1 | changed 2026-03-26 18:29:34.077833 | 2026-03-26 18:29:34.077945 | PLAY RECAP 2026-03-26 18:29:34.077997 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-26 18:29:34.078028 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-26 18:29:34.078100 | 2026-03-26 18:29:34.216251 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-26 18:29:34.220283 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-26 18:29:34.823901 | 2026-03-26 18:29:34.824502 | PLAY [localhost] 2026-03-26 18:29:34.835955 | 2026-03-26 18:29:34.836035 | TASK [Generate Zuul manifest] 2026-03-26 18:29:34.860585 | localhost | ok 2026-03-26 18:29:34.878624 | 2026-03-26 18:29:34.878786 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-26 18:29:35.203402 | localhost | changed 2026-03-26 18:29:35.216946 | 2026-03-26 18:29:35.217088 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-26 18:29:35.292122 | localhost | ok 2026-03-26 18:29:35.302113 | 2026-03-26 18:29:35.302200 | TASK [Upload logs] 2026-03-26 18:29:35.335783 | localhost | ok 2026-03-26 18:29:35.395765 | 2026-03-26 18:29:35.395930 | TASK [Set zuul-log-path fact] 2026-03-26 18:29:35.419177 | localhost | ok 2026-03-26 18:29:35.434828 | 2026-03-26 18:29:35.434916 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-26 18:29:35.470463 | localhost | ok 2026-03-26 18:29:35.479617 | 2026-03-26 18:29:35.479705 | TASK [upload-logs : Create log directories] 2026-03-26 18:29:35.978471 | localhost | changed 2026-03-26 18:29:35.986400 | 2026-03-26 18:29:35.986554 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-26 18:29:36.394757 | localhost -> localhost | ok: Runtime: 0:00:00.005306 2026-03-26 18:29:36.401504 | 2026-03-26 18:29:36.401597 | TASK [upload-logs : Upload logs to log server] 2026-03-26 18:29:36.871649 | localhost | Output suppressed because no_log was given 2026-03-26 18:29:36.876630 | 2026-03-26 18:29:36.876723 | LOOP [upload-logs : Compress console log and json output] 2026-03-26 18:29:36.922967 | localhost | skipping: Conditional result was False 2026-03-26 18:29:36.930847 | localhost | skipping: Conditional result was False 2026-03-26 18:29:36.940757 | 2026-03-26 18:29:36.940946 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-26 18:29:36.993109 | localhost | skipping: Conditional result was False 2026-03-26 18:29:36.993543 | 2026-03-26 18:29:36.997807 | localhost | skipping: Conditional result was False 2026-03-26 18:29:37.015112 | 2026-03-26 18:29:37.015342 | LOOP [upload-logs : Upload console log and json output]