2026-03-05 16:31:32.446596 | Job console starting 2026-03-05 16:31:32.461082 | Updating git repos 2026-03-05 16:31:32.484073 | Cloning repos into workspace 2026-03-05 16:31:32.725232 | Restoring repo states 2026-03-05 16:31:32.732809 | Merging changes 2026-03-05 16:31:33.002637 | Checking out repos 2026-03-05 16:31:33.130501 | Preparing playbooks 2026-03-05 16:31:37.966713 | Running Ansible setup 2026-03-05 16:31:43.499462 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:44.096137 | 2026-03-05 16:31:44.221211 | PLAY [localhost] 2026-03-05 16:31:44.234800 | 2026-03-05 16:31:44.234905 | TASK [Gathering Facts] 2026-03-05 16:31:46.086146 | localhost | ok 2026-03-05 16:31:46.097547 | 2026-03-05 16:31:46.097651 | TASK [Setup log path fact] 2026-03-05 16:31:46.118759 | localhost | ok 2026-03-05 16:31:46.131850 | 2026-03-05 16:31:46.132024 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:31:46.161244 | localhost | ok 2026-03-05 16:31:46.169795 | 2026-03-05 16:31:46.169888 | TASK [emit-job-header : Print job information] 2026-03-05 16:31:46.211808 | # Job Information 2026-03-05 16:31:46.274707 | Ansible Version: 2.16.16 2026-03-05 16:31:46.274819 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-05 16:31:46.274875 | Pipeline: check 2026-03-05 16:31:46.274922 | Executor: 0a8996d2b663 2026-03-05 16:31:46.274965 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/93 2026-03-05 16:31:46.275015 | Event ID: 6c11fb90-18ae-11f1-8dd1-418c053b88bb 2026-03-05 16:31:46.281421 | 2026-03-05 16:31:46.281555 | LOOP [emit-job-header : Print node information] 2026-03-05 16:31:46.389939 | localhost | ok: 2026-03-05 16:31:46.390226 | localhost | # Node Information 2026-03-05 16:31:46.390268 | localhost | Inventory Hostname: mon1 2026-03-05 16:31:46.390300 | localhost | Hostname: np0000157926 2026-03-05 16:31:46.390330 | localhost | Username: zuul 2026-03-05 16:31:46.390368 | localhost | Distro: Ubuntu 24.04 2026-03-05 16:31:46.390399 | localhost | Provider: yul1 2026-03-05 16:31:46.390428 | localhost | Region: ca-ymq-1 2026-03-05 16:31:46.390457 | localhost | Label: ubuntu-noble 2026-03-05 16:31:46.390484 | localhost | Product Name: OpenStack Nova 2026-03-05 16:31:46.390511 | localhost | Interface IP: 162.253.55.200 2026-03-05 16:31:46.443875 | localhost | ok: 2026-03-05 16:31:46.443949 | localhost | # Node Information 2026-03-05 16:31:46.443986 | localhost | Inventory Hostname: osd1 2026-03-05 16:31:46.444016 | localhost | Hostname: np0000157927 2026-03-05 16:31:46.444043 | localhost | Username: zuul 2026-03-05 16:31:46.444070 | localhost | Distro: Ubuntu 24.04 2026-03-05 16:31:46.444097 | localhost | Provider: yul1 2026-03-05 16:31:46.444122 | localhost | Region: ca-ymq-1 2026-03-05 16:31:46.444148 | localhost | Label: ubuntu-noble 2026-03-05 16:31:46.444173 | localhost | Product Name: OpenStack Nova 2026-03-05 16:31:46.444200 | localhost | Interface IP: 162.253.55.49 2026-03-05 16:31:46.455082 | 2026-03-05 16:31:46.455209 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 16:31:46.823410 | localhost -> localhost | changed 2026-03-05 16:31:46.829599 | 2026-03-05 16:31:46.829682 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 16:31:48.480829 | localhost -> localhost | changed 2026-03-05 16:31:48.490672 | 2026-03-05 16:31:48.490778 | PLAY [all] 2026-03-05 16:31:48.502409 | 2026-03-05 16:31:48.502498 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 16:31:48.728712 | mon1 -> localhost | ok 2026-03-05 16:31:48.740255 | 2026-03-05 16:31:48.740361 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 16:31:48.775094 | mon1 | ok 2026-03-05 16:31:48.781736 | osd1 | ok 2026-03-05 16:31:48.804510 | mon1 | included: /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:31:48.804625 | osd1 | included: /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 16:31:48.811565 | 2026-03-05 16:31:48.811663 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 16:31:50.115214 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 16:31:50.115438 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/3f0fe44090a444e1a9405a0a2f9f2608_id_rsa 2026-03-05 16:31:50.115469 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/3f0fe44090a444e1a9405a0a2f9f2608_id_rsa.pub 2026-03-05 16:31:50.115493 | mon1 -> localhost | The key fingerprint is: 2026-03-05 16:31:50.115515 | mon1 -> localhost | SHA256:NG5SC4NeIm4j3i07huj6pq4n7XJEMDT6ylktdLFZVqE zuul-build-sshkey 2026-03-05 16:31:50.115536 | mon1 -> localhost | The key's randomart image is: 2026-03-05 16:31:50.115556 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 16:31:50.115576 | mon1 -> localhost | |.o . o.o. | 2026-03-05 16:31:50.115596 | mon1 -> localhost | |+ . .* . | 2026-03-05 16:31:50.115615 | mon1 -> localhost | |.o..o++E+ | 2026-03-05 16:31:50.115635 | mon1 -> localhost | | ooooo * o | 2026-03-05 16:31:50.115656 | mon1 -> localhost | |..=o... S | 2026-03-05 16:31:50.115675 | mon1 -> localhost | |o+=.o o | 2026-03-05 16:31:50.115695 | mon1 -> localhost | |o*.o . | 2026-03-05 16:31:50.115714 | mon1 -> localhost | |+.=oo | 2026-03-05 16:31:50.115733 | mon1 -> localhost | |O%+.. | 2026-03-05 16:31:50.115752 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 16:31:50.115801 | mon1 -> localhost | ok: Runtime: 0:00:00.813677 2026-03-05 16:31:50.122776 | 2026-03-05 16:31:50.122843 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 16:31:50.159116 | mon1 | ok 2026-03-05 16:31:50.165776 | osd1 | ok 2026-03-05 16:31:50.180353 | mon1 | included: /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:31:50.180410 | osd1 | included: /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 16:31:50.191044 | 2026-03-05 16:31:50.191106 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 16:31:50.217115 | mon1 | skipping: Conditional result was False 2026-03-05 16:31:50.228663 | osd1 | skipping: Conditional result was False 2026-03-05 16:31:50.239640 | 2026-03-05 16:31:50.239736 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 16:31:50.761995 | mon1 | changed 2026-03-05 16:31:51.072014 | osd1 | changed 2026-03-05 16:31:51.077759 | 2026-03-05 16:31:51.077824 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 16:31:51.305081 | mon1 | ok 2026-03-05 16:31:51.310291 | osd1 | ok 2026-03-05 16:31:51.316441 | 2026-03-05 16:31:51.316510 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 16:31:51.908417 | osd1 | changed 2026-03-05 16:31:54.424262 | mon1 | changed 2026-03-05 16:31:54.429476 | 2026-03-05 16:31:54.429537 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 16:31:55.041483 | mon1 | changed 2026-03-05 16:31:55.046456 | osd1 | changed 2026-03-05 16:31:55.051952 | 2026-03-05 16:31:55.052195 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 16:31:55.082003 | mon1 | skipping: Conditional result was False 2026-03-05 16:31:55.093500 | osd1 | skipping: Conditional result was False 2026-03-05 16:31:55.104628 | 2026-03-05 16:31:55.104708 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 16:31:55.444233 | mon1 -> localhost | changed 2026-03-05 16:31:55.466038 | 2026-03-05 16:31:55.466120 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 16:31:55.746023 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/3f0fe44090a444e1a9405a0a2f9f2608_id_rsa (zuul-build-sshkey) 2026-03-05 16:31:55.746334 | mon1 -> localhost | ok: Runtime: 0:00:00.013334 2026-03-05 16:31:55.754741 | 2026-03-05 16:31:55.754830 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 16:31:56.079244 | mon1 | ok 2026-03-05 16:31:56.084208 | osd1 | ok 2026-03-05 16:31:56.089308 | 2026-03-05 16:31:56.089371 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 16:31:56.115937 | mon1 | skipping: Conditional result was False 2026-03-05 16:31:56.127073 | osd1 | skipping: Conditional result was False 2026-03-05 16:31:56.151101 | 2026-03-05 16:31:56.151166 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 16:31:56.471256 | osd1 | ok 2026-03-05 16:31:56.478173 | mon1 | ok 2026-03-05 16:31:56.484302 | 2026-03-05 16:31:56.484366 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 16:31:57.344092 | mon1 | Output suppressed because no_log was given 2026-03-05 16:31:57.352118 | osd1 | Output suppressed because no_log was given 2026-03-05 16:31:57.367963 | 2026-03-05 16:31:57.368028 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 16:31:57.596441 | mon1 | ok: "logs" 2026-03-05 16:31:57.596765 | mon1 | ok: All items complete 2026-03-05 16:31:57.596807 | 2026-03-05 16:31:57.632493 | osd1 | ok: "logs" 2026-03-05 16:31:57.806297 | mon1 | ok: "artifacts" 2026-03-05 16:31:57.859756 | osd1 | ok: "artifacts" 2026-03-05 16:31:58.006905 | mon1 | ok: "docs" 2026-03-05 16:31:58.205923 | osd1 | ok: "docs" 2026-03-05 16:31:58.225809 | 2026-03-05 16:31:58.225900 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 16:31:58.472097 | mon1 | changed: "logs" 2026-03-05 16:31:58.511102 | mon1 | ok: All items complete 2026-03-05 16:31:58.511197 | 2026-03-05 16:31:58.520509 | osd1 | changed: "logs" 2026-03-05 16:31:58.666255 | osd1 | changed: "artifacts" 2026-03-05 16:31:58.672843 | mon1 | changed: "artifacts" 2026-03-05 16:31:58.874321 | mon1 | changed: "docs" 2026-03-05 16:31:58.891368 | osd1 | changed: "docs" 2026-03-05 16:31:58.908454 | 2026-03-05 16:31:58.908513 | PLAY RECAP 2026-03-05 16:31:58.908559 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:31:58.908587 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:31:58.908612 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 16:31:58.908631 | 2026-03-05 16:31:59.064230 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 16:31:59.278536 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:31:59.865700 | 2026-03-05 16:31:59.865824 | PLAY [all] 2026-03-05 16:31:59.877626 | 2026-03-05 16:31:59.877702 | TASK [setup-uv : Extract archive] 2026-03-05 16:32:02.266495 | osd1 | changed 2026-03-05 16:32:02.318006 | mon1 | changed 2026-03-05 16:32:02.360117 | 2026-03-05 16:32:02.360261 | TASK [setup-uv : Print version] 2026-03-05 16:32:02.756453 | mon1 | uv 0.8.13 2026-03-05 16:32:02.713371 | osd1 | uv 0.8.13 2026-03-05 16:32:03.587912 | osd1 | ok: Runtime: 0:00:00.016319 2026-03-05 16:32:03.597549 | mon1 | ok: Runtime: 0:00:00.016624 2026-03-05 16:32:03.609000 | 2026-03-05 16:32:03.609058 | PLAY RECAP 2026-03-05 16:32:03.609107 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:32:03.609134 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:32:03.609153 | 2026-03-05 16:32:03.763251 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 16:32:03.767669 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:32:04.370288 | 2026-03-05 16:32:04.370442 | PLAY [all] 2026-03-05 16:32:04.382464 | 2026-03-05 16:32:04.382587 | TASK [Copy inventory file for Zuul] 2026-03-05 16:32:05.416606 | mon1 | changed 2026-03-05 16:32:05.423372 | 2026-03-05 16:32:05.423451 | TASK [Switch "ansible_host" to private IP] 2026-03-05 16:32:05.782928 | mon1 | changed: 2 replacements made 2026-03-05 16:32:05.789770 | 2026-03-05 16:32:05.789838 | TASK [Run Molecule scenario] 2026-03-05 16:32:06.253899 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-05 16:32:06.254083 | mon1 | Creating virtual environment at: .venv 2026-03-05 16:32:06.541442 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 16:32:06.542751 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 16:32:06.543372 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 16:32:06.544036 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 16:32:06.737187 | mon1 | Downloading netaddr 2026-03-05 16:32:06.748436 | mon1 | Downloading cryptography 2026-03-05 16:32:06.811027 | mon1 | Downloading pygments 2026-03-05 16:32:06.993128 | mon1 | Downloading ansible-core 2026-03-05 16:32:07.040029 | mon1 | Installed 37 packages in 46ms 2026-03-05 16:32:07.812546 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 16:32:07.812657 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 16:32:08.475622 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 16:32:08.475719 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 16:32:22.922075 | mon1 | INFO [default > dependency] Executing 2026-03-05 16:32:22.922328 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 16:32:22.922672 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 16:32:22.922821 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 16:32:22.930422 | mon1 | INFO [default > cleanup] Executing 2026-03-05 16:32:22.930738 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:22.936397 | mon1 | INFO [default > destroy] Executing 2026-03-05 16:32:22.936453 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:32:22.936554 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 16:32:22.942148 | mon1 | INFO [default > syntax] Executing 2026-03-05 16:32:24.028843 | mon1 | 2026-03-05 16:32:24.029111 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 16:32:24.080947 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 16:32:24.092356 | mon1 | INFO [default > create] Executing 2026-03-05 16:32:24.093839 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:32:24.099741 | mon1 | INFO [default > prepare] Executing 2026-03-05 16:32:25.002031 | mon1 | 2026-03-05 16:32:25.002257 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 16:32:25.002530 | mon1 | 2026-03-05 16:32:25.002792 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:25.003134 | mon1 | Thursday 05 March 2026 16:32:24 +0000 (0:00:00.040) 0:00:00.040 ******** 2026-03-05 16:32:26.299930 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:32:26.300010 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:32:26.300031 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:32:26.300092 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:32:26.300213 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:27.301020 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:32:27.301179 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:32:27.301448 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:32:27.301684 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:32:27.301922 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:32:27.313452 | mon1 | ok: [osd1] 2026-03-05 16:32:27.313686 | mon1 | ok: [mon1] 2026-03-05 16:32:27.313924 | mon1 | 2026-03-05 16:32:27.314205 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 16:32:27.314499 | mon1 | Thursday 05 March 2026 16:32:27 +0000 (0:00:02.314) 0:00:02.355 ******** 2026-03-05 16:32:28.129402 | mon1 | changed: [mon1] 2026-03-05 16:32:28.129514 | mon1 | changed: [osd1] 2026-03-05 16:32:28.129656 | mon1 | 2026-03-05 16:32:28.129904 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 16:32:28.130179 | mon1 | Thursday 05 March 2026 16:32:28 +0000 (0:00:00.815) 0:00:03.170 ******** 2026-03-05 16:32:28.463721 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 16:32:28.463801 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 16:32:28.463885 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 16:32:28.476270 | mon1 | changed: [mon1] 2026-03-05 16:32:28.476549 | mon1 | changed: [osd1] 2026-03-05 16:32:28.476772 | mon1 | 2026-03-05 16:32:28.477016 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 16:32:28.477264 | mon1 | Thursday 05 March 2026 16:32:28 +0000 (0:00:00.347) 0:00:03.517 ******** 2026-03-05 16:32:34.977450 | mon1 | changed: [mon1] 2026-03-05 16:32:34.977602 | mon1 | changed: [osd1] 2026-03-05 16:32:34.977829 | mon1 | 2026-03-05 16:32:34.978082 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 16:32:34.978323 | mon1 | 2026-03-05 16:32:34.978596 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:32:34.978968 | mon1 | Thursday 05 March 2026 16:32:34 +0000 (0:00:06.498) 0:00:10.016 ******** 2026-03-05 16:32:35.790765 | mon1 | ok: [osd1] 2026-03-05 16:32:35.790864 | mon1 | 2026-03-05 16:32:35.790911 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 16:32:35.791017 | mon1 | Thursday 05 March 2026 16:32:35 +0000 (0:00:00.816) 0:00:10.832 ******** 2026-03-05 16:32:56.218544 | mon1 | changed: [osd1] 2026-03-05 16:32:56.218665 | mon1 | 2026-03-05 16:32:56.218684 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 16:32:56.218805 | mon1 | Thursday 05 March 2026 16:32:56 +0000 (0:00:20.425) 0:00:31.257 ******** 2026-03-05 16:32:56.890000 | mon1 | ok: [osd1] 2026-03-05 16:32:56.890189 | mon1 | 2026-03-05 16:32:56.890485 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 16:32:56.890730 | mon1 | Thursday 05 March 2026 16:32:56 +0000 (0:00:00.673) 0:00:31.931 ******** 2026-03-05 16:32:57.276046 | mon1 | ok: [osd1] 2026-03-05 16:32:57.276248 | mon1 | 2026-03-05 16:32:57.276539 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 16:32:57.276836 | mon1 | Thursday 05 March 2026 16:32:57 +0000 (0:00:00.385) 0:00:32.317 ******** 2026-03-05 16:32:58.054574 | mon1 | changed: [osd1] 2026-03-05 16:32:58.054765 | mon1 | 2026-03-05 16:32:58.055078 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 16:32:58.055461 | mon1 | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.778) 0:00:33.095 ******** 2026-03-05 16:32:58.297594 | mon1 | ok: [osd1] 2026-03-05 16:32:58.297771 | mon1 | 2026-03-05 16:32:58.298031 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 16:32:58.298279 | mon1 | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.242) 0:00:33.338 ******** 2026-03-05 16:32:58.325165 | mon1 | skipping: [osd1] 2026-03-05 16:32:58.325414 | mon1 | 2026-03-05 16:32:58.325668 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 16:32:58.325918 | mon1 | Thursday 05 March 2026 16:32:58 +0000 (0:00:00.028) 0:00:33.367 ******** 2026-03-05 16:32:59.054783 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:32:59.055056 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:32:59.055378 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:32:59.055659 | mon1 | 2026-03-05 16:32:59.055973 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 16:32:59.056265 | mon1 | Thursday 05 March 2026 16:32:59 +0000 (0:00:00.728) 0:00:34.096 ******** 2026-03-05 16:32:59.864396 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:32:59.864591 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:32:59.864836 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:32:59.865057 | mon1 | 2026-03-05 16:32:59.865316 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 16:32:59.865574 | mon1 | Thursday 05 March 2026 16:32:59 +0000 (0:00:00.809) 0:00:34.905 ******** 2026-03-05 16:33:00.693875 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:00.694116 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:00.694461 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:00.694696 | mon1 | 2026-03-05 16:33:00.694950 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 16:33:00.695199 | mon1 | Thursday 05 March 2026 16:33:00 +0000 (0:00:00.829) 0:00:35.735 ******** 2026-03-05 16:33:02.190132 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 16:33:02.190362 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 16:33:02.190653 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 16:33:02.190887 | mon1 | 2026-03-05 16:33:02.191139 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 16:33:02.191420 | mon1 | Thursday 05 March 2026 16:33:02 +0000 (0:00:01.495) 0:00:37.230 ******** 2026-03-05 16:33:03.559659 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 16:33:03.559764 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 16:33:03.559907 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 16:33:03.560037 | mon1 | 2026-03-05 16:33:03.560175 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:33:03.560375 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:33:03.560521 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 16:33:03.560657 | mon1 | 2026-03-05 16:33:03.560789 | mon1 | 2026-03-05 16:33:03.560937 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:33:03.561088 | mon1 | Thursday 05 March 2026 16:33:03 +0000 (0:00:01.370) 0:00:38.601 ******** 2026-03-05 16:33:03.561233 | mon1 | =============================================================================== 2026-03-05 16:33:03.561429 | mon1 | Install depedencies ---------------------------------------------------- 20.43s 2026-03-05 16:33:03.561580 | mon1 | Update apt cache -------------------------------------------------------- 6.50s 2026-03-05 16:33:03.561729 | mon1 | Gathering Facts --------------------------------------------------------- 2.31s 2026-03-05 16:33:03.561879 | mon1 | Create a volume group for each loop device ------------------------------ 1.50s 2026-03-05 16:33:03.562027 | mon1 | Create a logical volume for each loop device ---------------------------- 1.37s 2026-03-05 16:33:03.562175 | mon1 | Start loop devices ------------------------------------------------------ 0.83s 2026-03-05 16:33:03.562343 | mon1 | Gathering Facts --------------------------------------------------------- 0.82s 2026-03-05 16:33:03.562492 | mon1 | Configure short hostname ------------------------------------------------ 0.82s 2026-03-05 16:33:03.562640 | mon1 | Set permissions on loopback devices ------------------------------------- 0.81s 2026-03-05 16:33:03.562789 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.78s 2026-03-05 16:33:03.562940 | mon1 | Create devices for Ceph ------------------------------------------------- 0.73s 2026-03-05 16:33:03.563084 | mon1 | Start up service -------------------------------------------------------- 0.67s 2026-03-05 16:33:03.563230 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.39s 2026-03-05 16:33:03.563404 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.35s 2026-03-05 16:33:03.563557 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s 2026-03-05 16:33:03.563710 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-05 16:33:03.632872 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 16:33:03.643393 | mon1 | INFO [default > converge] Executing 2026-03-05 16:33:04.605796 | mon1 | 2026-03-05 16:33:04.606071 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:33:04.606417 | mon1 | 2026-03-05 16:33:04.606729 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:33:04.606999 | mon1 | Thursday 05 March 2026 16:33:04 +0000 (0:00:00.051) 0:00:00.051 ******** 2026-03-05 16:33:05.708766 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:33:05.708835 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:33:05.709058 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:33:05.709199 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:33:05.709374 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:33:05.722157 | mon1 | ok: [mon1] 2026-03-05 16:33:05.722351 | mon1 | 2026-03-05 16:33:05.722596 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:05.722942 | mon1 | Thursday 05 March 2026 16:33:05 +0000 (0:00:01.116) 0:00:01.167 ******** 2026-03-05 16:33:06.061106 | mon1 | ok: [mon1] 2026-03-05 16:33:06.061286 | mon1 | 2026-03-05 16:33:06.061589 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:06.061837 | mon1 | Thursday 05 March 2026 16:33:06 +0000 (0:00:00.338) 0:00:01.506 ******** 2026-03-05 16:33:06.109787 | mon1 | skipping: [mon1] 2026-03-05 16:33:06.109983 | mon1 | 2026-03-05 16:33:06.110231 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:33:06.110507 | mon1 | Thursday 05 March 2026 16:33:06 +0000 (0:00:00.049) 0:00:01.555 ******** 2026-03-05 16:33:06.471181 | mon1 | changed: [mon1] 2026-03-05 16:33:06.471447 | mon1 | 2026-03-05 16:33:06.471780 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:06.472147 | mon1 | Thursday 05 March 2026 16:33:06 +0000 (0:00:00.360) 0:00:01.916 ******** 2026-03-05 16:33:06.573229 | mon1 | ok: [mon1] => { 2026-03-05 16:33:06.573540 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:33:06.573786 | mon1 | } 2026-03-05 16:33:06.574049 | mon1 | 2026-03-05 16:33:06.574438 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:06.574750 | mon1 | Thursday 05 March 2026 16:33:06 +0000 (0:00:00.102) 0:00:02.018 ******** 2026-03-05 16:33:07.381179 | mon1 | changed: [mon1] 2026-03-05 16:33:07.381237 | mon1 | 2026-03-05 16:33:07.381248 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:07.381257 | mon1 | Thursday 05 March 2026 16:33:07 +0000 (0:00:00.807) 0:00:02.826 ******** 2026-03-05 16:33:07.430514 | mon1 | skipping: [mon1] 2026-03-05 16:33:07.430627 | mon1 | 2026-03-05 16:33:07.430897 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:07.431132 | mon1 | Thursday 05 March 2026 16:33:07 +0000 (0:00:00.050) 0:00:02.876 ******** 2026-03-05 16:33:07.475163 | mon1 | skipping: [mon1] 2026-03-05 16:33:07.475393 | mon1 | 2026-03-05 16:33:07.475666 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:07.475894 | mon1 | Thursday 05 March 2026 16:33:07 +0000 (0:00:00.044) 0:00:02.921 ******** 2026-03-05 16:33:07.728728 | mon1 | ok: [mon1] 2026-03-05 16:33:07.728798 | mon1 | 2026-03-05 16:33:07.730482 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:33:07.730522 | mon1 | Thursday 05 March 2026 16:33:07 +0000 (0:00:00.252) 0:00:03.174 ******** 2026-03-05 16:33:08.833181 | mon1 | ok: [mon1] 2026-03-05 16:33:08.833489 | mon1 | 2026-03-05 16:33:08.833772 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:08.834026 | mon1 | Thursday 05 March 2026 16:33:08 +0000 (0:00:01.103) 0:00:04.277 ******** 2026-03-05 16:33:09.041808 | mon1 | ok: [mon1] => { 2026-03-05 16:33:09.041973 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:33:09.042218 | mon1 | } 2026-03-05 16:33:09.042436 | mon1 | 2026-03-05 16:33:09.042651 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:09.042821 | mon1 | Thursday 05 March 2026 16:33:09 +0000 (0:00:00.209) 0:00:04.487 ******** 2026-03-05 16:33:10.013522 | mon1 | changed: [mon1] 2026-03-05 16:33:10.013765 | mon1 | 2026-03-05 16:33:10.014062 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:10.014385 | mon1 | Thursday 05 March 2026 16:33:10 +0000 (0:00:00.970) 0:00:05.457 ******** 2026-03-05 16:33:13.228460 | mon1 | changed: [mon1] 2026-03-05 16:33:13.228529 | mon1 | 2026-03-05 16:33:13.229155 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:33:13.229197 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:03.216) 0:00:08.673 ******** 2026-03-05 16:33:13.267446 | mon1 | skipping: [mon1] 2026-03-05 16:33:13.267506 | mon1 | 2026-03-05 16:33:13.267562 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:33:13.267827 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.037) 0:00:08.711 ******** 2026-03-05 16:33:13.298128 | mon1 | skipping: [mon1] 2026-03-05 16:33:13.298166 | mon1 | 2026-03-05 16:33:13.298171 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:33:13.298179 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.030) 0:00:08.742 ******** 2026-03-05 16:33:13.340284 | mon1 | skipping: [mon1] 2026-03-05 16:33:13.340353 | mon1 | 2026-03-05 16:33:13.340359 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:33:13.340365 | mon1 | Thursday 05 March 2026 16:33:13 +0000 (0:00:00.042) 0:00:08.784 ******** 2026-03-05 16:33:21.344056 | mon1 | changed: [mon1] 2026-03-05 16:33:21.344163 | mon1 | 2026-03-05 16:33:21.345366 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:33:21.345405 | mon1 | Thursday 05 March 2026 16:33:21 +0000 (0:00:08.003) 0:00:16.788 ******** 2026-03-05 16:33:22.032419 | mon1 | changed: [mon1] 2026-03-05 16:33:22.032478 | mon1 | 2026-03-05 16:33:22.032935 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:33:22.032996 | mon1 | Thursday 05 March 2026 16:33:22 +0000 (0:00:00.688) 0:00:17.477 ******** 2026-03-05 16:33:23.193733 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:33:23.193809 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:33:23.194363 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:33:23.194386 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:33:23.194395 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:33:23.194403 | mon1 | 2026-03-05 16:33:23.194595 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:33:23.194609 | mon1 | Thursday 05 March 2026 16:33:23 +0000 (0:00:01.161) 0:00:18.638 ******** 2026-03-05 16:33:23.899595 | mon1 | changed: [mon1] 2026-03-05 16:33:23.899650 | mon1 | 2026-03-05 16:33:23.899664 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:33:23.899677 | mon1 | Thursday 05 March 2026 16:33:23 +0000 (0:00:00.695) 0:00:19.334 ******** 2026-03-05 16:33:23.899688 | mon1 | 2026-03-05 16:33:23.899700 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:23.899712 | mon1 | Thursday 05 March 2026 16:33:23 +0000 (0:00:00.009) 0:00:19.343 ******** 2026-03-05 16:33:25.015415 | mon1 | ok: [mon1] 2026-03-05 16:33:25.015503 | mon1 | 2026-03-05 16:33:25.016221 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:33:25.016284 | mon1 | Thursday 05 March 2026 16:33:25 +0000 (0:00:01.116) 0:00:20.459 ******** 2026-03-05 16:33:25.598966 | mon1 | changed: [mon1] 2026-03-05 16:33:25.599153 | mon1 | 2026-03-05 16:33:25.599166 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:33:25.599176 | mon1 | Thursday 05 March 2026 16:33:25 +0000 (0:00:00.582) 0:00:21.042 ******** 2026-03-05 16:33:26.327385 | mon1 | changed: [mon1] 2026-03-05 16:33:26.327472 | mon1 | 2026-03-05 16:33:26.327484 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:33:26.327495 | mon1 | Thursday 05 March 2026 16:33:26 +0000 (0:00:00.728) 0:00:21.770 ******** 2026-03-05 16:33:26.584004 | mon1 | ok: [mon1] 2026-03-05 16:33:26.584068 | mon1 | 2026-03-05 16:33:26.584080 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:33:26.584089 | mon1 | Thursday 05 March 2026 16:33:26 +0000 (0:00:00.257) 0:00:22.028 ******** 2026-03-05 16:33:26.662462 | mon1 | ok: [mon1] => { 2026-03-05 16:33:26.662541 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:33:26.662556 | mon1 | } 2026-03-05 16:33:26.662577 | mon1 | 2026-03-05 16:33:26.662889 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:33:26.662924 | mon1 | Thursday 05 March 2026 16:33:26 +0000 (0:00:00.078) 0:00:22.106 ******** 2026-03-05 16:33:27.726782 | mon1 | changed: [mon1] 2026-03-05 16:33:27.726854 | mon1 | 2026-03-05 16:33:27.728415 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:33:27.728484 | mon1 | Thursday 05 March 2026 16:33:27 +0000 (0:00:01.065) 0:00:23.171 ******** 2026-03-05 16:33:32.305399 | mon1 | changed: [mon1] 2026-03-05 16:33:32.305498 | mon1 | 2026-03-05 16:33:32.306175 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:33:32.306232 | mon1 | Thursday 05 March 2026 16:33:32 +0000 (0:00:04.578) 0:00:27.750 ******** 2026-03-05 16:33:33.286748 | mon1 | ok: [mon1] 2026-03-05 16:33:33.286793 | mon1 | 2026-03-05 16:33:33.287046 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:33:33.287081 | mon1 | Thursday 05 March 2026 16:33:33 +0000 (0:00:00.980) 0:00:28.730 ******** 2026-03-05 16:33:33.708715 | mon1 | changed: [mon1] 2026-03-05 16:33:33.708786 | mon1 | 2026-03-05 16:33:33.709021 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:33:33.709056 | mon1 | Thursday 05 March 2026 16:33:33 +0000 (0:00:00.423) 0:00:29.153 ******** 2026-03-05 16:33:34.280714 | mon1 | changed: [mon1] 2026-03-05 16:33:34.280769 | mon1 | 2026-03-05 16:33:34.280895 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:33:34.281031 | mon1 | Thursday 05 March 2026 16:33:34 +0000 (0:00:00.572) 0:00:29.726 ******** 2026-03-05 16:33:34.966747 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 16:33:34.966823 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:33:34.967253 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:33:34.967303 | mon1 | 2026-03-05 16:33:34.967312 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:33:34.967318 | mon1 | Thursday 05 March 2026 16:33:34 +0000 (0:00:00.685) 0:00:30.411 ******** 2026-03-05 16:33:35.515399 | mon1 | changed: [mon1] 2026-03-05 16:33:35.515460 | mon1 | 2026-03-05 16:33:35.515871 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:33:35.515935 | mon1 | Thursday 05 March 2026 16:33:35 +0000 (0:00:00.547) 0:00:30.959 ******** 2026-03-05 16:33:36.094455 | mon1 | changed: [mon1] 2026-03-05 16:33:36.094514 | mon1 | 2026-03-05 16:33:36.094537 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:33:36.095200 | mon1 | Thursday 05 March 2026 16:33:36 +0000 (0:00:00.571) 0:00:31.531 ******** 2026-03-05 16:33:36.095234 | mon1 | 2026-03-05 16:33:36.095325 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:33:36.095669 | mon1 | Thursday 05 March 2026 16:33:36 +0000 (0:00:00.007) 0:00:31.539 ******** 2026-03-05 16:33:36.960414 | mon1 | ok: [mon1] 2026-03-05 16:33:36.960472 | mon1 | 2026-03-05 16:33:36.960483 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:33:36.960493 | mon1 | Thursday 05 March 2026 16:33:36 +0000 (0:00:00.866) 0:00:32.405 ******** 2026-03-05 16:33:38.135422 | mon1 | changed: [mon1] 2026-03-05 16:33:38.135550 | mon1 | 2026-03-05 16:33:38.136103 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:33:38.136153 | mon1 | Thursday 05 March 2026 16:33:38 +0000 (0:00:01.175) 0:00:33.580 ******** 2026-03-05 16:33:38.858433 | mon1 | changed: [mon1] 2026-03-05 16:33:38.858503 | mon1 | 2026-03-05 16:33:38.859007 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:33:38.859137 | mon1 | Thursday 05 March 2026 16:33:38 +0000 (0:00:00.722) 0:00:34.303 ******** 2026-03-05 16:33:38.916420 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:33:38.916491 | mon1 | 2026-03-05 16:33:38.916512 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:33:38.916726 | mon1 | Thursday 05 March 2026 16:33:38 +0000 (0:00:00.058) 0:00:34.361 ******** 2026-03-05 16:33:57.203195 | mon1 | changed: [mon1] 2026-03-05 16:33:57.203322 | mon1 | 2026-03-05 16:33:57.203340 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:33:57.203353 | mon1 | Thursday 05 March 2026 16:33:57 +0000 (0:00:18.286) 0:00:52.648 ******** 2026-03-05 16:33:58.023387 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 16:33:58.023448 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 16:33:58.023467 | mon1 | 2026-03-05 16:33:58.023484 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:33:58.023499 | mon1 | Thursday 05 March 2026 16:33:58 +0000 (0:00:00.819) 0:00:53.467 ******** 2026-03-05 16:33:58.429718 | mon1 | changed: [mon1] 2026-03-05 16:33:58.429792 | mon1 | 2026-03-05 16:33:58.429807 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:33:58.429829 | mon1 | Thursday 05 March 2026 16:33:58 +0000 (0:00:00.406) 0:00:53.874 ******** 2026-03-05 16:33:58.678402 | mon1 | ok: [mon1] 2026-03-05 16:33:58.678481 | mon1 | 2026-03-05 16:33:58.678502 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:33:58.678789 | mon1 | Thursday 05 March 2026 16:33:58 +0000 (0:00:00.249) 0:00:54.123 ******** 2026-03-05 16:33:59.217835 | mon1 | changed: [mon1] 2026-03-05 16:33:59.217905 | mon1 | 2026-03-05 16:33:59.218128 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:33:59.218170 | mon1 | Thursday 05 March 2026 16:33:59 +0000 (0:00:00.537) 0:00:54.660 ******** 2026-03-05 16:33:59.623925 | mon1 | changed: [mon1] 2026-03-05 16:33:59.624000 | mon1 | 2026-03-05 16:33:59.624029 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:33:59.624043 | mon1 | Thursday 05 March 2026 16:33:59 +0000 (0:00:00.407) 0:00:55.068 ******** 2026-03-05 16:33:59.753023 | mon1 | ok: [mon1] 2026-03-05 16:33:59.753083 | mon1 | 2026-03-05 16:33:59.753097 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:33:59.753110 | mon1 | Thursday 05 March 2026 16:33:59 +0000 (0:00:00.128) 0:00:55.196 ******** 2026-03-05 16:34:00.019243 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:34:00.019279 | mon1 | 2026-03-05 16:34:00.019286 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:34:00.019295 | mon1 | Thursday 05 March 2026 16:34:00 +0000 (0:00:00.266) 0:00:55.463 ******** 2026-03-05 16:34:00.068908 | mon1 | ok: [mon1] 2026-03-05 16:34:00.068960 | mon1 | 2026-03-05 16:34:00.068974 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:34:00.068987 | mon1 | Thursday 05 March 2026 16:34:00 +0000 (0:00:00.050) 0:00:55.513 ******** 2026-03-05 16:34:00.168990 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 16:34:00.169079 | mon1 | 2026-03-05 16:34:00.169090 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 16:34:00.169100 | mon1 | Thursday 05 March 2026 16:34:00 +0000 (0:00:00.099) 0:00:55.613 ******** 2026-03-05 16:34:00.481938 | mon1 | changed: [mon1] 2026-03-05 16:34:00.482015 | mon1 | 2026-03-05 16:34:00.483665 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 16:34:00.483813 | mon1 | Thursday 05 March 2026 16:34:00 +0000 (0:00:00.313) 0:00:55.926 ******** 2026-03-05 16:34:01.252563 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 16:34:01.252627 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 16:34:01.253135 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 16:34:01.253162 | mon1 | 2026-03-05 16:34:01.253167 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 16:34:01.253172 | mon1 | Thursday 05 March 2026 16:34:01 +0000 (0:00:00.771) 0:00:56.698 ******** 2026-03-05 16:36:17.052928 | mon1 | ok: [mon1] 2026-03-05 16:36:17.052987 | mon1 | 2026-03-05 16:36:17.053002 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 16:36:17.053014 | mon1 | Thursday 05 March 2026 16:36:17 +0000 (0:02:15.799) 0:03:12.497 ******** 2026-03-05 16:36:17.299840 | mon1 | changed: [mon1] 2026-03-05 16:36:17.299916 | mon1 | 2026-03-05 16:36:17.299930 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 16:36:17.299943 | mon1 | Thursday 05 March 2026 16:36:17 +0000 (0:00:00.246) 0:03:12.743 ******** 2026-03-05 16:36:17.339697 | mon1 | ok: [mon1] 2026-03-05 16:36:17.339730 | mon1 | 2026-03-05 16:36:17.339743 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:17.339755 | mon1 | Thursday 05 March 2026 16:36:17 +0000 (0:00:00.040) 0:03:12.784 ******** 2026-03-05 16:36:17.412444 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:36:17.412509 | mon1 | 2026-03-05 16:36:17.412547 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:17.412807 | mon1 | Thursday 05 March 2026 16:36:17 +0000 (0:00:00.073) 0:03:12.857 ******** 2026-03-05 16:36:23.131769 | mon1 | ok: [mon1] 2026-03-05 16:36:23.131886 | mon1 | 2026-03-05 16:36:23.132062 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:23.132277 | mon1 | Thursday 05 March 2026 16:36:23 +0000 (0:00:05.717) 0:03:18.575 ******** 2026-03-05 16:36:23.193461 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:36:23.193541 | mon1 | 2026-03-05 16:36:23.193664 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:23.193778 | mon1 | Thursday 05 March 2026 16:36:23 +0000 (0:00:00.063) 0:03:18.639 ******** 2026-03-05 16:36:23.628400 | mon1 | ok: [mon1] 2026-03-05 16:36:23.628463 | mon1 | 2026-03-05 16:36:23.628722 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:36:23.628756 | mon1 | Thursday 05 March 2026 16:36:23 +0000 (0:00:00.434) 0:03:19.074 ******** 2026-03-05 16:36:31.783170 | mon1 | ok: [mon1] 2026-03-05 16:36:31.783238 | mon1 | 2026-03-05 16:36:31.783253 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:36:31.783266 | mon1 | Thursday 05 March 2026 16:36:31 +0000 (0:00:08.152) 0:03:27.227 ******** 2026-03-05 16:36:45.041324 | mon1 | changed: [mon1] 2026-03-05 16:36:45.041370 | mon1 | 2026-03-05 16:36:45.041379 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:36:45.041388 | mon1 | Thursday 05 March 2026 16:36:45 +0000 (0:00:13.259) 0:03:40.486 ******** 2026-03-05 16:36:59.720431 | mon1 | ok: [mon1] 2026-03-05 16:36:59.720549 | mon1 | 2026-03-05 16:36:59.720605 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:36:59.720917 | mon1 | Thursday 05 March 2026 16:36:59 +0000 (0:00:14.679) 0:03:55.165 ******** 2026-03-05 16:36:59.792965 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:36:59.793022 | mon1 | 2026-03-05 16:36:59.793033 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:36:59.793043 | mon1 | Thursday 05 March 2026 16:36:59 +0000 (0:00:00.071) 0:03:55.237 ******** 2026-03-05 16:36:59.847373 | mon1 | skipping: [mon1] 2026-03-05 16:36:59.847406 | mon1 | 2026-03-05 16:36:59.847446 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:36:59.847773 | mon1 | Thursday 05 March 2026 16:36:59 +0000 (0:00:00.055) 0:03:55.292 ******** 2026-03-05 16:36:59.900057 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 16:36:59.900475 | mon1 | skipping: [mon1] 2026-03-05 16:36:59.900778 | mon1 | 2026-03-05 16:36:59.901099 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:36:59.901467 | mon1 | Thursday 05 March 2026 16:36:59 +0000 (0:00:00.052) 0:03:55.345 ******** 2026-03-05 16:37:00.220515 | mon1 | ok: [mon1] 2026-03-05 16:37:00.220957 | mon1 | 2026-03-05 16:37:00.221618 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:37:00.221644 | mon1 | Thursday 05 March 2026 16:37:00 +0000 (0:00:00.320) 0:03:55.665 ******** 2026-03-05 16:37:07.286165 | mon1 | ok: [mon1] 2026-03-05 16:37:07.286227 | mon1 | 2026-03-05 16:37:07.286241 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:37:07.286254 | mon1 | Thursday 05 March 2026 16:37:07 +0000 (0:00:07.065) 0:04:02.731 ******** 2026-03-05 16:37:20.126516 | mon1 | changed: [mon1] 2026-03-05 16:37:20.126558 | mon1 | 2026-03-05 16:37:20.126565 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:37:20.126570 | mon1 | Thursday 05 March 2026 16:37:20 +0000 (0:00:12.837) 0:04:15.568 ******** 2026-03-05 16:37:26.701394 | mon1 | ok: [mon1] 2026-03-05 16:37:26.701764 | mon1 | 2026-03-05 16:37:26.702183 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:37:26.702562 | mon1 | Thursday 05 March 2026 16:37:26 +0000 (0:00:06.577) 0:04:22.146 ******** 2026-03-05 16:37:34.716155 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:37:34.716245 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 16:37:34.716376 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 16:37:34.716475 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 16:37:34.716582 | mon1 | 2026-03-05 16:37:34.716689 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:37:34.716791 | mon1 | 2026-03-05 16:37:34.716902 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:37:34.717021 | mon1 | Thursday 05 March 2026 16:37:34 +0000 (0:00:08.015) 0:04:30.162 ******** 2026-03-05 16:37:35.934087 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:37:35.934329 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:37:35.934609 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:37:35.934849 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:37:35.935124 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:37:35.947492 | mon1 | ok: [osd1] 2026-03-05 16:37:35.947528 | mon1 | 2026-03-05 16:37:35.947535 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:35.947541 | mon1 | Thursday 05 March 2026 16:37:35 +0000 (0:00:01.228) 0:04:31.390 ******** 2026-03-05 16:37:36.202988 | mon1 | ok: [osd1] 2026-03-05 16:37:36.203017 | mon1 | 2026-03-05 16:37:36.203024 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:36.203030 | mon1 | Thursday 05 March 2026 16:37:36 +0000 (0:00:00.257) 0:04:31.647 ******** 2026-03-05 16:37:36.248000 | mon1 | skipping: [osd1] 2026-03-05 16:37:36.248036 | mon1 | 2026-03-05 16:37:36.248042 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:37:36.248058 | mon1 | Thursday 05 March 2026 16:37:36 +0000 (0:00:00.043) 0:04:31.691 ******** 2026-03-05 16:37:36.535064 | mon1 | changed: [osd1] 2026-03-05 16:37:36.535096 | mon1 | 2026-03-05 16:37:36.535101 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:36.535105 | mon1 | Thursday 05 March 2026 16:37:36 +0000 (0:00:00.289) 0:04:31.980 ******** 2026-03-05 16:37:36.601432 | mon1 | ok: [osd1] => { 2026-03-05 16:37:36.601457 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:37:36.601463 | mon1 | } 2026-03-05 16:37:36.601469 | mon1 | 2026-03-05 16:37:36.601475 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:36.601481 | mon1 | Thursday 05 March 2026 16:37:36 +0000 (0:00:00.063) 0:04:32.044 ******** 2026-03-05 16:37:37.301326 | mon1 | changed: [osd1] 2026-03-05 16:37:37.301497 | mon1 | 2026-03-05 16:37:37.301643 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:37.301783 | mon1 | Thursday 05 March 2026 16:37:37 +0000 (0:00:00.703) 0:04:32.747 ******** 2026-03-05 16:37:37.348377 | mon1 | skipping: [osd1] 2026-03-05 16:37:37.348401 | mon1 | 2026-03-05 16:37:37.348406 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:37.348410 | mon1 | Thursday 05 March 2026 16:37:37 +0000 (0:00:00.046) 0:04:32.794 ******** 2026-03-05 16:37:37.393703 | mon1 | skipping: [osd1] 2026-03-05 16:37:37.395697 | mon1 | 2026-03-05 16:37:37.395710 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:37.395715 | mon1 | Thursday 05 March 2026 16:37:37 +0000 (0:00:00.045) 0:04:32.840 ******** 2026-03-05 16:37:37.661761 | mon1 | ok: [osd1] 2026-03-05 16:37:37.664065 | mon1 | 2026-03-05 16:37:37.664079 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:37:37.664084 | mon1 | Thursday 05 March 2026 16:37:37 +0000 (0:00:00.267) 0:04:33.107 ******** 2026-03-05 16:37:38.755566 | mon1 | ok: [osd1] 2026-03-05 16:37:38.758676 | mon1 | 2026-03-05 16:37:38.758847 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:38.758994 | mon1 | Thursday 05 March 2026 16:37:38 +0000 (0:00:01.093) 0:04:34.201 ******** 2026-03-05 16:37:38.833734 | mon1 | ok: [osd1] => { 2026-03-05 16:37:38.836765 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:37:38.836967 | mon1 | } 2026-03-05 16:37:38.837150 | mon1 | 2026-03-05 16:37:38.837369 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:38.837516 | mon1 | Thursday 05 March 2026 16:37:38 +0000 (0:00:00.077) 0:04:34.279 ******** 2026-03-05 16:37:39.695150 | mon1 | changed: [osd1] 2026-03-05 16:37:39.695329 | mon1 | 2026-03-05 16:37:39.695483 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:39.695625 | mon1 | Thursday 05 March 2026 16:37:39 +0000 (0:00:00.860) 0:04:35.139 ******** 2026-03-05 16:37:42.623116 | mon1 | changed: [osd1] 2026-03-05 16:37:42.623152 | mon1 | 2026-03-05 16:37:42.623157 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:37:42.623161 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:02.926) 0:04:38.065 ******** 2026-03-05 16:37:42.656645 | mon1 | skipping: [osd1] 2026-03-05 16:37:42.656812 | mon1 | 2026-03-05 16:37:42.656959 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:37:42.657103 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:00.036) 0:04:38.102 ******** 2026-03-05 16:37:42.694196 | mon1 | skipping: [osd1] 2026-03-05 16:37:42.694419 | mon1 | 2026-03-05 16:37:42.696580 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:37:42.696595 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:00.037) 0:04:38.140 ******** 2026-03-05 16:37:42.727966 | mon1 | skipping: [osd1] 2026-03-05 16:37:42.728214 | mon1 | 2026-03-05 16:37:42.730768 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:37:42.730800 | mon1 | Thursday 05 March 2026 16:37:42 +0000 (0:00:00.033) 0:04:38.173 ******** 2026-03-05 16:37:50.787930 | mon1 | changed: [osd1] 2026-03-05 16:37:50.788102 | mon1 | 2026-03-05 16:37:50.790494 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:37:50.790653 | mon1 | Thursday 05 March 2026 16:37:50 +0000 (0:00:08.060) 0:04:46.234 ******** 2026-03-05 16:37:51.366684 | mon1 | changed: [osd1] 2026-03-05 16:37:51.366853 | mon1 | 2026-03-05 16:37:51.367007 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:37:51.367154 | mon1 | Thursday 05 March 2026 16:37:51 +0000 (0:00:00.577) 0:04:46.811 ******** 2026-03-05 16:37:52.496866 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:37:52.499220 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:37:52.499401 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:37:52.499558 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:37:52.499709 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:37:52.499840 | mon1 | 2026-03-05 16:37:52.499988 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:37:52.500157 | mon1 | Thursday 05 March 2026 16:37:52 +0000 (0:00:01.131) 0:04:47.943 ******** 2026-03-05 16:37:53.171454 | mon1 | changed: [osd1] 2026-03-05 16:37:53.171627 | mon1 | 2026-03-05 16:37:53.171777 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:37:53.171923 | mon1 | Thursday 05 March 2026 16:37:53 +0000 (0:00:00.668) 0:04:48.611 ******** 2026-03-05 16:37:53.172058 | mon1 | 2026-03-05 16:37:53.172207 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:37:53.172374 | mon1 | Thursday 05 March 2026 16:37:53 +0000 (0:00:00.006) 0:04:48.617 ******** 2026-03-05 16:37:54.060634 | mon1 | ok: [osd1] 2026-03-05 16:37:54.060667 | mon1 | 2026-03-05 16:37:54.060672 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 16:37:54.060676 | mon1 | Thursday 05 March 2026 16:37:54 +0000 (0:00:00.888) 0:04:49.506 ******** 2026-03-05 16:37:54.653072 | mon1 | changed: [osd1] 2026-03-05 16:37:54.653102 | mon1 | 2026-03-05 16:37:54.653107 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:37:54.653111 | mon1 | Thursday 05 March 2026 16:37:54 +0000 (0:00:00.590) 0:04:50.097 ******** 2026-03-05 16:37:55.390959 | mon1 | changed: [osd1] 2026-03-05 16:37:55.390991 | mon1 | 2026-03-05 16:37:55.390996 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:37:55.391001 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.737) 0:04:50.834 ******** 2026-03-05 16:37:55.642659 | mon1 | ok: [osd1] 2026-03-05 16:37:55.642827 | mon1 | 2026-03-05 16:37:55.642980 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:37:55.643126 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.252) 0:04:51.087 ******** 2026-03-05 16:37:55.703328 | mon1 | ok: [osd1] => { 2026-03-05 16:37:55.703514 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:37:55.705797 | mon1 | } 2026-03-05 16:37:55.705810 | mon1 | 2026-03-05 16:37:55.705822 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:37:55.705826 | mon1 | Thursday 05 March 2026 16:37:55 +0000 (0:00:00.062) 0:04:51.149 ******** 2026-03-05 16:37:56.942533 | mon1 | changed: [osd1] 2026-03-05 16:37:56.945256 | mon1 | 2026-03-05 16:37:56.945462 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:37:56.945614 | mon1 | Thursday 05 March 2026 16:37:56 +0000 (0:00:01.239) 0:04:52.388 ******** 2026-03-05 16:38:01.548668 | mon1 | changed: [osd1] 2026-03-05 16:38:01.551496 | mon1 | 2026-03-05 16:38:01.551657 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:38:01.551801 | mon1 | Thursday 05 March 2026 16:38:01 +0000 (0:00:04.606) 0:04:56.994 ******** 2026-03-05 16:38:02.629650 | mon1 | ok: [osd1] 2026-03-05 16:38:02.629816 | mon1 | 2026-03-05 16:38:02.629965 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:38:02.630112 | mon1 | Thursday 05 March 2026 16:38:02 +0000 (0:00:01.080) 0:04:58.075 ******** 2026-03-05 16:38:02.930662 | mon1 | changed: [osd1] 2026-03-05 16:38:02.930840 | mon1 | 2026-03-05 16:38:02.933609 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:38:02.933768 | mon1 | Thursday 05 March 2026 16:38:02 +0000 (0:00:00.301) 0:04:58.376 ******** 2026-03-05 16:38:03.525146 | mon1 | changed: [osd1] 2026-03-05 16:38:03.525184 | mon1 | 2026-03-05 16:38:03.525189 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:38:03.525193 | mon1 | Thursday 05 March 2026 16:38:03 +0000 (0:00:00.593) 0:04:58.969 ******** 2026-03-05 16:38:04.219231 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 16:38:04.219262 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:38:04.219267 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:38:04.219271 | mon1 | 2026-03-05 16:38:04.219275 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:38:04.219279 | mon1 | Thursday 05 March 2026 16:38:04 +0000 (0:00:00.692) 0:04:59.661 ******** 2026-03-05 16:38:04.787038 | mon1 | changed: [osd1] 2026-03-05 16:38:04.789731 | mon1 | 2026-03-05 16:38:04.789746 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:38:04.789752 | mon1 | Thursday 05 March 2026 16:38:04 +0000 (0:00:00.570) 0:05:00.232 ******** 2026-03-05 16:38:05.390880 | mon1 | changed: [osd1] 2026-03-05 16:38:05.391046 | mon1 | 2026-03-05 16:38:05.391207 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:38:05.391394 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.598) 0:05:00.830 ******** 2026-03-05 16:38:05.392435 | mon1 | 2026-03-05 16:38:05.392588 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 16:38:05.392729 | mon1 | Thursday 05 March 2026 16:38:05 +0000 (0:00:00.006) 0:05:00.837 ******** 2026-03-05 16:38:06.336132 | mon1 | ok: [osd1] 2026-03-05 16:38:06.339903 | mon1 | 2026-03-05 16:38:06.339929 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 16:38:06.339938 | mon1 | Thursday 05 March 2026 16:38:06 +0000 (0:00:00.944) 0:05:01.781 ******** 2026-03-05 16:38:07.445878 | mon1 | changed: [osd1] 2026-03-05 16:38:07.446001 | mon1 | 2026-03-05 16:38:07.446167 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:38:07.446361 | mon1 | Thursday 05 March 2026 16:38:07 +0000 (0:00:01.109) 0:05:02.891 ******** 2026-03-05 16:38:08.150965 | mon1 | changed: [osd1] 2026-03-05 16:38:08.151000 | mon1 | 2026-03-05 16:38:08.151007 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:38:08.151013 | mon1 | Thursday 05 March 2026 16:38:08 +0000 (0:00:00.704) 0:05:03.596 ******** 2026-03-05 16:38:08.201347 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:38:08.201701 | mon1 | 2026-03-05 16:38:08.202218 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:38:08.202233 | mon1 | Thursday 05 March 2026 16:38:08 +0000 (0:00:00.048) 0:05:03.644 ******** 2026-03-05 16:38:09.177149 | mon1 | ok: [osd1] 2026-03-05 16:38:09.177190 | mon1 | 2026-03-05 16:38:09.177198 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:38:09.177205 | mon1 | Thursday 05 March 2026 16:38:09 +0000 (0:00:00.978) 0:05:04.622 ******** 2026-03-05 16:38:10.011669 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 16:38:10.011943 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 16:38:10.012138 | mon1 | 2026-03-05 16:38:10.012596 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:38:10.012954 | mon1 | Thursday 05 March 2026 16:38:10 +0000 (0:00:00.834) 0:05:05.457 ******** 2026-03-05 16:38:10.395006 | mon1 | changed: [osd1] 2026-03-05 16:38:10.395440 | mon1 | 2026-03-05 16:38:10.395819 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:38:10.396143 | mon1 | Thursday 05 March 2026 16:38:10 +0000 (0:00:00.382) 0:05:05.840 ******** 2026-03-05 16:38:10.659877 | mon1 | ok: [osd1] 2026-03-05 16:38:10.660224 | mon1 | 2026-03-05 16:38:10.660594 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:38:10.660926 | mon1 | Thursday 05 March 2026 16:38:10 +0000 (0:00:00.265) 0:05:06.105 ******** 2026-03-05 16:38:11.057244 | mon1 | changed: [osd1] 2026-03-05 16:38:11.057673 | mon1 | 2026-03-05 16:38:11.058026 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:38:11.058404 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.397) 0:05:06.503 ******** 2026-03-05 16:38:11.333442 | mon1 | changed: [osd1] 2026-03-05 16:38:11.333792 | mon1 | 2026-03-05 16:38:11.334116 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:38:11.334483 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.276) 0:05:06.779 ******** 2026-03-05 16:38:11.610231 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 16:38:11.610270 | mon1 | 2026-03-05 16:38:11.610275 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:38:11.610281 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.275) 0:05:07.054 ******** 2026-03-05 16:38:11.663084 | mon1 | ok: [osd1] 2026-03-05 16:38:11.663127 | mon1 | 2026-03-05 16:38:11.663136 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:38:11.663143 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.053) 0:05:07.108 ******** 2026-03-05 16:38:11.721165 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 16:38:11.721203 | mon1 | 2026-03-05 16:38:11.721208 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:38:11.721214 | mon1 | Thursday 05 March 2026 16:38:11 +0000 (0:00:00.058) 0:05:07.166 ******** 2026-03-05 16:38:17.526407 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:38:17.526492 | mon1 | 2026-03-05 16:38:17.527082 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:38:17.527141 | mon1 | Thursday 05 March 2026 16:38:17 +0000 (0:00:05.804) 0:05:12.971 ******** 2026-03-05 16:38:17.578206 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 16:38:17.578271 | mon1 | 2026-03-05 16:38:17.578329 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:38:17.578351 | mon1 | Thursday 05 March 2026 16:38:17 +0000 (0:00:00.050) 0:05:13.021 ******** 2026-03-05 16:38:17.892475 | mon1 | changed: [osd1] 2026-03-05 16:38:17.892535 | mon1 | 2026-03-05 16:38:17.893006 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:38:17.893078 | mon1 | Thursday 05 March 2026 16:38:17 +0000 (0:00:00.315) 0:05:13.337 ******** 2026-03-05 16:38:29.045795 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:38:29.045876 | mon1 | 2026-03-05 16:38:29.049360 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:38:29.049397 | mon1 | Thursday 05 March 2026 16:38:29 +0000 (0:00:11.153) 0:05:24.490 ******** 2026-03-05 16:38:30.710524 | mon1 | ok: [osd1] 2026-03-05 16:38:30.710605 | mon1 | 2026-03-05 16:38:30.710620 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:38:30.710632 | mon1 | Thursday 05 March 2026 16:38:30 +0000 (0:00:01.663) 0:05:26.154 ******** 2026-03-05 16:39:14.299137 | mon1 | ok: [osd1] 2026-03-05 16:39:14.299212 | mon1 | 2026-03-05 16:39:14.299226 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:39:14.299270 | mon1 | Thursday 05 March 2026 16:39:14 +0000 (0:00:43.588) 0:06:09.742 ******** 2026-03-05 16:41:04.269462 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 16:41:04.269529 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 16:41:04.269542 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 16:41:04.269555 | mon1 | 2026-03-05 16:41:04.269568 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:41:04.269580 | mon1 | Thursday 05 March 2026 16:41:04 +0000 (0:01:49.970) 0:07:59.713 ******** 2026-03-05 16:41:10.957344 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:10.958071 | mon1 | 2026-03-05 16:41:10.958103 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:41:10.958117 | mon1 | Thursday 05 March 2026 16:41:10 +0000 (0:00:06.687) 0:08:06.400 ******** 2026-03-05 16:41:17.641514 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:17.641597 | mon1 | 2026-03-05 16:41:17.641618 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:41:17.641861 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:06.685) 0:08:13.086 ******** 2026-03-05 16:41:17.725903 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 16:41:17.725967 | mon1 | 2026-03-05 16:41:17.725989 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:41:17.726316 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:00.085) 0:08:13.171 ******** 2026-03-05 16:41:17.777175 | mon1 | ok: [osd1] 2026-03-05 16:41:17.777221 | mon1 | 2026-03-05 16:41:17.777235 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:41:17.777248 | mon1 | Thursday 05 March 2026 16:41:17 +0000 (0:00:00.050) 0:08:13.221 ******** 2026-03-05 16:41:24.563216 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:41:24.563321 | mon1 | 2026-03-05 16:41:24.563340 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:41:24.563353 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:06.786) 0:08:20.008 ******** 2026-03-05 16:41:24.608920 | mon1 | ok: [osd1] 2026-03-05 16:41:24.609053 | mon1 | 2026-03-05 16:41:24.609471 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:41:24.609753 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.045) 0:08:20.054 ******** 2026-03-05 16:41:24.649083 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:24.649535 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:24.649922 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:41:24.650258 | mon1 | skipping: [osd1] 2026-03-05 16:41:24.650704 | mon1 | 2026-03-05 16:41:24.651075 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:41:24.651380 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.040) 0:08:20.094 ******** 2026-03-05 16:41:24.684873 | mon1 | skipping: [osd1] 2026-03-05 16:41:24.685025 | mon1 | 2026-03-05 16:41:24.685331 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:41:24.685607 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 16:41:24.685952 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 16:41:24.686188 | mon1 | 2026-03-05 16:41:24.686447 | mon1 | 2026-03-05 16:41:24.686813 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:41:24.687187 | mon1 | Thursday 05 March 2026 16:41:24 +0000 (0:00:00.035) 0:08:20.130 ******** 2026-03-05 16:41:24.687466 | mon1 | =============================================================================== 2026-03-05 16:41:24.687722 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 135.80s 2026-03-05 16:41:24.688008 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 109.97s 2026-03-05 16:41:24.688260 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 43.59s 2026-03-05 16:41:24.688534 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.29s 2026-03-05 16:41:24.688779 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.68s 2026-03-05 16:41:24.689031 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.26s 2026-03-05 16:41:24.689282 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.84s 2026-03-05 16:41:24.689556 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 11.15s 2026-03-05 16:41:24.689795 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.15s 2026-03-05 16:41:24.690035 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.06s 2026-03-05 16:41:24.690281 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.02s 2026-03-05 16:41:24.690559 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.00s 2026-03-05 16:41:24.690800 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.07s 2026-03-05 16:41:24.691042 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.79s 2026-03-05 16:41:24.691305 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.69s 2026-03-05 16:41:24.691569 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.69s 2026-03-05 16:41:24.691814 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.58s 2026-03-05 16:41:24.692159 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.80s 2026-03-05 16:41:24.692501 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.72s 2026-03-05 16:41:24.692772 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.61s 2026-03-05 16:41:24.776892 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 16:41:24.788582 | mon1 | INFO [default > idempotence] Executing 2026-03-05 16:41:25.746090 | mon1 | 2026-03-05 16:41:25.746331 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 16:41:25.746601 | mon1 | 2026-03-05 16:41:25.746877 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:41:25.747610 | mon1 | Thursday 05 March 2026 16:41:25 +0000 (0:00:00.050) 0:00:00.050 ******** 2026-03-05 16:41:26.989370 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:41:26.989439 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:41:26.989455 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:41:26.989476 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:41:26.989671 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:41:27.006399 | mon1 | ok: [mon1] 2026-03-05 16:41:27.006635 | mon1 | 2026-03-05 16:41:27.006887 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:27.007131 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:01.260) 0:00:01.310 ******** 2026-03-05 16:41:27.352620 | mon1 | ok: [mon1] 2026-03-05 16:41:27.352875 | mon1 | 2026-03-05 16:41:27.353156 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:27.353493 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.346) 0:00:01.657 ******** 2026-03-05 16:41:27.397928 | mon1 | skipping: [mon1] 2026-03-05 16:41:27.398231 | mon1 | 2026-03-05 16:41:27.398592 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:41:27.398900 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.045) 0:00:01.702 ******** 2026-03-05 16:41:27.753999 | mon1 | ok: [mon1] 2026-03-05 16:41:27.754194 | mon1 | 2026-03-05 16:41:27.754521 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:27.754780 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.356) 0:00:02.058 ******** 2026-03-05 16:41:27.831958 | mon1 | ok: [mon1] => { 2026-03-05 16:41:27.832200 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:41:27.832471 | mon1 | } 2026-03-05 16:41:27.832817 | mon1 | 2026-03-05 16:41:27.833218 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:27.833511 | mon1 | Thursday 05 March 2026 16:41:27 +0000 (0:00:00.077) 0:00:02.136 ******** 2026-03-05 16:41:28.324749 | mon1 | ok: [mon1] 2026-03-05 16:41:28.324973 | mon1 | 2026-03-05 16:41:28.325341 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:28.325593 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.492) 0:00:02.629 ******** 2026-03-05 16:41:28.376742 | mon1 | skipping: [mon1] 2026-03-05 16:41:28.376965 | mon1 | 2026-03-05 16:41:28.377226 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:28.377510 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.052) 0:00:02.681 ******** 2026-03-05 16:41:28.426883 | mon1 | skipping: [mon1] 2026-03-05 16:41:28.427102 | mon1 | 2026-03-05 16:41:28.427441 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:28.427723 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.050) 0:00:02.731 ******** 2026-03-05 16:41:28.668472 | mon1 | ok: [mon1] 2026-03-05 16:41:28.668544 | mon1 | 2026-03-05 16:41:28.668560 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:41:28.668580 | mon1 | Thursday 05 March 2026 16:41:28 +0000 (0:00:00.241) 0:00:02.972 ******** 2026-03-05 16:41:29.806822 | mon1 | ok: [mon1] 2026-03-05 16:41:29.807002 | mon1 | 2026-03-05 16:41:29.807268 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:29.807692 | mon1 | Thursday 05 March 2026 16:41:29 +0000 (0:00:01.138) 0:00:04.111 ******** 2026-03-05 16:41:29.982773 | mon1 | ok: [mon1] => { 2026-03-05 16:41:29.982971 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:41:29.983200 | mon1 | } 2026-03-05 16:41:29.983472 | mon1 | 2026-03-05 16:41:29.983770 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:29.984010 | mon1 | Thursday 05 March 2026 16:41:29 +0000 (0:00:00.175) 0:00:04.287 ******** 2026-03-05 16:41:30.526129 | mon1 | ok: [mon1] 2026-03-05 16:41:30.526347 | mon1 | 2026-03-05 16:41:30.526617 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:30.526862 | mon1 | Thursday 05 March 2026 16:41:30 +0000 (0:00:00.543) 0:00:04.830 ******** 2026-03-05 16:41:32.991534 | mon1 | ok: [mon1] 2026-03-05 16:41:32.991589 | mon1 | 2026-03-05 16:41:32.991601 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:41:32.991610 | mon1 | Thursday 05 March 2026 16:41:32 +0000 (0:00:02.464) 0:00:07.295 ******** 2026-03-05 16:41:33.023473 | mon1 | skipping: [mon1] 2026-03-05 16:41:33.023538 | mon1 | 2026-03-05 16:41:33.023775 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:41:33.024022 | mon1 | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.032) 0:00:07.328 ******** 2026-03-05 16:41:33.057117 | mon1 | skipping: [mon1] 2026-03-05 16:41:33.057329 | mon1 | 2026-03-05 16:41:33.057615 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:41:33.057862 | mon1 | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.033) 0:00:07.361 ******** 2026-03-05 16:41:33.091867 | mon1 | skipping: [mon1] 2026-03-05 16:41:33.092087 | mon1 | 2026-03-05 16:41:33.092391 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:41:33.092639 | mon1 | Thursday 05 March 2026 16:41:33 +0000 (0:00:00.034) 0:00:07.396 ******** 2026-03-05 16:41:34.053041 | mon1 | ok: [mon1] 2026-03-05 16:41:34.053268 | mon1 | 2026-03-05 16:41:34.053606 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:41:34.053868 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.961) 0:00:08.357 ******** 2026-03-05 16:41:34.609114 | mon1 | ok: [mon1] 2026-03-05 16:41:34.609345 | mon1 | 2026-03-05 16:41:34.609707 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:41:34.610161 | mon1 | Thursday 05 March 2026 16:41:34 +0000 (0:00:00.556) 0:00:08.913 ******** 2026-03-05 16:41:35.734428 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:41:35.734480 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:41:35.734490 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:41:35.735638 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:41:35.735676 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:41:35.735681 | mon1 | 2026-03-05 16:41:35.735686 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:41:35.735939 | mon1 | Thursday 05 March 2026 16:41:35 +0000 (0:00:01.124) 0:00:10.038 ******** 2026-03-05 16:41:36.369733 | mon1 | ok: [mon1] 2026-03-05 16:41:36.369791 | mon1 | 2026-03-05 16:41:36.369916 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:41:36.370402 | mon1 | Thursday 05 March 2026 16:41:36 +0000 (0:00:00.627) 0:00:10.666 ******** 2026-03-05 16:41:36.370464 | mon1 | 2026-03-05 16:41:36.370476 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:41:36.370492 | mon1 | Thursday 05 March 2026 16:41:36 +0000 (0:00:00.007) 0:00:10.673 ******** 2026-03-05 16:41:37.046774 | mon1 | ok: [mon1] 2026-03-05 16:41:37.046843 | mon1 | 2026-03-05 16:41:37.047142 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:41:37.047171 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.677) 0:00:11.351 ******** 2026-03-05 16:41:37.296409 | mon1 | ok: [mon1] 2026-03-05 16:41:37.296472 | mon1 | 2026-03-05 16:41:37.296853 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:41:37.296877 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.249) 0:00:11.600 ******** 2026-03-05 16:41:37.371364 | mon1 | ok: [mon1] => { 2026-03-05 16:41:37.371400 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:41:37.371640 | mon1 | } 2026-03-05 16:41:37.371931 | mon1 | 2026-03-05 16:41:37.372251 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:41:37.372595 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.074) 0:00:11.674 ******** 2026-03-05 16:41:37.787725 | mon1 | ok: [mon1] 2026-03-05 16:41:37.787786 | mon1 | 2026-03-05 16:41:37.787901 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:41:37.788036 | mon1 | Thursday 05 March 2026 16:41:37 +0000 (0:00:00.417) 0:00:12.091 ******** 2026-03-05 16:41:41.050412 | mon1 | ok: [mon1] 2026-03-05 16:41:41.050504 | mon1 | 2026-03-05 16:41:41.050917 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:41:41.050958 | mon1 | Thursday 05 March 2026 16:41:41 +0000 (0:00:03.262) 0:00:15.354 ******** 2026-03-05 16:41:41.973736 | mon1 | ok: [mon1] 2026-03-05 16:41:41.973807 | mon1 | 2026-03-05 16:41:41.974023 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:41:41.974050 | mon1 | Thursday 05 March 2026 16:41:41 +0000 (0:00:00.923) 0:00:16.278 ******** 2026-03-05 16:41:42.314397 | mon1 | ok: [mon1] 2026-03-05 16:41:42.314452 | mon1 | 2026-03-05 16:41:42.314469 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:41:42.314747 | mon1 | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.340) 0:00:16.618 ******** 2026-03-05 16:41:42.872419 | mon1 | ok: [mon1] 2026-03-05 16:41:42.872477 | mon1 | 2026-03-05 16:41:42.873034 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:41:42.873088 | mon1 | Thursday 05 March 2026 16:41:42 +0000 (0:00:00.558) 0:00:17.176 ******** 2026-03-05 16:41:43.561237 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 16:41:43.561270 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:41:43.561275 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:41:43.561279 | mon1 | 2026-03-05 16:41:43.561672 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:41:43.561723 | mon1 | Thursday 05 March 2026 16:41:43 +0000 (0:00:00.687) 0:00:17.863 ******** 2026-03-05 16:41:44.091851 | mon1 | ok: [mon1] 2026-03-05 16:41:44.091910 | mon1 | 2026-03-05 16:41:44.091921 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:41:44.091931 | mon1 | Thursday 05 March 2026 16:41:44 +0000 (0:00:00.531) 0:00:18.395 ******** 2026-03-05 16:41:44.671443 | mon1 | ok: [mon1] 2026-03-05 16:41:44.671505 | mon1 | 2026-03-05 16:41:44.671520 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:41:44.671533 | mon1 | Thursday 05 March 2026 16:41:44 +0000 (0:00:00.571) 0:00:18.966 ******** 2026-03-05 16:41:44.671545 | mon1 | 2026-03-05 16:41:44.671602 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:41:44.671721 | mon1 | Thursday 05 March 2026 16:41:44 +0000 (0:00:00.009) 0:00:18.975 ******** 2026-03-05 16:41:45.124455 | mon1 | ok: [mon1] 2026-03-05 16:41:45.124522 | mon1 | 2026-03-05 16:41:45.125020 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:41:45.125044 | mon1 | Thursday 05 March 2026 16:41:45 +0000 (0:00:00.452) 0:00:19.428 ******** 2026-03-05 16:41:45.179020 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:41:45.179065 | mon1 | 2026-03-05 16:41:45.179077 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:41:45.179087 | mon1 | Thursday 05 March 2026 16:41:45 +0000 (0:00:00.054) 0:00:19.482 ******** 2026-03-05 16:41:46.188741 | mon1 | ok: [mon1] 2026-03-05 16:41:46.188801 | mon1 | 2026-03-05 16:41:46.188810 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:41:46.188818 | mon1 | Thursday 05 March 2026 16:41:46 +0000 (0:00:01.009) 0:00:20.492 ******** 2026-03-05 16:41:47.003437 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 16:41:47.003495 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 16:41:47.003977 | mon1 | 2026-03-05 16:41:47.004058 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:41:47.004358 | mon1 | Thursday 05 March 2026 16:41:46 +0000 (0:00:00.814) 0:00:21.307 ******** 2026-03-05 16:41:47.392449 | mon1 | ok: [mon1] 2026-03-05 16:41:47.393211 | mon1 | 2026-03-05 16:41:47.393234 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:41:47.393245 | mon1 | Thursday 05 March 2026 16:41:47 +0000 (0:00:00.389) 0:00:21.696 ******** 2026-03-05 16:41:47.639905 | mon1 | ok: [mon1] 2026-03-05 16:41:47.639960 | mon1 | 2026-03-05 16:41:47.639971 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:41:47.639981 | mon1 | Thursday 05 March 2026 16:41:47 +0000 (0:00:00.246) 0:00:21.943 ******** 2026-03-05 16:41:48.129381 | mon1 | ok: [mon1] 2026-03-05 16:41:48.129435 | mon1 | 2026-03-05 16:41:48.130085 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:41:48.130109 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.490) 0:00:22.433 ******** 2026-03-05 16:41:48.475477 | mon1 | ok: [mon1] 2026-03-05 16:41:48.475540 | mon1 | 2026-03-05 16:41:48.475567 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 16:41:48.475577 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.345) 0:00:22.779 ******** 2026-03-05 16:41:48.555760 | mon1 | ok: [mon1] 2026-03-05 16:41:48.555811 | mon1 | 2026-03-05 16:41:48.555841 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 16:41:48.555851 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.080) 0:00:22.859 ******** 2026-03-05 16:41:48.830450 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:41:48.830499 | mon1 | 2026-03-05 16:41:48.830510 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 16:41:48.830612 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.274) 0:00:23.133 ******** 2026-03-05 16:41:48.881937 | mon1 | ok: [mon1] 2026-03-05 16:41:48.881978 | mon1 | 2026-03-05 16:41:48.881983 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 16:41:48.881988 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.052) 0:00:23.185 ******** 2026-03-05 16:41:48.921727 | mon1 | skipping: [mon1] 2026-03-05 16:41:48.921799 | mon1 | 2026-03-05 16:41:48.922027 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:41:48.922053 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.040) 0:00:23.226 ******** 2026-03-05 16:41:48.997550 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:41:48.997621 | mon1 | 2026-03-05 16:41:48.997640 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:41:48.997946 | mon1 | Thursday 05 March 2026 16:41:48 +0000 (0:00:00.074) 0:00:23.300 ******** 2026-03-05 16:42:06.115538 | mon1 | ok: [mon1] 2026-03-05 16:42:06.115598 | mon1 | 2026-03-05 16:42:06.115607 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:42:06.115615 | mon1 | Thursday 05 March 2026 16:42:06 +0000 (0:00:17.118) 0:00:40.419 ******** 2026-03-05 16:42:06.177191 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 16:42:06.177217 | mon1 | 2026-03-05 16:42:06.177226 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:42:06.177233 | mon1 | Thursday 05 March 2026 16:42:06 +0000 (0:00:00.062) 0:00:40.481 ******** 2026-03-05 16:42:06.631383 | mon1 | ok: [mon1] 2026-03-05 16:42:06.631473 | mon1 | 2026-03-05 16:42:06.631489 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:42:06.631502 | mon1 | Thursday 05 March 2026 16:42:06 +0000 (0:00:00.452) 0:00:40.934 ******** 2026-03-05 16:42:20.367706 | mon1 | ok: [mon1] 2026-03-05 16:42:20.367782 | mon1 | 2026-03-05 16:42:20.368028 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 16:42:20.368084 | mon1 | Thursday 05 March 2026 16:42:20 +0000 (0:00:13.738) 0:00:54.672 ******** 2026-03-05 16:42:27.149771 | mon1 | ok: [mon1] 2026-03-05 16:42:27.149853 | mon1 | 2026-03-05 16:42:27.150091 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 16:42:27.150132 | mon1 | Thursday 05 March 2026 16:42:27 +0000 (0:00:06.782) 0:01:01.454 ******** 2026-03-05 16:42:42.042980 | mon1 | ok: [mon1] 2026-03-05 16:42:42.043043 | mon1 | 2026-03-05 16:42:42.043057 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:42:42.043070 | mon1 | Thursday 05 March 2026 16:42:42 +0000 (0:00:14.891) 0:01:16.346 ******** 2026-03-05 16:42:42.111955 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 16:42:42.112012 | mon1 | 2026-03-05 16:42:42.112026 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:42:42.112038 | mon1 | Thursday 05 March 2026 16:42:42 +0000 (0:00:00.069) 0:01:16.415 ******** 2026-03-05 16:42:42.159033 | mon1 | skipping: [mon1] 2026-03-05 16:42:42.159094 | mon1 | 2026-03-05 16:42:42.159108 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:42:42.159122 | mon1 | Thursday 05 March 2026 16:42:42 +0000 (0:00:00.046) 0:01:16.462 ******** 2026-03-05 16:42:42.210464 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 16:42:42.210513 | mon1 | skipping: [mon1] 2026-03-05 16:42:42.211124 | mon1 | 2026-03-05 16:42:42.211182 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:42:42.211197 | mon1 | Thursday 05 March 2026 16:42:42 +0000 (0:00:00.052) 0:01:16.514 ******** 2026-03-05 16:42:42.535242 | mon1 | ok: [mon1] 2026-03-05 16:42:42.535279 | mon1 | 2026-03-05 16:42:42.535285 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:42:42.535294 | mon1 | Thursday 05 March 2026 16:42:42 +0000 (0:00:00.323) 0:01:16.837 ******** 2026-03-05 16:42:49.769055 | mon1 | ok: [mon1] 2026-03-05 16:42:49.769478 | mon1 | 2026-03-05 16:42:49.769909 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 16:42:49.770403 | mon1 | Thursday 05 March 2026 16:42:49 +0000 (0:00:07.235) 0:01:24.073 ******** 2026-03-05 16:42:56.436278 | mon1 | ok: [mon1] 2026-03-05 16:42:56.436786 | mon1 | 2026-03-05 16:42:56.437180 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 16:42:56.437578 | mon1 | Thursday 05 March 2026 16:42:56 +0000 (0:00:06.666) 0:01:30.739 ******** 2026-03-05 16:43:03.045779 | mon1 | ok: [mon1] 2026-03-05 16:43:03.045861 | mon1 | 2026-03-05 16:43:03.047428 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 16:43:03.047494 | mon1 | Thursday 05 March 2026 16:43:03 +0000 (0:00:06.610) 0:01:37.349 ******** 2026-03-05 16:43:11.022854 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 16:43:11.022942 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 16:43:11.023776 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 16:43:11.023838 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 16:43:11.023845 | mon1 | 2026-03-05 16:43:11.023852 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 16:43:11.023858 | mon1 | 2026-03-05 16:43:11.023863 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:43:11.023869 | mon1 | Thursday 05 March 2026 16:43:11 +0000 (0:00:07.977) 0:01:45.327 ******** 2026-03-05 16:43:13.283403 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 16:43:13.283472 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:43:13.284167 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:43:13.284226 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:43:13.284240 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:43:13.296385 | mon1 | ok: [osd1] 2026-03-05 16:43:13.296417 | mon1 | 2026-03-05 16:43:13.296431 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:43:13.296443 | mon1 | Thursday 05 March 2026 16:43:13 +0000 (0:00:02.272) 0:01:47.599 ******** 2026-03-05 16:43:13.561340 | mon1 | ok: [osd1] 2026-03-05 16:43:13.561377 | mon1 | 2026-03-05 16:43:13.561385 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:43:13.561512 | mon1 | Thursday 05 March 2026 16:43:13 +0000 (0:00:00.265) 0:01:47.865 ******** 2026-03-05 16:43:13.603742 | mon1 | skipping: [osd1] 2026-03-05 16:43:13.604026 | mon1 | 2026-03-05 16:43:13.604289 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 16:43:13.604609 | mon1 | Thursday 05 March 2026 16:43:13 +0000 (0:00:00.043) 0:01:47.908 ******** 2026-03-05 16:43:13.866809 | mon1 | ok: [osd1] 2026-03-05 16:43:13.866989 | mon1 | 2026-03-05 16:43:13.867380 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:43:13.867737 | mon1 | Thursday 05 March 2026 16:43:13 +0000 (0:00:00.263) 0:01:48.171 ******** 2026-03-05 16:43:13.961333 | mon1 | ok: [osd1] => { 2026-03-05 16:43:13.961640 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 16:43:13.961926 | mon1 | } 2026-03-05 16:43:13.962197 | mon1 | 2026-03-05 16:43:13.962488 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:43:13.962747 | mon1 | Thursday 05 March 2026 16:43:13 +0000 (0:00:00.094) 0:01:48.265 ******** 2026-03-05 16:43:14.355378 | mon1 | ok: [osd1] 2026-03-05 16:43:14.355648 | mon1 | 2026-03-05 16:43:14.355971 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:43:14.357364 | mon1 | Thursday 05 March 2026 16:43:14 +0000 (0:00:00.394) 0:01:48.659 ******** 2026-03-05 16:43:14.400471 | mon1 | skipping: [osd1] 2026-03-05 16:43:14.400522 | mon1 | 2026-03-05 16:43:14.400633 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:43:14.400955 | mon1 | Thursday 05 March 2026 16:43:14 +0000 (0:00:00.045) 0:01:48.704 ******** 2026-03-05 16:43:14.447561 | mon1 | skipping: [osd1] 2026-03-05 16:43:14.447778 | mon1 | 2026-03-05 16:43:14.448056 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:43:14.448358 | mon1 | Thursday 05 March 2026 16:43:14 +0000 (0:00:00.047) 0:01:48.752 ******** 2026-03-05 16:43:14.696377 | mon1 | ok: [osd1] 2026-03-05 16:43:14.696417 | mon1 | 2026-03-05 16:43:14.696565 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 16:43:14.696812 | mon1 | Thursday 05 March 2026 16:43:14 +0000 (0:00:00.248) 0:01:49.000 ******** 2026-03-05 16:43:15.657779 | mon1 | ok: [osd1] 2026-03-05 16:43:15.657855 | mon1 | 2026-03-05 16:43:15.660393 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:43:15.660434 | mon1 | Thursday 05 March 2026 16:43:15 +0000 (0:00:00.961) 0:01:49.961 ******** 2026-03-05 16:43:15.848913 | mon1 | ok: [osd1] => { 2026-03-05 16:43:15.849156 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 16:43:15.849453 | mon1 | } 2026-03-05 16:43:15.849649 | mon1 | 2026-03-05 16:43:15.849981 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:43:15.850232 | mon1 | Thursday 05 March 2026 16:43:15 +0000 (0:00:00.191) 0:01:50.153 ******** 2026-03-05 16:43:16.380517 | mon1 | ok: [osd1] 2026-03-05 16:43:16.380826 | mon1 | 2026-03-05 16:43:16.381120 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:43:16.381404 | mon1 | Thursday 05 March 2026 16:43:16 +0000 (0:00:00.531) 0:01:50.684 ******** 2026-03-05 16:43:18.666467 | mon1 | ok: [osd1] 2026-03-05 16:43:18.666532 | mon1 | 2026-03-05 16:43:18.666924 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 16:43:18.666980 | mon1 | Thursday 05 March 2026 16:43:18 +0000 (0:00:02.285) 0:01:52.970 ******** 2026-03-05 16:43:18.694726 | mon1 | skipping: [osd1] 2026-03-05 16:43:18.694814 | mon1 | 2026-03-05 16:43:18.695070 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 16:43:18.695104 | mon1 | Thursday 05 March 2026 16:43:18 +0000 (0:00:00.028) 0:01:52.999 ******** 2026-03-05 16:43:18.733470 | mon1 | skipping: [osd1] 2026-03-05 16:43:18.733531 | mon1 | 2026-03-05 16:43:18.733553 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 16:43:18.733779 | mon1 | Thursday 05 March 2026 16:43:18 +0000 (0:00:00.038) 0:01:53.037 ******** 2026-03-05 16:43:18.768722 | mon1 | skipping: [osd1] 2026-03-05 16:43:18.768794 | mon1 | 2026-03-05 16:43:18.769046 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 16:43:18.769067 | mon1 | Thursday 05 March 2026 16:43:18 +0000 (0:00:00.035) 0:01:53.072 ******** 2026-03-05 16:43:19.917383 | mon1 | ok: [osd1] 2026-03-05 16:43:19.917922 | mon1 | 2026-03-05 16:43:19.917970 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 16:43:19.917979 | mon1 | Thursday 05 March 2026 16:43:19 +0000 (0:00:01.148) 0:01:54.221 ******** 2026-03-05 16:43:20.507677 | mon1 | ok: [osd1] 2026-03-05 16:43:20.508398 | mon1 | 2026-03-05 16:43:20.508511 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 16:43:20.508788 | mon1 | Thursday 05 March 2026 16:43:20 +0000 (0:00:00.589) 0:01:54.810 ******** 2026-03-05 16:43:21.686764 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 16:43:21.686808 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 16:43:21.686815 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 16:43:21.686834 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 16:43:21.686838 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 16:43:21.686842 | mon1 | 2026-03-05 16:43:21.687243 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 16:43:21.687284 | mon1 | Thursday 05 March 2026 16:43:21 +0000 (0:00:01.177) 0:01:55.988 ******** 2026-03-05 16:43:22.361686 | mon1 | ok: [osd1] 2026-03-05 16:43:22.361749 | mon1 | 2026-03-05 16:43:22.361779 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 16:43:22.361793 | mon1 | Thursday 05 March 2026 16:43:22 +0000 (0:00:00.669) 0:01:56.658 ******** 2026-03-05 16:43:22.361805 | mon1 | 2026-03-05 16:43:22.361816 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 16:43:22.361826 | mon1 | Thursday 05 March 2026 16:43:22 +0000 (0:00:00.006) 0:01:56.664 ******** 2026-03-05 16:43:22.824873 | mon1 | ok: [osd1] 2026-03-05 16:43:22.824932 | mon1 | 2026-03-05 16:43:22.824944 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 16:43:22.824953 | mon1 | Thursday 05 March 2026 16:43:22 +0000 (0:00:00.463) 0:01:57.128 ******** 2026-03-05 16:43:23.079401 | mon1 | ok: [osd1] 2026-03-05 16:43:23.079463 | mon1 | 2026-03-05 16:43:23.079936 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 16:43:23.079982 | mon1 | Thursday 05 March 2026 16:43:23 +0000 (0:00:00.255) 0:01:57.383 ******** 2026-03-05 16:43:23.159108 | mon1 | ok: [osd1] => { 2026-03-05 16:43:23.159146 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 16:43:23.159156 | mon1 | } 2026-03-05 16:43:23.159165 | mon1 | 2026-03-05 16:43:23.159174 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 16:43:23.159183 | mon1 | Thursday 05 March 2026 16:43:23 +0000 (0:00:00.079) 0:01:57.462 ******** 2026-03-05 16:43:23.600430 | mon1 | ok: [osd1] 2026-03-05 16:43:23.600484 | mon1 | 2026-03-05 16:43:23.600927 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 16:43:23.600971 | mon1 | Thursday 05 March 2026 16:43:23 +0000 (0:00:00.441) 0:01:57.904 ******** 2026-03-05 16:43:26.973426 | mon1 | ok: [osd1] 2026-03-05 16:43:26.973487 | mon1 | 2026-03-05 16:43:26.973582 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 16:43:26.973834 | mon1 | Thursday 05 March 2026 16:43:26 +0000 (0:00:03.372) 0:02:01.277 ******** 2026-03-05 16:43:28.175772 | mon1 | ok: [osd1] 2026-03-05 16:43:28.175985 | mon1 | 2026-03-05 16:43:28.176265 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 16:43:28.176582 | mon1 | Thursday 05 March 2026 16:43:28 +0000 (0:00:01.203) 0:02:02.480 ******** 2026-03-05 16:43:28.415661 | mon1 | ok: [osd1] 2026-03-05 16:43:28.415857 | mon1 | 2026-03-05 16:43:28.416121 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 16:43:28.416437 | mon1 | Thursday 05 March 2026 16:43:28 +0000 (0:00:00.239) 0:02:02.719 ******** 2026-03-05 16:43:28.995926 | mon1 | ok: [osd1] 2026-03-05 16:43:28.995982 | mon1 | 2026-03-05 16:43:28.995997 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 16:43:28.996011 | mon1 | Thursday 05 March 2026 16:43:28 +0000 (0:00:00.579) 0:02:03.299 ******** 2026-03-05 16:43:29.697481 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 16:43:29.697542 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 16:43:29.697556 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 16:43:29.697568 | mon1 | 2026-03-05 16:43:29.697587 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 16:43:29.697937 | mon1 | Thursday 05 March 2026 16:43:29 +0000 (0:00:00.701) 0:02:04.001 ******** 2026-03-05 16:43:30.241378 | mon1 | ok: [osd1] 2026-03-05 16:43:30.242137 | mon1 | 2026-03-05 16:43:30.242169 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 16:43:30.242177 | mon1 | Thursday 05 March 2026 16:43:30 +0000 (0:00:00.544) 0:02:04.545 ******** 2026-03-05 16:43:30.801419 | mon1 | ok: [osd1] 2026-03-05 16:43:30.801478 | mon1 | 2026-03-05 16:43:30.801489 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 16:43:30.801499 | mon1 | Thursday 05 March 2026 16:43:30 +0000 (0:00:00.552) 0:02:05.097 ******** 2026-03-05 16:43:30.801508 | mon1 | 2026-03-05 16:43:30.801516 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 16:43:30.801663 | mon1 | Thursday 05 March 2026 16:43:30 +0000 (0:00:00.006) 0:02:05.104 ******** 2026-03-05 16:43:31.268416 | mon1 | ok: [osd1] 2026-03-05 16:43:31.268474 | mon1 | 2026-03-05 16:43:31.268884 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 16:43:31.268930 | mon1 | Thursday 05 March 2026 16:43:31 +0000 (0:00:00.467) 0:02:05.572 ******** 2026-03-05 16:43:31.330412 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 16:43:31.330456 | mon1 | 2026-03-05 16:43:31.331026 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 16:43:31.331074 | mon1 | Thursday 05 March 2026 16:43:31 +0000 (0:00:00.062) 0:02:05.634 ******** 2026-03-05 16:43:32.554952 | mon1 | ok: [osd1] 2026-03-05 16:43:32.555025 | mon1 | 2026-03-05 16:43:32.556401 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 16:43:32.556432 | mon1 | Thursday 05 March 2026 16:43:32 +0000 (0:00:01.225) 0:02:06.859 ******** 2026-03-05 16:43:33.419137 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 16:43:33.419172 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 16:43:33.419179 | mon1 | 2026-03-05 16:43:33.419185 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 16:43:33.419191 | mon1 | Thursday 05 March 2026 16:43:33 +0000 (0:00:00.861) 0:02:07.720 ******** 2026-03-05 16:43:33.815084 | mon1 | ok: [osd1] 2026-03-05 16:43:33.815165 | mon1 | 2026-03-05 16:43:33.815606 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 16:43:33.815659 | mon1 | Thursday 05 March 2026 16:43:33 +0000 (0:00:00.399) 0:02:08.119 ******** 2026-03-05 16:43:34.065476 | mon1 | ok: [osd1] 2026-03-05 16:43:34.065588 | mon1 | 2026-03-05 16:43:34.065607 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 16:43:34.065895 | mon1 | Thursday 05 March 2026 16:43:34 +0000 (0:00:00.249) 0:02:08.369 ******** 2026-03-05 16:43:34.386484 | mon1 | ok: [osd1] 2026-03-05 16:43:34.386564 | mon1 | 2026-03-05 16:43:34.386977 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 16:43:34.387034 | mon1 | Thursday 05 March 2026 16:43:34 +0000 (0:00:00.320) 0:02:08.689 ******** 2026-03-05 16:43:34.658757 | mon1 | ok: [osd1] 2026-03-05 16:43:34.658834 | mon1 | 2026-03-05 16:43:34.661395 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 16:43:34.661444 | mon1 | Thursday 05 March 2026 16:43:34 +0000 (0:00:00.273) 0:02:08.962 ******** 2026-03-05 16:43:34.929322 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 16:43:34.929367 | mon1 | 2026-03-05 16:43:34.929376 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 16:43:34.929384 | mon1 | Thursday 05 March 2026 16:43:34 +0000 (0:00:00.270) 0:02:09.233 ******** 2026-03-05 16:43:34.983965 | mon1 | ok: [osd1] 2026-03-05 16:43:34.984022 | mon1 | 2026-03-05 16:43:34.984037 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 16:43:34.984050 | mon1 | Thursday 05 March 2026 16:43:34 +0000 (0:00:00.053) 0:02:09.286 ******** 2026-03-05 16:43:35.046441 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 16:43:35.046517 | mon1 | 2026-03-05 16:43:35.046866 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 16:43:35.046927 | mon1 | Thursday 05 March 2026 16:43:35 +0000 (0:00:00.063) 0:02:09.350 ******** 2026-03-05 16:43:42.699801 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:43:42.701356 | mon1 | 2026-03-05 16:43:42.701394 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 16:43:42.701401 | mon1 | Thursday 05 March 2026 16:43:42 +0000 (0:00:07.653) 0:02:17.003 ******** 2026-03-05 16:43:42.756414 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 16:43:42.756489 | mon1 | 2026-03-05 16:43:42.756557 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 16:43:42.756873 | mon1 | Thursday 05 March 2026 16:43:42 +0000 (0:00:00.056) 0:02:17.060 ******** 2026-03-05 16:43:43.103221 | mon1 | ok: [osd1] 2026-03-05 16:43:43.103477 | mon1 | 2026-03-05 16:43:43.103745 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 16:43:43.104000 | mon1 | Thursday 05 March 2026 16:43:43 +0000 (0:00:00.347) 0:02:17.407 ******** 2026-03-05 16:43:50.478585 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:43:50.479319 | mon1 | 2026-03-05 16:43:50.479335 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 16:43:50.479341 | mon1 | Thursday 05 March 2026 16:43:50 +0000 (0:00:07.375) 0:02:24.783 ******** 2026-03-05 16:43:56.106460 | mon1 | ok: [osd1] 2026-03-05 16:43:56.106535 | mon1 | 2026-03-05 16:43:56.106555 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 16:43:56.106901 | mon1 | Thursday 05 March 2026 16:43:56 +0000 (0:00:05.627) 0:02:30.410 ******** 2026-03-05 16:44:19.316070 | mon1 | ok: [osd1] 2026-03-05 16:44:19.316238 | mon1 | 2026-03-05 16:44:19.316593 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 16:44:19.316852 | mon1 | Thursday 05 March 2026 16:44:19 +0000 (0:00:23.210) 0:02:53.620 ******** 2026-03-05 16:44:19.382024 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 16:44:19.382320 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 16:44:19.382728 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 16:44:19.383022 | mon1 | skipping: [osd1] 2026-03-05 16:44:19.383250 | mon1 | 2026-03-05 16:44:19.383548 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 16:44:19.383787 | mon1 | Thursday 05 March 2026 16:44:19 +0000 (0:00:00.065) 0:02:53.686 ******** 2026-03-05 16:44:26.168561 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:44:26.168825 | mon1 | 2026-03-05 16:44:26.169095 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 16:44:26.169428 | mon1 | Thursday 05 March 2026 16:44:26 +0000 (0:00:06.786) 0:03:00.472 ******** 2026-03-05 16:44:32.868666 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:44:32.868827 | mon1 | 2026-03-05 16:44:32.869415 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 16:44:32.869549 | mon1 | Thursday 05 March 2026 16:44:32 +0000 (0:00:06.699) 0:03:07.172 ******** 2026-03-05 16:44:32.930168 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 16:44:32.930204 | mon1 | 2026-03-05 16:44:32.930211 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 16:44:32.930217 | mon1 | Thursday 05 March 2026 16:44:32 +0000 (0:00:00.060) 0:03:07.233 ******** 2026-03-05 16:44:32.978936 | mon1 | ok: [osd1] 2026-03-05 16:44:32.978953 | mon1 | 2026-03-05 16:44:32.978959 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 16:44:32.978964 | mon1 | Thursday 05 March 2026 16:44:32 +0000 (0:00:00.049) 0:03:07.283 ******** 2026-03-05 16:44:39.679213 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 16:44:39.679657 | mon1 | 2026-03-05 16:44:39.679745 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 16:44:39.680028 | mon1 | Thursday 05 March 2026 16:44:39 +0000 (0:00:06.699) 0:03:13.983 ******** 2026-03-05 16:44:39.729506 | mon1 | ok: [osd1] 2026-03-05 16:44:39.729579 | mon1 | 2026-03-05 16:44:39.729693 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 16:44:39.729808 | mon1 | Thursday 05 March 2026 16:44:39 +0000 (0:00:00.050) 0:03:14.034 ******** 2026-03-05 16:44:39.768365 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:44:39.768567 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:44:39.768860 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 16:44:39.769063 | mon1 | skipping: [osd1] 2026-03-05 16:44:39.769281 | mon1 | 2026-03-05 16:44:39.769607 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 16:44:39.769820 | mon1 | Thursday 05 March 2026 16:44:39 +0000 (0:00:00.038) 0:03:14.073 ******** 2026-03-05 16:44:39.798754 | mon1 | skipping: [osd1] 2026-03-05 16:44:39.799001 | mon1 | 2026-03-05 16:44:39.799444 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:44:39.799729 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 16:44:39.799987 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 16:44:39.800209 | mon1 | 2026-03-05 16:44:39.800459 | mon1 | 2026-03-05 16:44:39.800697 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:44:39.800938 | mon1 | Thursday 05 March 2026 16:44:39 +0000 (0:00:00.030) 0:03:14.103 ******** 2026-03-05 16:44:39.801160 | mon1 | =============================================================================== 2026-03-05 16:44:39.801430 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.21s 2026-03-05 16:44:39.801676 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 17.12s 2026-03-05 16:44:39.801916 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.89s 2026-03-05 16:44:39.802192 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.74s 2026-03-05 16:44:39.802429 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.98s 2026-03-05 16:44:39.802785 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.65s 2026-03-05 16:44:39.803007 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.38s 2026-03-05 16:44:39.803239 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.24s 2026-03-05 16:44:39.803465 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.79s 2026-03-05 16:44:39.803608 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.78s 2026-03-05 16:44:39.803755 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.70s 2026-03-05 16:44:39.803896 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.70s 2026-03-05 16:44:39.804042 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.67s 2026-03-05 16:44:39.804190 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.61s 2026-03-05 16:44:39.804359 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.63s 2026-03-05 16:44:39.804508 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.37s 2026-03-05 16:44:39.804656 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.26s 2026-03-05 16:44:39.804803 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.46s 2026-03-05 16:44:39.804952 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.29s 2026-03-05 16:44:39.805096 | mon1 | Gathering Facts --------------------------------------------------------- 2.27s 2026-03-05 16:44:39.882806 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 16:44:39.892998 | mon1 | INFO [default > side_effect] Executing 2026-03-05 16:44:39.893432 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:44:39.965981 | mon1 | INFO [default > verify] Executing 2026-03-05 16:44:40.722195 | mon1 | 2026-03-05 16:44:40.722365 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 16:44:40.722699 | mon1 | 2026-03-05 16:44:40.722966 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 16:44:40.723271 | mon1 | Thursday 05 March 2026 16:44:40 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 16:44:42.969142 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 16:44:42.969452 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 16:44:42.969783 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 16:44:42.970057 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 16:44:42.970322 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 16:44:42.975616 | mon1 | ok: [mon1] 2026-03-05 16:44:42.975770 | mon1 | 2026-03-05 16:44:42.976039 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 16:44:42.976276 | mon1 | Thursday 05 March 2026 16:44:42 +0000 (0:00:02.253) 0:00:02.261 ******** 2026-03-05 16:44:53.786806 | mon1 | ok: [mon1] 2026-03-05 16:44:53.786897 | mon1 | 2026-03-05 16:44:53.787249 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 16:44:53.787324 | mon1 | Thursday 05 March 2026 16:44:53 +0000 (0:00:10.809) 0:00:13.071 ******** 2026-03-05 16:44:53.824456 | mon1 | ok: [mon1] => { 2026-03-05 16:44:53.824517 | mon1 | "_ceph_health": { 2026-03-05 16:44:53.825410 | mon1 | "changed": false, 2026-03-05 16:44:53.825443 | mon1 | "cmd": [ 2026-03-05 16:44:53.825456 | mon1 | "cephadm", 2026-03-05 16:44:53.825474 | mon1 | "shell", 2026-03-05 16:44:53.825832 | mon1 | "--", 2026-03-05 16:44:53.826336 | mon1 | "ceph", 2026-03-05 16:44:53.826350 | mon1 | "health" 2026-03-05 16:44:53.826891 | mon1 | ], 2026-03-05 16:44:53.826904 | mon1 | "delta": "0:00:10.470401", 2026-03-05 16:44:53.827374 | mon1 | "end": "2026-03-05 16:44:53.740474", 2026-03-05 16:44:53.827414 | mon1 | "failed": false, 2026-03-05 16:44:53.827463 | mon1 | "msg": "", 2026-03-05 16:44:53.827961 | mon1 | "rc": 0, 2026-03-05 16:44:53.827973 | mon1 | "start": "2026-03-05 16:44:43.270073", 2026-03-05 16:44:53.828414 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 16:44:53.829032 | mon1 | "stderr_lines": [ 2026-03-05 16:44:53.829044 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 16:44:53.829280 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 16:44:53.830100 | mon1 | ], 2026-03-05 16:44:53.830112 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 16:44:53.830396 | mon1 | "stdout_lines": [ 2026-03-05 16:44:53.830437 | mon1 | "HEALTH_OK" 2026-03-05 16:44:53.831169 | mon1 | ] 2026-03-05 16:44:53.831180 | mon1 | } 2026-03-05 16:44:53.831188 | mon1 | } 2026-03-05 16:44:53.831985 | mon1 | 2026-03-05 16:44:53.832026 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 16:44:53.832046 | mon1 | Thursday 05 March 2026 16:44:53 +0000 (0:00:00.037) 0:00:13.108 ******** 2026-03-05 16:44:53.857700 | mon1 | ok: [mon1] => { 2026-03-05 16:44:53.857805 | mon1 | "changed": false, 2026-03-05 16:44:53.858388 | mon1 | "msg": "All assertions passed" 2026-03-05 16:44:53.858425 | mon1 | } 2026-03-05 16:44:53.858431 | mon1 | 2026-03-05 16:44:53.858437 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 16:44:53.858443 | mon1 | Thursday 05 March 2026 16:44:53 +0000 (0:00:00.033) 0:00:13.142 ******** 2026-03-05 16:45:02.888441 | mon1 | changed: [mon1] 2026-03-05 16:45:02.888680 | mon1 | 2026-03-05 16:45:02.889004 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 16:45:02.889243 | mon1 | Thursday 05 March 2026 16:45:02 +0000 (0:00:09.029) 0:00:22.172 ******** 2026-03-05 16:45:08.379449 | mon1 | changed: [mon1] 2026-03-05 16:45:08.379497 | mon1 | 2026-03-05 16:45:08.379506 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 16:45:08.379514 | mon1 | Thursday 05 March 2026 16:45:08 +0000 (0:00:05.492) 0:00:27.664 ******** 2026-03-05 16:45:11.314463 | mon1 | ok: [mon1] 2026-03-05 16:45:11.314545 | mon1 | 2026-03-05 16:45:11.314982 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 16:45:11.315046 | mon1 | Thursday 05 March 2026 16:45:11 +0000 (0:00:02.934) 0:00:30.599 ******** 2026-03-05 16:45:11.357416 | mon1 | ok: [mon1] => { 2026-03-05 16:45:11.357457 | mon1 | "changed": false, 2026-03-05 16:45:11.358428 | mon1 | "msg": "All assertions passed" 2026-03-05 16:45:11.358474 | mon1 | } 2026-03-05 16:45:11.358500 | mon1 | 2026-03-05 16:45:11.358516 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 16:45:11.358692 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 16:45:11.358981 | mon1 | 2026-03-05 16:45:11.359198 | mon1 | 2026-03-05 16:45:11.359464 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 16:45:11.359706 | mon1 | Thursday 05 March 2026 16:45:11 +0000 (0:00:00.043) 0:00:30.643 ******** 2026-03-05 16:45:11.359928 | mon1 | =============================================================================== 2026-03-05 16:45:11.360174 | mon1 | Get cluster health status ---------------------------------------------- 10.81s 2026-03-05 16:45:11.360507 | mon1 | Create a test Ceph pool ------------------------------------------------- 9.03s 2026-03-05 16:45:11.360770 | mon1 | Create a test Ceph key -------------------------------------------------- 5.49s 2026-03-05 16:45:11.361028 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 2.93s 2026-03-05 16:45:11.361374 | mon1 | Gathering Facts --------------------------------------------------------- 2.25s 2026-03-05 16:45:11.361646 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-05 16:45:11.361920 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-03-05 16:45:11.362134 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 16:45:11.431134 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 16:45:11.442114 | mon1 | INFO [default > cleanup] Executing 2026-03-05 16:45:11.442440 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 16:45:11.448370 | mon1 | INFO [default > destroy] Executing 2026-03-05 16:45:11.448512 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 16:45:11.448658 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 16:45:11.448973 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 16:45:11.911019 | mon1 | ok: Runtime: 0:13:05.345999 2026-03-05 16:45:11.923268 | 2026-03-05 16:45:11.923318 | PLAY RECAP 2026-03-05 16:45:11.923363 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 16:45:11.923385 | 2026-03-05 16:45:12.012946 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 16:45:12.019575 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:45:12.582993 | 2026-03-05 16:45:12.583106 | PLAY [all] 2026-03-05 16:45:12.595769 | 2026-03-05 16:45:12.595854 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 16:45:12.648682 | mon1 | ok 2026-03-05 16:45:12.655343 | osd1 | ok 2026-03-05 16:45:12.660834 | 2026-03-05 16:45:12.660909 | TASK [fetch-output : Set log path for single node] 2026-03-05 16:45:12.684012 | mon1 | skipping: Conditional result was False 2026-03-05 16:45:12.695052 | osd1 | skipping: Conditional result was False 2026-03-05 16:45:12.705778 | 2026-03-05 16:45:12.705874 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 16:45:13.053611 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/logs/mon1" 2026-03-05 16:45:13.061358 | osd1 -> localhost | changed: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/logs/osd1" 2026-03-05 16:45:13.279391 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/artifacts" 2026-03-05 16:45:13.291145 | osd1 -> localhost | ok: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/artifacts" 2026-03-05 16:45:13.490688 | mon1 -> localhost | changed: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/docs" 2026-03-05 16:45:13.515512 | osd1 -> localhost | ok: "/var/lib/zuul/builds/3f0fe44090a444e1a9405a0a2f9f2608/work/docs" 2026-03-05 16:45:13.515681 | osd1 -> localhost | changed: All items complete 2026-03-05 16:45:13.515727 | 2026-03-05 16:45:13.537949 | 2026-03-05 16:45:13.538182 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 16:45:14.168399 | mon1 | changed: .d..t...... ./ 2026-03-05 16:45:14.176873 | osd1 | changed: .d..t...... ./ 2026-03-05 16:45:14.626600 | mon1 | ok 2026-03-05 16:45:14.633909 | osd1 | changed: .d..t...... ./ 2026-03-05 16:45:15.082730 | mon1 | changed: .d..t...... ./ 2026-03-05 16:45:15.106972 | osd1 | ok 2026-03-05 16:45:15.107049 | osd1 | changed: All items complete 2026-03-05 16:45:15.107084 | 2026-03-05 16:45:15.139351 | 2026-03-05 16:45:15.139473 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 16:45:15.567053 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007573 2026-03-05 16:45:15.780121 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.004827 2026-03-05 16:45:15.800557 | 2026-03-05 16:45:15.800667 | PLAY [all] 2026-03-05 16:45:15.807552 | 2026-03-05 16:45:15.807619 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 16:45:16.291635 | mon1 | changed 2026-03-05 16:45:16.475795 | osd1 | changed 2026-03-05 16:45:16.486394 | 2026-03-05 16:45:16.486477 | PLAY RECAP 2026-03-05 16:45:16.486544 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:45:16.486585 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 16:45:16.486626 | 2026-03-05 16:45:16.589228 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 16:45:16.591780 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 16:45:17.130245 | 2026-03-05 16:45:17.130355 | PLAY [localhost] 2026-03-05 16:45:17.139836 | 2026-03-05 16:45:17.139906 | TASK [Generate Zuul manifest] 2026-03-05 16:45:17.160919 | localhost | ok 2026-03-05 16:45:17.175369 | 2026-03-05 16:45:17.175443 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 16:45:17.492538 | localhost | changed 2026-03-05 16:45:17.505775 | 2026-03-05 16:45:17.505858 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 16:45:17.535735 | localhost | ok 2026-03-05 16:45:17.546971 | 2026-03-05 16:45:17.547110 | TASK [Upload logs] 2026-03-05 16:45:17.580309 | localhost | ok 2026-03-05 16:45:17.637720 | 2026-03-05 16:45:17.637835 | TASK [Set zuul-log-path fact] 2026-03-05 16:45:17.657791 | localhost | ok 2026-03-05 16:45:17.671302 | 2026-03-05 16:45:17.671366 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 16:45:17.701458 | localhost | ok 2026-03-05 16:45:17.711152 | 2026-03-05 16:45:17.711228 | TASK [upload-logs : Create log directories] 2026-03-05 16:45:18.096247 | localhost | changed 2026-03-05 16:45:18.105757 | 2026-03-05 16:45:18.105839 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 16:45:18.491390 | localhost -> localhost | ok: Runtime: 0:00:00.005067 2026-03-05 16:45:18.497719 | 2026-03-05 16:45:18.497809 | TASK [upload-logs : Upload logs to log server] 2026-03-05 16:45:18.946514 | localhost | Output suppressed because no_log was given 2026-03-05 16:45:18.951384 | 2026-03-05 16:45:18.951552 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 16:45:18.996556 | localhost | skipping: Conditional result was False 2026-03-05 16:45:19.004270 | localhost | skipping: Conditional result was False 2026-03-05 16:45:19.015019 | 2026-03-05 16:45:19.015165 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 16:45:19.056534 | localhost | skipping: Conditional result was False 2026-03-05 16:45:19.057143 | 2026-03-05 16:45:19.060342 | localhost | skipping: Conditional result was False 2026-03-05 16:45:19.078986 | 2026-03-05 16:45:19.079172 | LOOP [upload-logs : Upload console log and json output]