2026-04-29 22:09:30.329858 | Job console starting 2026-04-29 22:09:30.356183 | Updating git repos 2026-04-29 22:09:30.393831 | Cloning repos into workspace 2026-04-29 22:09:31.244738 | Restoring repo states 2026-04-29 22:09:31.251618 | Merging changes 2026-04-29 22:09:32.001609 | Checking out repos 2026-04-29 22:09:32.316343 | Preparing playbooks 2026-04-29 22:09:34.847129 | Running Ansible setup 2026-04-29 22:09:39.704700 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-29 22:09:40.366294 | 2026-04-29 22:09:40.366462 | PLAY [localhost] 2026-04-29 22:09:40.374620 | 2026-04-29 22:09:40.374695 | TASK [Gathering Facts] 2026-04-29 22:09:41.286781 | localhost | ok 2026-04-29 22:09:41.294978 | 2026-04-29 22:09:41.295093 | TASK [Setup log path fact] 2026-04-29 22:09:41.314327 | localhost | ok 2026-04-29 22:09:41.329313 | 2026-04-29 22:09:41.329441 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-29 22:09:41.360479 | localhost | ok 2026-04-29 22:09:41.369238 | 2026-04-29 22:09:41.369321 | TASK [emit-job-header : Print job information] 2026-04-29 22:09:41.410893 | # Job Information 2026-04-29 22:09:41.411191 | Ansible Version: 2.16.18 2026-04-29 22:09:41.411287 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-04-29 22:09:41.411342 | Pipeline: check 2026-04-29 22:09:41.411387 | Executor: 2d72f0692154 2026-04-29 22:09:41.411430 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/107 2026-04-29 22:09:41.411479 | Event ID: 01d05390-4418-11f1-8ce9-b322f90cd2ce 2026-04-29 22:09:41.416409 | 2026-04-29 22:09:41.416507 | LOOP [emit-job-header : Print node information] 2026-04-29 22:09:41.527105 | localhost | ok: 2026-04-29 22:09:41.527372 | localhost | # Node Information 2026-04-29 22:09:41.527402 | localhost | Inventory Hostname: mon1 2026-04-29 22:09:41.527424 | localhost | Hostname: np0000171346 2026-04-29 22:09:41.527445 | localhost | Username: zuul 2026-04-29 22:09:41.527468 | localhost | Distro: Ubuntu 24.04 2026-04-29 22:09:41.527488 | localhost | Provider: yul1 2026-04-29 22:09:41.527508 | localhost | Region: ca-ymq-1 2026-04-29 22:09:41.527527 | localhost | Label: ubuntu-noble 2026-04-29 22:09:41.527546 | localhost | Product Name: OpenStack Nova 2026-04-29 22:09:41.527565 | localhost | Interface IP: 199.204.45.44 2026-04-29 22:09:41.586500 | localhost | ok: 2026-04-29 22:09:41.586615 | localhost | # Node Information 2026-04-29 22:09:41.586648 | localhost | Inventory Hostname: osd1 2026-04-29 22:09:41.586673 | localhost | Hostname: np0000171347 2026-04-29 22:09:41.586698 | localhost | Username: zuul 2026-04-29 22:09:41.586721 | localhost | Distro: Ubuntu 24.04 2026-04-29 22:09:41.586743 | localhost | Provider: yul1 2026-04-29 22:09:41.586765 | localhost | Region: ca-ymq-1 2026-04-29 22:09:41.586787 | localhost | Label: ubuntu-noble 2026-04-29 22:09:41.586808 | localhost | Product Name: OpenStack Nova 2026-04-29 22:09:41.586833 | localhost | Interface IP: 199.204.45.169 2026-04-29 22:09:41.596878 | 2026-04-29 22:09:41.597064 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-29 22:09:41.959291 | localhost -> localhost | changed 2026-04-29 22:09:41.968693 | 2026-04-29 22:09:41.968991 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-29 22:09:42.842312 | localhost -> localhost | changed 2026-04-29 22:09:42.854101 | 2026-04-29 22:09:42.854245 | PLAY [all] 2026-04-29 22:09:42.866373 | 2026-04-29 22:09:42.866492 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-29 22:09:43.121902 | mon1 -> localhost | ok 2026-04-29 22:09:43.135341 | 2026-04-29 22:09:43.135457 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-29 22:09:43.175251 | mon1 | ok 2026-04-29 22:09:43.183372 | osd1 | ok 2026-04-29 22:09:43.215879 | mon1 | included: /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-29 22:09:43.216112 | osd1 | included: /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-29 22:09:43.230610 | 2026-04-29 22:09:43.230699 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-29 22:09:45.340012 | mon1 -> localhost | Generating public/private rsa key pair. 2026-04-29 22:09:45.340243 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/80e49f13f0894ad9b8a9a5e2775c505b_id_rsa 2026-04-29 22:09:45.340288 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/80e49f13f0894ad9b8a9a5e2775c505b_id_rsa.pub 2026-04-29 22:09:45.340324 | mon1 -> localhost | The key fingerprint is: 2026-04-29 22:09:45.340358 | mon1 -> localhost | SHA256:VCvpdsS0Ok6sZPfJCYp+yVrFl88+cqnRC7G/iK+1uXU zuul-build-sshkey 2026-04-29 22:09:45.340390 | mon1 -> localhost | The key's randomart image is: 2026-04-29 22:09:45.340420 | mon1 -> localhost | +---[RSA 3072]----+ 2026-04-29 22:09:45.340450 | mon1 -> localhost | | o | 2026-04-29 22:09:45.340480 | mon1 -> localhost | | = o | 2026-04-29 22:09:45.340511 | mon1 -> localhost | | + = | 2026-04-29 22:09:45.340541 | mon1 -> localhost | | = + . | 2026-04-29 22:09:45.340570 | mon1 -> localhost | | o S = | 2026-04-29 22:09:45.340600 | mon1 -> localhost | | + O B O | 2026-04-29 22:09:45.340629 | mon1 -> localhost | | ..+.. X =.E | 2026-04-29 22:09:45.340657 | mon1 -> localhost | | . .+ o.X+o | 2026-04-29 22:09:45.340686 | mon1 -> localhost | | oo ooB==o | 2026-04-29 22:09:45.340714 | mon1 -> localhost | +----[SHA256]-----+ 2026-04-29 22:09:45.340799 | mon1 -> localhost | ok: Runtime: 0:00:01.402541 2026-04-29 22:09:45.348833 | 2026-04-29 22:09:45.349033 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-29 22:09:45.374050 | mon1 | ok 2026-04-29 22:09:45.391389 | osd1 | ok 2026-04-29 22:09:45.408888 | mon1 | included: /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-29 22:09:45.409070 | osd1 | included: /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-29 22:09:45.423150 | 2026-04-29 22:09:45.423276 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-29 22:09:45.441941 | mon1 | skipping: Conditional result was False 2026-04-29 22:09:45.463192 | osd1 | skipping: Conditional result was False 2026-04-29 22:09:45.475369 | 2026-04-29 22:09:45.475481 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-29 22:09:46.042939 | mon1 | changed 2026-04-29 22:09:46.073660 | osd1 | changed 2026-04-29 22:09:46.082683 | 2026-04-29 22:09:46.082885 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-29 22:09:46.307620 | osd1 | ok 2026-04-29 22:09:46.437076 | mon1 | ok 2026-04-29 22:09:46.444561 | 2026-04-29 22:09:46.444656 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-29 22:09:47.129060 | mon1 | changed 2026-04-29 22:09:47.134193 | osd1 | changed 2026-04-29 22:09:47.141725 | 2026-04-29 22:09:47.141812 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-29 22:09:47.731380 | mon1 | changed 2026-04-29 22:09:47.771931 | osd1 | changed 2026-04-29 22:09:47.779867 | 2026-04-29 22:09:47.779970 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-29 22:09:47.807571 | mon1 | skipping: Conditional result was False 2026-04-29 22:09:47.819052 | osd1 | skipping: Conditional result was False 2026-04-29 22:09:47.830438 | 2026-04-29 22:09:47.830532 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-29 22:09:48.160502 | mon1 -> localhost | changed 2026-04-29 22:09:48.181851 | 2026-04-29 22:09:48.181991 | TASK [add-build-sshkey : Add back temp key] 2026-04-29 22:09:48.474791 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/80e49f13f0894ad9b8a9a5e2775c505b_id_rsa (zuul-build-sshkey) 2026-04-29 22:09:48.475044 | mon1 -> localhost | ok: Runtime: 0:00:00.015754 2026-04-29 22:09:48.483893 | 2026-04-29 22:09:48.484094 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-29 22:09:48.786300 | osd1 | ok 2026-04-29 22:09:48.795139 | mon1 | ok 2026-04-29 22:09:48.801034 | 2026-04-29 22:09:48.801114 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-29 22:09:48.833208 | mon1 | skipping: Conditional result was False 2026-04-29 22:09:48.845330 | osd1 | skipping: Conditional result was False 2026-04-29 22:09:48.870894 | 2026-04-29 22:09:48.871049 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-29 22:09:49.209949 | osd1 | ok 2026-04-29 22:09:49.215512 | mon1 | ok 2026-04-29 22:09:49.221588 | 2026-04-29 22:09:49.221654 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-29 22:09:50.044482 | osd1 | Output suppressed because no_log was given 2026-04-29 22:09:50.053856 | mon1 | Output suppressed because no_log was given 2026-04-29 22:09:50.069703 | 2026-04-29 22:09:50.069842 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-29 22:09:50.320896 | mon1 | ok: "logs" 2026-04-29 22:09:50.321140 | mon1 | ok: All items complete 2026-04-29 22:09:50.321169 | 2026-04-29 22:09:50.327572 | osd1 | ok: "logs" 2026-04-29 22:09:50.530063 | osd1 | ok: "artifacts" 2026-04-29 22:09:50.537882 | mon1 | ok: "artifacts" 2026-04-29 22:09:50.744019 | mon1 | ok: "docs" 2026-04-29 22:09:51.323008 | osd1 | ok: "docs" 2026-04-29 22:09:51.338403 | 2026-04-29 22:09:51.338531 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-29 22:09:51.608639 | mon1 | changed: "logs" 2026-04-29 22:09:51.608913 | mon1 | ok: All items complete 2026-04-29 22:09:51.608980 | 2026-04-29 22:09:51.614427 | osd1 | changed: "logs" 2026-04-29 22:09:51.817040 | osd1 | changed: "artifacts" 2026-04-29 22:09:51.844294 | mon1 | changed: "artifacts" 2026-04-29 22:09:52.014536 | osd1 | changed: "docs" 2026-04-29 22:09:52.046768 | mon1 | changed: "docs" 2026-04-29 22:09:52.069862 | 2026-04-29 22:09:52.070005 | PLAY RECAP 2026-04-29 22:09:52.070075 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-29 22:09:52.070123 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-29 22:09:52.070167 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-29 22:09:52.070203 | 2026-04-29 22:09:52.232261 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-29 22:09:52.238232 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-29 22:09:52.882499 | 2026-04-29 22:09:52.882761 | PLAY [all] 2026-04-29 22:09:52.897640 | 2026-04-29 22:09:52.897796 | TASK [setup-uv : Extract archive] 2026-04-29 22:09:55.376073 | mon1 | changed 2026-04-29 22:09:55.417885 | osd1 | changed 2026-04-29 22:09:55.423974 | 2026-04-29 22:09:55.424073 | TASK [setup-uv : Print version] 2026-04-29 22:09:55.166118 | osd1 | uv 0.8.13 2026-04-29 22:09:55.533786 | mon1 | uv 0.8.13 2026-04-29 22:09:55.994255 | mon1 | ok: Runtime: 0:00:00.014918 2026-04-29 22:09:56.004659 | osd1 | ok: Runtime: 0:00:00.018803 2026-04-29 22:09:56.016593 | 2026-04-29 22:09:56.016709 | PLAY RECAP 2026-04-29 22:09:56.016773 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-29 22:09:56.016805 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-29 22:09:56.016826 | 2026-04-29 22:09:56.173967 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-29 22:09:56.177096 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-29 22:09:56.772649 | 2026-04-29 22:09:56.772780 | PLAY [all] 2026-04-29 22:09:56.785219 | 2026-04-29 22:09:56.785308 | TASK [Copy inventory file for Zuul] 2026-04-29 22:09:57.783660 | mon1 | changed 2026-04-29 22:09:57.792538 | 2026-04-29 22:09:57.792652 | TASK [Switch "ansible_host" to private IP] 2026-04-29 22:09:58.182392 | mon1 | changed: 2 replacements made 2026-04-29 22:09:58.190587 | 2026-04-29 22:09:58.190677 | TASK [Run Molecule scenario] 2026-04-29 22:09:58.392034 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-04-29 22:09:58.392186 | mon1 | Creating virtual environment at: .venv 2026-04-29 22:09:58.763504 | mon1 | Downloading netaddr (2.2MiB) 2026-04-29 22:09:58.778770 | mon1 | Downloading ansible-core (2.1MiB) 2026-04-29 22:09:58.780150 | mon1 | Downloading pygments (1.2MiB) 2026-04-29 22:09:58.782473 | mon1 | Downloading cryptography (4.3MiB) 2026-04-29 22:09:58.985055 | mon1 | Downloading netaddr 2026-04-29 22:09:58.998153 | mon1 | Downloading cryptography 2026-04-29 22:09:59.061864 | mon1 | Downloading pygments 2026-04-29 22:09:59.230271 | mon1 | Downloading ansible-core 2026-04-29 22:09:59.289413 | mon1 | Installed 37 packages in 58ms 2026-04-29 22:10:00.121200 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-04-29 22:10:00.121461 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-04-29 22:10:00.812011 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-29 22:10:00.812102 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-04-29 22:10:17.604034 | mon1 | INFO [default > dependency] Executing 2026-04-29 22:10:17.604301 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-04-29 22:10:17.604573 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-04-29 22:10:17.604742 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-29 22:10:17.612021 | mon1 | INFO [default > cleanup] Executing 2026-04-29 22:10:17.612352 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-29 22:10:17.617965 | mon1 | INFO [default > destroy] Executing 2026-04-29 22:10:17.618001 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-29 22:10:17.618100 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-29 22:10:17.623668 | mon1 | INFO [default > syntax] Executing 2026-04-29 22:10:18.800215 | mon1 | 2026-04-29 22:10:18.800551 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-29 22:10:18.861113 | mon1 | INFO [default > syntax] Executed: Successful 2026-04-29 22:10:18.873716 | mon1 | INFO [default > create] Executing 2026-04-29 22:10:18.875760 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-29 22:10:18.883399 | mon1 | INFO [default > prepare] Executing 2026-04-29 22:10:19.776309 | mon1 | 2026-04-29 22:10:19.776525 | mon1 | PLAY [Prepare] ***************************************************************** 2026-04-29 22:10:19.776783 | mon1 | 2026-04-29 22:10:19.777036 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:10:19.777325 | mon1 | Wednesday 29 April 2026 22:10:19 +0000 (0:00:00.036) 0:00:00.036 ******* 2026-04-29 22:10:21.077473 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-29 22:10:21.077723 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:10:21.078042 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:10:21.078374 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:10:21.078669 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:10:21.099689 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-29 22:10:21.099936 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:10:21.100261 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:10:21.100573 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:10:21.100846 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:10:21.106854 | mon1 | ok: [osd1] 2026-04-29 22:10:21.107094 | mon1 | ok: [mon1] 2026-04-29 22:10:21.107372 | mon1 | 2026-04-29 22:10:21.107781 | mon1 | TASK [Configure short hostname] ************************************************ 2026-04-29 22:10:21.108043 | mon1 | Wednesday 29 April 2026 22:10:21 +0000 (0:00:01.331) 0:00:01.368 ******* 2026-04-29 22:10:21.943803 | mon1 | changed: [mon1] 2026-04-29 22:10:21.943962 | mon1 | changed: [osd1] 2026-04-29 22:10:21.944186 | mon1 | 2026-04-29 22:10:21.944528 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-29 22:10:21.944880 | mon1 | Wednesday 29 April 2026 22:10:21 +0000 (0:00:00.836) 0:00:02.204 ******* 2026-04-29 22:10:22.266006 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-29 22:10:22.267317 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-04-29 22:10:22.267377 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-29 22:10:22.276451 | mon1 | changed: [osd1] 2026-04-29 22:10:22.276535 | mon1 | changed: [mon1] 2026-04-29 22:10:22.276553 | mon1 | 2026-04-29 22:10:22.276766 | mon1 | TASK [Update apt cache] ******************************************************** 2026-04-29 22:10:22.277009 | mon1 | Wednesday 29 April 2026 22:10:22 +0000 (0:00:00.332) 0:00:02.537 ******* 2026-04-29 22:10:28.972943 | mon1 | changed: [osd1] 2026-04-29 22:10:28.973177 | mon1 | changed: [mon1] 2026-04-29 22:10:28.973515 | mon1 | 2026-04-29 22:10:28.973782 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-04-29 22:10:28.974016 | mon1 | 2026-04-29 22:10:28.974436 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:10:28.974673 | mon1 | Wednesday 29 April 2026 22:10:28 +0000 (0:00:06.696) 0:00:09.233 ******* 2026-04-29 22:10:30.793195 | mon1 | ok: [osd1] 2026-04-29 22:10:30.793431 | mon1 | 2026-04-29 22:10:30.793684 | mon1 | TASK [Install depedencies] ***************************************************** 2026-04-29 22:10:30.793950 | mon1 | Wednesday 29 April 2026 22:10:30 +0000 (0:00:01.820) 0:00:11.054 ******* 2026-04-29 22:10:53.091497 | mon1 | changed: [osd1] 2026-04-29 22:10:53.091665 | mon1 | 2026-04-29 22:10:53.091937 | mon1 | TASK [Start up service] ******************************************************** 2026-04-29 22:10:53.092191 | mon1 | Wednesday 29 April 2026 22:10:53 +0000 (0:00:22.295) 0:00:33.349 ******* 2026-04-29 22:10:53.748946 | mon1 | ok: [osd1] 2026-04-29 22:10:53.749045 | mon1 | 2026-04-29 22:10:53.749062 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-04-29 22:10:53.749208 | mon1 | Wednesday 29 April 2026 22:10:53 +0000 (0:00:00.660) 0:00:34.009 ******* 2026-04-29 22:10:54.100796 | mon1 | ok: [osd1] 2026-04-29 22:10:54.100958 | mon1 | 2026-04-29 22:10:54.101250 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-29 22:10:54.101571 | mon1 | Wednesday 29 April 2026 22:10:54 +0000 (0:00:00.351) 0:00:34.361 ******* 2026-04-29 22:10:54.920755 | mon1 | changed: [osd1] 2026-04-29 22:10:54.920853 | mon1 | 2026-04-29 22:10:54.921128 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-04-29 22:10:54.921349 | mon1 | Wednesday 29 April 2026 22:10:54 +0000 (0:00:00.819) 0:00:35.181 ******* 2026-04-29 22:10:55.177701 | mon1 | ok: [osd1] 2026-04-29 22:10:55.177884 | mon1 | 2026-04-29 22:10:55.178137 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-29 22:10:55.178453 | mon1 | Wednesday 29 April 2026 22:10:55 +0000 (0:00:00.256) 0:00:35.438 ******* 2026-04-29 22:10:55.204947 | mon1 | skipping: [osd1] 2026-04-29 22:10:55.205154 | mon1 | 2026-04-29 22:10:55.205449 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-04-29 22:10:55.205696 | mon1 | Wednesday 29 April 2026 22:10:55 +0000 (0:00:00.027) 0:00:35.466 ******* 2026-04-29 22:10:55.954815 | mon1 | changed: [osd1] => (item=osd0) 2026-04-29 22:10:55.955013 | mon1 | changed: [osd1] => (item=osd1) 2026-04-29 22:10:55.955287 | mon1 | changed: [osd1] => (item=osd2) 2026-04-29 22:10:55.955555 | mon1 | 2026-04-29 22:10:55.955800 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-04-29 22:10:55.956109 | mon1 | Wednesday 29 April 2026 22:10:55 +0000 (0:00:00.749) 0:00:36.215 ******* 2026-04-29 22:10:56.756059 | mon1 | changed: [osd1] => (item=osd0) 2026-04-29 22:10:56.756267 | mon1 | changed: [osd1] => (item=osd1) 2026-04-29 22:10:56.756538 | mon1 | changed: [osd1] => (item=osd2) 2026-04-29 22:10:56.756758 | mon1 | 2026-04-29 22:10:56.757046 | mon1 | TASK [Start loop devices] ****************************************************** 2026-04-29 22:10:56.757341 | mon1 | Wednesday 29 April 2026 22:10:56 +0000 (0:00:00.801) 0:00:37.016 ******* 2026-04-29 22:10:57.669008 | mon1 | changed: [osd1] => (item=osd0) 2026-04-29 22:10:57.669149 | mon1 | changed: [osd1] => (item=osd1) 2026-04-29 22:10:57.669446 | mon1 | changed: [osd1] => (item=osd2) 2026-04-29 22:10:57.669597 | mon1 | 2026-04-29 22:10:57.669794 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-04-29 22:10:57.670082 | mon1 | Wednesday 29 April 2026 22:10:57 +0000 (0:00:00.913) 0:00:37.929 ******* 2026-04-29 22:10:59.137101 | mon1 | changed: [osd1] => (item=osd0) 2026-04-29 22:10:59.137193 | mon1 | changed: [osd1] => (item=osd1) 2026-04-29 22:10:59.137200 | mon1 | changed: [osd1] => (item=osd2) 2026-04-29 22:10:59.137315 | mon1 | 2026-04-29 22:10:59.137436 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-04-29 22:10:59.137551 | mon1 | Wednesday 29 April 2026 22:10:59 +0000 (0:00:01.468) 0:00:39.397 ******* 2026-04-29 22:11:00.581451 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-04-29 22:11:00.581540 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-04-29 22:11:00.581689 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-04-29 22:11:00.581830 | mon1 | 2026-04-29 22:11:00.582007 | mon1 | PLAY RECAP ********************************************************************* 2026-04-29 22:11:00.582212 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-29 22:11:00.582395 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-29 22:11:00.582584 | mon1 | 2026-04-29 22:11:00.582732 | mon1 | 2026-04-29 22:11:00.586331 | mon1 | TASKS RECAP ******************************************************************** 2026-04-29 22:11:00.586395 | mon1 | Wednesday 29 April 2026 22:11:00 +0000 (0:00:01.444) 0:00:40.842 ******* 2026-04-29 22:11:00.586403 | mon1 | =============================================================================== 2026-04-29 22:11:00.586408 | mon1 | Install depedencies ---------------------------------------------------- 22.30s 2026-04-29 22:11:00.586413 | mon1 | Update apt cache -------------------------------------------------------- 6.70s 2026-04-29 22:11:00.586418 | mon1 | Gathering Facts --------------------------------------------------------- 1.82s 2026-04-29 22:11:00.586423 | mon1 | Create a volume group for each loop device ------------------------------ 1.47s 2026-04-29 22:11:00.586428 | mon1 | Create a logical volume for each loop device ---------------------------- 1.44s 2026-04-29 22:11:00.586433 | mon1 | Gathering Facts --------------------------------------------------------- 1.33s 2026-04-29 22:11:00.586438 | mon1 | Start loop devices ------------------------------------------------------ 0.91s 2026-04-29 22:11:00.586443 | mon1 | Configure short hostname ------------------------------------------------ 0.84s 2026-04-29 22:11:00.586448 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.82s 2026-04-29 22:11:00.586452 | mon1 | Set permissions on loopback devices ------------------------------------- 0.80s 2026-04-29 22:11:00.586458 | mon1 | Create devices for Ceph ------------------------------------------------- 0.75s 2026-04-29 22:11:00.586462 | mon1 | Start up service -------------------------------------------------------- 0.66s 2026-04-29 22:11:00.586467 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s 2026-04-29 22:11:00.586472 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s 2026-04-29 22:11:00.586477 | mon1 | Get list of all loopback devices ---------------------------------------- 0.26s 2026-04-29 22:11:00.586481 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-04-29 22:11:00.683615 | mon1 | INFO [default > prepare] Executed: Successful 2026-04-29 22:11:00.694574 | mon1 | INFO [default > converge] Executing 2026-04-29 22:11:01.716464 | mon1 | 2026-04-29 22:11:01.716515 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-29 22:11:01.716526 | mon1 | 2026-04-29 22:11:01.716686 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:11:01.716932 | mon1 | Wednesday 29 April 2026 22:11:01 +0000 (0:00:00.053) 0:00:00.053 ******* 2026-04-29 22:11:03.786354 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-29 22:11:03.786711 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:11:03.787060 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:11:03.787392 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:11:03.787705 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:11:03.798588 | mon1 | ok: [mon1] 2026-04-29 22:11:03.798711 | mon1 | 2026-04-29 22:11:03.798865 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:11:03.799023 | mon1 | Wednesday 29 April 2026 22:11:03 +0000 (0:00:02.082) 0:00:02.136 ******* 2026-04-29 22:11:04.145060 | mon1 | ok: [mon1] 2026-04-29 22:11:04.152622 | mon1 | 2026-04-29 22:11:04.152649 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:11:04.152661 | mon1 | Wednesday 29 April 2026 22:11:04 +0000 (0:00:00.346) 0:00:02.482 ******* 2026-04-29 22:11:04.185838 | mon1 | skipping: [mon1] 2026-04-29 22:11:04.186043 | mon1 | 2026-04-29 22:11:04.186328 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-29 22:11:04.186574 | mon1 | Wednesday 29 April 2026 22:11:04 +0000 (0:00:00.041) 0:00:02.523 ******* 2026-04-29 22:11:04.546701 | mon1 | changed: [mon1] 2026-04-29 22:11:04.546877 | mon1 | 2026-04-29 22:11:04.547151 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:11:04.547452 | mon1 | Wednesday 29 April 2026 22:11:04 +0000 (0:00:00.360) 0:00:02.884 ******* 2026-04-29 22:11:04.653742 | mon1 | ok: [mon1] => { 2026-04-29 22:11:04.653992 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-29 22:11:04.654460 | mon1 | } 2026-04-29 22:11:04.654808 | mon1 | 2026-04-29 22:11:04.655190 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:11:04.655669 | mon1 | Wednesday 29 April 2026 22:11:04 +0000 (0:00:00.106) 0:00:02.990 ******* 2026-04-29 22:11:05.448442 | mon1 | changed: [mon1] 2026-04-29 22:11:05.448519 | mon1 | 2026-04-29 22:11:05.448531 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:11:05.448540 | mon1 | Wednesday 29 April 2026 22:11:05 +0000 (0:00:00.794) 0:00:03.784 ******* 2026-04-29 22:11:05.502149 | mon1 | skipping: [mon1] 2026-04-29 22:11:05.502224 | mon1 | 2026-04-29 22:11:05.502271 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:11:05.502281 | mon1 | Wednesday 29 April 2026 22:11:05 +0000 (0:00:00.053) 0:00:03.838 ******* 2026-04-29 22:11:05.558036 | mon1 | skipping: [mon1] 2026-04-29 22:11:05.558101 | mon1 | 2026-04-29 22:11:05.558111 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:11:05.558121 | mon1 | Wednesday 29 April 2026 22:11:05 +0000 (0:00:00.055) 0:00:03.893 ******* 2026-04-29 22:11:05.809991 | mon1 | ok: [mon1] 2026-04-29 22:11:05.810051 | mon1 | 2026-04-29 22:11:05.810062 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:11:05.810071 | mon1 | Wednesday 29 April 2026 22:11:05 +0000 (0:00:00.252) 0:00:04.145 ******* 2026-04-29 22:11:06.976770 | mon1 | ok: [mon1] 2026-04-29 22:11:06.976866 | mon1 | 2026-04-29 22:11:06.976881 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:11:06.977030 | mon1 | Wednesday 29 April 2026 22:11:06 +0000 (0:00:01.167) 0:00:05.313 ******* 2026-04-29 22:11:07.179529 | mon1 | ok: [mon1] => { 2026-04-29 22:11:07.179602 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-29 22:11:07.179636 | mon1 | } 2026-04-29 22:11:07.179647 | mon1 | 2026-04-29 22:11:07.179656 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:11:07.179666 | mon1 | Wednesday 29 April 2026 22:11:07 +0000 (0:00:00.201) 0:00:05.515 ******* 2026-04-29 22:11:08.227336 | mon1 | changed: [mon1] 2026-04-29 22:11:08.227566 | mon1 | 2026-04-29 22:11:08.227917 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:11:08.228327 | mon1 | Wednesday 29 April 2026 22:11:08 +0000 (0:00:01.047) 0:00:06.562 ******* 2026-04-29 22:11:11.547477 | mon1 | changed: [mon1] 2026-04-29 22:11:11.547561 | mon1 | 2026-04-29 22:11:11.547587 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-29 22:11:11.547708 | mon1 | Wednesday 29 April 2026 22:11:11 +0000 (0:00:03.321) 0:00:09.884 ******* 2026-04-29 22:11:11.586353 | mon1 | skipping: [mon1] 2026-04-29 22:11:11.586562 | mon1 | 2026-04-29 22:11:11.586833 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-29 22:11:11.587093 | mon1 | Wednesday 29 April 2026 22:11:11 +0000 (0:00:00.039) 0:00:09.923 ******* 2026-04-29 22:11:11.624863 | mon1 | skipping: [mon1] 2026-04-29 22:11:11.625047 | mon1 | 2026-04-29 22:11:11.625358 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-29 22:11:11.625633 | mon1 | Wednesday 29 April 2026 22:11:11 +0000 (0:00:00.038) 0:00:09.962 ******* 2026-04-29 22:11:11.666109 | mon1 | skipping: [mon1] 2026-04-29 22:11:11.666341 | mon1 | 2026-04-29 22:11:11.666627 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-29 22:11:11.666879 | mon1 | Wednesday 29 April 2026 22:11:11 +0000 (0:00:00.041) 0:00:10.003 ******* 2026-04-29 22:11:19.694448 | mon1 | changed: [mon1] 2026-04-29 22:11:19.694531 | mon1 | 2026-04-29 22:11:19.694541 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-29 22:11:19.694646 | mon1 | Wednesday 29 April 2026 22:11:19 +0000 (0:00:08.028) 0:00:18.031 ******* 2026-04-29 22:11:20.385128 | mon1 | changed: [mon1] 2026-04-29 22:11:20.385177 | mon1 | 2026-04-29 22:11:20.385183 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-29 22:11:20.385190 | mon1 | Wednesday 29 April 2026 22:11:20 +0000 (0:00:00.690) 0:00:18.722 ******* 2026-04-29 22:11:21.574956 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-29 22:11:21.575045 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-29 22:11:21.575060 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-29 22:11:21.575071 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-29 22:11:21.575083 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-29 22:11:21.575095 | mon1 | 2026-04-29 22:11:21.575107 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-29 22:11:21.575119 | mon1 | Wednesday 29 April 2026 22:11:21 +0000 (0:00:01.188) 0:00:19.910 ******* 2026-04-29 22:11:22.346601 | mon1 | changed: [mon1] 2026-04-29 22:11:22.346691 | mon1 | 2026-04-29 22:11:22.346705 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-29 22:11:22.346718 | mon1 | Wednesday 29 April 2026 22:11:22 +0000 (0:00:00.764) 0:00:20.674 ******* 2026-04-29 22:11:22.346729 | mon1 | 2026-04-29 22:11:22.346741 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-29 22:11:22.346753 | mon1 | Wednesday 29 April 2026 22:11:22 +0000 (0:00:00.007) 0:00:20.681 ******* 2026-04-29 22:11:23.538871 | mon1 | ok: [mon1] 2026-04-29 22:11:23.538948 | mon1 | 2026-04-29 22:11:23.538961 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-29 22:11:23.538972 | mon1 | Wednesday 29 April 2026 22:11:23 +0000 (0:00:01.193) 0:00:21.875 ******* 2026-04-29 22:11:24.164292 | mon1 | changed: [mon1] 2026-04-29 22:11:24.164366 | mon1 | 2026-04-29 22:11:24.164371 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-29 22:11:24.164520 | mon1 | Wednesday 29 April 2026 22:11:24 +0000 (0:00:00.624) 0:00:22.499 ******* 2026-04-29 22:11:24.861365 | mon1 | changed: [mon1] 2026-04-29 22:11:24.861457 | mon1 | 2026-04-29 22:11:24.861468 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:11:24.861484 | mon1 | Wednesday 29 April 2026 22:11:24 +0000 (0:00:00.698) 0:00:23.198 ******* 2026-04-29 22:11:25.112576 | mon1 | ok: [mon1] 2026-04-29 22:11:25.112635 | mon1 | 2026-04-29 22:11:25.112642 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:11:25.112648 | mon1 | Wednesday 29 April 2026 22:11:25 +0000 (0:00:00.251) 0:00:23.449 ******* 2026-04-29 22:11:25.195603 | mon1 | ok: [mon1] => { 2026-04-29 22:11:25.195677 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-29 22:11:25.195690 | mon1 | } 2026-04-29 22:11:25.195700 | mon1 | 2026-04-29 22:11:25.195710 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:11:25.195719 | mon1 | Wednesday 29 April 2026 22:11:25 +0000 (0:00:00.081) 0:00:23.531 ******* 2026-04-29 22:11:26.463968 | mon1 | changed: [mon1] 2026-04-29 22:11:26.464038 | mon1 | 2026-04-29 22:11:26.464049 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:11:26.464059 | mon1 | Wednesday 29 April 2026 22:11:26 +0000 (0:00:01.268) 0:00:24.800 ******* 2026-04-29 22:11:31.110168 | mon1 | changed: [mon1] 2026-04-29 22:11:31.110272 | mon1 | 2026-04-29 22:11:31.110291 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-29 22:11:31.110304 | mon1 | Wednesday 29 April 2026 22:11:31 +0000 (0:00:04.645) 0:00:29.445 ******* 2026-04-29 22:11:32.178702 | mon1 | ok: [mon1] 2026-04-29 22:11:32.178783 | mon1 | 2026-04-29 22:11:32.178873 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-29 22:11:32.178999 | mon1 | Wednesday 29 April 2026 22:11:32 +0000 (0:00:01.068) 0:00:30.514 ******* 2026-04-29 22:11:32.878722 | mon1 | changed: [mon1] 2026-04-29 22:11:32.878805 | mon1 | 2026-04-29 22:11:32.878889 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-29 22:11:32.878987 | mon1 | Wednesday 29 April 2026 22:11:32 +0000 (0:00:00.702) 0:00:31.216 ******* 2026-04-29 22:11:33.496008 | mon1 | changed: [mon1] 2026-04-29 22:11:33.496100 | mon1 | 2026-04-29 22:11:33.499064 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-29 22:11:33.499222 | mon1 | Wednesday 29 April 2026 22:11:33 +0000 (0:00:00.616) 0:00:31.833 ******* 2026-04-29 22:11:34.247683 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-04-29 22:11:34.247909 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-29 22:11:34.248157 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-29 22:11:34.248422 | mon1 | 2026-04-29 22:11:34.248670 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-29 22:11:34.248918 | mon1 | Wednesday 29 April 2026 22:11:34 +0000 (0:00:00.751) 0:00:32.585 ******* 2026-04-29 22:11:34.827684 | mon1 | changed: [mon1] 2026-04-29 22:11:34.827841 | mon1 | 2026-04-29 22:11:34.827961 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-29 22:11:34.828217 | mon1 | Wednesday 29 April 2026 22:11:34 +0000 (0:00:00.576) 0:00:33.161 ******* 2026-04-29 22:11:35.464718 | mon1 | changed: [mon1] 2026-04-29 22:11:35.464830 | mon1 | 2026-04-29 22:11:35.464848 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-29 22:11:35.464987 | mon1 | Wednesday 29 April 2026 22:11:35 +0000 (0:00:00.632) 0:00:33.794 ******* 2026-04-29 22:11:35.465073 | mon1 | 2026-04-29 22:11:35.465190 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-29 22:11:35.465327 | mon1 | Wednesday 29 April 2026 22:11:35 +0000 (0:00:00.007) 0:00:33.801 ******* 2026-04-29 22:11:36.372439 | mon1 | ok: [mon1] 2026-04-29 22:11:36.372521 | mon1 | 2026-04-29 22:11:36.372528 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-29 22:11:36.372663 | mon1 | Wednesday 29 April 2026 22:11:36 +0000 (0:00:00.907) 0:00:34.709 ******* 2026-04-29 22:11:37.643954 | mon1 | changed: [mon1] 2026-04-29 22:11:37.644133 | mon1 | 2026-04-29 22:11:37.644426 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-29 22:11:37.644685 | mon1 | Wednesday 29 April 2026 22:11:37 +0000 (0:00:01.272) 0:00:35.981 ******* 2026-04-29 22:11:38.360785 | mon1 | changed: [mon1] 2026-04-29 22:11:38.360941 | mon1 | 2026-04-29 22:11:38.361277 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-29 22:11:38.361557 | mon1 | Wednesday 29 April 2026 22:11:38 +0000 (0:00:00.716) 0:00:36.698 ******* 2026-04-29 22:11:38.424794 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-29 22:11:38.424989 | mon1 | 2026-04-29 22:11:38.425315 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-29 22:11:38.425592 | mon1 | Wednesday 29 April 2026 22:11:38 +0000 (0:00:00.063) 0:00:36.762 ******* 2026-04-29 22:11:59.263455 | mon1 | changed: [mon1] 2026-04-29 22:11:59.263540 | mon1 | 2026-04-29 22:11:59.263561 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-29 22:11:59.263772 | mon1 | Wednesday 29 April 2026 22:11:59 +0000 (0:00:20.838) 0:00:57.600 ******* 2026-04-29 22:12:00.079842 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-29 22:12:00.080098 | mon1 | ok: [mon1] => (item=ssh) 2026-04-29 22:12:00.080382 | mon1 | 2026-04-29 22:12:00.080655 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-29 22:12:00.080912 | mon1 | Wednesday 29 April 2026 22:12:00 +0000 (0:00:00.816) 0:00:58.417 ******* 2026-04-29 22:12:00.459687 | mon1 | changed: [mon1] 2026-04-29 22:12:00.460039 | mon1 | 2026-04-29 22:12:00.460310 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-29 22:12:00.460668 | mon1 | Wednesday 29 April 2026 22:12:00 +0000 (0:00:00.379) 0:00:58.797 ******* 2026-04-29 22:12:00.715495 | mon1 | ok: [mon1] 2026-04-29 22:12:00.715697 | mon1 | 2026-04-29 22:12:00.715959 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-29 22:12:00.716300 | mon1 | Wednesday 29 April 2026 22:12:00 +0000 (0:00:00.255) 0:00:59.053 ******* 2026-04-29 22:12:01.284766 | mon1 | changed: [mon1] 2026-04-29 22:12:01.285091 | mon1 | 2026-04-29 22:12:01.285459 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-29 22:12:01.285871 | mon1 | Wednesday 29 April 2026 22:12:01 +0000 (0:00:00.569) 0:00:59.622 ******* 2026-04-29 22:12:01.670725 | mon1 | changed: [mon1] 2026-04-29 22:12:01.670819 | mon1 | 2026-04-29 22:12:01.670938 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-29 22:12:01.671020 | mon1 | Wednesday 29 April 2026 22:12:01 +0000 (0:00:00.385) 0:01:00.007 ******* 2026-04-29 22:12:01.806682 | mon1 | ok: [mon1] 2026-04-29 22:12:01.806740 | mon1 | 2026-04-29 22:12:01.806847 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-29 22:12:01.806959 | mon1 | Wednesday 29 April 2026 22:12:01 +0000 (0:00:00.136) 0:01:00.144 ******* 2026-04-29 22:12:02.078183 | mon1 | ok: [mon1] => (item=mon1) 2026-04-29 22:12:02.078411 | mon1 | 2026-04-29 22:12:02.078859 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-29 22:12:02.079108 | mon1 | Wednesday 29 April 2026 22:12:02 +0000 (0:00:00.271) 0:01:00.415 ******* 2026-04-29 22:12:02.130047 | mon1 | ok: [mon1] 2026-04-29 22:12:02.130261 | mon1 | 2026-04-29 22:12:02.130654 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-29 22:12:02.130948 | mon1 | Wednesday 29 April 2026 22:12:02 +0000 (0:00:00.051) 0:01:00.467 ******* 2026-04-29 22:12:02.237627 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-04-29 22:12:02.237917 | mon1 | 2026-04-29 22:12:02.238188 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-29 22:12:02.238543 | mon1 | Wednesday 29 April 2026 22:12:02 +0000 (0:00:00.107) 0:01:00.575 ******* 2026-04-29 22:12:02.547495 | mon1 | changed: [mon1] 2026-04-29 22:12:02.547671 | mon1 | 2026-04-29 22:12:02.547859 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-29 22:12:02.548075 | mon1 | Wednesday 29 April 2026 22:12:02 +0000 (0:00:00.309) 0:01:00.885 ******* 2026-04-29 22:12:03.369553 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-04-29 22:12:03.369820 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-04-29 22:12:03.370108 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-04-29 22:12:03.370402 | mon1 | 2026-04-29 22:12:03.370709 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-04-29 22:12:03.370977 | mon1 | Wednesday 29 April 2026 22:12:03 +0000 (0:00:00.821) 0:01:01.707 ******* 2026-04-29 22:13:42.728577 | mon1 | ok: [mon1] 2026-04-29 22:13:42.728659 | mon1 | 2026-04-29 22:13:42.728674 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-29 22:13:42.728687 | mon1 | Wednesday 29 April 2026 22:13:42 +0000 (0:01:39.358) 0:02:41.065 ******* 2026-04-29 22:13:42.981220 | mon1 | changed: [mon1] 2026-04-29 22:13:42.981441 | mon1 | 2026-04-29 22:13:42.981768 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-29 22:13:42.982089 | mon1 | Wednesday 29 April 2026 22:13:42 +0000 (0:00:00.253) 0:02:41.318 ******* 2026-04-29 22:13:43.023300 | mon1 | ok: [mon1] 2026-04-29 22:13:43.023528 | mon1 | 2026-04-29 22:13:43.023782 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:13:43.024051 | mon1 | Wednesday 29 April 2026 22:13:43 +0000 (0:00:00.042) 0:02:41.361 ******* 2026-04-29 22:13:43.099087 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-29 22:13:43.099323 | mon1 | 2026-04-29 22:13:43.099590 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:13:43.099819 | mon1 | Wednesday 29 April 2026 22:13:43 +0000 (0:00:00.075) 0:02:41.437 ******* 2026-04-29 22:13:49.311910 | mon1 | ok: [mon1] 2026-04-29 22:13:49.311987 | mon1 | 2026-04-29 22:13:49.312001 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:13:49.312013 | mon1 | Wednesday 29 April 2026 22:13:49 +0000 (0:00:06.211) 0:02:47.648 ******* 2026-04-29 22:13:49.368670 | mon1 | ok: [mon1] => (item=mon1) 2026-04-29 22:13:49.368722 | mon1 | 2026-04-29 22:13:49.368850 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:13:49.368960 | mon1 | Wednesday 29 April 2026 22:13:49 +0000 (0:00:00.056) 0:02:47.705 ******* 2026-04-29 22:13:49.798049 | mon1 | ok: [mon1] 2026-04-29 22:13:49.798328 | mon1 | 2026-04-29 22:13:49.798605 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:13:49.798902 | mon1 | Wednesday 29 April 2026 22:13:49 +0000 (0:00:00.429) 0:02:48.135 ******* 2026-04-29 22:13:57.755994 | mon1 | ok: [mon1] 2026-04-29 22:13:57.756781 | mon1 | 2026-04-29 22:13:57.756827 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-29 22:13:57.756837 | mon1 | Wednesday 29 April 2026 22:13:57 +0000 (0:00:07.958) 0:02:56.093 ******* 2026-04-29 22:14:53.643111 | mon1 | changed: [mon1] 2026-04-29 22:14:53.643188 | mon1 | 2026-04-29 22:14:53.643266 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-29 22:14:53.643388 | mon1 | Wednesday 29 April 2026 22:14:53 +0000 (0:00:55.886) 0:03:51.980 ******* 2026-04-29 22:15:08.151797 | mon1 | ok: [mon1] 2026-04-29 22:15:08.151870 | mon1 | 2026-04-29 22:15:08.151884 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:15:08.151896 | mon1 | Wednesday 29 April 2026 22:15:08 +0000 (0:00:14.507) 0:04:06.487 ******* 2026-04-29 22:15:08.226513 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-29 22:15:08.226566 | mon1 | 2026-04-29 22:15:08.226574 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:15:08.226580 | mon1 | Wednesday 29 April 2026 22:15:08 +0000 (0:00:00.075) 0:04:06.563 ******* 2026-04-29 22:15:08.279425 | mon1 | skipping: [mon1] 2026-04-29 22:15:08.279475 | mon1 | 2026-04-29 22:15:08.279481 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:15:08.279487 | mon1 | Wednesday 29 April 2026 22:15:08 +0000 (0:00:00.052) 0:04:06.616 ******* 2026-04-29 22:15:08.332494 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-29 22:15:08.332540 | mon1 | skipping: [mon1] 2026-04-29 22:15:08.332548 | mon1 | 2026-04-29 22:15:08.332553 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:15:08.332559 | mon1 | Wednesday 29 April 2026 22:15:08 +0000 (0:00:00.052) 0:04:06.669 ******* 2026-04-29 22:15:08.648653 | mon1 | ok: [mon1] 2026-04-29 22:15:08.648713 | mon1 | 2026-04-29 22:15:08.648934 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:15:08.648947 | mon1 | Wednesday 29 April 2026 22:15:08 +0000 (0:00:00.315) 0:04:06.985 ******* 2026-04-29 22:15:15.681384 | mon1 | ok: [mon1] 2026-04-29 22:15:15.681473 | mon1 | 2026-04-29 22:15:15.682030 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-29 22:15:15.682091 | mon1 | Wednesday 29 April 2026 22:15:15 +0000 (0:00:07.032) 0:04:14.018 ******* 2026-04-29 22:15:28.723460 | mon1 | changed: [mon1] 2026-04-29 22:15:28.723532 | mon1 | 2026-04-29 22:15:28.724020 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-29 22:15:28.724077 | mon1 | Wednesday 29 April 2026 22:15:28 +0000 (0:00:13.040) 0:04:27.059 ******* 2026-04-29 22:15:35.043782 | mon1 | ok: [mon1] 2026-04-29 22:15:35.043847 | mon1 | 2026-04-29 22:15:35.043861 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-29 22:15:35.043873 | mon1 | Wednesday 29 April 2026 22:15:35 +0000 (0:00:06.320) 0:04:33.379 ******* 2026-04-29 22:15:42.860300 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-29 22:15:42.860374 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-29 22:15:42.860387 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-04-29 22:15:42.860399 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-29 22:15:42.860410 | mon1 | 2026-04-29 22:15:42.860423 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-29 22:15:42.860435 | mon1 | 2026-04-29 22:15:42.860447 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:15:42.860492 | mon1 | Wednesday 29 April 2026 22:15:42 +0000 (0:00:07.815) 0:04:41.195 ******* 2026-04-29 22:15:44.090913 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-29 22:15:44.091125 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:15:44.091460 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:15:44.091646 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:15:44.091798 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:15:44.102576 | mon1 | ok: [osd1] 2026-04-29 22:15:44.102705 | mon1 | 2026-04-29 22:15:44.102865 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:15:44.103022 | mon1 | Wednesday 29 April 2026 22:15:44 +0000 (0:00:01.244) 0:04:42.440 ******* 2026-04-29 22:15:44.363707 | mon1 | ok: [osd1] 2026-04-29 22:15:44.363778 | mon1 | 2026-04-29 22:15:44.363878 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:15:44.363984 | mon1 | Wednesday 29 April 2026 22:15:44 +0000 (0:00:00.258) 0:04:42.699 ******* 2026-04-29 22:15:44.402861 | mon1 | skipping: [osd1] 2026-04-29 22:15:44.402929 | mon1 | 2026-04-29 22:15:44.403027 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-29 22:15:44.403171 | mon1 | Wednesday 29 April 2026 22:15:44 +0000 (0:00:00.041) 0:04:42.740 ******* 2026-04-29 22:15:44.663058 | mon1 | changed: [osd1] 2026-04-29 22:15:44.663115 | mon1 | 2026-04-29 22:15:44.663247 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:15:44.663375 | mon1 | Wednesday 29 April 2026 22:15:44 +0000 (0:00:00.260) 0:04:43.001 ******* 2026-04-29 22:15:44.730728 | mon1 | ok: [osd1] => { 2026-04-29 22:15:44.730881 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-29 22:15:44.731050 | mon1 | } 2026-04-29 22:15:44.731215 | mon1 | 2026-04-29 22:15:44.731429 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:15:44.731630 | mon1 | Wednesday 29 April 2026 22:15:44 +0000 (0:00:00.067) 0:04:43.068 ******* 2026-04-29 22:15:45.413679 | mon1 | changed: [osd1] 2026-04-29 22:15:45.413741 | mon1 | 2026-04-29 22:15:45.413868 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:15:45.413983 | mon1 | Wednesday 29 April 2026 22:15:45 +0000 (0:00:00.680) 0:04:43.749 ******* 2026-04-29 22:15:45.456426 | mon1 | skipping: [osd1] 2026-04-29 22:15:45.456503 | mon1 | 2026-04-29 22:15:45.456631 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:15:45.456743 | mon1 | Wednesday 29 April 2026 22:15:45 +0000 (0:00:00.045) 0:04:43.794 ******* 2026-04-29 22:15:45.501098 | mon1 | skipping: [osd1] 2026-04-29 22:15:45.501159 | mon1 | 2026-04-29 22:15:45.501304 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:15:45.501416 | mon1 | Wednesday 29 April 2026 22:15:45 +0000 (0:00:00.044) 0:04:43.839 ******* 2026-04-29 22:15:45.752645 | mon1 | ok: [osd1] 2026-04-29 22:15:45.752711 | mon1 | 2026-04-29 22:15:45.752817 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:15:45.752928 | mon1 | Wednesday 29 April 2026 22:15:45 +0000 (0:00:00.250) 0:04:44.090 ******* 2026-04-29 22:15:46.984434 | mon1 | ok: [osd1] 2026-04-29 22:15:46.984517 | mon1 | 2026-04-29 22:15:46.984635 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:15:46.984845 | mon1 | Wednesday 29 April 2026 22:15:46 +0000 (0:00:01.229) 0:04:45.319 ******* 2026-04-29 22:15:47.068470 | mon1 | ok: [osd1] => { 2026-04-29 22:15:47.068579 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-29 22:15:47.068688 | mon1 | } 2026-04-29 22:15:47.068854 | mon1 | 2026-04-29 22:15:47.068990 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:15:47.069089 | mon1 | Wednesday 29 April 2026 22:15:47 +0000 (0:00:00.084) 0:04:45.404 ******* 2026-04-29 22:15:47.913599 | mon1 | changed: [osd1] 2026-04-29 22:15:47.913681 | mon1 | 2026-04-29 22:15:47.913879 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:15:47.914018 | mon1 | Wednesday 29 April 2026 22:15:47 +0000 (0:00:00.846) 0:04:46.251 ******* 2026-04-29 22:15:50.858183 | mon1 | changed: [osd1] 2026-04-29 22:15:50.858440 | mon1 | 2026-04-29 22:15:50.858776 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-29 22:15:50.859167 | mon1 | Wednesday 29 April 2026 22:15:50 +0000 (0:00:02.944) 0:04:49.195 ******* 2026-04-29 22:15:50.895531 | mon1 | skipping: [osd1] 2026-04-29 22:15:50.895668 | mon1 | 2026-04-29 22:15:50.895925 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-29 22:15:50.896166 | mon1 | Wednesday 29 April 2026 22:15:50 +0000 (0:00:00.037) 0:04:49.233 ******* 2026-04-29 22:15:50.931610 | mon1 | skipping: [osd1] 2026-04-29 22:15:50.931771 | mon1 | 2026-04-29 22:15:50.932016 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-29 22:15:50.932286 | mon1 | Wednesday 29 April 2026 22:15:50 +0000 (0:00:00.035) 0:04:49.268 ******* 2026-04-29 22:15:50.967088 | mon1 | skipping: [osd1] 2026-04-29 22:15:50.967269 | mon1 | 2026-04-29 22:15:50.967549 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-29 22:15:50.967798 | mon1 | Wednesday 29 April 2026 22:15:50 +0000 (0:00:00.035) 0:04:49.304 ******* 2026-04-29 22:15:58.773378 | mon1 | changed: [osd1] 2026-04-29 22:15:58.773429 | mon1 | 2026-04-29 22:15:58.773858 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-29 22:15:58.773917 | mon1 | Wednesday 29 April 2026 22:15:58 +0000 (0:00:07.805) 0:04:57.110 ******* 2026-04-29 22:15:59.371757 | mon1 | changed: [osd1] 2026-04-29 22:15:59.371858 | mon1 | 2026-04-29 22:15:59.371973 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-29 22:15:59.372098 | mon1 | Wednesday 29 April 2026 22:15:59 +0000 (0:00:00.598) 0:04:57.708 ******* 2026-04-29 22:16:00.476851 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-29 22:16:00.476914 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-29 22:16:00.476925 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-29 22:16:00.476934 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-29 22:16:00.476942 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-29 22:16:00.476951 | mon1 | 2026-04-29 22:16:00.476961 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-29 22:16:00.476969 | mon1 | Wednesday 29 April 2026 22:16:00 +0000 (0:00:01.103) 0:04:58.812 ******* 2026-04-29 22:16:01.198385 | mon1 | changed: [osd1] 2026-04-29 22:16:01.198439 | mon1 | 2026-04-29 22:16:01.198450 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-29 22:16:01.198459 | mon1 | Wednesday 29 April 2026 22:16:01 +0000 (0:00:00.714) 0:04:59.527 ******* 2026-04-29 22:16:01.198468 | mon1 | 2026-04-29 22:16:01.198483 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-29 22:16:01.198661 | mon1 | Wednesday 29 April 2026 22:16:01 +0000 (0:00:00.008) 0:04:59.535 ******* 2026-04-29 22:16:02.147650 | mon1 | ok: [osd1] 2026-04-29 22:16:02.147724 | mon1 | 2026-04-29 22:16:02.147853 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-29 22:16:02.147967 | mon1 | Wednesday 29 April 2026 22:16:02 +0000 (0:00:00.949) 0:05:00.485 ******* 2026-04-29 22:16:02.776166 | mon1 | changed: [osd1] 2026-04-29 22:16:02.776202 | mon1 | 2026-04-29 22:16:02.776207 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-29 22:16:02.776212 | mon1 | Wednesday 29 April 2026 22:16:02 +0000 (0:00:00.628) 0:05:01.113 ******* 2026-04-29 22:16:03.504752 | mon1 | changed: [osd1] 2026-04-29 22:16:03.504799 | mon1 | 2026-04-29 22:16:03.504810 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:16:03.504820 | mon1 | Wednesday 29 April 2026 22:16:03 +0000 (0:00:00.727) 0:05:01.841 ******* 2026-04-29 22:16:03.749305 | mon1 | ok: [osd1] 2026-04-29 22:16:03.749544 | mon1 | 2026-04-29 22:16:03.749917 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:16:03.750306 | mon1 | Wednesday 29 April 2026 22:16:03 +0000 (0:00:00.244) 0:05:02.086 ******* 2026-04-29 22:16:03.809370 | mon1 | ok: [osd1] => { 2026-04-29 22:16:03.809444 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-29 22:16:03.809631 | mon1 | } 2026-04-29 22:16:03.809776 | mon1 | 2026-04-29 22:16:03.810049 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:16:03.810213 | mon1 | Wednesday 29 April 2026 22:16:03 +0000 (0:00:00.061) 0:05:02.147 ******* 2026-04-29 22:16:04.820316 | mon1 | changed: [osd1] 2026-04-29 22:16:04.820656 | mon1 | 2026-04-29 22:16:04.821014 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:16:04.821405 | mon1 | Wednesday 29 April 2026 22:16:04 +0000 (0:00:01.010) 0:05:03.158 ******* 2026-04-29 22:16:09.372402 | mon1 | changed: [osd1] 2026-04-29 22:16:09.372484 | mon1 | 2026-04-29 22:16:09.372495 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-29 22:16:09.372511 | mon1 | Wednesday 29 April 2026 22:16:09 +0000 (0:00:04.551) 0:05:07.709 ******* 2026-04-29 22:16:10.512910 | mon1 | ok: [osd1] 2026-04-29 22:16:10.512952 | mon1 | 2026-04-29 22:16:10.512957 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-29 22:16:10.512961 | mon1 | Wednesday 29 April 2026 22:16:10 +0000 (0:00:01.140) 0:05:08.850 ******* 2026-04-29 22:16:10.825946 | mon1 | changed: [osd1] 2026-04-29 22:16:10.826003 | mon1 | 2026-04-29 22:16:10.826013 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-29 22:16:10.826023 | mon1 | Wednesday 29 April 2026 22:16:10 +0000 (0:00:00.311) 0:05:09.161 ******* 2026-04-29 22:16:11.421023 | mon1 | changed: [osd1] 2026-04-29 22:16:11.421083 | mon1 | 2026-04-29 22:16:11.421094 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-29 22:16:11.421103 | mon1 | Wednesday 29 April 2026 22:16:11 +0000 (0:00:00.595) 0:05:09.756 ******* 2026-04-29 22:16:12.148612 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-04-29 22:16:12.148680 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-29 22:16:12.148686 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-29 22:16:12.148690 | mon1 | 2026-04-29 22:16:12.148694 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-29 22:16:12.148699 | mon1 | Wednesday 29 April 2026 22:16:12 +0000 (0:00:00.727) 0:05:10.484 ******* 2026-04-29 22:16:12.741720 | mon1 | changed: [osd1] 2026-04-29 22:16:12.741816 | mon1 | 2026-04-29 22:16:12.741867 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-29 22:16:12.741990 | mon1 | Wednesday 29 April 2026 22:16:12 +0000 (0:00:00.594) 0:05:11.078 ******* 2026-04-29 22:16:13.348403 | mon1 | changed: [osd1] 2026-04-29 22:16:13.348512 | mon1 | 2026-04-29 22:16:13.349405 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-29 22:16:13.349442 | mon1 | Wednesday 29 April 2026 22:16:13 +0000 (0:00:00.600) 0:05:11.679 ******* 2026-04-29 22:16:13.349453 | mon1 | 2026-04-29 22:16:13.349997 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-29 22:16:13.350060 | mon1 | Wednesday 29 April 2026 22:16:13 +0000 (0:00:00.005) 0:05:11.685 ******* 2026-04-29 22:16:14.314455 | mon1 | ok: [osd1] 2026-04-29 22:16:14.323972 | mon1 | 2026-04-29 22:16:14.323999 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-29 22:16:14.324008 | mon1 | Wednesday 29 April 2026 22:16:14 +0000 (0:00:00.965) 0:05:12.650 ******* 2026-04-29 22:16:16.132905 | mon1 | changed: [osd1] 2026-04-29 22:16:16.132968 | mon1 | 2026-04-29 22:16:16.132982 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-29 22:16:16.132994 | mon1 | Wednesday 29 April 2026 22:16:16 +0000 (0:00:01.817) 0:05:14.468 ******* 2026-04-29 22:16:16.857049 | mon1 | changed: [osd1] 2026-04-29 22:16:16.857134 | mon1 | 2026-04-29 22:16:16.857149 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-29 22:16:16.857162 | mon1 | Wednesday 29 April 2026 22:16:16 +0000 (0:00:00.725) 0:05:15.193 ******* 2026-04-29 22:16:16.921622 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-29 22:16:16.921660 | mon1 | 2026-04-29 22:16:16.921674 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-29 22:16:16.921686 | mon1 | Wednesday 29 April 2026 22:16:16 +0000 (0:00:00.064) 0:05:15.258 ******* 2026-04-29 22:16:18.132737 | mon1 | ok: [osd1] 2026-04-29 22:16:18.132820 | mon1 | 2026-04-29 22:16:18.132830 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-29 22:16:18.132839 | mon1 | Wednesday 29 April 2026 22:16:18 +0000 (0:00:01.210) 0:05:16.468 ******* 2026-04-29 22:16:18.983323 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-29 22:16:18.983446 | mon1 | ok: [osd1] => (item=ssh) 2026-04-29 22:16:18.983458 | mon1 | 2026-04-29 22:16:18.983467 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-29 22:16:18.983477 | mon1 | Wednesday 29 April 2026 22:16:18 +0000 (0:00:00.850) 0:05:17.319 ******* 2026-04-29 22:16:19.366236 | mon1 | changed: [osd1] 2026-04-29 22:16:19.366340 | mon1 | 2026-04-29 22:16:19.366350 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-29 22:16:19.366360 | mon1 | Wednesday 29 April 2026 22:16:19 +0000 (0:00:00.382) 0:05:17.701 ******* 2026-04-29 22:16:19.617990 | mon1 | ok: [osd1] 2026-04-29 22:16:19.618063 | mon1 | 2026-04-29 22:16:19.618074 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-29 22:16:19.618083 | mon1 | Wednesday 29 April 2026 22:16:19 +0000 (0:00:00.252) 0:05:17.953 ******* 2026-04-29 22:16:20.061932 | mon1 | changed: [osd1] 2026-04-29 22:16:20.062009 | mon1 | 2026-04-29 22:16:20.062020 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-29 22:16:20.062057 | mon1 | Wednesday 29 April 2026 22:16:20 +0000 (0:00:00.444) 0:05:18.398 ******* 2026-04-29 22:16:20.359049 | mon1 | changed: [osd1] 2026-04-29 22:16:20.359130 | mon1 | 2026-04-29 22:16:20.359141 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-29 22:16:20.359151 | mon1 | Wednesday 29 April 2026 22:16:20 +0000 (0:00:00.296) 0:05:18.695 ******* 2026-04-29 22:16:20.667388 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-29 22:16:20.667460 | mon1 | 2026-04-29 22:16:20.668024 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-29 22:16:20.668082 | mon1 | Wednesday 29 April 2026 22:16:20 +0000 (0:00:00.308) 0:05:19.003 ******* 2026-04-29 22:16:20.722204 | mon1 | ok: [osd1] 2026-04-29 22:16:20.722314 | mon1 | 2026-04-29 22:16:20.722325 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:16:20.722335 | mon1 | Wednesday 29 April 2026 22:16:20 +0000 (0:00:00.054) 0:05:19.057 ******* 2026-04-29 22:16:20.808907 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-29 22:16:20.808966 | mon1 | 2026-04-29 22:16:20.808977 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:16:20.808988 | mon1 | Wednesday 29 April 2026 22:16:20 +0000 (0:00:00.087) 0:05:19.144 ******* 2026-04-29 22:16:27.747699 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:16:27.747782 | mon1 | 2026-04-29 22:16:27.748017 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:16:27.748054 | mon1 | Wednesday 29 April 2026 22:16:27 +0000 (0:00:06.938) 0:05:26.083 ******* 2026-04-29 22:16:27.801928 | mon1 | ok: [osd1] => (item=osd1) 2026-04-29 22:16:27.801985 | mon1 | 2026-04-29 22:16:27.802000 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:16:27.802013 | mon1 | Wednesday 29 April 2026 22:16:27 +0000 (0:00:00.055) 0:05:26.138 ******* 2026-04-29 22:16:28.131793 | mon1 | changed: [osd1] 2026-04-29 22:16:28.131855 | mon1 | 2026-04-29 22:16:28.131869 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:16:28.131883 | mon1 | Wednesday 29 April 2026 22:16:28 +0000 (0:00:00.329) 0:05:26.468 ******* 2026-04-29 22:16:37.707437 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:16:37.707512 | mon1 | 2026-04-29 22:16:37.708107 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-29 22:16:37.708195 | mon1 | Wednesday 29 April 2026 22:16:37 +0000 (0:00:09.575) 0:05:36.043 ******* 2026-04-29 22:16:39.387652 | mon1 | ok: [osd1] 2026-04-29 22:16:39.387727 | mon1 | 2026-04-29 22:16:39.387834 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-29 22:16:39.387946 | mon1 | Wednesday 29 April 2026 22:16:39 +0000 (0:00:01.681) 0:05:37.725 ******* 2026-04-29 22:17:31.968264 | mon1 | ok: [osd1] 2026-04-29 22:17:31.968333 | mon1 | 2026-04-29 22:17:31.968340 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-29 22:17:31.968363 | mon1 | Wednesday 29 April 2026 22:17:31 +0000 (0:00:52.577) 0:06:30.303 ******* 2026-04-29 22:19:11.481037 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-04-29 22:19:11.481174 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-04-29 22:19:11.481189 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-04-29 22:19:11.481201 | mon1 | 2026-04-29 22:19:11.481214 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-29 22:19:11.481275 | mon1 | Wednesday 29 April 2026 22:19:11 +0000 (0:01:39.514) 0:08:09.817 ******* 2026-04-29 22:19:17.981091 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:19:17.981163 | mon1 | 2026-04-29 22:19:17.981179 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-29 22:19:17.981191 | mon1 | Wednesday 29 April 2026 22:19:17 +0000 (0:00:06.499) 0:08:16.317 ******* 2026-04-29 22:19:24.419181 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:19:24.419346 | mon1 | 2026-04-29 22:19:24.419367 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-29 22:19:24.419380 | mon1 | Wednesday 29 April 2026 22:19:24 +0000 (0:00:06.437) 0:08:22.754 ******* 2026-04-29 22:19:24.529786 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-29 22:19:24.529844 | mon1 | 2026-04-29 22:19:24.529858 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-29 22:19:24.529870 | mon1 | Wednesday 29 April 2026 22:19:24 +0000 (0:00:00.111) 0:08:22.866 ******* 2026-04-29 22:19:24.587526 | mon1 | ok: [osd1] 2026-04-29 22:19:24.587576 | mon1 | 2026-04-29 22:19:24.587586 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-29 22:19:24.587595 | mon1 | Wednesday 29 April 2026 22:19:24 +0000 (0:00:00.058) 0:08:22.924 ******* 2026-04-29 22:19:30.976078 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:19:30.976168 | mon1 | 2026-04-29 22:19:30.976198 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-29 22:19:30.976216 | mon1 | Wednesday 29 April 2026 22:19:30 +0000 (0:00:06.387) 0:08:29.311 ******* 2026-04-29 22:19:31.025843 | mon1 | ok: [osd1] 2026-04-29 22:19:31.025893 | mon1 | 2026-04-29 22:19:31.025909 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-29 22:19:31.025922 | mon1 | Wednesday 29 April 2026 22:19:31 +0000 (0:00:00.050) 0:08:29.362 ******* 2026-04-29 22:19:31.071355 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:19:31.071390 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:19:31.071403 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:19:31.071414 | mon1 | skipping: [osd1] 2026-04-29 22:19:31.071426 | mon1 | 2026-04-29 22:19:31.071438 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-29 22:19:31.071450 | mon1 | Wednesday 29 April 2026 22:19:31 +0000 (0:00:00.044) 0:08:29.406 ******* 2026-04-29 22:19:31.111414 | mon1 | skipping: [osd1] 2026-04-29 22:19:31.111499 | mon1 | 2026-04-29 22:19:31.111539 | mon1 | PLAY RECAP ********************************************************************* 2026-04-29 22:19:31.113294 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-29 22:19:31.113343 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-29 22:19:31.113358 | mon1 | 2026-04-29 22:19:31.113372 | mon1 | 2026-04-29 22:19:31.113385 | mon1 | TASKS RECAP ******************************************************************** 2026-04-29 22:19:31.113399 | mon1 | Wednesday 29 April 2026 22:19:31 +0000 (0:00:00.042) 0:08:29.448 ******* 2026-04-29 22:19:31.113520 | mon1 | =============================================================================== 2026-04-29 22:19:31.113856 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 99.51s 2026-04-29 22:19:31.114216 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 99.36s 2026-04-29 22:19:31.114597 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 55.89s 2026-04-29 22:19:31.114921 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 52.58s 2026-04-29 22:19:31.115297 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 20.84s 2026-04-29 22:19:31.115652 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.51s 2026-04-29 22:19:31.115983 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 13.04s 2026-04-29 22:19:31.116403 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.58s 2026-04-29 22:19:31.116777 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.03s 2026-04-29 22:19:31.117106 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.96s 2026-04-29 22:19:31.117469 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.82s 2026-04-29 22:19:31.117801 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.81s 2026-04-29 22:19:31.118320 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.03s 2026-04-29 22:19:31.118681 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.94s 2026-04-29 22:19:31.119003 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.50s 2026-04-29 22:19:31.119469 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.44s 2026-04-29 22:19:31.119620 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.39s 2026-04-29 22:19:31.119758 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.32s 2026-04-29 22:19:31.119898 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.21s 2026-04-29 22:19:31.120034 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.65s 2026-04-29 22:19:31.240475 | mon1 | INFO [default > converge] Executed: Successful 2026-04-29 22:19:31.254280 | mon1 | INFO [default > idempotence] Executing 2026-04-29 22:19:32.265959 | mon1 | 2026-04-29 22:19:32.266197 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-29 22:19:32.266397 | mon1 | 2026-04-29 22:19:32.266614 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:19:32.266846 | mon1 | Wednesday 29 April 2026 22:19:32 +0000 (0:00:00.054) 0:00:00.054 ******* 2026-04-29 22:19:34.563915 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-29 22:19:34.564353 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:19:34.564681 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:19:34.564985 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:19:34.565322 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:19:34.577542 | mon1 | ok: [mon1] 2026-04-29 22:19:34.577632 | mon1 | 2026-04-29 22:19:34.577749 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:19:34.577878 | mon1 | Wednesday 29 April 2026 22:19:34 +0000 (0:00:02.312) 0:00:02.366 ******* 2026-04-29 22:19:34.913669 | mon1 | ok: [mon1] 2026-04-29 22:19:34.913741 | mon1 | 2026-04-29 22:19:34.913902 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:19:34.913936 | mon1 | Wednesday 29 April 2026 22:19:34 +0000 (0:00:00.335) 0:00:02.701 ******* 2026-04-29 22:19:34.961821 | mon1 | skipping: [mon1] 2026-04-29 22:19:34.961875 | mon1 | 2026-04-29 22:19:34.961888 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-29 22:19:34.961900 | mon1 | Wednesday 29 April 2026 22:19:34 +0000 (0:00:00.047) 0:00:02.749 ******* 2026-04-29 22:19:35.317853 | mon1 | ok: [mon1] 2026-04-29 22:19:35.317909 | mon1 | 2026-04-29 22:19:35.317921 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:19:35.317959 | mon1 | Wednesday 29 April 2026 22:19:35 +0000 (0:00:00.355) 0:00:03.104 ******* 2026-04-29 22:19:35.398334 | mon1 | ok: [mon1] => { 2026-04-29 22:19:35.398393 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-29 22:19:35.398692 | mon1 | } 2026-04-29 22:19:35.398981 | mon1 | 2026-04-29 22:19:35.399394 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:19:35.399725 | mon1 | Wednesday 29 April 2026 22:19:35 +0000 (0:00:00.081) 0:00:03.186 ******* 2026-04-29 22:19:35.907852 | mon1 | ok: [mon1] 2026-04-29 22:19:35.908490 | mon1 | 2026-04-29 22:19:35.908508 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:19:35.908515 | mon1 | Wednesday 29 April 2026 22:19:35 +0000 (0:00:00.509) 0:00:03.696 ******* 2026-04-29 22:19:35.962089 | mon1 | skipping: [mon1] 2026-04-29 22:19:35.962145 | mon1 | 2026-04-29 22:19:35.962156 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:19:35.962166 | mon1 | Wednesday 29 April 2026 22:19:35 +0000 (0:00:00.053) 0:00:03.749 ******* 2026-04-29 22:19:36.013929 | mon1 | skipping: [mon1] 2026-04-29 22:19:36.013993 | mon1 | 2026-04-29 22:19:36.014003 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:19:36.014013 | mon1 | Wednesday 29 April 2026 22:19:36 +0000 (0:00:00.051) 0:00:03.800 ******* 2026-04-29 22:19:36.287699 | mon1 | ok: [mon1] 2026-04-29 22:19:36.287741 | mon1 | 2026-04-29 22:19:36.287746 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:19:36.287750 | mon1 | Wednesday 29 April 2026 22:19:36 +0000 (0:00:00.275) 0:00:04.075 ******* 2026-04-29 22:19:37.465961 | mon1 | ok: [mon1] 2026-04-29 22:19:37.466022 | mon1 | 2026-04-29 22:19:37.466055 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:19:37.466064 | mon1 | Wednesday 29 April 2026 22:19:37 +0000 (0:00:01.176) 0:00:05.252 ******* 2026-04-29 22:19:37.655332 | mon1 | ok: [mon1] => { 2026-04-29 22:19:37.656537 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-29 22:19:37.656621 | mon1 | } 2026-04-29 22:19:37.656632 | mon1 | 2026-04-29 22:19:37.656643 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:19:37.656653 | mon1 | Wednesday 29 April 2026 22:19:37 +0000 (0:00:00.189) 0:00:05.442 ******* 2026-04-29 22:19:38.204658 | mon1 | ok: [mon1] 2026-04-29 22:19:38.204694 | mon1 | 2026-04-29 22:19:38.204698 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:19:38.204703 | mon1 | Wednesday 29 April 2026 22:19:38 +0000 (0:00:00.548) 0:00:05.990 ******* 2026-04-29 22:19:40.714923 | mon1 | ok: [mon1] 2026-04-29 22:19:40.714999 | mon1 | 2026-04-29 22:19:40.715132 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-29 22:19:40.715281 | mon1 | Wednesday 29 April 2026 22:19:40 +0000 (0:00:02.511) 0:00:08.502 ******* 2026-04-29 22:19:40.749860 | mon1 | skipping: [mon1] 2026-04-29 22:19:40.749936 | mon1 | 2026-04-29 22:19:40.749946 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-29 22:19:40.749957 | mon1 | Wednesday 29 April 2026 22:19:40 +0000 (0:00:00.034) 0:00:08.537 ******* 2026-04-29 22:19:40.787898 | mon1 | skipping: [mon1] 2026-04-29 22:19:40.787957 | mon1 | 2026-04-29 22:19:40.787968 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-29 22:19:40.787977 | mon1 | Wednesday 29 April 2026 22:19:40 +0000 (0:00:00.037) 0:00:08.574 ******* 2026-04-29 22:19:40.826032 | mon1 | skipping: [mon1] 2026-04-29 22:19:40.826114 | mon1 | 2026-04-29 22:19:40.826134 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-29 22:19:40.826148 | mon1 | Wednesday 29 April 2026 22:19:40 +0000 (0:00:00.036) 0:00:08.611 ******* 2026-04-29 22:19:42.018189 | mon1 | ok: [mon1] 2026-04-29 22:19:42.018986 | mon1 | 2026-04-29 22:19:42.019076 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-29 22:19:42.019088 | mon1 | Wednesday 29 April 2026 22:19:42 +0000 (0:00:01.194) 0:00:09.805 ******* 2026-04-29 22:19:42.596396 | mon1 | ok: [mon1] 2026-04-29 22:19:42.596452 | mon1 | 2026-04-29 22:19:42.596465 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-29 22:19:42.596683 | mon1 | Wednesday 29 April 2026 22:19:42 +0000 (0:00:00.578) 0:00:10.384 ******* 2026-04-29 22:19:43.744422 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-29 22:19:43.744500 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-29 22:19:43.744508 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-29 22:19:43.745722 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-29 22:19:43.745783 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-29 22:19:43.745795 | mon1 | 2026-04-29 22:19:43.745805 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-29 22:19:43.745815 | mon1 | Wednesday 29 April 2026 22:19:43 +0000 (0:00:01.148) 0:00:11.532 ******* 2026-04-29 22:19:44.454644 | mon1 | ok: [mon1] 2026-04-29 22:19:44.454701 | mon1 | 2026-04-29 22:19:44.454711 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-29 22:19:44.454721 | mon1 | Wednesday 29 April 2026 22:19:44 +0000 (0:00:00.698) 0:00:12.230 ******* 2026-04-29 22:19:44.454730 | mon1 | 2026-04-29 22:19:44.454738 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-29 22:19:44.454747 | mon1 | Wednesday 29 April 2026 22:19:44 +0000 (0:00:00.010) 0:00:12.240 ******* 2026-04-29 22:19:45.167881 | mon1 | ok: [mon1] 2026-04-29 22:19:45.167942 | mon1 | 2026-04-29 22:19:45.167956 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:19:45.167969 | mon1 | Wednesday 29 April 2026 22:19:45 +0000 (0:00:00.714) 0:00:12.955 ******* 2026-04-29 22:19:45.435407 | mon1 | ok: [mon1] 2026-04-29 22:19:45.436373 | mon1 | 2026-04-29 22:19:45.436460 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:19:45.436473 | mon1 | Wednesday 29 April 2026 22:19:45 +0000 (0:00:00.267) 0:00:13.223 ******* 2026-04-29 22:19:45.507355 | mon1 | ok: [mon1] => { 2026-04-29 22:19:45.508591 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-29 22:19:45.508655 | mon1 | } 2026-04-29 22:19:45.508666 | mon1 | 2026-04-29 22:19:45.508676 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:19:45.508686 | mon1 | Wednesday 29 April 2026 22:19:45 +0000 (0:00:00.071) 0:00:13.294 ******* 2026-04-29 22:19:45.944600 | mon1 | ok: [mon1] 2026-04-29 22:19:45.944654 | mon1 | 2026-04-29 22:19:45.944786 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:19:45.944893 | mon1 | Wednesday 29 April 2026 22:19:45 +0000 (0:00:00.436) 0:00:13.731 ******* 2026-04-29 22:19:49.281827 | mon1 | ok: [mon1] 2026-04-29 22:19:49.281899 | mon1 | 2026-04-29 22:19:49.282101 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-29 22:19:49.282250 | mon1 | Wednesday 29 April 2026 22:19:49 +0000 (0:00:03.338) 0:00:17.070 ******* 2026-04-29 22:19:50.344125 | mon1 | ok: [mon1] 2026-04-29 22:19:50.344378 | mon1 | 2026-04-29 22:19:50.344644 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-29 22:19:50.344899 | mon1 | Wednesday 29 April 2026 22:19:50 +0000 (0:00:01.060) 0:00:18.131 ******* 2026-04-29 22:19:50.668684 | mon1 | ok: [mon1] 2026-04-29 22:19:50.668900 | mon1 | 2026-04-29 22:19:50.669009 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-29 22:19:50.669160 | mon1 | Wednesday 29 April 2026 22:19:50 +0000 (0:00:00.326) 0:00:18.457 ******* 2026-04-29 22:19:51.222747 | mon1 | ok: [mon1] 2026-04-29 22:19:51.222864 | mon1 | 2026-04-29 22:19:51.223032 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-29 22:19:51.224617 | mon1 | Wednesday 29 April 2026 22:19:51 +0000 (0:00:00.553) 0:00:19.010 ******* 2026-04-29 22:19:51.927493 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-04-29 22:19:51.927565 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-29 22:19:51.927576 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-29 22:19:51.927592 | mon1 | 2026-04-29 22:19:51.928097 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-29 22:19:51.928138 | mon1 | Wednesday 29 April 2026 22:19:51 +0000 (0:00:00.703) 0:00:19.714 ******* 2026-04-29 22:19:52.493001 | mon1 | ok: [mon1] 2026-04-29 22:19:52.493080 | mon1 | 2026-04-29 22:19:52.493262 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-29 22:19:52.493465 | mon1 | Wednesday 29 April 2026 22:19:52 +0000 (0:00:00.565) 0:00:20.280 ******* 2026-04-29 22:19:53.040883 | mon1 | ok: [mon1] 2026-04-29 22:19:53.040937 | mon1 | 2026-04-29 22:19:53.040948 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-29 22:19:53.040958 | mon1 | Wednesday 29 April 2026 22:19:53 +0000 (0:00:00.539) 0:00:20.819 ******* 2026-04-29 22:19:53.040966 | mon1 | 2026-04-29 22:19:53.040975 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-29 22:19:53.040984 | mon1 | Wednesday 29 April 2026 22:19:53 +0000 (0:00:00.007) 0:00:20.827 ******* 2026-04-29 22:19:53.483888 | mon1 | ok: [mon1] 2026-04-29 22:19:53.483931 | mon1 | 2026-04-29 22:19:53.483938 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-29 22:19:53.483945 | mon1 | Wednesday 29 April 2026 22:19:53 +0000 (0:00:00.444) 0:00:21.271 ******* 2026-04-29 22:19:53.539806 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-29 22:19:53.539842 | mon1 | 2026-04-29 22:19:53.539852 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-29 22:19:53.539862 | mon1 | Wednesday 29 April 2026 22:19:53 +0000 (0:00:00.056) 0:00:21.327 ******* 2026-04-29 22:19:54.561693 | mon1 | ok: [mon1] 2026-04-29 22:19:54.561753 | mon1 | 2026-04-29 22:19:54.561865 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-29 22:19:54.562003 | mon1 | Wednesday 29 April 2026 22:19:54 +0000 (0:00:01.019) 0:00:22.347 ******* 2026-04-29 22:19:55.356689 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-29 22:19:55.356782 | mon1 | ok: [mon1] => (item=ssh) 2026-04-29 22:19:55.356940 | mon1 | 2026-04-29 22:19:55.357324 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-29 22:19:55.357365 | mon1 | Wednesday 29 April 2026 22:19:55 +0000 (0:00:00.797) 0:00:23.145 ******* 2026-04-29 22:19:55.736059 | mon1 | ok: [mon1] 2026-04-29 22:19:55.736089 | mon1 | 2026-04-29 22:19:55.736094 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-29 22:19:55.736098 | mon1 | Wednesday 29 April 2026 22:19:55 +0000 (0:00:00.378) 0:00:23.523 ******* 2026-04-29 22:19:55.972929 | mon1 | ok: [mon1] 2026-04-29 22:19:55.972967 | mon1 | 2026-04-29 22:19:55.972972 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-29 22:19:55.972977 | mon1 | Wednesday 29 April 2026 22:19:55 +0000 (0:00:00.234) 0:00:23.758 ******* 2026-04-29 22:19:56.420988 | mon1 | ok: [mon1] 2026-04-29 22:19:56.421020 | mon1 | 2026-04-29 22:19:56.421025 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-29 22:19:56.421029 | mon1 | Wednesday 29 April 2026 22:19:56 +0000 (0:00:00.449) 0:00:24.208 ******* 2026-04-29 22:19:56.834814 | mon1 | ok: [mon1] 2026-04-29 22:19:56.834856 | mon1 | 2026-04-29 22:19:56.834884 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-29 22:19:56.834894 | mon1 | Wednesday 29 April 2026 22:19:56 +0000 (0:00:00.414) 0:00:24.622 ******* 2026-04-29 22:19:56.914687 | mon1 | ok: [mon1] 2026-04-29 22:19:56.914727 | mon1 | 2026-04-29 22:19:56.914762 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-29 22:19:56.914772 | mon1 | Wednesday 29 April 2026 22:19:56 +0000 (0:00:00.079) 0:00:24.701 ******* 2026-04-29 22:19:57.191213 | mon1 | ok: [mon1] => (item=mon1) 2026-04-29 22:19:57.191280 | mon1 | 2026-04-29 22:19:57.191286 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-29 22:19:57.191291 | mon1 | Wednesday 29 April 2026 22:19:57 +0000 (0:00:00.277) 0:00:24.978 ******* 2026-04-29 22:19:57.246789 | mon1 | ok: [mon1] 2026-04-29 22:19:57.246834 | mon1 | 2026-04-29 22:19:57.246844 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-29 22:19:57.246854 | mon1 | Wednesday 29 April 2026 22:19:57 +0000 (0:00:00.055) 0:00:25.034 ******* 2026-04-29 22:19:57.288558 | mon1 | skipping: [mon1] 2026-04-29 22:19:57.288589 | mon1 | 2026-04-29 22:19:57.288600 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:19:57.288609 | mon1 | Wednesday 29 April 2026 22:19:57 +0000 (0:00:00.041) 0:00:25.075 ******* 2026-04-29 22:19:57.363811 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-29 22:19:57.363858 | mon1 | 2026-04-29 22:19:57.363868 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:19:57.363878 | mon1 | Wednesday 29 April 2026 22:19:57 +0000 (0:00:00.074) 0:00:25.150 ******* 2026-04-29 22:20:03.809785 | mon1 | ok: [mon1] 2026-04-29 22:20:03.809839 | mon1 | 2026-04-29 22:20:03.809853 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:20:03.809865 | mon1 | Wednesday 29 April 2026 22:20:03 +0000 (0:00:06.446) 0:00:31.596 ******* 2026-04-29 22:20:03.875401 | mon1 | ok: [mon1] => (item=mon1) 2026-04-29 22:20:03.875462 | mon1 | 2026-04-29 22:20:03.875468 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:20:03.875474 | mon1 | Wednesday 29 April 2026 22:20:03 +0000 (0:00:00.065) 0:00:31.662 ******* 2026-04-29 22:20:04.375426 | mon1 | ok: [mon1] 2026-04-29 22:20:04.375498 | mon1 | 2026-04-29 22:20:04.375512 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:20:04.375637 | mon1 | Wednesday 29 April 2026 22:20:04 +0000 (0:00:00.500) 0:00:32.162 ******* 2026-04-29 22:20:11.294449 | mon1 | ok: [mon1] 2026-04-29 22:20:11.294631 | mon1 | 2026-04-29 22:20:11.294840 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-29 22:20:11.295150 | mon1 | Wednesday 29 April 2026 22:20:11 +0000 (0:00:06.920) 0:00:39.083 ******* 2026-04-29 22:20:18.002933 | mon1 | ok: [mon1] 2026-04-29 22:20:18.002995 | mon1 | 2026-04-29 22:20:18.003010 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-29 22:20:18.003022 | mon1 | Wednesday 29 April 2026 22:20:17 +0000 (0:00:06.706) 0:00:45.789 ******* 2026-04-29 22:20:32.422314 | mon1 | ok: [mon1] 2026-04-29 22:20:32.422445 | mon1 | 2026-04-29 22:20:32.422878 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:20:32.423270 | mon1 | Wednesday 29 April 2026 22:20:32 +0000 (0:00:14.420) 0:01:00.210 ******* 2026-04-29 22:20:32.493114 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-29 22:20:32.493181 | mon1 | 2026-04-29 22:20:32.493196 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:20:32.493210 | mon1 | Wednesday 29 April 2026 22:20:32 +0000 (0:00:00.069) 0:01:00.279 ******* 2026-04-29 22:20:32.545588 | mon1 | skipping: [mon1] 2026-04-29 22:20:32.545620 | mon1 | 2026-04-29 22:20:32.545634 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:20:32.545645 | mon1 | Wednesday 29 April 2026 22:20:32 +0000 (0:00:00.053) 0:01:00.332 ******* 2026-04-29 22:20:32.597435 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-29 22:20:32.597544 | mon1 | skipping: [mon1] 2026-04-29 22:20:32.597558 | mon1 | 2026-04-29 22:20:32.597571 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:20:32.597584 | mon1 | Wednesday 29 April 2026 22:20:32 +0000 (0:00:00.052) 0:01:00.384 ******* 2026-04-29 22:20:32.917669 | mon1 | ok: [mon1] 2026-04-29 22:20:32.917729 | mon1 | 2026-04-29 22:20:32.917740 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:20:32.917749 | mon1 | Wednesday 29 April 2026 22:20:32 +0000 (0:00:00.319) 0:01:00.704 ******* 2026-04-29 22:20:39.802792 | mon1 | ok: [mon1] 2026-04-29 22:20:39.802849 | mon1 | 2026-04-29 22:20:39.802864 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-29 22:20:39.802877 | mon1 | Wednesday 29 April 2026 22:20:39 +0000 (0:00:06.886) 0:01:07.590 ******* 2026-04-29 22:20:46.350493 | mon1 | ok: [mon1] 2026-04-29 22:20:46.350555 | mon1 | 2026-04-29 22:20:46.350565 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-29 22:20:46.350574 | mon1 | Wednesday 29 April 2026 22:20:46 +0000 (0:00:06.547) 0:01:14.138 ******* 2026-04-29 22:20:52.697682 | mon1 | ok: [mon1] 2026-04-29 22:20:52.697756 | mon1 | 2026-04-29 22:20:52.697841 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-29 22:20:52.697949 | mon1 | Wednesday 29 April 2026 22:20:52 +0000 (0:00:06.347) 0:01:20.485 ******* 2026-04-29 22:21:01.076305 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-29 22:21:01.076379 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-29 22:21:01.076393 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-04-29 22:21:01.076405 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-29 22:21:01.076417 | mon1 | 2026-04-29 22:21:01.076429 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-29 22:21:01.076441 | mon1 | 2026-04-29 22:21:01.076453 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:21:01.076685 | mon1 | Wednesday 29 April 2026 22:21:01 +0000 (0:00:08.376) 0:01:28.862 ******* 2026-04-29 22:21:02.331991 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-29 22:21:02.332297 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:21:02.332505 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:21:02.332705 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:21:02.332904 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:21:02.345720 | mon1 | ok: [osd1] 2026-04-29 22:21:02.345969 | mon1 | 2026-04-29 22:21:02.346186 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:21:02.346418 | mon1 | Wednesday 29 April 2026 22:21:02 +0000 (0:00:01.271) 0:01:30.133 ******* 2026-04-29 22:21:02.609125 | mon1 | ok: [osd1] 2026-04-29 22:21:02.609574 | mon1 | 2026-04-29 22:21:02.609910 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:21:02.610284 | mon1 | Wednesday 29 April 2026 22:21:02 +0000 (0:00:00.262) 0:01:30.396 ******* 2026-04-29 22:21:02.651922 | mon1 | skipping: [osd1] 2026-04-29 22:21:02.652316 | mon1 | 2026-04-29 22:21:02.652658 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-29 22:21:02.652984 | mon1 | Wednesday 29 April 2026 22:21:02 +0000 (0:00:00.043) 0:01:30.439 ******* 2026-04-29 22:21:02.913191 | mon1 | ok: [osd1] 2026-04-29 22:21:02.913659 | mon1 | 2026-04-29 22:21:02.913988 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:21:02.914362 | mon1 | Wednesday 29 April 2026 22:21:02 +0000 (0:00:00.260) 0:01:30.700 ******* 2026-04-29 22:21:02.996704 | mon1 | ok: [osd1] => { 2026-04-29 22:21:02.997117 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-29 22:21:02.997502 | mon1 | } 2026-04-29 22:21:02.997794 | mon1 | 2026-04-29 22:21:02.998456 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:21:02.998485 | mon1 | Wednesday 29 April 2026 22:21:02 +0000 (0:00:00.083) 0:01:30.784 ******* 2026-04-29 22:21:03.404434 | mon1 | ok: [osd1] 2026-04-29 22:21:03.404499 | mon1 | 2026-04-29 22:21:03.404512 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:21:03.404553 | mon1 | Wednesday 29 April 2026 22:21:03 +0000 (0:00:00.407) 0:01:31.191 ******* 2026-04-29 22:21:03.451988 | mon1 | skipping: [osd1] 2026-04-29 22:21:03.452147 | mon1 | 2026-04-29 22:21:03.452467 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:21:03.452695 | mon1 | Wednesday 29 April 2026 22:21:03 +0000 (0:00:00.048) 0:01:31.240 ******* 2026-04-29 22:21:03.500772 | mon1 | skipping: [osd1] 2026-04-29 22:21:03.500967 | mon1 | 2026-04-29 22:21:03.501386 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:21:03.501668 | mon1 | Wednesday 29 April 2026 22:21:03 +0000 (0:00:00.048) 0:01:31.289 ******* 2026-04-29 22:21:03.758213 | mon1 | ok: [osd1] 2026-04-29 22:21:03.758460 | mon1 | 2026-04-29 22:21:03.758767 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-29 22:21:03.759045 | mon1 | Wednesday 29 April 2026 22:21:03 +0000 (0:00:00.257) 0:01:31.546 ******* 2026-04-29 22:21:05.145451 | mon1 | ok: [osd1] 2026-04-29 22:21:05.145554 | mon1 | 2026-04-29 22:21:05.145565 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:21:05.145583 | mon1 | Wednesday 29 April 2026 22:21:05 +0000 (0:00:01.386) 0:01:32.932 ******* 2026-04-29 22:21:05.330788 | mon1 | ok: [osd1] => { 2026-04-29 22:21:05.330894 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-29 22:21:05.331012 | mon1 | } 2026-04-29 22:21:05.331178 | mon1 | 2026-04-29 22:21:05.331388 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:21:05.331543 | mon1 | Wednesday 29 April 2026 22:21:05 +0000 (0:00:00.184) 0:01:33.117 ******* 2026-04-29 22:21:05.910524 | mon1 | ok: [osd1] 2026-04-29 22:21:05.910604 | mon1 | 2026-04-29 22:21:05.910702 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:21:05.910827 | mon1 | Wednesday 29 April 2026 22:21:05 +0000 (0:00:00.581) 0:01:33.698 ******* 2026-04-29 22:21:08.218055 | mon1 | ok: [osd1] 2026-04-29 22:21:08.218101 | mon1 | 2026-04-29 22:21:08.218108 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-29 22:21:08.218114 | mon1 | Wednesday 29 April 2026 22:21:08 +0000 (0:00:02.307) 0:01:36.006 ******* 2026-04-29 22:21:08.248845 | mon1 | skipping: [osd1] 2026-04-29 22:21:08.248877 | mon1 | 2026-04-29 22:21:08.248883 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-29 22:21:08.248889 | mon1 | Wednesday 29 April 2026 22:21:08 +0000 (0:00:00.029) 0:01:36.035 ******* 2026-04-29 22:21:08.279901 | mon1 | skipping: [osd1] 2026-04-29 22:21:08.279925 | mon1 | 2026-04-29 22:21:08.279933 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-29 22:21:08.279941 | mon1 | Wednesday 29 April 2026 22:21:08 +0000 (0:00:00.032) 0:01:36.068 ******* 2026-04-29 22:21:08.316579 | mon1 | skipping: [osd1] 2026-04-29 22:21:08.316799 | mon1 | 2026-04-29 22:21:08.317010 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-29 22:21:08.317255 | mon1 | Wednesday 29 April 2026 22:21:08 +0000 (0:00:00.036) 0:01:36.104 ******* 2026-04-29 22:21:09.511714 | mon1 | ok: [osd1] 2026-04-29 22:21:09.515655 | mon1 | 2026-04-29 22:21:09.515677 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-29 22:21:09.515682 | mon1 | Wednesday 29 April 2026 22:21:09 +0000 (0:00:01.195) 0:01:37.300 ******* 2026-04-29 22:21:10.073375 | mon1 | ok: [osd1] 2026-04-29 22:21:10.073426 | mon1 | 2026-04-29 22:21:10.073434 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-29 22:21:10.073442 | mon1 | Wednesday 29 April 2026 22:21:10 +0000 (0:00:00.561) 0:01:37.861 ******* 2026-04-29 22:21:11.228293 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-29 22:21:11.228350 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-29 22:21:11.228357 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-29 22:21:11.228374 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-29 22:21:11.228378 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-29 22:21:11.228382 | mon1 | 2026-04-29 22:21:11.228386 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-29 22:21:11.228390 | mon1 | Wednesday 29 April 2026 22:21:11 +0000 (0:00:01.151) 0:01:39.013 ******* 2026-04-29 22:21:11.922745 | mon1 | ok: [osd1] 2026-04-29 22:21:11.922855 | mon1 | 2026-04-29 22:21:11.922873 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-29 22:21:11.923381 | mon1 | Wednesday 29 April 2026 22:21:11 +0000 (0:00:00.690) 0:01:39.704 ******* 2026-04-29 22:21:11.923431 | mon1 | 2026-04-29 22:21:11.923437 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-29 22:21:11.923442 | mon1 | Wednesday 29 April 2026 22:21:11 +0000 (0:00:00.007) 0:01:39.711 ******* 2026-04-29 22:21:12.379952 | mon1 | ok: [osd1] 2026-04-29 22:21:12.380008 | mon1 | 2026-04-29 22:21:12.380022 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-29 22:21:12.380035 | mon1 | Wednesday 29 April 2026 22:21:12 +0000 (0:00:00.455) 0:01:40.166 ******* 2026-04-29 22:21:12.656376 | mon1 | ok: [osd1] 2026-04-29 22:21:12.656492 | mon1 | 2026-04-29 22:21:12.656516 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-29 22:21:12.656875 | mon1 | Wednesday 29 April 2026 22:21:12 +0000 (0:00:00.276) 0:01:40.443 ******* 2026-04-29 22:21:12.738396 | mon1 | ok: [osd1] => { 2026-04-29 22:21:12.738471 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-29 22:21:12.738485 | mon1 | } 2026-04-29 22:21:12.738497 | mon1 | 2026-04-29 22:21:12.738510 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-29 22:21:12.738658 | mon1 | Wednesday 29 April 2026 22:21:12 +0000 (0:00:00.081) 0:01:40.524 ******* 2026-04-29 22:21:13.162820 | mon1 | ok: [osd1] 2026-04-29 22:21:13.162890 | mon1 | 2026-04-29 22:21:13.162904 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-29 22:21:13.162916 | mon1 | Wednesday 29 April 2026 22:21:13 +0000 (0:00:00.424) 0:01:40.949 ******* 2026-04-29 22:21:16.494529 | mon1 | ok: [osd1] 2026-04-29 22:21:16.494755 | mon1 | 2026-04-29 22:21:16.495108 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-29 22:21:16.495499 | mon1 | Wednesday 29 April 2026 22:21:16 +0000 (0:00:03.332) 0:01:44.282 ******* 2026-04-29 22:21:17.601162 | mon1 | ok: [osd1] 2026-04-29 22:21:17.601270 | mon1 | 2026-04-29 22:21:17.601289 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-29 22:21:17.601301 | mon1 | Wednesday 29 April 2026 22:21:17 +0000 (0:00:01.106) 0:01:45.388 ******* 2026-04-29 22:21:17.861452 | mon1 | ok: [osd1] 2026-04-29 22:21:17.861555 | mon1 | 2026-04-29 22:21:17.861578 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-29 22:21:17.861736 | mon1 | Wednesday 29 April 2026 22:21:17 +0000 (0:00:00.260) 0:01:45.648 ******* 2026-04-29 22:21:18.433294 | mon1 | ok: [osd1] 2026-04-29 22:21:18.433460 | mon1 | 2026-04-29 22:21:18.433783 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-29 22:21:18.434080 | mon1 | Wednesday 29 April 2026 22:21:18 +0000 (0:00:00.572) 0:01:46.221 ******* 2026-04-29 22:21:19.163008 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-04-29 22:21:19.163186 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-29 22:21:19.163536 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-29 22:21:19.163759 | mon1 | 2026-04-29 22:21:19.163959 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-29 22:21:19.164204 | mon1 | Wednesday 29 April 2026 22:21:19 +0000 (0:00:00.729) 0:01:46.951 ******* 2026-04-29 22:21:19.732264 | mon1 | ok: [osd1] 2026-04-29 22:21:19.732467 | mon1 | 2026-04-29 22:21:19.732747 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-29 22:21:19.733025 | mon1 | Wednesday 29 April 2026 22:21:19 +0000 (0:00:00.568) 0:01:47.520 ******* 2026-04-29 22:21:20.310335 | mon1 | ok: [osd1] 2026-04-29 22:21:20.310566 | mon1 | 2026-04-29 22:21:20.310844 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-29 22:21:20.311092 | mon1 | Wednesday 29 April 2026 22:21:20 +0000 (0:00:00.566) 0:01:48.086 ******* 2026-04-29 22:21:20.311344 | mon1 | 2026-04-29 22:21:20.311593 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-29 22:21:20.311834 | mon1 | Wednesday 29 April 2026 22:21:20 +0000 (0:00:00.011) 0:01:48.098 ******* 2026-04-29 22:21:20.771093 | mon1 | ok: [osd1] 2026-04-29 22:21:20.771530 | mon1 | 2026-04-29 22:21:20.771795 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-29 22:21:20.772069 | mon1 | Wednesday 29 April 2026 22:21:20 +0000 (0:00:00.460) 0:01:48.559 ******* 2026-04-29 22:21:20.831688 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-29 22:21:20.831753 | mon1 | 2026-04-29 22:21:20.831996 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-29 22:21:20.832122 | mon1 | Wednesday 29 April 2026 22:21:20 +0000 (0:00:00.060) 0:01:48.620 ******* 2026-04-29 22:21:22.179447 | mon1 | ok: [osd1] 2026-04-29 22:21:22.179558 | mon1 | 2026-04-29 22:21:22.179828 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-29 22:21:22.180069 | mon1 | Wednesday 29 April 2026 22:21:22 +0000 (0:00:01.347) 0:01:49.967 ******* 2026-04-29 22:21:23.007761 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-29 22:21:23.007843 | mon1 | ok: [osd1] => (item=ssh) 2026-04-29 22:21:23.008004 | mon1 | 2026-04-29 22:21:23.008209 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-29 22:21:23.008419 | mon1 | Wednesday 29 April 2026 22:21:23 +0000 (0:00:00.828) 0:01:50.796 ******* 2026-04-29 22:21:23.405422 | mon1 | ok: [osd1] 2026-04-29 22:21:23.405516 | mon1 | 2026-04-29 22:21:23.406017 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-29 22:21:23.406089 | mon1 | Wednesday 29 April 2026 22:21:23 +0000 (0:00:00.397) 0:01:51.193 ******* 2026-04-29 22:21:23.663678 | mon1 | ok: [osd1] 2026-04-29 22:21:23.663773 | mon1 | 2026-04-29 22:21:23.663787 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-29 22:21:23.663800 | mon1 | Wednesday 29 April 2026 22:21:23 +0000 (0:00:00.256) 0:01:51.449 ******* 2026-04-29 22:21:23.979222 | mon1 | ok: [osd1] 2026-04-29 22:21:23.979354 | mon1 | 2026-04-29 22:21:23.979367 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-29 22:21:23.979380 | mon1 | Wednesday 29 April 2026 22:21:23 +0000 (0:00:00.315) 0:01:51.765 ******* 2026-04-29 22:21:24.238111 | mon1 | ok: [osd1] 2026-04-29 22:21:24.238185 | mon1 | 2026-04-29 22:21:24.238199 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-29 22:21:24.238262 | mon1 | Wednesday 29 April 2026 22:21:24 +0000 (0:00:00.258) 0:01:52.024 ******* 2026-04-29 22:21:24.526410 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-29 22:21:24.526486 | mon1 | 2026-04-29 22:21:24.527079 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-29 22:21:24.527166 | mon1 | Wednesday 29 April 2026 22:21:24 +0000 (0:00:00.288) 0:01:52.313 ******* 2026-04-29 22:21:24.583059 | mon1 | ok: [osd1] 2026-04-29 22:21:24.583138 | mon1 | 2026-04-29 22:21:24.583151 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-29 22:21:24.583164 | mon1 | Wednesday 29 April 2026 22:21:24 +0000 (0:00:00.056) 0:01:52.369 ******* 2026-04-29 22:21:24.655564 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-29 22:21:24.655628 | mon1 | 2026-04-29 22:21:24.655637 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-29 22:21:24.655667 | mon1 | Wednesday 29 April 2026 22:21:24 +0000 (0:00:00.072) 0:01:52.442 ******* 2026-04-29 22:21:30.973713 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:21:30.973782 | mon1 | 2026-04-29 22:21:30.973797 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-29 22:21:30.973811 | mon1 | Wednesday 29 April 2026 22:21:30 +0000 (0:00:06.318) 0:01:58.761 ******* 2026-04-29 22:21:31.026329 | mon1 | ok: [osd1] => (item=osd1) 2026-04-29 22:21:31.026381 | mon1 | 2026-04-29 22:21:31.026390 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-29 22:21:31.026399 | mon1 | Wednesday 29 April 2026 22:21:31 +0000 (0:00:00.052) 0:01:58.813 ******* 2026-04-29 22:21:31.378805 | mon1 | ok: [osd1] 2026-04-29 22:21:31.378860 | mon1 | 2026-04-29 22:21:31.378874 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-29 22:21:31.378886 | mon1 | Wednesday 29 April 2026 22:21:31 +0000 (0:00:00.352) 0:01:59.166 ******* 2026-04-29 22:21:38.295673 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:21:38.295748 | mon1 | 2026-04-29 22:21:38.295841 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-29 22:21:38.295952 | mon1 | Wednesday 29 April 2026 22:21:38 +0000 (0:00:06.916) 0:02:06.082 ******* 2026-04-29 22:21:43.958706 | mon1 | ok: [osd1] 2026-04-29 22:21:43.958800 | mon1 | 2026-04-29 22:21:43.958824 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-29 22:21:43.958965 | mon1 | Wednesday 29 April 2026 22:21:43 +0000 (0:00:05.664) 0:02:11.747 ******* 2026-04-29 22:22:06.416064 | mon1 | ok: [osd1] 2026-04-29 22:22:06.416159 | mon1 | 2026-04-29 22:22:06.416173 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-29 22:22:06.416186 | mon1 | Wednesday 29 April 2026 22:22:06 +0000 (0:00:22.455) 0:02:34.203 ******* 2026-04-29 22:22:06.498116 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-04-29 22:22:06.498217 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-04-29 22:22:06.498263 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-04-29 22:22:06.498276 | mon1 | skipping: [osd1] 2026-04-29 22:22:06.498290 | mon1 | 2026-04-29 22:22:06.498303 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-29 22:22:06.498317 | mon1 | Wednesday 29 April 2026 22:22:06 +0000 (0:00:00.080) 0:02:34.283 ******* 2026-04-29 22:22:12.928791 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:22:12.928836 | mon1 | 2026-04-29 22:22:12.928843 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-29 22:22:12.928848 | mon1 | Wednesday 29 April 2026 22:22:12 +0000 (0:00:06.431) 0:02:40.715 ******* 2026-04-29 22:22:19.273705 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:22:19.273785 | mon1 | 2026-04-29 22:22:19.274102 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-29 22:22:19.274126 | mon1 | Wednesday 29 April 2026 22:22:19 +0000 (0:00:06.346) 0:02:47.061 ******* 2026-04-29 22:22:19.343662 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-29 22:22:19.343716 | mon1 | 2026-04-29 22:22:19.343730 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-29 22:22:19.343742 | mon1 | Wednesday 29 April 2026 22:22:19 +0000 (0:00:00.068) 0:02:47.130 ******* 2026-04-29 22:22:19.392306 | mon1 | ok: [osd1] 2026-04-29 22:22:19.392364 | mon1 | 2026-04-29 22:22:19.392505 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-29 22:22:19.392719 | mon1 | Wednesday 29 April 2026 22:22:19 +0000 (0:00:00.049) 0:02:47.180 ******* 2026-04-29 22:22:25.743030 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-29 22:22:25.744022 | mon1 | 2026-04-29 22:22:25.744055 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-29 22:22:25.744068 | mon1 | Wednesday 29 April 2026 22:22:25 +0000 (0:00:06.350) 0:02:53.530 ******* 2026-04-29 22:22:25.789332 | mon1 | ok: [osd1] 2026-04-29 22:22:25.789383 | mon1 | 2026-04-29 22:22:25.789848 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-29 22:22:25.789872 | mon1 | Wednesday 29 April 2026 22:22:25 +0000 (0:00:00.046) 0:02:53.576 ******* 2026-04-29 22:22:25.829701 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:22:25.829773 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:22:25.829895 | mon1 | skipping: [osd1] => (item=1) 2026-04-29 22:22:25.830002 | mon1 | skipping: [osd1] 2026-04-29 22:22:25.830110 | mon1 | 2026-04-29 22:22:25.830249 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-29 22:22:25.830347 | mon1 | Wednesday 29 April 2026 22:22:25 +0000 (0:00:00.040) 0:02:53.617 ******* 2026-04-29 22:22:25.876313 | mon1 | skipping: [osd1] 2026-04-29 22:22:25.876394 | mon1 | 2026-04-29 22:22:25.876405 | mon1 | PLAY RECAP ********************************************************************* 2026-04-29 22:22:25.876418 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-29 22:22:25.876428 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-29 22:22:25.876439 | mon1 | 2026-04-29 22:22:25.876448 | mon1 | 2026-04-29 22:22:25.876505 | mon1 | TASKS RECAP ******************************************************************** 2026-04-29 22:22:25.876864 | mon1 | Wednesday 29 April 2026 22:22:25 +0000 (0:00:00.044) 0:02:53.662 ******* 2026-04-29 22:22:25.877174 | mon1 | =============================================================================== 2026-04-29 22:22:25.877532 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.46s 2026-04-29 22:22:25.877895 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.42s 2026-04-29 22:22:25.878217 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.38s 2026-04-29 22:22:25.878583 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.92s 2026-04-29 22:22:25.878903 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.92s 2026-04-29 22:22:25.879265 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.89s 2026-04-29 22:22:25.879654 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.71s 2026-04-29 22:22:25.879984 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.55s 2026-04-29 22:22:25.880344 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.45s 2026-04-29 22:22:25.880675 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.43s 2026-04-29 22:22:25.880992 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.35s 2026-04-29 22:22:25.881346 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.35s 2026-04-29 22:22:25.881676 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.35s 2026-04-29 22:22:25.882062 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.32s 2026-04-29 22:22:25.882406 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.66s 2026-04-29 22:22:25.882599 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s 2026-04-29 22:22:25.882785 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.33s 2026-04-29 22:22:25.882972 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.51s 2026-04-29 22:22:25.883157 | mon1 | Gathering Facts --------------------------------------------------------- 2.31s 2026-04-29 22:22:25.883367 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.31s 2026-04-29 22:22:25.988689 | mon1 | INFO [default > idempotence] Executed: Successful 2026-04-29 22:22:25.998693 | mon1 | INFO [default > side_effect] Executing 2026-04-29 22:22:25.999116 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-29 22:22:26.004953 | mon1 | INFO [default > verify] Executing 2026-04-29 22:22:26.733927 | mon1 | 2026-04-29 22:22:26.734360 | mon1 | PLAY [Verify] ****************************************************************** 2026-04-29 22:22:26.734662 | mon1 | 2026-04-29 22:22:26.734969 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-29 22:22:26.735307 | mon1 | Wednesday 29 April 2026 22:22:26 +0000 (0:00:00.007) 0:00:00.007 ******* 2026-04-29 22:22:29.958848 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-29 22:22:29.959051 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-29 22:22:29.959188 | mon1 | interpreter could change the meaning of that path. See 2026-04-29 22:22:29.959347 | mon1 | https://docs.ansible.com/ansible- 2026-04-29 22:22:29.959489 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-29 22:22:29.968264 | mon1 | ok: [mon1] 2026-04-29 22:22:29.968457 | mon1 | 2026-04-29 22:22:29.968646 | mon1 | TASK [Get cluster health status] *********************************************** 2026-04-29 22:22:29.968834 | mon1 | Wednesday 29 April 2026 22:22:29 +0000 (0:00:03.234) 0:00:03.242 ******* 2026-04-29 22:22:40.746436 | mon1 | ok: [mon1] 2026-04-29 22:22:40.746774 | mon1 | 2026-04-29 22:22:40.747082 | mon1 | TASK [Print cluster health status] ********************************************* 2026-04-29 22:22:40.747481 | mon1 | Wednesday 29 April 2026 22:22:40 +0000 (0:00:10.777) 0:00:14.020 ******* 2026-04-29 22:22:40.776421 | mon1 | ok: [mon1] => { 2026-04-29 22:22:40.776493 | mon1 | "_ceph_health": { 2026-04-29 22:22:40.776507 | mon1 | "changed": false, 2026-04-29 22:22:40.776518 | mon1 | "cmd": [ 2026-04-29 22:22:40.776536 | mon1 | "cephadm", 2026-04-29 22:22:40.776646 | mon1 | "shell", 2026-04-29 22:22:40.776859 | mon1 | "--", 2026-04-29 22:22:40.777085 | mon1 | "ceph", 2026-04-29 22:22:40.777355 | mon1 | "health" 2026-04-29 22:22:40.777583 | mon1 | ], 2026-04-29 22:22:40.777824 | mon1 | "delta": "0:00:10.437528", 2026-04-29 22:22:40.778060 | mon1 | "end": "2026-04-29 22:22:40.701032", 2026-04-29 22:22:40.778339 | mon1 | "failed": false, 2026-04-29 22:22:40.778574 | mon1 | "msg": "", 2026-04-29 22:22:40.778803 | mon1 | "rc": 0, 2026-04-29 22:22:40.779036 | mon1 | "start": "2026-04-29 22:22:30.263504", 2026-04-29 22:22:40.779328 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-04-29 22:22:40.779582 | mon1 | "stderr_lines": [ 2026-04-29 22:22:40.779822 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-04-29 22:22:40.780075 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-04-29 22:22:40.780339 | mon1 | ], 2026-04-29 22:22:40.780580 | mon1 | "stdout": "HEALTH_OK", 2026-04-29 22:22:40.780813 | mon1 | "stdout_lines": [ 2026-04-29 22:22:40.781044 | mon1 | "HEALTH_OK" 2026-04-29 22:22:40.781295 | mon1 | ] 2026-04-29 22:22:40.781553 | mon1 | } 2026-04-29 22:22:40.781755 | mon1 | } 2026-04-29 22:22:40.781971 | mon1 | 2026-04-29 22:22:40.782210 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-04-29 22:22:40.782484 | mon1 | Wednesday 29 April 2026 22:22:40 +0000 (0:00:00.028) 0:00:14.049 ******* 2026-04-29 22:22:40.804572 | mon1 | ok: [mon1] => { 2026-04-29 22:22:40.804786 | mon1 | "changed": false, 2026-04-29 22:22:40.805040 | mon1 | "msg": "All assertions passed" 2026-04-29 22:22:40.805323 | mon1 | } 2026-04-29 22:22:40.805549 | mon1 | 2026-04-29 22:22:40.805785 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-04-29 22:22:40.806026 | mon1 | Wednesday 29 April 2026 22:22:40 +0000 (0:00:00.029) 0:00:14.078 ******* 2026-04-29 22:22:47.702913 | mon1 | changed: [mon1] 2026-04-29 22:22:47.703119 | mon1 | 2026-04-29 22:22:47.703429 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-04-29 22:22:47.703665 | mon1 | Wednesday 29 April 2026 22:22:47 +0000 (0:00:06.898) 0:00:20.976 ******* 2026-04-29 22:22:50.597916 | mon1 | changed: [mon1] 2026-04-29 22:22:50.598097 | mon1 | 2026-04-29 22:22:50.598403 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-04-29 22:22:50.598657 | mon1 | Wednesday 29 April 2026 22:22:50 +0000 (0:00:02.894) 0:00:23.870 ******* 2026-04-29 22:22:52.054708 | mon1 | ok: [mon1] 2026-04-29 22:22:52.054917 | mon1 | 2026-04-29 22:22:52.055183 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-04-29 22:22:52.055554 | mon1 | Wednesday 29 April 2026 22:22:52 +0000 (0:00:01.456) 0:00:25.327 ******* 2026-04-29 22:22:52.096019 | mon1 | ok: [mon1] => { 2026-04-29 22:22:52.096301 | mon1 | "changed": false, 2026-04-29 22:22:52.096561 | mon1 | "msg": "All assertions passed" 2026-04-29 22:22:52.096798 | mon1 | } 2026-04-29 22:22:52.097052 | mon1 | 2026-04-29 22:22:52.097324 | mon1 | PLAY RECAP ********************************************************************* 2026-04-29 22:22:52.097589 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-29 22:22:52.097811 | mon1 | 2026-04-29 22:22:52.098026 | mon1 | 2026-04-29 22:22:52.098958 | mon1 | TASKS RECAP ******************************************************************** 2026-04-29 22:22:52.099219 | mon1 | Wednesday 29 April 2026 22:22:52 +0000 (0:00:00.042) 0:00:25.370 ******* 2026-04-29 22:22:52.099473 | mon1 | =============================================================================== 2026-04-29 22:22:52.099904 | mon1 | Get cluster health status ---------------------------------------------- 10.78s 2026-04-29 22:22:52.100387 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.90s 2026-04-29 22:22:52.101083 | mon1 | Gathering Facts --------------------------------------------------------- 3.23s 2026-04-29 22:22:52.101560 | mon1 | Create a test Ceph key -------------------------------------------------- 2.89s 2026-04-29 22:22:52.101854 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.46s 2026-04-29 22:22:52.102102 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-04-29 22:22:52.102398 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-04-29 22:22:52.102630 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-04-29 22:22:52.202655 | mon1 | INFO [default > verify] Executed: Successful 2026-04-29 22:22:52.211478 | mon1 | INFO [default > cleanup] Executing 2026-04-29 22:22:52.211882 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-29 22:22:52.219778 | mon1 | INFO [default > destroy] Executing 2026-04-29 22:22:52.219863 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-29 22:22:52.219933 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-29 22:22:52.220183 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-04-29 22:23:02.786398 | mon1 | ok: Runtime: 0:12:53.973221 2026-04-29 22:23:02.798460 | 2026-04-29 22:23:02.798559 | PLAY RECAP 2026-04-29 22:23:02.798611 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-29 22:23:02.798637 | 2026-04-29 22:23:02.927124 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-29 22:23:02.930774 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-29 22:23:03.620505 | 2026-04-29 22:23:03.620699 | PLAY [all] 2026-04-29 22:23:03.637530 | 2026-04-29 22:23:03.637760 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-29 22:23:03.697081 | mon1 | ok 2026-04-29 22:23:03.715552 | osd1 | ok 2026-04-29 22:23:03.724724 | 2026-04-29 22:23:03.724838 | TASK [fetch-output : Set log path for single node] 2026-04-29 22:23:03.753030 | mon1 | skipping: Conditional result was False 2026-04-29 22:23:03.764240 | osd1 | skipping: Conditional result was False 2026-04-29 22:23:03.775539 | 2026-04-29 22:23:03.775613 | LOOP [fetch-output : Ensure local output dirs] 2026-04-29 22:23:04.179200 | osd1 -> localhost | changed: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/logs/osd1" 2026-04-29 22:23:04.194419 | mon1 -> localhost | changed: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/logs/mon1" 2026-04-29 22:23:04.420121 | osd1 -> localhost | changed: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/artifacts" 2026-04-29 22:23:04.452227 | mon1 -> localhost | ok: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/artifacts" 2026-04-29 22:23:04.660242 | osd1 -> localhost | changed: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/docs" 2026-04-29 22:23:04.694882 | mon1 -> localhost | ok: "/var/lib/zuul/builds/80e49f13f0894ad9b8a9a5e2775c505b/work/docs" 2026-04-29 22:23:04.695031 | mon1 -> localhost | changed: All items complete 2026-04-29 22:23:04.695096 | 2026-04-29 22:23:04.714950 | 2026-04-29 22:23:04.715132 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-29 22:23:05.369624 | mon1 | changed: .d..t...... ./ 2026-04-29 22:23:05.415142 | osd1 | changed: .d..t...... ./ 2026-04-29 22:23:05.854845 | mon1 | changed: .d..t...... ./ 2026-04-29 22:23:05.887762 | osd1 | ok 2026-04-29 22:23:06.353897 | mon1 | changed: .d..t...... ./ 2026-04-29 22:23:06.362861 | osd1 | ok 2026-04-29 22:23:06.389761 | 2026-04-29 22:23:06.389906 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-29 22:23:06.820267 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006159 2026-04-29 22:23:06.820468 | mon1 -> localhost | changed: All items complete 2026-04-29 22:23:06.820497 | 2026-04-29 22:23:07.051045 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008963 2026-04-29 22:23:07.074804 | 2026-04-29 22:23:07.074927 | PLAY [all] 2026-04-29 22:23:07.081683 | 2026-04-29 22:23:07.081757 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-29 22:23:07.554423 | mon1 | changed 2026-04-29 22:23:07.798288 | osd1 | changed 2026-04-29 22:23:07.811466 | 2026-04-29 22:23:07.811527 | PLAY RECAP 2026-04-29 22:23:07.811570 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-29 22:23:07.811601 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-29 22:23:07.811637 | 2026-04-29 22:23:07.941180 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-29 22:23:07.945279 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-29 22:23:08.548258 | 2026-04-29 22:23:08.548392 | PLAY [localhost] 2026-04-29 22:23:08.558789 | 2026-04-29 22:23:08.558875 | TASK [Generate Zuul manifest] 2026-04-29 22:23:08.581588 | localhost | ok 2026-04-29 22:23:08.597883 | 2026-04-29 22:23:08.597979 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-29 22:23:09.055470 | localhost | changed 2026-04-29 22:23:09.068863 | 2026-04-29 22:23:09.068987 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-29 22:23:09.111476 | localhost | ok 2026-04-29 22:23:09.121074 | 2026-04-29 22:23:09.121166 | TASK [Upload logs] 2026-04-29 22:23:09.141194 | localhost | ok 2026-04-29 22:23:09.205136 | 2026-04-29 22:23:09.205275 | TASK [Set zuul-log-path fact] 2026-04-29 22:23:09.227200 | localhost | ok 2026-04-29 22:23:09.244630 | 2026-04-29 22:23:09.244740 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-29 22:23:09.275874 | localhost | ok 2026-04-29 22:23:09.283173 | 2026-04-29 22:23:09.283252 | TASK [upload-logs : Create log directories] 2026-04-29 22:23:09.711430 | localhost | changed 2026-04-29 22:23:09.719220 | 2026-04-29 22:23:09.719353 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-29 22:23:10.170952 | localhost -> localhost | ok: Runtime: 0:00:00.006433 2026-04-29 22:23:10.176807 | 2026-04-29 22:23:10.176886 | TASK [upload-logs : Upload logs to log server] 2026-04-29 22:23:10.664530 | localhost | Output suppressed because no_log was given 2026-04-29 22:23:10.672127 | 2026-04-29 22:23:10.672246 | LOOP [upload-logs : Compress console log and json output] 2026-04-29 22:23:10.766520 | localhost | skipping: Conditional result was False 2026-04-29 22:23:10.773052 | localhost | skipping: Conditional result was False 2026-04-29 22:23:10.794011 | 2026-04-29 22:23:10.794190 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-29 22:23:10.880210 | localhost | skipping: Conditional result was False 2026-04-29 22:23:10.880641 | 2026-04-29 22:23:10.884172 | localhost | skipping: Conditional result was False 2026-04-29 22:23:10.967935 | 2026-04-29 22:23:10.968669 | LOOP [upload-logs : Upload console log and json output]