2026-03-05 21:38:27.714113 | Job console starting 2026-03-05 21:38:27.796027 | Updating git repos 2026-03-05 21:38:27.818707 | Cloning repos into workspace 2026-03-05 21:38:28.021191 | Restoring repo states 2026-03-05 21:38:28.029051 | Merging changes 2026-03-05 21:38:28.387434 | Checking out repos 2026-03-05 21:38:28.454582 | Preparing playbooks 2026-03-05 21:38:30.122083 | Running Ansible setup 2026-03-05 21:38:35.642785 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:36.266837 | 2026-03-05 21:38:36.280861 | PLAY [localhost] 2026-03-05 21:38:36.291974 | 2026-03-05 21:38:36.292089 | TASK [Gathering Facts] 2026-03-05 21:38:37.136431 | localhost | ok 2026-03-05 21:38:37.146906 | 2026-03-05 21:38:37.147047 | TASK [Setup log path fact] 2026-03-05 21:38:37.168906 | localhost | ok 2026-03-05 21:38:37.184028 | 2026-03-05 21:38:37.184141 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:38:37.215140 | localhost | ok 2026-03-05 21:38:37.228258 | 2026-03-05 21:38:37.228426 | TASK [emit-job-header : Print job information] 2026-03-05 21:38:37.270325 | # Job Information 2026-03-05 21:38:37.270549 | Ansible Version: 2.16.16 2026-03-05 21:38:37.270617 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-05 21:38:37.270666 | Pipeline: check 2026-03-05 21:38:37.270710 | Executor: 0a8996d2b663 2026-03-05 21:38:37.270753 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/95 2026-03-05 21:38:37.270803 | Event ID: 753cf340-18d7-11f1-84a2-1dadd23b4000 2026-03-05 21:38:37.274705 | 2026-03-05 21:38:37.274802 | LOOP [emit-job-header : Print node information] 2026-03-05 21:38:37.377850 | localhost | ok: 2026-03-05 21:38:37.378096 | localhost | # Node Information 2026-03-05 21:38:37.378137 | localhost | Inventory Hostname: mon1 2026-03-05 21:38:37.378167 | localhost | Hostname: np0000157961 2026-03-05 21:38:37.378194 | localhost | Username: zuul 2026-03-05 21:38:37.378225 | localhost | Distro: Ubuntu 24.04 2026-03-05 21:38:37.378252 | localhost | Provider: yul1 2026-03-05 21:38:37.378280 | localhost | Region: ca-ymq-1 2026-03-05 21:38:37.378306 | localhost | Label: ubuntu-noble 2026-03-05 21:38:37.378331 | localhost | Product Name: OpenStack Nova 2026-03-05 21:38:37.378357 | localhost | Interface IP: 199.204.45.116 2026-03-05 21:38:37.426030 | localhost | ok: 2026-03-05 21:38:37.426138 | localhost | # Node Information 2026-03-05 21:38:37.426198 | localhost | Inventory Hostname: osd1 2026-03-05 21:38:37.426248 | localhost | Hostname: np0000157962 2026-03-05 21:38:37.426292 | localhost | Username: zuul 2026-03-05 21:38:37.426453 | localhost | Distro: Ubuntu 24.04 2026-03-05 21:38:37.426528 | localhost | Provider: yul1 2026-03-05 21:38:37.426574 | localhost | Region: ca-ymq-1 2026-03-05 21:38:37.426617 | localhost | Label: ubuntu-noble 2026-03-05 21:38:37.426658 | localhost | Product Name: OpenStack Nova 2026-03-05 21:38:37.426700 | localhost | Interface IP: 199.204.45.4 2026-03-05 21:38:37.444412 | 2026-03-05 21:38:37.444638 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 21:38:37.814810 | localhost -> localhost | changed 2026-03-05 21:38:37.822095 | 2026-03-05 21:38:37.822186 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 21:38:38.629411 | localhost -> localhost | changed 2026-03-05 21:38:38.638210 | 2026-03-05 21:38:38.638301 | PLAY [all] 2026-03-05 21:38:38.648193 | 2026-03-05 21:38:38.648280 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 21:38:38.875012 | mon1 -> localhost | ok 2026-03-05 21:38:38.883355 | 2026-03-05 21:38:38.883450 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 21:38:38.920709 | mon1 | ok 2026-03-05 21:38:38.927539 | osd1 | ok 2026-03-05 21:38:38.952850 | mon1 | included: /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:38:38.952926 | osd1 | included: /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 21:38:38.959300 | 2026-03-05 21:38:38.959364 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 21:38:39.864907 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 21:38:39.865114 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/d5ac4ca2319d42d1bd9077e53b3aa2fa_id_rsa 2026-03-05 21:38:39.865146 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/d5ac4ca2319d42d1bd9077e53b3aa2fa_id_rsa.pub 2026-03-05 21:38:39.865170 | mon1 -> localhost | The key fingerprint is: 2026-03-05 21:38:39.865192 | mon1 -> localhost | SHA256:Fdhk418wM0r/k2Sn1UuI3UjqnA7zanc2yrtqcmldv7c zuul-build-sshkey 2026-03-05 21:38:39.865213 | mon1 -> localhost | The key's randomart image is: 2026-03-05 21:38:39.865233 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 21:38:39.865254 | mon1 -> localhost | | +* =. | 2026-03-05 21:38:39.865274 | mon1 -> localhost | | .+.===+ .| 2026-03-05 21:38:39.865294 | mon1 -> localhost | | +o.++o+| 2026-03-05 21:38:39.865314 | mon1 -> localhost | | .o..=.=.| 2026-03-05 21:38:39.865334 | mon1 -> localhost | | So +. =. | 2026-03-05 21:38:39.865354 | mon1 -> localhost | | = . . | 2026-03-05 21:38:39.865374 | mon1 -> localhost | | oo. . | 2026-03-05 21:38:39.865394 | mon1 -> localhost | | . *oo + ..| 2026-03-05 21:38:39.865413 | mon1 -> localhost | | *oo=* .E+| 2026-03-05 21:38:39.865433 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 21:38:39.865477 | mon1 -> localhost | ok: Runtime: 0:00:00.517494 2026-03-05 21:38:39.872208 | 2026-03-05 21:38:39.872277 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 21:38:39.909102 | mon1 | ok 2026-03-05 21:38:39.929088 | osd1 | ok 2026-03-05 21:38:39.947135 | mon1 | included: /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:38:39.947189 | osd1 | included: /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 21:38:39.957465 | 2026-03-05 21:38:39.957527 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 21:38:39.983911 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:39.995249 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:40.006573 | 2026-03-05 21:38:40.006742 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 21:38:40.521405 | mon1 | changed 2026-03-05 21:38:40.526772 | osd1 | changed 2026-03-05 21:38:40.531817 | 2026-03-05 21:38:40.531880 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 21:38:40.748548 | mon1 | ok 2026-03-05 21:38:40.768263 | osd1 | ok 2026-03-05 21:38:40.776378 | 2026-03-05 21:38:40.776466 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 21:38:41.328309 | mon1 | changed 2026-03-05 21:38:41.334300 | osd1 | changed 2026-03-05 21:38:41.339498 | 2026-03-05 21:38:41.339558 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 21:38:41.923956 | mon1 | changed 2026-03-05 21:38:41.933714 | osd1 | changed 2026-03-05 21:38:41.939334 | 2026-03-05 21:38:41.939411 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 21:38:41.964719 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:41.975764 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:41.985898 | 2026-03-05 21:38:41.985987 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 21:38:42.295746 | mon1 -> localhost | changed 2026-03-05 21:38:42.322195 | 2026-03-05 21:38:42.322423 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 21:38:42.593751 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/d5ac4ca2319d42d1bd9077e53b3aa2fa_id_rsa (zuul-build-sshkey) 2026-03-05 21:38:42.593966 | mon1 -> localhost | ok: Runtime: 0:00:00.013456 2026-03-05 21:38:42.599383 | 2026-03-05 21:38:42.599444 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 21:38:42.888580 | osd1 | ok 2026-03-05 21:38:42.894172 | mon1 | ok 2026-03-05 21:38:42.899004 | 2026-03-05 21:38:42.899073 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 21:38:42.934726 | mon1 | skipping: Conditional result was False 2026-03-05 21:38:42.935636 | osd1 | skipping: Conditional result was False 2026-03-05 21:38:42.961077 | 2026-03-05 21:38:42.961207 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 21:38:43.269506 | osd1 | ok 2026-03-05 21:38:43.308861 | mon1 | ok 2026-03-05 21:38:43.317669 | 2026-03-05 21:38:43.317740 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 21:38:44.119981 | osd1 | Output suppressed because no_log was given 2026-03-05 21:38:44.150515 | mon1 | Output suppressed because no_log was given 2026-03-05 21:38:44.168149 | 2026-03-05 21:38:44.168233 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 21:38:44.381299 | mon1 | ok: "logs" 2026-03-05 21:38:44.381574 | mon1 | ok: All items complete 2026-03-05 21:38:44.381615 | 2026-03-05 21:38:44.397248 | osd1 | ok: "logs" 2026-03-05 21:38:44.574762 | mon1 | ok: "artifacts" 2026-03-05 21:38:44.590590 | osd1 | ok: "artifacts" 2026-03-05 21:38:44.765370 | mon1 | ok: "docs" 2026-03-05 21:38:44.782736 | osd1 | ok: "docs" 2026-03-05 21:38:44.804375 | 2026-03-05 21:38:44.804509 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 21:38:45.033496 | mon1 | changed: "logs" 2026-03-05 21:38:45.033756 | mon1 | ok: All items complete 2026-03-05 21:38:45.033790 | 2026-03-05 21:38:45.038862 | osd1 | changed: "logs" 2026-03-05 21:38:45.227572 | osd1 | changed: "artifacts" 2026-03-05 21:38:45.241285 | mon1 | changed: "artifacts" 2026-03-05 21:38:45.436108 | osd1 | changed: "docs" 2026-03-05 21:38:45.441445 | mon1 | changed: "docs" 2026-03-05 21:38:45.463067 | 2026-03-05 21:38:45.463187 | PLAY RECAP 2026-03-05 21:38:45.463252 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:45.463296 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:45.463333 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 21:38:45.463362 | 2026-03-05 21:38:45.596768 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 21:38:45.601575 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:46.176463 | 2026-03-05 21:38:46.176574 | PLAY [all] 2026-03-05 21:38:46.188048 | 2026-03-05 21:38:46.188121 | TASK [setup-uv : Extract archive] 2026-03-05 21:38:48.556388 | mon1 | changed 2026-03-05 21:38:48.561499 | osd1 | changed 2026-03-05 21:38:48.567576 | 2026-03-05 21:38:48.567650 | TASK [setup-uv : Print version] 2026-03-05 21:38:47.792350 | mon1 | uv 0.8.13 2026-03-05 21:38:47.567740 | osd1 | uv 0.8.13 2026-03-05 21:38:49.137920 | mon1 | ok: Runtime: 0:00:00.019668 2026-03-05 21:38:49.147224 | osd1 | ok: Runtime: 0:00:00.019725 2026-03-05 21:38:49.159765 | 2026-03-05 21:38:49.159816 | PLAY RECAP 2026-03-05 21:38:49.159860 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:49.159888 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:38:49.159906 | 2026-03-05 21:38:49.281308 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 21:38:49.287873 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:38:49.826731 | 2026-03-05 21:38:49.826844 | PLAY [all] 2026-03-05 21:38:49.838083 | 2026-03-05 21:38:49.838169 | TASK [Copy inventory file for Zuul] 2026-03-05 21:38:50.765561 | mon1 | changed 2026-03-05 21:38:50.772751 | 2026-03-05 21:38:50.772844 | TASK [Switch "ansible_host" to private IP] 2026-03-05 21:38:51.109782 | mon1 | changed: 2 replacements made 2026-03-05 21:38:51.117328 | 2026-03-05 21:38:51.117411 | TASK [Run Molecule scenario] 2026-03-05 21:38:50.405102 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-05 21:38:50.405282 | mon1 | Creating virtual environment at: .venv 2026-03-05 21:38:51.797987 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 21:38:51.809662 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 21:38:51.810507 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 21:38:51.832731 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 21:38:51.991189 | mon1 | Downloading netaddr 2026-03-05 21:38:52.001816 | mon1 | Downloading cryptography 2026-03-05 21:38:52.057289 | mon1 | Downloading pygments 2026-03-05 21:38:52.226715 | mon1 | Downloading ansible-core 2026-03-05 21:38:52.269227 | mon1 | Installed 37 packages in 41ms 2026-03-05 21:38:53.029793 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 21:38:53.029852 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 21:38:53.671976 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 21:38:53.672035 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 21:39:05.225726 | mon1 | INFO [default > dependency] Executing 2026-03-05 21:39:05.226002 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 21:39:05.226302 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 21:39:05.226409 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 21:39:05.233033 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:39:05.233399 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:05.238988 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:39:05.239022 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:39:05.239039 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:39:05.244711 | mon1 | INFO [default > syntax] Executing 2026-03-05 21:39:06.275948 | mon1 | 2026-03-05 21:39:06.276272 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 21:39:06.326415 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 21:39:06.335916 | mon1 | INFO [default > create] Executing 2026-03-05 21:39:06.338639 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:39:06.345661 | mon1 | INFO [default > prepare] Executing 2026-03-05 21:39:07.125170 | mon1 | 2026-03-05 21:39:07.125341 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 21:39:07.125623 | mon1 | 2026-03-05 21:39:07.125875 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:07.126130 | mon1 | Thursday 05 March 2026 21:39:07 +0000 (0:00:00.035) 0:00:00.035 ******** 2026-03-05 21:39:08.382530 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:39:08.382652 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:39:08.382807 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:08.382956 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:08.383134 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:08.387980 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:39:08.388156 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:39:08.388302 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:08.388450 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:08.388602 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:08.396729 | mon1 | ok: [mon1] 2026-03-05 21:39:08.396869 | mon1 | ok: [osd1] 2026-03-05 21:39:08.397039 | mon1 | 2026-03-05 21:39:08.397324 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 21:39:08.397564 | mon1 | Thursday 05 March 2026 21:39:08 +0000 (0:00:01.272) 0:00:01.308 ******** 2026-03-05 21:39:09.144048 | mon1 | changed: [osd1] 2026-03-05 21:39:09.144323 | mon1 | changed: [mon1] 2026-03-05 21:39:09.144561 | mon1 | 2026-03-05 21:39:09.144822 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 21:39:09.145124 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.746) 0:00:02.054 ******** 2026-03-05 21:39:09.453715 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 21:39:09.453774 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 21:39:09.453784 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 21:39:09.483038 | mon1 | changed: [osd1] 2026-03-05 21:39:09.483135 | mon1 | changed: [mon1] 2026-03-05 21:39:09.483150 | mon1 | 2026-03-05 21:39:09.483160 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 21:39:09.483169 | mon1 | Thursday 05 March 2026 21:39:09 +0000 (0:00:00.337) 0:00:02.392 ******** 2026-03-05 21:39:16.213294 | mon1 | changed: [osd1] 2026-03-05 21:39:16.213384 | mon1 | changed: [mon1] 2026-03-05 21:39:16.213523 | mon1 | 2026-03-05 21:39:16.213816 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 21:39:16.214033 | mon1 | 2026-03-05 21:39:16.214343 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:16.214599 | mon1 | Thursday 05 March 2026 21:39:16 +0000 (0:00:06.731) 0:00:09.124 ******** 2026-03-05 21:39:17.008263 | mon1 | ok: [osd1] 2026-03-05 21:39:17.008417 | mon1 | 2026-03-05 21:39:17.008658 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 21:39:17.008900 | mon1 | Thursday 05 March 2026 21:39:17 +0000 (0:00:00.795) 0:00:09.919 ******** 2026-03-05 21:39:35.891450 | mon1 | changed: [osd1] 2026-03-05 21:39:35.891545 | mon1 | 2026-03-05 21:39:35.891563 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 21:39:35.891699 | mon1 | Thursday 05 March 2026 21:39:35 +0000 (0:00:18.883) 0:00:28.802 ******** 2026-03-05 21:39:36.546338 | mon1 | ok: [osd1] 2026-03-05 21:39:36.546433 | mon1 | 2026-03-05 21:39:36.546447 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 21:39:36.546567 | mon1 | Thursday 05 March 2026 21:39:36 +0000 (0:00:00.654) 0:00:29.456 ******** 2026-03-05 21:39:36.897961 | mon1 | ok: [osd1] 2026-03-05 21:39:36.898120 | mon1 | 2026-03-05 21:39:36.898281 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 21:39:36.898397 | mon1 | Thursday 05 March 2026 21:39:36 +0000 (0:00:00.352) 0:00:29.809 ******** 2026-03-05 21:39:37.677656 | mon1 | changed: [osd1] 2026-03-05 21:39:37.678066 | mon1 | 2026-03-05 21:39:37.678707 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 21:39:37.678730 | mon1 | Thursday 05 March 2026 21:39:37 +0000 (0:00:00.779) 0:00:30.588 ******** 2026-03-05 21:39:37.923259 | mon1 | ok: [osd1] 2026-03-05 21:39:37.923495 | mon1 | 2026-03-05 21:39:37.923760 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 21:39:37.924008 | mon1 | Thursday 05 March 2026 21:39:37 +0000 (0:00:00.245) 0:00:30.833 ******** 2026-03-05 21:39:37.946872 | mon1 | skipping: [osd1] 2026-03-05 21:39:37.947083 | mon1 | 2026-03-05 21:39:37.947379 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 21:39:37.947625 | mon1 | Thursday 05 March 2026 21:39:37 +0000 (0:00:00.024) 0:00:30.858 ******** 2026-03-05 21:39:38.633951 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:38.634126 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:38.634373 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:38.634511 | mon1 | 2026-03-05 21:39:38.634677 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 21:39:38.634825 | mon1 | Thursday 05 March 2026 21:39:38 +0000 (0:00:00.686) 0:00:31.544 ******** 2026-03-05 21:39:39.399646 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:39.399860 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:39.400118 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:39.400384 | mon1 | 2026-03-05 21:39:39.400640 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 21:39:39.400921 | mon1 | Thursday 05 March 2026 21:39:39 +0000 (0:00:00.765) 0:00:32.309 ******** 2026-03-05 21:39:40.234209 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:40.234366 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:40.234620 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:40.234840 | mon1 | 2026-03-05 21:39:40.235129 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:39:40.235365 | mon1 | Thursday 05 March 2026 21:39:40 +0000 (0:00:00.834) 0:00:33.144 ******** 2026-03-05 21:39:41.728003 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:39:41.728169 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:39:41.728490 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:39:41.728709 | mon1 | 2026-03-05 21:39:41.728957 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:39:41.729219 | mon1 | Thursday 05 March 2026 21:39:41 +0000 (0:00:01.493) 0:00:34.638 ******** 2026-03-05 21:39:43.139604 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 21:39:43.140011 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 21:39:43.140031 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 21:39:43.140301 | mon1 | 2026-03-05 21:39:43.141432 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:39:43.141453 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:39:43.141462 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:39:43.141471 | mon1 | 2026-03-05 21:39:43.141483 | mon1 | 2026-03-05 21:39:43.141709 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:39:43.141957 | mon1 | Thursday 05 March 2026 21:39:43 +0000 (0:00:01.412) 0:00:36.050 ******** 2026-03-05 21:39:43.142211 | mon1 | =============================================================================== 2026-03-05 21:39:43.142446 | mon1 | Install depedencies ---------------------------------------------------- 18.88s 2026-03-05 21:39:43.142685 | mon1 | Update apt cache -------------------------------------------------------- 6.73s 2026-03-05 21:39:43.142933 | mon1 | Create a volume group for each loop device ------------------------------ 1.49s 2026-03-05 21:39:43.143223 | mon1 | Create a logical volume for each loop device ---------------------------- 1.41s 2026-03-05 21:39:43.143467 | mon1 | Gathering Facts --------------------------------------------------------- 1.27s 2026-03-05 21:39:43.143706 | mon1 | Start loop devices ------------------------------------------------------ 0.83s 2026-03-05 21:39:43.143951 | mon1 | Gathering Facts --------------------------------------------------------- 0.80s 2026-03-05 21:39:43.144216 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.78s 2026-03-05 21:39:43.144470 | mon1 | Set permissions on loopback devices ------------------------------------- 0.77s 2026-03-05 21:39:43.144789 | mon1 | Configure short hostname ------------------------------------------------ 0.75s 2026-03-05 21:39:43.144984 | mon1 | Create devices for Ceph ------------------------------------------------- 0.69s 2026-03-05 21:39:43.145239 | mon1 | Start up service -------------------------------------------------------- 0.65s 2026-03-05 21:39:43.145527 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s 2026-03-05 21:39:43.145763 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.34s 2026-03-05 21:39:43.146028 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-03-05 21:39:43.146290 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 21:39:43.228778 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 21:39:43.238704 | mon1 | INFO [default > converge] Executing 2026-03-05 21:39:44.271556 | mon1 | 2026-03-05 21:39:44.271738 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:39:44.271955 | mon1 | 2026-03-05 21:39:44.272260 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:39:44.272512 | mon1 | Thursday 05 March 2026 21:39:44 +0000 (0:00:00.054) 0:00:00.054 ******** 2026-03-05 21:39:45.345839 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:39:45.346050 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:39:45.346336 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:39:45.346571 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:39:45.346814 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:39:45.359449 | mon1 | ok: [mon1] 2026-03-05 21:39:45.359665 | mon1 | 2026-03-05 21:39:45.359913 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:45.360190 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:01.087) 0:00:01.142 ******** 2026-03-05 21:39:45.715544 | mon1 | ok: [mon1] 2026-03-05 21:39:45.715761 | mon1 | 2026-03-05 21:39:45.716016 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:45.716295 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.355) 0:00:01.498 ******** 2026-03-05 21:39:45.760781 | mon1 | skipping: [mon1] 2026-03-05 21:39:45.761013 | mon1 | 2026-03-05 21:39:45.761354 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:39:45.761630 | mon1 | Thursday 05 March 2026 21:39:45 +0000 (0:00:00.045) 0:00:01.543 ******** 2026-03-05 21:39:46.117950 | mon1 | changed: [mon1] 2026-03-05 21:39:46.118234 | mon1 | 2026-03-05 21:39:46.118433 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:46.118678 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.356) 0:00:01.900 ******** 2026-03-05 21:39:46.224180 | mon1 | ok: [mon1] => { 2026-03-05 21:39:46.224430 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:39:46.224661 | mon1 | } 2026-03-05 21:39:46.224876 | mon1 | 2026-03-05 21:39:46.225157 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:46.225404 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.106) 0:00:02.006 ******** 2026-03-05 21:39:46.973583 | mon1 | changed: [mon1] 2026-03-05 21:39:46.973666 | mon1 | 2026-03-05 21:39:46.977116 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:46.977130 | mon1 | Thursday 05 March 2026 21:39:46 +0000 (0:00:00.748) 0:00:02.755 ******** 2026-03-05 21:39:47.018847 | mon1 | skipping: [mon1] 2026-03-05 21:39:47.019064 | mon1 | 2026-03-05 21:39:47.019349 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:47.019590 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.046) 0:00:02.801 ******** 2026-03-05 21:39:47.063564 | mon1 | skipping: [mon1] 2026-03-05 21:39:47.063781 | mon1 | 2026-03-05 21:39:47.064022 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:39:47.064300 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.044) 0:00:02.846 ******** 2026-03-05 21:39:47.335028 | mon1 | ok: [mon1] 2026-03-05 21:39:47.335299 | mon1 | 2026-03-05 21:39:47.335547 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:39:47.335792 | mon1 | Thursday 05 March 2026 21:39:47 +0000 (0:00:00.270) 0:00:03.117 ******** 2026-03-05 21:39:48.467874 | mon1 | ok: [mon1] 2026-03-05 21:39:48.468056 | mon1 | 2026-03-05 21:39:48.468355 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:39:48.468600 | mon1 | Thursday 05 March 2026 21:39:48 +0000 (0:00:01.132) 0:00:04.250 ******** 2026-03-05 21:39:48.657571 | mon1 | ok: [mon1] => { 2026-03-05 21:39:48.657759 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:39:48.658001 | mon1 | } 2026-03-05 21:39:48.658268 | mon1 | 2026-03-05 21:39:48.658515 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:39:48.658765 | mon1 | Thursday 05 March 2026 21:39:48 +0000 (0:00:00.190) 0:00:04.440 ******** 2026-03-05 21:39:49.543822 | mon1 | changed: [mon1] 2026-03-05 21:39:49.543985 | mon1 | 2026-03-05 21:39:49.544313 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:39:49.544547 | mon1 | Thursday 05 March 2026 21:39:49 +0000 (0:00:00.885) 0:00:05.326 ******** 2026-03-05 21:39:52.716571 | mon1 | changed: [mon1] 2026-03-05 21:39:52.716642 | mon1 | 2026-03-05 21:39:52.716914 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:39:52.716956 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:03.172) 0:00:08.498 ******** 2026-03-05 21:39:52.751810 | mon1 | skipping: [mon1] 2026-03-05 21:39:52.751866 | mon1 | 2026-03-05 21:39:52.751876 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:39:52.751886 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:00.034) 0:00:08.532 ******** 2026-03-05 21:39:52.777117 | mon1 | skipping: [mon1] 2026-03-05 21:39:52.777177 | mon1 | 2026-03-05 21:39:52.777182 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:39:52.777188 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:00.025) 0:00:08.558 ******** 2026-03-05 21:39:52.805685 | mon1 | skipping: [mon1] 2026-03-05 21:39:52.805698 | mon1 | 2026-03-05 21:39:52.805702 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:39:52.805707 | mon1 | Thursday 05 March 2026 21:39:52 +0000 (0:00:00.028) 0:00:08.587 ******** 2026-03-05 21:39:59.825856 | mon1 | changed: [mon1] 2026-03-05 21:39:59.825984 | mon1 | 2026-03-05 21:39:59.825997 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:39:59.826009 | mon1 | Thursday 05 March 2026 21:39:59 +0000 (0:00:07.019) 0:00:15.606 ******** 2026-03-05 21:40:00.529905 | mon1 | changed: [mon1] 2026-03-05 21:40:00.529999 | mon1 | 2026-03-05 21:40:00.530013 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:40:00.530026 | mon1 | Thursday 05 March 2026 21:40:00 +0000 (0:00:00.703) 0:00:16.310 ******** 2026-03-05 21:40:01.647228 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:40:01.647337 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:40:01.648840 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:40:01.648912 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:40:01.648925 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:40:01.648938 | mon1 | 2026-03-05 21:40:01.648950 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:40:01.648962 | mon1 | Thursday 05 March 2026 21:40:01 +0000 (0:00:01.117) 0:00:17.428 ******** 2026-03-05 21:40:02.367530 | mon1 | changed: [mon1] 2026-03-05 21:40:02.368023 | mon1 | 2026-03-05 21:40:02.368030 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:40:02.368036 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.709) 0:00:18.138 ******** 2026-03-05 21:40:02.368042 | mon1 | 2026-03-05 21:40:02.368047 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:40:02.368057 | mon1 | Thursday 05 March 2026 21:40:02 +0000 (0:00:00.007) 0:00:18.145 ******** 2026-03-05 21:40:03.472194 | mon1 | ok: [mon1] 2026-03-05 21:40:03.472244 | mon1 | 2026-03-05 21:40:03.472250 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:40:03.472258 | mon1 | Thursday 05 March 2026 21:40:03 +0000 (0:00:01.108) 0:00:19.254 ******** 2026-03-05 21:40:04.048646 | mon1 | changed: [mon1] 2026-03-05 21:40:04.048753 | mon1 | 2026-03-05 21:40:04.048876 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:40:04.049567 | mon1 | Thursday 05 March 2026 21:40:04 +0000 (0:00:00.576) 0:00:19.830 ******** 2026-03-05 21:40:04.760386 | mon1 | changed: [mon1] 2026-03-05 21:40:04.760563 | mon1 | 2026-03-05 21:40:04.760817 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:40:04.761067 | mon1 | Thursday 05 March 2026 21:40:04 +0000 (0:00:00.712) 0:00:20.542 ******** 2026-03-05 21:40:05.017884 | mon1 | ok: [mon1] 2026-03-05 21:40:05.018074 | mon1 | 2026-03-05 21:40:05.018369 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:40:05.018674 | mon1 | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.257) 0:00:20.800 ******** 2026-03-05 21:40:05.093389 | mon1 | ok: [mon1] => { 2026-03-05 21:40:05.093641 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:40:05.093873 | mon1 | } 2026-03-05 21:40:05.094120 | mon1 | 2026-03-05 21:40:05.094382 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:40:05.094681 | mon1 | Thursday 05 March 2026 21:40:05 +0000 (0:00:00.075) 0:00:20.876 ******** 2026-03-05 21:40:06.209696 | mon1 | changed: [mon1] 2026-03-05 21:40:06.209841 | mon1 | 2026-03-05 21:40:06.210155 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:40:06.210433 | mon1 | Thursday 05 March 2026 21:40:06 +0000 (0:00:01.115) 0:00:21.991 ******** 2026-03-05 21:40:10.894973 | mon1 | changed: [mon1] 2026-03-05 21:40:10.895197 | mon1 | 2026-03-05 21:40:10.895459 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:40:10.895705 | mon1 | Thursday 05 March 2026 21:40:10 +0000 (0:00:04.684) 0:00:26.676 ******** 2026-03-05 21:40:11.857028 | mon1 | ok: [mon1] 2026-03-05 21:40:11.857217 | mon1 | 2026-03-05 21:40:11.857491 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:40:11.857749 | mon1 | Thursday 05 March 2026 21:40:11 +0000 (0:00:00.962) 0:00:27.639 ******** 2026-03-05 21:40:12.252200 | mon1 | changed: [mon1] 2026-03-05 21:40:12.252331 | mon1 | 2026-03-05 21:40:12.252347 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:40:12.252361 | mon1 | Thursday 05 March 2026 21:40:12 +0000 (0:00:00.394) 0:00:28.033 ******** 2026-03-05 21:40:12.856607 | mon1 | changed: [mon1] 2026-03-05 21:40:12.856672 | mon1 | 2026-03-05 21:40:12.856686 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:40:12.856700 | mon1 | Thursday 05 March 2026 21:40:12 +0000 (0:00:00.603) 0:00:28.637 ******** 2026-03-05 21:40:13.553239 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:40:13.553318 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:40:13.553332 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:40:13.553344 | mon1 | 2026-03-05 21:40:13.553364 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:40:13.553688 | mon1 | Thursday 05 March 2026 21:40:13 +0000 (0:00:00.695) 0:00:29.333 ******** 2026-03-05 21:40:14.126879 | mon1 | changed: [mon1] 2026-03-05 21:40:14.126954 | mon1 | 2026-03-05 21:40:14.127354 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:40:14.127404 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.574) 0:00:29.908 ******** 2026-03-05 21:40:14.710232 | mon1 | changed: [mon1] 2026-03-05 21:40:14.710328 | mon1 | 2026-03-05 21:40:14.710443 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:40:14.710693 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.575) 0:00:30.483 ******** 2026-03-05 21:40:14.710912 | mon1 | 2026-03-05 21:40:14.711215 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:40:14.711471 | mon1 | Thursday 05 March 2026 21:40:14 +0000 (0:00:00.007) 0:00:30.491 ******** 2026-03-05 21:40:15.587659 | mon1 | ok: [mon1] 2026-03-05 21:40:15.587746 | mon1 | 2026-03-05 21:40:15.587789 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:40:15.589222 | mon1 | Thursday 05 March 2026 21:40:15 +0000 (0:00:00.878) 0:00:31.369 ******** 2026-03-05 21:40:16.763274 | mon1 | changed: [mon1] 2026-03-05 21:40:16.763360 | mon1 | 2026-03-05 21:40:16.763376 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:40:16.763398 | mon1 | Thursday 05 March 2026 21:40:16 +0000 (0:00:01.175) 0:00:32.545 ******** 2026-03-05 21:40:17.477170 | mon1 | changed: [mon1] 2026-03-05 21:40:17.477390 | mon1 | 2026-03-05 21:40:17.477658 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:40:17.477902 | mon1 | Thursday 05 March 2026 21:40:17 +0000 (0:00:00.714) 0:00:33.259 ******** 2026-03-05 21:40:17.549508 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:40:17.549726 | mon1 | 2026-03-05 21:40:17.550040 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:40:17.550427 | mon1 | Thursday 05 March 2026 21:40:17 +0000 (0:00:00.068) 0:00:33.328 ******** 2026-03-05 21:40:36.941143 | mon1 | changed: [mon1] 2026-03-05 21:40:36.941219 | mon1 | 2026-03-05 21:40:36.941230 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:40:36.941241 | mon1 | Thursday 05 March 2026 21:40:36 +0000 (0:00:19.394) 0:00:52.722 ******** 2026-03-05 21:40:37.768415 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:40:37.768518 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:40:37.768542 | mon1 | 2026-03-05 21:40:37.768608 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:40:37.768753 | mon1 | Thursday 05 March 2026 21:40:37 +0000 (0:00:00.828) 0:00:53.550 ******** 2026-03-05 21:40:38.589579 | mon1 | changed: [mon1] 2026-03-05 21:40:38.589645 | mon1 | 2026-03-05 21:40:38.589893 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:40:38.589943 | mon1 | Thursday 05 March 2026 21:40:38 +0000 (0:00:00.821) 0:00:54.372 ******** 2026-03-05 21:40:38.840261 | mon1 | ok: [mon1] 2026-03-05 21:40:38.840317 | mon1 | 2026-03-05 21:40:38.840826 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:40:38.840878 | mon1 | Thursday 05 March 2026 21:40:38 +0000 (0:00:00.249) 0:00:54.621 ******** 2026-03-05 21:40:39.410851 | mon1 | changed: [mon1] 2026-03-05 21:40:39.410919 | mon1 | 2026-03-05 21:40:39.410932 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:40:39.410945 | mon1 | Thursday 05 March 2026 21:40:39 +0000 (0:00:00.570) 0:00:55.191 ******** 2026-03-05 21:40:39.793261 | mon1 | changed: [mon1] 2026-03-05 21:40:39.793327 | mon1 | 2026-03-05 21:40:39.794037 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:40:39.794131 | mon1 | Thursday 05 March 2026 21:40:39 +0000 (0:00:00.383) 0:00:55.575 ******** 2026-03-05 21:40:39.923390 | mon1 | ok: [mon1] 2026-03-05 21:40:39.923424 | mon1 | 2026-03-05 21:40:39.923437 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:40:39.923449 | mon1 | Thursday 05 March 2026 21:40:39 +0000 (0:00:00.129) 0:00:55.704 ******** 2026-03-05 21:40:40.187270 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:40:40.187347 | mon1 | 2026-03-05 21:40:40.187361 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:40:40.187382 | mon1 | Thursday 05 March 2026 21:40:40 +0000 (0:00:00.264) 0:00:55.968 ******** 2026-03-05 21:40:40.240857 | mon1 | ok: [mon1] 2026-03-05 21:40:40.240922 | mon1 | 2026-03-05 21:40:40.240936 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:40:40.240949 | mon1 | Thursday 05 March 2026 21:40:40 +0000 (0:00:00.053) 0:00:56.022 ******** 2026-03-05 21:40:40.355772 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:40:40.355858 | mon1 | 2026-03-05 21:40:40.355869 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:40:40.355878 | mon1 | Thursday 05 March 2026 21:40:40 +0000 (0:00:00.114) 0:00:56.136 ******** 2026-03-05 21:40:40.678904 | mon1 | changed: [mon1] 2026-03-05 21:40:40.678968 | mon1 | 2026-03-05 21:40:40.678979 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:40:40.678988 | mon1 | Thursday 05 March 2026 21:40:40 +0000 (0:00:00.323) 0:00:56.460 ******** 2026-03-05 21:40:41.448755 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:40:41.448827 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:40:41.450170 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:40:41.450215 | mon1 | 2026-03-05 21:40:41.450220 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:40:41.450226 | mon1 | Thursday 05 March 2026 21:40:41 +0000 (0:00:00.769) 0:00:57.229 ******** 2026-03-05 21:43:01.606567 | mon1 | ok: [mon1] 2026-03-05 21:43:01.606619 | mon1 | 2026-03-05 21:43:01.606625 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:43:01.606631 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:02:20.152) 0:03:17.382 ******** 2026-03-05 21:43:01.847559 | mon1 | changed: [mon1] 2026-03-05 21:43:01.847621 | mon1 | 2026-03-05 21:43:01.847847 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:43:01.847882 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:00:00.247) 0:03:17.629 ******** 2026-03-05 21:43:01.891518 | mon1 | ok: [mon1] 2026-03-05 21:43:01.891580 | mon1 | 2026-03-05 21:43:01.891749 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:43:01.891859 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:00:00.043) 0:03:17.673 ******** 2026-03-05 21:43:01.966674 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:43:01.966693 | mon1 | 2026-03-05 21:43:01.966706 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:43:01.966712 | mon1 | Thursday 05 March 2026 21:43:01 +0000 (0:00:00.075) 0:03:17.748 ******** 2026-03-05 21:43:07.720437 | mon1 | ok: [mon1] 2026-03-05 21:43:07.720508 | mon1 | 2026-03-05 21:43:07.720730 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:07.720765 | mon1 | Thursday 05 March 2026 21:43:07 +0000 (0:00:05.754) 0:03:23.503 ******** 2026-03-05 21:43:07.787569 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:43:07.787616 | mon1 | 2026-03-05 21:43:07.787745 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:07.787855 | mon1 | Thursday 05 March 2026 21:43:07 +0000 (0:00:00.064) 0:03:23.567 ******** 2026-03-05 21:43:08.202860 | mon1 | ok: [mon1] 2026-03-05 21:43:08.202929 | mon1 | 2026-03-05 21:43:08.203224 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:08.203259 | mon1 | Thursday 05 March 2026 21:43:08 +0000 (0:00:00.417) 0:03:23.985 ******** 2026-03-05 21:43:16.364520 | mon1 | ok: [mon1] 2026-03-05 21:43:16.364591 | mon1 | 2026-03-05 21:43:16.364828 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:43:16.364858 | mon1 | Thursday 05 March 2026 21:43:16 +0000 (0:00:08.160) 0:03:32.146 ******** 2026-03-05 21:43:29.695614 | mon1 | changed: [mon1] 2026-03-05 21:43:29.695688 | mon1 | 2026-03-05 21:43:29.695892 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:43:29.695950 | mon1 | Thursday 05 March 2026 21:43:29 +0000 (0:00:13.331) 0:03:45.478 ******** 2026-03-05 21:43:44.406672 | mon1 | ok: [mon1] 2026-03-05 21:43:44.406727 | mon1 | 2026-03-05 21:43:44.406741 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:43:44.406754 | mon1 | Thursday 05 March 2026 21:43:44 +0000 (0:00:14.709) 0:04:00.187 ******** 2026-03-05 21:43:44.476479 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:43:44.476548 | mon1 | 2026-03-05 21:43:44.476555 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:43:44.476563 | mon1 | Thursday 05 March 2026 21:43:44 +0000 (0:00:00.070) 0:04:00.257 ******** 2026-03-05 21:43:44.532300 | mon1 | skipping: [mon1] 2026-03-05 21:43:44.532365 | mon1 | 2026-03-05 21:43:44.532377 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:43:44.532504 | mon1 | Thursday 05 March 2026 21:43:44 +0000 (0:00:00.056) 0:04:00.314 ******** 2026-03-05 21:43:44.583159 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:43:44.583194 | mon1 | skipping: [mon1] 2026-03-05 21:43:44.583447 | mon1 | 2026-03-05 21:43:44.583769 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:43:44.584078 | mon1 | Thursday 05 March 2026 21:43:44 +0000 (0:00:00.051) 0:04:00.365 ******** 2026-03-05 21:43:44.919916 | mon1 | ok: [mon1] 2026-03-05 21:43:44.919959 | mon1 | 2026-03-05 21:43:44.919964 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:43:44.919969 | mon1 | Thursday 05 March 2026 21:43:44 +0000 (0:00:00.336) 0:04:00.701 ******** 2026-03-05 21:43:52.069820 | mon1 | ok: [mon1] 2026-03-05 21:43:52.069946 | mon1 | 2026-03-05 21:43:52.069972 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:43:52.070198 | mon1 | Thursday 05 March 2026 21:43:52 +0000 (0:00:07.151) 0:04:07.852 ******** 2026-03-05 21:44:05.100809 | mon1 | changed: [mon1] 2026-03-05 21:44:05.100893 | mon1 | 2026-03-05 21:44:05.100915 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:44:05.101063 | mon1 | Thursday 05 March 2026 21:44:05 +0000 (0:00:13.030) 0:04:20.882 ******** 2026-03-05 21:44:11.704325 | mon1 | ok: [mon1] 2026-03-05 21:44:11.704385 | mon1 | 2026-03-05 21:44:11.704398 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:44:11.704411 | mon1 | Thursday 05 March 2026 21:44:11 +0000 (0:00:06.602) 0:04:27.485 ******** 2026-03-05 21:44:20.235160 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:44:20.235218 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:44:20.235225 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:44:20.235230 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:44:20.235237 | mon1 | 2026-03-05 21:44:20.235242 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:44:20.235249 | mon1 | 2026-03-05 21:44:20.235254 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:44:20.235259 | mon1 | Thursday 05 March 2026 21:44:20 +0000 (0:00:08.528) 0:04:36.013 ******** 2026-03-05 21:44:21.433449 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:44:21.433506 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:44:21.433515 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:44:21.433524 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:44:21.433531 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:44:21.448645 | mon1 | ok: [osd1] 2026-03-05 21:44:21.448661 | mon1 | 2026-03-05 21:44:21.448668 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:21.448673 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:01.215) 0:04:37.228 ******** 2026-03-05 21:44:21.699038 | mon1 | ok: [osd1] 2026-03-05 21:44:21.699115 | mon1 | 2026-03-05 21:44:21.699124 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:21.699132 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:00.249) 0:04:37.478 ******** 2026-03-05 21:44:21.745082 | mon1 | skipping: [osd1] 2026-03-05 21:44:21.745141 | mon1 | 2026-03-05 21:44:21.745147 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:44:21.745170 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:00.047) 0:04:37.526 ******** 2026-03-05 21:44:21.999049 | mon1 | changed: [osd1] 2026-03-05 21:44:21.999127 | mon1 | 2026-03-05 21:44:21.999135 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:21.999141 | mon1 | Thursday 05 March 2026 21:44:21 +0000 (0:00:00.252) 0:04:37.778 ******** 2026-03-05 21:44:22.064467 | mon1 | ok: [osd1] => { 2026-03-05 21:44:22.064629 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:44:22.064763 | mon1 | } 2026-03-05 21:44:22.064890 | mon1 | 2026-03-05 21:44:22.065035 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:22.065204 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.068) 0:04:37.847 ******** 2026-03-05 21:44:22.720990 | mon1 | changed: [osd1] 2026-03-05 21:44:22.721037 | mon1 | 2026-03-05 21:44:22.721042 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:22.721047 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.652) 0:04:38.500 ******** 2026-03-05 21:44:22.769645 | mon1 | skipping: [osd1] 2026-03-05 21:44:22.769666 | mon1 | 2026-03-05 21:44:22.769670 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:22.769674 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.052) 0:04:38.552 ******** 2026-03-05 21:44:22.821625 | mon1 | skipping: [osd1] 2026-03-05 21:44:22.821639 | mon1 | 2026-03-05 21:44:22.821644 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:22.821648 | mon1 | Thursday 05 March 2026 21:44:22 +0000 (0:00:00.050) 0:04:38.602 ******** 2026-03-05 21:44:23.078941 | mon1 | ok: [osd1] 2026-03-05 21:44:23.078980 | mon1 | 2026-03-05 21:44:23.078985 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:44:23.078990 | mon1 | Thursday 05 March 2026 21:44:23 +0000 (0:00:00.256) 0:04:38.859 ******** 2026-03-05 21:44:24.015297 | mon1 | ok: [osd1] 2026-03-05 21:44:24.017481 | mon1 | 2026-03-05 21:44:24.017495 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:24.017500 | mon1 | Thursday 05 March 2026 21:44:24 +0000 (0:00:00.938) 0:04:39.797 ******** 2026-03-05 21:44:24.094383 | mon1 | ok: [osd1] => { 2026-03-05 21:44:24.094609 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:44:24.096946 | mon1 | } 2026-03-05 21:44:24.096963 | mon1 | 2026-03-05 21:44:24.096981 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:24.096988 | mon1 | Thursday 05 March 2026 21:44:24 +0000 (0:00:00.078) 0:04:39.876 ******** 2026-03-05 21:44:24.921058 | mon1 | changed: [osd1] 2026-03-05 21:44:24.921129 | mon1 | 2026-03-05 21:44:24.921134 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:24.921140 | mon1 | Thursday 05 March 2026 21:44:24 +0000 (0:00:00.823) 0:04:40.699 ******** 2026-03-05 21:44:27.757139 | mon1 | changed: [osd1] 2026-03-05 21:44:27.757347 | mon1 | 2026-03-05 21:44:27.757500 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:44:27.757645 | mon1 | Thursday 05 March 2026 21:44:27 +0000 (0:00:02.839) 0:04:43.539 ******** 2026-03-05 21:44:27.798776 | mon1 | skipping: [osd1] 2026-03-05 21:44:27.798977 | mon1 | 2026-03-05 21:44:27.802507 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:44:27.802526 | mon1 | Thursday 05 March 2026 21:44:27 +0000 (0:00:00.042) 0:04:43.581 ******** 2026-03-05 21:44:27.837201 | mon1 | skipping: [osd1] 2026-03-05 21:44:27.837351 | mon1 | 2026-03-05 21:44:27.837498 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:44:27.837641 | mon1 | Thursday 05 March 2026 21:44:27 +0000 (0:00:00.038) 0:04:43.620 ******** 2026-03-05 21:44:27.874004 | mon1 | skipping: [osd1] 2026-03-05 21:44:27.874198 | mon1 | 2026-03-05 21:44:27.874359 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:44:27.874520 | mon1 | Thursday 05 March 2026 21:44:27 +0000 (0:00:00.036) 0:04:43.657 ******** 2026-03-05 21:44:35.302419 | mon1 | changed: [osd1] 2026-03-05 21:44:35.302517 | mon1 | 2026-03-05 21:44:35.302533 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:44:35.302580 | mon1 | Thursday 05 March 2026 21:44:35 +0000 (0:00:07.427) 0:04:51.084 ******** 2026-03-05 21:44:35.904862 | mon1 | changed: [osd1] 2026-03-05 21:44:35.904941 | mon1 | 2026-03-05 21:44:35.904956 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:44:35.905082 | mon1 | Thursday 05 March 2026 21:44:35 +0000 (0:00:00.600) 0:04:51.684 ******** 2026-03-05 21:44:37.035141 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:44:37.035246 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:44:37.035266 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:44:37.035396 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:44:37.035511 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:44:37.035617 | mon1 | 2026-03-05 21:44:37.035742 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:44:37.035882 | mon1 | Thursday 05 March 2026 21:44:37 +0000 (0:00:01.133) 0:04:52.817 ******** 2026-03-05 21:44:37.712369 | mon1 | changed: [osd1] 2026-03-05 21:44:37.712464 | mon1 | 2026-03-05 21:44:37.712483 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:44:37.712630 | mon1 | Thursday 05 March 2026 21:44:37 +0000 (0:00:00.660) 0:04:53.478 ******** 2026-03-05 21:44:37.712726 | mon1 | 2026-03-05 21:44:37.712889 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:44:37.712955 | mon1 | Thursday 05 March 2026 21:44:37 +0000 (0:00:00.006) 0:04:53.484 ******** 2026-03-05 21:44:38.600866 | mon1 | ok: [osd1] 2026-03-05 21:44:38.600967 | mon1 | 2026-03-05 21:44:38.600985 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:44:38.601117 | mon1 | Thursday 05 March 2026 21:44:38 +0000 (0:00:00.897) 0:04:54.382 ******** 2026-03-05 21:44:39.188698 | mon1 | changed: [osd1] 2026-03-05 21:44:39.188799 | mon1 | 2026-03-05 21:44:39.189009 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:44:39.189198 | mon1 | Thursday 05 March 2026 21:44:39 +0000 (0:00:00.588) 0:04:54.970 ******** 2026-03-05 21:44:39.891706 | mon1 | changed: [osd1] 2026-03-05 21:44:39.891772 | mon1 | 2026-03-05 21:44:39.891888 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:44:39.892005 | mon1 | Thursday 05 March 2026 21:44:39 +0000 (0:00:00.701) 0:04:55.672 ******** 2026-03-05 21:44:40.150199 | mon1 | ok: [osd1] 2026-03-05 21:44:40.150336 | mon1 | 2026-03-05 21:44:40.150456 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:44:40.150576 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.249) 0:04:55.922 ******** 2026-03-05 21:44:40.213374 | mon1 | ok: [osd1] => { 2026-03-05 21:44:40.213477 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:44:40.213596 | mon1 | } 2026-03-05 21:44:40.213693 | mon1 | 2026-03-05 21:44:40.213851 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:44:40.213925 | mon1 | Thursday 05 March 2026 21:44:40 +0000 (0:00:00.071) 0:04:55.993 ******** 2026-03-05 21:44:41.160918 | mon1 | changed: [osd1] 2026-03-05 21:44:41.161008 | mon1 | 2026-03-05 21:44:41.161061 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:44:41.161211 | mon1 | Thursday 05 March 2026 21:44:41 +0000 (0:00:00.949) 0:04:56.943 ******** 2026-03-05 21:44:45.837081 | mon1 | changed: [osd1] 2026-03-05 21:44:45.837239 | mon1 | 2026-03-05 21:44:45.837252 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:44:45.837345 | mon1 | Thursday 05 March 2026 21:44:45 +0000 (0:00:04.676) 0:05:01.619 ******** 2026-03-05 21:44:46.786542 | mon1 | ok: [osd1] 2026-03-05 21:44:46.786638 | mon1 | 2026-03-05 21:44:46.786654 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:44:46.786772 | mon1 | Thursday 05 March 2026 21:44:46 +0000 (0:00:00.949) 0:05:02.569 ******** 2026-03-05 21:44:47.318674 | mon1 | changed: [osd1] 2026-03-05 21:44:47.318756 | mon1 | 2026-03-05 21:44:47.318817 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:44:47.318946 | mon1 | Thursday 05 March 2026 21:44:47 +0000 (0:00:00.529) 0:05:03.098 ******** 2026-03-05 21:44:47.910530 | mon1 | changed: [osd1] 2026-03-05 21:44:47.910606 | mon1 | 2026-03-05 21:44:47.910847 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:44:47.910964 | mon1 | Thursday 05 March 2026 21:44:47 +0000 (0:00:00.594) 0:05:03.693 ******** 2026-03-05 21:44:48.643402 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:44:48.643507 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:44:48.643526 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:44:48.643652 | mon1 | 2026-03-05 21:44:48.643772 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:44:48.643904 | mon1 | Thursday 05 March 2026 21:44:48 +0000 (0:00:00.732) 0:05:04.426 ******** 2026-03-05 21:44:49.215793 | mon1 | changed: [osd1] 2026-03-05 21:44:49.215870 | mon1 | 2026-03-05 21:44:49.215959 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:44:49.216072 | mon1 | Thursday 05 March 2026 21:44:49 +0000 (0:00:00.570) 0:05:04.996 ******** 2026-03-05 21:44:49.809613 | mon1 | changed: [osd1] 2026-03-05 21:44:49.809685 | mon1 | 2026-03-05 21:44:49.809797 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:44:49.809914 | mon1 | Thursday 05 March 2026 21:44:49 +0000 (0:00:00.588) 0:05:05.585 ******** 2026-03-05 21:44:49.810120 | mon1 | 2026-03-05 21:44:49.810160 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:44:49.810263 | mon1 | Thursday 05 March 2026 21:44:49 +0000 (0:00:00.005) 0:05:05.591 ******** 2026-03-05 21:44:50.711603 | mon1 | ok: [osd1] 2026-03-05 21:44:50.711686 | mon1 | 2026-03-05 21:44:50.711805 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:44:50.711919 | mon1 | Thursday 05 March 2026 21:44:50 +0000 (0:00:00.902) 0:05:06.493 ******** 2026-03-05 21:44:51.763800 | mon1 | changed: [osd1] 2026-03-05 21:44:51.763885 | mon1 | 2026-03-05 21:44:51.764028 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:44:51.764260 | mon1 | Thursday 05 March 2026 21:44:51 +0000 (0:00:01.051) 0:05:07.544 ******** 2026-03-05 21:44:52.483637 | mon1 | changed: [osd1] 2026-03-05 21:44:52.483732 | mon1 | 2026-03-05 21:44:52.483802 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:44:52.483936 | mon1 | Thursday 05 March 2026 21:44:52 +0000 (0:00:00.720) 0:05:08.265 ******** 2026-03-05 21:44:52.541523 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:44:52.541594 | mon1 | 2026-03-05 21:44:52.541784 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:44:52.541934 | mon1 | Thursday 05 March 2026 21:44:52 +0000 (0:00:00.059) 0:05:08.324 ******** 2026-03-05 21:44:53.867132 | mon1 | ok: [osd1] 2026-03-05 21:44:53.867186 | mon1 | 2026-03-05 21:44:53.867192 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:44:53.867199 | mon1 | Thursday 05 March 2026 21:44:53 +0000 (0:00:01.324) 0:05:09.648 ******** 2026-03-05 21:44:54.687579 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:44:54.687963 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:44:54.688128 | mon1 | 2026-03-05 21:44:54.689885 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:44:54.690327 | mon1 | Thursday 05 March 2026 21:44:54 +0000 (0:00:00.820) 0:05:10.469 ******** 2026-03-05 21:44:55.070787 | mon1 | changed: [osd1] 2026-03-05 21:44:55.070863 | mon1 | 2026-03-05 21:44:55.070969 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:44:55.071068 | mon1 | Thursday 05 March 2026 21:44:55 +0000 (0:00:00.382) 0:05:10.852 ******** 2026-03-05 21:44:55.307700 | mon1 | ok: [osd1] 2026-03-05 21:44:55.307793 | mon1 | 2026-03-05 21:44:55.307807 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:44:55.308025 | mon1 | Thursday 05 March 2026 21:44:55 +0000 (0:00:00.234) 0:05:11.087 ******** 2026-03-05 21:44:55.705912 | mon1 | changed: [osd1] 2026-03-05 21:44:55.705989 | mon1 | 2026-03-05 21:44:55.705999 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:44:55.706024 | mon1 | Thursday 05 March 2026 21:44:55 +0000 (0:00:00.399) 0:05:11.486 ******** 2026-03-05 21:44:55.990304 | mon1 | changed: [osd1] 2026-03-05 21:44:55.990403 | mon1 | 2026-03-05 21:44:55.990980 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:44:55.991021 | mon1 | Thursday 05 March 2026 21:44:55 +0000 (0:00:00.285) 0:05:11.771 ******** 2026-03-05 21:44:56.273689 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:44:56.273737 | mon1 | 2026-03-05 21:44:56.274000 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:44:56.274030 | mon1 | Thursday 05 March 2026 21:44:56 +0000 (0:00:00.283) 0:05:12.055 ******** 2026-03-05 21:44:56.331195 | mon1 | ok: [osd1] 2026-03-05 21:44:56.331232 | mon1 | 2026-03-05 21:44:56.331275 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:44:56.331547 | mon1 | Thursday 05 March 2026 21:44:56 +0000 (0:00:00.056) 0:05:12.112 ******** 2026-03-05 21:44:56.400758 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:44:56.400800 | mon1 | 2026-03-05 21:44:56.401066 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:44:56.401135 | mon1 | Thursday 05 March 2026 21:44:56 +0000 (0:00:00.070) 0:05:12.182 ******** 2026-03-05 21:45:02.137737 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:45:02.137803 | mon1 | 2026-03-05 21:45:02.137817 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:45:02.137830 | mon1 | Thursday 05 March 2026 21:45:02 +0000 (0:00:05.736) 0:05:17.919 ******** 2026-03-05 21:45:02.199912 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:45:02.199989 | mon1 | 2026-03-05 21:45:02.200003 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:45:02.200025 | mon1 | Thursday 05 March 2026 21:45:02 +0000 (0:00:00.061) 0:05:17.980 ******** 2026-03-05 21:45:02.536830 | mon1 | changed: [osd1] 2026-03-05 21:45:02.536935 | mon1 | 2026-03-05 21:45:02.536949 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:45:02.536962 | mon1 | Thursday 05 March 2026 21:45:02 +0000 (0:00:00.337) 0:05:18.318 ******** 2026-03-05 21:45:13.713295 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:45:13.713382 | mon1 | 2026-03-05 21:45:13.713991 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:45:13.714068 | mon1 | Thursday 05 March 2026 21:45:13 +0000 (0:00:11.176) 0:05:29.494 ******** 2026-03-05 21:45:15.383822 | mon1 | ok: [osd1] 2026-03-05 21:45:15.383908 | mon1 | 2026-03-05 21:45:15.386232 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:45:15.386309 | mon1 | Thursday 05 March 2026 21:45:15 +0000 (0:00:01.671) 0:05:31.165 ******** 2026-03-05 21:45:59.365258 | mon1 | ok: [osd1] 2026-03-05 21:45:59.365361 | mon1 | 2026-03-05 21:45:59.365384 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:45:59.365710 | mon1 | Thursday 05 March 2026 21:45:59 +0000 (0:00:43.981) 0:06:15.147 ******** 2026-03-05 21:47:51.905189 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:47:51.905271 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:47:51.905321 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:47:51.905669 | mon1 | 2026-03-05 21:47:51.905708 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:47:51.905715 | mon1 | Thursday 05 March 2026 21:47:51 +0000 (0:01:52.539) 0:08:07.686 ******** 2026-03-05 21:47:58.609659 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:47:58.609740 | mon1 | 2026-03-05 21:47:58.611186 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:47:58.611242 | mon1 | Thursday 05 March 2026 21:47:58 +0000 (0:00:06.704) 0:08:14.391 ******** 2026-03-05 21:48:05.234773 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:05.234856 | mon1 | 2026-03-05 21:48:05.234870 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:48:05.234882 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:06.624) 0:08:21.016 ******** 2026-03-05 21:48:05.323248 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:48:05.323319 | mon1 | 2026-03-05 21:48:05.323844 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:48:05.323907 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.088) 0:08:21.104 ******** 2026-03-05 21:48:05.362649 | mon1 | ok: [osd1] 2026-03-05 21:48:05.366124 | mon1 | 2026-03-05 21:48:05.366153 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:48:05.366166 | mon1 | Thursday 05 March 2026 21:48:05 +0000 (0:00:00.040) 0:08:21.145 ******** 2026-03-05 21:48:12.051064 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:48:12.051462 | mon1 | 2026-03-05 21:48:12.051938 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:48:12.052307 | mon1 | Thursday 05 March 2026 21:48:12 +0000 (0:00:06.687) 0:08:27.832 ******** 2026-03-05 21:48:12.102791 | mon1 | ok: [osd1] 2026-03-05 21:48:12.103135 | mon1 | 2026-03-05 21:48:12.103173 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:48:12.103206 | mon1 | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.051) 0:08:27.884 ******** 2026-03-05 21:48:12.149269 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:12.149610 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:12.149926 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:48:12.150291 | mon1 | skipping: [osd1] 2026-03-05 21:48:12.151277 | mon1 | 2026-03-05 21:48:12.151349 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:48:12.151363 | mon1 | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.047) 0:08:27.931 ******** 2026-03-05 21:48:12.186142 | mon1 | skipping: [osd1] 2026-03-05 21:48:12.186415 | mon1 | 2026-03-05 21:48:12.186675 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:48:12.186928 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:48:12.187218 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:48:12.187440 | mon1 | 2026-03-05 21:48:12.187657 | mon1 | 2026-03-05 21:48:12.187893 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:48:12.188185 | mon1 | Thursday 05 March 2026 21:48:12 +0000 (0:00:00.037) 0:08:27.969 ******** 2026-03-05 21:48:12.188431 | mon1 | =============================================================================== 2026-03-05 21:48:12.188662 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 140.15s 2026-03-05 21:48:12.188905 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 112.54s 2026-03-05 21:48:12.189170 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 43.98s 2026-03-05 21:48:12.189415 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.39s 2026-03-05 21:48:12.189657 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.71s 2026-03-05 21:48:12.189899 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.33s 2026-03-05 21:48:12.190187 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 13.03s 2026-03-05 21:48:12.190435 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 11.18s 2026-03-05 21:48:12.190676 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.53s 2026-03-05 21:48:12.190919 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.16s 2026-03-05 21:48:12.191193 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.43s 2026-03-05 21:48:12.191437 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.15s 2026-03-05 21:48:12.191683 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.02s 2026-03-05 21:48:12.191920 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.70s 2026-03-05 21:48:12.192207 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.69s 2026-03-05 21:48:12.192443 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.63s 2026-03-05 21:48:12.192687 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.60s 2026-03-05 21:48:12.192932 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.75s 2026-03-05 21:48:12.193211 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.74s 2026-03-05 21:48:12.193451 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.68s 2026-03-05 21:48:12.327678 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:48:12.337936 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:48:13.313531 | mon1 | 2026-03-05 21:48:13.313769 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:48:13.314030 | mon1 | 2026-03-05 21:48:13.314314 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:48:13.314544 | mon1 | Thursday 05 March 2026 21:48:13 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-03-05 21:48:14.602841 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:48:14.603043 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:48:14.603338 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:48:14.603576 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:48:14.603829 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:48:14.617131 | mon1 | ok: [mon1] 2026-03-05 21:48:14.617358 | mon1 | 2026-03-05 21:48:14.617607 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:14.617859 | mon1 | Thursday 05 March 2026 21:48:14 +0000 (0:00:01.303) 0:00:01.356 ******** 2026-03-05 21:48:14.958484 | mon1 | ok: [mon1] 2026-03-05 21:48:14.958668 | mon1 | 2026-03-05 21:48:14.958934 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:14.959218 | mon1 | Thursday 05 March 2026 21:48:14 +0000 (0:00:00.341) 0:00:01.697 ******** 2026-03-05 21:48:15.002460 | mon1 | skipping: [mon1] 2026-03-05 21:48:15.002698 | mon1 | 2026-03-05 21:48:15.002970 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:48:15.003269 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.044) 0:00:01.741 ******** 2026-03-05 21:48:15.370594 | mon1 | ok: [mon1] 2026-03-05 21:48:15.370839 | mon1 | 2026-03-05 21:48:15.371110 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:15.371393 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.367) 0:00:02.109 ******** 2026-03-05 21:48:15.449564 | mon1 | ok: [mon1] => { 2026-03-05 21:48:15.449843 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:48:15.450122 | mon1 | } 2026-03-05 21:48:15.450408 | mon1 | 2026-03-05 21:48:15.450664 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:15.450948 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.079) 0:00:02.188 ******** 2026-03-05 21:48:15.962297 | mon1 | ok: [mon1] 2026-03-05 21:48:15.962355 | mon1 | 2026-03-05 21:48:15.962367 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:15.962382 | mon1 | Thursday 05 March 2026 21:48:15 +0000 (0:00:00.511) 0:00:02.700 ******** 2026-03-05 21:48:16.014556 | mon1 | skipping: [mon1] 2026-03-05 21:48:16.014709 | mon1 | 2026-03-05 21:48:16.015017 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:16.015295 | mon1 | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.053) 0:00:02.753 ******** 2026-03-05 21:48:16.065558 | mon1 | skipping: [mon1] 2026-03-05 21:48:16.065784 | mon1 | 2026-03-05 21:48:16.066039 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:16.066319 | mon1 | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.050) 0:00:02.804 ******** 2026-03-05 21:48:16.322732 | mon1 | ok: [mon1] 2026-03-05 21:48:16.322922 | mon1 | 2026-03-05 21:48:16.323217 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:48:16.323468 | mon1 | Thursday 05 March 2026 21:48:16 +0000 (0:00:00.257) 0:00:03.061 ******** 2026-03-05 21:48:17.488932 | mon1 | ok: [mon1] 2026-03-05 21:48:17.489142 | mon1 | 2026-03-05 21:48:17.489420 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:17.489652 | mon1 | Thursday 05 March 2026 21:48:17 +0000 (0:00:01.165) 0:00:04.227 ******** 2026-03-05 21:48:17.703907 | mon1 | ok: [mon1] => { 2026-03-05 21:48:17.704067 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:48:17.704359 | mon1 | } 2026-03-05 21:48:17.704386 | mon1 | 2026-03-05 21:48:17.704593 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:17.704677 | mon1 | Thursday 05 March 2026 21:48:17 +0000 (0:00:00.215) 0:00:04.442 ******** 2026-03-05 21:48:18.255418 | mon1 | ok: [mon1] 2026-03-05 21:48:18.255590 | mon1 | 2026-03-05 21:48:18.255854 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:18.256121 | mon1 | Thursday 05 March 2026 21:48:18 +0000 (0:00:00.551) 0:00:04.994 ******** 2026-03-05 21:48:20.710277 | mon1 | ok: [mon1] 2026-03-05 21:48:20.710354 | mon1 | 2026-03-05 21:48:20.710369 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:48:20.710464 | mon1 | Thursday 05 March 2026 21:48:20 +0000 (0:00:02.454) 0:00:07.448 ******** 2026-03-05 21:48:20.745354 | mon1 | skipping: [mon1] 2026-03-05 21:48:20.745587 | mon1 | 2026-03-05 21:48:20.745818 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:48:20.746056 | mon1 | Thursday 05 March 2026 21:48:20 +0000 (0:00:00.035) 0:00:07.484 ******** 2026-03-05 21:48:20.782282 | mon1 | skipping: [mon1] 2026-03-05 21:48:20.782483 | mon1 | 2026-03-05 21:48:20.782724 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:48:20.782966 | mon1 | Thursday 05 March 2026 21:48:20 +0000 (0:00:00.036) 0:00:07.521 ******** 2026-03-05 21:48:20.814354 | mon1 | skipping: [mon1] 2026-03-05 21:48:20.814544 | mon1 | 2026-03-05 21:48:20.814815 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:48:20.815038 | mon1 | Thursday 05 March 2026 21:48:20 +0000 (0:00:00.032) 0:00:07.553 ******** 2026-03-05 21:48:21.847281 | mon1 | ok: [mon1] 2026-03-05 21:48:21.847362 | mon1 | 2026-03-05 21:48:21.847622 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:48:21.847933 | mon1 | Thursday 05 March 2026 21:48:21 +0000 (0:00:01.032) 0:00:08.585 ******** 2026-03-05 21:48:22.414480 | mon1 | ok: [mon1] 2026-03-05 21:48:22.414655 | mon1 | 2026-03-05 21:48:22.414904 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:48:22.415190 | mon1 | Thursday 05 March 2026 21:48:22 +0000 (0:00:00.567) 0:00:09.153 ******** 2026-03-05 21:48:23.584446 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:48:23.584667 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:48:23.584930 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:48:23.585247 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:48:23.585517 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:48:23.585754 | mon1 | 2026-03-05 21:48:23.585997 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:48:23.586304 | mon1 | Thursday 05 March 2026 21:48:23 +0000 (0:00:01.170) 0:00:10.323 ******** 2026-03-05 21:48:24.229912 | mon1 | ok: [mon1] 2026-03-05 21:48:24.230135 | mon1 | 2026-03-05 21:48:24.230411 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:48:24.230685 | mon1 | Thursday 05 March 2026 21:48:24 +0000 (0:00:00.636) 0:00:10.960 ******** 2026-03-05 21:48:24.230916 | mon1 | 2026-03-05 21:48:24.231207 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:48:24.231459 | mon1 | Thursday 05 March 2026 21:48:24 +0000 (0:00:00.007) 0:00:10.967 ******** 2026-03-05 21:48:24.950911 | mon1 | ok: [mon1] 2026-03-05 21:48:24.951076 | mon1 | 2026-03-05 21:48:24.951471 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:48:24.951720 | mon1 | Thursday 05 March 2026 21:48:24 +0000 (0:00:00.722) 0:00:11.689 ******** 2026-03-05 21:48:25.205796 | mon1 | ok: [mon1] 2026-03-05 21:48:25.205854 | mon1 | 2026-03-05 21:48:25.205970 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:48:25.206082 | mon1 | Thursday 05 March 2026 21:48:25 +0000 (0:00:00.255) 0:00:11.945 ******** 2026-03-05 21:48:25.286770 | mon1 | ok: [mon1] => { 2026-03-05 21:48:25.287035 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:48:25.287379 | mon1 | } 2026-03-05 21:48:25.287600 | mon1 | 2026-03-05 21:48:25.287868 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:48:25.288167 | mon1 | Thursday 05 March 2026 21:48:25 +0000 (0:00:00.080) 0:00:12.025 ******** 2026-03-05 21:48:25.727607 | mon1 | ok: [mon1] 2026-03-05 21:48:25.727821 | mon1 | 2026-03-05 21:48:25.728077 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:48:25.728364 | mon1 | Thursday 05 March 2026 21:48:25 +0000 (0:00:00.441) 0:00:12.466 ******** 2026-03-05 21:48:29.046263 | mon1 | ok: [mon1] 2026-03-05 21:48:29.046332 | mon1 | 2026-03-05 21:48:29.046439 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:48:29.046552 | mon1 | Thursday 05 March 2026 21:48:29 +0000 (0:00:03.318) 0:00:15.785 ******** 2026-03-05 21:48:30.159150 | mon1 | ok: [mon1] 2026-03-05 21:48:30.159227 | mon1 | 2026-03-05 21:48:30.159305 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:48:30.159419 | mon1 | Thursday 05 March 2026 21:48:30 +0000 (0:00:01.112) 0:00:16.898 ******** 2026-03-05 21:48:30.503312 | mon1 | ok: [mon1] 2026-03-05 21:48:30.503497 | mon1 | 2026-03-05 21:48:30.503801 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:48:30.504009 | mon1 | Thursday 05 March 2026 21:48:30 +0000 (0:00:00.344) 0:00:17.242 ******** 2026-03-05 21:48:31.073005 | mon1 | ok: [mon1] 2026-03-05 21:48:31.073160 | mon1 | 2026-03-05 21:48:31.073333 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:48:31.073492 | mon1 | Thursday 05 March 2026 21:48:31 +0000 (0:00:00.568) 0:00:17.811 ******** 2026-03-05 21:48:31.830222 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:48:31.830459 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:48:31.830723 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:48:31.830950 | mon1 | 2026-03-05 21:48:31.831243 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:48:31.831493 | mon1 | Thursday 05 March 2026 21:48:31 +0000 (0:00:00.757) 0:00:18.569 ******** 2026-03-05 21:48:32.422809 | mon1 | ok: [mon1] 2026-03-05 21:48:32.422974 | mon1 | 2026-03-05 21:48:32.423261 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:48:32.423504 | mon1 | Thursday 05 March 2026 21:48:32 +0000 (0:00:00.592) 0:00:19.161 ******** 2026-03-05 21:48:32.982187 | mon1 | ok: [mon1] 2026-03-05 21:48:32.982256 | mon1 | 2026-03-05 21:48:32.982267 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:48:32.983562 | mon1 | Thursday 05 March 2026 21:48:32 +0000 (0:00:00.548) 0:00:19.710 ******** 2026-03-05 21:48:32.983618 | mon1 | 2026-03-05 21:48:32.983629 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:48:32.983638 | mon1 | Thursday 05 March 2026 21:48:32 +0000 (0:00:00.010) 0:00:19.720 ******** 2026-03-05 21:48:33.462223 | mon1 | ok: [mon1] 2026-03-05 21:48:33.462297 | mon1 | 2026-03-05 21:48:33.462759 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:48:33.462803 | mon1 | Thursday 05 March 2026 21:48:33 +0000 (0:00:00.479) 0:00:20.199 ******** 2026-03-05 21:48:33.519309 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:48:33.519344 | mon1 | 2026-03-05 21:48:33.519355 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:48:33.519627 | mon1 | Thursday 05 March 2026 21:48:33 +0000 (0:00:00.057) 0:00:20.257 ******** 2026-03-05 21:48:34.565120 | mon1 | ok: [mon1] 2026-03-05 21:48:34.565200 | mon1 | 2026-03-05 21:48:34.565211 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:48:34.565221 | mon1 | Thursday 05 March 2026 21:48:34 +0000 (0:00:01.043) 0:00:21.301 ******** 2026-03-05 21:48:35.372167 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:48:35.372215 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:48:35.372221 | mon1 | 2026-03-05 21:48:35.372225 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:48:35.372235 | mon1 | Thursday 05 March 2026 21:48:35 +0000 (0:00:00.809) 0:00:22.110 ******** 2026-03-05 21:48:35.775322 | mon1 | ok: [mon1] 2026-03-05 21:48:35.775493 | mon1 | 2026-03-05 21:48:35.775685 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:48:35.775850 | mon1 | Thursday 05 March 2026 21:48:35 +0000 (0:00:00.395) 0:00:22.506 ******** 2026-03-05 21:48:36.022218 | mon1 | ok: [mon1] 2026-03-05 21:48:36.022274 | mon1 | 2026-03-05 21:48:36.022412 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:48:36.022526 | mon1 | Thursday 05 March 2026 21:48:36 +0000 (0:00:00.254) 0:00:22.761 ******** 2026-03-05 21:48:36.469254 | mon1 | ok: [mon1] 2026-03-05 21:48:36.469436 | mon1 | 2026-03-05 21:48:36.469709 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:48:36.470023 | mon1 | Thursday 05 March 2026 21:48:36 +0000 (0:00:00.446) 0:00:23.208 ******** 2026-03-05 21:48:36.841257 | mon1 | ok: [mon1] 2026-03-05 21:48:36.841328 | mon1 | 2026-03-05 21:48:36.841354 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:48:36.841498 | mon1 | Thursday 05 March 2026 21:48:36 +0000 (0:00:00.371) 0:00:23.579 ******** 2026-03-05 21:48:36.922861 | mon1 | ok: [mon1] 2026-03-05 21:48:36.922998 | mon1 | 2026-03-05 21:48:36.923374 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:48:36.923662 | mon1 | Thursday 05 March 2026 21:48:36 +0000 (0:00:00.082) 0:00:23.662 ******** 2026-03-05 21:48:37.203924 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:48:37.204262 | mon1 | 2026-03-05 21:48:37.204615 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:48:37.204927 | mon1 | Thursday 05 March 2026 21:48:37 +0000 (0:00:00.280) 0:00:23.942 ******** 2026-03-05 21:48:37.248687 | mon1 | ok: [mon1] 2026-03-05 21:48:37.248750 | mon1 | 2026-03-05 21:48:37.248761 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:48:37.248777 | mon1 | Thursday 05 March 2026 21:48:37 +0000 (0:00:00.045) 0:00:23.987 ******** 2026-03-05 21:48:37.297327 | mon1 | skipping: [mon1] 2026-03-05 21:48:37.297591 | mon1 | 2026-03-05 21:48:37.297853 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:48:37.298150 | mon1 | Thursday 05 March 2026 21:48:37 +0000 (0:00:00.048) 0:00:24.036 ******** 2026-03-05 21:48:37.374068 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:48:37.374345 | mon1 | 2026-03-05 21:48:37.374627 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:48:37.374893 | mon1 | Thursday 05 March 2026 21:48:37 +0000 (0:00:00.076) 0:00:24.112 ******** 2026-03-05 21:48:44.169077 | mon1 | ok: [mon1] 2026-03-05 21:48:44.169166 | mon1 | 2026-03-05 21:48:44.169180 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:48:44.169193 | mon1 | Thursday 05 March 2026 21:48:44 +0000 (0:00:06.794) 0:00:30.907 ******** 2026-03-05 21:48:44.228714 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:48:44.228768 | mon1 | 2026-03-05 21:48:44.228782 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:48:44.228795 | mon1 | Thursday 05 March 2026 21:48:44 +0000 (0:00:00.058) 0:00:30.966 ******** 2026-03-05 21:48:44.715335 | mon1 | ok: [mon1] 2026-03-05 21:48:44.715423 | mon1 | 2026-03-05 21:48:44.715437 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:48:44.715580 | mon1 | Thursday 05 March 2026 21:48:44 +0000 (0:00:00.486) 0:00:31.452 ******** 2026-03-05 21:48:52.086574 | mon1 | ok: [mon1] 2026-03-05 21:48:52.086668 | mon1 | 2026-03-05 21:48:52.086737 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:48:52.086849 | mon1 | Thursday 05 March 2026 21:48:52 +0000 (0:00:07.371) 0:00:38.824 ******** 2026-03-05 21:48:58.882485 | mon1 | ok: [mon1] 2026-03-05 21:48:58.882568 | mon1 | 2026-03-05 21:48:58.882784 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:48:58.882834 | mon1 | Thursday 05 March 2026 21:48:58 +0000 (0:00:06.797) 0:00:45.621 ******** 2026-03-05 21:49:13.646664 | mon1 | ok: [mon1] 2026-03-05 21:49:13.646741 | mon1 | 2026-03-05 21:49:13.646755 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:49:13.646767 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:14.762) 0:01:00.384 ******** 2026-03-05 21:49:13.725272 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:49:13.725333 | mon1 | 2026-03-05 21:49:13.725758 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:49:13.725816 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.078) 0:01:00.463 ******** 2026-03-05 21:49:13.780178 | mon1 | skipping: [mon1] 2026-03-05 21:49:13.780214 | mon1 | 2026-03-05 21:49:13.780233 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:49:13.780558 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.054) 0:01:00.518 ******** 2026-03-05 21:49:13.835307 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:49:13.835407 | mon1 | skipping: [mon1] 2026-03-05 21:49:13.836158 | mon1 | 2026-03-05 21:49:13.836234 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:49:13.836250 | mon1 | Thursday 05 March 2026 21:49:13 +0000 (0:00:00.055) 0:01:00.573 ******** 2026-03-05 21:49:14.164237 | mon1 | ok: [mon1] 2026-03-05 21:49:14.164933 | mon1 | 2026-03-05 21:49:14.165002 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:49:14.165019 | mon1 | Thursday 05 March 2026 21:49:14 +0000 (0:00:00.329) 0:01:00.902 ******** 2026-03-05 21:49:21.343209 | mon1 | ok: [mon1] 2026-03-05 21:49:21.343277 | mon1 | 2026-03-05 21:49:21.343299 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:49:21.343599 | mon1 | Thursday 05 March 2026 21:49:21 +0000 (0:00:07.178) 0:01:08.081 ******** 2026-03-05 21:49:27.985480 | mon1 | ok: [mon1] 2026-03-05 21:49:27.985553 | mon1 | 2026-03-05 21:49:27.985562 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:49:27.985571 | mon1 | Thursday 05 March 2026 21:49:27 +0000 (0:00:06.642) 0:01:14.723 ******** 2026-03-05 21:49:34.626242 | mon1 | ok: [mon1] 2026-03-05 21:49:34.626293 | mon1 | 2026-03-05 21:49:34.626771 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:49:34.626837 | mon1 | Thursday 05 March 2026 21:49:34 +0000 (0:00:06.641) 0:01:21.364 ******** 2026-03-05 21:49:42.945279 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:49:42.945355 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:49:42.945369 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:49:42.945380 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:49:42.945392 | mon1 | 2026-03-05 21:49:42.945413 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:49:42.946168 | mon1 | 2026-03-05 21:49:42.946246 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:49:42.946261 | mon1 | Thursday 05 March 2026 21:49:42 +0000 (0:00:08.318) 0:01:29.682 ******** 2026-03-05 21:49:44.203055 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:49:44.203123 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:49:44.203131 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:49:44.203137 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:49:44.203142 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:49:44.217022 | mon1 | ok: [osd1] 2026-03-05 21:49:44.217083 | mon1 | 2026-03-05 21:49:44.217132 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:44.217340 | mon1 | Thursday 05 March 2026 21:49:44 +0000 (0:00:01.272) 0:01:30.955 ******** 2026-03-05 21:49:44.483865 | mon1 | ok: [osd1] 2026-03-05 21:49:44.483934 | mon1 | 2026-03-05 21:49:44.483948 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:44.483961 | mon1 | Thursday 05 March 2026 21:49:44 +0000 (0:00:00.266) 0:01:31.221 ******** 2026-03-05 21:49:44.523597 | mon1 | skipping: [osd1] 2026-03-05 21:49:44.523648 | mon1 | 2026-03-05 21:49:44.523663 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:49:44.523675 | mon1 | Thursday 05 March 2026 21:49:44 +0000 (0:00:00.039) 0:01:31.261 ******** 2026-03-05 21:49:44.789814 | mon1 | ok: [osd1] 2026-03-05 21:49:44.789901 | mon1 | 2026-03-05 21:49:44.789925 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:44.790259 | mon1 | Thursday 05 March 2026 21:49:44 +0000 (0:00:00.267) 0:01:31.528 ******** 2026-03-05 21:49:44.870669 | mon1 | ok: [osd1] => { 2026-03-05 21:49:44.870946 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:49:44.871222 | mon1 | } 2026-03-05 21:49:44.871399 | mon1 | 2026-03-05 21:49:44.871653 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:44.871904 | mon1 | Thursday 05 March 2026 21:49:44 +0000 (0:00:00.081) 0:01:31.610 ******** 2026-03-05 21:49:45.273355 | mon1 | ok: [osd1] 2026-03-05 21:49:45.273402 | mon1 | 2026-03-05 21:49:45.273719 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:45.273975 | mon1 | Thursday 05 March 2026 21:49:45 +0000 (0:00:00.402) 0:01:32.012 ******** 2026-03-05 21:49:45.319535 | mon1 | skipping: [osd1] 2026-03-05 21:49:45.319697 | mon1 | 2026-03-05 21:49:45.319949 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:45.320240 | mon1 | Thursday 05 March 2026 21:49:45 +0000 (0:00:00.046) 0:01:32.058 ******** 2026-03-05 21:49:45.370699 | mon1 | skipping: [osd1] 2026-03-05 21:49:45.370864 | mon1 | 2026-03-05 21:49:45.371122 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:45.371437 | mon1 | Thursday 05 March 2026 21:49:45 +0000 (0:00:00.051) 0:01:32.110 ******** 2026-03-05 21:49:45.632952 | mon1 | ok: [osd1] 2026-03-05 21:49:45.633117 | mon1 | 2026-03-05 21:49:45.633324 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:49:45.633481 | mon1 | Thursday 05 March 2026 21:49:45 +0000 (0:00:00.261) 0:01:32.371 ******** 2026-03-05 21:49:46.761412 | mon1 | ok: [osd1] 2026-03-05 21:49:46.761494 | mon1 | 2026-03-05 21:49:46.761505 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:46.761516 | mon1 | Thursday 05 March 2026 21:49:46 +0000 (0:00:01.127) 0:01:33.499 ******** 2026-03-05 21:49:46.955288 | mon1 | ok: [osd1] => { 2026-03-05 21:49:46.955326 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:49:46.955336 | mon1 | } 2026-03-05 21:49:46.955345 | mon1 | 2026-03-05 21:49:46.955354 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:46.955363 | mon1 | Thursday 05 March 2026 21:49:46 +0000 (0:00:00.193) 0:01:33.692 ******** 2026-03-05 21:49:47.491289 | mon1 | ok: [osd1] 2026-03-05 21:49:47.491384 | mon1 | 2026-03-05 21:49:47.491404 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:47.491612 | mon1 | Thursday 05 March 2026 21:49:47 +0000 (0:00:00.536) 0:01:34.229 ******** 2026-03-05 21:49:49.758279 | mon1 | ok: [osd1] 2026-03-05 21:49:49.758358 | mon1 | 2026-03-05 21:49:49.758749 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:49:49.758807 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:02.266) 0:01:36.496 ******** 2026-03-05 21:49:49.795441 | mon1 | skipping: [osd1] 2026-03-05 21:49:49.795487 | mon1 | 2026-03-05 21:49:49.795497 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:49:49.795506 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:00.037) 0:01:36.533 ******** 2026-03-05 21:49:49.831421 | mon1 | skipping: [osd1] 2026-03-05 21:49:49.831458 | mon1 | 2026-03-05 21:49:49.831469 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:49:49.831478 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:00.035) 0:01:36.569 ******** 2026-03-05 21:49:49.863338 | mon1 | skipping: [osd1] 2026-03-05 21:49:49.863407 | mon1 | 2026-03-05 21:49:49.863418 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:49:49.863602 | mon1 | Thursday 05 March 2026 21:49:49 +0000 (0:00:00.032) 0:01:36.601 ******** 2026-03-05 21:49:50.829191 | mon1 | ok: [osd1] 2026-03-05 21:49:50.829276 | mon1 | 2026-03-05 21:49:50.829520 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:49:50.829676 | mon1 | Thursday 05 March 2026 21:49:50 +0000 (0:00:00.966) 0:01:37.567 ******** 2026-03-05 21:49:51.391834 | mon1 | ok: [osd1] 2026-03-05 21:49:51.391922 | mon1 | 2026-03-05 21:49:51.391933 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:49:51.392084 | mon1 | Thursday 05 March 2026 21:49:51 +0000 (0:00:00.562) 0:01:38.129 ******** 2026-03-05 21:49:52.541314 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:49:52.541444 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:49:52.541455 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:49:52.541493 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:49:52.541502 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:49:52.541521 | mon1 | 2026-03-05 21:49:52.541945 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:49:52.542004 | mon1 | Thursday 05 March 2026 21:49:52 +0000 (0:00:01.148) 0:01:39.278 ******** 2026-03-05 21:49:53.195571 | mon1 | ok: [osd1] 2026-03-05 21:49:53.195636 | mon1 | 2026-03-05 21:49:53.195647 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:49:53.195657 | mon1 | Thursday 05 March 2026 21:49:53 +0000 (0:00:00.648) 0:01:39.926 ******** 2026-03-05 21:49:53.195901 | mon1 | 2026-03-05 21:49:53.196172 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:49:53.196304 | mon1 | Thursday 05 March 2026 21:49:53 +0000 (0:00:00.006) 0:01:39.933 ******** 2026-03-05 21:49:53.649816 | mon1 | ok: [osd1] 2026-03-05 21:49:53.649861 | mon1 | 2026-03-05 21:49:53.649866 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:49:53.649871 | mon1 | Thursday 05 March 2026 21:49:53 +0000 (0:00:00.454) 0:01:40.387 ******** 2026-03-05 21:49:53.912715 | mon1 | ok: [osd1] 2026-03-05 21:49:53.912771 | mon1 | 2026-03-05 21:49:53.913015 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:49:53.913046 | mon1 | Thursday 05 March 2026 21:49:53 +0000 (0:00:00.264) 0:01:40.652 ******** 2026-03-05 21:49:53.991264 | mon1 | ok: [osd1] => { 2026-03-05 21:49:53.991307 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:49:53.991316 | mon1 | } 2026-03-05 21:49:53.991326 | mon1 | 2026-03-05 21:49:53.991677 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:49:53.991727 | mon1 | Thursday 05 March 2026 21:49:53 +0000 (0:00:00.077) 0:01:40.729 ******** 2026-03-05 21:49:54.433543 | mon1 | ok: [osd1] 2026-03-05 21:49:54.433577 | mon1 | 2026-03-05 21:49:54.433588 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:49:54.433597 | mon1 | Thursday 05 March 2026 21:49:54 +0000 (0:00:00.442) 0:01:41.171 ******** 2026-03-05 21:49:57.774829 | mon1 | ok: [osd1] 2026-03-05 21:49:57.774905 | mon1 | 2026-03-05 21:49:57.774915 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:49:57.774926 | mon1 | Thursday 05 March 2026 21:49:57 +0000 (0:00:03.341) 0:01:44.512 ******** 2026-03-05 21:49:58.745563 | mon1 | ok: [osd1] 2026-03-05 21:49:58.745650 | mon1 | 2026-03-05 21:49:58.747275 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:49:58.747378 | mon1 | Thursday 05 March 2026 21:49:58 +0000 (0:00:00.971) 0:01:45.483 ******** 2026-03-05 21:49:58.989136 | mon1 | ok: [osd1] 2026-03-05 21:49:58.989738 | mon1 | 2026-03-05 21:49:58.989754 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:49:58.989984 | mon1 | Thursday 05 March 2026 21:49:58 +0000 (0:00:00.243) 0:01:45.727 ******** 2026-03-05 21:49:59.541919 | mon1 | ok: [osd1] 2026-03-05 21:49:59.541994 | mon1 | 2026-03-05 21:49:59.542005 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:49:59.542015 | mon1 | Thursday 05 March 2026 21:49:59 +0000 (0:00:00.552) 0:01:46.279 ******** 2026-03-05 21:50:00.231876 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:50:00.231954 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:50:00.231966 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:50:00.231976 | mon1 | 2026-03-05 21:50:00.231993 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:50:00.232330 | mon1 | Thursday 05 March 2026 21:50:00 +0000 (0:00:00.689) 0:01:46.969 ******** 2026-03-05 21:50:00.762345 | mon1 | ok: [osd1] 2026-03-05 21:50:00.762435 | mon1 | 2026-03-05 21:50:00.762454 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:50:00.762752 | mon1 | Thursday 05 March 2026 21:50:00 +0000 (0:00:00.530) 0:01:47.500 ******** 2026-03-05 21:50:01.302292 | mon1 | ok: [osd1] 2026-03-05 21:50:01.302382 | mon1 | 2026-03-05 21:50:01.303746 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:50:01.303818 | mon1 | Thursday 05 March 2026 21:50:01 +0000 (0:00:00.534) 0:01:48.034 ******** 2026-03-05 21:50:01.303829 | mon1 | 2026-03-05 21:50:01.303839 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:50:01.303848 | mon1 | Thursday 05 March 2026 21:50:01 +0000 (0:00:00.006) 0:01:48.040 ******** 2026-03-05 21:50:01.750205 | mon1 | ok: [osd1] 2026-03-05 21:50:01.750918 | mon1 | 2026-03-05 21:50:01.750982 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:50:01.751012 | mon1 | Thursday 05 March 2026 21:50:01 +0000 (0:00:00.448) 0:01:48.488 ******** 2026-03-05 21:50:01.803354 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:50:01.803390 | mon1 | 2026-03-05 21:50:01.803400 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:50:01.803409 | mon1 | Thursday 05 March 2026 21:50:01 +0000 (0:00:00.052) 0:01:48.541 ******** 2026-03-05 21:50:02.792265 | mon1 | ok: [osd1] 2026-03-05 21:50:02.792348 | mon1 | 2026-03-05 21:50:02.792859 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:50:02.792925 | mon1 | Thursday 05 March 2026 21:50:02 +0000 (0:00:00.989) 0:01:49.530 ******** 2026-03-05 21:50:03.607326 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:50:03.607414 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:50:03.608043 | mon1 | 2026-03-05 21:50:03.608142 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:50:03.608155 | mon1 | Thursday 05 March 2026 21:50:03 +0000 (0:00:00.815) 0:01:50.345 ******** 2026-03-05 21:50:04.500764 | mon1 | ok: [osd1] 2026-03-05 21:50:04.500832 | mon1 | 2026-03-05 21:50:04.500844 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:50:04.500854 | mon1 | Thursday 05 March 2026 21:50:04 +0000 (0:00:00.892) 0:01:51.238 ******** 2026-03-05 21:50:04.750273 | mon1 | ok: [osd1] 2026-03-05 21:50:04.750335 | mon1 | 2026-03-05 21:50:04.750346 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:50:04.750355 | mon1 | Thursday 05 March 2026 21:50:04 +0000 (0:00:00.248) 0:01:51.486 ******** 2026-03-05 21:50:05.051834 | mon1 | ok: [osd1] 2026-03-05 21:50:05.052006 | mon1 | 2026-03-05 21:50:05.052376 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:50:05.052627 | mon1 | Thursday 05 March 2026 21:50:05 +0000 (0:00:00.303) 0:01:51.790 ******** 2026-03-05 21:50:05.312590 | mon1 | ok: [osd1] 2026-03-05 21:50:05.312634 | mon1 | 2026-03-05 21:50:05.314262 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:50:05.314397 | mon1 | Thursday 05 March 2026 21:50:05 +0000 (0:00:00.259) 0:01:52.050 ******** 2026-03-05 21:50:05.603400 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:50:05.603572 | mon1 | 2026-03-05 21:50:05.603847 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:50:05.604122 | mon1 | Thursday 05 March 2026 21:50:05 +0000 (0:00:00.291) 0:01:52.342 ******** 2026-03-05 21:50:05.659236 | mon1 | ok: [osd1] 2026-03-05 21:50:05.659451 | mon1 | 2026-03-05 21:50:05.659696 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:50:05.660131 | mon1 | Thursday 05 March 2026 21:50:05 +0000 (0:00:00.055) 0:01:52.397 ******** 2026-03-05 21:50:05.724479 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:50:05.724736 | mon1 | 2026-03-05 21:50:05.725039 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:50:05.725332 | mon1 | Thursday 05 March 2026 21:50:05 +0000 (0:00:00.065) 0:01:52.463 ******** 2026-03-05 21:50:12.425027 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:12.425280 | mon1 | 2026-03-05 21:50:12.425555 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:50:12.425837 | mon1 | Thursday 05 March 2026 21:50:12 +0000 (0:00:06.700) 0:01:59.164 ******** 2026-03-05 21:50:12.487667 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:50:12.487879 | mon1 | 2026-03-05 21:50:12.488182 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:50:12.488435 | mon1 | Thursday 05 March 2026 21:50:12 +0000 (0:00:00.063) 0:01:59.227 ******** 2026-03-05 21:50:12.845887 | mon1 | ok: [osd1] 2026-03-05 21:50:12.846151 | mon1 | 2026-03-05 21:50:12.846422 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:50:12.846669 | mon1 | Thursday 05 March 2026 21:50:12 +0000 (0:00:00.357) 0:01:59.585 ******** 2026-03-05 21:50:20.045927 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:20.046195 | mon1 | 2026-03-05 21:50:20.046489 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:50:20.046741 | mon1 | Thursday 05 March 2026 21:50:20 +0000 (0:00:07.199) 0:02:06.785 ******** 2026-03-05 21:50:25.636274 | mon1 | ok: [osd1] 2026-03-05 21:50:25.636365 | mon1 | 2026-03-05 21:50:25.636388 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:50:25.636661 | mon1 | Thursday 05 March 2026 21:50:25 +0000 (0:00:05.589) 0:02:12.374 ******** 2026-03-05 21:50:48.741198 | mon1 | ok: [osd1] 2026-03-05 21:50:48.741261 | mon1 | 2026-03-05 21:50:48.741270 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:50:48.741283 | mon1 | Thursday 05 March 2026 21:50:48 +0000 (0:00:23.105) 0:02:35.479 ******** 2026-03-05 21:50:48.807258 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:50:48.807332 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:50:48.807353 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:50:48.808483 | mon1 | skipping: [osd1] 2026-03-05 21:50:48.808552 | mon1 | 2026-03-05 21:50:48.808567 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:50:48.808580 | mon1 | Thursday 05 March 2026 21:50:48 +0000 (0:00:00.065) 0:02:35.544 ******** 2026-03-05 21:50:55.490650 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:50:55.490728 | mon1 | 2026-03-05 21:50:55.490742 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:50:55.490754 | mon1 | Thursday 05 March 2026 21:50:55 +0000 (0:00:06.683) 0:02:42.228 ******** 2026-03-05 21:51:02.084234 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:51:02.084312 | mon1 | 2026-03-05 21:51:02.084897 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:51:02.084960 | mon1 | Thursday 05 March 2026 21:51:02 +0000 (0:00:06.594) 0:02:48.822 ******** 2026-03-05 21:51:02.148396 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:51:02.148429 | mon1 | 2026-03-05 21:51:02.148442 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:51:02.148454 | mon1 | Thursday 05 March 2026 21:51:02 +0000 (0:00:00.064) 0:02:48.886 ******** 2026-03-05 21:51:02.193183 | mon1 | ok: [osd1] 2026-03-05 21:51:02.193230 | mon1 | 2026-03-05 21:51:02.193552 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:51:02.193875 | mon1 | Thursday 05 March 2026 21:51:02 +0000 (0:00:00.044) 0:02:48.931 ******** 2026-03-05 21:51:08.790876 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:51:08.791297 | mon1 | 2026-03-05 21:51:08.791913 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:51:08.791937 | mon1 | Thursday 05 March 2026 21:51:08 +0000 (0:00:06.597) 0:02:55.529 ******** 2026-03-05 21:51:08.839540 | mon1 | ok: [osd1] 2026-03-05 21:51:08.839620 | mon1 | 2026-03-05 21:51:08.839884 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:51:08.839909 | mon1 | Thursday 05 March 2026 21:51:08 +0000 (0:00:00.048) 0:02:55.578 ******** 2026-03-05 21:51:08.886484 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:51:08.886550 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:51:08.886567 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:51:08.887311 | mon1 | skipping: [osd1] 2026-03-05 21:51:08.887414 | mon1 | 2026-03-05 21:51:08.887811 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:51:08.887840 | mon1 | Thursday 05 March 2026 21:51:08 +0000 (0:00:00.046) 0:02:55.624 ******** 2026-03-05 21:51:08.920250 | mon1 | skipping: [osd1] 2026-03-05 21:51:08.920309 | mon1 | 2026-03-05 21:51:08.920319 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:51:08.920336 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:51:08.922139 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:51:08.922175 | mon1 | 2026-03-05 21:51:08.922185 | mon1 | 2026-03-05 21:51:08.922194 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:51:08.922203 | mon1 | Thursday 05 March 2026 21:51:08 +0000 (0:00:00.034) 0:02:55.658 ******** 2026-03-05 21:51:08.922212 | mon1 | =============================================================================== 2026-03-05 21:51:08.922221 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.11s 2026-03-05 21:51:08.922343 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.76s 2026-03-05 21:51:08.922644 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.32s 2026-03-05 21:51:08.922966 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.37s 2026-03-05 21:51:08.923298 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.20s 2026-03-05 21:51:08.923623 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.18s 2026-03-05 21:51:08.923935 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.80s 2026-03-05 21:51:08.924270 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.79s 2026-03-05 21:51:08.924585 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.70s 2026-03-05 21:51:08.924881 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.68s 2026-03-05 21:51:08.925211 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.64s 2026-03-05 21:51:08.925520 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.64s 2026-03-05 21:51:08.925814 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.60s 2026-03-05 21:51:08.926139 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.59s 2026-03-05 21:51:08.926453 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.59s 2026-03-05 21:51:08.926755 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s 2026-03-05 21:51:08.927074 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.32s 2026-03-05 21:51:08.927416 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.45s 2026-03-05 21:51:08.927723 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.27s 2026-03-05 21:51:08.928018 | mon1 | Gathering Facts --------------------------------------------------------- 1.30s 2026-03-05 21:51:09.027497 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:51:09.038300 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:51:09.038661 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:51:09.044321 | mon1 | INFO [default > verify] Executing 2026-03-05 21:51:09.774754 | mon1 | 2026-03-05 21:51:09.775159 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:51:09.775484 | mon1 | 2026-03-05 21:51:09.775790 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:51:09.776127 | mon1 | Thursday 05 March 2026 21:51:09 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 21:51:10.974348 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:51:10.974757 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:51:10.975076 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:51:10.975696 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:51:10.975718 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:51:10.984250 | mon1 | ok: [mon1] 2026-03-05 21:51:10.984307 | mon1 | 2026-03-05 21:51:10.984458 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:51:10.984626 | mon1 | Thursday 05 March 2026 21:51:10 +0000 (0:00:01.209) 0:00:01.217 ******** 2026-03-05 21:51:21.682235 | mon1 | ok: [mon1] 2026-03-05 21:51:21.682446 | mon1 | 2026-03-05 21:51:21.682714 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:51:21.682975 | mon1 | Thursday 05 March 2026 21:51:21 +0000 (0:00:10.697) 0:00:11.914 ******** 2026-03-05 21:51:21.717241 | mon1 | ok: [mon1] => { 2026-03-05 21:51:21.717435 | mon1 | "_ceph_health": { 2026-03-05 21:51:21.717771 | mon1 | "changed": false, 2026-03-05 21:51:21.718000 | mon1 | "cmd": [ 2026-03-05 21:51:21.718309 | mon1 | "cephadm", 2026-03-05 21:51:21.718538 | mon1 | "shell", 2026-03-05 21:51:21.719241 | mon1 | "--", 2026-03-05 21:51:21.719280 | mon1 | "ceph", 2026-03-05 21:51:21.719292 | mon1 | "health" 2026-03-05 21:51:21.719466 | mon1 | ], 2026-03-05 21:51:21.719691 | mon1 | "delta": "0:00:10.373036", 2026-03-05 21:51:21.719926 | mon1 | "end": "2026-03-05 21:51:21.638008", 2026-03-05 21:51:21.720192 | mon1 | "failed": false, 2026-03-05 21:51:21.720418 | mon1 | "msg": "", 2026-03-05 21:51:21.720644 | mon1 | "rc": 0, 2026-03-05 21:51:21.720876 | mon1 | "start": "2026-03-05 21:51:11.264972", 2026-03-05 21:51:21.721166 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:51:21.721409 | mon1 | "stderr_lines": [ 2026-03-05 21:51:21.721687 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:51:21.721936 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:51:21.722227 | mon1 | ], 2026-03-05 21:51:21.722476 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:51:21.722713 | mon1 | "stdout_lines": [ 2026-03-05 21:51:21.722937 | mon1 | "HEALTH_OK" 2026-03-05 21:51:21.723190 | mon1 | ] 2026-03-05 21:51:21.723441 | mon1 | } 2026-03-05 21:51:21.723649 | mon1 | } 2026-03-05 21:51:21.723858 | mon1 | 2026-03-05 21:51:21.724112 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:51:21.724374 | mon1 | Thursday 05 March 2026 21:51:21 +0000 (0:00:00.035) 0:00:11.950 ******** 2026-03-05 21:51:21.747450 | mon1 | ok: [mon1] => { 2026-03-05 21:51:21.747669 | mon1 | "changed": false, 2026-03-05 21:51:21.747901 | mon1 | "msg": "All assertions passed" 2026-03-05 21:51:21.748154 | mon1 | } 2026-03-05 21:51:21.748378 | mon1 | 2026-03-05 21:51:21.748618 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:51:21.748857 | mon1 | Thursday 05 March 2026 21:51:21 +0000 (0:00:00.030) 0:00:11.980 ******** 2026-03-05 21:51:29.111515 | mon1 | changed: [mon1] 2026-03-05 21:51:29.111598 | mon1 | 2026-03-05 21:51:29.113180 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:51:29.113212 | mon1 | Thursday 05 March 2026 21:51:29 +0000 (0:00:07.362) 0:00:19.343 ******** 2026-03-05 21:51:31.909127 | mon1 | changed: [mon1] 2026-03-05 21:51:31.909933 | mon1 | 2026-03-05 21:51:31.909983 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:51:31.909999 | mon1 | Thursday 05 March 2026 21:51:31 +0000 (0:00:02.798) 0:00:22.142 ******** 2026-03-05 21:51:33.329167 | mon1 | ok: [mon1] 2026-03-05 21:51:33.329828 | mon1 | 2026-03-05 21:51:33.329886 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:51:33.329900 | mon1 | Thursday 05 March 2026 21:51:33 +0000 (0:00:01.419) 0:00:23.561 ******** 2026-03-05 21:51:33.372156 | mon1 | ok: [mon1] => { 2026-03-05 21:51:33.372212 | mon1 | "changed": false, 2026-03-05 21:51:33.372226 | mon1 | "msg": "All assertions passed" 2026-03-05 21:51:33.372237 | mon1 | } 2026-03-05 21:51:33.372249 | mon1 | 2026-03-05 21:51:33.372261 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:51:33.372274 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:51:33.372286 | mon1 | 2026-03-05 21:51:33.372298 | mon1 | 2026-03-05 21:51:33.372309 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:51:33.372563 | mon1 | Thursday 05 March 2026 21:51:33 +0000 (0:00:00.040) 0:00:23.602 ******** 2026-03-05 21:51:33.372862 | mon1 | =============================================================================== 2026-03-05 21:51:33.373204 | mon1 | Get cluster health status ---------------------------------------------- 10.70s 2026-03-05 21:51:33.373519 | mon1 | Create a test Ceph pool ------------------------------------------------- 7.36s 2026-03-05 21:51:33.373829 | mon1 | Create a test Ceph key -------------------------------------------------- 2.80s 2026-03-05 21:51:33.374170 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.42s 2026-03-05 21:51:33.374491 | mon1 | Gathering Facts --------------------------------------------------------- 1.21s 2026-03-05 21:51:33.374806 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-05 21:51:33.375139 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-03-05 21:51:33.375458 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 21:51:33.443636 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:51:33.454240 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:51:33.454609 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:51:33.461876 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:51:33.461915 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:51:33.462005 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:51:33.462285 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:51:33.793346 | mon1 | ok: Runtime: 0:12:43.204439 2026-03-05 21:51:33.806959 | 2026-03-05 21:51:33.807036 | PLAY RECAP 2026-03-05 21:51:33.807097 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:51:33.807132 | 2026-03-05 21:51:33.915203 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:51:33.917996 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:51:34.460907 | 2026-03-05 21:51:34.461062 | PLAY [all] 2026-03-05 21:51:34.473516 | 2026-03-05 21:51:34.473595 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:51:34.526311 | mon1 | ok 2026-03-05 21:51:34.532872 | osd1 | ok 2026-03-05 21:51:34.538110 | 2026-03-05 21:51:34.538189 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:51:34.562342 | mon1 | skipping: Conditional result was False 2026-03-05 21:51:34.573485 | osd1 | skipping: Conditional result was False 2026-03-05 21:51:34.583782 | 2026-03-05 21:51:34.583883 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:51:34.947597 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/logs/osd1" 2026-03-05 21:51:34.949103 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/logs/mon1" 2026-03-05 21:51:35.155903 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/artifacts" 2026-03-05 21:51:35.157674 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/artifacts" 2026-03-05 21:51:35.356041 | mon1 -> localhost | ok: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/docs" 2026-03-05 21:51:35.358582 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d5ac4ca2319d42d1bd9077e53b3aa2fa/work/docs" 2026-03-05 21:51:35.372576 | 2026-03-05 21:51:35.372735 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:51:36.005890 | mon1 | changed: .d..t...... ./ 2026-03-05 21:51:36.006205 | mon1 | changed: All items complete 2026-03-05 21:51:36.006243 | 2026-03-05 21:51:36.013434 | osd1 | changed: .d..t...... ./ 2026-03-05 21:51:36.464981 | mon1 | changed: .d..t...... ./ 2026-03-05 21:51:36.486727 | osd1 | changed: .d..t...... ./ 2026-03-05 21:51:36.936266 | mon1 | changed: .d..t...... ./ 2026-03-05 21:51:36.952575 | osd1 | ok 2026-03-05 21:51:36.976028 | 2026-03-05 21:51:36.976195 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:51:37.368457 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006770 2026-03-05 21:51:37.368824 | mon1 -> localhost | changed: All items complete 2026-03-05 21:51:37.368863 | 2026-03-05 21:51:37.574370 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006874 2026-03-05 21:51:37.601301 | 2026-03-05 21:51:37.601412 | PLAY [all] 2026-03-05 21:51:37.607698 | 2026-03-05 21:51:37.607762 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:51:38.069951 | mon1 | changed 2026-03-05 21:51:38.293568 | osd1 | changed 2026-03-05 21:51:38.305817 | 2026-03-05 21:51:38.305869 | PLAY RECAP 2026-03-05 21:51:38.305921 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:51:38.305950 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:51:38.305984 | 2026-03-05 21:51:38.417086 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:51:38.419546 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:51:38.954840 | 2026-03-05 21:51:38.955146 | PLAY [localhost] 2026-03-05 21:51:38.965127 | 2026-03-05 21:51:38.965203 | TASK [Generate Zuul manifest] 2026-03-05 21:51:38.986565 | localhost | ok 2026-03-05 21:51:39.002223 | 2026-03-05 21:51:39.002324 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:51:39.315888 | localhost | changed 2026-03-05 21:51:39.329117 | 2026-03-05 21:51:39.329202 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:51:39.360575 | localhost | ok 2026-03-05 21:51:39.367373 | 2026-03-05 21:51:39.367435 | TASK [Upload logs] 2026-03-05 21:51:39.389480 | localhost | ok 2026-03-05 21:51:39.450157 | 2026-03-05 21:51:39.450307 | TASK [Set zuul-log-path fact] 2026-03-05 21:51:39.472199 | localhost | ok 2026-03-05 21:51:39.485689 | 2026-03-05 21:51:39.485754 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:51:39.517453 | localhost | ok 2026-03-05 21:51:39.526415 | 2026-03-05 21:51:39.526484 | TASK [upload-logs : Create log directories] 2026-03-05 21:51:39.923850 | localhost | changed 2026-03-05 21:51:39.930305 | 2026-03-05 21:51:39.930387 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:51:40.312125 | localhost -> localhost | ok: Runtime: 0:00:00.004797 2026-03-05 21:51:40.317084 | 2026-03-05 21:51:40.317152 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:51:40.745133 | localhost | Output suppressed because no_log was given 2026-03-05 21:51:40.749189 | 2026-03-05 21:51:40.749251 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:51:40.791475 | localhost | skipping: Conditional result was False 2026-03-05 21:51:40.798066 | localhost | skipping: Conditional result was False 2026-03-05 21:51:40.811075 | 2026-03-05 21:51:40.811183 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:51:40.848020 | localhost | skipping: Conditional result was False 2026-03-05 21:51:40.848511 | 2026-03-05 21:51:40.852030 | localhost | skipping: Conditional result was False 2026-03-05 21:51:40.863235 | 2026-03-05 21:51:40.863427 | LOOP [upload-logs : Upload console log and json output]