2026-03-05 20:58:28.506614 | Job console starting 2026-03-05 20:58:28.520998 | Updating git repos 2026-03-05 20:58:28.564921 | Cloning repos into workspace 2026-03-05 20:58:28.651328 | Restoring repo states 2026-03-05 20:58:28.659448 | Merging changes 2026-03-05 20:58:28.981270 | Checking out repos 2026-03-05 20:58:29.017113 | Preparing playbooks 2026-03-05 20:58:30.881859 | Running Ansible setup 2026-03-05 20:58:35.437128 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:58:36.001448 | 2026-03-05 20:58:36.002022 | PLAY [localhost] 2026-03-05 20:58:36.011082 | 2026-03-05 20:58:36.011194 | TASK [Gathering Facts] 2026-03-05 20:58:36.935275 | localhost | ok 2026-03-05 20:58:36.947391 | 2026-03-05 20:58:36.947485 | TASK [Setup log path fact] 2026-03-05 20:58:36.979009 | localhost | ok 2026-03-05 20:58:36.992184 | 2026-03-05 20:58:36.992257 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 20:58:37.022719 | localhost | ok 2026-03-05 20:58:37.031366 | 2026-03-05 20:58:37.031433 | TASK [emit-job-header : Print job information] 2026-03-05 20:58:37.072307 | # Job Information 2026-03-05 20:58:37.072469 | Ansible Version: 2.16.16 2026-03-05 20:58:37.072513 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-05 20:58:37.072544 | Pipeline: check 2026-03-05 20:58:37.072572 | Executor: 0a8996d2b663 2026-03-05 20:58:37.072600 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-03-05 20:58:37.072632 | Event ID: d6e15bb0-18d5-11f1-98b1-d42532538547 2026-03-05 20:58:37.076809 | 2026-03-05 20:58:37.076936 | LOOP [emit-job-header : Print node information] 2026-03-05 20:58:37.182287 | localhost | ok: 2026-03-05 20:58:37.182705 | localhost | # Node Information 2026-03-05 20:58:37.182748 | localhost | Inventory Hostname: mon1 2026-03-05 20:58:37.182780 | localhost | Hostname: np0000157944 2026-03-05 20:58:37.182809 | localhost | Username: zuul 2026-03-05 20:58:37.182846 | localhost | Distro: Ubuntu 24.04 2026-03-05 20:58:37.182875 | localhost | Provider: yul1 2026-03-05 20:58:37.182902 | localhost | Region: ca-ymq-1 2026-03-05 20:58:37.182929 | localhost | Label: ubuntu-noble 2026-03-05 20:58:37.182955 | localhost | Product Name: OpenStack Nova 2026-03-05 20:58:37.182981 | localhost | Interface IP: 199.204.45.149 2026-03-05 20:58:37.255921 | localhost | ok: 2026-03-05 20:58:37.256117 | localhost | # Node Information 2026-03-05 20:58:37.256157 | localhost | Inventory Hostname: osd1 2026-03-05 20:58:37.256198 | localhost | Hostname: np0000157945 2026-03-05 20:58:37.256241 | localhost | Username: zuul 2026-03-05 20:58:37.256280 | localhost | Distro: Ubuntu 24.04 2026-03-05 20:58:37.256320 | localhost | Provider: yul1 2026-03-05 20:58:37.256348 | localhost | Region: ca-ymq-1 2026-03-05 20:58:37.256375 | localhost | Label: ubuntu-noble 2026-03-05 20:58:37.256401 | localhost | Product Name: OpenStack Nova 2026-03-05 20:58:37.256428 | localhost | Interface IP: 162.253.55.110 2026-03-05 20:58:37.275749 | 2026-03-05 20:58:37.291918 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 20:58:37.743218 | localhost -> localhost | changed 2026-03-05 20:58:37.749817 | 2026-03-05 20:58:37.749916 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 20:58:38.624222 | localhost -> localhost | changed 2026-03-05 20:58:38.631587 | 2026-03-05 20:58:38.631645 | PLAY [all] 2026-03-05 20:58:38.642196 | 2026-03-05 20:58:38.642264 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 20:58:38.890146 | mon1 -> localhost | ok 2026-03-05 20:58:38.902905 | 2026-03-05 20:58:38.903009 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 20:58:38.934790 | mon1 | ok 2026-03-05 20:58:38.950502 | osd1 | ok 2026-03-05 20:58:38.970051 | mon1 | included: /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 20:58:38.970109 | osd1 | included: /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 20:58:38.976655 | 2026-03-05 20:58:38.976715 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 20:58:39.976153 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 20:58:39.976441 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/33b44d887d564690960bb25b7845ea8e_id_rsa 2026-03-05 20:58:39.976491 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/33b44d887d564690960bb25b7845ea8e_id_rsa.pub 2026-03-05 20:58:39.976527 | mon1 -> localhost | The key fingerprint is: 2026-03-05 20:58:39.976560 | mon1 -> localhost | SHA256:vTUVv/eVxCw2SPjRH2Jeu6VkxZWY1gwYC3kSVdwGox8 zuul-build-sshkey 2026-03-05 20:58:39.976591 | mon1 -> localhost | The key's randomart image is: 2026-03-05 20:58:39.976621 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 20:58:39.976651 | mon1 -> localhost | | o=+*=X.+| 2026-03-05 20:58:39.976682 | mon1 -> localhost | | +o++O+@o| 2026-03-05 20:58:39.976712 | mon1 -> localhost | | ++=E*=+| 2026-03-05 20:58:39.976743 | mon1 -> localhost | | . .ooBo+| 2026-03-05 20:58:39.976774 | mon1 -> localhost | | S . o+ +=| 2026-03-05 20:58:39.976804 | mon1 -> localhost | | o ...+| 2026-03-05 20:58:39.976832 | mon1 -> localhost | | . .| 2026-03-05 20:58:39.976860 | mon1 -> localhost | | | 2026-03-05 20:58:39.976896 | mon1 -> localhost | | | 2026-03-05 20:58:39.976940 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 20:58:39.977066 | mon1 -> localhost | ok: Runtime: 0:00:00.559237 2026-03-05 20:58:39.985479 | 2026-03-05 20:58:39.985562 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 20:58:40.023046 | mon1 | ok 2026-03-05 20:58:40.028475 | osd1 | ok 2026-03-05 20:58:40.042738 | mon1 | included: /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 20:58:40.042795 | osd1 | included: /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 20:58:40.053596 | 2026-03-05 20:58:40.053674 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 20:58:40.081190 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:40.082648 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:40.091037 | 2026-03-05 20:58:40.091129 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 20:58:40.662939 | mon1 | changed 2026-03-05 20:58:40.669063 | osd1 | changed 2026-03-05 20:58:40.674645 | 2026-03-05 20:58:40.674711 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 20:58:40.907687 | mon1 | ok 2026-03-05 20:58:40.915172 | osd1 | ok 2026-03-05 20:58:40.921031 | 2026-03-05 20:58:40.921092 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 20:58:41.516860 | mon1 | changed 2026-03-05 20:58:41.536951 | osd1 | changed 2026-03-05 20:58:41.544153 | 2026-03-05 20:58:41.544329 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 20:58:42.162391 | mon1 | changed 2026-03-05 20:58:42.167235 | osd1 | changed 2026-03-05 20:58:42.172375 | 2026-03-05 20:58:42.172437 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 20:58:42.197104 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:42.208454 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:42.219167 | 2026-03-05 20:58:42.219259 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 20:58:42.553079 | mon1 -> localhost | changed 2026-03-05 20:58:42.577774 | 2026-03-05 20:58:42.577959 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 20:58:42.885500 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/33b44d887d564690960bb25b7845ea8e_id_rsa (zuul-build-sshkey) 2026-03-05 20:58:42.885774 | mon1 -> localhost | ok: Runtime: 0:00:00.015877 2026-03-05 20:58:42.891550 | 2026-03-05 20:58:42.891619 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 20:58:43.206352 | osd1 | ok 2026-03-05 20:58:43.211086 | mon1 | ok 2026-03-05 20:58:43.216416 | 2026-03-05 20:58:43.216482 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 20:58:43.244902 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:43.256477 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:43.277039 | 2026-03-05 20:58:43.277115 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 20:58:43.601114 | mon1 | ok 2026-03-05 20:58:43.621683 | osd1 | ok 2026-03-05 20:58:43.629777 | 2026-03-05 20:58:43.629846 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 20:58:44.465412 | mon1 | Output suppressed because no_log was given 2026-03-05 20:58:44.487110 | osd1 | Output suppressed because no_log was given 2026-03-05 20:58:44.512318 | 2026-03-05 20:58:44.512492 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 20:58:44.749063 | mon1 | ok: "logs" 2026-03-05 20:58:44.749385 | mon1 | ok: All items complete 2026-03-05 20:58:44.749429 | 2026-03-05 20:58:44.755799 | osd1 | ok: "logs" 2026-03-05 20:58:44.954317 | mon1 | ok: "artifacts" 2026-03-05 20:58:44.960381 | osd1 | ok: "artifacts" 2026-03-05 20:58:45.164790 | osd1 | ok: "docs" 2026-03-05 20:58:45.185133 | mon1 | ok: "docs" 2026-03-05 20:58:45.202034 | 2026-03-05 20:58:45.202146 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 20:58:45.454761 | mon1 | changed: "logs" 2026-03-05 20:58:45.454997 | mon1 | ok: All items complete 2026-03-05 20:58:45.455032 | 2026-03-05 20:58:45.461224 | osd1 | changed: "logs" 2026-03-05 20:58:45.659945 | mon1 | changed: "artifacts" 2026-03-05 20:58:45.676908 | osd1 | changed: "artifacts" 2026-03-05 20:58:45.872545 | mon1 | changed: "docs" 2026-03-05 20:58:45.892575 | osd1 | changed: "docs" 2026-03-05 20:58:45.913284 | 2026-03-05 20:58:45.913412 | PLAY RECAP 2026-03-05 20:58:45.913462 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:45.913492 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 20:58:45.913517 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 20:58:45.913535 | 2026-03-05 20:58:46.028646 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:58:46.033528 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:46.602235 | 2026-03-05 20:58:46.602344 | PLAY [all] 2026-03-05 20:58:46.613874 | 2026-03-05 20:58:46.613949 | TASK [setup-uv : Extract archive] 2026-03-05 20:58:49.092724 | mon1 | changed 2026-03-05 20:58:49.153636 | osd1 | changed 2026-03-05 20:58:49.160170 | 2026-03-05 20:58:49.160251 | TASK [setup-uv : Print version] 2026-03-05 20:58:48.891409 | osd1 | uv 0.8.13 2026-03-05 20:58:48.916061 | mon1 | uv 0.8.13 2026-03-05 20:58:49.730821 | osd1 | ok: Runtime: 0:00:00.016395 2026-03-05 20:58:49.740080 | mon1 | ok: Runtime: 0:00:00.016078 2026-03-05 20:58:49.752590 | 2026-03-05 20:58:49.752668 | PLAY RECAP 2026-03-05 20:58:49.752720 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:49.752760 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:49.752785 | 2026-03-05 20:58:49.861893 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:49.864256 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 20:58:50.466543 | 2026-03-05 20:58:50.466724 | PLAY [all] 2026-03-05 20:58:50.478833 | 2026-03-05 20:58:50.478926 | TASK [Copy inventory file for Zuul] 2026-03-05 20:58:51.463341 | mon1 | changed 2026-03-05 20:58:51.468723 | 2026-03-05 20:58:51.468799 | TASK [Switch "ansible_host" to private IP] 2026-03-05 20:58:51.879900 | mon1 | changed: 2 replacements made 2026-03-05 20:58:51.887651 | 2026-03-05 20:58:51.887723 | TASK [Run Molecule scenario] 2026-03-05 20:58:51.651586 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-05 20:58:51.651706 | mon1 | Creating virtual environment at: .venv 2026-03-05 20:58:51.922356 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 20:58:51.927023 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 20:58:51.928439 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 20:58:51.939795 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 20:58:52.130062 | mon1 | Downloading netaddr 2026-03-05 20:58:52.141101 | mon1 | Downloading cryptography 2026-03-05 20:58:52.206534 | mon1 | Downloading pygments 2026-03-05 20:58:52.404673 | mon1 | Downloading ansible-core 2026-03-05 20:58:52.450904 | mon1 | Installed 37 packages in 45ms 2026-03-05 20:58:53.228911 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 20:58:53.229008 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 20:58:54.006631 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 20:58:54.006726 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 20:59:07.625891 | mon1 | INFO [default > dependency] Executing 2026-03-05 20:59:07.626021 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 20:59:07.626337 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 20:59:07.626509 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 20:59:07.633279 | mon1 | INFO [default > cleanup] Executing 2026-03-05 20:59:07.633570 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:59:07.639433 | mon1 | INFO [default > destroy] Executing 2026-03-05 20:59:07.639462 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 20:59:07.639580 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 20:59:07.645690 | mon1 | INFO [default > syntax] Executing 2026-03-05 20:59:08.722620 | mon1 | 2026-03-05 20:59:08.722828 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 20:59:08.782892 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 20:59:08.793337 | mon1 | INFO [default > create] Executing 2026-03-05 20:59:08.795383 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:59:08.801599 | mon1 | INFO [default > prepare] Executing 2026-03-05 20:59:09.669054 | mon1 | 2026-03-05 20:59:09.669129 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 20:59:09.669543 | mon1 | 2026-03-05 20:59:09.669836 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:59:09.670135 | mon1 | Thursday 05 March 2026 20:59:09 +0000 (0:00:00.035) 0:00:00.035 ******** 2026-03-05 20:59:10.967431 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 20:59:10.967523 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 20:59:10.968873 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 20:59:10.968928 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 20:59:10.968935 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:59:11.982060 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 20:59:11.982209 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 20:59:11.982230 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 20:59:11.982240 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 20:59:11.982434 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:59:11.992028 | mon1 | ok: [mon1] 2026-03-05 20:59:11.992258 | mon1 | ok: [osd1] 2026-03-05 20:59:11.992489 | mon1 | 2026-03-05 20:59:11.992742 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 20:59:11.993036 | mon1 | Thursday 05 March 2026 20:59:11 +0000 (0:00:02.324) 0:00:02.359 ******** 2026-03-05 20:59:13.798566 | mon1 | changed: [osd1] 2026-03-05 20:59:13.798768 | mon1 | changed: [mon1] 2026-03-05 20:59:13.799038 | mon1 | 2026-03-05 20:59:13.799359 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 20:59:13.799639 | mon1 | Thursday 05 March 2026 20:59:13 +0000 (0:00:01.805) 0:00:04.165 ******** 2026-03-05 20:59:14.137833 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 20:59:14.138182 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 20:59:14.138455 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 20:59:14.164653 | mon1 | changed: [mon1] 2026-03-05 20:59:14.164921 | mon1 | changed: [osd1] 2026-03-05 20:59:14.165161 | mon1 | 2026-03-05 20:59:14.165395 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 20:59:14.165681 | mon1 | Thursday 05 March 2026 20:59:14 +0000 (0:00:00.366) 0:00:04.531 ******** 2026-03-05 20:59:21.726837 | mon1 | changed: [mon1] 2026-03-05 20:59:21.727024 | mon1 | changed: [osd1] 2026-03-05 20:59:21.727261 | mon1 | 2026-03-05 20:59:21.727522 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 20:59:21.727747 | mon1 | 2026-03-05 20:59:21.728077 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:59:21.728440 | mon1 | Thursday 05 March 2026 20:59:21 +0000 (0:00:07.559) 0:00:12.091 ******** 2026-03-05 20:59:22.889685 | mon1 | ok: [osd1] 2026-03-05 20:59:22.889748 | mon1 | 2026-03-05 20:59:22.889759 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 20:59:22.889769 | mon1 | Thursday 05 March 2026 20:59:22 +0000 (0:00:01.164) 0:00:13.255 ******** 2026-03-05 20:59:57.077380 | mon1 | changed: [osd1] 2026-03-05 20:59:57.077482 | mon1 | 2026-03-05 20:59:57.077500 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 20:59:57.077517 | mon1 | Thursday 05 March 2026 20:59:57 +0000 (0:00:34.187) 0:00:47.443 ******** 2026-03-05 20:59:57.733970 | mon1 | ok: [osd1] 2026-03-05 20:59:57.734062 | mon1 | 2026-03-05 20:59:57.734083 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 20:59:57.734301 | mon1 | Thursday 05 March 2026 20:59:57 +0000 (0:00:00.657) 0:00:48.100 ******** 2026-03-05 20:59:58.098254 | mon1 | ok: [osd1] 2026-03-05 20:59:58.098420 | mon1 | 2026-03-05 20:59:58.098439 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 20:59:58.100896 | mon1 | Thursday 05 March 2026 20:59:58 +0000 (0:00:00.365) 0:00:48.465 ******** 2026-03-05 20:59:58.948979 | mon1 | changed: [osd1] 2026-03-05 20:59:58.949167 | mon1 | 2026-03-05 20:59:58.949424 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 20:59:58.949676 | mon1 | Thursday 05 March 2026 20:59:58 +0000 (0:00:00.850) 0:00:49.316 ******** 2026-03-05 20:59:59.206009 | mon1 | ok: [osd1] 2026-03-05 20:59:59.206244 | mon1 | 2026-03-05 20:59:59.206506 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 20:59:59.206757 | mon1 | Thursday 05 March 2026 20:59:59 +0000 (0:00:00.256) 0:00:49.572 ******** 2026-03-05 20:59:59.233385 | mon1 | skipping: [osd1] 2026-03-05 20:59:59.233606 | mon1 | 2026-03-05 20:59:59.233885 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 20:59:59.234136 | mon1 | Thursday 05 March 2026 20:59:59 +0000 (0:00:00.028) 0:00:49.601 ******** 2026-03-05 20:59:59.938192 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 20:59:59.938402 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 20:59:59.938705 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 20:59:59.938993 | mon1 | 2026-03-05 20:59:59.939317 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 20:59:59.939613 | mon1 | Thursday 05 March 2026 20:59:59 +0000 (0:00:00.704) 0:00:50.305 ******** 2026-03-05 21:00:00.749932 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:00:00.750142 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:00:00.750339 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:00:00.750509 | mon1 | 2026-03-05 21:00:00.750674 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 21:00:00.750851 | mon1 | Thursday 05 March 2026 21:00:00 +0000 (0:00:00.811) 0:00:51.117 ******** 2026-03-05 21:00:01.587070 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:00:01.587174 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:00:01.587336 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:00:01.587470 | mon1 | 2026-03-05 21:00:01.587620 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 21:00:01.587770 | mon1 | Thursday 05 March 2026 21:00:01 +0000 (0:00:00.837) 0:00:51.954 ******** 2026-03-05 21:00:03.544524 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 21:00:03.544642 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 21:00:03.544946 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 21:00:03.545255 | mon1 | 2026-03-05 21:00:03.545459 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 21:00:03.545714 | mon1 | Thursday 05 March 2026 21:00:03 +0000 (0:00:01.957) 0:00:53.911 ******** 2026-03-05 21:00:05.144158 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 21:00:05.144216 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 21:00:05.144222 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 21:00:05.144228 | mon1 | 2026-03-05 21:00:05.144837 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:00:05.144853 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:00:05.145884 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 21:00:05.145950 | mon1 | 2026-03-05 21:00:05.145960 | mon1 | 2026-03-05 21:00:05.145970 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:00:05.146093 | mon1 | Thursday 05 March 2026 21:00:05 +0000 (0:00:01.599) 0:00:55.511 ******** 2026-03-05 21:00:05.146393 | mon1 | =============================================================================== 2026-03-05 21:00:05.146721 | mon1 | Install depedencies ---------------------------------------------------- 34.19s 2026-03-05 21:00:05.147054 | mon1 | Update apt cache -------------------------------------------------------- 7.56s 2026-03-05 21:00:05.147287 | mon1 | Gathering Facts --------------------------------------------------------- 2.32s 2026-03-05 21:00:05.147488 | mon1 | Create a volume group for each loop device ------------------------------ 1.96s 2026-03-05 21:00:05.147685 | mon1 | Configure short hostname ------------------------------------------------ 1.81s 2026-03-05 21:00:05.147911 | mon1 | Create a logical volume for each loop device ---------------------------- 1.60s 2026-03-05 21:00:05.148116 | mon1 | Gathering Facts --------------------------------------------------------- 1.16s 2026-03-05 21:00:05.148315 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.85s 2026-03-05 21:00:05.148514 | mon1 | Start loop devices ------------------------------------------------------ 0.84s 2026-03-05 21:00:05.148714 | mon1 | Set permissions on loopback devices ------------------------------------- 0.81s 2026-03-05 21:00:05.148939 | mon1 | Create devices for Ceph ------------------------------------------------- 0.70s 2026-03-05 21:00:05.149144 | mon1 | Start up service -------------------------------------------------------- 0.66s 2026-03-05 21:00:05.149342 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.37s 2026-03-05 21:00:05.149540 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.37s 2026-03-05 21:00:05.149743 | mon1 | Get list of all loopback devices ---------------------------------------- 0.26s 2026-03-05 21:00:05.149998 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-05 21:00:05.249641 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 21:00:05.260714 | mon1 | INFO [default > converge] Executing 2026-03-05 21:00:06.285105 | mon1 | 2026-03-05 21:00:06.286558 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:00:06.286587 | mon1 | 2026-03-05 21:00:06.286647 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:00:06.286659 | mon1 | Thursday 05 March 2026 21:00:06 +0000 (0:00:00.055) 0:00:00.055 ******** 2026-03-05 21:00:07.402087 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:00:07.402172 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:00:07.402218 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:00:07.402228 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:00:07.402245 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:00:07.415418 | mon1 | ok: [mon1] 2026-03-05 21:00:07.415611 | mon1 | 2026-03-05 21:00:07.416062 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:00:07.416323 | mon1 | Thursday 05 March 2026 21:00:07 +0000 (0:00:01.130) 0:00:01.185 ******** 2026-03-05 21:00:07.789366 | mon1 | ok: [mon1] 2026-03-05 21:00:07.789532 | mon1 | 2026-03-05 21:00:07.789820 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:00:07.790071 | mon1 | Thursday 05 March 2026 21:00:07 +0000 (0:00:00.372) 0:00:01.558 ******** 2026-03-05 21:00:07.832448 | mon1 | skipping: [mon1] 2026-03-05 21:00:07.832647 | mon1 | 2026-03-05 21:00:07.832937 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:00:07.833210 | mon1 | Thursday 05 March 2026 21:00:07 +0000 (0:00:00.044) 0:00:01.602 ******** 2026-03-05 21:00:08.192479 | mon1 | changed: [mon1] 2026-03-05 21:00:08.192819 | mon1 | 2026-03-05 21:00:08.193086 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:00:08.193320 | mon1 | Thursday 05 March 2026 21:00:08 +0000 (0:00:00.359) 0:00:01.962 ******** 2026-03-05 21:00:08.305427 | mon1 | ok: [mon1] => { 2026-03-05 21:00:08.305599 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:00:08.305831 | mon1 | } 2026-03-05 21:00:08.306081 | mon1 | 2026-03-05 21:00:08.306337 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:00:08.306584 | mon1 | Thursday 05 March 2026 21:00:08 +0000 (0:00:00.112) 0:00:02.075 ******** 2026-03-05 21:00:09.153741 | mon1 | changed: [mon1] 2026-03-05 21:00:09.154064 | mon1 | 2026-03-05 21:00:09.154347 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:00:09.154720 | mon1 | Thursday 05 March 2026 21:00:09 +0000 (0:00:00.848) 0:00:02.923 ******** 2026-03-05 21:00:09.205988 | mon1 | skipping: [mon1] 2026-03-05 21:00:09.206139 | mon1 | 2026-03-05 21:00:09.206399 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:00:09.206642 | mon1 | Thursday 05 March 2026 21:00:09 +0000 (0:00:00.052) 0:00:02.976 ******** 2026-03-05 21:00:09.259962 | mon1 | skipping: [mon1] 2026-03-05 21:00:09.260159 | mon1 | 2026-03-05 21:00:09.260478 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:00:09.260753 | mon1 | Thursday 05 March 2026 21:00:09 +0000 (0:00:00.053) 0:00:03.029 ******** 2026-03-05 21:00:09.516824 | mon1 | ok: [mon1] 2026-03-05 21:00:09.517079 | mon1 | 2026-03-05 21:00:09.517722 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:00:09.517775 | mon1 | Thursday 05 March 2026 21:00:09 +0000 (0:00:00.256) 0:00:03.286 ******** 2026-03-05 21:00:10.635938 | mon1 | ok: [mon1] 2026-03-05 21:00:10.635997 | mon1 | 2026-03-05 21:00:10.636151 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:00:10.636405 | mon1 | Thursday 05 March 2026 21:00:10 +0000 (0:00:01.119) 0:00:04.405 ******** 2026-03-05 21:00:10.833966 | mon1 | ok: [mon1] => { 2026-03-05 21:00:10.834048 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:00:10.834111 | mon1 | } 2026-03-05 21:00:10.834121 | mon1 | 2026-03-05 21:00:10.834138 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:00:10.834246 | mon1 | Thursday 05 March 2026 21:00:10 +0000 (0:00:00.197) 0:00:04.603 ******** 2026-03-05 21:00:11.820992 | mon1 | changed: [mon1] 2026-03-05 21:00:11.821057 | mon1 | 2026-03-05 21:00:11.821068 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:00:11.821287 | mon1 | Thursday 05 March 2026 21:00:11 +0000 (0:00:00.987) 0:00:05.590 ******** 2026-03-05 21:00:15.058923 | mon1 | changed: [mon1] 2026-03-05 21:00:15.058977 | mon1 | 2026-03-05 21:00:15.059465 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:00:15.059510 | mon1 | Thursday 05 March 2026 21:00:15 +0000 (0:00:03.238) 0:00:08.828 ******** 2026-03-05 21:00:15.094943 | mon1 | skipping: [mon1] 2026-03-05 21:00:15.094977 | mon1 | 2026-03-05 21:00:15.095181 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:00:15.095363 | mon1 | Thursday 05 March 2026 21:00:15 +0000 (0:00:00.035) 0:00:08.864 ******** 2026-03-05 21:00:15.129706 | mon1 | skipping: [mon1] 2026-03-05 21:00:15.129752 | mon1 | 2026-03-05 21:00:15.129757 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:00:15.129761 | mon1 | Thursday 05 March 2026 21:00:15 +0000 (0:00:00.035) 0:00:08.899 ******** 2026-03-05 21:00:15.164961 | mon1 | skipping: [mon1] 2026-03-05 21:00:15.165005 | mon1 | 2026-03-05 21:00:15.165023 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:00:15.165336 | mon1 | Thursday 05 March 2026 21:00:15 +0000 (0:00:00.035) 0:00:08.934 ******** 2026-03-05 21:00:24.766182 | mon1 | changed: [mon1] 2026-03-05 21:00:24.766288 | mon1 | 2026-03-05 21:00:24.766299 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:00:24.766424 | mon1 | Thursday 05 March 2026 21:00:24 +0000 (0:00:09.596) 0:00:18.531 ******** 2026-03-05 21:00:25.471087 | mon1 | changed: [mon1] 2026-03-05 21:00:25.471255 | mon1 | 2026-03-05 21:00:25.471544 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:00:25.471807 | mon1 | Thursday 05 March 2026 21:00:25 +0000 (0:00:00.710) 0:00:19.241 ******** 2026-03-05 21:00:26.633537 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:00:26.633768 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:00:26.634048 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:00:26.634333 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:00:26.634601 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:00:26.634886 | mon1 | 2026-03-05 21:00:26.635128 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:00:26.635368 | mon1 | Thursday 05 March 2026 21:00:26 +0000 (0:00:01.162) 0:00:20.403 ******** 2026-03-05 21:00:27.396498 | mon1 | changed: [mon1] 2026-03-05 21:00:27.396668 | mon1 | 2026-03-05 21:00:27.397010 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:00:27.397263 | mon1 | Thursday 05 March 2026 21:00:27 +0000 (0:00:00.755) 0:00:21.159 ******** 2026-03-05 21:00:27.397486 | mon1 | 2026-03-05 21:00:27.397743 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:00:27.398037 | mon1 | Thursday 05 March 2026 21:00:27 +0000 (0:00:00.007) 0:00:21.166 ******** 2026-03-05 21:00:28.524915 | mon1 | ok: [mon1] 2026-03-05 21:00:28.525094 | mon1 | 2026-03-05 21:00:28.525390 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:00:28.525703 | mon1 | Thursday 05 March 2026 21:00:28 +0000 (0:00:01.128) 0:00:22.295 ******** 2026-03-05 21:00:29.170240 | mon1 | changed: [mon1] 2026-03-05 21:00:29.170447 | mon1 | 2026-03-05 21:00:29.170731 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:00:29.171255 | mon1 | Thursday 05 March 2026 21:00:29 +0000 (0:00:00.645) 0:00:22.940 ******** 2026-03-05 21:00:29.894010 | mon1 | changed: [mon1] 2026-03-05 21:00:29.894082 | mon1 | 2026-03-05 21:00:29.894094 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:00:29.894111 | mon1 | Thursday 05 March 2026 21:00:29 +0000 (0:00:00.722) 0:00:23.663 ******** 2026-03-05 21:00:30.158449 | mon1 | ok: [mon1] 2026-03-05 21:00:30.158535 | mon1 | 2026-03-05 21:00:30.159960 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:00:30.160030 | mon1 | Thursday 05 March 2026 21:00:30 +0000 (0:00:00.264) 0:00:23.927 ******** 2026-03-05 21:00:30.242558 | mon1 | ok: [mon1] => { 2026-03-05 21:00:30.242914 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:00:30.243028 | mon1 | } 2026-03-05 21:00:30.243047 | mon1 | 2026-03-05 21:00:30.243057 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:00:30.243196 | mon1 | Thursday 05 March 2026 21:00:30 +0000 (0:00:00.084) 0:00:24.011 ******** 2026-03-05 21:00:31.221330 | mon1 | changed: [mon1] 2026-03-05 21:00:31.221401 | mon1 | 2026-03-05 21:00:31.221819 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:00:31.221867 | mon1 | Thursday 05 March 2026 21:00:31 +0000 (0:00:00.979) 0:00:24.990 ******** 2026-03-05 21:00:35.913619 | mon1 | changed: [mon1] 2026-03-05 21:00:35.913690 | mon1 | 2026-03-05 21:00:35.913701 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:00:35.913710 | mon1 | Thursday 05 March 2026 21:00:35 +0000 (0:00:04.691) 0:00:29.681 ******** 2026-03-05 21:00:36.843562 | mon1 | ok: [mon1] 2026-03-05 21:00:36.843633 | mon1 | 2026-03-05 21:00:36.843644 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:00:36.843653 | mon1 | Thursday 05 March 2026 21:00:36 +0000 (0:00:00.929) 0:00:30.611 ******** 2026-03-05 21:00:37.727446 | mon1 | changed: [mon1] 2026-03-05 21:00:37.727504 | mon1 | 2026-03-05 21:00:37.727515 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:00:37.727524 | mon1 | Thursday 05 March 2026 21:00:37 +0000 (0:00:00.884) 0:00:31.496 ******** 2026-03-05 21:00:38.325223 | mon1 | changed: [mon1] 2026-03-05 21:00:38.325281 | mon1 | 2026-03-05 21:00:38.325412 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:00:38.325561 | mon1 | Thursday 05 March 2026 21:00:38 +0000 (0:00:00.598) 0:00:32.094 ******** 2026-03-05 21:00:39.046905 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:00:39.046993 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:00:39.047959 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:00:39.048043 | mon1 | 2026-03-05 21:00:39.048054 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:00:39.048072 | mon1 | Thursday 05 March 2026 21:00:39 +0000 (0:00:00.721) 0:00:32.815 ******** 2026-03-05 21:00:39.652485 | mon1 | changed: [mon1] 2026-03-05 21:00:39.652551 | mon1 | 2026-03-05 21:00:39.652563 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:00:39.652573 | mon1 | Thursday 05 March 2026 21:00:39 +0000 (0:00:00.605) 0:00:33.421 ******** 2026-03-05 21:00:40.231272 | mon1 | changed: [mon1] 2026-03-05 21:00:40.231341 | mon1 | 2026-03-05 21:00:40.231348 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:00:40.231356 | mon1 | Thursday 05 March 2026 21:00:40 +0000 (0:00:00.571) 0:00:33.993 ******** 2026-03-05 21:00:40.231361 | mon1 | 2026-03-05 21:00:40.231366 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:00:40.231372 | mon1 | Thursday 05 March 2026 21:00:40 +0000 (0:00:00.007) 0:00:34.000 ******** 2026-03-05 21:00:41.132873 | mon1 | ok: [mon1] 2026-03-05 21:00:41.132916 | mon1 | 2026-03-05 21:00:41.132920 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:00:41.132929 | mon1 | Thursday 05 March 2026 21:00:41 +0000 (0:00:00.896) 0:00:34.897 ******** 2026-03-05 21:00:42.870543 | mon1 | changed: [mon1] 2026-03-05 21:00:42.870581 | mon1 | 2026-03-05 21:00:42.870587 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:00:42.870593 | mon1 | Thursday 05 March 2026 21:00:42 +0000 (0:00:01.742) 0:00:36.639 ******** 2026-03-05 21:00:43.594099 | mon1 | changed: [mon1] 2026-03-05 21:00:43.594142 | mon1 | 2026-03-05 21:00:43.594391 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:00:43.594407 | mon1 | Thursday 05 March 2026 21:00:43 +0000 (0:00:00.725) 0:00:37.364 ******** 2026-03-05 21:00:43.653917 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:00:43.654143 | mon1 | 2026-03-05 21:00:43.654769 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:00:43.654880 | mon1 | Thursday 05 March 2026 21:00:43 +0000 (0:00:00.058) 0:00:37.423 ******** 2026-03-05 21:01:02.882965 | mon1 | changed: [mon1] 2026-03-05 21:01:02.883033 | mon1 | 2026-03-05 21:01:02.883046 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:01:02.883059 | mon1 | Thursday 05 March 2026 21:01:02 +0000 (0:00:19.228) 0:00:56.652 ******** 2026-03-05 21:01:03.712906 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:01:03.712996 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:01:03.713714 | mon1 | 2026-03-05 21:01:03.713761 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:01:03.713775 | mon1 | Thursday 05 March 2026 21:01:03 +0000 (0:00:00.830) 0:00:57.482 ******** 2026-03-05 21:01:04.116896 | mon1 | changed: [mon1] 2026-03-05 21:01:04.116969 | mon1 | 2026-03-05 21:01:04.117365 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:01:04.117427 | mon1 | Thursday 05 March 2026 21:01:04 +0000 (0:00:00.403) 0:00:57.885 ******** 2026-03-05 21:01:04.381006 | mon1 | ok: [mon1] 2026-03-05 21:01:04.381050 | mon1 | 2026-03-05 21:01:04.381578 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:01:04.381660 | mon1 | Thursday 05 March 2026 21:01:04 +0000 (0:00:00.265) 0:00:58.150 ******** 2026-03-05 21:01:04.931344 | mon1 | changed: [mon1] 2026-03-05 21:01:04.931418 | mon1 | 2026-03-05 21:01:04.931820 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:01:04.931864 | mon1 | Thursday 05 March 2026 21:01:04 +0000 (0:00:00.550) 0:00:58.701 ******** 2026-03-05 21:01:05.348245 | mon1 | changed: [mon1] 2026-03-05 21:01:05.348314 | mon1 | 2026-03-05 21:01:05.348549 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:01:05.348579 | mon1 | Thursday 05 March 2026 21:01:05 +0000 (0:00:00.417) 0:00:59.118 ******** 2026-03-05 21:01:05.490463 | mon1 | ok: [mon1] 2026-03-05 21:01:05.490532 | mon1 | 2026-03-05 21:01:05.490546 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:01:05.490558 | mon1 | Thursday 05 March 2026 21:01:05 +0000 (0:00:00.140) 0:00:59.259 ******** 2026-03-05 21:01:05.751870 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:01:05.751980 | mon1 | 2026-03-05 21:01:05.752319 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:01:05.752664 | mon1 | Thursday 05 March 2026 21:01:05 +0000 (0:00:00.262) 0:00:59.521 ******** 2026-03-05 21:01:05.802471 | mon1 | ok: [mon1] 2026-03-05 21:01:05.803546 | mon1 | 2026-03-05 21:01:05.803585 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:01:05.803602 | mon1 | Thursday 05 March 2026 21:01:05 +0000 (0:00:00.051) 0:00:59.573 ******** 2026-03-05 21:01:05.911642 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:01:05.911706 | mon1 | 2026-03-05 21:01:05.911713 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:01:05.911719 | mon1 | Thursday 05 March 2026 21:01:05 +0000 (0:00:00.108) 0:00:59.681 ******** 2026-03-05 21:01:06.236315 | mon1 | changed: [mon1] 2026-03-05 21:01:06.236361 | mon1 | 2026-03-05 21:01:06.236371 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:01:06.236380 | mon1 | Thursday 05 March 2026 21:01:06 +0000 (0:00:00.324) 0:01:00.005 ******** 2026-03-05 21:01:07.018973 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:01:07.019043 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:01:07.019242 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:01:07.019494 | mon1 | 2026-03-05 21:01:07.019755 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:01:07.020044 | mon1 | Thursday 05 March 2026 21:01:07 +0000 (0:00:00.782) 0:01:00.788 ******** 2026-03-05 21:03:32.901381 | mon1 | ok: [mon1] 2026-03-05 21:03:32.901660 | mon1 | 2026-03-05 21:03:32.901979 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:03:32.902245 | mon1 | Thursday 05 March 2026 21:03:32 +0000 (0:02:25.877) 0:03:26.666 ******** 2026-03-05 21:03:33.165707 | mon1 | changed: [mon1] 2026-03-05 21:03:33.166071 | mon1 | 2026-03-05 21:03:33.166363 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:03:33.166627 | mon1 | Thursday 05 March 2026 21:03:33 +0000 (0:00:00.269) 0:03:26.936 ******** 2026-03-05 21:03:33.212552 | mon1 | ok: [mon1] 2026-03-05 21:03:33.212805 | mon1 | 2026-03-05 21:03:33.213082 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:03:33.213358 | mon1 | Thursday 05 March 2026 21:03:33 +0000 (0:00:00.046) 0:03:26.982 ******** 2026-03-05 21:03:33.290996 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:03:33.291225 | mon1 | 2026-03-05 21:03:33.291501 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:03:33.291853 | mon1 | Thursday 05 March 2026 21:03:33 +0000 (0:00:00.078) 0:03:27.061 ******** 2026-03-05 21:03:39.201261 | mon1 | ok: [mon1] 2026-03-05 21:03:39.201491 | mon1 | 2026-03-05 21:03:39.201767 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:03:39.202057 | mon1 | Thursday 05 March 2026 21:03:39 +0000 (0:00:05.910) 0:03:32.971 ******** 2026-03-05 21:03:39.269568 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:03:39.269779 | mon1 | 2026-03-05 21:03:39.270110 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:03:39.270444 | mon1 | Thursday 05 March 2026 21:03:39 +0000 (0:00:00.068) 0:03:33.039 ******** 2026-03-05 21:03:39.696597 | mon1 | ok: [mon1] 2026-03-05 21:03:39.696863 | mon1 | 2026-03-05 21:03:39.697141 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:03:39.697435 | mon1 | Thursday 05 March 2026 21:03:39 +0000 (0:00:00.426) 0:03:33.466 ******** 2026-03-05 21:03:47.082469 | mon1 | ok: [mon1] 2026-03-05 21:03:47.082766 | mon1 | 2026-03-05 21:03:47.083199 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:03:47.083557 | mon1 | Thursday 05 March 2026 21:03:47 +0000 (0:00:07.386) 0:03:40.852 ******** 2026-03-05 21:04:00.454082 | mon1 | changed: [mon1] 2026-03-05 21:04:00.454231 | mon1 | 2026-03-05 21:04:00.454249 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:04:00.454263 | mon1 | Thursday 05 March 2026 21:04:00 +0000 (0:00:13.371) 0:03:54.224 ******** 2026-03-05 21:04:15.198324 | mon1 | ok: [mon1] 2026-03-05 21:04:15.198411 | mon1 | 2026-03-05 21:04:15.198462 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:04:15.198597 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:14.744) 0:04:08.968 ******** 2026-03-05 21:04:15.274657 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:04:15.274716 | mon1 | 2026-03-05 21:04:15.274728 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:04:15.274740 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.074) 0:04:09.043 ******** 2026-03-05 21:04:15.328901 | mon1 | skipping: [mon1] 2026-03-05 21:04:15.328961 | mon1 | 2026-03-05 21:04:15.329540 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:04:15.329579 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.055) 0:04:09.098 ******** 2026-03-05 21:04:15.380544 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:04:15.380564 | mon1 | skipping: [mon1] 2026-03-05 21:04:15.380569 | mon1 | 2026-03-05 21:04:15.380573 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:04:15.380578 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.051) 0:04:09.150 ******** 2026-03-05 21:04:15.706382 | mon1 | ok: [mon1] 2026-03-05 21:04:15.706448 | mon1 | 2026-03-05 21:04:15.706560 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:04:15.706691 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.320) 0:04:09.470 ******** 2026-03-05 21:04:22.949178 | mon1 | ok: [mon1] 2026-03-05 21:04:22.949323 | mon1 | 2026-03-05 21:04:22.949627 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:04:22.950015 | mon1 | Thursday 05 March 2026 21:04:22 +0000 (0:00:07.248) 0:04:16.719 ******** 2026-03-05 21:04:36.013163 | mon1 | changed: [mon1] 2026-03-05 21:04:36.013358 | mon1 | 2026-03-05 21:04:36.013631 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:04:36.013918 | mon1 | Thursday 05 March 2026 21:04:36 +0000 (0:00:13.064) 0:04:29.783 ******** 2026-03-05 21:04:42.694949 | mon1 | ok: [mon1] 2026-03-05 21:04:42.695011 | mon1 | 2026-03-05 21:04:42.695027 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:04:42.695046 | mon1 | Thursday 05 March 2026 21:04:42 +0000 (0:00:06.681) 0:04:36.465 ******** 2026-03-05 21:04:54.023310 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:04:54.023391 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:04:54.023398 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:04:54.023404 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:04:54.023409 | mon1 | 2026-03-05 21:04:54.023415 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:04:54.023421 | mon1 | 2026-03-05 21:04:54.023426 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:04:54.023431 | mon1 | Thursday 05 March 2026 21:04:54 +0000 (0:00:11.322) 0:04:47.787 ******** 2026-03-05 21:04:55.266088 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:04:55.266154 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:04:55.266163 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:04:55.266170 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:04:55.266178 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:04:55.276328 | mon1 | ok: [osd1] 2026-03-05 21:04:55.276344 | mon1 | 2026-03-05 21:04:55.276351 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:04:55.276356 | mon1 | Thursday 05 March 2026 21:04:55 +0000 (0:00:01.257) 0:04:49.044 ******** 2026-03-05 21:04:55.546244 | mon1 | ok: [osd1] 2026-03-05 21:04:55.546436 | mon1 | 2026-03-05 21:04:55.546592 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:04:55.549483 | mon1 | Thursday 05 March 2026 21:04:55 +0000 (0:00:00.271) 0:04:49.316 ******** 2026-03-05 21:04:55.589012 | mon1 | skipping: [osd1] 2026-03-05 21:04:55.589159 | mon1 | 2026-03-05 21:04:55.589310 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:04:55.592982 | mon1 | Thursday 05 March 2026 21:04:55 +0000 (0:00:00.043) 0:04:49.359 ******** 2026-03-05 21:04:55.872627 | mon1 | changed: [osd1] 2026-03-05 21:04:55.872672 | mon1 | 2026-03-05 21:04:55.872678 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:04:55.872683 | mon1 | Thursday 05 March 2026 21:04:55 +0000 (0:00:00.283) 0:04:49.642 ******** 2026-03-05 21:04:55.942131 | mon1 | ok: [osd1] => { 2026-03-05 21:04:55.945735 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:04:55.945749 | mon1 | } 2026-03-05 21:04:55.945754 | mon1 | 2026-03-05 21:04:55.945758 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:04:55.945763 | mon1 | Thursday 05 March 2026 21:04:55 +0000 (0:00:00.069) 0:04:49.711 ******** 2026-03-05 21:04:56.586131 | mon1 | changed: [osd1] 2026-03-05 21:04:56.586323 | mon1 | 2026-03-05 21:04:56.589555 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:04:56.589570 | mon1 | Thursday 05 March 2026 21:04:56 +0000 (0:00:00.644) 0:04:50.356 ******** 2026-03-05 21:04:56.634920 | mon1 | skipping: [osd1] 2026-03-05 21:04:56.635091 | mon1 | 2026-03-05 21:04:56.635240 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:04:56.635383 | mon1 | Thursday 05 March 2026 21:04:56 +0000 (0:00:00.048) 0:04:50.405 ******** 2026-03-05 21:04:56.688065 | mon1 | skipping: [osd1] 2026-03-05 21:04:56.691186 | mon1 | 2026-03-05 21:04:56.691201 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:04:56.691206 | mon1 | Thursday 05 March 2026 21:04:56 +0000 (0:00:00.053) 0:04:50.458 ******** 2026-03-05 21:04:56.948155 | mon1 | ok: [osd1] 2026-03-05 21:04:56.948949 | mon1 | 2026-03-05 21:04:56.949111 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:04:56.949266 | mon1 | Thursday 05 March 2026 21:04:56 +0000 (0:00:00.259) 0:04:50.718 ******** 2026-03-05 21:04:58.178998 | mon1 | ok: [osd1] 2026-03-05 21:04:58.179941 | mon1 | 2026-03-05 21:04:58.180099 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:04:58.180246 | mon1 | Thursday 05 March 2026 21:04:58 +0000 (0:00:01.231) 0:04:51.949 ******** 2026-03-05 21:04:58.264106 | mon1 | ok: [osd1] => { 2026-03-05 21:04:58.264324 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:04:58.264468 | mon1 | } 2026-03-05 21:04:58.264600 | mon1 | 2026-03-05 21:04:58.267620 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:04:58.267773 | mon1 | Thursday 05 March 2026 21:04:58 +0000 (0:00:00.084) 0:04:52.034 ******** 2026-03-05 21:04:59.027328 | mon1 | changed: [osd1] 2026-03-05 21:04:59.027536 | mon1 | 2026-03-05 21:04:59.031088 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:04:59.031103 | mon1 | Thursday 05 March 2026 21:04:59 +0000 (0:00:00.762) 0:04:52.797 ******** 2026-03-05 21:05:01.902994 | mon1 | changed: [osd1] 2026-03-05 21:05:01.903198 | mon1 | 2026-03-05 21:05:01.903368 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:05:01.903520 | mon1 | Thursday 05 March 2026 21:05:01 +0000 (0:00:02.876) 0:04:55.673 ******** 2026-03-05 21:05:01.943862 | mon1 | skipping: [osd1] 2026-03-05 21:05:01.944142 | mon1 | 2026-03-05 21:05:01.946006 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:05:01.946179 | mon1 | Thursday 05 March 2026 21:05:01 +0000 (0:00:00.040) 0:04:55.713 ******** 2026-03-05 21:05:01.986537 | mon1 | skipping: [osd1] 2026-03-05 21:05:01.986754 | mon1 | 2026-03-05 21:05:01.986966 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:05:01.987137 | mon1 | Thursday 05 March 2026 21:05:01 +0000 (0:00:00.042) 0:04:55.756 ******** 2026-03-05 21:05:02.028893 | mon1 | skipping: [osd1] 2026-03-05 21:05:02.032214 | mon1 | 2026-03-05 21:05:02.032229 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:05:02.032252 | mon1 | Thursday 05 March 2026 21:05:02 +0000 (0:00:00.042) 0:04:55.799 ******** 2026-03-05 21:05:11.781661 | mon1 | changed: [osd1] 2026-03-05 21:05:11.781916 | mon1 | 2026-03-05 21:05:11.782215 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:05:11.783956 | mon1 | Thursday 05 March 2026 21:05:11 +0000 (0:00:09.752) 0:05:05.552 ******** 2026-03-05 21:05:12.389412 | mon1 | changed: [osd1] 2026-03-05 21:05:12.389639 | mon1 | 2026-03-05 21:05:12.389935 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:05:12.390204 | mon1 | Thursday 05 March 2026 21:05:12 +0000 (0:00:00.607) 0:05:06.159 ******** 2026-03-05 21:05:13.592729 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:05:13.593822 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:05:13.594005 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:05:13.594159 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:05:13.594309 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:05:13.595248 | mon1 | 2026-03-05 21:05:13.595448 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:05:13.595595 | mon1 | Thursday 05 March 2026 21:05:13 +0000 (0:00:01.200) 0:05:07.360 ******** 2026-03-05 21:05:14.303600 | mon1 | changed: [osd1] 2026-03-05 21:05:14.303781 | mon1 | 2026-03-05 21:05:14.303999 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:05:14.304182 | mon1 | Thursday 05 March 2026 21:05:14 +0000 (0:00:00.701) 0:05:08.061 ******** 2026-03-05 21:05:14.304322 | mon1 | 2026-03-05 21:05:14.304533 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:05:14.304693 | mon1 | Thursday 05 March 2026 21:05:14 +0000 (0:00:00.006) 0:05:08.067 ******** 2026-03-05 21:05:15.250230 | mon1 | ok: [osd1] 2026-03-05 21:05:15.252236 | mon1 | 2026-03-05 21:05:15.252251 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:05:15.252256 | mon1 | Thursday 05 March 2026 21:05:15 +0000 (0:00:00.952) 0:05:09.020 ******** 2026-03-05 21:05:16.083275 | mon1 | changed: [osd1] 2026-03-05 21:05:16.083450 | mon1 | 2026-03-05 21:05:16.083987 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:05:16.084146 | mon1 | Thursday 05 March 2026 21:05:16 +0000 (0:00:00.832) 0:05:09.852 ******** 2026-03-05 21:05:16.790674 | mon1 | changed: [osd1] 2026-03-05 21:05:16.792153 | mon1 | 2026-03-05 21:05:16.792512 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:05:16.792875 | mon1 | Thursday 05 March 2026 21:05:16 +0000 (0:00:00.708) 0:05:10.561 ******** 2026-03-05 21:05:17.053909 | mon1 | ok: [osd1] 2026-03-05 21:05:17.053947 | mon1 | 2026-03-05 21:05:17.053952 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:05:17.053956 | mon1 | Thursday 05 March 2026 21:05:17 +0000 (0:00:00.263) 0:05:10.824 ******** 2026-03-05 21:05:17.116872 | mon1 | ok: [osd1] => { 2026-03-05 21:05:17.117066 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:05:17.117210 | mon1 | } 2026-03-05 21:05:17.117343 | mon1 | 2026-03-05 21:05:17.117596 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:05:17.117970 | mon1 | Thursday 05 March 2026 21:05:17 +0000 (0:00:00.063) 0:05:10.887 ******** 2026-03-05 21:05:18.334549 | mon1 | changed: [osd1] 2026-03-05 21:05:18.334584 | mon1 | 2026-03-05 21:05:18.334589 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:05:18.334593 | mon1 | Thursday 05 March 2026 21:05:18 +0000 (0:00:01.215) 0:05:12.102 ******** 2026-03-05 21:05:23.059504 | mon1 | changed: [osd1] 2026-03-05 21:05:23.062112 | mon1 | 2026-03-05 21:05:23.062126 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:05:23.062130 | mon1 | Thursday 05 March 2026 21:05:23 +0000 (0:00:04.727) 0:05:16.830 ******** 2026-03-05 21:05:24.167865 | mon1 | ok: [osd1] 2026-03-05 21:05:24.168935 | mon1 | 2026-03-05 21:05:24.169087 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:05:24.169229 | mon1 | Thursday 05 March 2026 21:05:24 +0000 (0:00:01.107) 0:05:17.937 ******** 2026-03-05 21:05:24.496607 | mon1 | changed: [osd1] 2026-03-05 21:05:24.497989 | mon1 | 2026-03-05 21:05:24.498180 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:05:24.498340 | mon1 | Thursday 05 March 2026 21:05:24 +0000 (0:00:00.329) 0:05:18.267 ******** 2026-03-05 21:05:25.082926 | mon1 | changed: [osd1] 2026-03-05 21:05:25.083153 | mon1 | 2026-03-05 21:05:25.086217 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:05:25.086237 | mon1 | Thursday 05 March 2026 21:05:25 +0000 (0:00:00.586) 0:05:18.853 ******** 2026-03-05 21:05:25.796428 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:05:25.796707 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:05:25.796985 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:05:25.798024 | mon1 | 2026-03-05 21:05:25.798267 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:05:25.798488 | mon1 | Thursday 05 March 2026 21:05:25 +0000 (0:00:00.713) 0:05:19.566 ******** 2026-03-05 21:05:26.414071 | mon1 | changed: [osd1] 2026-03-05 21:05:26.414996 | mon1 | 2026-03-05 21:05:26.415222 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:05:26.415426 | mon1 | Thursday 05 March 2026 21:05:26 +0000 (0:00:00.617) 0:05:20.184 ******** 2026-03-05 21:05:27.008201 | mon1 | changed: [osd1] 2026-03-05 21:05:27.008373 | mon1 | 2026-03-05 21:05:27.011067 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:05:27.011222 | mon1 | Thursday 05 March 2026 21:05:26 +0000 (0:00:00.586) 0:05:20.770 ******** 2026-03-05 21:05:27.011357 | mon1 | 2026-03-05 21:05:27.011503 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:05:27.011645 | mon1 | Thursday 05 March 2026 21:05:27 +0000 (0:00:00.007) 0:05:20.778 ******** 2026-03-05 21:05:27.956215 | mon1 | ok: [osd1] 2026-03-05 21:05:27.956385 | mon1 | 2026-03-05 21:05:27.956530 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:05:27.956672 | mon1 | Thursday 05 March 2026 21:05:27 +0000 (0:00:00.947) 0:05:21.726 ******** 2026-03-05 21:05:29.800277 | mon1 | changed: [osd1] 2026-03-05 21:05:29.800356 | mon1 | 2026-03-05 21:05:29.800573 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:05:29.800612 | mon1 | Thursday 05 March 2026 21:05:29 +0000 (0:00:01.844) 0:05:23.570 ******** 2026-03-05 21:05:30.540250 | mon1 | changed: [osd1] 2026-03-05 21:05:30.540314 | mon1 | 2026-03-05 21:05:30.540573 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:05:30.540614 | mon1 | Thursday 05 March 2026 21:05:30 +0000 (0:00:00.739) 0:05:24.310 ******** 2026-03-05 21:05:30.597340 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:05:30.597394 | mon1 | 2026-03-05 21:05:30.597646 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:05:30.597676 | mon1 | Thursday 05 March 2026 21:05:30 +0000 (0:00:00.056) 0:05:24.367 ******** 2026-03-05 21:05:31.887929 | mon1 | ok: [osd1] 2026-03-05 21:05:31.888001 | mon1 | 2026-03-05 21:05:31.888460 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:05:31.888494 | mon1 | Thursday 05 March 2026 21:05:31 +0000 (0:00:01.289) 0:05:25.657 ******** 2026-03-05 21:05:32.718698 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:05:32.718778 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:05:32.718846 | mon1 | 2026-03-05 21:05:32.718857 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:05:32.718866 | mon1 | Thursday 05 March 2026 21:05:32 +0000 (0:00:00.830) 0:05:26.487 ******** 2026-03-05 21:05:33.535329 | mon1 | changed: [osd1] 2026-03-05 21:05:33.535403 | mon1 | 2026-03-05 21:05:33.535694 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:05:33.535898 | mon1 | Thursday 05 March 2026 21:05:33 +0000 (0:00:00.817) 0:05:27.304 ******** 2026-03-05 21:05:33.777307 | mon1 | ok: [osd1] 2026-03-05 21:05:33.777360 | mon1 | 2026-03-05 21:05:33.777371 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:05:33.777568 | mon1 | Thursday 05 March 2026 21:05:33 +0000 (0:00:00.241) 0:05:27.546 ******** 2026-03-05 21:05:34.193896 | mon1 | changed: [osd1] 2026-03-05 21:05:34.193934 | mon1 | 2026-03-05 21:05:34.193940 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:05:34.193956 | mon1 | Thursday 05 March 2026 21:05:34 +0000 (0:00:00.415) 0:05:27.961 ******** 2026-03-05 21:05:34.476413 | mon1 | changed: [osd1] 2026-03-05 21:05:34.476522 | mon1 | 2026-03-05 21:05:34.476817 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:05:34.476893 | mon1 | Thursday 05 March 2026 21:05:34 +0000 (0:00:00.285) 0:05:28.247 ******** 2026-03-05 21:05:34.757249 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:05:34.757913 | mon1 | 2026-03-05 21:05:34.757976 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:05:34.758137 | mon1 | Thursday 05 March 2026 21:05:34 +0000 (0:00:00.278) 0:05:28.525 ******** 2026-03-05 21:05:34.803628 | mon1 | ok: [osd1] 2026-03-05 21:05:34.803812 | mon1 | 2026-03-05 21:05:34.804049 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:05:34.804258 | mon1 | Thursday 05 March 2026 21:05:34 +0000 (0:00:00.047) 0:05:28.573 ******** 2026-03-05 21:05:34.870631 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:05:34.870950 | mon1 | 2026-03-05 21:05:34.871251 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:05:34.871537 | mon1 | Thursday 05 March 2026 21:05:34 +0000 (0:00:00.067) 0:05:28.641 ******** 2026-03-05 21:05:41.533949 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:05:41.534028 | mon1 | 2026-03-05 21:05:41.534213 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:05:41.534498 | mon1 | Thursday 05 March 2026 21:05:41 +0000 (0:00:06.662) 0:05:35.303 ******** 2026-03-05 21:05:41.591273 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:05:41.591484 | mon1 | 2026-03-05 21:05:41.591821 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:05:41.592124 | mon1 | Thursday 05 March 2026 21:05:41 +0000 (0:00:00.057) 0:05:35.361 ******** 2026-03-05 21:05:41.952099 | mon1 | changed: [osd1] 2026-03-05 21:05:41.952292 | mon1 | 2026-03-05 21:05:41.952558 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:05:41.952824 | mon1 | Thursday 05 March 2026 21:05:41 +0000 (0:00:00.360) 0:05:35.722 ******** 2026-03-05 21:05:53.796343 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:05:53.796414 | mon1 | 2026-03-05 21:05:53.796736 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:05:53.797139 | mon1 | Thursday 05 March 2026 21:05:53 +0000 (0:00:11.842) 0:05:47.565 ******** 2026-03-05 21:05:55.463822 | mon1 | ok: [osd1] 2026-03-05 21:05:55.463859 | mon1 | 2026-03-05 21:05:55.464006 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:05:55.464291 | mon1 | Thursday 05 March 2026 21:05:55 +0000 (0:00:01.668) 0:05:49.233 ******** 2026-03-05 21:06:43.693312 | mon1 | ok: [osd1] 2026-03-05 21:06:43.693596 | mon1 | 2026-03-05 21:06:43.693911 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:06:43.694268 | mon1 | Thursday 05 March 2026 21:06:43 +0000 (0:00:48.230) 0:06:37.463 ******** 2026-03-05 21:08:47.193285 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:08:47.193498 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:08:47.193670 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:08:47.193834 | mon1 | 2026-03-05 21:08:47.194151 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:08:47.194163 | mon1 | Thursday 05 March 2026 21:08:47 +0000 (0:02:03.499) 0:08:40.963 ******** 2026-03-05 21:08:53.954262 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:08:53.954346 | mon1 | 2026-03-05 21:08:53.954570 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:08:53.954604 | mon1 | Thursday 05 March 2026 21:08:53 +0000 (0:00:06.760) 0:08:47.724 ******** 2026-03-05 21:09:00.624043 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:00.624134 | mon1 | 2026-03-05 21:09:00.624149 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:09:00.624234 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:06.669) 0:08:54.393 ******** 2026-03-05 21:09:00.727983 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:09:00.728125 | mon1 | 2026-03-05 21:09:00.728394 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:09:00.728684 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.104) 0:08:54.498 ******** 2026-03-05 21:09:00.777653 | mon1 | ok: [osd1] 2026-03-05 21:09:00.777933 | mon1 | 2026-03-05 21:09:00.778218 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:09:00.778471 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.049) 0:08:54.547 ******** 2026-03-05 21:09:07.438069 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:07.438157 | mon1 | 2026-03-05 21:09:07.438844 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:09:07.438879 | mon1 | Thursday 05 March 2026 21:09:07 +0000 (0:00:06.659) 0:09:01.207 ******** 2026-03-05 21:09:07.486940 | mon1 | ok: [osd1] 2026-03-05 21:09:07.487083 | mon1 | 2026-03-05 21:09:07.487346 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:09:07.487594 | mon1 | Thursday 05 March 2026 21:09:07 +0000 (0:00:00.049) 0:09:01.257 ******** 2026-03-05 21:09:07.527561 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:09:07.527904 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:09:07.528162 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:09:07.528424 | mon1 | skipping: [osd1] 2026-03-05 21:09:07.528669 | mon1 | 2026-03-05 21:09:07.528979 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:09:07.529246 | mon1 | Thursday 05 March 2026 21:09:07 +0000 (0:00:00.040) 0:09:01.297 ******** 2026-03-05 21:09:07.567168 | mon1 | skipping: [osd1] 2026-03-05 21:09:07.567365 | mon1 | 2026-03-05 21:09:07.567627 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:09:07.567977 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:09:07.568271 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:09:07.568463 | mon1 | 2026-03-05 21:09:07.568679 | mon1 | 2026-03-05 21:09:07.568950 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:09:07.569216 | mon1 | Thursday 05 March 2026 21:09:07 +0000 (0:00:00.040) 0:09:01.337 ******** 2026-03-05 21:09:07.569454 | mon1 | =============================================================================== 2026-03-05 21:09:07.569693 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 145.88s 2026-03-05 21:09:07.569969 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 123.50s 2026-03-05 21:09:07.570212 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 48.23s 2026-03-05 21:09:07.570453 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.23s 2026-03-05 21:09:07.570699 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.74s 2026-03-05 21:09:07.570981 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.37s 2026-03-05 21:09:07.571229 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 13.06s 2026-03-05 21:09:07.571470 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 11.84s 2026-03-05 21:09:07.571826 | mon1 | vexxhost.ceph.mgr : Configure manager modules -------------------------- 11.32s 2026-03-05 21:09:07.572018 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.75s 2026-03-05 21:09:07.572259 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.60s 2026-03-05 21:09:07.572502 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.39s 2026-03-05 21:09:07.572767 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.25s 2026-03-05 21:09:07.573022 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.76s 2026-03-05 21:09:07.573278 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.68s 2026-03-05 21:09:07.573523 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.67s 2026-03-05 21:09:07.573768 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.66s 2026-03-05 21:09:07.574049 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.66s 2026-03-05 21:09:07.574296 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.91s 2026-03-05 21:09:07.574539 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.73s 2026-03-05 21:09:07.662941 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:09:07.676515 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:09:08.651747 | mon1 | 2026-03-05 21:09:08.652001 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:09:08.652264 | mon1 | 2026-03-05 21:09:08.652479 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:09:08.652712 | mon1 | Thursday 05 March 2026 21:09:08 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-03-05 21:09:09.871894 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:09:09.871946 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:09:09.871953 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:09:09.871966 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:09:09.871977 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:09:09.885289 | mon1 | ok: [mon1] 2026-03-05 21:09:09.885416 | mon1 | 2026-03-05 21:09:09.885583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:09:09.885747 | mon1 | Thursday 05 March 2026 21:09:09 +0000 (0:00:01.234) 0:00:01.286 ******** 2026-03-05 21:09:10.234817 | mon1 | ok: [mon1] 2026-03-05 21:09:10.234868 | mon1 | 2026-03-05 21:09:10.234996 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:09:10.235097 | mon1 | Thursday 05 March 2026 21:09:10 +0000 (0:00:00.349) 0:00:01.635 ******** 2026-03-05 21:09:10.272985 | mon1 | skipping: [mon1] 2026-03-05 21:09:10.273170 | mon1 | 2026-03-05 21:09:10.273435 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:09:10.273706 | mon1 | Thursday 05 March 2026 21:09:10 +0000 (0:00:00.037) 0:00:01.673 ******** 2026-03-05 21:09:10.618569 | mon1 | ok: [mon1] 2026-03-05 21:09:10.618631 | mon1 | 2026-03-05 21:09:10.618770 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:09:10.618942 | mon1 | Thursday 05 March 2026 21:09:10 +0000 (0:00:00.345) 0:00:02.019 ******** 2026-03-05 21:09:10.695158 | mon1 | ok: [mon1] => { 2026-03-05 21:09:10.695297 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:09:10.695441 | mon1 | } 2026-03-05 21:09:10.695584 | mon1 | 2026-03-05 21:09:10.695740 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:09:10.695927 | mon1 | Thursday 05 March 2026 21:09:10 +0000 (0:00:00.076) 0:00:02.096 ******** 2026-03-05 21:09:11.208148 | mon1 | ok: [mon1] 2026-03-05 21:09:11.208253 | mon1 | 2026-03-05 21:09:11.208519 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:09:11.208758 | mon1 | Thursday 05 March 2026 21:09:11 +0000 (0:00:00.512) 0:00:02.608 ******** 2026-03-05 21:09:11.259494 | mon1 | skipping: [mon1] 2026-03-05 21:09:11.259722 | mon1 | 2026-03-05 21:09:11.260012 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:09:11.260255 | mon1 | Thursday 05 March 2026 21:09:11 +0000 (0:00:00.051) 0:00:02.660 ******** 2026-03-05 21:09:11.309352 | mon1 | skipping: [mon1] 2026-03-05 21:09:11.309615 | mon1 | 2026-03-05 21:09:11.309904 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:09:11.310163 | mon1 | Thursday 05 March 2026 21:09:11 +0000 (0:00:00.049) 0:00:02.710 ******** 2026-03-05 21:09:11.567213 | mon1 | ok: [mon1] 2026-03-05 21:09:11.567309 | mon1 | 2026-03-05 21:09:11.567594 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:09:11.567877 | mon1 | Thursday 05 March 2026 21:09:11 +0000 (0:00:00.257) 0:00:02.968 ******** 2026-03-05 21:09:12.834744 | mon1 | ok: [mon1] 2026-03-05 21:09:12.834835 | mon1 | 2026-03-05 21:09:12.834868 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:09:12.834878 | mon1 | Thursday 05 March 2026 21:09:12 +0000 (0:00:01.266) 0:00:04.235 ******** 2026-03-05 21:09:13.030996 | mon1 | ok: [mon1] => { 2026-03-05 21:09:13.031069 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:09:13.031080 | mon1 | } 2026-03-05 21:09:13.031089 | mon1 | 2026-03-05 21:09:13.031105 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:09:13.032168 | mon1 | Thursday 05 March 2026 21:09:13 +0000 (0:00:00.195) 0:00:04.430 ******** 2026-03-05 21:09:13.551293 | mon1 | ok: [mon1] 2026-03-05 21:09:13.551479 | mon1 | 2026-03-05 21:09:13.551735 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:09:13.552015 | mon1 | Thursday 05 March 2026 21:09:13 +0000 (0:00:00.521) 0:00:04.952 ******** 2026-03-05 21:09:17.068962 | mon1 | ok: [mon1] 2026-03-05 21:09:17.069037 | mon1 | 2026-03-05 21:09:17.069048 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:09:17.069214 | mon1 | Thursday 05 March 2026 21:09:17 +0000 (0:00:03.516) 0:00:08.469 ******** 2026-03-05 21:09:17.105474 | mon1 | skipping: [mon1] 2026-03-05 21:09:17.105531 | mon1 | 2026-03-05 21:09:17.105539 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:09:17.105547 | mon1 | Thursday 05 March 2026 21:09:17 +0000 (0:00:00.036) 0:00:08.505 ******** 2026-03-05 21:09:17.140545 | mon1 | skipping: [mon1] 2026-03-05 21:09:17.140603 | mon1 | 2026-03-05 21:09:17.140613 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:09:17.140622 | mon1 | Thursday 05 March 2026 21:09:17 +0000 (0:00:00.034) 0:00:08.539 ******** 2026-03-05 21:09:17.170847 | mon1 | skipping: [mon1] 2026-03-05 21:09:17.170901 | mon1 | 2026-03-05 21:09:17.170911 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:09:17.170921 | mon1 | Thursday 05 March 2026 21:09:17 +0000 (0:00:00.031) 0:00:08.571 ******** 2026-03-05 21:09:18.249995 | mon1 | ok: [mon1] 2026-03-05 21:09:18.250054 | mon1 | 2026-03-05 21:09:18.250511 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:09:18.250550 | mon1 | Thursday 05 March 2026 21:09:18 +0000 (0:00:01.078) 0:00:09.650 ******** 2026-03-05 21:09:18.819334 | mon1 | ok: [mon1] 2026-03-05 21:09:18.819391 | mon1 | 2026-03-05 21:09:18.819779 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:09:18.819824 | mon1 | Thursday 05 March 2026 21:09:18 +0000 (0:00:00.569) 0:00:10.219 ******** 2026-03-05 21:09:19.962044 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:09:19.962149 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:09:19.962920 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:09:19.962978 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:09:19.962995 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:09:19.963562 | mon1 | 2026-03-05 21:09:19.963592 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:09:19.963690 | mon1 | Thursday 05 March 2026 21:09:19 +0000 (0:00:01.142) 0:00:11.362 ******** 2026-03-05 21:09:20.598237 | mon1 | ok: [mon1] 2026-03-05 21:09:20.598318 | mon1 | 2026-03-05 21:09:20.598931 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:09:20.598967 | mon1 | Thursday 05 March 2026 21:09:20 +0000 (0:00:00.628) 0:00:11.990 ******** 2026-03-05 21:09:20.598972 | mon1 | 2026-03-05 21:09:20.598976 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:09:20.598980 | mon1 | Thursday 05 March 2026 21:09:20 +0000 (0:00:00.008) 0:00:11.998 ******** 2026-03-05 21:09:21.302911 | mon1 | ok: [mon1] 2026-03-05 21:09:21.302955 | mon1 | 2026-03-05 21:09:21.302962 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:09:21.302968 | mon1 | Thursday 05 March 2026 21:09:21 +0000 (0:00:00.704) 0:00:12.703 ******** 2026-03-05 21:09:21.577864 | mon1 | ok: [mon1] 2026-03-05 21:09:21.577916 | mon1 | 2026-03-05 21:09:21.578492 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:09:21.578518 | mon1 | Thursday 05 March 2026 21:09:21 +0000 (0:00:00.274) 0:00:12.977 ******** 2026-03-05 21:09:21.658836 | mon1 | ok: [mon1] => { 2026-03-05 21:09:21.658891 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:09:21.658900 | mon1 | } 2026-03-05 21:09:21.658910 | mon1 | 2026-03-05 21:09:21.658919 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:09:21.658928 | mon1 | Thursday 05 March 2026 21:09:21 +0000 (0:00:00.080) 0:00:13.058 ******** 2026-03-05 21:09:22.109887 | mon1 | ok: [mon1] 2026-03-05 21:09:22.109946 | mon1 | 2026-03-05 21:09:22.110569 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:09:22.110608 | mon1 | Thursday 05 March 2026 21:09:22 +0000 (0:00:00.451) 0:00:13.509 ******** 2026-03-05 21:09:25.354927 | mon1 | ok: [mon1] 2026-03-05 21:09:25.354989 | mon1 | 2026-03-05 21:09:25.355365 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:09:25.355404 | mon1 | Thursday 05 March 2026 21:09:25 +0000 (0:00:03.245) 0:00:16.755 ******** 2026-03-05 21:09:26.382984 | mon1 | ok: [mon1] 2026-03-05 21:09:26.383033 | mon1 | 2026-03-05 21:09:26.383040 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:09:26.383046 | mon1 | Thursday 05 March 2026 21:09:26 +0000 (0:00:01.027) 0:00:17.782 ******** 2026-03-05 21:09:26.738585 | mon1 | ok: [mon1] 2026-03-05 21:09:26.738780 | mon1 | 2026-03-05 21:09:26.739090 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:09:26.739331 | mon1 | Thursday 05 March 2026 21:09:26 +0000 (0:00:00.356) 0:00:18.139 ******** 2026-03-05 21:09:27.297858 | mon1 | ok: [mon1] 2026-03-05 21:09:27.297910 | mon1 | 2026-03-05 21:09:27.297972 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:09:27.298223 | mon1 | Thursday 05 March 2026 21:09:27 +0000 (0:00:00.558) 0:00:18.697 ******** 2026-03-05 21:09:27.996865 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:09:27.996963 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:09:27.997039 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:09:27.997140 | mon1 | 2026-03-05 21:09:27.997302 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:09:27.997416 | mon1 | Thursday 05 March 2026 21:09:27 +0000 (0:00:00.697) 0:00:19.395 ******** 2026-03-05 21:09:28.536631 | mon1 | ok: [mon1] 2026-03-05 21:09:28.536681 | mon1 | 2026-03-05 21:09:28.536814 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:09:28.537163 | mon1 | Thursday 05 March 2026 21:09:28 +0000 (0:00:00.541) 0:00:19.937 ******** 2026-03-05 21:09:29.085056 | mon1 | ok: [mon1] 2026-03-05 21:09:29.085359 | mon1 | 2026-03-05 21:09:29.085689 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:09:29.086748 | mon1 | Thursday 05 March 2026 21:09:29 +0000 (0:00:00.538) 0:00:20.476 ******** 2026-03-05 21:09:29.086766 | mon1 | 2026-03-05 21:09:29.087095 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:09:29.087436 | mon1 | Thursday 05 March 2026 21:09:29 +0000 (0:00:00.009) 0:00:20.485 ******** 2026-03-05 21:09:29.540371 | mon1 | ok: [mon1] 2026-03-05 21:09:29.540649 | mon1 | 2026-03-05 21:09:29.541102 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:09:29.541554 | mon1 | Thursday 05 March 2026 21:09:29 +0000 (0:00:00.455) 0:00:20.941 ******** 2026-03-05 21:09:29.596287 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:09:29.596353 | mon1 | 2026-03-05 21:09:29.596607 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:09:29.596847 | mon1 | Thursday 05 March 2026 21:09:29 +0000 (0:00:00.056) 0:00:20.997 ******** 2026-03-05 21:09:30.620387 | mon1 | ok: [mon1] 2026-03-05 21:09:30.620438 | mon1 | 2026-03-05 21:09:30.620582 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:09:30.620692 | mon1 | Thursday 05 March 2026 21:09:30 +0000 (0:00:01.024) 0:00:22.021 ******** 2026-03-05 21:09:31.438827 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-05 21:09:31.438860 | mon1 | ok: [mon1] => (item=ssh) 2026-03-05 21:09:31.438865 | mon1 | 2026-03-05 21:09:31.439092 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:09:31.439377 | mon1 | Thursday 05 March 2026 21:09:31 +0000 (0:00:00.817) 0:00:22.839 ******** 2026-03-05 21:09:31.839133 | mon1 | ok: [mon1] 2026-03-05 21:09:31.839336 | mon1 | 2026-03-05 21:09:31.839672 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:09:31.840038 | mon1 | Thursday 05 March 2026 21:09:31 +0000 (0:00:00.400) 0:00:23.240 ******** 2026-03-05 21:09:32.093668 | mon1 | ok: [mon1] 2026-03-05 21:09:32.093738 | mon1 | 2026-03-05 21:09:32.093837 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:09:32.093968 | mon1 | Thursday 05 March 2026 21:09:32 +0000 (0:00:00.254) 0:00:23.494 ******** 2026-03-05 21:09:32.524445 | mon1 | ok: [mon1] 2026-03-05 21:09:32.524580 | mon1 | 2026-03-05 21:09:32.524774 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:09:32.524981 | mon1 | Thursday 05 March 2026 21:09:32 +0000 (0:00:00.430) 0:00:23.925 ******** 2026-03-05 21:09:32.878605 | mon1 | ok: [mon1] 2026-03-05 21:09:32.878688 | mon1 | 2026-03-05 21:09:32.878715 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:09:32.878726 | mon1 | Thursday 05 March 2026 21:09:32 +0000 (0:00:00.353) 0:00:24.279 ******** 2026-03-05 21:09:32.961874 | mon1 | ok: [mon1] 2026-03-05 21:09:32.961924 | mon1 | 2026-03-05 21:09:32.962101 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:09:32.962420 | mon1 | Thursday 05 March 2026 21:09:32 +0000 (0:00:00.083) 0:00:24.362 ******** 2026-03-05 21:09:33.248170 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:09:33.250203 | mon1 | 2026-03-05 21:09:33.250216 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:09:33.250221 | mon1 | Thursday 05 March 2026 21:09:33 +0000 (0:00:00.286) 0:00:24.649 ******** 2026-03-05 21:09:33.299473 | mon1 | ok: [mon1] 2026-03-05 21:09:33.299505 | mon1 | 2026-03-05 21:09:33.299510 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:09:33.299514 | mon1 | Thursday 05 March 2026 21:09:33 +0000 (0:00:00.051) 0:00:24.700 ******** 2026-03-05 21:09:33.347587 | mon1 | skipping: [mon1] 2026-03-05 21:09:33.347990 | mon1 | 2026-03-05 21:09:33.348272 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:09:33.348664 | mon1 | Thursday 05 March 2026 21:09:33 +0000 (0:00:00.047) 0:00:24.747 ******** 2026-03-05 21:09:33.435053 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:09:33.435306 | mon1 | 2026-03-05 21:09:33.435591 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:09:33.435877 | mon1 | Thursday 05 March 2026 21:09:33 +0000 (0:00:00.087) 0:00:24.835 ******** 2026-03-05 21:09:40.223279 | mon1 | ok: [mon1] 2026-03-05 21:09:40.223581 | mon1 | 2026-03-05 21:09:40.223901 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:09:40.224165 | mon1 | Thursday 05 March 2026 21:09:40 +0000 (0:00:06.788) 0:00:31.624 ******** 2026-03-05 21:09:40.283954 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:09:40.284197 | mon1 | 2026-03-05 21:09:40.284482 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:09:40.284753 | mon1 | Thursday 05 March 2026 21:09:40 +0000 (0:00:00.060) 0:00:31.684 ******** 2026-03-05 21:09:40.739086 | mon1 | ok: [mon1] 2026-03-05 21:09:40.739351 | mon1 | 2026-03-05 21:09:40.739629 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:09:40.739920 | mon1 | Thursday 05 March 2026 21:09:40 +0000 (0:00:00.455) 0:00:32.139 ******** 2026-03-05 21:09:47.937855 | mon1 | ok: [mon1] 2026-03-05 21:09:47.937899 | mon1 | 2026-03-05 21:09:47.937906 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:09:47.937911 | mon1 | Thursday 05 March 2026 21:09:47 +0000 (0:00:07.198) 0:00:39.338 ******** 2026-03-05 21:09:54.681441 | mon1 | ok: [mon1] 2026-03-05 21:09:54.681846 | mon1 | 2026-03-05 21:09:54.682193 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:09:54.682551 | mon1 | Thursday 05 March 2026 21:09:54 +0000 (0:00:06.744) 0:00:46.082 ******** 2026-03-05 21:10:09.360829 | mon1 | ok: [mon1] 2026-03-05 21:10:09.361218 | mon1 | 2026-03-05 21:10:09.361732 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:10:09.362151 | mon1 | Thursday 05 March 2026 21:10:09 +0000 (0:00:14.678) 0:01:00.760 ******** 2026-03-05 21:10:09.432937 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:10:09.433012 | mon1 | 2026-03-05 21:10:09.433027 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:10:09.433039 | mon1 | Thursday 05 March 2026 21:10:09 +0000 (0:00:00.072) 0:01:00.833 ******** 2026-03-05 21:10:09.484417 | mon1 | skipping: [mon1] 2026-03-05 21:10:09.484452 | mon1 | 2026-03-05 21:10:09.484458 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:10:09.484467 | mon1 | Thursday 05 March 2026 21:10:09 +0000 (0:00:00.050) 0:01:00.883 ******** 2026-03-05 21:10:09.530264 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:10:09.530486 | mon1 | skipping: [mon1] 2026-03-05 21:10:09.530710 | mon1 | 2026-03-05 21:10:09.531002 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:10:09.531288 | mon1 | Thursday 05 March 2026 21:10:09 +0000 (0:00:00.047) 0:01:00.931 ******** 2026-03-05 21:10:09.861608 | mon1 | ok: [mon1] 2026-03-05 21:10:09.861777 | mon1 | 2026-03-05 21:10:09.862088 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:10:09.862440 | mon1 | Thursday 05 March 2026 21:10:09 +0000 (0:00:00.331) 0:01:01.262 ******** 2026-03-05 21:10:17.057238 | mon1 | ok: [mon1] 2026-03-05 21:10:17.057437 | mon1 | 2026-03-05 21:10:17.057708 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:10:17.058022 | mon1 | Thursday 05 March 2026 21:10:17 +0000 (0:00:07.195) 0:01:08.458 ******** 2026-03-05 21:10:23.722892 | mon1 | ok: [mon1] 2026-03-05 21:10:23.722959 | mon1 | 2026-03-05 21:10:23.722974 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:10:23.722986 | mon1 | Thursday 05 March 2026 21:10:23 +0000 (0:00:06.665) 0:01:15.123 ******** 2026-03-05 21:10:30.389995 | mon1 | ok: [mon1] 2026-03-05 21:10:30.390055 | mon1 | 2026-03-05 21:10:30.390064 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:10:30.390071 | mon1 | Thursday 05 March 2026 21:10:30 +0000 (0:00:06.666) 0:01:21.789 ******** 2026-03-05 21:10:39.015900 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:10:39.015960 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:10:39.017178 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:10:39.017232 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:10:39.017238 | mon1 | 2026-03-05 21:10:39.017244 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:10:39.017250 | mon1 | 2026-03-05 21:10:39.017259 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:10:39.017578 | mon1 | Thursday 05 March 2026 21:10:39 +0000 (0:00:08.626) 0:01:30.416 ******** 2026-03-05 21:10:40.227933 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:10:40.228001 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:10:40.228898 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:10:40.228925 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:10:40.228941 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:10:40.240554 | mon1 | ok: [osd1] 2026-03-05 21:10:40.240683 | mon1 | 2026-03-05 21:10:40.240885 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:10:40.241025 | mon1 | Thursday 05 March 2026 21:10:40 +0000 (0:00:01.225) 0:01:31.641 ******** 2026-03-05 21:10:40.497143 | mon1 | ok: [osd1] 2026-03-05 21:10:40.497302 | mon1 | 2026-03-05 21:10:40.497535 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:10:40.497748 | mon1 | Thursday 05 March 2026 21:10:40 +0000 (0:00:00.256) 0:01:31.898 ******** 2026-03-05 21:10:40.537383 | mon1 | skipping: [osd1] 2026-03-05 21:10:40.537630 | mon1 | 2026-03-05 21:10:40.537944 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:10:40.538219 | mon1 | Thursday 05 March 2026 21:10:40 +0000 (0:00:00.040) 0:01:31.938 ******** 2026-03-05 21:10:40.787249 | mon1 | ok: [osd1] 2026-03-05 21:10:40.787461 | mon1 | 2026-03-05 21:10:40.787750 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:10:40.788075 | mon1 | Thursday 05 March 2026 21:10:40 +0000 (0:00:00.249) 0:01:32.188 ******** 2026-03-05 21:10:40.861458 | mon1 | ok: [osd1] => { 2026-03-05 21:10:40.861669 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:10:40.861941 | mon1 | } 2026-03-05 21:10:40.862157 | mon1 | 2026-03-05 21:10:40.862444 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:10:40.862672 | mon1 | Thursday 05 March 2026 21:10:40 +0000 (0:00:00.074) 0:01:32.262 ******** 2026-03-05 21:10:41.241636 | mon1 | ok: [osd1] 2026-03-05 21:10:41.241897 | mon1 | 2026-03-05 21:10:41.242155 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:10:41.242404 | mon1 | Thursday 05 March 2026 21:10:41 +0000 (0:00:00.379) 0:01:32.642 ******** 2026-03-05 21:10:41.289203 | mon1 | skipping: [osd1] 2026-03-05 21:10:41.289452 | mon1 | 2026-03-05 21:10:41.289686 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:10:41.289935 | mon1 | Thursday 05 March 2026 21:10:41 +0000 (0:00:00.047) 0:01:32.690 ******** 2026-03-05 21:10:41.335954 | mon1 | skipping: [osd1] 2026-03-05 21:10:41.336257 | mon1 | 2026-03-05 21:10:41.336617 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:10:41.336977 | mon1 | Thursday 05 March 2026 21:10:41 +0000 (0:00:00.046) 0:01:32.737 ******** 2026-03-05 21:10:41.581719 | mon1 | ok: [osd1] 2026-03-05 21:10:41.581979 | mon1 | 2026-03-05 21:10:41.582286 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:10:41.582586 | mon1 | Thursday 05 March 2026 21:10:41 +0000 (0:00:00.245) 0:01:32.982 ******** 2026-03-05 21:10:42.624762 | mon1 | ok: [osd1] 2026-03-05 21:10:42.624879 | mon1 | 2026-03-05 21:10:42.624904 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:10:42.624917 | mon1 | Thursday 05 March 2026 21:10:42 +0000 (0:00:01.042) 0:01:34.024 ******** 2026-03-05 21:10:42.820912 | mon1 | ok: [osd1] => { 2026-03-05 21:10:42.820968 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:10:42.820978 | mon1 | } 2026-03-05 21:10:42.820987 | mon1 | 2026-03-05 21:10:42.820996 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:10:42.821177 | mon1 | Thursday 05 March 2026 21:10:42 +0000 (0:00:00.195) 0:01:34.220 ******** 2026-03-05 21:10:43.354930 | mon1 | ok: [osd1] 2026-03-05 21:10:43.355002 | mon1 | 2026-03-05 21:10:43.355076 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:10:43.355404 | mon1 | Thursday 05 March 2026 21:10:43 +0000 (0:00:00.535) 0:01:34.755 ******** 2026-03-05 21:10:45.628415 | mon1 | ok: [osd1] 2026-03-05 21:10:45.628481 | mon1 | 2026-03-05 21:10:45.628495 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:10:45.628514 | mon1 | Thursday 05 March 2026 21:10:45 +0000 (0:00:02.273) 0:01:37.028 ******** 2026-03-05 21:10:45.658736 | mon1 | skipping: [osd1] 2026-03-05 21:10:45.658777 | mon1 | 2026-03-05 21:10:45.659122 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:10:45.659168 | mon1 | Thursday 05 March 2026 21:10:45 +0000 (0:00:00.031) 0:01:37.060 ******** 2026-03-05 21:10:45.694179 | mon1 | skipping: [osd1] 2026-03-05 21:10:45.694281 | mon1 | 2026-03-05 21:10:45.694572 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:10:45.694593 | mon1 | Thursday 05 March 2026 21:10:45 +0000 (0:00:00.035) 0:01:37.095 ******** 2026-03-05 21:10:45.726293 | mon1 | skipping: [osd1] 2026-03-05 21:10:45.726343 | mon1 | 2026-03-05 21:10:45.726387 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:10:45.726509 | mon1 | Thursday 05 March 2026 21:10:45 +0000 (0:00:00.031) 0:01:37.127 ******** 2026-03-05 21:10:46.734974 | mon1 | ok: [osd1] 2026-03-05 21:10:46.735054 | mon1 | 2026-03-05 21:10:46.735607 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:10:46.735666 | mon1 | Thursday 05 March 2026 21:10:46 +0000 (0:00:01.007) 0:01:38.134 ******** 2026-03-05 21:10:47.272408 | mon1 | ok: [osd1] 2026-03-05 21:10:47.272465 | mon1 | 2026-03-05 21:10:47.272479 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:10:47.272491 | mon1 | Thursday 05 March 2026 21:10:47 +0000 (0:00:00.537) 0:01:38.672 ******** 2026-03-05 21:10:48.388954 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:10:48.389016 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:10:48.389879 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:10:48.389967 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:10:48.389978 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:10:48.390587 | mon1 | 2026-03-05 21:10:48.390611 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:10:48.390622 | mon1 | Thursday 05 March 2026 21:10:48 +0000 (0:00:01.116) 0:01:39.788 ******** 2026-03-05 21:10:49.022006 | mon1 | ok: [osd1] 2026-03-05 21:10:49.022095 | mon1 | 2026-03-05 21:10:49.022939 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:10:49.023019 | mon1 | Thursday 05 March 2026 21:10:49 +0000 (0:00:00.627) 0:01:40.416 ******** 2026-03-05 21:10:49.023030 | mon1 | 2026-03-05 21:10:49.023048 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:10:49.023269 | mon1 | Thursday 05 March 2026 21:10:49 +0000 (0:00:00.006) 0:01:40.422 ******** 2026-03-05 21:10:49.468893 | mon1 | ok: [osd1] 2026-03-05 21:10:49.468938 | mon1 | 2026-03-05 21:10:49.469348 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:10:49.469387 | mon1 | Thursday 05 March 2026 21:10:49 +0000 (0:00:00.446) 0:01:40.869 ******** 2026-03-05 21:10:49.728494 | mon1 | ok: [osd1] 2026-03-05 21:10:49.728553 | mon1 | 2026-03-05 21:10:49.728564 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:10:49.728573 | mon1 | Thursday 05 March 2026 21:10:49 +0000 (0:00:00.258) 0:01:41.128 ******** 2026-03-05 21:10:49.803933 | mon1 | ok: [osd1] => { 2026-03-05 21:10:49.803986 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:10:49.804934 | mon1 | } 2026-03-05 21:10:49.804983 | mon1 | 2026-03-05 21:10:49.804994 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:10:49.805003 | mon1 | Thursday 05 March 2026 21:10:49 +0000 (0:00:00.076) 0:01:41.204 ******** 2026-03-05 21:10:50.232910 | mon1 | ok: [osd1] 2026-03-05 21:10:50.232972 | mon1 | 2026-03-05 21:10:50.232983 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:10:50.232999 | mon1 | Thursday 05 March 2026 21:10:50 +0000 (0:00:00.428) 0:01:41.633 ******** 2026-03-05 21:10:54.549301 | mon1 | ok: [osd1] 2026-03-05 21:10:54.549488 | mon1 | 2026-03-05 21:10:54.549756 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:10:54.550054 | mon1 | Thursday 05 March 2026 21:10:54 +0000 (0:00:04.316) 0:01:45.950 ******** 2026-03-05 21:10:55.504382 | mon1 | ok: [osd1] 2026-03-05 21:10:55.504569 | mon1 | 2026-03-05 21:10:55.504909 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:10:55.505168 | mon1 | Thursday 05 March 2026 21:10:55 +0000 (0:00:00.955) 0:01:46.905 ******** 2026-03-05 21:10:55.753204 | mon1 | ok: [osd1] 2026-03-05 21:10:55.753420 | mon1 | 2026-03-05 21:10:55.753689 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:10:55.754001 | mon1 | Thursday 05 March 2026 21:10:55 +0000 (0:00:00.248) 0:01:47.154 ******** 2026-03-05 21:10:56.321036 | mon1 | ok: [osd1] 2026-03-05 21:10:56.321308 | mon1 | 2026-03-05 21:10:56.321573 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:10:56.322024 | mon1 | Thursday 05 March 2026 21:10:56 +0000 (0:00:00.567) 0:01:47.721 ******** 2026-03-05 21:10:57.020375 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:10:57.020596 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:10:57.020889 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:10:57.021122 | mon1 | 2026-03-05 21:10:57.021380 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:10:57.021671 | mon1 | Thursday 05 March 2026 21:10:57 +0000 (0:00:00.699) 0:01:48.421 ******** 2026-03-05 21:10:57.561964 | mon1 | ok: [osd1] 2026-03-05 21:10:57.562051 | mon1 | 2026-03-05 21:10:57.562063 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:10:57.562072 | mon1 | Thursday 05 March 2026 21:10:57 +0000 (0:00:00.540) 0:01:48.961 ******** 2026-03-05 21:10:58.120397 | mon1 | ok: [osd1] 2026-03-05 21:10:58.120456 | mon1 | 2026-03-05 21:10:58.120466 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:10:58.120476 | mon1 | Thursday 05 March 2026 21:10:58 +0000 (0:00:00.549) 0:01:49.511 ******** 2026-03-05 21:10:58.120484 | mon1 | 2026-03-05 21:10:58.120493 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:10:58.120502 | mon1 | Thursday 05 March 2026 21:10:58 +0000 (0:00:00.007) 0:01:49.518 ******** 2026-03-05 21:10:58.562969 | mon1 | ok: [osd1] 2026-03-05 21:10:58.563028 | mon1 | 2026-03-05 21:10:58.563042 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:10:58.563239 | mon1 | Thursday 05 March 2026 21:10:58 +0000 (0:00:00.445) 0:01:49.964 ******** 2026-03-05 21:10:58.618138 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-05 21:10:58.618361 | mon1 | 2026-03-05 21:10:58.618642 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:10:58.618924 | mon1 | Thursday 05 March 2026 21:10:58 +0000 (0:00:00.054) 0:01:50.019 ******** 2026-03-05 21:10:59.579947 | mon1 | ok: [osd1] 2026-03-05 21:10:59.580006 | mon1 | 2026-03-05 21:10:59.580265 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:10:59.580320 | mon1 | Thursday 05 March 2026 21:10:59 +0000 (0:00:00.961) 0:01:50.980 ******** 2026-03-05 21:11:00.376950 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-05 21:11:00.377017 | mon1 | ok: [osd1] => (item=ssh) 2026-03-05 21:11:00.377032 | mon1 | 2026-03-05 21:11:00.377044 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:11:00.377125 | mon1 | Thursday 05 March 2026 21:11:00 +0000 (0:00:00.796) 0:01:51.777 ******** 2026-03-05 21:11:00.772253 | mon1 | ok: [osd1] 2026-03-05 21:11:00.772315 | mon1 | 2026-03-05 21:11:00.775820 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:11:00.775847 | mon1 | Thursday 05 March 2026 21:11:00 +0000 (0:00:00.395) 0:01:52.172 ******** 2026-03-05 21:11:01.014892 | mon1 | ok: [osd1] 2026-03-05 21:11:01.015116 | mon1 | 2026-03-05 21:11:01.015391 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:11:01.015684 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.243) 0:01:52.415 ******** 2026-03-05 21:11:01.318975 | mon1 | ok: [osd1] 2026-03-05 21:11:01.319212 | mon1 | 2026-03-05 21:11:01.319528 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:11:01.319904 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.303) 0:01:52.719 ******** 2026-03-05 21:11:01.561102 | mon1 | ok: [osd1] 2026-03-05 21:11:01.561308 | mon1 | 2026-03-05 21:11:01.561552 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:11:01.561816 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.242) 0:01:52.962 ******** 2026-03-05 21:11:01.845917 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:11:01.845982 | mon1 | 2026-03-05 21:11:01.846000 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:11:01.846024 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.283) 0:01:53.246 ******** 2026-03-05 21:11:01.895318 | mon1 | ok: [osd1] 2026-03-05 21:11:01.895778 | mon1 | 2026-03-05 21:11:01.895824 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:11:01.895833 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.049) 0:01:53.295 ******** 2026-03-05 21:11:01.949256 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:11:01.949312 | mon1 | 2026-03-05 21:11:01.949568 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:11:01.949592 | mon1 | Thursday 05 March 2026 21:11:01 +0000 (0:00:00.053) 0:01:53.349 ******** 2026-03-05 21:11:08.576607 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:11:08.576671 | mon1 | 2026-03-05 21:11:08.576686 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:11:08.576699 | mon1 | Thursday 05 March 2026 21:11:08 +0000 (0:00:06.625) 0:01:59.975 ******** 2026-03-05 21:11:08.631675 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:11:08.631735 | mon1 | 2026-03-05 21:11:08.631749 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:11:08.631763 | mon1 | Thursday 05 March 2026 21:11:08 +0000 (0:00:00.055) 0:02:00.031 ******** 2026-03-05 21:11:08.956393 | mon1 | ok: [osd1] 2026-03-05 21:11:08.956481 | mon1 | 2026-03-05 21:11:08.956495 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:11:08.956507 | mon1 | Thursday 05 March 2026 21:11:08 +0000 (0:00:00.325) 0:02:00.356 ******** 2026-03-05 21:11:16.159423 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:11:16.159500 | mon1 | 2026-03-05 21:11:16.159598 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:11:16.159712 | mon1 | Thursday 05 March 2026 21:11:16 +0000 (0:00:07.200) 0:02:07.557 ******** 2026-03-05 21:11:21.769116 | mon1 | ok: [osd1] 2026-03-05 21:11:21.769208 | mon1 | 2026-03-05 21:11:21.769490 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:11:21.769554 | mon1 | Thursday 05 March 2026 21:11:21 +0000 (0:00:05.612) 0:02:13.169 ******** 2026-03-05 21:11:44.979246 | mon1 | ok: [osd1] 2026-03-05 21:11:44.979350 | mon1 | 2026-03-05 21:11:44.979365 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:11:44.979498 | mon1 | Thursday 05 March 2026 21:11:44 +0000 (0:00:23.209) 0:02:36.379 ******** 2026-03-05 21:11:45.050223 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:11:45.050261 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:11:45.050267 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:11:45.050272 | mon1 | skipping: [osd1] 2026-03-05 21:11:45.050278 | mon1 | 2026-03-05 21:11:45.050654 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:11:45.050711 | mon1 | Thursday 05 March 2026 21:11:45 +0000 (0:00:00.069) 0:02:36.449 ******** 2026-03-05 21:11:51.765466 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:11:51.765542 | mon1 | 2026-03-05 21:11:51.765557 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:11:51.765571 | mon1 | Thursday 05 March 2026 21:11:51 +0000 (0:00:06.715) 0:02:43.164 ******** 2026-03-05 21:11:58.377190 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:11:58.377246 | mon1 | 2026-03-05 21:11:58.377256 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:11:58.377264 | mon1 | Thursday 05 March 2026 21:11:58 +0000 (0:00:06.612) 0:02:49.776 ******** 2026-03-05 21:11:58.436291 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:11:58.436374 | mon1 | 2026-03-05 21:11:58.436652 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:11:58.436698 | mon1 | Thursday 05 March 2026 21:11:58 +0000 (0:00:00.059) 0:02:49.836 ******** 2026-03-05 21:11:58.488444 | mon1 | ok: [osd1] 2026-03-05 21:11:58.488514 | mon1 | 2026-03-05 21:11:58.488531 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:11:58.488546 | mon1 | Thursday 05 March 2026 21:11:58 +0000 (0:00:00.051) 0:02:49.888 ******** 2026-03-05 21:12:05.110480 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:12:05.110551 | mon1 | 2026-03-05 21:12:05.110566 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:12:05.110578 | mon1 | Thursday 05 March 2026 21:12:05 +0000 (0:00:06.621) 0:02:56.509 ******** 2026-03-05 21:12:05.156967 | mon1 | ok: [osd1] 2026-03-05 21:12:05.157025 | mon1 | 2026-03-05 21:12:05.157036 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:12:05.157173 | mon1 | Thursday 05 March 2026 21:12:05 +0000 (0:00:00.046) 0:02:56.556 ******** 2026-03-05 21:12:05.198976 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:12:05.199036 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:12:05.199936 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:12:05.199990 | mon1 | skipping: [osd1] 2026-03-05 21:12:05.200000 | mon1 | 2026-03-05 21:12:05.200010 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:12:05.200229 | mon1 | Thursday 05 March 2026 21:12:05 +0000 (0:00:00.042) 0:02:56.598 ******** 2026-03-05 21:12:05.240988 | mon1 | skipping: [osd1] 2026-03-05 21:12:05.241055 | mon1 | 2026-03-05 21:12:05.241064 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:12:05.241073 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:12:05.241080 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:12:05.241093 | mon1 | 2026-03-05 21:12:05.241906 | mon1 | 2026-03-05 21:12:05.241979 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:12:05.241990 | mon1 | Thursday 05 March 2026 21:12:05 +0000 (0:00:00.041) 0:02:56.640 ******** 2026-03-05 21:12:05.242005 | mon1 | =============================================================================== 2026-03-05 21:12:05.244850 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.21s 2026-03-05 21:12:05.244910 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.68s 2026-03-05 21:12:05.244920 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.63s 2026-03-05 21:12:05.244929 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.20s 2026-03-05 21:12:05.244938 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.20s 2026-03-05 21:12:05.244946 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.20s 2026-03-05 21:12:05.244954 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.79s 2026-03-05 21:12:05.244963 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.74s 2026-03-05 21:12:05.244971 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.72s 2026-03-05 21:12:05.244979 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.67s 2026-03-05 21:12:05.244988 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.67s 2026-03-05 21:12:05.245126 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.63s 2026-03-05 21:12:05.245425 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.62s 2026-03-05 21:12:05.245725 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.61s 2026-03-05 21:12:05.246059 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.61s 2026-03-05 21:12:05.246366 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.32s 2026-03-05 21:12:05.246694 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.52s 2026-03-05 21:12:05.247030 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.25s 2026-03-05 21:12:05.247337 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.27s 2026-03-05 21:12:05.247637 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.27s 2026-03-05 21:12:05.344226 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:12:05.357226 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:12:05.357730 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:12:05.364655 | mon1 | INFO [default > verify] Executing 2026-03-05 21:12:06.081038 | mon1 | 2026-03-05 21:12:06.081544 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:12:06.081940 | mon1 | 2026-03-05 21:12:06.082335 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:12:06.082730 | mon1 | Thursday 05 March 2026 21:12:06 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-03-05 21:12:08.279526 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:12:08.279846 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-05 21:12:08.280177 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:12:08.280485 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:12:08.280817 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:12:08.288191 | mon1 | ok: [mon1] 2026-03-05 21:12:08.288492 | mon1 | 2026-03-05 21:12:08.288932 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:12:08.289264 | mon1 | Thursday 05 March 2026 21:12:08 +0000 (0:00:02.207) 0:00:02.215 ******** 2026-03-05 21:12:19.025467 | mon1 | ok: [mon1] 2026-03-05 21:12:19.025890 | mon1 | 2026-03-05 21:12:19.026229 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:12:19.026557 | mon1 | Thursday 05 March 2026 21:12:19 +0000 (0:00:10.736) 0:00:12.951 ******** 2026-03-05 21:12:19.071376 | mon1 | ok: [mon1] => { 2026-03-05 21:12:19.071958 | mon1 | "_ceph_health": { 2026-03-05 21:12:19.072333 | mon1 | "changed": false, 2026-03-05 21:12:19.072642 | mon1 | "cmd": [ 2026-03-05 21:12:19.073186 | mon1 | "cephadm", 2026-03-05 21:12:19.073547 | mon1 | "shell", 2026-03-05 21:12:19.073961 | mon1 | "--", 2026-03-05 21:12:19.074392 | mon1 | "ceph", 2026-03-05 21:12:19.074748 | mon1 | "health" 2026-03-05 21:12:19.075159 | mon1 | ], 2026-03-05 21:12:19.075553 | mon1 | "delta": "0:00:10.397700", 2026-03-05 21:12:19.076150 | mon1 | "end": "2026-03-05 21:12:18.978479", 2026-03-05 21:12:19.076378 | mon1 | "failed": false, 2026-03-05 21:12:19.076942 | mon1 | "msg": "", 2026-03-05 21:12:19.076974 | mon1 | "rc": 0, 2026-03-05 21:12:19.076984 | mon1 | "start": "2026-03-05 21:12:08.580779", 2026-03-05 21:12:19.077265 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:12:19.077414 | mon1 | "stderr_lines": [ 2026-03-05 21:12:19.077568 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:12:19.077740 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:12:19.077921 | mon1 | ], 2026-03-05 21:12:19.078076 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:12:19.078318 | mon1 | "stdout_lines": [ 2026-03-05 21:12:19.078472 | mon1 | "HEALTH_OK" 2026-03-05 21:12:19.078615 | mon1 | ] 2026-03-05 21:12:19.078761 | mon1 | } 2026-03-05 21:12:19.078929 | mon1 | } 2026-03-05 21:12:19.079098 | mon1 | 2026-03-05 21:12:19.079259 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:12:19.079502 | mon1 | Thursday 05 March 2026 21:12:19 +0000 (0:00:00.045) 0:00:12.997 ******** 2026-03-05 21:12:19.107817 | mon1 | ok: [mon1] => { 2026-03-05 21:12:19.107834 | mon1 | "changed": false, 2026-03-05 21:12:19.107839 | mon1 | "msg": "All assertions passed" 2026-03-05 21:12:19.108021 | mon1 | } 2026-03-05 21:12:19.108357 | mon1 | 2026-03-05 21:12:19.108724 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:12:19.109140 | mon1 | Thursday 05 March 2026 21:12:19 +0000 (0:00:00.036) 0:00:13.034 ******** 2026-03-05 21:12:26.902671 | mon1 | changed: [mon1] 2026-03-05 21:12:26.902906 | mon1 | 2026-03-05 21:12:26.903173 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:12:26.903412 | mon1 | Thursday 05 March 2026 21:12:26 +0000 (0:00:07.794) 0:00:20.829 ******** 2026-03-05 21:12:29.813205 | mon1 | changed: [mon1] 2026-03-05 21:12:29.813590 | mon1 | 2026-03-05 21:12:29.813614 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:12:29.813862 | mon1 | Thursday 05 March 2026 21:12:29 +0000 (0:00:02.910) 0:00:23.739 ******** 2026-03-05 21:12:31.275605 | mon1 | ok: [mon1] 2026-03-05 21:12:31.275824 | mon1 | 2026-03-05 21:12:31.276119 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:12:31.276372 | mon1 | Thursday 05 March 2026 21:12:31 +0000 (0:00:01.462) 0:00:25.202 ******** 2026-03-05 21:12:31.314525 | mon1 | ok: [mon1] => { 2026-03-05 21:12:31.314783 | mon1 | "changed": false, 2026-03-05 21:12:31.315141 | mon1 | "msg": "All assertions passed" 2026-03-05 21:12:31.315431 | mon1 | } 2026-03-05 21:12:31.315751 | mon1 | 2026-03-05 21:12:31.316038 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:12:31.316306 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:12:31.316579 | mon1 | 2026-03-05 21:12:31.316826 | mon1 | 2026-03-05 21:12:31.317129 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:12:31.317401 | mon1 | Thursday 05 March 2026 21:12:31 +0000 (0:00:00.039) 0:00:25.241 ******** 2026-03-05 21:12:31.317715 | mon1 | =============================================================================== 2026-03-05 21:12:31.318063 | mon1 | Get cluster health status ---------------------------------------------- 10.74s 2026-03-05 21:12:31.318339 | mon1 | Create a test Ceph pool ------------------------------------------------- 7.80s 2026-03-05 21:12:31.318600 | mon1 | Create a test Ceph key -------------------------------------------------- 2.91s 2026-03-05 21:12:31.319005 | mon1 | Gathering Facts --------------------------------------------------------- 2.21s 2026-03-05 21:12:31.319327 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.46s 2026-03-05 21:12:31.319621 | mon1 | Print cluster health status --------------------------------------------- 0.05s 2026-03-05 21:12:31.319963 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-05 21:12:31.320249 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-03-05 21:12:31.390747 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:12:31.401418 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:12:31.401749 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:12:31.407699 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:12:31.407737 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:12:31.407844 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:12:31.408203 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:12:31.678091 | mon1 | ok: Runtime: 0:13:39.920347 2026-03-05 21:12:31.689541 | 2026-03-05 21:12:31.689603 | PLAY RECAP 2026-03-05 21:12:31.689649 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:12:31.689670 | 2026-03-05 21:12:31.791693 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:12:31.795139 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:12:32.338814 | 2026-03-05 21:12:32.338930 | PLAY [all] 2026-03-05 21:12:32.350713 | 2026-03-05 21:12:32.350786 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:12:32.402053 | mon1 | ok 2026-03-05 21:12:32.408260 | osd1 | ok 2026-03-05 21:12:32.413503 | 2026-03-05 21:12:32.413571 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:12:32.436134 | mon1 | skipping: Conditional result was False 2026-03-05 21:12:32.457708 | osd1 | skipping: Conditional result was False 2026-03-05 21:12:32.467009 | 2026-03-05 21:12:32.467074 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:12:32.813260 | mon1 -> localhost | changed: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/logs/mon1" 2026-03-05 21:12:32.816211 | osd1 -> localhost | changed: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/logs/osd1" 2026-03-05 21:12:33.011033 | mon1 -> localhost | changed: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/artifacts" 2026-03-05 21:12:33.041877 | osd1 -> localhost | ok: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/artifacts" 2026-03-05 21:12:33.202657 | mon1 -> localhost | changed: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/docs" 2026-03-05 21:12:33.236111 | osd1 -> localhost | ok: "/var/lib/zuul/builds/33b44d887d564690960bb25b7845ea8e/work/docs" 2026-03-05 21:12:33.236226 | osd1 -> localhost | changed: All items complete 2026-03-05 21:12:33.236286 | 2026-03-05 21:12:33.258595 | 2026-03-05 21:12:33.258732 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:12:33.859174 | osd1 | changed: .d..t...... ./ 2026-03-05 21:12:33.887493 | mon1 | changed: .d..t...... ./ 2026-03-05 21:12:34.321189 | osd1 | changed: .d..t...... ./ 2026-03-05 21:12:34.355871 | mon1 | ok 2026-03-05 21:12:34.775321 | osd1 | changed: .d..t...... ./ 2026-03-05 21:12:34.810399 | mon1 | ok 2026-03-05 21:12:34.810463 | mon1 | changed: All items complete 2026-03-05 21:12:34.810488 | 2026-03-05 21:12:34.841737 | 2026-03-05 21:12:34.841890 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:12:35.215231 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.005902 2026-03-05 21:12:35.427747 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006596 2026-03-05 21:12:35.446225 | 2026-03-05 21:12:35.446354 | PLAY [all] 2026-03-05 21:12:35.452816 | 2026-03-05 21:12:35.452884 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:12:35.923180 | mon1 | changed 2026-03-05 21:12:36.126686 | osd1 | changed 2026-03-05 21:12:36.137790 | 2026-03-05 21:12:36.137839 | PLAY RECAP 2026-03-05 21:12:36.137891 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:12:36.137921 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:12:36.137957 | 2026-03-05 21:12:36.250468 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:12:36.253740 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:12:36.838933 | 2026-03-05 21:12:36.839062 | PLAY [localhost] 2026-03-05 21:12:36.849121 | 2026-03-05 21:12:36.849193 | TASK [Generate Zuul manifest] 2026-03-05 21:12:36.870483 | localhost | ok 2026-03-05 21:12:36.885253 | 2026-03-05 21:12:36.885331 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:12:37.180469 | localhost | changed 2026-03-05 21:12:37.192122 | 2026-03-05 21:12:37.192213 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:12:37.221599 | localhost | ok 2026-03-05 21:12:37.229541 | 2026-03-05 21:12:37.229607 | TASK [Upload logs] 2026-03-05 21:12:37.252163 | localhost | ok 2026-03-05 21:12:37.310481 | 2026-03-05 21:12:37.310622 | TASK [Set zuul-log-path fact] 2026-03-05 21:12:37.329458 | localhost | ok 2026-03-05 21:12:37.340035 | 2026-03-05 21:12:37.340107 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:12:37.369216 | localhost | ok 2026-03-05 21:12:37.377875 | 2026-03-05 21:12:37.377937 | TASK [upload-logs : Create log directories] 2026-03-05 21:12:37.755644 | localhost | changed 2026-03-05 21:12:37.761905 | 2026-03-05 21:12:37.762001 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:12:38.136421 | localhost -> localhost | ok: Runtime: 0:00:00.005414 2026-03-05 21:12:38.142999 | 2026-03-05 21:12:38.143089 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:12:38.581552 | localhost | Output suppressed because no_log was given 2026-03-05 21:12:38.585092 | 2026-03-05 21:12:38.585158 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:12:38.626076 | localhost | skipping: Conditional result was False 2026-03-05 21:12:38.632664 | localhost | skipping: Conditional result was False 2026-03-05 21:12:38.647425 | 2026-03-05 21:12:38.647574 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:12:38.689863 | localhost | skipping: Conditional result was False 2026-03-05 21:12:38.690264 | 2026-03-05 21:12:38.693719 | localhost | skipping: Conditional result was False 2026-03-05 21:12:38.709262 | 2026-03-05 21:12:38.709398 | LOOP [upload-logs : Upload console log and json output]