2026-03-05 20:58:03.068092 | Job console starting 2026-03-05 20:58:03.082706 | Updating git repos 2026-03-05 20:58:03.111507 | Cloning repos into workspace 2026-03-05 20:58:03.169679 | Restoring repo states 2026-03-05 20:58:03.179056 | Merging changes 2026-03-05 20:58:03.463131 | Checking out repos 2026-03-05 20:58:03.501534 | Preparing playbooks 2026-03-05 20:58:04.521053 | Running Ansible setup 2026-03-05 20:58:08.740948 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:58:09.391181 | 2026-03-05 20:58:09.391373 | PLAY [localhost] 2026-03-05 20:58:09.401943 | 2026-03-05 20:58:09.402032 | TASK [Gathering Facts] 2026-03-05 20:58:10.305808 | localhost | ok 2026-03-05 20:58:10.315630 | 2026-03-05 20:58:10.315707 | TASK [Setup log path fact] 2026-03-05 20:58:10.340287 | localhost | ok 2026-03-05 20:58:10.353739 | 2026-03-05 20:58:10.353865 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 20:58:10.386073 | localhost | ok 2026-03-05 20:58:10.395028 | 2026-03-05 20:58:10.395103 | TASK [emit-job-header : Print job information] 2026-03-05 20:58:10.436033 | # Job Information 2026-03-05 20:58:10.436267 | Ansible Version: 2.16.16 2026-03-05 20:58:10.436339 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-05 20:58:10.436390 | Pipeline: check 2026-03-05 20:58:10.436437 | Executor: 0a8996d2b663 2026-03-05 20:58:10.436482 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-03-05 20:58:10.436628 | Event ID: d6e15bb0-18d5-11f1-98b1-d42532538547 2026-03-05 20:58:10.439887 | 2026-03-05 20:58:10.440004 | LOOP [emit-job-header : Print node information] 2026-03-05 20:58:10.538453 | localhost | ok: 2026-03-05 20:58:10.538816 | localhost | # Node Information 2026-03-05 20:58:10.538872 | localhost | Inventory Hostname: mon1 2026-03-05 20:58:10.538912 | localhost | Hostname: np0000157942 2026-03-05 20:58:10.538946 | localhost | Username: zuul 2026-03-05 20:58:10.538995 | localhost | Distro: Ubuntu 22.04 2026-03-05 20:58:10.539028 | localhost | Provider: yul1 2026-03-05 20:58:10.539062 | localhost | Region: ca-ymq-1 2026-03-05 20:58:10.539095 | localhost | Label: ubuntu-jammy 2026-03-05 20:58:10.539129 | localhost | Product Name: OpenStack Nova 2026-03-05 20:58:10.539162 | localhost | Interface IP: 162.253.55.204 2026-03-05 20:58:10.579067 | localhost | ok: 2026-03-05 20:58:10.579159 | localhost | # Node Information 2026-03-05 20:58:10.579198 | localhost | Inventory Hostname: osd1 2026-03-05 20:58:10.579228 | localhost | Hostname: np0000157943 2026-03-05 20:58:10.579257 | localhost | Username: zuul 2026-03-05 20:58:10.579285 | localhost | Distro: Ubuntu 22.04 2026-03-05 20:58:10.579312 | localhost | Provider: yul1 2026-03-05 20:58:10.579339 | localhost | Region: ca-ymq-1 2026-03-05 20:58:10.579366 | localhost | Label: ubuntu-jammy 2026-03-05 20:58:10.579391 | localhost | Product Name: OpenStack Nova 2026-03-05 20:58:10.579418 | localhost | Interface IP: 162.253.55.207 2026-03-05 20:58:10.593608 | 2026-03-05 20:58:10.593821 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-05 20:58:10.963146 | localhost -> localhost | changed 2026-03-05 20:58:10.972583 | 2026-03-05 20:58:10.972680 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-05 20:58:11.801839 | localhost -> localhost | changed 2026-03-05 20:58:11.809636 | 2026-03-05 20:58:11.809709 | PLAY [all] 2026-03-05 20:58:11.830346 | 2026-03-05 20:58:11.830423 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-05 20:58:12.085244 | mon1 -> localhost | ok 2026-03-05 20:58:12.094497 | 2026-03-05 20:58:12.094562 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-05 20:58:12.126714 | mon1 | ok 2026-03-05 20:58:12.132379 | osd1 | ok 2026-03-05 20:58:12.149878 | mon1 | included: /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 20:58:12.149930 | osd1 | included: /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-05 20:58:12.155993 | 2026-03-05 20:58:12.156054 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-05 20:58:13.506590 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-05 20:58:13.506787 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/b0d23fa0bf2942d780020d232882c87c_id_rsa 2026-03-05 20:58:13.506832 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/b0d23fa0bf2942d780020d232882c87c_id_rsa.pub 2026-03-05 20:58:13.506867 | mon1 -> localhost | The key fingerprint is: 2026-03-05 20:58:13.506900 | mon1 -> localhost | SHA256:dJMVzMmMI7iKWryGG4S1Q7j2/063yjnOmoqtXQtDHXk zuul-build-sshkey 2026-03-05 20:58:13.506932 | mon1 -> localhost | The key's randomart image is: 2026-03-05 20:58:13.506962 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-05 20:58:13.506992 | mon1 -> localhost | | . *oo | 2026-03-05 20:58:13.507023 | mon1 -> localhost | | . o . oo* | 2026-03-05 20:58:13.507053 | mon1 -> localhost | |. o o E..+. | 2026-03-05 20:58:13.507084 | mon1 -> localhost | |.+ .. +. . . | 2026-03-05 20:58:13.507114 | mon1 -> localhost | |o+oo o S | 2026-03-05 20:58:13.507143 | mon1 -> localhost | |o *.. | 2026-03-05 20:58:13.507173 | mon1 -> localhost | |.+ = . . . | 2026-03-05 20:58:13.507202 | mon1 -> localhost | |o.* = *.o . | 2026-03-05 20:58:13.507231 | mon1 -> localhost | |.=.+.==Oo. | 2026-03-05 20:58:13.507260 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-05 20:58:13.507326 | mon1 -> localhost | ok: Runtime: 0:00:00.933265 2026-03-05 20:58:13.513171 | 2026-03-05 20:58:13.513240 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-05 20:58:13.547527 | mon1 | ok 2026-03-05 20:58:13.552151 | osd1 | ok 2026-03-05 20:58:13.567513 | mon1 | included: /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 20:58:13.567657 | osd1 | included: /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-05 20:58:13.580980 | 2026-03-05 20:58:13.581140 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-05 20:58:13.609747 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:13.621301 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:13.632158 | 2026-03-05 20:58:13.632302 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-05 20:58:14.091133 | mon1 | changed 2026-03-05 20:58:14.097534 | osd1 | changed 2026-03-05 20:58:14.102394 | 2026-03-05 20:58:14.102459 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-05 20:58:14.289792 | mon1 | ok 2026-03-05 20:58:14.311673 | osd1 | ok 2026-03-05 20:58:14.316899 | 2026-03-05 20:58:14.316982 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-05 20:58:14.779114 | mon1 | changed 2026-03-05 20:58:14.799404 | osd1 | changed 2026-03-05 20:58:14.812985 | 2026-03-05 20:58:14.813229 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-05 20:58:15.286323 | mon1 | changed 2026-03-05 20:58:15.292028 | osd1 | changed 2026-03-05 20:58:15.297192 | 2026-03-05 20:58:15.297286 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-05 20:58:15.320737 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:15.335473 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:15.386652 | 2026-03-05 20:58:15.386793 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-05 20:58:15.736298 | mon1 -> localhost | changed 2026-03-05 20:58:15.757308 | 2026-03-05 20:58:15.757380 | TASK [add-build-sshkey : Add back temp key] 2026-03-05 20:58:16.063808 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/b0d23fa0bf2942d780020d232882c87c_id_rsa (zuul-build-sshkey) 2026-03-05 20:58:16.065222 | mon1 -> localhost | ok: Runtime: 0:00:00.016139 2026-03-05 20:58:16.076051 | 2026-03-05 20:58:16.076113 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-05 20:58:16.355387 | mon1 | ok 2026-03-05 20:58:16.383981 | osd1 | ok 2026-03-05 20:58:16.390766 | 2026-03-05 20:58:16.390829 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-05 20:58:16.415472 | mon1 | skipping: Conditional result was False 2026-03-05 20:58:16.426735 | osd1 | skipping: Conditional result was False 2026-03-05 20:58:16.447155 | 2026-03-05 20:58:16.447220 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-05 20:58:16.734439 | mon1 | ok 2026-03-05 20:58:16.739918 | osd1 | ok 2026-03-05 20:58:16.746590 | 2026-03-05 20:58:16.746655 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-05 20:58:17.454789 | mon1 | Output suppressed because no_log was given 2026-03-05 20:58:17.473684 | osd1 | Output suppressed because no_log was given 2026-03-05 20:58:17.486699 | 2026-03-05 20:58:17.486794 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-05 20:58:17.669738 | mon1 | ok: "logs" 2026-03-05 20:58:17.671555 | mon1 | ok: All items complete 2026-03-05 20:58:17.671598 | 2026-03-05 20:58:17.684684 | osd1 | ok: "logs" 2026-03-05 20:58:17.843291 | osd1 | ok: "artifacts" 2026-03-05 20:58:17.855645 | mon1 | ok: "artifacts" 2026-03-05 20:58:18.006174 | osd1 | ok: "docs" 2026-03-05 20:58:18.012482 | mon1 | ok: "docs" 2026-03-05 20:58:18.023437 | 2026-03-05 20:58:18.023591 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-05 20:58:18.208841 | mon1 | changed: "logs" 2026-03-05 20:58:18.209169 | mon1 | ok: All items complete 2026-03-05 20:58:18.209217 | 2026-03-05 20:58:18.215190 | osd1 | changed: "logs" 2026-03-05 20:58:18.375077 | osd1 | changed: "artifacts" 2026-03-05 20:58:18.380756 | mon1 | changed: "artifacts" 2026-03-05 20:58:18.528275 | mon1 | changed: "docs" 2026-03-05 20:58:18.539086 | osd1 | changed: "docs" 2026-03-05 20:58:18.561656 | 2026-03-05 20:58:18.561766 | PLAY RECAP 2026-03-05 20:58:18.561813 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:18.561843 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 20:58:18.561870 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-05 20:58:18.561888 | 2026-03-05 20:58:18.690236 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-05 20:58:18.694144 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:19.308562 | 2026-03-05 20:58:19.308784 | PLAY [all] 2026-03-05 20:58:19.322683 | 2026-03-05 20:58:19.322783 | TASK [setup-uv : Extract archive] 2026-03-05 20:58:21.593437 | mon1 | changed 2026-03-05 20:58:21.654927 | osd1 | changed 2026-03-05 20:58:21.662552 | 2026-03-05 20:58:21.662635 | TASK [setup-uv : Print version] 2026-03-05 20:58:21.843728 | mon1 | uv 0.8.13 2026-03-05 20:58:21.736554 | osd1 | uv 0.8.13 2026-03-05 20:58:22.225801 | osd1 | ok: Runtime: 0:00:00.012602 2026-03-05 20:58:22.238500 | mon1 | ok: Runtime: 0:00:00.013791 2026-03-05 20:58:22.247645 | 2026-03-05 20:58:22.247699 | PLAY RECAP 2026-03-05 20:58:22.247739 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:22.247766 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 20:58:22.247785 | 2026-03-05 20:58:22.357365 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-05 20:58:22.362659 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 20:58:22.957273 | 2026-03-05 20:58:22.957439 | PLAY [all] 2026-03-05 20:58:22.969577 | 2026-03-05 20:58:22.969668 | TASK [Copy inventory file for Zuul] 2026-03-05 20:58:23.835851 | mon1 | changed 2026-03-05 20:58:23.842385 | 2026-03-05 20:58:23.842464 | TASK [Switch "ansible_host" to private IP] 2026-03-05 20:58:24.138902 | mon1 | changed: 2 replacements made 2026-03-05 20:58:24.147689 | 2026-03-05 20:58:24.147925 | TASK [Run Molecule scenario] 2026-03-05 20:58:24.568155 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-05 20:58:25.335033 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-05 20:58:25.560517 | mon1 | Using CPython 3.13.7 2026-03-05 20:58:25.560571 | mon1 | Creating virtual environment at: .venv 2026-03-05 20:58:25.790490 | mon1 | Downloading netaddr (2.2MiB) 2026-03-05 20:58:25.792988 | mon1 | Downloading pygments (1.2MiB) 2026-03-05 20:58:25.796802 | mon1 | Downloading cryptography (4.3MiB) 2026-03-05 20:58:25.821242 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-05 20:58:25.978100 | mon1 | Downloading netaddr 2026-03-05 20:58:25.989719 | mon1 | Downloading cryptography 2026-03-05 20:58:26.033011 | mon1 | Downloading pygments 2026-03-05 20:58:26.158300 | mon1 | Downloading ansible-core 2026-03-05 20:58:26.185864 | mon1 | Installed 36 packages in 27ms 2026-03-05 20:58:27.298787 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-05 20:58:27.298918 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-05 20:58:27.933770 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-05 20:58:27.933871 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-05 20:58:40.533065 | mon1 | INFO [default > dependency] Executing 2026-03-05 20:58:40.533204 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-05 20:58:40.533398 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-05 20:58:40.533511 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-05 20:58:40.538454 | mon1 | INFO [default > cleanup] Executing 2026-03-05 20:58:40.538733 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:58:40.543642 | mon1 | INFO [default > destroy] Executing 2026-03-05 20:58:40.543699 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 20:58:40.543775 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 20:58:40.548649 | mon1 | INFO [default > syntax] Executing 2026-03-05 20:58:41.481625 | mon1 | 2026-03-05 20:58:41.481886 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-05 20:58:41.541006 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-05 20:58:41.550900 | mon1 | INFO [default > create] Executing 2026-03-05 20:58:41.552426 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 20:58:41.557984 | mon1 | INFO [default > prepare] Executing 2026-03-05 20:58:42.218664 | mon1 | 2026-03-05 20:58:42.218832 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-05 20:58:42.219027 | mon1 | 2026-03-05 20:58:42.219242 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:58:42.219461 | mon1 | Thursday 05 March 2026 20:58:42 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-03-05 20:58:43.333266 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 20:58:43.333421 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 20:58:43.333687 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 20:58:43.333902 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 20:58:43.334138 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:58:43.421646 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 20:58:43.422042 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 20:58:43.422261 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 20:58:43.422407 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 20:58:43.422606 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:58:43.431630 | mon1 | ok: [mon1] 2026-03-05 20:58:43.431808 | mon1 | ok: [osd1] 2026-03-05 20:58:43.431986 | mon1 | 2026-03-05 20:58:43.432186 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-05 20:58:43.432400 | mon1 | Thursday 05 March 2026 20:58:43 +0000 (0:00:01.213) 0:00:01.243 ******** 2026-03-05 20:58:44.126512 | mon1 | changed: [mon1] 2026-03-05 20:58:44.126680 | mon1 | changed: [osd1] 2026-03-05 20:58:44.126870 | mon1 | 2026-03-05 20:58:44.127082 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-05 20:58:44.127299 | mon1 | Thursday 05 March 2026 20:58:44 +0000 (0:00:00.694) 0:00:01.938 ******** 2026-03-05 20:58:44.393161 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-05 20:58:44.393319 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-05 20:58:44.393538 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-05 20:58:44.409771 | mon1 | changed: [mon1] 2026-03-05 20:58:44.409964 | mon1 | changed: [osd1] 2026-03-05 20:58:44.410158 | mon1 | 2026-03-05 20:58:44.410371 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-05 20:58:44.410588 | mon1 | Thursday 05 March 2026 20:58:44 +0000 (0:00:00.283) 0:00:02.221 ******** 2026-03-05 20:58:51.899329 | mon1 | changed: [mon1] 2026-03-05 20:58:51.899539 | mon1 | changed: [osd1] 2026-03-05 20:58:51.899789 | mon1 | 2026-03-05 20:58:51.900043 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-05 20:58:51.900256 | mon1 | 2026-03-05 20:58:51.900605 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:58:51.900875 | mon1 | Thursday 05 March 2026 20:58:51 +0000 (0:00:07.489) 0:00:09.711 ******** 2026-03-05 20:58:52.575546 | mon1 | ok: [osd1] 2026-03-05 20:58:52.575712 | mon1 | 2026-03-05 20:58:52.575918 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-05 20:58:52.576175 | mon1 | Thursday 05 March 2026 20:58:52 +0000 (0:00:00.675) 0:00:10.387 ******** 2026-03-05 20:59:19.405091 | mon1 | changed: [osd1] 2026-03-05 20:59:19.405190 | mon1 | 2026-03-05 20:59:19.405296 | mon1 | TASK [Start up service] ******************************************************** 2026-03-05 20:59:19.405431 | mon1 | Thursday 05 March 2026 20:59:19 +0000 (0:00:26.829) 0:00:37.216 ******** 2026-03-05 20:59:19.961332 | mon1 | ok: [osd1] 2026-03-05 20:59:19.961440 | mon1 | 2026-03-05 20:59:19.961672 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-05 20:59:19.961879 | mon1 | Thursday 05 March 2026 20:59:19 +0000 (0:00:00.556) 0:00:37.773 ******** 2026-03-05 20:59:20.270936 | mon1 | ok: [osd1] 2026-03-05 20:59:20.271086 | mon1 | 2026-03-05 20:59:20.271193 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-05 20:59:20.271327 | mon1 | Thursday 05 March 2026 20:59:20 +0000 (0:00:00.309) 0:00:38.082 ******** 2026-03-05 20:59:20.921255 | mon1 | changed: [osd1] 2026-03-05 20:59:20.921358 | mon1 | 2026-03-05 20:59:20.921613 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-05 20:59:20.921814 | mon1 | Thursday 05 March 2026 20:59:20 +0000 (0:00:00.650) 0:00:38.732 ******** 2026-03-05 20:59:21.171920 | mon1 | ok: [osd1] 2026-03-05 20:59:21.172105 | mon1 | 2026-03-05 20:59:21.172311 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-05 20:59:21.172593 | mon1 | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.250) 0:00:38.983 ******** 2026-03-05 20:59:21.191251 | mon1 | skipping: [osd1] 2026-03-05 20:59:21.191437 | mon1 | 2026-03-05 20:59:21.191641 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-05 20:59:21.191837 | mon1 | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.019) 0:00:39.003 ******** 2026-03-05 20:59:21.715898 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 20:59:21.716010 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 20:59:21.716138 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 20:59:21.716259 | mon1 | 2026-03-05 20:59:21.716432 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-05 20:59:21.716548 | mon1 | Thursday 05 March 2026 20:59:21 +0000 (0:00:00.524) 0:00:39.527 ******** 2026-03-05 20:59:22.343220 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 20:59:22.343430 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 20:59:22.343869 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 20:59:22.344155 | mon1 | 2026-03-05 20:59:22.344497 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-05 20:59:22.344845 | mon1 | Thursday 05 March 2026 20:59:22 +0000 (0:00:00.626) 0:00:40.154 ******** 2026-03-05 20:59:23.048294 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 20:59:23.048391 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 20:59:23.048516 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 20:59:23.048619 | mon1 | 2026-03-05 20:59:23.048746 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-05 20:59:23.048868 | mon1 | Thursday 05 March 2026 20:59:23 +0000 (0:00:00.705) 0:00:40.860 ******** 2026-03-05 20:59:26.657893 | mon1 | changed: [osd1] => (item=osd0) 2026-03-05 20:59:26.658084 | mon1 | changed: [osd1] => (item=osd1) 2026-03-05 20:59:26.658303 | mon1 | changed: [osd1] => (item=osd2) 2026-03-05 20:59:26.658501 | mon1 | 2026-03-05 20:59:26.658721 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-05 20:59:26.658936 | mon1 | Thursday 05 March 2026 20:59:26 +0000 (0:00:03.609) 0:00:44.469 ******** 2026-03-05 20:59:29.652156 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-05 20:59:29.652247 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-05 20:59:29.652259 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-05 20:59:29.652269 | mon1 | 2026-03-05 20:59:29.652294 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 20:59:29.652305 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 20:59:29.652323 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-05 20:59:29.652467 | mon1 | 2026-03-05 20:59:29.652658 | mon1 | 2026-03-05 20:59:29.652864 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 20:59:29.653683 | mon1 | Thursday 05 March 2026 20:59:29 +0000 (0:00:02.993) 0:00:47.463 ******** 2026-03-05 20:59:29.653696 | mon1 | =============================================================================== 2026-03-05 20:59:29.653706 | mon1 | Install depedencies ---------------------------------------------------- 26.83s 2026-03-05 20:59:29.653715 | mon1 | Update apt cache -------------------------------------------------------- 7.49s 2026-03-05 20:59:29.653882 | mon1 | Create a volume group for each loop device ------------------------------ 3.61s 2026-03-05 20:59:29.654091 | mon1 | Create a logical volume for each loop device ---------------------------- 2.99s 2026-03-05 20:59:29.654293 | mon1 | Gathering Facts --------------------------------------------------------- 1.21s 2026-03-05 20:59:29.654513 | mon1 | Start loop devices ------------------------------------------------------ 0.71s 2026-03-05 20:59:29.654757 | mon1 | Configure short hostname ------------------------------------------------ 0.69s 2026-03-05 20:59:29.654945 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s 2026-03-05 20:59:29.655137 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s 2026-03-05 20:59:29.655343 | mon1 | Set permissions on loopback devices ------------------------------------- 0.63s 2026-03-05 20:59:29.655558 | mon1 | Start up service -------------------------------------------------------- 0.56s 2026-03-05 20:59:29.655749 | mon1 | Create devices for Ceph ------------------------------------------------- 0.52s 2026-03-05 20:59:29.655961 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-03-05 20:59:29.656241 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.28s 2026-03-05 20:59:29.656504 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-03-05 20:59:29.656628 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-05 20:59:29.737370 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-05 20:59:29.746905 | mon1 | INFO [default > converge] Executing 2026-03-05 20:59:30.539805 | mon1 | 2026-03-05 20:59:30.539930 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 20:59:30.540069 | mon1 | 2026-03-05 20:59:30.540218 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 20:59:30.540414 | mon1 | Thursday 05 March 2026 20:59:30 +0000 (0:00:00.048) 0:00:00.048 ******** 2026-03-05 20:59:31.553081 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 20:59:31.553259 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 20:59:31.553474 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 20:59:31.553687 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 20:59:31.553898 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 20:59:31.567185 | mon1 | ok: [mon1] 2026-03-05 20:59:31.567394 | mon1 | 2026-03-05 20:59:31.567605 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:31.567813 | mon1 | Thursday 05 March 2026 20:59:31 +0000 (0:00:01.027) 0:00:01.076 ******** 2026-03-05 20:59:31.857692 | mon1 | ok: [mon1] 2026-03-05 20:59:31.857764 | mon1 | 2026-03-05 20:59:31.857845 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:31.857937 | mon1 | Thursday 05 March 2026 20:59:31 +0000 (0:00:00.290) 0:00:01.366 ******** 2026-03-05 20:59:31.891875 | mon1 | skipping: [mon1] 2026-03-05 20:59:31.892061 | mon1 | 2026-03-05 20:59:31.892275 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 20:59:31.892512 | mon1 | Thursday 05 March 2026 20:59:31 +0000 (0:00:00.034) 0:00:01.400 ******** 2026-03-05 20:59:32.208292 | mon1 | changed: [mon1] 2026-03-05 20:59:32.208496 | mon1 | 2026-03-05 20:59:32.208712 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:32.208914 | mon1 | Thursday 05 March 2026 20:59:32 +0000 (0:00:00.316) 0:00:01.717 ******** 2026-03-05 20:59:32.308459 | mon1 | ok: [mon1] => { 2026-03-05 20:59:32.308659 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 20:59:32.308874 | mon1 | } 2026-03-05 20:59:32.309064 | mon1 | 2026-03-05 20:59:32.309270 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:32.309471 | mon1 | Thursday 05 March 2026 20:59:32 +0000 (0:00:00.100) 0:00:01.817 ******** 2026-03-05 20:59:33.025107 | mon1 | changed: [mon1] 2026-03-05 20:59:33.025308 | mon1 | 2026-03-05 20:59:33.025556 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:33.025761 | mon1 | Thursday 05 March 2026 20:59:33 +0000 (0:00:00.715) 0:00:02.532 ******** 2026-03-05 20:59:33.066557 | mon1 | skipping: [mon1] 2026-03-05 20:59:33.066709 | mon1 | 2026-03-05 20:59:33.066958 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:33.067155 | mon1 | Thursday 05 March 2026 20:59:33 +0000 (0:00:00.042) 0:00:02.575 ******** 2026-03-05 20:59:33.108867 | mon1 | skipping: [mon1] 2026-03-05 20:59:33.109021 | mon1 | 2026-03-05 20:59:33.109308 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:33.109536 | mon1 | Thursday 05 March 2026 20:59:33 +0000 (0:00:00.042) 0:00:02.617 ******** 2026-03-05 20:59:33.316980 | mon1 | ok: [mon1] 2026-03-05 20:59:33.317145 | mon1 | 2026-03-05 20:59:33.317451 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 20:59:33.317680 | mon1 | Thursday 05 March 2026 20:59:33 +0000 (0:00:00.207) 0:00:02.825 ******** 2026-03-05 20:59:34.577128 | mon1 | ok: [mon1] 2026-03-05 20:59:34.577305 | mon1 | 2026-03-05 20:59:34.577568 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:34.577788 | mon1 | Thursday 05 March 2026 20:59:34 +0000 (0:00:01.254) 0:00:04.080 ******** 2026-03-05 20:59:34.650243 | mon1 | ok: [mon1] => { 2026-03-05 20:59:34.650462 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 20:59:34.650677 | mon1 | } 2026-03-05 20:59:34.650848 | mon1 | 2026-03-05 20:59:34.651069 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:34.651270 | mon1 | Thursday 05 March 2026 20:59:34 +0000 (0:00:00.078) 0:00:04.159 ******** 2026-03-05 20:59:35.401674 | mon1 | changed: [mon1] 2026-03-05 20:59:35.401823 | mon1 | 2026-03-05 20:59:35.402118 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:35.402325 | mon1 | Thursday 05 March 2026 20:59:35 +0000 (0:00:00.750) 0:00:04.910 ******** 2026-03-05 20:59:38.407275 | mon1 | changed: [mon1] 2026-03-05 20:59:38.407471 | mon1 | 2026-03-05 20:59:38.407610 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 20:59:38.407739 | mon1 | Thursday 05 March 2026 20:59:38 +0000 (0:00:03.001) 0:00:07.911 ******** 2026-03-05 20:59:38.437016 | mon1 | skipping: [mon1] 2026-03-05 20:59:38.437175 | mon1 | 2026-03-05 20:59:38.437401 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 20:59:38.437580 | mon1 | Thursday 05 March 2026 20:59:38 +0000 (0:00:00.034) 0:00:07.945 ******** 2026-03-05 20:59:38.465436 | mon1 | skipping: [mon1] 2026-03-05 20:59:38.465521 | mon1 | 2026-03-05 20:59:38.465675 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 20:59:38.465889 | mon1 | Thursday 05 March 2026 20:59:38 +0000 (0:00:00.028) 0:00:07.974 ******** 2026-03-05 20:59:38.496569 | mon1 | skipping: [mon1] 2026-03-05 20:59:38.496671 | mon1 | 2026-03-05 20:59:38.496817 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 20:59:38.496946 | mon1 | Thursday 05 March 2026 20:59:38 +0000 (0:00:00.031) 0:00:08.005 ******** 2026-03-05 20:59:44.028990 | mon1 | changed: [mon1] 2026-03-05 20:59:44.029105 | mon1 | 2026-03-05 20:59:44.029359 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 20:59:44.029563 | mon1 | Thursday 05 March 2026 20:59:44 +0000 (0:00:05.531) 0:00:13.537 ******** 2026-03-05 20:59:44.592128 | mon1 | changed: [mon1] 2026-03-05 20:59:44.592242 | mon1 | 2026-03-05 20:59:44.592325 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 20:59:44.592475 | mon1 | Thursday 05 March 2026 20:59:44 +0000 (0:00:00.563) 0:00:14.101 ******** 2026-03-05 20:59:45.500523 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 20:59:45.500605 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 20:59:45.500620 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 20:59:45.500630 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 20:59:45.500649 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 20:59:45.500661 | mon1 | 2026-03-05 20:59:45.501183 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 20:59:45.501449 | mon1 | Thursday 05 March 2026 20:59:45 +0000 (0:00:00.906) 0:00:15.007 ******** 2026-03-05 20:59:46.066622 | mon1 | changed: [mon1] 2026-03-05 20:59:46.066704 | mon1 | 2026-03-05 20:59:46.066741 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 20:59:46.067159 | mon1 | Thursday 05 March 2026 20:59:46 +0000 (0:00:00.559) 0:00:15.567 ******** 2026-03-05 20:59:46.067222 | mon1 | 2026-03-05 20:59:46.067229 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 20:59:46.067234 | mon1 | Thursday 05 March 2026 20:59:46 +0000 (0:00:00.008) 0:00:15.575 ******** 2026-03-05 20:59:47.012933 | mon1 | ok: [mon1] 2026-03-05 20:59:47.012983 | mon1 | 2026-03-05 20:59:47.012991 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 20:59:47.012998 | mon1 | Thursday 05 March 2026 20:59:47 +0000 (0:00:00.945) 0:00:16.521 ******** 2026-03-05 20:59:47.489710 | mon1 | changed: [mon1] 2026-03-05 20:59:47.489776 | mon1 | 2026-03-05 20:59:47.489782 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 20:59:47.489787 | mon1 | Thursday 05 March 2026 20:59:47 +0000 (0:00:00.476) 0:00:16.998 ******** 2026-03-05 20:59:48.042874 | mon1 | changed: [mon1] 2026-03-05 20:59:48.042955 | mon1 | 2026-03-05 20:59:48.043018 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 20:59:48.043196 | mon1 | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.553) 0:00:17.551 ******** 2026-03-05 20:59:48.248184 | mon1 | ok: [mon1] 2026-03-05 20:59:48.248284 | mon1 | 2026-03-05 20:59:48.248297 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 20:59:48.248468 | mon1 | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.205) 0:00:17.757 ******** 2026-03-05 20:59:48.316037 | mon1 | ok: [mon1] => { 2026-03-05 20:59:48.316587 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 20:59:48.316664 | mon1 | } 2026-03-05 20:59:48.316678 | mon1 | 2026-03-05 20:59:48.316690 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 20:59:48.316701 | mon1 | Thursday 05 March 2026 20:59:48 +0000 (0:00:00.067) 0:00:17.825 ******** 2026-03-05 20:59:49.379163 | mon1 | changed: [mon1] 2026-03-05 20:59:49.379259 | mon1 | 2026-03-05 20:59:49.379272 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 20:59:49.379434 | mon1 | Thursday 05 March 2026 20:59:49 +0000 (0:00:01.063) 0:00:18.888 ******** 2026-03-05 20:59:53.763286 | mon1 | changed: [mon1] 2026-03-05 20:59:53.763409 | mon1 | 2026-03-05 20:59:53.763422 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 20:59:53.763433 | mon1 | Thursday 05 March 2026 20:59:53 +0000 (0:00:04.383) 0:00:23.271 ******** 2026-03-05 20:59:54.830297 | mon1 | ok: [mon1] 2026-03-05 20:59:54.830571 | mon1 | 2026-03-05 20:59:54.830586 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 20:59:54.830600 | mon1 | Thursday 05 March 2026 20:59:54 +0000 (0:00:01.067) 0:00:24.339 ******** 2026-03-05 20:59:55.166629 | mon1 | changed: [mon1] 2026-03-05 20:59:55.166686 | mon1 | 2026-03-05 20:59:55.167082 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 20:59:55.167143 | mon1 | Thursday 05 March 2026 20:59:55 +0000 (0:00:00.336) 0:00:24.675 ******** 2026-03-05 20:59:55.637762 | mon1 | changed: [mon1] 2026-03-05 20:59:55.637840 | mon1 | 2026-03-05 20:59:55.637923 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 20:59:55.638084 | mon1 | Thursday 05 March 2026 20:59:55 +0000 (0:00:00.471) 0:00:25.146 ******** 2026-03-05 20:59:56.223564 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 20:59:56.223680 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 20:59:56.224255 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 20:59:56.224314 | mon1 | 2026-03-05 20:59:56.224323 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 20:59:56.224330 | mon1 | Thursday 05 March 2026 20:59:56 +0000 (0:00:00.585) 0:00:25.732 ******** 2026-03-05 20:59:56.687620 | mon1 | changed: [mon1] 2026-03-05 20:59:56.687697 | mon1 | 2026-03-05 20:59:56.687763 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 20:59:56.687933 | mon1 | Thursday 05 March 2026 20:59:56 +0000 (0:00:00.463) 0:00:26.196 ******** 2026-03-05 20:59:57.183946 | mon1 | changed: [mon1] 2026-03-05 20:59:57.184058 | mon1 | 2026-03-05 20:59:57.184071 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 20:59:57.184085 | mon1 | Thursday 05 March 2026 20:59:57 +0000 (0:00:00.490) 0:00:26.687 ******** 2026-03-05 20:59:57.184515 | mon1 | 2026-03-05 20:59:57.184601 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 20:59:57.184644 | mon1 | Thursday 05 March 2026 20:59:57 +0000 (0:00:00.005) 0:00:26.693 ******** 2026-03-05 20:59:57.879577 | mon1 | ok: [mon1] 2026-03-05 20:59:57.879650 | mon1 | 2026-03-05 20:59:57.879951 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 20:59:57.880100 | mon1 | Thursday 05 March 2026 20:59:57 +0000 (0:00:00.695) 0:00:27.388 ******** 2026-03-05 20:59:58.834793 | mon1 | changed: [mon1] 2026-03-05 20:59:58.834874 | mon1 | 2026-03-05 20:59:58.835236 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 20:59:58.835318 | mon1 | Thursday 05 March 2026 20:59:58 +0000 (0:00:00.954) 0:00:28.343 ******** 2026-03-05 20:59:59.394048 | mon1 | changed: [mon1] 2026-03-05 20:59:59.394108 | mon1 | 2026-03-05 20:59:59.394305 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 20:59:59.394320 | mon1 | Thursday 05 March 2026 20:59:59 +0000 (0:00:00.559) 0:00:28.903 ******** 2026-03-05 20:59:59.447459 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 20:59:59.447541 | mon1 | 2026-03-05 20:59:59.447635 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 20:59:59.447727 | mon1 | Thursday 05 March 2026 20:59:59 +0000 (0:00:00.053) 0:00:28.956 ******** 2026-03-05 21:00:23.969473 | mon1 | changed: [mon1] 2026-03-05 21:00:23.969562 | mon1 | 2026-03-05 21:00:23.969574 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:00:23.969584 | mon1 | Thursday 05 March 2026 21:00:23 +0000 (0:00:24.521) 0:00:53.478 ******** 2026-03-05 21:00:24.576996 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:00:24.577066 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:00:24.577136 | mon1 | 2026-03-05 21:00:24.577343 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:00:24.577387 | mon1 | Thursday 05 March 2026 21:00:24 +0000 (0:00:00.608) 0:00:54.086 ******** 2026-03-05 21:00:24.847508 | mon1 | changed: [mon1] 2026-03-05 21:00:24.847958 | mon1 | 2026-03-05 21:00:24.848008 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:00:24.848017 | mon1 | Thursday 05 March 2026 21:00:24 +0000 (0:00:00.270) 0:00:54.356 ******** 2026-03-05 21:00:25.032734 | mon1 | ok: [mon1] 2026-03-05 21:00:25.033032 | mon1 | 2026-03-05 21:00:25.033045 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:00:25.033098 | mon1 | Thursday 05 March 2026 21:00:25 +0000 (0:00:00.185) 0:00:54.541 ******** 2026-03-05 21:00:25.481077 | mon1 | changed: [mon1] 2026-03-05 21:00:25.481126 | mon1 | 2026-03-05 21:00:25.481132 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:00:25.481137 | mon1 | Thursday 05 March 2026 21:00:25 +0000 (0:00:00.448) 0:00:54.989 ******** 2026-03-05 21:00:25.802290 | mon1 | changed: [mon1] 2026-03-05 21:00:25.802354 | mon1 | 2026-03-05 21:00:25.802445 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:00:25.802578 | mon1 | Thursday 05 March 2026 21:00:25 +0000 (0:00:00.321) 0:00:55.311 ******** 2026-03-05 21:00:25.916629 | mon1 | ok: [mon1] 2026-03-05 21:00:25.916697 | mon1 | 2026-03-05 21:00:25.916712 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:00:25.916837 | mon1 | Thursday 05 March 2026 21:00:25 +0000 (0:00:00.114) 0:00:55.425 ******** 2026-03-05 21:00:26.121982 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:00:26.122377 | mon1 | 2026-03-05 21:00:26.122433 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:00:26.122441 | mon1 | Thursday 05 March 2026 21:00:26 +0000 (0:00:00.205) 0:00:55.630 ******** 2026-03-05 21:00:26.167217 | mon1 | ok: [mon1] 2026-03-05 21:00:26.167294 | mon1 | 2026-03-05 21:00:26.167336 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:00:26.167440 | mon1 | Thursday 05 March 2026 21:00:26 +0000 (0:00:00.045) 0:00:55.676 ******** 2026-03-05 21:00:26.259149 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-05 21:00:26.259230 | mon1 | 2026-03-05 21:00:26.259242 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-05 21:00:26.259382 | mon1 | Thursday 05 March 2026 21:00:26 +0000 (0:00:00.091) 0:00:55.768 ******** 2026-03-05 21:00:26.535485 | mon1 | changed: [mon1] 2026-03-05 21:00:26.535573 | mon1 | 2026-03-05 21:00:26.535891 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-05 21:00:26.535930 | mon1 | Thursday 05 March 2026 21:00:26 +0000 (0:00:00.276) 0:00:56.044 ******** 2026-03-05 21:00:27.178297 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-05 21:00:27.178338 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-05 21:00:27.178346 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-05 21:00:27.178353 | mon1 | 2026-03-05 21:00:27.178359 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-05 21:00:27.178365 | mon1 | Thursday 05 March 2026 21:00:27 +0000 (0:00:00.642) 0:00:56.686 ******** 2026-03-05 21:02:32.167615 | mon1 | ok: [mon1] 2026-03-05 21:02:32.167701 | mon1 | 2026-03-05 21:02:32.167716 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-05 21:02:32.167853 | mon1 | Thursday 05 March 2026 21:02:32 +0000 (0:02:04.989) 0:03:01.676 ******** 2026-03-05 21:02:32.367295 | mon1 | changed: [mon1] 2026-03-05 21:02:32.367359 | mon1 | 2026-03-05 21:02:32.367447 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-05 21:02:32.367543 | mon1 | Thursday 05 March 2026 21:02:32 +0000 (0:00:00.199) 0:03:01.876 ******** 2026-03-05 21:02:32.408941 | mon1 | ok: [mon1] 2026-03-05 21:02:32.409001 | mon1 | 2026-03-05 21:02:32.409099 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:02:32.409225 | mon1 | Thursday 05 March 2026 21:02:32 +0000 (0:00:00.041) 0:03:01.918 ******** 2026-03-05 21:02:32.474728 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:02:32.474768 | mon1 | 2026-03-05 21:02:32.475022 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:02:32.475068 | mon1 | Thursday 05 March 2026 21:02:32 +0000 (0:00:00.065) 0:03:01.983 ******** 2026-03-05 21:02:37.928712 | mon1 | ok: [mon1] 2026-03-05 21:02:37.929062 | mon1 | 2026-03-05 21:02:37.929420 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:02:37.929480 | mon1 | Thursday 05 March 2026 21:02:37 +0000 (0:00:05.453) 0:03:07.437 ******** 2026-03-05 21:02:37.969987 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:02:37.970288 | mon1 | 2026-03-05 21:02:37.970332 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:02:37.970338 | mon1 | Thursday 05 March 2026 21:02:37 +0000 (0:00:00.041) 0:03:07.478 ******** 2026-03-05 21:02:38.325410 | mon1 | ok: [mon1] 2026-03-05 21:02:38.325454 | mon1 | 2026-03-05 21:02:38.325463 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:02:38.325469 | mon1 | Thursday 05 March 2026 21:02:38 +0000 (0:00:00.354) 0:03:07.833 ******** 2026-03-05 21:02:44.787748 | mon1 | ok: [mon1] 2026-03-05 21:02:44.787821 | mon1 | 2026-03-05 21:02:44.787993 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:02:44.788183 | mon1 | Thursday 05 March 2026 21:02:44 +0000 (0:00:06.462) 0:03:14.296 ******** 2026-03-05 21:02:56.662357 | mon1 | changed: [mon1] 2026-03-05 21:02:56.662418 | mon1 | 2026-03-05 21:02:56.662731 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:02:56.662772 | mon1 | Thursday 05 March 2026 21:02:56 +0000 (0:00:11.874) 0:03:26.171 ******** 2026-03-05 21:03:10.828926 | mon1 | ok: [mon1] 2026-03-05 21:03:10.828983 | mon1 | 2026-03-05 21:03:10.829122 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:03:10.829269 | mon1 | Thursday 05 March 2026 21:03:10 +0000 (0:00:14.166) 0:03:40.338 ******** 2026-03-05 21:03:10.890065 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:03:10.890155 | mon1 | 2026-03-05 21:03:10.890300 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:03:10.890446 | mon1 | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.061) 0:03:40.399 ******** 2026-03-05 21:03:10.933948 | mon1 | skipping: [mon1] 2026-03-05 21:03:10.934014 | mon1 | 2026-03-05 21:03:10.934182 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:03:10.934351 | mon1 | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.043) 0:03:40.443 ******** 2026-03-05 21:03:10.969249 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:03:10.969343 | mon1 | skipping: [mon1] 2026-03-05 21:03:10.969426 | mon1 | 2026-03-05 21:03:10.969655 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:03:10.969701 | mon1 | Thursday 05 March 2026 21:03:10 +0000 (0:00:00.035) 0:03:40.478 ******** 2026-03-05 21:03:11.207261 | mon1 | ok: [mon1] 2026-03-05 21:03:11.207322 | mon1 | 2026-03-05 21:03:11.207543 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:03:11.207588 | mon1 | Thursday 05 March 2026 21:03:11 +0000 (0:00:00.237) 0:03:40.716 ******** 2026-03-05 21:03:17.716670 | mon1 | ok: [mon1] 2026-03-05 21:03:17.716799 | mon1 | 2026-03-05 21:03:17.716825 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:03:17.716836 | mon1 | Thursday 05 March 2026 21:03:17 +0000 (0:00:06.509) 0:03:47.225 ******** 2026-03-05 21:03:29.709265 | mon1 | changed: [mon1] 2026-03-05 21:03:29.709339 | mon1 | 2026-03-05 21:03:29.709536 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:03:29.709576 | mon1 | Thursday 05 March 2026 21:03:29 +0000 (0:00:11.992) 0:03:59.218 ******** 2026-03-05 21:03:36.013191 | mon1 | ok: [mon1] 2026-03-05 21:03:36.013299 | mon1 | 2026-03-05 21:03:36.013562 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:03:36.013583 | mon1 | Thursday 05 March 2026 21:03:36 +0000 (0:00:06.303) 0:04:05.522 ******** 2026-03-05 21:03:41.349787 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:03:41.349902 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:03:41.350024 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:03:41.350141 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:03:41.350261 | mon1 | 2026-03-05 21:03:41.350381 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:03:41.350488 | mon1 | 2026-03-05 21:03:41.350607 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:03:41.350728 | mon1 | Thursday 05 March 2026 21:03:41 +0000 (0:00:05.336) 0:04:10.859 ******** 2026-03-05 21:03:42.427514 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:03:42.427752 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:03:42.428022 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:03:42.428320 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:03:42.428699 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:03:42.440902 | mon1 | ok: [osd1] 2026-03-05 21:03:42.441019 | mon1 | 2026-03-05 21:03:42.441154 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:42.441281 | mon1 | Thursday 05 March 2026 21:03:42 +0000 (0:00:01.091) 0:04:11.950 ******** 2026-03-05 21:03:42.644899 | mon1 | ok: [osd1] 2026-03-05 21:03:42.644975 | mon1 | 2026-03-05 21:03:42.644987 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:42.645076 | mon1 | Thursday 05 March 2026 21:03:42 +0000 (0:00:00.203) 0:04:12.154 ******** 2026-03-05 21:03:42.678086 | mon1 | skipping: [osd1] 2026-03-05 21:03:42.678161 | mon1 | 2026-03-05 21:03:42.678173 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:03:42.678261 | mon1 | Thursday 05 March 2026 21:03:42 +0000 (0:00:00.033) 0:04:12.187 ******** 2026-03-05 21:03:42.877737 | mon1 | changed: [osd1] 2026-03-05 21:03:42.877809 | mon1 | 2026-03-05 21:03:42.877844 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:42.877961 | mon1 | Thursday 05 March 2026 21:03:42 +0000 (0:00:00.199) 0:04:12.386 ******** 2026-03-05 21:03:42.926705 | mon1 | ok: [osd1] => { 2026-03-05 21:03:42.926774 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:03:42.926876 | mon1 | } 2026-03-05 21:03:42.927039 | mon1 | 2026-03-05 21:03:42.927113 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:42.927297 | mon1 | Thursday 05 March 2026 21:03:42 +0000 (0:00:00.049) 0:04:12.435 ******** 2026-03-05 21:03:43.475141 | mon1 | changed: [osd1] 2026-03-05 21:03:43.475208 | mon1 | 2026-03-05 21:03:43.475249 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:43.475340 | mon1 | Thursday 05 March 2026 21:03:43 +0000 (0:00:00.548) 0:04:12.984 ******** 2026-03-05 21:03:43.510174 | mon1 | skipping: [osd1] 2026-03-05 21:03:43.510244 | mon1 | 2026-03-05 21:03:43.510263 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:43.510316 | mon1 | Thursday 05 March 2026 21:03:43 +0000 (0:00:00.034) 0:04:13.019 ******** 2026-03-05 21:03:43.546751 | mon1 | skipping: [osd1] 2026-03-05 21:03:43.546804 | mon1 | 2026-03-05 21:03:43.546865 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:43.546946 | mon1 | Thursday 05 March 2026 21:03:43 +0000 (0:00:00.036) 0:04:13.055 ******** 2026-03-05 21:03:43.740926 | mon1 | ok: [osd1] 2026-03-05 21:03:43.740997 | mon1 | 2026-03-05 21:03:43.741044 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:03:43.741149 | mon1 | Thursday 05 March 2026 21:03:43 +0000 (0:00:00.194) 0:04:13.250 ******** 2026-03-05 21:03:44.728933 | mon1 | ok: [osd1] 2026-03-05 21:03:44.729001 | mon1 | 2026-03-05 21:03:44.729067 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:44.729159 | mon1 | Thursday 05 March 2026 21:03:44 +0000 (0:00:00.987) 0:04:14.238 ******** 2026-03-05 21:03:44.791792 | mon1 | ok: [osd1] => { 2026-03-05 21:03:44.791859 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:03:44.791982 | mon1 | } 2026-03-05 21:03:44.792088 | mon1 | 2026-03-05 21:03:44.792216 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:44.792342 | mon1 | Thursday 05 March 2026 21:03:44 +0000 (0:00:00.062) 0:04:14.301 ******** 2026-03-05 21:03:45.551890 | mon1 | changed: [osd1] 2026-03-05 21:03:45.551986 | mon1 | 2026-03-05 21:03:45.552150 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:45.552282 | mon1 | Thursday 05 March 2026 21:03:45 +0000 (0:00:00.759) 0:04:15.060 ******** 2026-03-05 21:03:48.169716 | mon1 | changed: [osd1] 2026-03-05 21:03:48.169786 | mon1 | 2026-03-05 21:03:48.169844 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:03:48.169940 | mon1 | Thursday 05 March 2026 21:03:48 +0000 (0:00:02.617) 0:04:17.678 ******** 2026-03-05 21:03:48.193202 | mon1 | skipping: [osd1] 2026-03-05 21:03:48.193275 | mon1 | 2026-03-05 21:03:48.193373 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:03:48.193469 | mon1 | Thursday 05 March 2026 21:03:48 +0000 (0:00:00.023) 0:04:17.702 ******** 2026-03-05 21:03:48.218238 | mon1 | skipping: [osd1] 2026-03-05 21:03:48.218276 | mon1 | 2026-03-05 21:03:48.218379 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:03:48.218479 | mon1 | Thursday 05 March 2026 21:03:48 +0000 (0:00:00.024) 0:04:17.727 ******** 2026-03-05 21:03:48.248041 | mon1 | skipping: [osd1] 2026-03-05 21:03:48.248080 | mon1 | 2026-03-05 21:03:48.248169 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:03:48.248259 | mon1 | Thursday 05 March 2026 21:03:48 +0000 (0:00:00.029) 0:04:17.757 ******** 2026-03-05 21:03:53.527023 | mon1 | changed: [osd1] 2026-03-05 21:03:53.527088 | mon1 | 2026-03-05 21:03:53.527177 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:03:53.527272 | mon1 | Thursday 05 March 2026 21:03:53 +0000 (0:00:05.278) 0:04:23.036 ******** 2026-03-05 21:03:53.977243 | mon1 | changed: [osd1] 2026-03-05 21:03:53.977308 | mon1 | 2026-03-05 21:03:53.977395 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:03:53.977489 | mon1 | Thursday 05 March 2026 21:03:53 +0000 (0:00:00.450) 0:04:23.486 ******** 2026-03-05 21:03:54.883807 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:03:54.883919 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:03:54.884062 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:03:54.884209 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:03:54.884352 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:03:54.884524 | mon1 | 2026-03-05 21:03:54.884646 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:03:54.884782 | mon1 | Thursday 05 March 2026 21:03:54 +0000 (0:00:00.906) 0:04:24.392 ******** 2026-03-05 21:03:55.377543 | mon1 | changed: [osd1] 2026-03-05 21:03:55.377604 | mon1 | 2026-03-05 21:03:55.377689 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:03:55.377779 | mon1 | Thursday 05 March 2026 21:03:55 +0000 (0:00:00.488) 0:04:24.881 ******** 2026-03-05 21:03:55.377862 | mon1 | 2026-03-05 21:03:55.377958 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:03:55.378039 | mon1 | Thursday 05 March 2026 21:03:55 +0000 (0:00:00.005) 0:04:24.886 ******** 2026-03-05 21:03:56.060927 | mon1 | ok: [osd1] 2026-03-05 21:03:56.061004 | mon1 | 2026-03-05 21:03:56.061120 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-05 21:03:56.061303 | mon1 | Thursday 05 March 2026 21:03:56 +0000 (0:00:00.682) 0:04:25.569 ******** 2026-03-05 21:03:56.509081 | mon1 | changed: [osd1] 2026-03-05 21:03:56.509152 | mon1 | 2026-03-05 21:03:56.509341 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:03:56.509437 | mon1 | Thursday 05 March 2026 21:03:56 +0000 (0:00:00.448) 0:04:26.017 ******** 2026-03-05 21:03:57.022071 | mon1 | changed: [osd1] 2026-03-05 21:03:57.022158 | mon1 | 2026-03-05 21:03:57.022171 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:03:57.022246 | mon1 | Thursday 05 March 2026 21:03:57 +0000 (0:00:00.513) 0:04:26.531 ******** 2026-03-05 21:03:57.223369 | mon1 | ok: [osd1] 2026-03-05 21:03:57.223440 | mon1 | 2026-03-05 21:03:57.223498 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:03:57.223586 | mon1 | Thursday 05 March 2026 21:03:57 +0000 (0:00:00.201) 0:04:26.732 ******** 2026-03-05 21:03:57.277326 | mon1 | ok: [osd1] => { 2026-03-05 21:03:57.277365 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:03:57.277458 | mon1 | } 2026-03-05 21:03:57.277540 | mon1 | 2026-03-05 21:03:57.277636 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:03:57.277732 | mon1 | Thursday 05 March 2026 21:03:57 +0000 (0:00:00.054) 0:04:26.786 ******** 2026-03-05 21:03:58.405028 | mon1 | changed: [osd1] 2026-03-05 21:03:58.405099 | mon1 | 2026-03-05 21:03:58.405186 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:03:58.405276 | mon1 | Thursday 05 March 2026 21:03:58 +0000 (0:00:01.127) 0:04:27.914 ******** 2026-03-05 21:04:02.713872 | mon1 | changed: [osd1] 2026-03-05 21:04:02.713946 | mon1 | 2026-03-05 21:04:02.714013 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:04:02.714108 | mon1 | Thursday 05 March 2026 21:04:02 +0000 (0:00:04.308) 0:04:32.223 ******** 2026-03-05 21:04:03.781120 | mon1 | ok: [osd1] 2026-03-05 21:04:03.781193 | mon1 | 2026-03-05 21:04:03.781273 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:04:03.781364 | mon1 | Thursday 05 March 2026 21:04:03 +0000 (0:00:01.067) 0:04:33.290 ******** 2026-03-05 21:04:04.010319 | mon1 | changed: [osd1] 2026-03-05 21:04:04.010366 | mon1 | 2026-03-05 21:04:04.010374 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:04:04.010381 | mon1 | Thursday 05 March 2026 21:04:04 +0000 (0:00:00.228) 0:04:33.518 ******** 2026-03-05 21:04:04.501854 | mon1 | changed: [osd1] 2026-03-05 21:04:04.501894 | mon1 | 2026-03-05 21:04:04.501899 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:04:04.501904 | mon1 | Thursday 05 March 2026 21:04:04 +0000 (0:00:00.492) 0:04:34.010 ******** 2026-03-05 21:04:05.030211 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:04:05.030247 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:04:05.030253 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:04:05.030258 | mon1 | 2026-03-05 21:04:05.030263 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:04:05.030267 | mon1 | Thursday 05 March 2026 21:04:05 +0000 (0:00:00.528) 0:04:34.539 ******** 2026-03-05 21:04:05.460480 | mon1 | changed: [osd1] 2026-03-05 21:04:05.460588 | mon1 | 2026-03-05 21:04:05.460886 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:04:05.460929 | mon1 | Thursday 05 March 2026 21:04:05 +0000 (0:00:00.430) 0:04:34.969 ******** 2026-03-05 21:04:05.895898 | mon1 | changed: [osd1] 2026-03-05 21:04:05.895966 | mon1 | 2026-03-05 21:04:05.896050 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:04:05.896471 | mon1 | Thursday 05 March 2026 21:04:05 +0000 (0:00:00.428) 0:04:35.397 ******** 2026-03-05 21:04:05.896529 | mon1 | 2026-03-05 21:04:05.896540 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-05 21:04:05.896549 | mon1 | Thursday 05 March 2026 21:04:05 +0000 (0:00:00.007) 0:04:35.405 ******** 2026-03-05 21:04:06.568568 | mon1 | ok: [osd1] 2026-03-05 21:04:06.568644 | mon1 | 2026-03-05 21:04:06.568657 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-05 21:04:06.568675 | mon1 | Thursday 05 March 2026 21:04:06 +0000 (0:00:00.671) 0:04:36.076 ******** 2026-03-05 21:04:07.686398 | mon1 | changed: [osd1] 2026-03-05 21:04:07.686473 | mon1 | 2026-03-05 21:04:07.686752 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:04:07.686854 | mon1 | Thursday 05 March 2026 21:04:07 +0000 (0:00:01.117) 0:04:37.194 ******** 2026-03-05 21:04:08.206871 | mon1 | changed: [osd1] 2026-03-05 21:04:08.207016 | mon1 | 2026-03-05 21:04:08.207029 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:04:08.207436 | mon1 | Thursday 05 March 2026 21:04:08 +0000 (0:00:00.520) 0:04:37.715 ******** 2026-03-05 21:04:08.256841 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:04:08.256973 | mon1 | 2026-03-05 21:04:08.257377 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:04:08.257459 | mon1 | Thursday 05 March 2026 21:04:08 +0000 (0:00:00.049) 0:04:37.765 ******** 2026-03-05 21:04:13.282760 | mon1 | changed: [osd1] 2026-03-05 21:04:13.282855 | mon1 | 2026-03-05 21:04:13.282922 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:04:13.283069 | mon1 | Thursday 05 March 2026 21:04:13 +0000 (0:00:05.026) 0:04:42.791 ******** 2026-03-05 21:04:13.923603 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:04:13.923670 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:04:13.924032 | mon1 | 2026-03-05 21:04:13.924054 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:04:13.924062 | mon1 | Thursday 05 March 2026 21:04:13 +0000 (0:00:00.640) 0:04:43.432 ******** 2026-03-05 21:04:14.208570 | mon1 | changed: [osd1] 2026-03-05 21:04:14.208638 | mon1 | 2026-03-05 21:04:14.208897 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:04:14.208918 | mon1 | Thursday 05 March 2026 21:04:14 +0000 (0:00:00.284) 0:04:43.717 ******** 2026-03-05 21:04:14.399647 | mon1 | ok: [osd1] 2026-03-05 21:04:14.399711 | mon1 | 2026-03-05 21:04:14.399797 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:04:14.400258 | mon1 | Thursday 05 March 2026 21:04:14 +0000 (0:00:00.191) 0:04:43.908 ******** 2026-03-05 21:04:14.701357 | mon1 | changed: [osd1] 2026-03-05 21:04:14.701426 | mon1 | 2026-03-05 21:04:14.701669 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:04:14.701692 | mon1 | Thursday 05 March 2026 21:04:14 +0000 (0:00:00.301) 0:04:44.210 ******** 2026-03-05 21:04:14.908704 | mon1 | changed: [osd1] 2026-03-05 21:04:14.908761 | mon1 | 2026-03-05 21:04:14.908943 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:04:14.908958 | mon1 | Thursday 05 March 2026 21:04:14 +0000 (0:00:00.207) 0:04:44.417 ******** 2026-03-05 21:04:15.107494 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:04:15.107590 | mon1 | 2026-03-05 21:04:15.107913 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:04:15.107963 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.198) 0:04:44.616 ******** 2026-03-05 21:04:15.150342 | mon1 | ok: [osd1] 2026-03-05 21:04:15.150621 | mon1 | 2026-03-05 21:04:15.150641 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:04:15.150647 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.042) 0:04:44.659 ******** 2026-03-05 21:04:15.203225 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:04:15.203288 | mon1 | 2026-03-05 21:04:15.203396 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:04:15.203490 | mon1 | Thursday 05 March 2026 21:04:15 +0000 (0:00:00.053) 0:04:44.712 ******** 2026-03-05 21:04:21.388188 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:04:21.388518 | mon1 | 2026-03-05 21:04:21.388846 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:04:21.388878 | mon1 | Thursday 05 March 2026 21:04:21 +0000 (0:00:06.184) 0:04:50.897 ******** 2026-03-05 21:04:21.431838 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:04:21.431998 | mon1 | 2026-03-05 21:04:21.432467 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:04:21.432538 | mon1 | Thursday 05 March 2026 21:04:21 +0000 (0:00:00.043) 0:04:50.940 ******** 2026-03-05 21:04:21.680779 | mon1 | changed: [osd1] 2026-03-05 21:04:21.680894 | mon1 | 2026-03-05 21:04:21.681246 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:04:21.681305 | mon1 | Thursday 05 March 2026 21:04:21 +0000 (0:00:00.248) 0:04:51.189 ******** 2026-03-05 21:04:31.702431 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:04:31.702507 | mon1 | 2026-03-05 21:04:31.702566 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:04:31.702701 | mon1 | Thursday 05 March 2026 21:04:31 +0000 (0:00:10.021) 0:05:01.211 ******** 2026-03-05 21:04:33.221764 | mon1 | ok: [osd1] 2026-03-05 21:04:33.221836 | mon1 | 2026-03-05 21:04:33.222120 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:04:33.222142 | mon1 | Thursday 05 March 2026 21:04:33 +0000 (0:00:01.519) 0:05:02.730 ******** 2026-03-05 21:05:17.673963 | mon1 | ok: [osd1] 2026-03-05 21:05:17.674055 | mon1 | 2026-03-05 21:05:17.674070 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:05:17.674192 | mon1 | Thursday 05 March 2026 21:05:17 +0000 (0:00:44.452) 0:05:47.183 ******** 2026-03-05 21:07:00.473653 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:07:00.473748 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:07:00.474294 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:07:00.474340 | mon1 | 2026-03-05 21:07:00.474348 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:07:00.474355 | mon1 | Thursday 05 March 2026 21:07:00 +0000 (0:01:42.799) 0:07:29.982 ******** 2026-03-05 21:07:06.686491 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:07:06.686559 | mon1 | 2026-03-05 21:07:06.686647 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:07:06.686767 | mon1 | Thursday 05 March 2026 21:07:06 +0000 (0:00:06.213) 0:07:36.195 ******** 2026-03-05 21:07:12.804939 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:07:12.805020 | mon1 | 2026-03-05 21:07:12.805242 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:07:12.805290 | mon1 | Thursday 05 March 2026 21:07:12 +0000 (0:00:06.118) 0:07:42.314 ******** 2026-03-05 21:07:12.856255 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:07:12.856452 | mon1 | 2026-03-05 21:07:12.856469 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:07:12.856510 | mon1 | Thursday 05 March 2026 21:07:12 +0000 (0:00:00.051) 0:07:42.365 ******** 2026-03-05 21:07:12.891984 | mon1 | ok: [osd1] 2026-03-05 21:07:12.892118 | mon1 | 2026-03-05 21:07:12.892132 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:07:12.892315 | mon1 | Thursday 05 March 2026 21:07:12 +0000 (0:00:00.035) 0:07:42.401 ******** 2026-03-05 21:07:19.026973 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:07:19.027047 | mon1 | 2026-03-05 21:07:19.027259 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:07:19.027440 | mon1 | Thursday 05 March 2026 21:07:19 +0000 (0:00:06.134) 0:07:48.536 ******** 2026-03-05 21:07:19.072647 | mon1 | ok: [osd1] 2026-03-05 21:07:19.072971 | mon1 | 2026-03-05 21:07:19.073041 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:07:19.073060 | mon1 | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.045) 0:07:48.581 ******** 2026-03-05 21:07:19.111997 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:07:19.112092 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:07:19.112564 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:07:19.112692 | mon1 | skipping: [osd1] 2026-03-05 21:07:19.112719 | mon1 | 2026-03-05 21:07:19.112730 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:07:19.112776 | mon1 | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.039) 0:07:48.621 ******** 2026-03-05 21:07:19.136425 | mon1 | skipping: [osd1] 2026-03-05 21:07:19.136488 | mon1 | 2026-03-05 21:07:19.136597 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:07:19.139012 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:07:19.139066 | mon1 | osd1 : ok=53 changed=24 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-05 21:07:19.139074 | mon1 | 2026-03-05 21:07:19.139080 | mon1 | 2026-03-05 21:07:19.139085 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:07:19.139090 | mon1 | Thursday 05 March 2026 21:07:19 +0000 (0:00:00.024) 0:07:48.645 ******** 2026-03-05 21:07:19.139095 | mon1 | =============================================================================== 2026-03-05 21:07:19.139112 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 124.99s 2026-03-05 21:07:19.139117 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 102.80s 2026-03-05 21:07:19.139121 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 44.45s 2026-03-05 21:07:19.139125 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 24.52s 2026-03-05 21:07:19.139129 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.17s 2026-03-05 21:07:19.139133 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.99s 2026-03-05 21:07:19.139138 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.87s 2026-03-05 21:07:19.139142 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.02s 2026-03-05 21:07:19.139147 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.51s 2026-03-05 21:07:19.139151 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.46s 2026-03-05 21:07:19.139156 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.30s 2026-03-05 21:07:19.139160 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.21s 2026-03-05 21:07:19.139164 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.18s 2026-03-05 21:07:19.139168 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.13s 2026-03-05 21:07:19.139173 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.12s 2026-03-05 21:07:19.139177 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.53s 2026-03-05 21:07:19.139181 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.45s 2026-03-05 21:07:19.139186 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.34s 2026-03-05 21:07:19.139191 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.28s 2026-03-05 21:07:19.139196 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.03s 2026-03-05 21:07:19.276189 | mon1 | INFO [default > converge] Executed: Successful 2026-03-05 21:07:19.285279 | mon1 | INFO [default > idempotence] Executing 2026-03-05 21:07:20.103539 | mon1 | 2026-03-05 21:07:20.103887 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-05 21:07:20.104136 | mon1 | 2026-03-05 21:07:20.104468 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:07:20.104776 | mon1 | Thursday 05 March 2026 21:07:20 +0000 (0:00:00.046) 0:00:00.046 ******** 2026-03-05 21:07:21.264162 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:07:21.264244 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:07:21.264259 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:07:21.264272 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:07:21.264285 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:07:21.275390 | mon1 | ok: [mon1] 2026-03-05 21:07:21.275428 | mon1 | 2026-03-05 21:07:21.275436 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:21.275443 | mon1 | Thursday 05 March 2026 21:07:21 +0000 (0:00:01.171) 0:00:01.217 ******** 2026-03-05 21:07:21.567811 | mon1 | ok: [mon1] 2026-03-05 21:07:21.567869 | mon1 | 2026-03-05 21:07:21.567881 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:21.567891 | mon1 | Thursday 05 March 2026 21:07:21 +0000 (0:00:00.292) 0:00:01.509 ******** 2026-03-05 21:07:21.598454 | mon1 | skipping: [mon1] 2026-03-05 21:07:21.598487 | mon1 | 2026-03-05 21:07:21.598498 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:07:21.598508 | mon1 | Thursday 05 March 2026 21:07:21 +0000 (0:00:00.030) 0:00:01.540 ******** 2026-03-05 21:07:21.894991 | mon1 | ok: [mon1] 2026-03-05 21:07:21.895047 | mon1 | 2026-03-05 21:07:21.895060 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:21.895082 | mon1 | Thursday 05 March 2026 21:07:21 +0000 (0:00:00.296) 0:00:01.837 ******** 2026-03-05 21:07:21.968438 | mon1 | ok: [mon1] => { 2026-03-05 21:07:21.968483 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:07:21.968493 | mon1 | } 2026-03-05 21:07:21.968501 | mon1 | 2026-03-05 21:07:21.968507 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:21.968518 | mon1 | Thursday 05 March 2026 21:07:21 +0000 (0:00:00.073) 0:00:01.910 ******** 2026-03-05 21:07:22.385090 | mon1 | ok: [mon1] 2026-03-05 21:07:22.385156 | mon1 | 2026-03-05 21:07:22.385459 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:22.385480 | mon1 | Thursday 05 March 2026 21:07:22 +0000 (0:00:00.417) 0:00:02.327 ******** 2026-03-05 21:07:22.425802 | mon1 | skipping: [mon1] 2026-03-05 21:07:22.425864 | mon1 | 2026-03-05 21:07:22.425960 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:22.426064 | mon1 | Thursday 05 March 2026 21:07:22 +0000 (0:00:00.040) 0:00:02.368 ******** 2026-03-05 21:07:22.469022 | mon1 | skipping: [mon1] 2026-03-05 21:07:22.469083 | mon1 | 2026-03-05 21:07:22.469281 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:22.469301 | mon1 | Thursday 05 March 2026 21:07:22 +0000 (0:00:00.043) 0:00:02.411 ******** 2026-03-05 21:07:22.674709 | mon1 | ok: [mon1] 2026-03-05 21:07:22.674776 | mon1 | 2026-03-05 21:07:22.674853 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:07:22.674956 | mon1 | Thursday 05 March 2026 21:07:22 +0000 (0:00:00.205) 0:00:02.617 ******** 2026-03-05 21:07:23.723200 | mon1 | ok: [mon1] 2026-03-05 21:07:23.723282 | mon1 | 2026-03-05 21:07:23.723475 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:23.723524 | mon1 | Thursday 05 March 2026 21:07:23 +0000 (0:00:01.048) 0:00:03.666 ******** 2026-03-05 21:07:23.796111 | mon1 | ok: [mon1] => { 2026-03-05 21:07:23.796522 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:07:23.796598 | mon1 | } 2026-03-05 21:07:23.796618 | mon1 | 2026-03-05 21:07:23.796829 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:23.796862 | mon1 | Thursday 05 March 2026 21:07:23 +0000 (0:00:00.072) 0:00:03.739 ******** 2026-03-05 21:07:24.142705 | mon1 | ok: [mon1] 2026-03-05 21:07:24.142766 | mon1 | 2026-03-05 21:07:24.142996 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:24.143207 | mon1 | Thursday 05 March 2026 21:07:24 +0000 (0:00:00.346) 0:00:04.085 ******** 2026-03-05 21:07:26.306204 | mon1 | ok: [mon1] 2026-03-05 21:07:26.306251 | mon1 | 2026-03-05 21:07:26.306355 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:07:26.306489 | mon1 | Thursday 05 March 2026 21:07:26 +0000 (0:00:02.163) 0:00:06.249 ******** 2026-03-05 21:07:26.331666 | mon1 | skipping: [mon1] 2026-03-05 21:07:26.331751 | mon1 | 2026-03-05 21:07:26.331974 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:07:26.331998 | mon1 | Thursday 05 March 2026 21:07:26 +0000 (0:00:00.025) 0:00:06.274 ******** 2026-03-05 21:07:26.358663 | mon1 | skipping: [mon1] 2026-03-05 21:07:26.358711 | mon1 | 2026-03-05 21:07:26.358998 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:07:26.359074 | mon1 | Thursday 05 March 2026 21:07:26 +0000 (0:00:00.026) 0:00:06.301 ******** 2026-03-05 21:07:26.388453 | mon1 | skipping: [mon1] 2026-03-05 21:07:26.388780 | mon1 | 2026-03-05 21:07:26.388816 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:07:26.388823 | mon1 | Thursday 05 March 2026 21:07:26 +0000 (0:00:00.029) 0:00:06.331 ******** 2026-03-05 21:07:27.365405 | mon1 | ok: [mon1] 2026-03-05 21:07:27.365467 | mon1 | 2026-03-05 21:07:27.365526 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:07:27.365646 | mon1 | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.977) 0:00:07.308 ******** 2026-03-05 21:07:27.793319 | mon1 | ok: [mon1] 2026-03-05 21:07:27.793373 | mon1 | 2026-03-05 21:07:27.793472 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:07:27.793609 | mon1 | Thursday 05 March 2026 21:07:27 +0000 (0:00:00.428) 0:00:07.736 ******** 2026-03-05 21:07:28.695032 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:07:28.695109 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:07:28.695168 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:07:28.695660 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:07:28.695702 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:07:28.695708 | mon1 | 2026-03-05 21:07:28.695713 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:07:28.695718 | mon1 | Thursday 05 March 2026 21:07:28 +0000 (0:00:00.901) 0:00:08.638 ******** 2026-03-05 21:07:29.191717 | mon1 | ok: [mon1] 2026-03-05 21:07:29.191785 | mon1 | 2026-03-05 21:07:29.192266 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:07:29.192316 | mon1 | Thursday 05 March 2026 21:07:29 +0000 (0:00:00.489) 0:00:09.127 ******** 2026-03-05 21:07:29.192322 | mon1 | 2026-03-05 21:07:29.192327 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:07:29.192331 | mon1 | Thursday 05 March 2026 21:07:29 +0000 (0:00:00.007) 0:00:09.134 ******** 2026-03-05 21:07:29.785416 | mon1 | ok: [mon1] 2026-03-05 21:07:29.785499 | mon1 | 2026-03-05 21:07:29.785514 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:07:29.785661 | mon1 | Thursday 05 March 2026 21:07:29 +0000 (0:00:00.593) 0:00:09.728 ******** 2026-03-05 21:07:29.985303 | mon1 | ok: [mon1] 2026-03-05 21:07:29.985624 | mon1 | 2026-03-05 21:07:29.985673 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:07:29.985680 | mon1 | Thursday 05 March 2026 21:07:29 +0000 (0:00:00.199) 0:00:09.928 ******** 2026-03-05 21:07:30.066270 | mon1 | ok: [mon1] => { 2026-03-05 21:07:30.066335 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:07:30.066754 | mon1 | } 2026-03-05 21:07:30.066833 | mon1 | 2026-03-05 21:07:30.066839 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:07:30.066845 | mon1 | Thursday 05 March 2026 21:07:30 +0000 (0:00:00.080) 0:00:10.008 ******** 2026-03-05 21:07:30.426493 | mon1 | ok: [mon1] 2026-03-05 21:07:30.426636 | mon1 | 2026-03-05 21:07:30.426654 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:07:30.426668 | mon1 | Thursday 05 March 2026 21:07:30 +0000 (0:00:00.360) 0:00:10.369 ******** 2026-03-05 21:07:33.464806 | mon1 | ok: [mon1] 2026-03-05 21:07:33.464905 | mon1 | 2026-03-05 21:07:33.464919 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:07:33.465059 | mon1 | Thursday 05 March 2026 21:07:33 +0000 (0:00:03.038) 0:00:13.407 ******** 2026-03-05 21:07:34.665570 | mon1 | ok: [mon1] 2026-03-05 21:07:34.665635 | mon1 | 2026-03-05 21:07:34.665648 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:07:34.665747 | mon1 | Thursday 05 March 2026 21:07:34 +0000 (0:00:01.200) 0:00:14.608 ******** 2026-03-05 21:07:34.934293 | mon1 | ok: [mon1] 2026-03-05 21:07:34.934344 | mon1 | 2026-03-05 21:07:34.934453 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:07:34.934562 | mon1 | Thursday 05 March 2026 21:07:34 +0000 (0:00:00.268) 0:00:14.877 ******** 2026-03-05 21:07:35.384122 | mon1 | ok: [mon1] 2026-03-05 21:07:35.384185 | mon1 | 2026-03-05 21:07:35.384479 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:07:35.384657 | mon1 | Thursday 05 March 2026 21:07:35 +0000 (0:00:00.449) 0:00:15.326 ******** 2026-03-05 21:07:35.926411 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-05 21:07:35.926474 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:07:35.926851 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:07:35.926892 | mon1 | 2026-03-05 21:07:35.926898 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:07:35.926903 | mon1 | Thursday 05 March 2026 21:07:35 +0000 (0:00:00.537) 0:00:15.863 ******** 2026-03-05 21:07:36.353647 | mon1 | ok: [mon1] 2026-03-05 21:07:36.353713 | mon1 | 2026-03-05 21:07:36.353774 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:07:36.353936 | mon1 | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.432) 0:00:16.295 ******** 2026-03-05 21:07:36.786244 | mon1 | ok: [mon1] 2026-03-05 21:07:36.786349 | mon1 | 2026-03-05 21:07:36.786362 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:07:36.786750 | mon1 | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.427) 0:00:16.723 ******** 2026-03-05 21:07:36.786802 | mon1 | 2026-03-05 21:07:36.786809 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:07:36.786814 | mon1 | Thursday 05 March 2026 21:07:36 +0000 (0:00:00.006) 0:00:16.729 ******** 2026-03-05 21:07:37.185919 | mon1 | ok: [mon1] 2026-03-05 21:07:37.185999 | mon1 | 2026-03-05 21:07:37.186053 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:07:37.186186 | mon1 | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.399) 0:00:17.128 ******** 2026-03-05 21:07:37.232908 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:07:37.232984 | mon1 | 2026-03-05 21:07:37.233268 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:07:37.233345 | mon1 | Thursday 05 March 2026 21:07:37 +0000 (0:00:00.046) 0:00:17.175 ******** 2026-03-05 21:07:38.257621 | mon1 | ok: [mon1] 2026-03-05 21:07:38.257710 | mon1 | 2026-03-05 21:07:38.257717 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:07:38.257723 | mon1 | Thursday 05 March 2026 21:07:38 +0000 (0:00:01.024) 0:00:18.199 ******** 2026-03-05 21:07:38.915602 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-05 21:07:38.915922 | mon1 | ok: [mon1] => (item=sshd) 2026-03-05 21:07:38.915936 | mon1 | 2026-03-05 21:07:38.915947 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:07:38.915958 | mon1 | Thursday 05 March 2026 21:07:38 +0000 (0:00:00.658) 0:00:18.858 ******** 2026-03-05 21:07:39.187642 | mon1 | ok: [mon1] 2026-03-05 21:07:39.187728 | mon1 | 2026-03-05 21:07:39.187744 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:07:39.187888 | mon1 | Thursday 05 March 2026 21:07:39 +0000 (0:00:00.271) 0:00:19.130 ******** 2026-03-05 21:07:39.381020 | mon1 | ok: [mon1] 2026-03-05 21:07:39.381088 | mon1 | 2026-03-05 21:07:39.381324 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:07:39.381388 | mon1 | Thursday 05 March 2026 21:07:39 +0000 (0:00:00.192) 0:00:19.323 ******** 2026-03-05 21:07:39.809999 | mon1 | ok: [mon1] 2026-03-05 21:07:39.810119 | mon1 | 2026-03-05 21:07:39.810133 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:07:39.810198 | mon1 | Thursday 05 March 2026 21:07:39 +0000 (0:00:00.428) 0:00:19.752 ******** 2026-03-05 21:07:40.135716 | mon1 | ok: [mon1] 2026-03-05 21:07:40.135822 | mon1 | 2026-03-05 21:07:40.135835 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-05 21:07:40.135954 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.326) 0:00:20.078 ******** 2026-03-05 21:07:40.217321 | mon1 | ok: [mon1] 2026-03-05 21:07:40.217398 | mon1 | 2026-03-05 21:07:40.217658 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-05 21:07:40.217737 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.081) 0:00:20.159 ******** 2026-03-05 21:07:40.439705 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:07:40.439806 | mon1 | 2026-03-05 21:07:40.439821 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-05 21:07:40.439972 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.222) 0:00:20.382 ******** 2026-03-05 21:07:40.497758 | mon1 | ok: [mon1] 2026-03-05 21:07:40.497840 | mon1 | 2026-03-05 21:07:40.498066 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-05 21:07:40.498096 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.057) 0:00:20.440 ******** 2026-03-05 21:07:40.537690 | mon1 | skipping: [mon1] 2026-03-05 21:07:40.537833 | mon1 | 2026-03-05 21:07:40.538111 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:07:40.538139 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.040) 0:00:20.480 ******** 2026-03-05 21:07:40.603137 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:07:40.603218 | mon1 | 2026-03-05 21:07:40.603440 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:07:40.603470 | mon1 | Thursday 05 March 2026 21:07:40 +0000 (0:00:00.065) 0:00:20.546 ******** 2026-03-05 21:07:47.906508 | mon1 | ok: [mon1] 2026-03-05 21:07:47.906588 | mon1 | 2026-03-05 21:07:47.906594 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:07:47.906600 | mon1 | Thursday 05 March 2026 21:07:47 +0000 (0:00:07.302) 0:00:27.848 ******** 2026-03-05 21:07:47.958526 | mon1 | ok: [mon1] => (item=mon1) 2026-03-05 21:07:47.958589 | mon1 | 2026-03-05 21:07:47.958597 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:07:47.958604 | mon1 | Thursday 05 March 2026 21:07:47 +0000 (0:00:00.051) 0:00:27.900 ******** 2026-03-05 21:07:48.339448 | mon1 | ok: [mon1] 2026-03-05 21:07:48.339496 | mon1 | 2026-03-05 21:07:48.339502 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:07:48.339508 | mon1 | Thursday 05 March 2026 21:07:48 +0000 (0:00:00.381) 0:00:28.282 ******** 2026-03-05 21:07:55.664634 | mon1 | ok: [mon1] 2026-03-05 21:07:55.664717 | mon1 | 2026-03-05 21:07:55.664775 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-05 21:07:55.664872 | mon1 | Thursday 05 March 2026 21:07:55 +0000 (0:00:07.325) 0:00:35.607 ******** 2026-03-05 21:08:02.184734 | mon1 | ok: [mon1] 2026-03-05 21:08:02.184810 | mon1 | 2026-03-05 21:08:02.184995 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-05 21:08:02.185041 | mon1 | Thursday 05 March 2026 21:08:02 +0000 (0:00:06.520) 0:00:42.127 ******** 2026-03-05 21:08:16.523009 | mon1 | ok: [mon1] 2026-03-05 21:08:16.523078 | mon1 | 2026-03-05 21:08:16.523139 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:08:16.523291 | mon1 | Thursday 05 March 2026 21:08:16 +0000 (0:00:14.338) 0:00:56.465 ******** 2026-03-05 21:08:16.605057 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-05 21:08:16.605127 | mon1 | 2026-03-05 21:08:16.605365 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:08:16.605410 | mon1 | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.082) 0:00:56.548 ******** 2026-03-05 21:08:16.657087 | mon1 | skipping: [mon1] 2026-03-05 21:08:16.657161 | mon1 | 2026-03-05 21:08:16.657223 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:08:16.657337 | mon1 | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.052) 0:00:56.600 ******** 2026-03-05 21:08:16.697829 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-05 21:08:16.697950 | mon1 | skipping: [mon1] 2026-03-05 21:08:16.698305 | mon1 | 2026-03-05 21:08:16.698350 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:08:16.698357 | mon1 | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.040) 0:00:56.640 ******** 2026-03-05 21:08:16.943452 | mon1 | ok: [mon1] 2026-03-05 21:08:16.943526 | mon1 | 2026-03-05 21:08:16.943582 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:08:16.943710 | mon1 | Thursday 05 March 2026 21:08:16 +0000 (0:00:00.245) 0:00:56.886 ******** 2026-03-05 21:08:24.033360 | mon1 | ok: [mon1] 2026-03-05 21:08:24.033433 | mon1 | 2026-03-05 21:08:24.033513 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-05 21:08:24.033641 | mon1 | Thursday 05 March 2026 21:08:24 +0000 (0:00:07.089) 0:01:03.976 ******** 2026-03-05 21:08:30.192520 | mon1 | ok: [mon1] 2026-03-05 21:08:30.192598 | mon1 | 2026-03-05 21:08:30.192686 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-05 21:08:30.192794 | mon1 | Thursday 05 March 2026 21:08:30 +0000 (0:00:06.158) 0:01:10.135 ******** 2026-03-05 21:08:36.437113 | mon1 | ok: [mon1] 2026-03-05 21:08:36.437233 | mon1 | 2026-03-05 21:08:36.437454 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-05 21:08:36.437657 | mon1 | Thursday 05 March 2026 21:08:36 +0000 (0:00:06.244) 0:01:16.379 ******** 2026-03-05 21:08:43.968481 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-05 21:08:43.968549 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-05 21:08:43.968562 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-05 21:08:43.968571 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-05 21:08:43.968583 | mon1 | 2026-03-05 21:08:43.968594 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-05 21:08:43.968604 | mon1 | 2026-03-05 21:08:43.968613 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:08:43.968629 | mon1 | Thursday 05 March 2026 21:08:43 +0000 (0:00:07.529) 0:01:23.909 ******** 2026-03-05 21:08:45.055744 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-05 21:08:45.056457 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:08:45.056514 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:08:45.056520 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:08:45.056694 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:08:45.072352 | mon1 | ok: [osd1] 2026-03-05 21:08:45.072448 | mon1 | 2026-03-05 21:08:45.072596 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:08:45.072724 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:01.105) 0:01:25.014 ******** 2026-03-05 21:08:45.283511 | mon1 | ok: [osd1] 2026-03-05 21:08:45.283725 | mon1 | 2026-03-05 21:08:45.284062 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:08:45.284231 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.210) 0:01:25.225 ******** 2026-03-05 21:08:45.323807 | mon1 | skipping: [osd1] 2026-03-05 21:08:45.323888 | mon1 | 2026-03-05 21:08:45.323990 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-05 21:08:45.324087 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.041) 0:01:25.266 ******** 2026-03-05 21:08:45.525475 | mon1 | ok: [osd1] 2026-03-05 21:08:45.525514 | mon1 | 2026-03-05 21:08:45.525722 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:08:45.525769 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.201) 0:01:25.468 ******** 2026-03-05 21:08:45.598820 | mon1 | ok: [osd1] => { 2026-03-05 21:08:45.598891 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-05 21:08:45.599269 | mon1 | } 2026-03-05 21:08:45.599314 | mon1 | 2026-03-05 21:08:45.599319 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:08:45.599324 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.073) 0:01:25.541 ******** 2026-03-05 21:08:45.927093 | mon1 | ok: [osd1] 2026-03-05 21:08:45.927148 | mon1 | 2026-03-05 21:08:45.927348 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:08:45.927419 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.328) 0:01:25.869 ******** 2026-03-05 21:08:45.970316 | mon1 | skipping: [osd1] 2026-03-05 21:08:45.970355 | mon1 | 2026-03-05 21:08:45.970570 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:08:45.970597 | mon1 | Thursday 05 March 2026 21:08:45 +0000 (0:00:00.043) 0:01:25.913 ******** 2026-03-05 21:08:46.011660 | mon1 | skipping: [osd1] 2026-03-05 21:08:46.011710 | mon1 | 2026-03-05 21:08:46.011922 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:08:46.011942 | mon1 | Thursday 05 March 2026 21:08:46 +0000 (0:00:00.041) 0:01:25.954 ******** 2026-03-05 21:08:46.212974 | mon1 | ok: [osd1] 2026-03-05 21:08:46.213044 | mon1 | 2026-03-05 21:08:46.213275 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-05 21:08:46.213323 | mon1 | Thursday 05 March 2026 21:08:46 +0000 (0:00:00.201) 0:01:26.155 ******** 2026-03-05 21:08:47.381018 | mon1 | ok: [osd1] 2026-03-05 21:08:47.381068 | mon1 | 2026-03-05 21:08:47.381174 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:08:47.381312 | mon1 | Thursday 05 March 2026 21:08:47 +0000 (0:00:01.168) 0:01:27.323 ******** 2026-03-05 21:08:47.462997 | mon1 | ok: [osd1] => { 2026-03-05 21:08:47.463677 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-05 21:08:47.463706 | mon1 | } 2026-03-05 21:08:47.463714 | mon1 | 2026-03-05 21:08:47.463721 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:08:47.463728 | mon1 | Thursday 05 March 2026 21:08:47 +0000 (0:00:00.081) 0:01:27.405 ******** 2026-03-05 21:08:47.805184 | mon1 | ok: [osd1] 2026-03-05 21:08:47.805511 | mon1 | 2026-03-05 21:08:47.805784 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:08:47.806041 | mon1 | Thursday 05 March 2026 21:08:47 +0000 (0:00:00.341) 0:01:27.747 ******** 2026-03-05 21:08:49.732415 | mon1 | ok: [osd1] 2026-03-05 21:08:49.732493 | mon1 | 2026-03-05 21:08:49.732514 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-05 21:08:49.732638 | mon1 | Thursday 05 March 2026 21:08:49 +0000 (0:00:01.927) 0:01:29.675 ******** 2026-03-05 21:08:49.759611 | mon1 | skipping: [osd1] 2026-03-05 21:08:49.759693 | mon1 | 2026-03-05 21:08:49.759920 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-05 21:08:49.759965 | mon1 | Thursday 05 March 2026 21:08:49 +0000 (0:00:00.027) 0:01:29.702 ******** 2026-03-05 21:08:49.792698 | mon1 | skipping: [osd1] 2026-03-05 21:08:49.792779 | mon1 | 2026-03-05 21:08:49.792866 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-05 21:08:49.792962 | mon1 | Thursday 05 March 2026 21:08:49 +0000 (0:00:00.032) 0:01:29.735 ******** 2026-03-05 21:08:49.819570 | mon1 | skipping: [osd1] 2026-03-05 21:08:49.819756 | mon1 | 2026-03-05 21:08:49.819967 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-05 21:08:49.820170 | mon1 | Thursday 05 March 2026 21:08:49 +0000 (0:00:00.027) 0:01:29.762 ******** 2026-03-05 21:08:50.994349 | mon1 | ok: [osd1] 2026-03-05 21:08:50.994522 | mon1 | 2026-03-05 21:08:50.994796 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-05 21:08:50.995007 | mon1 | Thursday 05 March 2026 21:08:50 +0000 (0:00:01.174) 0:01:30.936 ******** 2026-03-05 21:08:51.425360 | mon1 | ok: [osd1] 2026-03-05 21:08:51.425691 | mon1 | 2026-03-05 21:08:51.425908 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-05 21:08:51.426119 | mon1 | Thursday 05 March 2026 21:08:51 +0000 (0:00:00.431) 0:01:31.367 ******** 2026-03-05 21:08:52.365013 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-05 21:08:52.365183 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-05 21:08:52.365199 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-05 21:08:52.365210 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-05 21:08:52.365219 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-05 21:08:52.365230 | mon1 | 2026-03-05 21:08:52.365240 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-05 21:08:52.365249 | mon1 | Thursday 05 March 2026 21:08:52 +0000 (0:00:00.936) 0:01:32.304 ******** 2026-03-05 21:08:52.835476 | mon1 | ok: [osd1] 2026-03-05 21:08:52.835597 | mon1 | 2026-03-05 21:08:52.835609 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-05 21:08:52.835676 | mon1 | Thursday 05 March 2026 21:08:52 +0000 (0:00:00.467) 0:01:32.772 ******** 2026-03-05 21:08:52.835981 | mon1 | 2026-03-05 21:08:52.836038 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-05 21:08:52.836045 | mon1 | Thursday 05 March 2026 21:08:52 +0000 (0:00:00.006) 0:01:32.778 ******** 2026-03-05 21:08:53.208436 | mon1 | ok: [osd1] 2026-03-05 21:08:53.208520 | mon1 | 2026-03-05 21:08:53.208533 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-05 21:08:53.208651 | mon1 | Thursday 05 March 2026 21:08:53 +0000 (0:00:00.372) 0:01:33.151 ******** 2026-03-05 21:08:53.414680 | mon1 | ok: [osd1] 2026-03-05 21:08:53.414728 | mon1 | 2026-03-05 21:08:53.414988 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-05 21:08:53.415071 | mon1 | Thursday 05 March 2026 21:08:53 +0000 (0:00:00.205) 0:01:33.357 ******** 2026-03-05 21:08:53.482921 | mon1 | ok: [osd1] => { 2026-03-05 21:08:53.483063 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-05 21:08:53.483239 | mon1 | } 2026-03-05 21:08:53.483356 | mon1 | 2026-03-05 21:08:53.483516 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-05 21:08:53.483641 | mon1 | Thursday 05 March 2026 21:08:53 +0000 (0:00:00.068) 0:01:33.425 ******** 2026-03-05 21:08:53.836463 | mon1 | ok: [osd1] 2026-03-05 21:08:53.836535 | mon1 | 2026-03-05 21:08:53.836547 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-05 21:08:53.836611 | mon1 | Thursday 05 March 2026 21:08:53 +0000 (0:00:00.353) 0:01:33.779 ******** 2026-03-05 21:08:56.897161 | mon1 | ok: [osd1] 2026-03-05 21:08:56.897229 | mon1 | 2026-03-05 21:08:56.897235 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-05 21:08:56.897240 | mon1 | Thursday 05 March 2026 21:08:56 +0000 (0:00:03.060) 0:01:36.839 ******** 2026-03-05 21:08:58.062192 | mon1 | ok: [osd1] 2026-03-05 21:08:58.062249 | mon1 | 2026-03-05 21:08:58.062341 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-05 21:08:58.062438 | mon1 | Thursday 05 March 2026 21:08:58 +0000 (0:00:01.165) 0:01:38.005 ******** 2026-03-05 21:08:58.268151 | mon1 | ok: [osd1] 2026-03-05 21:08:58.268253 | mon1 | 2026-03-05 21:08:58.268266 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-05 21:08:58.268406 | mon1 | Thursday 05 March 2026 21:08:58 +0000 (0:00:00.205) 0:01:38.211 ******** 2026-03-05 21:08:58.698334 | mon1 | ok: [osd1] 2026-03-05 21:08:58.698399 | mon1 | 2026-03-05 21:08:58.698697 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-05 21:08:58.698768 | mon1 | Thursday 05 March 2026 21:08:58 +0000 (0:00:00.429) 0:01:38.640 ******** 2026-03-05 21:08:59.261638 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-05 21:08:59.261763 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-05 21:08:59.261777 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-05 21:08:59.261842 | mon1 | 2026-03-05 21:08:59.262072 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-05 21:08:59.262143 | mon1 | Thursday 05 March 2026 21:08:59 +0000 (0:00:00.563) 0:01:39.204 ******** 2026-03-05 21:08:59.676213 | mon1 | ok: [osd1] 2026-03-05 21:08:59.676270 | mon1 | 2026-03-05 21:08:59.676362 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-05 21:08:59.676513 | mon1 | Thursday 05 March 2026 21:08:59 +0000 (0:00:00.414) 0:01:39.619 ******** 2026-03-05 21:09:00.111021 | mon1 | ok: [osd1] 2026-03-05 21:09:00.111070 | mon1 | 2026-03-05 21:09:00.111143 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-05 21:09:00.111504 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.428) 0:01:40.047 ******** 2026-03-05 21:09:00.111520 | mon1 | 2026-03-05 21:09:00.111525 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-05 21:09:00.111529 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.006) 0:01:40.054 ******** 2026-03-05 21:09:00.466478 | mon1 | ok: [osd1] 2026-03-05 21:09:00.466542 | mon1 | 2026-03-05 21:09:00.466782 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-05 21:09:00.466800 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.355) 0:01:40.409 ******** 2026-03-05 21:09:00.516346 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-05 21:09:00.516777 | mon1 | 2026-03-05 21:09:00.516799 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-05 21:09:00.516806 | mon1 | Thursday 05 March 2026 21:09:00 +0000 (0:00:00.050) 0:01:40.459 ******** 2026-03-05 21:09:01.662766 | mon1 | ok: [osd1] 2026-03-05 21:09:01.662842 | mon1 | 2026-03-05 21:09:01.662902 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-05 21:09:01.663017 | mon1 | Thursday 05 March 2026 21:09:01 +0000 (0:00:01.146) 0:01:41.605 ******** 2026-03-05 21:09:02.328519 | mon1 | ok: [osd1] => (item=chronyd) 2026-03-05 21:09:02.328597 | mon1 | ok: [osd1] => (item=sshd) 2026-03-05 21:09:02.328611 | mon1 | 2026-03-05 21:09:02.328869 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-05 21:09:02.328909 | mon1 | Thursday 05 March 2026 21:09:02 +0000 (0:00:00.665) 0:01:42.271 ******** 2026-03-05 21:09:02.619513 | mon1 | ok: [osd1] 2026-03-05 21:09:02.619554 | mon1 | 2026-03-05 21:09:02.619760 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-05 21:09:02.619810 | mon1 | Thursday 05 March 2026 21:09:02 +0000 (0:00:00.291) 0:01:42.562 ******** 2026-03-05 21:09:02.818747 | mon1 | ok: [osd1] 2026-03-05 21:09:02.818808 | mon1 | 2026-03-05 21:09:02.819087 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-05 21:09:02.819172 | mon1 | Thursday 05 March 2026 21:09:02 +0000 (0:00:00.198) 0:01:42.761 ******** 2026-03-05 21:09:03.054867 | mon1 | ok: [osd1] 2026-03-05 21:09:03.055030 | mon1 | 2026-03-05 21:09:03.055044 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-05 21:09:03.055055 | mon1 | Thursday 05 March 2026 21:09:03 +0000 (0:00:00.236) 0:01:42.997 ******** 2026-03-05 21:09:03.267833 | mon1 | ok: [osd1] 2026-03-05 21:09:03.267949 | mon1 | 2026-03-05 21:09:03.267985 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-05 21:09:03.268051 | mon1 | Thursday 05 March 2026 21:09:03 +0000 (0:00:00.213) 0:01:43.210 ******** 2026-03-05 21:09:03.477361 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-05 21:09:03.477404 | mon1 | 2026-03-05 21:09:03.477410 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-05 21:09:03.477416 | mon1 | Thursday 05 March 2026 21:09:03 +0000 (0:00:00.208) 0:01:43.419 ******** 2026-03-05 21:09:03.521860 | mon1 | ok: [osd1] 2026-03-05 21:09:03.521877 | mon1 | 2026-03-05 21:09:03.521883 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-05 21:09:03.521887 | mon1 | Thursday 05 March 2026 21:09:03 +0000 (0:00:00.044) 0:01:43.464 ******** 2026-03-05 21:09:03.573056 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-05 21:09:03.573116 | mon1 | 2026-03-05 21:09:03.573386 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-05 21:09:03.573443 | mon1 | Thursday 05 March 2026 21:09:03 +0000 (0:00:00.051) 0:01:43.515 ******** 2026-03-05 21:09:09.770617 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:09.770698 | mon1 | 2026-03-05 21:09:09.770966 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-05 21:09:09.771009 | mon1 | Thursday 05 March 2026 21:09:09 +0000 (0:00:06.197) 0:01:49.713 ******** 2026-03-05 21:09:09.821266 | mon1 | ok: [osd1] => (item=osd1) 2026-03-05 21:09:09.821679 | mon1 | 2026-03-05 21:09:09.821728 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-05 21:09:09.821737 | mon1 | Thursday 05 March 2026 21:09:09 +0000 (0:00:00.050) 0:01:49.763 ******** 2026-03-05 21:09:10.077581 | mon1 | ok: [osd1] 2026-03-05 21:09:10.077662 | mon1 | 2026-03-05 21:09:10.077675 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-05 21:09:10.077792 | mon1 | Thursday 05 March 2026 21:09:10 +0000 (0:00:00.256) 0:01:50.020 ******** 2026-03-05 21:09:16.628563 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:16.628648 | mon1 | 2026-03-05 21:09:16.628655 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-05 21:09:16.628660 | mon1 | Thursday 05 March 2026 21:09:16 +0000 (0:00:06.550) 0:01:56.570 ******** 2026-03-05 21:09:21.985413 | mon1 | ok: [osd1] 2026-03-05 21:09:21.985530 | mon1 | 2026-03-05 21:09:21.985539 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-05 21:09:21.985705 | mon1 | Thursday 05 March 2026 21:09:21 +0000 (0:00:05.357) 0:02:01.928 ******** 2026-03-05 21:09:44.465814 | mon1 | ok: [osd1] 2026-03-05 21:09:44.465892 | mon1 | 2026-03-05 21:09:44.465948 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-05 21:09:44.466053 | mon1 | Thursday 05 March 2026 21:09:44 +0000 (0:00:22.480) 0:02:24.408 ******** 2026-03-05 21:09:44.527257 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-05 21:09:44.527343 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-05 21:09:44.527501 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-05 21:09:44.527580 | mon1 | skipping: [osd1] 2026-03-05 21:09:44.527595 | mon1 | 2026-03-05 21:09:44.527866 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-05 21:09:44.527911 | mon1 | Thursday 05 March 2026 21:09:44 +0000 (0:00:00.061) 0:02:24.470 ******** 2026-03-05 21:09:50.759119 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:50.759181 | mon1 | 2026-03-05 21:09:50.759364 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-05 21:09:50.759379 | mon1 | Thursday 05 March 2026 21:09:50 +0000 (0:00:06.231) 0:02:30.702 ******** 2026-03-05 21:09:56.914369 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:09:56.914455 | mon1 | 2026-03-05 21:09:56.914517 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-05 21:09:56.914634 | mon1 | Thursday 05 March 2026 21:09:56 +0000 (0:00:06.155) 0:02:36.857 ******** 2026-03-05 21:09:56.964791 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-05 21:09:56.964835 | mon1 | 2026-03-05 21:09:56.964959 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-05 21:09:56.965080 | mon1 | Thursday 05 March 2026 21:09:56 +0000 (0:00:00.050) 0:02:36.907 ******** 2026-03-05 21:09:57.001767 | mon1 | ok: [osd1] 2026-03-05 21:09:57.001828 | mon1 | 2026-03-05 21:09:57.001929 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-05 21:09:57.002035 | mon1 | Thursday 05 March 2026 21:09:56 +0000 (0:00:00.037) 0:02:36.944 ******** 2026-03-05 21:10:03.140487 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-05 21:10:03.140548 | mon1 | 2026-03-05 21:10:03.140576 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-05 21:10:03.140689 | mon1 | Thursday 05 March 2026 21:10:03 +0000 (0:00:06.138) 0:02:43.083 ******** 2026-03-05 21:10:03.180098 | mon1 | ok: [osd1] 2026-03-05 21:10:03.180182 | mon1 | 2026-03-05 21:10:03.180198 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-05 21:10:03.180333 | mon1 | Thursday 05 March 2026 21:10:03 +0000 (0:00:00.039) 0:02:43.123 ******** 2026-03-05 21:10:03.220427 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:10:03.220534 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:10:03.220998 | mon1 | skipping: [osd1] => (item=1) 2026-03-05 21:10:03.221045 | mon1 | skipping: [osd1] 2026-03-05 21:10:03.221058 | mon1 | 2026-03-05 21:10:03.221068 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-05 21:10:03.221074 | mon1 | Thursday 05 March 2026 21:10:03 +0000 (0:00:00.040) 0:02:43.163 ******** 2026-03-05 21:10:03.250568 | mon1 | skipping: [osd1] 2026-03-05 21:10:03.250606 | mon1 | 2026-03-05 21:10:03.250688 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:10:03.250838 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:10:03.250907 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-05 21:10:03.252589 | mon1 | 2026-03-05 21:10:03.252656 | mon1 | 2026-03-05 21:10:03.252668 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:10:03.252679 | mon1 | Thursday 05 March 2026 21:10:03 +0000 (0:00:00.030) 0:02:43.193 ******** 2026-03-05 21:10:03.252699 | mon1 | =============================================================================== 2026-03-05 21:10:03.252709 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.48s 2026-03-05 21:10:03.252719 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.34s 2026-03-05 21:10:03.252728 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.53s 2026-03-05 21:10:03.252738 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.33s 2026-03-05 21:10:03.252747 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.30s 2026-03-05 21:10:03.252757 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.09s 2026-03-05 21:10:03.252766 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.55s 2026-03-05 21:10:03.252777 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.52s 2026-03-05 21:10:03.252787 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.24s 2026-03-05 21:10:03.252798 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.23s 2026-03-05 21:10:03.252807 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.20s 2026-03-05 21:10:03.252817 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.16s 2026-03-05 21:10:03.252826 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.16s 2026-03-05 21:10:03.252836 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.14s 2026-03-05 21:10:03.252852 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.36s 2026-03-05 21:10:03.252862 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s 2026-03-05 21:10:03.252872 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s 2026-03-05 21:10:03.252884 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.16s 2026-03-05 21:10:03.253069 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.93s 2026-03-05 21:10:03.253086 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.20s 2026-03-05 21:10:03.341635 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-05 21:10:03.351766 | mon1 | INFO [default > side_effect] Executing 2026-03-05 21:10:03.352093 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:10:03.357116 | mon1 | INFO [default > verify] Executing 2026-03-05 21:10:03.988105 | mon1 | 2026-03-05 21:10:03.988459 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-05 21:10:03.988709 | mon1 | 2026-03-05 21:10:03.988965 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-05 21:10:03.989223 | mon1 | Thursday 05 March 2026 21:10:03 +0000 (0:00:00.006) 0:00:00.006 ******** 2026-03-05 21:10:05.108046 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-05 21:10:05.108112 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-05 21:10:05.108124 | mon1 | interpreter could change the meaning of that path. See 2026-03-05 21:10:05.108134 | mon1 | https://docs.ansible.com/ansible- 2026-03-05 21:10:05.108144 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-05 21:10:05.118107 | mon1 | ok: [mon1] 2026-03-05 21:10:05.118144 | mon1 | 2026-03-05 21:10:05.118155 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-05 21:10:05.118165 | mon1 | Thursday 05 March 2026 21:10:05 +0000 (0:00:01.129) 0:00:01.136 ******** 2026-03-05 21:10:15.368503 | mon1 | ok: [mon1] 2026-03-05 21:10:15.368565 | mon1 | 2026-03-05 21:10:15.368760 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-05 21:10:15.369051 | mon1 | Thursday 05 March 2026 21:10:15 +0000 (0:00:10.250) 0:00:11.386 ******** 2026-03-05 21:10:15.397231 | mon1 | ok: [mon1] => { 2026-03-05 21:10:15.397434 | mon1 | "_ceph_health": { 2026-03-05 21:10:15.397691 | mon1 | "changed": false, 2026-03-05 21:10:15.397943 | mon1 | "cmd": [ 2026-03-05 21:10:15.398147 | mon1 | "cephadm", 2026-03-05 21:10:15.398340 | mon1 | "shell", 2026-03-05 21:10:15.398529 | mon1 | "--", 2026-03-05 21:10:15.398719 | mon1 | "ceph", 2026-03-05 21:10:15.398905 | mon1 | "health" 2026-03-05 21:10:15.399086 | mon1 | ], 2026-03-05 21:10:15.399280 | mon1 | "delta": "0:00:09.953647", 2026-03-05 21:10:15.399473 | mon1 | "end": "2026-03-05 21:10:15.331686", 2026-03-05 21:10:15.399660 | mon1 | "failed": false, 2026-03-05 21:10:15.399846 | mon1 | "msg": "", 2026-03-05 21:10:15.400107 | mon1 | "rc": 0, 2026-03-05 21:10:15.400306 | mon1 | "start": "2026-03-05 21:10:05.378039", 2026-03-05 21:10:15.400564 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-05 21:10:15.400757 | mon1 | "stderr_lines": [ 2026-03-05 21:10:15.400956 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-05 21:10:15.401168 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-05 21:10:15.401356 | mon1 | ], 2026-03-05 21:10:15.401611 | mon1 | "stdout": "HEALTH_OK", 2026-03-05 21:10:15.401869 | mon1 | "stdout_lines": [ 2026-03-05 21:10:15.402069 | mon1 | "HEALTH_OK" 2026-03-05 21:10:15.402258 | mon1 | ] 2026-03-05 21:10:15.402447 | mon1 | } 2026-03-05 21:10:15.402637 | mon1 | } 2026-03-05 21:10:15.402865 | mon1 | 2026-03-05 21:10:15.403079 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-05 21:10:15.403275 | mon1 | Thursday 05 March 2026 21:10:15 +0000 (0:00:00.029) 0:00:11.415 ******** 2026-03-05 21:10:15.423474 | mon1 | ok: [mon1] => { 2026-03-05 21:10:15.423720 | mon1 | "changed": false, 2026-03-05 21:10:15.423979 | mon1 | "msg": "All assertions passed" 2026-03-05 21:10:15.424287 | mon1 | } 2026-03-05 21:10:15.424572 | mon1 | 2026-03-05 21:10:15.424837 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-05 21:10:15.425102 | mon1 | Thursday 05 March 2026 21:10:15 +0000 (0:00:00.026) 0:00:11.441 ******** 2026-03-05 21:10:22.279701 | mon1 | changed: [mon1] 2026-03-05 21:10:22.279849 | mon1 | 2026-03-05 21:10:22.280058 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-05 21:10:22.280263 | mon1 | Thursday 05 March 2026 21:10:22 +0000 (0:00:06.855) 0:00:18.297 ******** 2026-03-05 21:10:24.606808 | mon1 | changed: [mon1] 2026-03-05 21:10:24.606865 | mon1 | 2026-03-05 21:10:24.606872 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-05 21:10:24.606879 | mon1 | Thursday 05 March 2026 21:10:24 +0000 (0:00:02.326) 0:00:20.624 ******** 2026-03-05 21:10:25.798208 | mon1 | ok: [mon1] 2026-03-05 21:10:25.798296 | mon1 | 2026-03-05 21:10:25.798327 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-05 21:10:25.798460 | mon1 | Thursday 05 March 2026 21:10:25 +0000 (0:00:01.192) 0:00:21.816 ******** 2026-03-05 21:10:25.828719 | mon1 | ok: [mon1] => { 2026-03-05 21:10:25.828904 | mon1 | "changed": false, 2026-03-05 21:10:25.828956 | mon1 | "msg": "All assertions passed" 2026-03-05 21:10:25.830464 | mon1 | } 2026-03-05 21:10:25.830513 | mon1 | 2026-03-05 21:10:25.830520 | mon1 | PLAY RECAP ********************************************************************* 2026-03-05 21:10:25.830527 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-05 21:10:25.830531 | mon1 | 2026-03-05 21:10:25.830536 | mon1 | 2026-03-05 21:10:25.830541 | mon1 | TASKS RECAP ******************************************************************** 2026-03-05 21:10:25.830546 | mon1 | Thursday 05 March 2026 21:10:25 +0000 (0:00:00.030) 0:00:21.847 ******** 2026-03-05 21:10:25.830550 | mon1 | =============================================================================== 2026-03-05 21:10:25.830554 | mon1 | Get cluster health status ---------------------------------------------- 10.25s 2026-03-05 21:10:25.830558 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.86s 2026-03-05 21:10:25.830563 | mon1 | Create a test Ceph key -------------------------------------------------- 2.33s 2026-03-05 21:10:25.830567 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.19s 2026-03-05 21:10:25.830571 | mon1 | Gathering Facts --------------------------------------------------------- 1.13s 2026-03-05 21:10:25.830575 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.03s 2026-03-05 21:10:25.830579 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-05 21:10:25.830583 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-05 21:10:25.896458 | mon1 | INFO [default > verify] Executed: Successful 2026-03-05 21:10:25.902089 | mon1 | INFO [default > cleanup] Executing 2026-03-05 21:10:25.902413 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-05 21:10:25.908223 | mon1 | INFO [default > destroy] Executing 2026-03-05 21:10:25.908285 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-05 21:10:25.908366 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-05 21:10:25.908671 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-05 21:10:36.321192 | mon1 | ok: Runtime: 0:12:01.697983 2026-03-05 21:10:36.334088 | 2026-03-05 21:10:36.334191 | PLAY RECAP 2026-03-05 21:10:36.334237 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-05 21:10:36.334258 | 2026-03-05 21:10:36.445623 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-05 21:10:36.451242 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:10:37.010771 | 2026-03-05 21:10:37.010984 | PLAY [all] 2026-03-05 21:10:37.027305 | 2026-03-05 21:10:37.027415 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-05 21:10:37.070150 | mon1 | ok 2026-03-05 21:10:37.088303 | osd1 | ok 2026-03-05 21:10:37.093267 | 2026-03-05 21:10:37.093345 | TASK [fetch-output : Set log path for single node] 2026-03-05 21:10:37.114822 | mon1 | skipping: Conditional result was False 2026-03-05 21:10:37.136041 | osd1 | skipping: Conditional result was False 2026-03-05 21:10:37.146116 | 2026-03-05 21:10:37.146268 | LOOP [fetch-output : Ensure local output dirs] 2026-03-05 21:10:37.491097 | mon1 -> localhost | changed: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/logs/mon1" 2026-03-05 21:10:37.496286 | osd1 -> localhost | changed: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/logs/osd1" 2026-03-05 21:10:37.692914 | mon1 -> localhost | changed: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/artifacts" 2026-03-05 21:10:37.703372 | osd1 -> localhost | ok: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/artifacts" 2026-03-05 21:10:37.916162 | osd1 -> localhost | changed: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/docs" 2026-03-05 21:10:37.931390 | mon1 -> localhost | ok: "/var/lib/zuul/builds/b0d23fa0bf2942d780020d232882c87c/work/docs" 2026-03-05 21:10:37.931509 | mon1 -> localhost | changed: All items complete 2026-03-05 21:10:37.931567 | 2026-03-05 21:10:37.951395 | 2026-03-05 21:10:37.951585 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-05 21:10:38.621362 | mon1 | changed: .d..t...... ./ 2026-03-05 21:10:38.626858 | osd1 | changed: .d..t...... ./ 2026-03-05 21:10:39.058729 | osd1 | changed: .d..t...... ./ 2026-03-05 21:10:39.063124 | mon1 | ok 2026-03-05 21:10:39.501327 | osd1 | changed: .d..t...... ./ 2026-03-05 21:10:39.528553 | mon1 | ok 2026-03-05 21:10:39.528685 | mon1 | changed: All items complete 2026-03-05 21:10:39.528720 | 2026-03-05 21:10:39.556330 | 2026-03-05 21:10:39.556404 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-05 21:10:39.966679 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006748 2026-03-05 21:10:40.171127 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007331 2026-03-05 21:10:40.195660 | 2026-03-05 21:10:40.195717 | PLAY [all] 2026-03-05 21:10:40.201385 | 2026-03-05 21:10:40.201448 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-05 21:10:40.638644 | mon1 | changed 2026-03-05 21:10:40.834479 | osd1 | changed 2026-03-05 21:10:40.844764 | 2026-03-05 21:10:40.844814 | PLAY RECAP 2026-03-05 21:10:40.844903 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:10:40.844988 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-05 21:10:40.845014 | 2026-03-05 21:10:40.942635 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-05 21:10:40.946155 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-05 21:10:41.520315 | 2026-03-05 21:10:41.520481 | PLAY [localhost] 2026-03-05 21:10:41.530685 | 2026-03-05 21:10:41.530762 | TASK [Generate Zuul manifest] 2026-03-05 21:10:41.555764 | localhost | ok 2026-03-05 21:10:41.570055 | 2026-03-05 21:10:41.570195 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-05 21:10:41.886184 | localhost | changed 2026-03-05 21:10:41.897319 | 2026-03-05 21:10:41.897441 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-05 21:10:41.928652 | localhost | ok 2026-03-05 21:10:41.946078 | 2026-03-05 21:10:41.946278 | TASK [Upload logs] 2026-03-05 21:10:41.966606 | localhost | ok 2026-03-05 21:10:42.029638 | 2026-03-05 21:10:42.029819 | TASK [Set zuul-log-path fact] 2026-03-05 21:10:42.049476 | localhost | ok 2026-03-05 21:10:42.060786 | 2026-03-05 21:10:42.060891 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-05 21:10:42.094101 | localhost | ok 2026-03-05 21:10:42.103129 | 2026-03-05 21:10:42.103239 | TASK [upload-logs : Create log directories] 2026-03-05 21:10:42.530545 | localhost | changed 2026-03-05 21:10:42.537181 | 2026-03-05 21:10:42.537261 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-05 21:10:42.935003 | localhost -> localhost | ok: Runtime: 0:00:00.005062 2026-03-05 21:10:42.941739 | 2026-03-05 21:10:42.941812 | TASK [upload-logs : Upload logs to log server] 2026-03-05 21:10:43.388385 | localhost | Output suppressed because no_log was given 2026-03-05 21:10:43.393230 | 2026-03-05 21:10:43.393323 | LOOP [upload-logs : Compress console log and json output] 2026-03-05 21:10:43.437082 | localhost | skipping: Conditional result was False 2026-03-05 21:10:43.445051 | localhost | skipping: Conditional result was False 2026-03-05 21:10:43.456591 | 2026-03-05 21:10:43.456813 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-05 21:10:43.503457 | localhost | skipping: Conditional result was False 2026-03-05 21:10:43.503843 | 2026-03-05 21:10:43.507549 | localhost | skipping: Conditional result was False 2026-03-05 21:10:43.523130 | 2026-03-05 21:10:43.523337 | LOOP [upload-logs : Upload console log and json output]