2026-03-06 01:19:16.519137 | Job console starting 2026-03-06 01:19:16.561325 | Updating git repos 2026-03-06 01:19:16.592171 | Cloning repos into workspace 2026-03-06 01:19:16.747701 | Restoring repo states 2026-03-06 01:19:16.755355 | Merging changes 2026-03-06 01:19:17.011139 | Checking out repos 2026-03-06 01:19:17.047871 | Preparing playbooks 2026-03-06 01:19:18.364840 | Running Ansible setup 2026-03-06 01:19:23.931490 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-06 01:19:24.513420 | 2026-03-06 01:19:24.513549 | PLAY [localhost] 2026-03-06 01:19:24.521435 | 2026-03-06 01:19:24.521505 | TASK [Gathering Facts] 2026-03-06 01:19:25.409161 | localhost | ok 2026-03-06 01:19:25.422639 | 2026-03-06 01:19:25.422752 | TASK [Setup log path fact] 2026-03-06 01:19:25.440768 | localhost | ok 2026-03-06 01:19:25.454695 | 2026-03-06 01:19:25.454789 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-06 01:19:25.484656 | localhost | ok 2026-03-06 01:19:25.492846 | 2026-03-06 01:19:25.492913 | TASK [emit-job-header : Print job information] 2026-03-06 01:19:25.519510 | # Job Information 2026-03-06 01:19:25.519647 | Ansible Version: 2.16.16 2026-03-06 01:19:25.519679 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-06 01:19:25.519701 | Pipeline: check 2026-03-06 01:19:25.519721 | Executor: 0a8996d2b663 2026-03-06 01:19:25.519740 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96 2026-03-06 01:19:25.519763 | Event ID: 61bdb7f0-18fa-11f1-8961-149ac14c4b20 2026-03-06 01:19:25.523300 | 2026-03-06 01:19:25.523368 | LOOP [emit-job-header : Print node information] 2026-03-06 01:19:25.609087 | localhost | ok: 2026-03-06 01:19:25.609291 | localhost | # Node Information 2026-03-06 01:19:25.609321 | localhost | Inventory Hostname: mon1 2026-03-06 01:19:25.609344 | localhost | Hostname: np0000158008 2026-03-06 01:19:25.609364 | localhost | Username: zuul 2026-03-06 01:19:25.609386 | localhost | Distro: Ubuntu 24.04 2026-03-06 01:19:25.609406 | localhost | Provider: yul1 2026-03-06 01:19:25.609425 | localhost | Region: ca-ymq-1 2026-03-06 01:19:25.609444 | localhost | Label: ubuntu-noble 2026-03-06 01:19:25.609463 | localhost | Product Name: OpenStack Nova 2026-03-06 01:19:25.609481 | localhost | Interface IP: 162.253.55.12 2026-03-06 01:19:25.660522 | localhost | ok: 2026-03-06 01:19:25.660654 | localhost | # Node Information 2026-03-06 01:19:25.660690 | localhost | Inventory Hostname: osd1 2026-03-06 01:19:25.660720 | localhost | Hostname: np0000158009 2026-03-06 01:19:25.660748 | localhost | Username: zuul 2026-03-06 01:19:25.660774 | localhost | Distro: Ubuntu 24.04 2026-03-06 01:19:25.660801 | localhost | Provider: yul1 2026-03-06 01:19:25.660828 | localhost | Region: ca-ymq-1 2026-03-06 01:19:25.660853 | localhost | Label: ubuntu-noble 2026-03-06 01:19:25.660876 | localhost | Product Name: OpenStack Nova 2026-03-06 01:19:25.660900 | localhost | Interface IP: 199.204.45.157 2026-03-06 01:19:25.674644 | 2026-03-06 01:19:25.674753 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-06 01:19:26.096614 | localhost -> localhost | changed 2026-03-06 01:19:26.101069 | 2026-03-06 01:19:26.101133 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-06 01:19:26.883053 | localhost -> localhost | changed 2026-03-06 01:19:26.891258 | 2026-03-06 01:19:26.891317 | PLAY [all] 2026-03-06 01:19:26.902648 | 2026-03-06 01:19:26.902721 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-06 01:19:27.129741 | mon1 -> localhost | ok 2026-03-06 01:19:27.142175 | 2026-03-06 01:19:27.142306 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-06 01:19:27.185566 | mon1 | ok 2026-03-06 01:19:27.190627 | osd1 | ok 2026-03-06 01:19:27.212223 | mon1 | included: /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-06 01:19:27.212375 | osd1 | included: /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-06 01:19:27.219613 | 2026-03-06 01:19:27.219709 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-06 01:19:27.944637 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-06 01:19:27.944826 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/2fb4a734d9e44f6893221c8742284768_id_rsa 2026-03-06 01:19:27.944941 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/2fb4a734d9e44f6893221c8742284768_id_rsa.pub 2026-03-06 01:19:27.944988 | mon1 -> localhost | The key fingerprint is: 2026-03-06 01:19:27.945014 | mon1 -> localhost | SHA256:pz+AQCfIH8F2Pm35RuMB110dOQUC4mq9Jk10tvLA8Xs zuul-build-sshkey 2026-03-06 01:19:27.945036 | mon1 -> localhost | The key's randomart image is: 2026-03-06 01:19:27.945063 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-06 01:19:27.945091 | mon1 -> localhost | | . o.. . .o...+B| 2026-03-06 01:19:27.945116 | mon1 -> localhost | | o * o.... ...o.| 2026-03-06 01:19:27.945136 | mon1 -> localhost | | + * .++o .| 2026-03-06 01:19:27.945156 | mon1 -> localhost | | o o=+=+. | 2026-03-06 01:19:27.945176 | mon1 -> localhost | | .o+S++o | 2026-03-06 01:19:27.945195 | mon1 -> localhost | | ..o.B+. | 2026-03-06 01:19:27.945214 | mon1 -> localhost | | . =oo E | 2026-03-06 01:19:27.945233 | mon1 -> localhost | | o ... | 2026-03-06 01:19:27.945252 | mon1 -> localhost | | .. | 2026-03-06 01:19:27.945271 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-06 01:19:27.945319 | mon1 -> localhost | ok: Runtime: 0:00:00.263662 2026-03-06 01:19:27.951646 | 2026-03-06 01:19:27.951712 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-06 01:19:27.979917 | mon1 | ok 2026-03-06 01:19:27.989727 | osd1 | ok 2026-03-06 01:19:28.004269 | mon1 | included: /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-06 01:19:28.004352 | osd1 | included: /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-06 01:19:28.015688 | 2026-03-06 01:19:28.015792 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-06 01:19:28.039887 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:28.051208 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:28.062242 | 2026-03-06 01:19:28.062376 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-06 01:19:28.636682 | osd1 | changed 2026-03-06 01:19:28.667318 | mon1 | changed 2026-03-06 01:19:28.672773 | 2026-03-06 01:19:28.672831 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-06 01:19:28.909085 | osd1 | ok 2026-03-06 01:19:28.914004 | mon1 | ok 2026-03-06 01:19:28.919734 | 2026-03-06 01:19:28.919796 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-06 01:19:29.484942 | mon1 | changed 2026-03-06 01:19:29.522781 | osd1 | changed 2026-03-06 01:19:29.527959 | 2026-03-06 01:19:29.528056 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-06 01:19:30.129228 | osd1 | changed 2026-03-06 01:19:30.134154 | mon1 | changed 2026-03-06 01:19:30.139451 | 2026-03-06 01:19:30.139512 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-06 01:19:30.164345 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:30.175613 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:30.185529 | 2026-03-06 01:19:30.185594 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-06 01:19:30.515653 | mon1 -> localhost | changed 2026-03-06 01:19:30.537284 | 2026-03-06 01:19:30.537558 | TASK [add-build-sshkey : Add back temp key] 2026-03-06 01:19:30.807041 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/2fb4a734d9e44f6893221c8742284768_id_rsa (zuul-build-sshkey) 2026-03-06 01:19:30.807228 | mon1 -> localhost | ok: Runtime: 0:00:00.014716 2026-03-06 01:19:30.812452 | 2026-03-06 01:19:30.812522 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-06 01:19:31.103191 | osd1 | ok 2026-03-06 01:19:31.121570 | mon1 | ok 2026-03-06 01:19:31.129126 | 2026-03-06 01:19:31.129222 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-06 01:19:31.160813 | mon1 | skipping: Conditional result was False 2026-03-06 01:19:31.172462 | osd1 | skipping: Conditional result was False 2026-03-06 01:19:31.197011 | 2026-03-06 01:19:31.197194 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-06 01:19:31.539430 | mon1 | ok 2026-03-06 01:19:31.544088 | osd1 | ok 2026-03-06 01:19:31.549920 | 2026-03-06 01:19:31.549984 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-06 01:19:32.268249 | mon1 | Output suppressed because no_log was given 2026-03-06 01:19:32.289070 | osd1 | Output suppressed because no_log was given 2026-03-06 01:19:32.306835 | 2026-03-06 01:19:32.306954 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-06 01:19:32.547184 | osd1 | ok: "logs" 2026-03-06 01:19:32.547474 | osd1 | ok: All items complete 2026-03-06 01:19:32.547520 | 2026-03-06 01:19:32.554611 | mon1 | ok: "logs" 2026-03-06 01:19:32.749649 | mon1 | ok: "artifacts" 2026-03-06 01:19:32.769466 | osd1 | ok: "artifacts" 2026-03-06 01:19:32.939549 | mon1 | ok: "docs" 2026-03-06 01:19:32.988639 | osd1 | ok: "docs" 2026-03-06 01:19:33.006103 | 2026-03-06 01:19:33.006252 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-06 01:19:33.247160 | osd1 | changed: "logs" 2026-03-06 01:19:33.247434 | osd1 | ok: All items complete 2026-03-06 01:19:33.247470 | 2026-03-06 01:19:33.255709 | mon1 | changed: "logs" 2026-03-06 01:19:33.452427 | osd1 | changed: "artifacts" 2026-03-06 01:19:33.457570 | mon1 | changed: "artifacts" 2026-03-06 01:19:33.648912 | osd1 | changed: "docs" 2026-03-06 01:19:33.717568 | mon1 | changed: "docs" 2026-03-06 01:19:33.742285 | 2026-03-06 01:19:33.742332 | PLAY RECAP 2026-03-06 01:19:33.742374 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:33.742403 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-06 01:19:33.742427 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-06 01:19:33.742446 | 2026-03-06 01:19:33.852547 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-06 01:19:33.857931 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-06 01:19:34.455293 | 2026-03-06 01:19:34.455437 | PLAY [all] 2026-03-06 01:19:34.467454 | 2026-03-06 01:19:34.467532 | TASK [setup-uv : Extract archive] 2026-03-06 01:19:36.901107 | osd1 | changed 2026-03-06 01:19:36.982444 | mon1 | changed 2026-03-06 01:19:36.988402 | 2026-03-06 01:19:36.988485 | TASK [setup-uv : Print version] 2026-03-06 01:19:37.270555 | mon1 | uv 0.8.13 2026-03-06 01:19:36.607938 | osd1 | uv 0.8.13 2026-03-06 01:19:37.564492 | mon1 | ok: Runtime: 0:00:00.015831 2026-03-06 01:19:37.574408 | osd1 | ok: Runtime: 0:00:00.012599 2026-03-06 01:19:37.584781 | 2026-03-06 01:19:37.584826 | PLAY RECAP 2026-03-06 01:19:37.584867 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:37.584894 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:19:37.584913 | 2026-03-06 01:19:37.693208 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-06 01:19:37.698436 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-06 01:19:38.250984 | 2026-03-06 01:19:38.443089 | PLAY [all] 2026-03-06 01:19:38.463779 | 2026-03-06 01:19:38.464050 | TASK [Copy inventory file for Zuul] 2026-03-06 01:19:39.430753 | mon1 | changed 2026-03-06 01:19:39.437575 | 2026-03-06 01:19:39.437651 | TASK [Switch "ansible_host" to private IP] 2026-03-06 01:19:39.776260 | mon1 | changed: 2 replacements made 2026-03-06 01:19:39.783540 | 2026-03-06 01:19:39.783603 | TASK [Run Molecule scenario] 2026-03-06 01:19:40.188139 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-06 01:19:40.188244 | mon1 | Creating virtual environment at: .venv 2026-03-06 01:19:40.818733 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-06 01:19:40.819399 | mon1 | Downloading cryptography (4.3MiB) 2026-03-06 01:19:40.819927 | mon1 | Downloading netaddr (2.2MiB) 2026-03-06 01:19:40.821404 | mon1 | Downloading pygments (1.2MiB) 2026-03-06 01:19:41.107475 | mon1 | Downloading netaddr 2026-03-06 01:19:41.126517 | mon1 | Downloading cryptography 2026-03-06 01:19:41.181890 | mon1 | Downloading pygments 2026-03-06 01:19:41.415467 | mon1 | Downloading ansible-core 2026-03-06 01:19:41.473223 | mon1 | Installed 37 packages in 56ms 2026-03-06 01:19:42.250142 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-06 01:19:42.250248 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-06 01:19:42.961269 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-06 01:19:42.962114 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-06 01:19:56.454494 | mon1 | INFO [default > dependency] Executing 2026-03-06 01:19:56.454749 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-06 01:19:56.454981 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-06 01:19:56.455137 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-06 01:19:56.461058 | mon1 | INFO [default > cleanup] Executing 2026-03-06 01:19:56.461426 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:19:56.467288 | mon1 | INFO [default > destroy] Executing 2026-03-06 01:19:56.467386 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-06 01:19:56.467479 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-06 01:19:56.473341 | mon1 | INFO [default > syntax] Executing 2026-03-06 01:19:57.561235 | mon1 | 2026-03-06 01:19:57.561359 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-06 01:19:57.611713 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-06 01:19:57.621164 | mon1 | INFO [default > create] Executing 2026-03-06 01:19:57.643025 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:19:57.652500 | mon1 | INFO [default > prepare] Executing 2026-03-06 01:19:58.476180 | mon1 | 2026-03-06 01:19:58.476396 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-06 01:19:58.476659 | mon1 | 2026-03-06 01:19:58.476916 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:19:58.477164 | mon1 | Friday 06 March 2026 01:19:58 +0000 (0:00:00.039) 0:00:00.039 ********** 2026-03-06 01:19:59.708004 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:19:59.708212 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:19:59.708461 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:19:59.708691 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:19:59.708871 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:20:00.800467 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:20:00.800730 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:20:00.800996 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:20:00.801241 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:20:00.801485 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:20:00.811153 | mon1 | ok: [mon1] 2026-03-06 01:20:00.811384 | mon1 | ok: [osd1] 2026-03-06 01:20:00.811620 | mon1 | 2026-03-06 01:20:00.811888 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-06 01:20:00.812146 | mon1 | Friday 06 March 2026 01:20:00 +0000 (0:00:02.334) 0:00:02.374 ********** 2026-03-06 01:20:01.664716 | mon1 | changed: [osd1] 2026-03-06 01:20:01.664977 | mon1 | changed: [mon1] 2026-03-06 01:20:01.665214 | mon1 | 2026-03-06 01:20:01.665475 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-06 01:20:01.665771 | mon1 | Friday 06 March 2026 01:20:01 +0000 (0:00:00.853) 0:00:03.227 ********** 2026-03-06 01:20:02.002145 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-06 01:20:02.002500 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-06 01:20:02.002858 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-06 01:20:02.034338 | mon1 | changed: [osd1] 2026-03-06 01:20:02.034559 | mon1 | changed: [mon1] 2026-03-06 01:20:02.034891 | mon1 | 2026-03-06 01:20:02.035168 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-06 01:20:02.035445 | mon1 | Friday 06 March 2026 01:20:02 +0000 (0:00:00.370) 0:00:03.598 ********** 2026-03-06 01:20:10.454612 | mon1 | changed: [osd1] 2026-03-06 01:20:10.454910 | mon1 | changed: [mon1] 2026-03-06 01:20:10.455182 | mon1 | 2026-03-06 01:20:10.455458 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-06 01:20:10.455715 | mon1 | 2026-03-06 01:20:10.456068 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:20:10.456382 | mon1 | Friday 06 March 2026 01:20:10 +0000 (0:00:08.420) 0:00:12.018 ********** 2026-03-06 01:20:12.856042 | mon1 | ok: [osd1] 2026-03-06 01:20:12.856198 | mon1 | 2026-03-06 01:20:12.856477 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-06 01:20:12.856756 | mon1 | Friday 06 March 2026 01:20:12 +0000 (0:00:02.401) 0:00:14.419 ********** 2026-03-06 01:20:47.043949 | mon1 | changed: [osd1] 2026-03-06 01:20:47.044075 | mon1 | 2026-03-06 01:20:47.044091 | mon1 | TASK [Start up service] ******************************************************** 2026-03-06 01:20:47.044115 | mon1 | Friday 06 March 2026 01:20:47 +0000 (0:00:34.186) 0:00:48.606 ********** 2026-03-06 01:20:47.726547 | mon1 | ok: [osd1] 2026-03-06 01:20:47.726653 | mon1 | 2026-03-06 01:20:47.726668 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-06 01:20:47.726681 | mon1 | Friday 06 March 2026 01:20:47 +0000 (0:00:00.682) 0:00:49.289 ********** 2026-03-06 01:20:48.076157 | mon1 | ok: [osd1] 2026-03-06 01:20:48.076243 | mon1 | 2026-03-06 01:20:48.076258 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-06 01:20:48.077776 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.350) 0:00:49.639 ********** 2026-03-06 01:20:48.871897 | mon1 | changed: [osd1] 2026-03-06 01:20:48.871972 | mon1 | 2026-03-06 01:20:48.872127 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-06 01:20:48.872281 | mon1 | Friday 06 March 2026 01:20:48 +0000 (0:00:00.795) 0:00:50.435 ********** 2026-03-06 01:20:49.145943 | mon1 | ok: [osd1] 2026-03-06 01:20:49.146024 | mon1 | 2026-03-06 01:20:49.146302 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-06 01:20:49.146546 | mon1 | Friday 06 March 2026 01:20:49 +0000 (0:00:00.273) 0:00:50.708 ********** 2026-03-06 01:20:49.172365 | mon1 | skipping: [osd1] 2026-03-06 01:20:49.172620 | mon1 | 2026-03-06 01:20:49.172862 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-06 01:20:49.173108 | mon1 | Friday 06 March 2026 01:20:49 +0000 (0:00:00.028) 0:00:50.736 ********** 2026-03-06 01:20:49.887864 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:49.887945 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:49.888157 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:49.888280 | mon1 | 2026-03-06 01:20:49.888524 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-06 01:20:49.888715 | mon1 | Friday 06 March 2026 01:20:49 +0000 (0:00:00.714) 0:00:51.451 ********** 2026-03-06 01:20:50.677827 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:50.677934 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:50.677944 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:50.677953 | mon1 | 2026-03-06 01:20:50.677970 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-06 01:20:50.678262 | mon1 | Friday 06 March 2026 01:20:50 +0000 (0:00:00.788) 0:00:52.240 ********** 2026-03-06 01:20:51.505977 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:51.506025 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:51.506031 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:51.506037 | mon1 | 2026-03-06 01:20:51.506043 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-06 01:20:51.506049 | mon1 | Friday 06 March 2026 01:20:51 +0000 (0:00:00.827) 0:00:53.067 ********** 2026-03-06 01:20:53.023667 | mon1 | changed: [osd1] => (item=osd0) 2026-03-06 01:20:53.023994 | mon1 | changed: [osd1] => (item=osd1) 2026-03-06 01:20:53.024006 | mon1 | changed: [osd1] => (item=osd2) 2026-03-06 01:20:53.024014 | mon1 | 2026-03-06 01:20:53.024023 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-06 01:20:53.024030 | mon1 | Friday 06 March 2026 01:20:53 +0000 (0:00:01.518) 0:00:54.585 ********** 2026-03-06 01:20:54.545067 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-06 01:20:54.545822 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-06 01:20:54.545920 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-06 01:20:54.545939 | mon1 | 2026-03-06 01:20:54.548711 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:20:54.548836 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-06 01:20:54.548848 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-06 01:20:54.548866 | mon1 | 2026-03-06 01:20:54.548876 | mon1 | 2026-03-06 01:20:54.549644 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:20:54.549664 | mon1 | Friday 06 March 2026 01:20:54 +0000 (0:00:01.523) 0:00:56.108 ********** 2026-03-06 01:20:54.549676 | mon1 | =============================================================================== 2026-03-06 01:20:54.549686 | mon1 | Install depedencies ---------------------------------------------------- 34.19s 2026-03-06 01:20:54.549700 | mon1 | Update apt cache -------------------------------------------------------- 8.42s 2026-03-06 01:20:54.550650 | mon1 | Gathering Facts --------------------------------------------------------- 2.40s 2026-03-06 01:20:54.550720 | mon1 | Gathering Facts --------------------------------------------------------- 2.34s 2026-03-06 01:20:54.550727 | mon1 | Create a logical volume for each loop device ---------------------------- 1.52s 2026-03-06 01:20:54.550733 | mon1 | Create a volume group for each loop device ------------------------------ 1.52s 2026-03-06 01:20:54.550739 | mon1 | Configure short hostname ------------------------------------------------ 0.85s 2026-03-06 01:20:54.550910 | mon1 | Start loop devices ------------------------------------------------------ 0.83s 2026-03-06 01:20:54.551114 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.80s 2026-03-06 01:20:54.551328 | mon1 | Set permissions on loopback devices ------------------------------------- 0.79s 2026-03-06 01:20:54.551559 | mon1 | Create devices for Ceph ------------------------------------------------- 0.71s 2026-03-06 01:20:54.551787 | mon1 | Start up service -------------------------------------------------------- 0.68s 2026-03-06 01:20:54.551994 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.37s 2026-03-06 01:20:54.552229 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s 2026-03-06 01:20:54.552443 | mon1 | Get list of all loopback devices ---------------------------------------- 0.27s 2026-03-06 01:20:54.552673 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-06 01:20:54.622534 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-06 01:20:54.632010 | mon1 | INFO [default > converge] Executing 2026-03-06 01:20:55.623851 | mon1 | 2026-03-06 01:20:55.625112 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-06 01:20:55.625139 | mon1 | 2026-03-06 01:20:55.625149 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:20:55.625158 | mon1 | Friday 06 March 2026 01:20:55 +0000 (0:00:00.058) 0:00:00.058 ********** 2026-03-06 01:20:56.664623 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:20:56.664693 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:20:56.664729 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:20:56.664747 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:20:56.664764 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:20:56.679723 | mon1 | ok: [mon1] 2026-03-06 01:20:56.679785 | mon1 | 2026-03-06 01:20:56.679799 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:20:56.679819 | mon1 | Friday 06 March 2026 01:20:56 +0000 (0:00:01.055) 0:00:01.113 ********** 2026-03-06 01:20:57.028641 | mon1 | ok: [mon1] 2026-03-06 01:20:57.028695 | mon1 | 2026-03-06 01:20:57.028710 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:57.028723 | mon1 | Friday 06 March 2026 01:20:57 +0000 (0:00:00.348) 0:00:01.462 ********** 2026-03-06 01:20:57.069852 | mon1 | skipping: [mon1] 2026-03-06 01:20:57.069960 | mon1 | 2026-03-06 01:20:57.069984 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:20:57.070262 | mon1 | Friday 06 March 2026 01:20:57 +0000 (0:00:00.042) 0:00:01.504 ********** 2026-03-06 01:20:57.435109 | mon1 | changed: [mon1] 2026-03-06 01:20:57.435322 | mon1 | 2026-03-06 01:20:57.435678 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:20:57.435945 | mon1 | Friday 06 March 2026 01:20:57 +0000 (0:00:00.365) 0:00:01.869 ********** 2026-03-06 01:20:57.533067 | mon1 | ok: [mon1] => { 2026-03-06 01:20:57.533277 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:20:57.533522 | mon1 | } 2026-03-06 01:20:57.533803 | mon1 | 2026-03-06 01:20:57.534138 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:20:57.534450 | mon1 | Friday 06 March 2026 01:20:57 +0000 (0:00:00.097) 0:00:01.967 ********** 2026-03-06 01:20:58.331481 | mon1 | changed: [mon1] 2026-03-06 01:20:58.331696 | mon1 | 2026-03-06 01:20:58.331957 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:20:58.332202 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.798) 0:00:02.766 ********** 2026-03-06 01:20:58.380792 | mon1 | skipping: [mon1] 2026-03-06 01:20:58.380959 | mon1 | 2026-03-06 01:20:58.381214 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:58.381455 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.049) 0:00:02.815 ********** 2026-03-06 01:20:58.428714 | mon1 | skipping: [mon1] 2026-03-06 01:20:58.428878 | mon1 | 2026-03-06 01:20:58.429147 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:20:58.429430 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.048) 0:00:02.863 ********** 2026-03-06 01:20:58.677804 | mon1 | ok: [mon1] 2026-03-06 01:20:58.677924 | mon1 | 2026-03-06 01:20:58.678114 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:20:58.678305 | mon1 | Friday 06 March 2026 01:20:58 +0000 (0:00:00.248) 0:00:03.112 ********** 2026-03-06 01:20:59.945963 | mon1 | ok: [mon1] 2026-03-06 01:20:59.946681 | mon1 | 2026-03-06 01:20:59.946744 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:20:59.947018 | mon1 | Friday 06 March 2026 01:20:59 +0000 (0:00:01.265) 0:00:04.378 ********** 2026-03-06 01:21:00.160818 | mon1 | ok: [mon1] => { 2026-03-06 01:21:00.160879 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:21:00.160918 | mon1 | } 2026-03-06 01:21:00.160927 | mon1 | 2026-03-06 01:21:00.160937 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:21:00.160946 | mon1 | Friday 06 March 2026 01:21:00 +0000 (0:00:00.215) 0:00:04.593 ********** 2026-03-06 01:21:01.151775 | mon1 | changed: [mon1] 2026-03-06 01:21:01.151843 | mon1 | 2026-03-06 01:21:01.151953 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:21:01.152266 | mon1 | Friday 06 March 2026 01:21:01 +0000 (0:00:00.991) 0:00:05.585 ********** 2026-03-06 01:21:04.314387 | mon1 | changed: [mon1] 2026-03-06 01:21:04.314493 | mon1 | 2026-03-06 01:21:04.314607 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:21:04.314771 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:03.164) 0:00:08.749 ********** 2026-03-06 01:21:04.348416 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.348511 | mon1 | 2026-03-06 01:21:04.348641 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:21:04.348795 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.034) 0:00:08.783 ********** 2026-03-06 01:21:04.382853 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.382988 | mon1 | 2026-03-06 01:21:04.383010 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:21:04.383162 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.034) 0:00:08.818 ********** 2026-03-06 01:21:04.417555 | mon1 | skipping: [mon1] 2026-03-06 01:21:04.417692 | mon1 | 2026-03-06 01:21:04.417779 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:21:04.418044 | mon1 | Friday 06 March 2026 01:21:04 +0000 (0:00:00.034) 0:00:08.852 ********** 2026-03-06 01:21:14.155731 | mon1 | changed: [mon1] 2026-03-06 01:21:14.155788 | mon1 | 2026-03-06 01:21:14.155808 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:21:14.156214 | mon1 | Friday 06 March 2026 01:21:14 +0000 (0:00:09.736) 0:00:18.589 ********** 2026-03-06 01:21:14.865826 | mon1 | changed: [mon1] 2026-03-06 01:21:14.865925 | mon1 | 2026-03-06 01:21:14.866311 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:21:14.866380 | mon1 | Friday 06 March 2026 01:21:14 +0000 (0:00:00.709) 0:00:19.299 ********** 2026-03-06 01:21:16.043704 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:21:16.043830 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:21:16.044685 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:21:16.044705 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:21:16.044717 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:21:16.044928 | mon1 | 2026-03-06 01:21:16.045189 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:21:16.045438 | mon1 | Friday 06 March 2026 01:21:16 +0000 (0:00:01.177) 0:00:20.477 ********** 2026-03-06 01:21:16.766622 | mon1 | changed: [mon1] 2026-03-06 01:21:16.766713 | mon1 | 2026-03-06 01:21:16.766831 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:21:16.766965 | mon1 | Friday 06 March 2026 01:21:16 +0000 (0:00:00.712) 0:00:21.190 ********** 2026-03-06 01:21:16.767088 | mon1 | 2026-03-06 01:21:16.767226 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:21:16.767353 | mon1 | Friday 06 March 2026 01:21:16 +0000 (0:00:00.010) 0:00:21.201 ********** 2026-03-06 01:21:17.936056 | mon1 | ok: [mon1] 2026-03-06 01:21:17.936232 | mon1 | 2026-03-06 01:21:17.936502 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-06 01:21:17.936784 | mon1 | Friday 06 March 2026 01:21:17 +0000 (0:00:01.169) 0:00:22.370 ********** 2026-03-06 01:21:18.525722 | mon1 | changed: [mon1] 2026-03-06 01:21:18.525794 | mon1 | 2026-03-06 01:21:18.525849 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:21:18.526245 | mon1 | Friday 06 March 2026 01:21:18 +0000 (0:00:00.589) 0:00:22.959 ********** 2026-03-06 01:21:19.243990 | mon1 | changed: [mon1] 2026-03-06 01:21:19.244382 | mon1 | 2026-03-06 01:21:19.244762 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:21:19.245234 | mon1 | Friday 06 March 2026 01:21:19 +0000 (0:00:00.718) 0:00:23.678 ********** 2026-03-06 01:21:19.507707 | mon1 | ok: [mon1] 2026-03-06 01:21:19.507908 | mon1 | 2026-03-06 01:21:19.508241 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:21:19.508539 | mon1 | Friday 06 March 2026 01:21:19 +0000 (0:00:00.263) 0:00:23.942 ********** 2026-03-06 01:21:19.587982 | mon1 | ok: [mon1] => { 2026-03-06 01:21:19.588207 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:21:19.588438 | mon1 | } 2026-03-06 01:21:19.588692 | mon1 | 2026-03-06 01:21:19.588947 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:21:19.589187 | mon1 | Friday 06 March 2026 01:21:19 +0000 (0:00:00.080) 0:00:24.022 ********** 2026-03-06 01:21:20.912482 | mon1 | changed: [mon1] 2026-03-06 01:21:20.912614 | mon1 | 2026-03-06 01:21:20.912939 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:21:20.913237 | mon1 | Friday 06 March 2026 01:21:20 +0000 (0:00:01.323) 0:00:25.346 ********** 2026-03-06 01:21:25.747740 | mon1 | changed: [mon1] 2026-03-06 01:21:25.747833 | mon1 | 2026-03-06 01:21:25.747843 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:21:25.747852 | mon1 | Friday 06 March 2026 01:21:25 +0000 (0:00:04.836) 0:00:30.182 ********** 2026-03-06 01:21:26.896967 | mon1 | ok: [mon1] 2026-03-06 01:21:26.897071 | mon1 | 2026-03-06 01:21:26.897090 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:21:26.897107 | mon1 | Friday 06 March 2026 01:21:26 +0000 (0:00:01.147) 0:00:31.329 ********** 2026-03-06 01:21:28.495490 | mon1 | changed: [mon1] 2026-03-06 01:21:28.495606 | mon1 | 2026-03-06 01:21:28.495625 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:21:28.495638 | mon1 | Friday 06 March 2026 01:21:28 +0000 (0:00:01.599) 0:00:32.928 ********** 2026-03-06 01:21:29.119337 | mon1 | changed: [mon1] 2026-03-06 01:21:29.119401 | mon1 | 2026-03-06 01:21:29.119415 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:21:29.119427 | mon1 | Friday 06 March 2026 01:21:29 +0000 (0:00:00.623) 0:00:33.552 ********** 2026-03-06 01:21:29.828777 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-06 01:21:29.828857 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:21:29.829497 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:21:29.829569 | mon1 | 2026-03-06 01:21:29.829611 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:21:29.829621 | mon1 | Friday 06 March 2026 01:21:29 +0000 (0:00:00.710) 0:00:34.263 ********** 2026-03-06 01:21:30.439698 | mon1 | changed: [mon1] 2026-03-06 01:21:30.439754 | mon1 | 2026-03-06 01:21:30.439768 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:21:30.439873 | mon1 | Friday 06 March 2026 01:21:30 +0000 (0:00:00.610) 0:00:34.874 ********** 2026-03-06 01:21:31.052143 | mon1 | changed: [mon1] 2026-03-06 01:21:31.052242 | mon1 | 2026-03-06 01:21:31.052269 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:21:31.052758 | mon1 | Friday 06 March 2026 01:21:31 +0000 (0:00:00.604) 0:00:35.479 ********** 2026-03-06 01:21:31.052795 | mon1 | 2026-03-06 01:21:31.052801 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:21:31.052807 | mon1 | Friday 06 March 2026 01:21:31 +0000 (0:00:00.007) 0:00:35.487 ********** 2026-03-06 01:21:31.953042 | mon1 | ok: [mon1] 2026-03-06 01:21:31.953094 | mon1 | 2026-03-06 01:21:31.953106 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-06 01:21:31.953116 | mon1 | Friday 06 March 2026 01:21:31 +0000 (0:00:00.899) 0:00:36.386 ********** 2026-03-06 01:21:35.426705 | mon1 | changed: [mon1] 2026-03-06 01:21:35.426790 | mon1 | 2026-03-06 01:21:35.426804 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:21:35.426826 | mon1 | Friday 06 March 2026 01:21:35 +0000 (0:00:03.474) 0:00:39.861 ********** 2026-03-06 01:21:37.131108 | mon1 | changed: [mon1] 2026-03-06 01:21:37.131346 | mon1 | 2026-03-06 01:21:37.131362 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:21:37.131379 | mon1 | Friday 06 March 2026 01:21:37 +0000 (0:00:01.703) 0:00:41.565 ********** 2026-03-06 01:21:37.190506 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-06 01:21:37.190630 | mon1 | 2026-03-06 01:21:37.190648 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:21:37.190662 | mon1 | Friday 06 March 2026 01:21:37 +0000 (0:00:00.057) 0:00:41.623 ********** 2026-03-06 01:21:58.713681 | mon1 | changed: [mon1] 2026-03-06 01:21:58.714378 | mon1 | 2026-03-06 01:21:58.714399 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:21:58.714503 | mon1 | Friday 06 March 2026 01:21:58 +0000 (0:00:21.524) 0:01:03.147 ********** 2026-03-06 01:21:59.593708 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-06 01:21:59.593831 | mon1 | ok: [mon1] => (item=ssh) 2026-03-06 01:21:59.594486 | mon1 | 2026-03-06 01:21:59.594558 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:21:59.594571 | mon1 | Friday 06 March 2026 01:21:59 +0000 (0:00:00.880) 0:01:04.028 ********** 2026-03-06 01:21:59.979762 | mon1 | changed: [mon1] 2026-03-06 01:21:59.979826 | mon1 | 2026-03-06 01:21:59.979847 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:21:59.979951 | mon1 | Friday 06 March 2026 01:21:59 +0000 (0:00:00.385) 0:01:04.413 ********** 2026-03-06 01:22:00.263126 | mon1 | ok: [mon1] 2026-03-06 01:22:00.263193 | mon1 | 2026-03-06 01:22:00.263403 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:22:00.263422 | mon1 | Friday 06 March 2026 01:22:00 +0000 (0:00:00.283) 0:01:04.697 ********** 2026-03-06 01:22:02.256911 | mon1 | changed: [mon1] 2026-03-06 01:22:02.256965 | mon1 | 2026-03-06 01:22:02.256973 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:22:02.256981 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:01.993) 0:01:06.690 ********** 2026-03-06 01:22:02.716727 | mon1 | changed: [mon1] 2026-03-06 01:22:02.716827 | mon1 | 2026-03-06 01:22:02.717335 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-06 01:22:02.717395 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:00.459) 0:01:07.150 ********** 2026-03-06 01:22:02.882277 | mon1 | ok: [mon1] 2026-03-06 01:22:02.882370 | mon1 | 2026-03-06 01:22:02.882385 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-06 01:22:02.882533 | mon1 | Friday 06 March 2026 01:22:02 +0000 (0:00:00.165) 0:01:07.316 ********** 2026-03-06 01:22:03.166272 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:22:03.166338 | mon1 | 2026-03-06 01:22:03.166352 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-06 01:22:03.166365 | mon1 | Friday 06 March 2026 01:22:03 +0000 (0:00:00.283) 0:01:07.599 ********** 2026-03-06 01:22:03.221341 | mon1 | ok: [mon1] 2026-03-06 01:22:03.221417 | mon1 | 2026-03-06 01:22:03.221430 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-06 01:22:03.221443 | mon1 | Friday 06 March 2026 01:22:03 +0000 (0:00:00.054) 0:01:07.654 ********** 2026-03-06 01:22:03.346426 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-06 01:22:03.346536 | mon1 | 2026-03-06 01:22:03.346548 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-06 01:22:03.346557 | mon1 | Friday 06 March 2026 01:22:03 +0000 (0:00:00.125) 0:01:07.780 ********** 2026-03-06 01:22:03.686281 | mon1 | changed: [mon1] 2026-03-06 01:22:03.686355 | mon1 | 2026-03-06 01:22:03.686365 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-06 01:22:03.686375 | mon1 | Friday 06 March 2026 01:22:03 +0000 (0:00:00.339) 0:01:08.120 ********** 2026-03-06 01:22:04.545798 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-06 01:22:04.545889 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-06 01:22:04.545902 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-06 01:22:04.545921 | mon1 | 2026-03-06 01:22:04.545931 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-06 01:22:04.546090 | mon1 | Friday 06 March 2026 01:22:04 +0000 (0:00:00.859) 0:01:08.980 ********** 2026-03-06 01:26:02.296736 | mon1 | ok: [mon1] 2026-03-06 01:26:02.296824 | mon1 | 2026-03-06 01:26:02.296839 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-06 01:26:02.296997 | mon1 | Friday 06 March 2026 01:26:02 +0000 (0:03:57.749) 0:05:06.729 ********** 2026-03-06 01:26:02.555491 | mon1 | changed: [mon1] 2026-03-06 01:26:02.555527 | mon1 | 2026-03-06 01:26:02.555533 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-06 01:26:02.555539 | mon1 | Friday 06 March 2026 01:26:02 +0000 (0:00:00.259) 0:05:06.989 ********** 2026-03-06 01:26:02.600312 | mon1 | ok: [mon1] 2026-03-06 01:26:02.600404 | mon1 | 2026-03-06 01:26:02.600733 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:26:02.600789 | mon1 | Friday 06 March 2026 01:26:02 +0000 (0:00:00.044) 0:05:07.034 ********** 2026-03-06 01:26:02.699539 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:26:02.699634 | mon1 | 2026-03-06 01:26:02.699675 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:26:02.699688 | mon1 | Friday 06 March 2026 01:26:02 +0000 (0:00:00.098) 0:05:07.132 ********** 2026-03-06 01:26:08.643075 | mon1 | ok: [mon1] 2026-03-06 01:26:08.643205 | mon1 | 2026-03-06 01:26:08.643390 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:26:08.643555 | mon1 | Friday 06 March 2026 01:26:08 +0000 (0:00:05.945) 0:05:13.077 ********** 2026-03-06 01:26:08.706250 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:26:08.706310 | mon1 | 2026-03-06 01:26:08.706324 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:26:08.706336 | mon1 | Friday 06 March 2026 01:26:08 +0000 (0:00:00.061) 0:05:13.139 ********** 2026-03-06 01:26:09.142283 | mon1 | ok: [mon1] 2026-03-06 01:26:09.142332 | mon1 | 2026-03-06 01:26:09.142342 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:26:09.144129 | mon1 | Friday 06 March 2026 01:26:09 +0000 (0:00:00.437) 0:05:13.576 ********** 2026-03-06 01:26:16.293213 | mon1 | ok: [mon1] 2026-03-06 01:26:16.293270 | mon1 | 2026-03-06 01:26:16.293284 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-06 01:26:16.293296 | mon1 | Friday 06 March 2026 01:26:16 +0000 (0:00:07.149) 0:05:20.726 ********** 2026-03-06 01:26:34.266941 | mon1 | changed: [mon1] 2026-03-06 01:26:34.267748 | mon1 | 2026-03-06 01:26:34.267797 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-06 01:26:34.267865 | mon1 | Friday 06 March 2026 01:26:34 +0000 (0:00:17.966) 0:05:38.692 ********** 2026-03-06 01:26:49.295099 | mon1 | ok: [mon1] 2026-03-06 01:26:49.295162 | mon1 | 2026-03-06 01:26:49.295176 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:26:49.295189 | mon1 | Friday 06 March 2026 01:26:49 +0000 (0:00:15.035) 0:05:53.728 ********** 2026-03-06 01:26:49.363029 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:26:49.363090 | mon1 | 2026-03-06 01:26:49.363321 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:26:49.363366 | mon1 | Friday 06 March 2026 01:26:49 +0000 (0:00:00.068) 0:05:53.797 ********** 2026-03-06 01:26:49.423498 | mon1 | skipping: [mon1] 2026-03-06 01:26:49.423534 | mon1 | 2026-03-06 01:26:49.423540 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:26:49.423547 | mon1 | Friday 06 March 2026 01:26:49 +0000 (0:00:00.059) 0:05:53.857 ********** 2026-03-06 01:26:49.476726 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-06 01:26:49.476798 | mon1 | skipping: [mon1] 2026-03-06 01:26:49.477636 | mon1 | 2026-03-06 01:26:49.477664 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:26:49.477934 | mon1 | Friday 06 March 2026 01:26:49 +0000 (0:00:00.052) 0:05:53.910 ********** 2026-03-06 01:26:49.794041 | mon1 | ok: [mon1] 2026-03-06 01:26:49.794132 | mon1 | 2026-03-06 01:26:49.797634 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:26:49.797673 | mon1 | Friday 06 March 2026 01:26:49 +0000 (0:00:00.318) 0:05:54.228 ********** 2026-03-06 01:26:57.002285 | mon1 | ok: [mon1] 2026-03-06 01:26:57.002722 | mon1 | 2026-03-06 01:26:57.003093 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-06 01:26:57.003495 | mon1 | Friday 06 March 2026 01:26:56 +0000 (0:00:07.207) 0:06:01.436 ********** 2026-03-06 01:27:10.231134 | mon1 | changed: [mon1] 2026-03-06 01:27:10.231218 | mon1 | 2026-03-06 01:27:10.231228 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-06 01:27:10.231354 | mon1 | Friday 06 March 2026 01:27:10 +0000 (0:00:13.227) 0:06:14.663 ********** 2026-03-06 01:27:17.010746 | mon1 | ok: [mon1] 2026-03-06 01:27:17.010825 | mon1 | 2026-03-06 01:27:17.011152 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-06 01:27:17.011171 | mon1 | Friday 06 March 2026 01:27:17 +0000 (0:00:06.782) 0:06:21.445 ********** 2026-03-06 01:27:25.006503 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-06 01:27:25.006642 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-06 01:27:25.006660 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-06 01:27:25.006672 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-06 01:27:25.006684 | mon1 | 2026-03-06 01:27:25.006704 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-06 01:27:25.006717 | mon1 | 2026-03-06 01:27:25.006816 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:27:25.006911 | mon1 | Friday 06 March 2026 01:27:25 +0000 (0:00:07.995) 0:06:29.440 ********** 2026-03-06 01:27:26.257090 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:27:26.257157 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:27:26.257271 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:27:26.257386 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:27:26.257506 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:27:26.269097 | mon1 | ok: [osd1] 2026-03-06 01:27:26.269273 | mon1 | 2026-03-06 01:27:26.269473 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:26.269604 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:01.261) 0:06:30.702 ********** 2026-03-06 01:27:26.539028 | mon1 | ok: [osd1] 2026-03-06 01:27:26.539086 | mon1 | 2026-03-06 01:27:26.539181 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:26.539292 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.271) 0:06:30.973 ********** 2026-03-06 01:27:26.582029 | mon1 | skipping: [osd1] 2026-03-06 01:27:26.582071 | mon1 | 2026-03-06 01:27:26.582947 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:27:26.583004 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.042) 0:06:31.016 ********** 2026-03-06 01:27:26.849884 | mon1 | changed: [osd1] 2026-03-06 01:27:26.849966 | mon1 | 2026-03-06 01:27:26.850017 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:26.850143 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.269) 0:06:31.285 ********** 2026-03-06 01:27:26.917005 | mon1 | ok: [osd1] => { 2026-03-06 01:27:26.917154 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:27:26.917310 | mon1 | } 2026-03-06 01:27:26.917460 | mon1 | 2026-03-06 01:27:26.917671 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:26.917837 | mon1 | Friday 06 March 2026 01:27:26 +0000 (0:00:00.064) 0:06:31.349 ********** 2026-03-06 01:27:27.557868 | mon1 | changed: [osd1] 2026-03-06 01:27:27.557943 | mon1 | 2026-03-06 01:27:27.557985 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:27.558122 | mon1 | Friday 06 March 2026 01:27:27 +0000 (0:00:00.643) 0:06:31.993 ********** 2026-03-06 01:27:27.604412 | mon1 | skipping: [osd1] 2026-03-06 01:27:27.604479 | mon1 | 2026-03-06 01:27:27.604569 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:27.604713 | mon1 | Friday 06 March 2026 01:27:27 +0000 (0:00:00.044) 0:06:32.037 ********** 2026-03-06 01:27:27.642021 | mon1 | skipping: [osd1] 2026-03-06 01:27:27.642090 | mon1 | 2026-03-06 01:27:27.642182 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:27.642292 | mon1 | Friday 06 March 2026 01:27:27 +0000 (0:00:00.039) 0:06:32.076 ********** 2026-03-06 01:27:27.916014 | mon1 | ok: [osd1] 2026-03-06 01:27:27.916085 | mon1 | 2026-03-06 01:27:27.916182 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:27:27.916295 | mon1 | Friday 06 March 2026 01:27:27 +0000 (0:00:00.273) 0:06:32.350 ********** 2026-03-06 01:27:29.182972 | mon1 | ok: [osd1] 2026-03-06 01:27:29.183050 | mon1 | 2026-03-06 01:27:29.183141 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:29.183254 | mon1 | Friday 06 March 2026 01:27:29 +0000 (0:00:01.268) 0:06:33.618 ********** 2026-03-06 01:27:29.270003 | mon1 | ok: [osd1] => { 2026-03-06 01:27:29.270076 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:27:29.270178 | mon1 | } 2026-03-06 01:27:29.270278 | mon1 | 2026-03-06 01:27:29.270431 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:29.270520 | mon1 | Friday 06 March 2026 01:27:29 +0000 (0:00:00.085) 0:06:33.703 ********** 2026-03-06 01:27:30.149729 | mon1 | changed: [osd1] 2026-03-06 01:27:30.149810 | mon1 | 2026-03-06 01:27:30.149901 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:30.150010 | mon1 | Friday 06 March 2026 01:27:30 +0000 (0:00:00.881) 0:06:34.584 ********** 2026-03-06 01:27:33.151746 | mon1 | changed: [osd1] 2026-03-06 01:27:33.151834 | mon1 | 2026-03-06 01:27:33.151930 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:27:33.152048 | mon1 | Friday 06 March 2026 01:27:33 +0000 (0:00:03.001) 0:06:37.586 ********** 2026-03-06 01:27:33.189565 | mon1 | skipping: [osd1] 2026-03-06 01:27:33.189635 | mon1 | 2026-03-06 01:27:33.189642 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:27:33.189649 | mon1 | Friday 06 March 2026 01:27:33 +0000 (0:00:00.035) 0:06:37.622 ********** 2026-03-06 01:27:33.220442 | mon1 | skipping: [osd1] 2026-03-06 01:27:33.220466 | mon1 | 2026-03-06 01:27:33.220475 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:27:33.220482 | mon1 | Friday 06 March 2026 01:27:33 +0000 (0:00:00.031) 0:06:37.653 ********** 2026-03-06 01:27:33.265542 | mon1 | skipping: [osd1] 2026-03-06 01:27:33.265604 | mon1 | 2026-03-06 01:27:33.265616 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:27:33.265639 | mon1 | Friday 06 March 2026 01:27:33 +0000 (0:00:00.044) 0:06:37.698 ********** 2026-03-06 01:27:41.511760 | mon1 | changed: [osd1] 2026-03-06 01:27:41.511857 | mon1 | 2026-03-06 01:27:41.511875 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:27:41.512011 | mon1 | Friday 06 March 2026 01:27:41 +0000 (0:00:08.248) 0:06:45.946 ********** 2026-03-06 01:27:42.118516 | mon1 | changed: [osd1] 2026-03-06 01:27:42.118556 | mon1 | 2026-03-06 01:27:42.118562 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:27:42.118568 | mon1 | Friday 06 March 2026 01:27:42 +0000 (0:00:00.604) 0:06:46.551 ********** 2026-03-06 01:27:43.381931 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:27:43.381986 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:27:43.381999 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:27:43.382011 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:27:43.382022 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:27:43.382035 | mon1 | 2026-03-06 01:27:43.382047 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:27:43.382059 | mon1 | Friday 06 March 2026 01:27:43 +0000 (0:00:01.261) 0:06:47.812 ********** 2026-03-06 01:27:44.083622 | mon1 | changed: [osd1] 2026-03-06 01:27:44.083659 | mon1 | 2026-03-06 01:27:44.083665 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:27:44.083671 | mon1 | Friday 06 March 2026 01:27:44 +0000 (0:00:00.695) 0:06:48.508 ********** 2026-03-06 01:27:44.083677 | mon1 | 2026-03-06 01:27:44.083682 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:27:44.083687 | mon1 | Friday 06 March 2026 01:27:44 +0000 (0:00:00.007) 0:06:48.516 ********** 2026-03-06 01:27:45.003311 | mon1 | ok: [osd1] 2026-03-06 01:27:45.003356 | mon1 | 2026-03-06 01:27:45.003363 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-06 01:27:45.003369 | mon1 | Friday 06 March 2026 01:27:44 +0000 (0:00:00.919) 0:06:49.435 ********** 2026-03-06 01:27:45.606361 | mon1 | changed: [osd1] 2026-03-06 01:27:45.606551 | mon1 | 2026-03-06 01:27:45.606735 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:27:45.609454 | mon1 | Friday 06 March 2026 01:27:45 +0000 (0:00:00.605) 0:06:50.041 ********** 2026-03-06 01:27:46.357586 | mon1 | changed: [osd1] 2026-03-06 01:27:46.357628 | mon1 | 2026-03-06 01:27:46.357635 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:27:46.357640 | mon1 | Friday 06 March 2026 01:27:46 +0000 (0:00:00.749) 0:06:50.791 ********** 2026-03-06 01:27:46.613290 | mon1 | ok: [osd1] 2026-03-06 01:27:46.613330 | mon1 | 2026-03-06 01:27:46.613337 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:27:46.613342 | mon1 | Friday 06 March 2026 01:27:46 +0000 (0:00:00.254) 0:06:51.045 ********** 2026-03-06 01:27:46.677433 | mon1 | ok: [osd1] => { 2026-03-06 01:27:46.677753 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:27:46.678799 | mon1 | } 2026-03-06 01:27:46.679006 | mon1 | 2026-03-06 01:27:46.679238 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:27:46.679447 | mon1 | Friday 06 March 2026 01:27:46 +0000 (0:00:00.066) 0:06:51.112 ********** 2026-03-06 01:27:47.626955 | mon1 | changed: [osd1] 2026-03-06 01:27:47.627135 | mon1 | 2026-03-06 01:27:47.630149 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:27:47.630310 | mon1 | Friday 06 March 2026 01:27:47 +0000 (0:00:00.949) 0:06:52.061 ********** 2026-03-06 01:27:52.347829 | mon1 | changed: [osd1] 2026-03-06 01:27:52.350931 | mon1 | 2026-03-06 01:27:52.351091 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:27:52.351235 | mon1 | Friday 06 March 2026 01:27:52 +0000 (0:00:04.721) 0:06:56.783 ********** 2026-03-06 01:27:53.322294 | mon1 | ok: [osd1] 2026-03-06 01:27:53.322334 | mon1 | 2026-03-06 01:27:53.322339 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:27:53.322343 | mon1 | Friday 06 March 2026 01:27:53 +0000 (0:00:00.973) 0:06:57.756 ********** 2026-03-06 01:27:53.865294 | mon1 | changed: [osd1] 2026-03-06 01:27:53.865332 | mon1 | 2026-03-06 01:27:53.865336 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:27:53.865341 | mon1 | Friday 06 March 2026 01:27:53 +0000 (0:00:00.541) 0:06:58.298 ********** 2026-03-06 01:27:54.481478 | mon1 | changed: [osd1] 2026-03-06 01:27:54.481861 | mon1 | 2026-03-06 01:27:54.485000 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:27:54.485017 | mon1 | Friday 06 March 2026 01:27:54 +0000 (0:00:00.618) 0:06:58.916 ********** 2026-03-06 01:27:55.195665 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-06 01:27:55.195709 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:27:55.195716 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:27:55.195722 | mon1 | 2026-03-06 01:27:55.195729 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:27:55.195735 | mon1 | Friday 06 March 2026 01:27:55 +0000 (0:00:00.713) 0:06:59.629 ********** 2026-03-06 01:27:55.798325 | mon1 | changed: [osd1] 2026-03-06 01:27:55.798374 | mon1 | 2026-03-06 01:27:55.798379 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:27:55.798384 | mon1 | Friday 06 March 2026 01:27:55 +0000 (0:00:00.600) 0:07:00.230 ********** 2026-03-06 01:27:56.387675 | mon1 | changed: [osd1] 2026-03-06 01:27:56.388750 | mon1 | 2026-03-06 01:27:56.388922 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:27:56.389069 | mon1 | Friday 06 March 2026 01:27:56 +0000 (0:00:00.585) 0:07:00.816 ********** 2026-03-06 01:27:56.389200 | mon1 | 2026-03-06 01:27:56.392466 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-06 01:27:56.392634 | mon1 | Friday 06 March 2026 01:27:56 +0000 (0:00:00.006) 0:07:00.822 ********** 2026-03-06 01:27:57.333602 | mon1 | ok: [osd1] 2026-03-06 01:27:57.333659 | mon1 | 2026-03-06 01:27:57.333666 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-06 01:27:57.333672 | mon1 | Friday 06 March 2026 01:27:57 +0000 (0:00:00.942) 0:07:01.765 ********** 2026-03-06 01:27:59.067488 | mon1 | changed: [osd1] 2026-03-06 01:27:59.068731 | mon1 | 2026-03-06 01:27:59.068895 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:27:59.069047 | mon1 | Friday 06 March 2026 01:27:59 +0000 (0:00:01.736) 0:07:03.502 ********** 2026-03-06 01:27:59.809558 | mon1 | changed: [osd1] 2026-03-06 01:27:59.809752 | mon1 | 2026-03-06 01:27:59.810736 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:27:59.810889 | mon1 | Friday 06 March 2026 01:27:59 +0000 (0:00:00.742) 0:07:04.244 ********** 2026-03-06 01:27:59.868467 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-06 01:27:59.868711 | mon1 | 2026-03-06 01:27:59.868929 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:27:59.869795 | mon1 | Friday 06 March 2026 01:27:59 +0000 (0:00:00.058) 0:07:04.303 ********** 2026-03-06 01:28:00.892071 | mon1 | ok: [osd1] 2026-03-06 01:28:00.892196 | mon1 | 2026-03-06 01:28:00.892372 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:28:00.892552 | mon1 | Friday 06 March 2026 01:28:00 +0000 (0:00:01.023) 0:07:05.327 ********** 2026-03-06 01:28:01.739748 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-06 01:28:01.739832 | mon1 | ok: [osd1] => (item=ssh) 2026-03-06 01:28:01.739852 | mon1 | 2026-03-06 01:28:01.740281 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:28:01.740312 | mon1 | Friday 06 March 2026 01:28:01 +0000 (0:00:00.846) 0:07:06.173 ********** 2026-03-06 01:28:02.153104 | mon1 | changed: [osd1] 2026-03-06 01:28:02.156687 | mon1 | 2026-03-06 01:28:02.156749 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:28:02.156761 | mon1 | Friday 06 March 2026 01:28:02 +0000 (0:00:00.413) 0:07:06.587 ********** 2026-03-06 01:28:02.415971 | mon1 | ok: [osd1] 2026-03-06 01:28:02.416032 | mon1 | 2026-03-06 01:28:02.416156 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:28:02.416274 | mon1 | Friday 06 March 2026 01:28:02 +0000 (0:00:00.263) 0:07:06.850 ********** 2026-03-06 01:28:02.807045 | mon1 | changed: [osd1] 2026-03-06 01:28:02.807123 | mon1 | 2026-03-06 01:28:02.807637 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:28:02.807671 | mon1 | Friday 06 March 2026 01:28:02 +0000 (0:00:00.391) 0:07:07.241 ********** 2026-03-06 01:28:03.096887 | mon1 | changed: [osd1] 2026-03-06 01:28:03.096982 | mon1 | 2026-03-06 01:28:03.097230 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-06 01:28:03.097268 | mon1 | Friday 06 March 2026 01:28:03 +0000 (0:00:00.290) 0:07:07.532 ********** 2026-03-06 01:28:03.372717 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-06 01:28:03.373531 | mon1 | 2026-03-06 01:28:03.373647 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-06 01:28:03.373662 | mon1 | Friday 06 March 2026 01:28:03 +0000 (0:00:00.274) 0:07:07.806 ********** 2026-03-06 01:28:03.425092 | mon1 | ok: [osd1] 2026-03-06 01:28:03.425150 | mon1 | 2026-03-06 01:28:03.425164 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:28:03.425176 | mon1 | Friday 06 March 2026 01:28:03 +0000 (0:00:00.052) 0:07:07.859 ********** 2026-03-06 01:28:03.492916 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-06 01:28:03.492948 | mon1 | 2026-03-06 01:28:03.492962 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:28:03.492974 | mon1 | Friday 06 March 2026 01:28:03 +0000 (0:00:00.067) 0:07:07.927 ********** 2026-03-06 01:28:10.108647 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:28:10.109613 | mon1 | 2026-03-06 01:28:10.109623 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:28:10.109811 | mon1 | Friday 06 March 2026 01:28:10 +0000 (0:00:06.615) 0:07:14.542 ********** 2026-03-06 01:28:10.168548 | mon1 | ok: [osd1] => (item=osd1) 2026-03-06 01:28:10.168665 | mon1 | 2026-03-06 01:28:10.168681 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:28:10.168702 | mon1 | Friday 06 March 2026 01:28:10 +0000 (0:00:00.060) 0:07:14.602 ********** 2026-03-06 01:28:10.492431 | mon1 | changed: [osd1] 2026-03-06 01:28:10.492670 | mon1 | 2026-03-06 01:28:10.492939 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:28:10.493194 | mon1 | Friday 06 March 2026 01:28:10 +0000 (0:00:00.324) 0:07:14.927 ********** 2026-03-06 01:28:22.223843 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:28:22.223968 | mon1 | 2026-03-06 01:28:22.224153 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-06 01:28:22.224326 | mon1 | Friday 06 March 2026 01:28:22 +0000 (0:00:11.731) 0:07:26.658 ********** 2026-03-06 01:28:23.916179 | mon1 | ok: [osd1] 2026-03-06 01:28:23.916302 | mon1 | 2026-03-06 01:28:23.916469 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-06 01:28:23.916659 | mon1 | Friday 06 March 2026 01:28:23 +0000 (0:00:01.692) 0:07:28.351 ********** 2026-03-06 01:29:17.019540 | mon1 | ok: [osd1] 2026-03-06 01:29:17.019629 | mon1 | 2026-03-06 01:29:17.019641 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-06 01:29:17.019672 | mon1 | Friday 06 March 2026 01:29:17 +0000 (0:00:53.102) 0:08:21.453 ********** 2026-03-06 01:31:28.690492 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-06 01:31:28.690649 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-06 01:31:28.691237 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-06 01:31:28.691293 | mon1 | 2026-03-06 01:31:28.691300 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-06 01:31:28.691307 | mon1 | Friday 06 March 2026 01:31:28 +0000 (0:02:11.670) 0:10:33.124 ********** 2026-03-06 01:31:35.537555 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:31:35.537657 | mon1 | 2026-03-06 01:31:35.537669 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-06 01:31:35.537678 | mon1 | Friday 06 March 2026 01:31:35 +0000 (0:00:06.847) 0:10:39.971 ********** 2026-03-06 01:31:42.225218 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:31:42.225373 | mon1 | 2026-03-06 01:31:42.225673 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-06 01:31:42.225922 | mon1 | Friday 06 March 2026 01:31:42 +0000 (0:00:06.688) 0:10:46.659 ********** 2026-03-06 01:31:42.358143 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-06 01:31:42.358205 | mon1 | 2026-03-06 01:31:42.358219 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-06 01:31:42.358232 | mon1 | Friday 06 March 2026 01:31:42 +0000 (0:00:00.131) 0:10:46.791 ********** 2026-03-06 01:31:42.412090 | mon1 | ok: [osd1] 2026-03-06 01:31:42.412155 | mon1 | 2026-03-06 01:31:42.412168 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-06 01:31:42.412181 | mon1 | Friday 06 March 2026 01:31:42 +0000 (0:00:00.054) 0:10:46.845 ********** 2026-03-06 01:31:49.140105 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:31:49.140183 | mon1 | 2026-03-06 01:31:49.140189 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-06 01:31:49.140195 | mon1 | Friday 06 March 2026 01:31:49 +0000 (0:00:06.719) 0:10:53.565 ********** 2026-03-06 01:31:49.182763 | mon1 | ok: [osd1] 2026-03-06 01:31:49.182849 | mon1 | 2026-03-06 01:31:49.182872 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-06 01:31:49.183173 | mon1 | Friday 06 March 2026 01:31:49 +0000 (0:00:00.052) 0:10:53.617 ********** 2026-03-06 01:31:49.231457 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:49.231522 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:49.231529 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:31:49.231537 | mon1 | skipping: [osd1] 2026-03-06 01:31:49.231544 | mon1 | 2026-03-06 01:31:49.231552 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-06 01:31:49.231560 | mon1 | Friday 06 March 2026 01:31:49 +0000 (0:00:00.047) 0:10:53.664 ********** 2026-03-06 01:31:49.269799 | mon1 | skipping: [osd1] 2026-03-06 01:31:49.269908 | mon1 | 2026-03-06 01:31:49.269937 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:31:49.269945 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-06 01:31:49.269957 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-06 01:31:49.269964 | mon1 | 2026-03-06 01:31:49.270754 | mon1 | 2026-03-06 01:31:49.270868 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:31:49.270886 | mon1 | Friday 06 March 2026 01:31:49 +0000 (0:00:00.039) 0:10:53.704 ********** 2026-03-06 01:31:49.270900 | mon1 | =============================================================================== 2026-03-06 01:31:49.270923 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 237.75s 2026-03-06 01:31:49.270962 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 131.67s 2026-03-06 01:31:49.270977 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 53.10s 2026-03-06 01:31:49.271635 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 21.52s 2026-03-06 01:31:49.271695 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 17.97s 2026-03-06 01:31:49.271701 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 15.04s 2026-03-06 01:31:49.271706 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 13.23s 2026-03-06 01:31:49.271982 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 11.73s 2026-03-06 01:31:49.272163 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.74s 2026-03-06 01:31:49.272337 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.25s 2026-03-06 01:31:49.272509 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.00s 2026-03-06 01:31:49.272703 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.21s 2026-03-06 01:31:49.273077 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.15s 2026-03-06 01:31:49.273253 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.85s 2026-03-06 01:31:49.273433 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.78s 2026-03-06 01:31:49.273624 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.72s 2026-03-06 01:31:49.273803 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.69s 2026-03-06 01:31:49.273980 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.62s 2026-03-06 01:31:49.274159 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.95s 2026-03-06 01:31:49.274335 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.84s 2026-03-06 01:31:49.381795 | mon1 | INFO [default > converge] Executed: Successful 2026-03-06 01:31:49.391290 | mon1 | INFO [default > idempotence] Executing 2026-03-06 01:31:50.364850 | mon1 | 2026-03-06 01:31:50.364961 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-06 01:31:50.365127 | mon1 | 2026-03-06 01:31:50.365285 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:31:50.365486 | mon1 | Friday 06 March 2026 01:31:50 +0000 (0:00:00.053) 0:00:00.053 ********** 2026-03-06 01:31:51.619684 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:31:51.619762 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:31:51.620022 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:31:51.620269 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:31:51.620521 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:31:51.632105 | mon1 | ok: [mon1] 2026-03-06 01:31:51.632277 | mon1 | 2026-03-06 01:31:51.632529 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:31:51.632821 | mon1 | Friday 06 March 2026 01:31:51 +0000 (0:00:01.267) 0:00:01.321 ********** 2026-03-06 01:31:52.003710 | mon1 | ok: [mon1] 2026-03-06 01:31:52.003861 | mon1 | 2026-03-06 01:31:52.004131 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:52.004387 | mon1 | Friday 06 March 2026 01:31:52 +0000 (0:00:00.371) 0:00:01.692 ********** 2026-03-06 01:31:52.049962 | mon1 | skipping: [mon1] 2026-03-06 01:31:52.050122 | mon1 | 2026-03-06 01:31:52.050380 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:31:52.050742 | mon1 | Friday 06 March 2026 01:31:52 +0000 (0:00:00.046) 0:00:01.739 ********** 2026-03-06 01:31:52.414214 | mon1 | ok: [mon1] 2026-03-06 01:31:52.414420 | mon1 | 2026-03-06 01:31:52.414730 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:31:52.414986 | mon1 | Friday 06 March 2026 01:31:52 +0000 (0:00:00.364) 0:00:02.103 ********** 2026-03-06 01:31:52.489129 | mon1 | ok: [mon1] => { 2026-03-06 01:31:52.489369 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:31:52.489710 | mon1 | } 2026-03-06 01:31:52.489911 | mon1 | 2026-03-06 01:31:52.490182 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:31:52.490467 | mon1 | Friday 06 March 2026 01:31:52 +0000 (0:00:00.074) 0:00:02.178 ********** 2026-03-06 01:31:53.020608 | mon1 | ok: [mon1] 2026-03-06 01:31:53.020836 | mon1 | 2026-03-06 01:31:53.021098 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:31:53.021384 | mon1 | Friday 06 March 2026 01:31:53 +0000 (0:00:00.531) 0:00:02.709 ********** 2026-03-06 01:31:53.070649 | mon1 | skipping: [mon1] 2026-03-06 01:31:53.070710 | mon1 | 2026-03-06 01:31:53.070835 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:53.070954 | mon1 | Friday 06 March 2026 01:31:53 +0000 (0:00:00.050) 0:00:02.760 ********** 2026-03-06 01:31:53.122056 | mon1 | skipping: [mon1] 2026-03-06 01:31:53.122229 | mon1 | 2026-03-06 01:31:53.122477 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:31:53.122752 | mon1 | Friday 06 March 2026 01:31:53 +0000 (0:00:00.051) 0:00:02.811 ********** 2026-03-06 01:31:53.375751 | mon1 | ok: [mon1] 2026-03-06 01:31:53.376040 | mon1 | 2026-03-06 01:31:53.376411 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:31:53.376740 | mon1 | Friday 06 March 2026 01:31:53 +0000 (0:00:00.253) 0:00:03.064 ********** 2026-03-06 01:31:54.669861 | mon1 | ok: [mon1] 2026-03-06 01:31:54.670073 | mon1 | 2026-03-06 01:31:54.670360 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:31:54.670633 | mon1 | Friday 06 March 2026 01:31:54 +0000 (0:00:01.294) 0:00:04.358 ********** 2026-03-06 01:31:54.880359 | mon1 | ok: [mon1] => { 2026-03-06 01:31:54.880673 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:31:54.880921 | mon1 | } 2026-03-06 01:31:54.881149 | mon1 | 2026-03-06 01:31:54.881403 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:31:54.881686 | mon1 | Friday 06 March 2026 01:31:54 +0000 (0:00:00.210) 0:00:04.569 ********** 2026-03-06 01:31:55.483697 | mon1 | ok: [mon1] 2026-03-06 01:31:55.483978 | mon1 | 2026-03-06 01:31:55.484301 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:31:55.484554 | mon1 | Friday 06 March 2026 01:31:55 +0000 (0:00:00.603) 0:00:05.172 ********** 2026-03-06 01:31:58.011998 | mon1 | ok: [mon1] 2026-03-06 01:31:58.012200 | mon1 | 2026-03-06 01:31:58.012458 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:31:58.012734 | mon1 | Friday 06 March 2026 01:31:58 +0000 (0:00:02.528) 0:00:07.700 ********** 2026-03-06 01:31:58.049966 | mon1 | skipping: [mon1] 2026-03-06 01:31:58.050174 | mon1 | 2026-03-06 01:31:58.050418 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:31:58.050700 | mon1 | Friday 06 March 2026 01:31:58 +0000 (0:00:00.038) 0:00:07.739 ********** 2026-03-06 01:31:58.090831 | mon1 | skipping: [mon1] 2026-03-06 01:31:58.090907 | mon1 | 2026-03-06 01:31:58.091146 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:31:58.091320 | mon1 | Friday 06 March 2026 01:31:58 +0000 (0:00:00.040) 0:00:07.780 ********** 2026-03-06 01:31:58.118406 | mon1 | skipping: [mon1] 2026-03-06 01:31:58.118615 | mon1 | 2026-03-06 01:31:58.118875 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:31:58.119191 | mon1 | Friday 06 March 2026 01:31:58 +0000 (0:00:00.027) 0:00:07.808 ********** 2026-03-06 01:31:59.341783 | mon1 | ok: [mon1] 2026-03-06 01:31:59.341862 | mon1 | 2026-03-06 01:31:59.341901 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:31:59.341911 | mon1 | Friday 06 March 2026 01:31:59 +0000 (0:00:01.221) 0:00:09.030 ********** 2026-03-06 01:31:59.907194 | mon1 | ok: [mon1] 2026-03-06 01:31:59.907378 | mon1 | 2026-03-06 01:31:59.907659 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:31:59.907909 | mon1 | Friday 06 March 2026 01:31:59 +0000 (0:00:00.566) 0:00:09.596 ********** 2026-03-06 01:32:01.108932 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:32:01.109148 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:32:01.109395 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:32:01.109721 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:32:01.109967 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:32:01.110182 | mon1 | 2026-03-06 01:32:01.110432 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:32:01.110701 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:01.201) 0:00:10.798 ********** 2026-03-06 01:32:01.774545 | mon1 | ok: [mon1] 2026-03-06 01:32:01.774787 | mon1 | 2026-03-06 01:32:01.775053 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:32:01.775316 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:00.657) 0:00:11.455 ********** 2026-03-06 01:32:01.775542 | mon1 | 2026-03-06 01:32:01.775890 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:32:01.776152 | mon1 | Friday 06 March 2026 01:32:01 +0000 (0:00:00.007) 0:00:11.463 ********** 2026-03-06 01:32:02.513110 | mon1 | ok: [mon1] 2026-03-06 01:32:02.513172 | mon1 | 2026-03-06 01:32:02.514709 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:32:02.514768 | mon1 | Friday 06 March 2026 01:32:02 +0000 (0:00:00.738) 0:00:12.202 ********** 2026-03-06 01:32:02.756819 | mon1 | ok: [mon1] 2026-03-06 01:32:02.756998 | mon1 | 2026-03-06 01:32:02.757313 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:32:02.757572 | mon1 | Friday 06 March 2026 01:32:02 +0000 (0:00:00.243) 0:00:12.445 ********** 2026-03-06 01:32:02.829781 | mon1 | ok: [mon1] => { 2026-03-06 01:32:02.830053 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:32:02.830513 | mon1 | } 2026-03-06 01:32:02.830787 | mon1 | 2026-03-06 01:32:02.831045 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:32:02.831291 | mon1 | Friday 06 March 2026 01:32:02 +0000 (0:00:00.073) 0:00:12.519 ********** 2026-03-06 01:32:03.261858 | mon1 | ok: [mon1] 2026-03-06 01:32:03.262036 | mon1 | 2026-03-06 01:32:03.262287 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:32:03.262527 | mon1 | Friday 06 March 2026 01:32:03 +0000 (0:00:00.431) 0:00:12.951 ********** 2026-03-06 01:32:06.571515 | mon1 | ok: [mon1] 2026-03-06 01:32:06.571694 | mon1 | 2026-03-06 01:32:06.572001 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:32:06.572250 | mon1 | Friday 06 March 2026 01:32:06 +0000 (0:00:03.309) 0:00:16.260 ********** 2026-03-06 01:32:07.853456 | mon1 | ok: [mon1] 2026-03-06 01:32:07.853542 | mon1 | 2026-03-06 01:32:07.853738 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:32:07.853903 | mon1 | Friday 06 March 2026 01:32:07 +0000 (0:00:01.281) 0:00:17.541 ********** 2026-03-06 01:32:08.210137 | mon1 | ok: [mon1] 2026-03-06 01:32:08.210380 | mon1 | 2026-03-06 01:32:08.210730 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:32:08.210994 | mon1 | Friday 06 March 2026 01:32:08 +0000 (0:00:00.356) 0:00:17.898 ********** 2026-03-06 01:32:08.757424 | mon1 | ok: [mon1] 2026-03-06 01:32:08.757663 | mon1 | 2026-03-06 01:32:08.757938 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:32:08.758221 | mon1 | Friday 06 March 2026 01:32:08 +0000 (0:00:00.547) 0:00:18.446 ********** 2026-03-06 01:32:09.466321 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-06 01:32:09.466538 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:32:09.466849 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:32:09.467078 | mon1 | 2026-03-06 01:32:09.467337 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:32:09.467605 | mon1 | Friday 06 March 2026 01:32:09 +0000 (0:00:00.708) 0:00:19.154 ********** 2026-03-06 01:32:10.042663 | mon1 | ok: [mon1] 2026-03-06 01:32:10.042873 | mon1 | 2026-03-06 01:32:10.043124 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:32:10.043383 | mon1 | Friday 06 March 2026 01:32:10 +0000 (0:00:00.576) 0:00:19.731 ********** 2026-03-06 01:32:10.624758 | mon1 | ok: [mon1] 2026-03-06 01:32:10.624831 | mon1 | 2026-03-06 01:32:10.624838 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:32:10.624844 | mon1 | Friday 06 March 2026 01:32:10 +0000 (0:00:00.571) 0:00:20.303 ********** 2026-03-06 01:32:10.625898 | mon1 | 2026-03-06 01:32:10.625932 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:32:10.625942 | mon1 | Friday 06 March 2026 01:32:10 +0000 (0:00:00.009) 0:00:20.312 ********** 2026-03-06 01:32:11.138317 | mon1 | ok: [mon1] 2026-03-06 01:32:11.138371 | mon1 | 2026-03-06 01:32:11.138381 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:32:11.138391 | mon1 | Friday 06 March 2026 01:32:11 +0000 (0:00:00.512) 0:00:20.825 ********** 2026-03-06 01:32:11.200283 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-06 01:32:11.200344 | mon1 | 2026-03-06 01:32:11.200355 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:32:11.200365 | mon1 | Friday 06 March 2026 01:32:11 +0000 (0:00:00.061) 0:00:20.887 ********** 2026-03-06 01:32:12.320066 | mon1 | ok: [mon1] 2026-03-06 01:32:12.320129 | mon1 | 2026-03-06 01:32:12.320141 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:32:12.320190 | mon1 | Friday 06 March 2026 01:32:12 +0000 (0:00:01.120) 0:00:22.007 ********** 2026-03-06 01:32:13.192737 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-06 01:32:13.192863 | mon1 | ok: [mon1] => (item=ssh) 2026-03-06 01:32:13.193661 | mon1 | 2026-03-06 01:32:13.193724 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:32:13.193736 | mon1 | Friday 06 March 2026 01:32:13 +0000 (0:00:00.872) 0:00:22.880 ********** 2026-03-06 01:32:13.610270 | mon1 | ok: [mon1] 2026-03-06 01:32:13.610329 | mon1 | 2026-03-06 01:32:13.610339 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:32:13.610349 | mon1 | Friday 06 March 2026 01:32:13 +0000 (0:00:00.416) 0:00:23.297 ********** 2026-03-06 01:32:13.886243 | mon1 | ok: [mon1] 2026-03-06 01:32:13.886298 | mon1 | 2026-03-06 01:32:13.886309 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:32:13.886319 | mon1 | Friday 06 March 2026 01:32:13 +0000 (0:00:00.275) 0:00:23.573 ********** 2026-03-06 01:32:14.387683 | mon1 | ok: [mon1] 2026-03-06 01:32:14.388437 | mon1 | 2026-03-06 01:32:14.388486 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:32:14.388498 | mon1 | Friday 06 March 2026 01:32:14 +0000 (0:00:00.502) 0:00:24.075 ********** 2026-03-06 01:32:14.760684 | mon1 | ok: [mon1] 2026-03-06 01:32:14.760764 | mon1 | 2026-03-06 01:32:14.760796 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-06 01:32:14.760806 | mon1 | Friday 06 March 2026 01:32:14 +0000 (0:00:00.372) 0:00:24.448 ********** 2026-03-06 01:32:14.848615 | mon1 | ok: [mon1] 2026-03-06 01:32:14.848684 | mon1 | 2026-03-06 01:32:14.848720 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-06 01:32:14.848731 | mon1 | Friday 06 March 2026 01:32:14 +0000 (0:00:00.087) 0:00:24.535 ********** 2026-03-06 01:32:15.157312 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:32:15.157383 | mon1 | 2026-03-06 01:32:15.157393 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-06 01:32:15.157403 | mon1 | Friday 06 March 2026 01:32:15 +0000 (0:00:00.308) 0:00:24.844 ********** 2026-03-06 01:32:15.212503 | mon1 | ok: [mon1] 2026-03-06 01:32:15.212627 | mon1 | 2026-03-06 01:32:15.212646 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-06 01:32:15.212659 | mon1 | Friday 06 March 2026 01:32:15 +0000 (0:00:00.054) 0:00:24.899 ********** 2026-03-06 01:32:15.260837 | mon1 | skipping: [mon1] 2026-03-06 01:32:15.260922 | mon1 | 2026-03-06 01:32:15.260931 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:32:15.261063 | mon1 | Friday 06 March 2026 01:32:15 +0000 (0:00:00.048) 0:00:24.948 ********** 2026-03-06 01:32:15.348531 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:32:15.348626 | mon1 | 2026-03-06 01:32:15.348634 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:32:15.348638 | mon1 | Friday 06 March 2026 01:32:15 +0000 (0:00:00.088) 0:00:25.036 ********** 2026-03-06 01:32:22.143183 | mon1 | ok: [mon1] 2026-03-06 01:32:22.144649 | mon1 | 2026-03-06 01:32:22.144704 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:32:22.144711 | mon1 | Friday 06 March 2026 01:32:22 +0000 (0:00:06.794) 0:00:31.831 ********** 2026-03-06 01:32:22.196515 | mon1 | ok: [mon1] => (item=mon1) 2026-03-06 01:32:22.196627 | mon1 | 2026-03-06 01:32:22.196644 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:32:22.196658 | mon1 | Friday 06 March 2026 01:32:22 +0000 (0:00:00.052) 0:00:31.883 ********** 2026-03-06 01:32:22.675064 | mon1 | ok: [mon1] 2026-03-06 01:32:22.675158 | mon1 | 2026-03-06 01:32:22.675207 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:32:22.675364 | mon1 | Friday 06 March 2026 01:32:22 +0000 (0:00:00.478) 0:00:32.362 ********** 2026-03-06 01:32:29.935166 | mon1 | ok: [mon1] 2026-03-06 01:32:29.935239 | mon1 | 2026-03-06 01:32:29.935359 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-06 01:32:29.935459 | mon1 | Friday 06 March 2026 01:32:29 +0000 (0:00:07.260) 0:00:39.623 ********** 2026-03-06 01:32:36.830840 | mon1 | ok: [mon1] 2026-03-06 01:32:36.830949 | mon1 | 2026-03-06 01:32:36.830965 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-06 01:32:36.831107 | mon1 | Friday 06 March 2026 01:32:36 +0000 (0:00:06.897) 0:00:46.520 ********** 2026-03-06 01:32:51.597443 | mon1 | ok: [mon1] 2026-03-06 01:32:51.597519 | mon1 | 2026-03-06 01:32:51.597533 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:32:51.597546 | mon1 | Friday 06 March 2026 01:32:51 +0000 (0:00:14.764) 0:01:01.284 ********** 2026-03-06 01:32:51.672194 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-06 01:32:51.672249 | mon1 | 2026-03-06 01:32:51.672263 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:32:51.672275 | mon1 | Friday 06 March 2026 01:32:51 +0000 (0:00:00.075) 0:01:01.360 ********** 2026-03-06 01:32:51.729055 | mon1 | skipping: [mon1] 2026-03-06 01:32:51.729088 | mon1 | 2026-03-06 01:32:51.729101 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:32:51.729114 | mon1 | Friday 06 March 2026 01:32:51 +0000 (0:00:00.056) 0:01:01.416 ********** 2026-03-06 01:32:51.778423 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-06 01:32:51.778489 | mon1 | skipping: [mon1] 2026-03-06 01:32:51.778503 | mon1 | 2026-03-06 01:32:51.778515 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:32:51.778528 | mon1 | Friday 06 March 2026 01:32:51 +0000 (0:00:00.048) 0:01:01.465 ********** 2026-03-06 01:32:52.128814 | mon1 | ok: [mon1] 2026-03-06 01:32:52.128895 | mon1 | 2026-03-06 01:32:52.128902 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:32:52.128909 | mon1 | Friday 06 March 2026 01:32:52 +0000 (0:00:00.351) 0:01:01.817 ********** 2026-03-06 01:32:59.366209 | mon1 | ok: [mon1] 2026-03-06 01:32:59.366296 | mon1 | 2026-03-06 01:32:59.366310 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-06 01:32:59.366323 | mon1 | Friday 06 March 2026 01:32:59 +0000 (0:00:07.236) 0:01:09.053 ********** 2026-03-06 01:33:06.008696 | mon1 | ok: [mon1] 2026-03-06 01:33:06.009422 | mon1 | 2026-03-06 01:33:06.009499 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-06 01:33:06.009513 | mon1 | Friday 06 March 2026 01:33:06 +0000 (0:00:06.643) 0:01:15.697 ********** 2026-03-06 01:33:12.683506 | mon1 | ok: [mon1] 2026-03-06 01:33:12.683611 | mon1 | 2026-03-06 01:33:12.683630 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-06 01:33:12.683643 | mon1 | Friday 06 March 2026 01:33:12 +0000 (0:00:06.673) 0:01:22.370 ********** 2026-03-06 01:33:20.637717 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-06 01:33:20.637826 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-06 01:33:20.638673 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-06 01:33:20.638694 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-06 01:33:20.638706 | mon1 | 2026-03-06 01:33:20.638888 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-06 01:33:20.639108 | mon1 | 2026-03-06 01:33:20.639356 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:33:20.639601 | mon1 | Friday 06 March 2026 01:33:20 +0000 (0:00:07.954) 0:01:30.325 ********** 2026-03-06 01:33:21.871364 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-06 01:33:21.871588 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:33:21.871866 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:33:21.872105 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:33:21.872351 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:33:21.886800 | mon1 | ok: [osd1] 2026-03-06 01:33:21.887038 | mon1 | 2026-03-06 01:33:21.887313 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:33:21.887617 | mon1 | Friday 06 March 2026 01:33:21 +0000 (0:00:01.250) 0:01:31.575 ********** 2026-03-06 01:33:22.150159 | mon1 | ok: [osd1] 2026-03-06 01:33:22.150266 | mon1 | 2026-03-06 01:33:22.150566 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:33:22.150849 | mon1 | Friday 06 March 2026 01:33:22 +0000 (0:00:00.262) 0:01:31.838 ********** 2026-03-06 01:33:22.191375 | mon1 | skipping: [osd1] 2026-03-06 01:33:22.191548 | mon1 | 2026-03-06 01:33:22.191721 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-06 01:33:22.191880 | mon1 | Friday 06 March 2026 01:33:22 +0000 (0:00:00.041) 0:01:31.880 ********** 2026-03-06 01:33:22.467657 | mon1 | ok: [osd1] 2026-03-06 01:33:22.467812 | mon1 | 2026-03-06 01:33:22.468091 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:33:22.468450 | mon1 | Friday 06 March 2026 01:33:22 +0000 (0:00:00.275) 0:01:32.156 ********** 2026-03-06 01:33:22.550378 | mon1 | ok: [osd1] => { 2026-03-06 01:33:22.550624 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-06 01:33:22.550895 | mon1 | } 2026-03-06 01:33:22.551078 | mon1 | 2026-03-06 01:33:22.551325 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:33:22.551567 | mon1 | Friday 06 March 2026 01:33:22 +0000 (0:00:00.082) 0:01:32.239 ********** 2026-03-06 01:33:22.961490 | mon1 | ok: [osd1] 2026-03-06 01:33:22.961724 | mon1 | 2026-03-06 01:33:22.961999 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:33:22.962264 | mon1 | Friday 06 March 2026 01:33:22 +0000 (0:00:00.410) 0:01:32.650 ********** 2026-03-06 01:33:23.010719 | mon1 | skipping: [osd1] 2026-03-06 01:33:23.010948 | mon1 | 2026-03-06 01:33:23.011216 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:33:23.011475 | mon1 | Friday 06 March 2026 01:33:23 +0000 (0:00:00.049) 0:01:32.699 ********** 2026-03-06 01:33:23.061598 | mon1 | skipping: [osd1] 2026-03-06 01:33:23.061832 | mon1 | 2026-03-06 01:33:23.062109 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:33:23.062359 | mon1 | Friday 06 March 2026 01:33:23 +0000 (0:00:00.050) 0:01:32.750 ********** 2026-03-06 01:33:23.317856 | mon1 | ok: [osd1] 2026-03-06 01:33:23.318054 | mon1 | 2026-03-06 01:33:23.318321 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-06 01:33:23.318572 | mon1 | Friday 06 March 2026 01:33:23 +0000 (0:00:00.255) 0:01:33.006 ********** 2026-03-06 01:33:24.379842 | mon1 | ok: [osd1] 2026-03-06 01:33:24.379943 | mon1 | 2026-03-06 01:33:24.379964 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:33:24.379979 | mon1 | Friday 06 March 2026 01:33:24 +0000 (0:00:01.061) 0:01:34.068 ********** 2026-03-06 01:33:24.598248 | mon1 | ok: [osd1] => { 2026-03-06 01:33:24.598353 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-06 01:33:24.598366 | mon1 | } 2026-03-06 01:33:24.598807 | mon1 | 2026-03-06 01:33:24.598909 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:33:24.598935 | mon1 | Friday 06 March 2026 01:33:24 +0000 (0:00:00.218) 0:01:34.286 ********** 2026-03-06 01:33:25.185225 | mon1 | ok: [osd1] 2026-03-06 01:33:25.185318 | mon1 | 2026-03-06 01:33:25.185670 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:33:25.185723 | mon1 | Friday 06 March 2026 01:33:25 +0000 (0:00:00.587) 0:01:34.874 ********** 2026-03-06 01:33:27.490755 | mon1 | ok: [osd1] 2026-03-06 01:33:27.490840 | mon1 | 2026-03-06 01:33:27.491332 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-06 01:33:27.491400 | mon1 | Friday 06 March 2026 01:33:27 +0000 (0:00:02.304) 0:01:37.178 ********** 2026-03-06 01:33:27.526448 | mon1 | skipping: [osd1] 2026-03-06 01:33:27.526472 | mon1 | 2026-03-06 01:33:27.526479 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-06 01:33:27.526486 | mon1 | Friday 06 March 2026 01:33:27 +0000 (0:00:00.035) 0:01:37.214 ********** 2026-03-06 01:33:27.566368 | mon1 | skipping: [osd1] 2026-03-06 01:33:27.566388 | mon1 | 2026-03-06 01:33:27.566396 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-06 01:33:27.566404 | mon1 | Friday 06 March 2026 01:33:27 +0000 (0:00:00.040) 0:01:37.255 ********** 2026-03-06 01:33:27.605040 | mon1 | skipping: [osd1] 2026-03-06 01:33:27.605072 | mon1 | 2026-03-06 01:33:27.605084 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-06 01:33:27.605096 | mon1 | Friday 06 March 2026 01:33:27 +0000 (0:00:00.037) 0:01:37.292 ********** 2026-03-06 01:33:29.023760 | mon1 | ok: [osd1] 2026-03-06 01:33:29.023836 | mon1 | 2026-03-06 01:33:29.023852 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-06 01:33:29.023941 | mon1 | Friday 06 March 2026 01:33:29 +0000 (0:00:01.419) 0:01:38.712 ********** 2026-03-06 01:33:29.597371 | mon1 | ok: [osd1] 2026-03-06 01:33:29.597453 | mon1 | 2026-03-06 01:33:29.597469 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-06 01:33:29.597481 | mon1 | Friday 06 March 2026 01:33:29 +0000 (0:00:00.572) 0:01:39.284 ********** 2026-03-06 01:33:30.767763 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-06 01:33:30.767834 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-06 01:33:30.767848 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-06 01:33:30.767887 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-06 01:33:30.768648 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-06 01:33:30.768722 | mon1 | 2026-03-06 01:33:30.768942 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-06 01:33:30.769266 | mon1 | Friday 06 March 2026 01:33:30 +0000 (0:00:01.169) 0:01:40.454 ********** 2026-03-06 01:33:31.418268 | mon1 | ok: [osd1] 2026-03-06 01:33:31.418678 | mon1 | 2026-03-06 01:33:31.419025 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-06 01:33:31.419348 | mon1 | Friday 06 March 2026 01:33:31 +0000 (0:00:00.645) 0:01:41.100 ********** 2026-03-06 01:33:31.419729 | mon1 | 2026-03-06 01:33:31.420060 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-06 01:33:31.420406 | mon1 | Friday 06 March 2026 01:33:31 +0000 (0:00:00.006) 0:01:41.107 ********** 2026-03-06 01:33:31.898432 | mon1 | ok: [osd1] 2026-03-06 01:33:31.898508 | mon1 | 2026-03-06 01:33:31.898519 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-06 01:33:31.898530 | mon1 | Friday 06 March 2026 01:33:31 +0000 (0:00:00.478) 0:01:41.585 ********** 2026-03-06 01:33:32.155470 | mon1 | ok: [osd1] 2026-03-06 01:33:32.155542 | mon1 | 2026-03-06 01:33:32.155552 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-06 01:33:32.155562 | mon1 | Friday 06 March 2026 01:33:32 +0000 (0:00:00.257) 0:01:41.843 ********** 2026-03-06 01:33:32.234759 | mon1 | ok: [osd1] => { 2026-03-06 01:33:32.234849 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-06 01:33:32.234860 | mon1 | } 2026-03-06 01:33:32.235464 | mon1 | 2026-03-06 01:33:32.235494 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-06 01:33:32.235505 | mon1 | Friday 06 March 2026 01:33:32 +0000 (0:00:00.079) 0:01:41.922 ********** 2026-03-06 01:33:32.683775 | mon1 | ok: [osd1] 2026-03-06 01:33:32.683843 | mon1 | 2026-03-06 01:33:32.684215 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-06 01:33:32.684276 | mon1 | Friday 06 March 2026 01:33:32 +0000 (0:00:00.449) 0:01:42.372 ********** 2026-03-06 01:33:36.009074 | mon1 | ok: [osd1] 2026-03-06 01:33:36.009167 | mon1 | 2026-03-06 01:33:36.011751 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-06 01:33:36.011850 | mon1 | Friday 06 March 2026 01:33:36 +0000 (0:00:03.325) 0:01:45.697 ********** 2026-03-06 01:33:37.006755 | mon1 | ok: [osd1] 2026-03-06 01:33:37.006896 | mon1 | 2026-03-06 01:33:37.007179 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-06 01:33:37.007260 | mon1 | Friday 06 March 2026 01:33:37 +0000 (0:00:00.997) 0:01:46.694 ********** 2026-03-06 01:33:37.254768 | mon1 | ok: [osd1] 2026-03-06 01:33:37.255608 | mon1 | 2026-03-06 01:33:37.255689 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-06 01:33:37.255705 | mon1 | Friday 06 March 2026 01:33:37 +0000 (0:00:00.248) 0:01:46.943 ********** 2026-03-06 01:33:37.825219 | mon1 | ok: [osd1] 2026-03-06 01:33:37.825287 | mon1 | 2026-03-06 01:33:37.825301 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-06 01:33:37.825313 | mon1 | Friday 06 March 2026 01:33:37 +0000 (0:00:00.569) 0:01:47.513 ********** 2026-03-06 01:33:38.535655 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-06 01:33:38.535720 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-06 01:33:38.535729 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-06 01:33:38.535737 | mon1 | 2026-03-06 01:33:38.535745 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-06 01:33:38.535758 | mon1 | Friday 06 March 2026 01:33:38 +0000 (0:00:00.710) 0:01:48.223 ********** 2026-03-06 01:33:39.078381 | mon1 | ok: [osd1] 2026-03-06 01:33:39.078474 | mon1 | 2026-03-06 01:33:39.078485 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-06 01:33:39.078495 | mon1 | Friday 06 March 2026 01:33:39 +0000 (0:00:00.542) 0:01:48.765 ********** 2026-03-06 01:33:39.652245 | mon1 | ok: [osd1] 2026-03-06 01:33:39.652328 | mon1 | 2026-03-06 01:33:39.652339 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-06 01:33:39.652352 | mon1 | Friday 06 March 2026 01:33:39 +0000 (0:00:00.566) 0:01:49.331 ********** 2026-03-06 01:33:39.652363 | mon1 | 2026-03-06 01:33:39.652375 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-06 01:33:39.652386 | mon1 | Friday 06 March 2026 01:33:39 +0000 (0:00:00.007) 0:01:49.339 ********** 2026-03-06 01:33:40.131281 | mon1 | ok: [osd1] 2026-03-06 01:33:40.131367 | mon1 | 2026-03-06 01:33:40.131377 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-06 01:33:40.131426 | mon1 | Friday 06 March 2026 01:33:40 +0000 (0:00:00.478) 0:01:49.817 ********** 2026-03-06 01:33:40.188746 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-06 01:33:40.188827 | mon1 | 2026-03-06 01:33:40.189051 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-06 01:33:40.189300 | mon1 | Friday 06 March 2026 01:33:40 +0000 (0:00:00.060) 0:01:49.877 ********** 2026-03-06 01:33:41.320088 | mon1 | ok: [osd1] 2026-03-06 01:33:41.320249 | mon1 | 2026-03-06 01:33:41.320629 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-06 01:33:41.320926 | mon1 | Friday 06 March 2026 01:33:41 +0000 (0:00:01.130) 0:01:51.008 ********** 2026-03-06 01:33:42.146226 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-06 01:33:42.146324 | mon1 | ok: [osd1] => (item=ssh) 2026-03-06 01:33:42.146336 | mon1 | 2026-03-06 01:33:42.147724 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-06 01:33:42.147827 | mon1 | Friday 06 March 2026 01:33:42 +0000 (0:00:00.826) 0:01:51.834 ********** 2026-03-06 01:33:42.543703 | mon1 | ok: [osd1] 2026-03-06 01:33:42.543786 | mon1 | 2026-03-06 01:33:42.543798 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-06 01:33:42.543960 | mon1 | Friday 06 March 2026 01:33:42 +0000 (0:00:00.396) 0:01:52.231 ********** 2026-03-06 01:33:42.799223 | mon1 | ok: [osd1] 2026-03-06 01:33:42.799289 | mon1 | 2026-03-06 01:33:42.799299 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-06 01:33:42.799309 | mon1 | Friday 06 March 2026 01:33:42 +0000 (0:00:00.254) 0:01:52.486 ********** 2026-03-06 01:33:43.103381 | mon1 | ok: [osd1] 2026-03-06 01:33:43.103459 | mon1 | 2026-03-06 01:33:43.103470 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-06 01:33:43.103480 | mon1 | Friday 06 March 2026 01:33:43 +0000 (0:00:00.303) 0:01:52.790 ********** 2026-03-06 01:33:43.363237 | mon1 | ok: [osd1] 2026-03-06 01:33:43.363310 | mon1 | 2026-03-06 01:33:43.363321 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-06 01:33:43.363344 | mon1 | Friday 06 March 2026 01:33:43 +0000 (0:00:00.260) 0:01:53.051 ********** 2026-03-06 01:33:43.652716 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-06 01:33:43.652786 | mon1 | 2026-03-06 01:33:43.652797 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-06 01:33:43.652817 | mon1 | Friday 06 March 2026 01:33:43 +0000 (0:00:00.288) 0:01:53.339 ********** 2026-03-06 01:33:43.710186 | mon1 | ok: [osd1] 2026-03-06 01:33:43.711670 | mon1 | 2026-03-06 01:33:43.711756 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-06 01:33:43.711768 | mon1 | Friday 06 March 2026 01:33:43 +0000 (0:00:00.058) 0:01:53.398 ********** 2026-03-06 01:33:43.777248 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-06 01:33:43.780617 | mon1 | 2026-03-06 01:33:43.780645 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-06 01:33:43.780677 | mon1 | Friday 06 March 2026 01:33:43 +0000 (0:00:00.067) 0:01:53.465 ********** 2026-03-06 01:33:50.439564 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:50.439823 | mon1 | 2026-03-06 01:33:50.440104 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-06 01:33:50.440370 | mon1 | Friday 06 March 2026 01:33:50 +0000 (0:00:06.662) 0:02:00.128 ********** 2026-03-06 01:33:50.498865 | mon1 | ok: [osd1] => (item=osd1) 2026-03-06 01:33:50.499059 | mon1 | 2026-03-06 01:33:50.499315 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-06 01:33:50.499567 | mon1 | Friday 06 March 2026 01:33:50 +0000 (0:00:00.059) 0:02:00.188 ********** 2026-03-06 01:33:50.835026 | mon1 | ok: [osd1] 2026-03-06 01:33:50.835189 | mon1 | 2026-03-06 01:33:50.835456 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-06 01:33:50.835719 | mon1 | Friday 06 March 2026 01:33:50 +0000 (0:00:00.335) 0:02:00.523 ********** 2026-03-06 01:33:58.021219 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:33:58.021437 | mon1 | 2026-03-06 01:33:58.021849 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-06 01:33:58.022041 | mon1 | Friday 06 March 2026 01:33:58 +0000 (0:00:07.186) 0:02:07.710 ********** 2026-03-06 01:34:03.679763 | mon1 | ok: [osd1] 2026-03-06 01:34:03.679850 | mon1 | 2026-03-06 01:34:03.679871 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-06 01:34:03.679916 | mon1 | Friday 06 March 2026 01:34:03 +0000 (0:00:05.658) 0:02:13.368 ********** 2026-03-06 01:34:26.859200 | mon1 | ok: [osd1] 2026-03-06 01:34:26.859329 | mon1 | 2026-03-06 01:34:26.859345 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-06 01:34:26.859359 | mon1 | Friday 06 March 2026 01:34:26 +0000 (0:00:23.178) 0:02:36.547 ********** 2026-03-06 01:34:26.927123 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-06 01:34:26.927149 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-06 01:34:26.927157 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-06 01:34:26.927165 | mon1 | skipping: [osd1] 2026-03-06 01:34:26.927173 | mon1 | 2026-03-06 01:34:26.927180 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-06 01:34:26.927188 | mon1 | Friday 06 March 2026 01:34:26 +0000 (0:00:00.067) 0:02:36.615 ********** 2026-03-06 01:34:33.616670 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:34:33.617375 | mon1 | 2026-03-06 01:34:33.617457 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-06 01:34:33.617472 | mon1 | Friday 06 March 2026 01:34:33 +0000 (0:00:06.689) 0:02:43.304 ********** 2026-03-06 01:34:40.260180 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:34:40.260252 | mon1 | 2026-03-06 01:34:40.260266 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-06 01:34:40.260278 | mon1 | Friday 06 March 2026 01:34:40 +0000 (0:00:06.643) 0:02:49.948 ********** 2026-03-06 01:34:40.320678 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-06 01:34:40.320719 | mon1 | 2026-03-06 01:34:40.320733 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-06 01:34:40.320951 | mon1 | Friday 06 March 2026 01:34:40 +0000 (0:00:00.061) 0:02:50.009 ********** 2026-03-06 01:34:40.375241 | mon1 | ok: [osd1] 2026-03-06 01:34:40.375286 | mon1 | 2026-03-06 01:34:40.375598 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-06 01:34:40.375660 | mon1 | Friday 06 March 2026 01:34:40 +0000 (0:00:00.054) 0:02:50.063 ********** 2026-03-06 01:34:47.044709 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-06 01:34:47.044800 | mon1 | 2026-03-06 01:34:47.045133 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-06 01:34:47.045208 | mon1 | Friday 06 March 2026 01:34:47 +0000 (0:00:06.660) 0:02:56.723 ********** 2026-03-06 01:34:47.088404 | mon1 | ok: [osd1] 2026-03-06 01:34:47.088471 | mon1 | 2026-03-06 01:34:47.088483 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-06 01:34:47.088494 | mon1 | Friday 06 March 2026 01:34:47 +0000 (0:00:00.051) 0:02:56.775 ********** 2026-03-06 01:34:47.131227 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:34:47.131298 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:34:47.131858 | mon1 | skipping: [osd1] => (item=1) 2026-03-06 01:34:47.131903 | mon1 | skipping: [osd1] 2026-03-06 01:34:47.131908 | mon1 | 2026-03-06 01:34:47.131912 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-06 01:34:47.131917 | mon1 | Friday 06 March 2026 01:34:47 +0000 (0:00:00.043) 0:02:56.819 ********** 2026-03-06 01:34:47.176716 | mon1 | skipping: [osd1] 2026-03-06 01:34:47.176803 | mon1 | 2026-03-06 01:34:47.176814 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:34:47.176826 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-06 01:34:47.176835 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-06 01:34:47.176852 | mon1 | 2026-03-06 01:34:47.177639 | mon1 | 2026-03-06 01:34:47.177694 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:34:47.177705 | mon1 | Friday 06 March 2026 01:34:47 +0000 (0:00:00.044) 0:02:56.863 ********** 2026-03-06 01:34:47.177806 | mon1 | =============================================================================== 2026-03-06 01:34:47.178117 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 23.18s 2026-03-06 01:34:47.178453 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.76s 2026-03-06 01:34:47.178788 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.95s 2026-03-06 01:34:47.179103 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.26s 2026-03-06 01:34:47.179406 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.24s 2026-03-06 01:34:47.179750 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.19s 2026-03-06 01:34:47.180068 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.90s 2026-03-06 01:34:47.180373 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.79s 2026-03-06 01:34:47.180701 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.69s 2026-03-06 01:34:47.181016 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.67s 2026-03-06 01:34:47.181345 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.66s 2026-03-06 01:34:47.181678 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.66s 2026-03-06 01:34:47.181995 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.64s 2026-03-06 01:34:47.182744 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.64s 2026-03-06 01:34:47.182780 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.66s 2026-03-06 01:34:47.183511 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.33s 2026-03-06 01:34:47.183528 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s 2026-03-06 01:34:47.183535 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.53s 2026-03-06 01:34:47.183541 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.30s 2026-03-06 01:34:47.183547 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 1.42s 2026-03-06 01:34:47.287764 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-06 01:34:47.297839 | mon1 | INFO [default > side_effect] Executing 2026-03-06 01:34:47.298308 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:34:47.305512 | mon1 | INFO [default > verify] Executing 2026-03-06 01:34:48.094828 | mon1 | 2026-03-06 01:34:48.094904 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-06 01:34:48.094911 | mon1 | 2026-03-06 01:34:48.094916 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-06 01:34:48.094928 | mon1 | Friday 06 March 2026 01:34:48 +0000 (0:00:00.008) 0:00:00.008 ********** 2026-03-06 01:34:50.377844 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-06 01:34:50.378150 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-06 01:34:50.378165 | mon1 | interpreter could change the meaning of that path. See 2026-03-06 01:34:50.378273 | mon1 | https://docs.ansible.com/ansible- 2026-03-06 01:34:50.378425 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-06 01:34:50.386970 | mon1 | ok: [mon1] 2026-03-06 01:34:50.387182 | mon1 | 2026-03-06 01:34:50.387423 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-06 01:34:50.387698 | mon1 | Friday 06 March 2026 01:34:50 +0000 (0:00:02.293) 0:00:02.301 ********** 2026-03-06 01:35:01.200687 | mon1 | ok: [mon1] 2026-03-06 01:35:01.200754 | mon1 | 2026-03-06 01:35:01.200876 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-06 01:35:01.201033 | mon1 | Friday 06 March 2026 01:35:01 +0000 (0:00:10.813) 0:00:13.114 ********** 2026-03-06 01:35:01.233912 | mon1 | ok: [mon1] => { 2026-03-06 01:35:01.234040 | mon1 | "_ceph_health": { 2026-03-06 01:35:01.234186 | mon1 | "changed": false, 2026-03-06 01:35:01.234361 | mon1 | "cmd": [ 2026-03-06 01:35:01.234480 | mon1 | "cephadm", 2026-03-06 01:35:01.234652 | mon1 | "shell", 2026-03-06 01:35:01.234787 | mon1 | "--", 2026-03-06 01:35:01.234928 | mon1 | "ceph", 2026-03-06 01:35:01.235068 | mon1 | "health" 2026-03-06 01:35:01.235208 | mon1 | ], 2026-03-06 01:35:01.235352 | mon1 | "delta": "0:00:10.465941", 2026-03-06 01:35:01.235497 | mon1 | "end": "2026-03-06 01:35:01.151435", 2026-03-06 01:35:01.235664 | mon1 | "failed": false, 2026-03-06 01:35:01.235799 | mon1 | "msg": "", 2026-03-06 01:35:01.235939 | mon1 | "rc": 0, 2026-03-06 01:35:01.236084 | mon1 | "start": "2026-03-06 01:34:50.685494", 2026-03-06 01:35:01.236246 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-06 01:35:01.236390 | mon1 | "stderr_lines": [ 2026-03-06 01:35:01.236539 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-06 01:35:01.236720 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-06 01:35:01.236863 | mon1 | ], 2026-03-06 01:35:01.237042 | mon1 | "stdout": "HEALTH_OK", 2026-03-06 01:35:01.237184 | mon1 | "stdout_lines": [ 2026-03-06 01:35:01.237326 | mon1 | "HEALTH_OK" 2026-03-06 01:35:01.237466 | mon1 | ] 2026-03-06 01:35:01.237641 | mon1 | } 2026-03-06 01:35:01.237791 | mon1 | } 2026-03-06 01:35:01.237931 | mon1 | 2026-03-06 01:35:01.238087 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-06 01:35:01.238246 | mon1 | Friday 06 March 2026 01:35:01 +0000 (0:00:00.033) 0:00:13.148 ********** 2026-03-06 01:35:01.263923 | mon1 | ok: [mon1] => { 2026-03-06 01:35:01.264066 | mon1 | "changed": false, 2026-03-06 01:35:01.264216 | mon1 | "msg": "All assertions passed" 2026-03-06 01:35:01.264365 | mon1 | } 2026-03-06 01:35:01.264511 | mon1 | 2026-03-06 01:35:01.264706 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-06 01:35:01.264860 | mon1 | Friday 06 March 2026 01:35:01 +0000 (0:00:00.030) 0:00:13.178 ********** 2026-03-06 01:35:09.655755 | mon1 | changed: [mon1] 2026-03-06 01:35:09.655831 | mon1 | 2026-03-06 01:35:09.655859 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-06 01:35:09.656057 | mon1 | Friday 06 March 2026 01:35:09 +0000 (0:00:08.390) 0:00:21.569 ********** 2026-03-06 01:35:12.610202 | mon1 | changed: [mon1] 2026-03-06 01:35:12.610325 | mon1 | 2026-03-06 01:35:12.610669 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-06 01:35:12.610692 | mon1 | Friday 06 March 2026 01:35:12 +0000 (0:00:02.954) 0:00:24.523 ********** 2026-03-06 01:35:14.147681 | mon1 | ok: [mon1] 2026-03-06 01:35:14.147728 | mon1 | 2026-03-06 01:35:14.147857 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-06 01:35:14.148125 | mon1 | Friday 06 March 2026 01:35:14 +0000 (0:00:01.536) 0:00:26.060 ********** 2026-03-06 01:35:14.186785 | mon1 | ok: [mon1] => { 2026-03-06 01:35:14.187005 | mon1 | "changed": false, 2026-03-06 01:35:14.187238 | mon1 | "msg": "All assertions passed" 2026-03-06 01:35:14.187468 | mon1 | } 2026-03-06 01:35:14.187716 | mon1 | 2026-03-06 01:35:14.187950 | mon1 | PLAY RECAP ********************************************************************* 2026-03-06 01:35:14.188246 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-06 01:35:14.188529 | mon1 | 2026-03-06 01:35:14.188771 | mon1 | 2026-03-06 01:35:14.189008 | mon1 | TASKS RECAP ******************************************************************** 2026-03-06 01:35:14.189250 | mon1 | Friday 06 March 2026 01:35:14 +0000 (0:00:00.041) 0:00:26.101 ********** 2026-03-06 01:35:14.189476 | mon1 | =============================================================================== 2026-03-06 01:35:14.189746 | mon1 | Get cluster health status ---------------------------------------------- 10.81s 2026-03-06 01:35:14.189979 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.39s 2026-03-06 01:35:14.190216 | mon1 | Create a test Ceph key -------------------------------------------------- 2.95s 2026-03-06 01:35:14.190450 | mon1 | Gathering Facts --------------------------------------------------------- 2.29s 2026-03-06 01:35:14.190715 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.54s 2026-03-06 01:35:14.190945 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-06 01:35:14.191180 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-03-06 01:35:14.191412 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-03-06 01:35:14.262091 | mon1 | INFO [default > verify] Executed: Successful 2026-03-06 01:35:14.274443 | mon1 | INFO [default > cleanup] Executing 2026-03-06 01:35:14.274786 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-06 01:35:14.280486 | mon1 | INFO [default > destroy] Executing 2026-03-06 01:35:14.280532 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-06 01:35:14.280648 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-06 01:35:14.280965 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-06 01:35:14.634153 | mon1 | ok: Runtime: 0:15:34.290848 2026-03-06 01:35:14.648102 | 2026-03-06 01:35:14.648186 | PLAY RECAP 2026-03-06 01:35:14.648233 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-06 01:35:14.648257 | 2026-03-06 01:35:14.752003 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-06 01:35:14.755806 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-06 01:35:15.305607 | 2026-03-06 01:35:15.305723 | PLAY [all] 2026-03-06 01:35:15.318075 | 2026-03-06 01:35:15.318176 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-06 01:35:15.369561 | mon1 | ok 2026-03-06 01:35:15.389856 | osd1 | ok 2026-03-06 01:35:15.395269 | 2026-03-06 01:35:15.395347 | TASK [fetch-output : Set log path for single node] 2026-03-06 01:35:15.417150 | mon1 | skipping: Conditional result was False 2026-03-06 01:35:15.428363 | osd1 | skipping: Conditional result was False 2026-03-06 01:35:15.437836 | 2026-03-06 01:35:15.437953 | LOOP [fetch-output : Ensure local output dirs] 2026-03-06 01:35:15.799819 | mon1 -> localhost | changed: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/logs/mon1" 2026-03-06 01:35:15.801155 | osd1 -> localhost | changed: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/logs/osd1" 2026-03-06 01:35:15.991164 | mon1 -> localhost | changed: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/artifacts" 2026-03-06 01:35:16.006011 | osd1 -> localhost | ok: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/artifacts" 2026-03-06 01:35:16.197612 | mon1 -> localhost | changed: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/docs" 2026-03-06 01:35:16.215996 | osd1 -> localhost | ok: "/var/lib/zuul/builds/2fb4a734d9e44f6893221c8742284768/work/docs" 2026-03-06 01:35:16.216117 | osd1 -> localhost | changed: All items complete 2026-03-06 01:35:16.216172 | 2026-03-06 01:35:16.237193 | 2026-03-06 01:35:16.237297 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-06 01:35:16.839558 | osd1 | changed: .d..t...... ./ 2026-03-06 01:35:16.911888 | mon1 | changed: .d..t...... ./ 2026-03-06 01:35:17.303097 | osd1 | changed: .d..t...... ./ 2026-03-06 01:35:17.367413 | mon1 | changed: .d..t...... ./ 2026-03-06 01:35:17.747589 | osd1 | changed: .d..t...... ./ 2026-03-06 01:35:17.806859 | mon1 | changed: .d..t...... ./ 2026-03-06 01:35:17.807069 | mon1 | changed: All items complete 2026-03-06 01:35:17.807149 | 2026-03-06 01:35:17.832056 | 2026-03-06 01:35:17.832188 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-06 01:35:18.226568 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006739 2026-03-06 01:35:18.437336 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007003 2026-03-06 01:35:18.458282 | 2026-03-06 01:35:18.458442 | PLAY [all] 2026-03-06 01:35:18.466113 | 2026-03-06 01:35:18.466202 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-06 01:35:18.912738 | mon1 | changed 2026-03-06 01:35:19.124688 | osd1 | changed 2026-03-06 01:35:19.136057 | 2026-03-06 01:35:19.136104 | PLAY RECAP 2026-03-06 01:35:19.136150 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-06 01:35:19.136178 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-06 01:35:19.136211 | 2026-03-06 01:35:19.237964 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-06 01:35:19.243146 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-06 01:35:19.773483 | 2026-03-06 01:35:19.773595 | PLAY [localhost] 2026-03-06 01:35:19.782877 | 2026-03-06 01:35:19.782957 | TASK [Generate Zuul manifest] 2026-03-06 01:35:19.803396 | localhost | ok 2026-03-06 01:35:19.818972 | 2026-03-06 01:35:19.819055 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-06 01:35:20.123056 | localhost | changed 2026-03-06 01:35:20.134880 | 2026-03-06 01:35:20.134958 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-06 01:35:20.164189 | localhost | ok 2026-03-06 01:35:20.172175 | 2026-03-06 01:35:20.172249 | TASK [Upload logs] 2026-03-06 01:35:20.193113 | localhost | ok 2026-03-06 01:35:20.254410 | 2026-03-06 01:35:20.254522 | TASK [Set zuul-log-path fact] 2026-03-06 01:35:20.270551 | localhost | ok 2026-03-06 01:35:20.280664 | 2026-03-06 01:35:20.280729 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-06 01:35:20.306779 | localhost | ok 2026-03-06 01:35:20.313181 | 2026-03-06 01:35:20.313244 | TASK [upload-logs : Create log directories] 2026-03-06 01:35:20.687565 | localhost | changed 2026-03-06 01:35:20.693928 | 2026-03-06 01:35:20.694036 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-06 01:35:21.058320 | localhost -> localhost | ok: Runtime: 0:00:00.004082 2026-03-06 01:35:21.065461 | 2026-03-06 01:35:21.065594 | TASK [upload-logs : Upload logs to log server] 2026-03-06 01:35:21.500028 | localhost | Output suppressed because no_log was given 2026-03-06 01:35:21.505078 | 2026-03-06 01:35:21.505164 | LOOP [upload-logs : Compress console log and json output] 2026-03-06 01:35:21.544186 | localhost | skipping: Conditional result was False 2026-03-06 01:35:21.552560 | localhost | skipping: Conditional result was False 2026-03-06 01:35:21.562847 | 2026-03-06 01:35:21.562978 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-06 01:35:21.600103 | localhost | skipping: Conditional result was False 2026-03-06 01:35:21.600500 | 2026-03-06 01:35:21.604371 | localhost | skipping: Conditional result was False 2026-03-06 01:35:21.613599 | 2026-03-06 01:35:21.613771 | LOOP [upload-logs : Upload console log and json output]