2026-04-21 19:19:26.071108 | Job console starting 2026-04-21 19:19:26.095829 | Updating git repos 2026-04-21 19:19:26.133210 | Cloning repos into workspace 2026-04-21 19:19:26.178583 | Restoring repo states 2026-04-21 19:19:26.186421 | Merging changes 2026-04-21 19:19:26.433659 | Checking out repos 2026-04-21 19:19:26.715648 | Preparing playbooks 2026-04-21 19:19:27.858305 | Running Ansible setup 2026-04-21 19:19:32.442389 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-21 19:19:33.042028 | 2026-04-21 19:19:33.042396 | PLAY [localhost] 2026-04-21 19:19:33.050233 | 2026-04-21 19:19:33.050303 | TASK [Gathering Facts] 2026-04-21 19:19:33.928376 | localhost | ok 2026-04-21 19:19:33.935834 | 2026-04-21 19:19:33.935909 | TASK [Setup log path fact] 2026-04-21 19:19:33.954359 | localhost | ok 2026-04-21 19:19:33.964208 | 2026-04-21 19:19:33.964276 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-21 19:19:33.991476 | localhost | ok 2026-04-21 19:19:33.997211 | 2026-04-21 19:19:33.997273 | TASK [emit-job-header : Print job information] 2026-04-21 19:19:34.035041 | # Job Information 2026-04-21 19:19:34.035154 | Ansible Version: 2.16.16 2026-04-21 19:19:34.035187 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-04-21 19:19:34.035209 | Pipeline: check 2026-04-21 19:19:34.035230 | Executor: 0a8996d2b663 2026-04-21 19:19:34.035249 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/72 2026-04-21 19:19:34.035272 | Event ID: e792b610-3db6-11f1-9816-181e6ea45e76 2026-04-21 19:19:34.037891 | 2026-04-21 19:19:34.037955 | LOOP [emit-job-header : Print node information] 2026-04-21 19:19:34.137734 | localhost | ok: 2026-04-21 19:19:34.138103 | localhost | # Node Information 2026-04-21 19:19:34.138166 | localhost | Inventory Hostname: mon1 2026-04-21 19:19:34.138214 | localhost | Hostname: np0000168956 2026-04-21 19:19:34.138258 | localhost | Username: zuul 2026-04-21 19:19:34.138307 | localhost | Distro: Ubuntu 24.04 2026-04-21 19:19:34.138350 | localhost | Provider: yul1 2026-04-21 19:19:34.138392 | localhost | Region: ca-ymq-1 2026-04-21 19:19:34.138433 | localhost | Label: ubuntu-noble 2026-04-21 19:19:34.138475 | localhost | Product Name: OpenStack Nova 2026-04-21 19:19:34.138516 | localhost | Interface IP: 199.204.45.162 2026-04-21 19:19:34.186107 | localhost | ok: 2026-04-21 19:19:34.186262 | localhost | # Node Information 2026-04-21 19:19:34.186309 | localhost | Inventory Hostname: osd1 2026-04-21 19:19:34.186347 | localhost | Hostname: np0000168957 2026-04-21 19:19:34.186382 | localhost | Username: zuul 2026-04-21 19:19:34.186418 | localhost | Distro: Ubuntu 24.04 2026-04-21 19:19:34.186452 | localhost | Provider: yul1 2026-04-21 19:19:34.186485 | localhost | Region: ca-ymq-1 2026-04-21 19:19:34.186518 | localhost | Label: ubuntu-noble 2026-04-21 19:19:34.186551 | localhost | Product Name: OpenStack Nova 2026-04-21 19:19:34.186586 | localhost | Interface IP: 199.204.45.38 2026-04-21 19:19:34.198020 | 2026-04-21 19:19:34.198195 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-21 19:19:34.580197 | localhost -> localhost | changed 2026-04-21 19:19:34.587778 | 2026-04-21 19:19:34.588034 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-21 19:19:35.428124 | localhost -> localhost | changed 2026-04-21 19:19:35.438568 | 2026-04-21 19:19:35.438709 | PLAY [all] 2026-04-21 19:19:35.448873 | 2026-04-21 19:19:35.448986 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-21 19:19:35.696854 | mon1 -> localhost | ok 2026-04-21 19:19:35.709255 | 2026-04-21 19:19:35.709332 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-21 19:19:35.744680 | mon1 | ok 2026-04-21 19:19:35.750060 | osd1 | ok 2026-04-21 19:19:35.769214 | mon1 | included: /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-21 19:19:35.769270 | osd1 | included: /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-21 19:19:35.776128 | 2026-04-21 19:19:35.776192 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-21 19:19:36.938172 | mon1 -> localhost | Generating public/private rsa key pair. 2026-04-21 19:19:36.938443 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/aa27d512de43437196b33cc8aa60235f_id_rsa 2026-04-21 19:19:36.938489 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/aa27d512de43437196b33cc8aa60235f_id_rsa.pub 2026-04-21 19:19:36.938522 | mon1 -> localhost | The key fingerprint is: 2026-04-21 19:19:36.938553 | mon1 -> localhost | SHA256:V6zR/xfDOCBN+dg8MyCsElLWu6zO6VLKY0KsKrc117g zuul-build-sshkey 2026-04-21 19:19:36.938581 | mon1 -> localhost | The key's randomart image is: 2026-04-21 19:19:36.938609 | mon1 -> localhost | +---[RSA 3072]----+ 2026-04-21 19:19:36.938637 | mon1 -> localhost | | .o. . .. | 2026-04-21 19:19:36.938665 | mon1 -> localhost | | ... . oo= | 2026-04-21 19:19:36.938692 | mon1 -> localhost | | . . o.ooX | 2026-04-21 19:19:36.938720 | mon1 -> localhost | | . o .=.Oo | 2026-04-21 19:19:36.938747 | mon1 -> localhost | |. o S o o=+ | 2026-04-21 19:19:36.938776 | mon1 -> localhost | | o . = . ..o| 2026-04-21 19:19:36.938806 | mon1 -> localhost | |o . = + . o| 2026-04-21 19:19:36.938832 | mon1 -> localhost | |o..B.+.. .| 2026-04-21 19:19:36.938857 | mon1 -> localhost | |+.+.==E | 2026-04-21 19:19:36.938883 | mon1 -> localhost | +----[SHA256]-----+ 2026-04-21 19:19:36.938948 | mon1 -> localhost | ok: Runtime: 0:00:00.734273 2026-04-21 19:19:36.946719 | 2026-04-21 19:19:36.946788 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-21 19:19:36.984201 | mon1 | ok 2026-04-21 19:19:36.988787 | osd1 | ok 2026-04-21 19:19:37.002718 | mon1 | included: /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-21 19:19:37.002774 | osd1 | included: /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-21 19:19:37.013846 | 2026-04-21 19:19:37.013907 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-21 19:19:37.039440 | mon1 | skipping: Conditional result was False 2026-04-21 19:19:37.050346 | osd1 | skipping: Conditional result was False 2026-04-21 19:19:37.056292 | 2026-04-21 19:19:37.056359 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-21 19:19:37.590294 | osd1 | changed 2026-04-21 19:19:37.595442 | mon1 | changed 2026-04-21 19:19:37.600963 | 2026-04-21 19:19:37.601053 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-21 19:19:37.828550 | mon1 | ok 2026-04-21 19:19:37.835288 | osd1 | ok 2026-04-21 19:19:37.841647 | 2026-04-21 19:19:37.841712 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-21 19:19:38.436081 | osd1 | changed 2026-04-21 19:19:38.441141 | mon1 | changed 2026-04-21 19:19:38.446515 | 2026-04-21 19:19:38.446580 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-21 19:19:39.049802 | mon1 | changed 2026-04-21 19:19:39.054757 | osd1 | changed 2026-04-21 19:19:39.059856 | 2026-04-21 19:19:39.059921 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-21 19:19:39.085845 | mon1 | skipping: Conditional result was False 2026-04-21 19:19:39.097284 | osd1 | skipping: Conditional result was False 2026-04-21 19:19:39.107350 | 2026-04-21 19:19:39.107441 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-21 19:19:39.445405 | mon1 -> localhost | changed 2026-04-21 19:19:39.468813 | 2026-04-21 19:19:39.468982 | TASK [add-build-sshkey : Add back temp key] 2026-04-21 19:19:39.749500 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/aa27d512de43437196b33cc8aa60235f_id_rsa (zuul-build-sshkey) 2026-04-21 19:19:39.749731 | mon1 -> localhost | ok: Runtime: 0:00:00.015498 2026-04-21 19:19:39.755248 | 2026-04-21 19:19:39.755314 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-21 19:19:40.056827 | mon1 | ok 2026-04-21 19:19:40.063916 | osd1 | ok 2026-04-21 19:19:40.068938 | 2026-04-21 19:19:40.069025 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-21 19:19:40.095607 | mon1 | skipping: Conditional result was False 2026-04-21 19:19:40.106988 | osd1 | skipping: Conditional result was False 2026-04-21 19:19:40.126643 | 2026-04-21 19:19:40.126709 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-21 19:19:40.466770 | osd1 | ok 2026-04-21 19:19:40.472953 | mon1 | ok 2026-04-21 19:19:40.479350 | 2026-04-21 19:19:40.479422 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-21 19:19:41.214028 | mon1 | Output suppressed because no_log was given 2026-04-21 19:19:41.220823 | osd1 | Output suppressed because no_log was given 2026-04-21 19:19:41.235438 | 2026-04-21 19:19:41.235507 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-21 19:19:41.466271 | osd1 | ok: "logs" 2026-04-21 19:19:41.466587 | osd1 | ok: All items complete 2026-04-21 19:19:41.466615 | 2026-04-21 19:19:41.481380 | mon1 | ok: "logs" 2026-04-21 19:19:41.661753 | osd1 | ok: "artifacts" 2026-04-21 19:19:41.679705 | mon1 | ok: "artifacts" 2026-04-21 19:19:41.861334 | osd1 | ok: "docs" 2026-04-21 19:19:41.889252 | mon1 | ok: "docs" 2026-04-21 19:19:41.907793 | 2026-04-21 19:19:41.907939 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-21 19:19:42.132446 | mon1 | changed: "logs" 2026-04-21 19:19:42.132751 | mon1 | ok: All items complete 2026-04-21 19:19:42.132791 | 2026-04-21 19:19:42.138314 | osd1 | changed: "logs" 2026-04-21 19:19:42.347373 | osd1 | changed: "artifacts" 2026-04-21 19:19:42.352933 | mon1 | changed: "artifacts" 2026-04-21 19:19:42.544050 | osd1 | changed: "docs" 2026-04-21 19:19:42.549963 | mon1 | changed: "docs" 2026-04-21 19:19:42.569312 | 2026-04-21 19:19:42.569431 | PLAY RECAP 2026-04-21 19:19:42.569479 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-21 19:19:42.569508 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-21 19:19:42.569532 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-21 19:19:42.569550 | 2026-04-21 19:19:42.726037 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-21 19:19:42.731502 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-21 19:19:43.303360 | 2026-04-21 19:19:43.303491 | PLAY [all] 2026-04-21 19:19:43.315511 | 2026-04-21 19:19:43.315588 | TASK [setup-uv : Extract archive] 2026-04-21 19:19:45.783887 | osd1 | changed 2026-04-21 19:19:45.823872 | mon1 | changed 2026-04-21 19:19:45.829791 | 2026-04-21 19:19:45.829866 | TASK [setup-uv : Print version] 2026-04-21 19:19:46.545538 | mon1 | uv 0.8.13 2026-04-21 19:19:45.585130 | osd1 | uv 0.8.13 2026-04-21 19:19:46.396548 | mon1 | ok: Runtime: 0:00:00.014427 2026-04-21 19:19:46.405593 | osd1 | ok: Runtime: 0:00:00.016649 2026-04-21 19:19:46.416147 | 2026-04-21 19:19:46.416195 | PLAY RECAP 2026-04-21 19:19:46.416240 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-21 19:19:46.416270 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-21 19:19:46.416290 | 2026-04-21 19:19:46.553703 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-21 19:19:46.558245 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-21 19:19:47.114958 | 2026-04-21 19:19:47.115099 | PLAY [all] 2026-04-21 19:19:47.127267 | 2026-04-21 19:19:47.127343 | TASK [Copy inventory file for Zuul] 2026-04-21 19:19:48.127897 | mon1 | changed 2026-04-21 19:19:48.134387 | 2026-04-21 19:19:48.134459 | TASK [Switch "ansible_host" to private IP] 2026-04-21 19:19:48.485233 | mon1 | changed: 2 replacements made 2026-04-21 19:19:48.491098 | 2026-04-21 19:19:48.491174 | TASK [Run Molecule scenario] 2026-04-21 19:19:49.296521 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-04-21 19:19:49.296658 | mon1 | Creating virtual environment at: .venv 2026-04-21 19:19:49.583791 | mon1 | Downloading pygments (1.2MiB) 2026-04-21 19:19:49.588247 | mon1 | Downloading ansible-core (2.1MiB) 2026-04-21 19:19:49.588469 | mon1 | Downloading cryptography (4.3MiB) 2026-04-21 19:19:49.588977 | mon1 | Downloading netaddr (2.2MiB) 2026-04-21 19:19:49.804296 | mon1 | Downloading netaddr 2026-04-21 19:19:49.824332 | mon1 | Downloading cryptography 2026-04-21 19:19:49.872720 | mon1 | Downloading pygments 2026-04-21 19:19:50.041074 | mon1 | Downloading ansible-core 2026-04-21 19:19:50.089861 | mon1 | Installed 37 packages in 48ms 2026-04-21 19:19:50.876636 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-04-21 19:19:50.876726 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-04-21 19:19:51.511090 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-21 19:19:51.511174 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-04-21 19:20:09.964593 | mon1 | INFO [default > dependency] Executing 2026-04-21 19:20:09.964765 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-04-21 19:20:09.965105 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-04-21 19:20:09.965294 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-21 19:20:09.972099 | mon1 | INFO [default > cleanup] Executing 2026-04-21 19:20:09.972418 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-21 19:20:09.978115 | mon1 | INFO [default > destroy] Executing 2026-04-21 19:20:09.978151 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-21 19:20:09.978246 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-21 19:20:09.984773 | mon1 | INFO [default > syntax] Executing 2026-04-21 19:20:11.107502 | mon1 | 2026-04-21 19:20:11.107706 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-21 19:20:11.163976 | mon1 | INFO [default > syntax] Executed: Successful 2026-04-21 19:20:11.174628 | mon1 | INFO [default > create] Executing 2026-04-21 19:20:11.176174 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-21 19:20:11.182501 | mon1 | INFO [default > prepare] Executing 2026-04-21 19:20:11.991127 | mon1 | 2026-04-21 19:20:11.991315 | mon1 | PLAY [Prepare] ***************************************************************** 2026-04-21 19:20:11.991565 | mon1 | 2026-04-21 19:20:11.992070 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:20:11.992336 | mon1 | Tuesday 21 April 2026 19:20:11 +0000 (0:00:00.032) 0:00:00.032 ********* 2026-04-21 19:20:13.306427 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-21 19:20:13.306625 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:20:13.306917 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:20:13.307185 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:20:13.307443 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:20:14.285730 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-21 19:20:14.286009 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:20:14.286278 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:20:14.286533 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:20:14.286854 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:20:14.296128 | mon1 | ok: [mon1] 2026-04-21 19:20:14.296361 | mon1 | ok: [osd1] 2026-04-21 19:20:14.296591 | mon1 | 2026-04-21 19:20:14.296886 | mon1 | TASK [Configure short hostname] ************************************************ 2026-04-21 19:20:14.297227 | mon1 | Tuesday 21 April 2026 19:20:14 +0000 (0:00:02.305) 0:00:02.338 ********* 2026-04-21 19:20:15.111872 | mon1 | changed: [mon1] 2026-04-21 19:20:15.111920 | mon1 | changed: [osd1] 2026-04-21 19:20:15.111925 | mon1 | 2026-04-21 19:20:15.111929 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-21 19:20:15.111934 | mon1 | Tuesday 21 April 2026 19:20:15 +0000 (0:00:00.813) 0:00:03.152 ********* 2026-04-21 19:20:15.440949 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-04-21 19:20:15.441262 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-04-21 19:20:15.441565 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-21 19:20:15.479233 | mon1 | changed: [osd1] 2026-04-21 19:20:15.479562 | mon1 | changed: [mon1] 2026-04-21 19:20:15.479926 | mon1 | 2026-04-21 19:20:15.480251 | mon1 | TASK [Update apt cache] ******************************************************** 2026-04-21 19:20:15.480571 | mon1 | Tuesday 21 April 2026 19:20:15 +0000 (0:00:00.369) 0:00:03.521 ********* 2026-04-21 19:20:22.788299 | mon1 | changed: [mon1] 2026-04-21 19:20:22.788373 | mon1 | changed: [osd1] 2026-04-21 19:20:22.788427 | mon1 | 2026-04-21 19:20:22.788545 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-04-21 19:20:22.789873 | mon1 | 2026-04-21 19:20:22.789932 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:20:22.789941 | mon1 | Tuesday 21 April 2026 19:20:22 +0000 (0:00:07.309) 0:00:10.830 ********* 2026-04-21 19:20:23.622982 | mon1 | ok: [osd1] 2026-04-21 19:20:23.623033 | mon1 | 2026-04-21 19:20:23.623040 | mon1 | TASK [Install depedencies] ***************************************************** 2026-04-21 19:20:23.623052 | mon1 | Tuesday 21 April 2026 19:20:23 +0000 (0:00:00.833) 0:00:11.664 ********* 2026-04-21 19:20:57.550999 | mon1 | changed: [osd1] 2026-04-21 19:20:57.551129 | mon1 | 2026-04-21 19:20:57.551276 | mon1 | TASK [Start up service] ******************************************************** 2026-04-21 19:20:57.551518 | mon1 | Tuesday 21 April 2026 19:20:57 +0000 (0:00:33.928) 0:00:45.592 ********* 2026-04-21 19:20:58.185959 | mon1 | ok: [osd1] 2026-04-21 19:20:58.186158 | mon1 | 2026-04-21 19:20:58.186415 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-04-21 19:20:58.186672 | mon1 | Tuesday 21 April 2026 19:20:58 +0000 (0:00:00.635) 0:00:46.228 ********* 2026-04-21 19:20:58.544907 | mon1 | ok: [osd1] 2026-04-21 19:20:58.545129 | mon1 | 2026-04-21 19:20:58.545380 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-21 19:20:58.545684 | mon1 | Tuesday 21 April 2026 19:20:58 +0000 (0:00:00.359) 0:00:46.587 ********* 2026-04-21 19:20:59.308339 | mon1 | changed: [osd1] 2026-04-21 19:20:59.308534 | mon1 | 2026-04-21 19:20:59.308792 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-04-21 19:20:59.309058 | mon1 | Tuesday 21 April 2026 19:20:59 +0000 (0:00:00.763) 0:00:47.350 ********* 2026-04-21 19:20:59.550191 | mon1 | ok: [osd1] 2026-04-21 19:20:59.550434 | mon1 | 2026-04-21 19:20:59.550706 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-21 19:20:59.551008 | mon1 | Tuesday 21 April 2026 19:20:59 +0000 (0:00:00.241) 0:00:47.592 ********* 2026-04-21 19:20:59.578448 | mon1 | skipping: [osd1] 2026-04-21 19:20:59.578657 | mon1 | 2026-04-21 19:20:59.578949 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-04-21 19:20:59.579190 | mon1 | Tuesday 21 April 2026 19:20:59 +0000 (0:00:00.028) 0:00:47.621 ********* 2026-04-21 19:21:00.259645 | mon1 | changed: [osd1] => (item=osd0) 2026-04-21 19:21:00.259941 | mon1 | changed: [osd1] => (item=osd1) 2026-04-21 19:21:00.260205 | mon1 | changed: [osd1] => (item=osd2) 2026-04-21 19:21:00.260449 | mon1 | 2026-04-21 19:21:00.260791 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-04-21 19:21:00.261262 | mon1 | Tuesday 21 April 2026 19:21:00 +0000 (0:00:00.680) 0:00:48.301 ********* 2026-04-21 19:21:01.017330 | mon1 | changed: [osd1] => (item=osd0) 2026-04-21 19:21:01.017580 | mon1 | changed: [osd1] => (item=osd1) 2026-04-21 19:21:01.017836 | mon1 | changed: [osd1] => (item=osd2) 2026-04-21 19:21:01.018096 | mon1 | 2026-04-21 19:21:01.018368 | mon1 | TASK [Start loop devices] ****************************************************** 2026-04-21 19:21:01.018626 | mon1 | Tuesday 21 April 2026 19:21:01 +0000 (0:00:00.757) 0:00:49.059 ********* 2026-04-21 19:21:01.821155 | mon1 | changed: [osd1] => (item=osd0) 2026-04-21 19:21:01.821212 | mon1 | changed: [osd1] => (item=osd1) 2026-04-21 19:21:01.821367 | mon1 | changed: [osd1] => (item=osd2) 2026-04-21 19:21:01.821401 | mon1 | 2026-04-21 19:21:01.821545 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-04-21 19:21:01.821658 | mon1 | Tuesday 21 April 2026 19:21:01 +0000 (0:00:00.804) 0:00:49.863 ********* 2026-04-21 19:21:03.209728 | mon1 | changed: [osd1] => (item=osd0) 2026-04-21 19:21:03.210882 | mon1 | changed: [osd1] => (item=osd1) 2026-04-21 19:21:03.212074 | mon1 | changed: [osd1] => (item=osd2) 2026-04-21 19:21:03.212108 | mon1 | 2026-04-21 19:21:03.212124 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-04-21 19:21:03.212138 | mon1 | Tuesday 21 April 2026 19:21:03 +0000 (0:00:01.388) 0:00:51.252 ********* 2026-04-21 19:21:04.582231 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-04-21 19:21:04.582462 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-04-21 19:21:04.582717 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-04-21 19:21:04.582985 | mon1 | 2026-04-21 19:21:04.583225 | mon1 | PLAY RECAP ********************************************************************* 2026-04-21 19:21:04.583492 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-21 19:21:04.583752 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-21 19:21:04.584019 | mon1 | 2026-04-21 19:21:04.584276 | mon1 | 2026-04-21 19:21:04.584517 | mon1 | TASKS RECAP ******************************************************************** 2026-04-21 19:21:04.585007 | mon1 | Tuesday 21 April 2026 19:21:04 +0000 (0:00:01.372) 0:00:52.625 ********* 2026-04-21 19:21:04.585267 | mon1 | =============================================================================== 2026-04-21 19:21:04.585456 | mon1 | Install depedencies ---------------------------------------------------- 33.93s 2026-04-21 19:21:04.585609 | mon1 | Update apt cache -------------------------------------------------------- 7.31s 2026-04-21 19:21:04.585759 | mon1 | Gathering Facts --------------------------------------------------------- 2.31s 2026-04-21 19:21:04.585943 | mon1 | Create a volume group for each loop device ------------------------------ 1.39s 2026-04-21 19:21:04.586092 | mon1 | Create a logical volume for each loop device ---------------------------- 1.37s 2026-04-21 19:21:04.586233 | mon1 | Gathering Facts --------------------------------------------------------- 0.83s 2026-04-21 19:21:04.586386 | mon1 | Configure short hostname ------------------------------------------------ 0.81s 2026-04-21 19:21:04.586535 | mon1 | Start loop devices ------------------------------------------------------ 0.80s 2026-04-21 19:21:04.586687 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.76s 2026-04-21 19:21:04.586860 | mon1 | Set permissions on loopback devices ------------------------------------- 0.76s 2026-04-21 19:21:04.587015 | mon1 | Create devices for Ceph ------------------------------------------------- 0.68s 2026-04-21 19:21:04.587166 | mon1 | Start up service -------------------------------------------------------- 0.64s 2026-04-21 19:21:04.587309 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.37s 2026-04-21 19:21:04.587466 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s 2026-04-21 19:21:04.587621 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s 2026-04-21 19:21:04.587777 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-04-21 19:21:04.690495 | mon1 | INFO [default > prepare] Executed: Successful 2026-04-21 19:21:04.700315 | mon1 | INFO [default > converge] Executing 2026-04-21 19:21:05.636345 | mon1 | 2026-04-21 19:21:05.636468 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-21 19:21:05.636732 | mon1 | 2026-04-21 19:21:05.637014 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:21:05.637404 | mon1 | Tuesday 21 April 2026 19:21:05 +0000 (0:00:00.050) 0:00:00.051 ********* 2026-04-21 19:21:06.703090 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-21 19:21:06.703197 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:21:06.703238 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:21:06.703259 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:21:06.703565 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:21:06.716518 | mon1 | ok: [mon1] 2026-04-21 19:21:06.716556 | mon1 | 2026-04-21 19:21:06.716862 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:21:06.716920 | mon1 | Tuesday 21 April 2026 19:21:06 +0000 (0:00:01.079) 0:00:01.130 ********* 2026-04-21 19:21:07.054968 | mon1 | ok: [mon1] 2026-04-21 19:21:07.055068 | mon1 | 2026-04-21 19:21:07.055523 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:21:07.055569 | mon1 | Tuesday 21 April 2026 19:21:07 +0000 (0:00:00.338) 0:00:01.468 ********* 2026-04-21 19:21:07.096428 | mon1 | skipping: [mon1] 2026-04-21 19:21:07.096477 | mon1 | 2026-04-21 19:21:07.096487 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-21 19:21:07.096497 | mon1 | Tuesday 21 April 2026 19:21:07 +0000 (0:00:00.041) 0:00:01.509 ********* 2026-04-21 19:21:07.468360 | mon1 | changed: [mon1] 2026-04-21 19:21:07.468402 | mon1 | 2026-04-21 19:21:07.468412 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:21:07.468422 | mon1 | Tuesday 21 April 2026 19:21:07 +0000 (0:00:00.372) 0:00:01.881 ********* 2026-04-21 19:21:07.571095 | mon1 | ok: [mon1] => { 2026-04-21 19:21:07.571128 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-21 19:21:07.571135 | mon1 | } 2026-04-21 19:21:07.571140 | mon1 | 2026-04-21 19:21:07.571636 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:21:07.571707 | mon1 | Tuesday 21 April 2026 19:21:07 +0000 (0:00:00.101) 0:00:01.982 ********* 2026-04-21 19:21:08.329678 | mon1 | changed: [mon1] 2026-04-21 19:21:08.329737 | mon1 | 2026-04-21 19:21:08.329749 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:21:08.329759 | mon1 | Tuesday 21 April 2026 19:21:08 +0000 (0:00:00.760) 0:00:02.743 ********* 2026-04-21 19:21:08.374430 | mon1 | skipping: [mon1] 2026-04-21 19:21:08.374481 | mon1 | 2026-04-21 19:21:08.374492 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:21:08.374502 | mon1 | Tuesday 21 April 2026 19:21:08 +0000 (0:00:00.045) 0:00:02.788 ********* 2026-04-21 19:21:08.427521 | mon1 | skipping: [mon1] 2026-04-21 19:21:08.427632 | mon1 | 2026-04-21 19:21:08.427760 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:21:08.428117 | mon1 | Tuesday 21 April 2026 19:21:08 +0000 (0:00:00.052) 0:00:02.840 ********* 2026-04-21 19:21:08.696713 | mon1 | ok: [mon1] 2026-04-21 19:21:08.696786 | mon1 | 2026-04-21 19:21:08.696797 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:21:08.696807 | mon1 | Tuesday 21 April 2026 19:21:08 +0000 (0:00:00.268) 0:00:03.109 ********* 2026-04-21 19:21:09.868278 | mon1 | ok: [mon1] 2026-04-21 19:21:09.868336 | mon1 | 2026-04-21 19:21:09.868502 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:21:09.868639 | mon1 | Tuesday 21 April 2026 19:21:09 +0000 (0:00:01.172) 0:00:04.282 ********* 2026-04-21 19:21:10.057187 | mon1 | ok: [mon1] => { 2026-04-21 19:21:10.057244 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-21 19:21:10.057280 | mon1 | } 2026-04-21 19:21:10.057290 | mon1 | 2026-04-21 19:21:10.057300 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:21:10.057309 | mon1 | Tuesday 21 April 2026 19:21:10 +0000 (0:00:00.187) 0:00:04.470 ********* 2026-04-21 19:21:11.012949 | mon1 | changed: [mon1] 2026-04-21 19:21:11.013007 | mon1 | 2026-04-21 19:21:11.013422 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:21:11.013488 | mon1 | Tuesday 21 April 2026 19:21:11 +0000 (0:00:00.956) 0:00:05.426 ********* 2026-04-21 19:21:14.198010 | mon1 | changed: [mon1] 2026-04-21 19:21:14.198060 | mon1 | 2026-04-21 19:21:14.198072 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-21 19:21:14.198082 | mon1 | Tuesday 21 April 2026 19:21:14 +0000 (0:00:03.184) 0:00:08.611 ********* 2026-04-21 19:21:14.229250 | mon1 | skipping: [mon1] 2026-04-21 19:21:14.229349 | mon1 | 2026-04-21 19:21:14.229468 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-21 19:21:14.229584 | mon1 | Tuesday 21 April 2026 19:21:14 +0000 (0:00:00.032) 0:00:08.643 ********* 2026-04-21 19:21:14.263381 | mon1 | skipping: [mon1] 2026-04-21 19:21:14.263441 | mon1 | 2026-04-21 19:21:14.263456 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-21 19:21:14.263469 | mon1 | Tuesday 21 April 2026 19:21:14 +0000 (0:00:00.033) 0:00:08.676 ********* 2026-04-21 19:21:14.297112 | mon1 | skipping: [mon1] 2026-04-21 19:21:14.297144 | mon1 | 2026-04-21 19:21:14.297154 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-21 19:21:14.297163 | mon1 | Tuesday 21 April 2026 19:21:14 +0000 (0:00:00.033) 0:00:08.710 ********* 2026-04-21 19:21:22.759012 | mon1 | changed: [mon1] 2026-04-21 19:21:22.759127 | mon1 | 2026-04-21 19:21:22.759141 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-21 19:21:22.759163 | mon1 | Tuesday 21 April 2026 19:21:22 +0000 (0:00:08.460) 0:00:17.171 ********* 2026-04-21 19:21:23.432895 | mon1 | changed: [mon1] 2026-04-21 19:21:23.433079 | mon1 | 2026-04-21 19:21:23.433335 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-21 19:21:23.433578 | mon1 | Tuesday 21 April 2026 19:21:23 +0000 (0:00:00.676) 0:00:17.847 ********* 2026-04-21 19:21:24.600528 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-21 19:21:24.600844 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-21 19:21:24.601118 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-21 19:21:24.601407 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-21 19:21:24.601689 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-21 19:21:24.601975 | mon1 | 2026-04-21 19:21:24.602241 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-21 19:21:24.602502 | mon1 | Tuesday 21 April 2026 19:21:24 +0000 (0:00:01.167) 0:00:19.014 ********* 2026-04-21 19:21:25.360855 | mon1 | changed: [mon1] 2026-04-21 19:21:25.360890 | mon1 | 2026-04-21 19:21:25.360897 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-21 19:21:25.360906 | mon1 | Tuesday 21 April 2026 19:21:25 +0000 (0:00:00.752) 0:00:19.766 ********* 2026-04-21 19:21:25.361120 | mon1 | 2026-04-21 19:21:25.361384 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-21 19:21:25.361643 | mon1 | Tuesday 21 April 2026 19:21:25 +0000 (0:00:00.007) 0:00:19.774 ********* 2026-04-21 19:21:26.499028 | mon1 | ok: [mon1] 2026-04-21 19:21:26.499419 | mon1 | 2026-04-21 19:21:26.499755 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-21 19:21:26.500112 | mon1 | Tuesday 21 April 2026 19:21:26 +0000 (0:00:01.138) 0:00:20.913 ********* 2026-04-21 19:21:27.114202 | mon1 | changed: [mon1] 2026-04-21 19:21:27.117103 | mon1 | 2026-04-21 19:21:27.117255 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-21 19:21:27.117584 | mon1 | Tuesday 21 April 2026 19:21:27 +0000 (0:00:00.615) 0:00:21.528 ********* 2026-04-21 19:21:27.820584 | mon1 | changed: [mon1] 2026-04-21 19:21:27.820980 | mon1 | 2026-04-21 19:21:27.821663 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:21:27.821683 | mon1 | Tuesday 21 April 2026 19:21:27 +0000 (0:00:00.706) 0:00:22.234 ********* 2026-04-21 19:21:28.083010 | mon1 | ok: [mon1] 2026-04-21 19:21:28.083091 | mon1 | 2026-04-21 19:21:28.083108 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:21:28.083307 | mon1 | Tuesday 21 April 2026 19:21:28 +0000 (0:00:00.261) 0:00:22.496 ********* 2026-04-21 19:21:28.163442 | mon1 | ok: [mon1] => { 2026-04-21 19:21:28.163507 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-21 19:21:28.163517 | mon1 | } 2026-04-21 19:21:28.163528 | mon1 | 2026-04-21 19:21:28.163537 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:21:28.163546 | mon1 | Tuesday 21 April 2026 19:21:28 +0000 (0:00:00.079) 0:00:22.576 ********* 2026-04-21 19:21:29.272874 | mon1 | changed: [mon1] 2026-04-21 19:21:29.272919 | mon1 | 2026-04-21 19:21:29.273313 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:21:29.273354 | mon1 | Tuesday 21 April 2026 19:21:29 +0000 (0:00:01.110) 0:00:23.686 ********* 2026-04-21 19:21:33.824443 | mon1 | changed: [mon1] 2026-04-21 19:21:33.824507 | mon1 | 2026-04-21 19:21:33.824521 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-21 19:21:33.824534 | mon1 | Tuesday 21 April 2026 19:21:33 +0000 (0:00:04.551) 0:00:28.238 ********* 2026-04-21 19:21:34.802916 | mon1 | ok: [mon1] 2026-04-21 19:21:34.802988 | mon1 | 2026-04-21 19:21:34.803602 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-21 19:21:34.803664 | mon1 | Tuesday 21 April 2026 19:21:34 +0000 (0:00:00.978) 0:00:29.216 ********* 2026-04-21 19:21:35.207360 | mon1 | changed: [mon1] 2026-04-21 19:21:35.207448 | mon1 | 2026-04-21 19:21:35.207460 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-21 19:21:35.207472 | mon1 | Tuesday 21 April 2026 19:21:35 +0000 (0:00:00.403) 0:00:29.619 ********* 2026-04-21 19:21:35.773716 | mon1 | changed: [mon1] 2026-04-21 19:21:35.773791 | mon1 | 2026-04-21 19:21:35.773800 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-21 19:21:35.773832 | mon1 | Tuesday 21 April 2026 19:21:35 +0000 (0:00:00.564) 0:00:30.183 ********* 2026-04-21 19:21:36.486274 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-04-21 19:21:36.486364 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-21 19:21:36.486379 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-21 19:21:36.486391 | mon1 | 2026-04-21 19:21:36.486403 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-21 19:21:36.486415 | mon1 | Tuesday 21 April 2026 19:21:36 +0000 (0:00:00.715) 0:00:30.898 ********* 2026-04-21 19:21:37.055913 | mon1 | changed: [mon1] 2026-04-21 19:21:37.056004 | mon1 | 2026-04-21 19:21:37.056585 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-21 19:21:37.056640 | mon1 | Tuesday 21 April 2026 19:21:37 +0000 (0:00:00.571) 0:00:31.469 ********* 2026-04-21 19:21:37.621280 | mon1 | changed: [mon1] 2026-04-21 19:21:37.621347 | mon1 | 2026-04-21 19:21:37.621442 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-21 19:21:37.621549 | mon1 | Tuesday 21 April 2026 19:21:37 +0000 (0:00:00.558) 0:00:32.028 ********* 2026-04-21 19:21:37.621651 | mon1 | 2026-04-21 19:21:37.621771 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-21 19:21:37.621902 | mon1 | Tuesday 21 April 2026 19:21:37 +0000 (0:00:00.007) 0:00:32.035 ********* 2026-04-21 19:21:38.481974 | mon1 | ok: [mon1] 2026-04-21 19:21:38.482015 | mon1 | 2026-04-21 19:21:38.482022 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-21 19:21:38.482028 | mon1 | Tuesday 21 April 2026 19:21:38 +0000 (0:00:00.860) 0:00:32.895 ********* 2026-04-21 19:21:40.492323 | mon1 | changed: [mon1] 2026-04-21 19:21:40.492383 | mon1 | 2026-04-21 19:21:40.492397 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-21 19:21:40.492409 | mon1 | Tuesday 21 April 2026 19:21:40 +0000 (0:00:02.009) 0:00:34.905 ********* 2026-04-21 19:21:41.176284 | mon1 | changed: [mon1] 2026-04-21 19:21:41.176338 | mon1 | 2026-04-21 19:21:41.176381 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-21 19:21:41.176393 | mon1 | Tuesday 21 April 2026 19:21:41 +0000 (0:00:00.684) 0:00:35.590 ********* 2026-04-21 19:21:41.224945 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-21 19:21:41.225648 | mon1 | 2026-04-21 19:21:41.225700 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-21 19:21:41.225716 | mon1 | Tuesday 21 April 2026 19:21:41 +0000 (0:00:00.048) 0:00:35.638 ********* 2026-04-21 19:21:59.712381 | mon1 | changed: [mon1] 2026-04-21 19:21:59.712419 | mon1 | 2026-04-21 19:21:59.712710 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-21 19:21:59.712758 | mon1 | Tuesday 21 April 2026 19:21:59 +0000 (0:00:18.486) 0:00:54.125 ********* 2026-04-21 19:22:00.508727 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-21 19:22:00.508777 | mon1 | ok: [mon1] => (item=ssh) 2026-04-21 19:22:00.508791 | mon1 | 2026-04-21 19:22:00.508803 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-21 19:22:00.508870 | mon1 | Tuesday 21 April 2026 19:22:00 +0000 (0:00:00.795) 0:00:54.921 ********* 2026-04-21 19:22:00.876255 | mon1 | changed: [mon1] 2026-04-21 19:22:00.876311 | mon1 | 2026-04-21 19:22:00.876427 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-21 19:22:00.876539 | mon1 | Tuesday 21 April 2026 19:22:00 +0000 (0:00:00.367) 0:00:55.289 ********* 2026-04-21 19:22:01.130618 | mon1 | ok: [mon1] 2026-04-21 19:22:01.130673 | mon1 | 2026-04-21 19:22:01.130687 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-21 19:22:01.130700 | mon1 | Tuesday 21 April 2026 19:22:01 +0000 (0:00:00.253) 0:00:55.543 ********* 2026-04-21 19:22:01.653312 | mon1 | changed: [mon1] 2026-04-21 19:22:01.653366 | mon1 | 2026-04-21 19:22:01.653379 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-21 19:22:01.653392 | mon1 | Tuesday 21 April 2026 19:22:01 +0000 (0:00:00.523) 0:00:56.066 ********* 2026-04-21 19:22:02.032914 | mon1 | changed: [mon1] 2026-04-21 19:22:02.032973 | mon1 | 2026-04-21 19:22:02.033515 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-21 19:22:02.033571 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.380) 0:00:56.447 ********* 2026-04-21 19:22:02.168268 | mon1 | ok: [mon1] 2026-04-21 19:22:02.168329 | mon1 | 2026-04-21 19:22:02.168568 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-21 19:22:02.168600 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.135) 0:00:56.582 ********* 2026-04-21 19:22:02.443341 | mon1 | ok: [mon1] => (item=mon1) 2026-04-21 19:22:02.443399 | mon1 | 2026-04-21 19:22:02.443412 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-21 19:22:02.443425 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.274) 0:00:56.856 ********* 2026-04-21 19:22:02.498012 | mon1 | ok: [mon1] 2026-04-21 19:22:02.498090 | mon1 | 2026-04-21 19:22:02.498112 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-21 19:22:02.498406 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.054) 0:00:56.911 ********* 2026-04-21 19:22:02.622488 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-04-21 19:22:02.622569 | mon1 | 2026-04-21 19:22:02.622677 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-21 19:22:02.622783 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.125) 0:00:57.036 ********* 2026-04-21 19:22:02.973364 | mon1 | changed: [mon1] 2026-04-21 19:22:02.973417 | mon1 | 2026-04-21 19:22:02.973428 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-21 19:22:02.973437 | mon1 | Tuesday 21 April 2026 19:22:02 +0000 (0:00:00.350) 0:00:57.386 ********* 2026-04-21 19:22:03.768930 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-04-21 19:22:03.770073 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-04-21 19:22:03.770131 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-04-21 19:22:03.770141 | mon1 | 2026-04-21 19:22:03.770151 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-04-21 19:22:03.770159 | mon1 | Tuesday 21 April 2026 19:22:03 +0000 (0:00:00.795) 0:00:58.182 ********* 2026-04-21 19:23:38.789330 | mon1 | ok: [mon1] 2026-04-21 19:23:38.789372 | mon1 | 2026-04-21 19:23:38.789379 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-21 19:23:38.789385 | mon1 | Tuesday 21 April 2026 19:23:38 +0000 (0:01:35.018) 0:02:33.201 ********* 2026-04-21 19:23:39.039213 | mon1 | changed: [mon1] 2026-04-21 19:23:39.039267 | mon1 | 2026-04-21 19:23:39.039430 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-21 19:23:39.039555 | mon1 | Tuesday 21 April 2026 19:23:39 +0000 (0:00:00.252) 0:02:33.453 ********* 2026-04-21 19:23:39.084141 | mon1 | ok: [mon1] 2026-04-21 19:23:39.084201 | mon1 | 2026-04-21 19:23:39.084315 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:23:39.084416 | mon1 | Tuesday 21 April 2026 19:23:39 +0000 (0:00:00.043) 0:02:33.497 ********* 2026-04-21 19:23:39.157252 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-21 19:23:39.157304 | mon1 | 2026-04-21 19:23:39.157459 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:23:39.157537 | mon1 | Tuesday 21 April 2026 19:23:39 +0000 (0:00:00.075) 0:02:33.572 ********* 2026-04-21 19:23:45.094871 | mon1 | ok: [mon1] 2026-04-21 19:23:45.094907 | mon1 | 2026-04-21 19:23:45.094914 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:23:45.094920 | mon1 | Tuesday 21 April 2026 19:23:45 +0000 (0:00:05.937) 0:02:39.509 ********* 2026-04-21 19:23:45.156158 | mon1 | ok: [mon1] => (item=mon1) 2026-04-21 19:23:45.156206 | mon1 | 2026-04-21 19:23:45.156350 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:23:45.156473 | mon1 | Tuesday 21 April 2026 19:23:45 +0000 (0:00:00.058) 0:02:39.568 ********* 2026-04-21 19:23:45.604680 | mon1 | ok: [mon1] 2026-04-21 19:23:45.604743 | mon1 | 2026-04-21 19:23:45.604899 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:23:45.605062 | mon1 | Tuesday 21 April 2026 19:23:45 +0000 (0:00:00.451) 0:02:40.019 ********* 2026-04-21 19:23:52.376126 | mon1 | ok: [mon1] 2026-04-21 19:23:52.376188 | mon1 | 2026-04-21 19:23:52.376315 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-21 19:23:52.376445 | mon1 | Tuesday 21 April 2026 19:23:52 +0000 (0:00:06.771) 0:02:46.791 ********* 2026-04-21 19:24:44.383872 | mon1 | changed: [mon1] 2026-04-21 19:24:44.383974 | mon1 | 2026-04-21 19:24:44.383992 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-21 19:24:44.384158 | mon1 | Tuesday 21 April 2026 19:24:44 +0000 (0:00:52.007) 0:03:38.798 ********* 2026-04-21 19:24:58.823907 | mon1 | ok: [mon1] 2026-04-21 19:24:58.824055 | mon1 | 2026-04-21 19:24:58.824581 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:24:58.824615 | mon1 | Tuesday 21 April 2026 19:24:58 +0000 (0:00:14.438) 0:03:53.237 ********* 2026-04-21 19:24:58.901326 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-21 19:24:58.901363 | mon1 | 2026-04-21 19:24:58.901514 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:24:58.901628 | mon1 | Tuesday 21 April 2026 19:24:58 +0000 (0:00:00.077) 0:03:53.315 ********* 2026-04-21 19:24:58.958206 | mon1 | skipping: [mon1] 2026-04-21 19:24:58.958236 | mon1 | 2026-04-21 19:24:58.958246 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:24:58.958256 | mon1 | Tuesday 21 April 2026 19:24:58 +0000 (0:00:00.056) 0:03:53.371 ********* 2026-04-21 19:24:59.015383 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-21 19:24:59.015413 | mon1 | skipping: [mon1] 2026-04-21 19:24:59.015423 | mon1 | 2026-04-21 19:24:59.015432 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:24:59.015441 | mon1 | Tuesday 21 April 2026 19:24:59 +0000 (0:00:00.056) 0:03:53.428 ********* 2026-04-21 19:24:59.334916 | mon1 | ok: [mon1] 2026-04-21 19:24:59.334974 | mon1 | 2026-04-21 19:24:59.334984 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:24:59.334994 | mon1 | Tuesday 21 April 2026 19:24:59 +0000 (0:00:00.318) 0:03:53.747 ********* 2026-04-21 19:25:06.262412 | mon1 | ok: [mon1] 2026-04-21 19:25:06.262511 | mon1 | 2026-04-21 19:25:06.262525 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-21 19:25:06.262538 | mon1 | Tuesday 21 April 2026 19:25:06 +0000 (0:00:06.928) 0:04:00.676 ********* 2026-04-21 19:25:19.253344 | mon1 | changed: [mon1] 2026-04-21 19:25:19.253418 | mon1 | 2026-04-21 19:25:19.253430 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-21 19:25:19.253440 | mon1 | Tuesday 21 April 2026 19:25:19 +0000 (0:00:12.990) 0:04:13.666 ********* 2026-04-21 19:25:25.746977 | mon1 | ok: [mon1] 2026-04-21 19:25:25.747041 | mon1 | 2026-04-21 19:25:25.747545 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-21 19:25:25.747609 | mon1 | Tuesday 21 April 2026 19:25:25 +0000 (0:00:06.494) 0:04:20.160 ********* 2026-04-21 19:25:34.222976 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-21 19:25:34.223049 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-21 19:25:34.223058 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-04-21 19:25:34.223065 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-21 19:25:34.223072 | mon1 | 2026-04-21 19:25:34.223879 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-21 19:25:34.223948 | mon1 | 2026-04-21 19:25:34.223961 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:25:34.224084 | mon1 | Tuesday 21 April 2026 19:25:34 +0000 (0:00:08.475) 0:04:28.636 ********* 2026-04-21 19:25:35.373493 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-21 19:25:35.373703 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:25:35.374037 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:25:35.374287 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:25:35.374534 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:25:35.385387 | mon1 | ok: [osd1] 2026-04-21 19:25:35.385454 | mon1 | 2026-04-21 19:25:35.385604 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:25:35.385727 | mon1 | Tuesday 21 April 2026 19:25:35 +0000 (0:00:01.164) 0:04:29.800 ********* 2026-04-21 19:25:35.630254 | mon1 | ok: [osd1] 2026-04-21 19:25:35.630316 | mon1 | 2026-04-21 19:25:35.630447 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:25:35.630556 | mon1 | Tuesday 21 April 2026 19:25:35 +0000 (0:00:00.241) 0:04:30.042 ********* 2026-04-21 19:25:35.669993 | mon1 | skipping: [osd1] 2026-04-21 19:25:35.670092 | mon1 | 2026-04-21 19:25:35.670213 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-21 19:25:35.670351 | mon1 | Tuesday 21 April 2026 19:25:35 +0000 (0:00:00.042) 0:04:30.085 ********* 2026-04-21 19:25:35.924691 | mon1 | changed: [osd1] 2026-04-21 19:25:35.924768 | mon1 | 2026-04-21 19:25:35.924878 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:25:35.924982 | mon1 | Tuesday 21 April 2026 19:25:35 +0000 (0:00:00.254) 0:04:30.339 ********* 2026-04-21 19:25:35.988849 | mon1 | ok: [osd1] => { 2026-04-21 19:25:35.988958 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-21 19:25:35.989071 | mon1 | } 2026-04-21 19:25:35.989180 | mon1 | 2026-04-21 19:25:35.989290 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:25:35.989395 | mon1 | Tuesday 21 April 2026 19:25:35 +0000 (0:00:00.064) 0:04:30.403 ********* 2026-04-21 19:25:36.629248 | mon1 | changed: [osd1] 2026-04-21 19:25:36.629333 | mon1 | 2026-04-21 19:25:36.629444 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:25:36.629553 | mon1 | Tuesday 21 April 2026 19:25:36 +0000 (0:00:00.639) 0:04:31.043 ********* 2026-04-21 19:25:36.676257 | mon1 | skipping: [osd1] 2026-04-21 19:25:36.676320 | mon1 | 2026-04-21 19:25:36.676435 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:25:36.676551 | mon1 | Tuesday 21 April 2026 19:25:36 +0000 (0:00:00.045) 0:04:31.088 ********* 2026-04-21 19:25:36.719122 | mon1 | skipping: [osd1] 2026-04-21 19:25:36.719187 | mon1 | 2026-04-21 19:25:36.719302 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:25:36.719413 | mon1 | Tuesday 21 April 2026 19:25:36 +0000 (0:00:00.045) 0:04:31.134 ********* 2026-04-21 19:25:36.966358 | mon1 | ok: [osd1] 2026-04-21 19:25:36.966428 | mon1 | 2026-04-21 19:25:36.966536 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:25:36.966692 | mon1 | Tuesday 21 April 2026 19:25:36 +0000 (0:00:00.247) 0:04:31.381 ********* 2026-04-21 19:25:38.063402 | mon1 | ok: [osd1] 2026-04-21 19:25:38.063486 | mon1 | 2026-04-21 19:25:38.063580 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:25:38.063697 | mon1 | Tuesday 21 April 2026 19:25:38 +0000 (0:00:01.097) 0:04:32.478 ********* 2026-04-21 19:25:38.146999 | mon1 | ok: [osd1] => { 2026-04-21 19:25:38.147111 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-21 19:25:38.147220 | mon1 | } 2026-04-21 19:25:38.147349 | mon1 | 2026-04-21 19:25:38.147495 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:25:38.147561 | mon1 | Tuesday 21 April 2026 19:25:38 +0000 (0:00:00.081) 0:04:32.560 ********* 2026-04-21 19:25:39.064876 | mon1 | changed: [osd1] 2026-04-21 19:25:39.064955 | mon1 | 2026-04-21 19:25:39.065149 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:25:39.065306 | mon1 | Tuesday 21 April 2026 19:25:39 +0000 (0:00:00.919) 0:04:33.479 ********* 2026-04-21 19:25:42.002366 | mon1 | changed: [osd1] 2026-04-21 19:25:42.002436 | mon1 | 2026-04-21 19:25:42.002441 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-21 19:25:42.002446 | mon1 | Tuesday 21 April 2026 19:25:41 +0000 (0:00:02.927) 0:04:36.407 ********* 2026-04-21 19:25:42.029440 | mon1 | skipping: [osd1] 2026-04-21 19:25:42.029523 | mon1 | 2026-04-21 19:25:42.029664 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-21 19:25:42.029757 | mon1 | Tuesday 21 April 2026 19:25:42 +0000 (0:00:00.034) 0:04:36.441 ********* 2026-04-21 19:25:42.059243 | mon1 | skipping: [osd1] 2026-04-21 19:25:42.059283 | mon1 | 2026-04-21 19:25:42.059417 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-21 19:25:42.059526 | mon1 | Tuesday 21 April 2026 19:25:42 +0000 (0:00:00.032) 0:04:36.474 ********* 2026-04-21 19:25:42.096622 | mon1 | skipping: [osd1] 2026-04-21 19:25:42.096686 | mon1 | 2026-04-21 19:25:42.096958 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-21 19:25:42.097192 | mon1 | Tuesday 21 April 2026 19:25:42 +0000 (0:00:00.037) 0:04:36.511 ********* 2026-04-21 19:25:49.966740 | mon1 | changed: [osd1] 2026-04-21 19:25:49.966843 | mon1 | 2026-04-21 19:25:49.966857 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-21 19:25:49.966865 | mon1 | Tuesday 21 April 2026 19:25:49 +0000 (0:00:07.868) 0:04:44.379 ********* 2026-04-21 19:25:50.571751 | mon1 | changed: [osd1] 2026-04-21 19:25:50.571865 | mon1 | 2026-04-21 19:25:50.571882 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-21 19:25:50.571891 | mon1 | Tuesday 21 April 2026 19:25:50 +0000 (0:00:00.604) 0:04:44.984 ********* 2026-04-21 19:25:51.681015 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-21 19:25:51.681264 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-21 19:25:51.681308 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-21 19:25:51.681312 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-21 19:25:51.681316 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-21 19:25:51.681332 | mon1 | 2026-04-21 19:25:51.681337 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-21 19:25:51.681631 | mon1 | Tuesday 21 April 2026 19:25:51 +0000 (0:00:01.109) 0:04:46.093 ********* 2026-04-21 19:25:52.429990 | mon1 | changed: [osd1] 2026-04-21 19:25:52.430198 | mon1 | 2026-04-21 19:25:52.430532 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-21 19:25:52.430949 | mon1 | Tuesday 21 April 2026 19:25:52 +0000 (0:00:00.740) 0:04:46.834 ********* 2026-04-21 19:25:52.431807 | mon1 | 2026-04-21 19:25:52.431864 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-21 19:25:52.431874 | mon1 | Tuesday 21 April 2026 19:25:52 +0000 (0:00:00.008) 0:04:46.843 ********* 2026-04-21 19:25:53.309367 | mon1 | ok: [osd1] 2026-04-21 19:25:53.309453 | mon1 | 2026-04-21 19:25:53.309506 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-21 19:25:53.309645 | mon1 | Tuesday 21 April 2026 19:25:53 +0000 (0:00:00.880) 0:04:47.723 ********* 2026-04-21 19:25:53.872447 | mon1 | changed: [osd1] 2026-04-21 19:25:53.872544 | mon1 | 2026-04-21 19:25:53.872684 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-21 19:25:53.872790 | mon1 | Tuesday 21 April 2026 19:25:53 +0000 (0:00:00.562) 0:04:48.286 ********* 2026-04-21 19:25:54.584516 | mon1 | changed: [osd1] 2026-04-21 19:25:54.584561 | mon1 | 2026-04-21 19:25:54.584572 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:25:54.584581 | mon1 | Tuesday 21 April 2026 19:25:54 +0000 (0:00:00.711) 0:04:48.997 ********* 2026-04-21 19:25:54.834503 | mon1 | ok: [osd1] 2026-04-21 19:25:54.834565 | mon1 | 2026-04-21 19:25:54.834576 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:25:54.834586 | mon1 | Tuesday 21 April 2026 19:25:54 +0000 (0:00:00.249) 0:04:49.246 ********* 2026-04-21 19:25:54.904805 | mon1 | ok: [osd1] => { 2026-04-21 19:25:54.904871 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-21 19:25:54.904882 | mon1 | } 2026-04-21 19:25:54.904893 | mon1 | 2026-04-21 19:25:54.904915 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:25:54.904925 | mon1 | Tuesday 21 April 2026 19:25:54 +0000 (0:00:00.070) 0:04:49.317 ********* 2026-04-21 19:25:55.851438 | mon1 | changed: [osd1] 2026-04-21 19:25:55.851539 | mon1 | 2026-04-21 19:25:55.851551 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:25:55.851561 | mon1 | Tuesday 21 April 2026 19:25:55 +0000 (0:00:00.946) 0:04:50.264 ********* 2026-04-21 19:26:00.403919 | mon1 | changed: [osd1] 2026-04-21 19:26:00.404054 | mon1 | 2026-04-21 19:26:00.404666 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-21 19:26:00.404715 | mon1 | Tuesday 21 April 2026 19:26:00 +0000 (0:00:04.553) 0:04:54.817 ********* 2026-04-21 19:26:01.423353 | mon1 | ok: [osd1] 2026-04-21 19:26:01.423438 | mon1 | 2026-04-21 19:26:01.423490 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-21 19:26:01.423614 | mon1 | Tuesday 21 April 2026 19:26:01 +0000 (0:00:01.019) 0:04:55.837 ********* 2026-04-21 19:26:01.768316 | mon1 | changed: [osd1] 2026-04-21 19:26:01.768380 | mon1 | 2026-04-21 19:26:01.768495 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-21 19:26:01.768603 | mon1 | Tuesday 21 April 2026 19:26:01 +0000 (0:00:00.345) 0:04:56.182 ********* 2026-04-21 19:26:02.364969 | mon1 | changed: [osd1] 2026-04-21 19:26:02.365019 | mon1 | 2026-04-21 19:26:02.365024 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-21 19:26:02.365029 | mon1 | Tuesday 21 April 2026 19:26:02 +0000 (0:00:00.596) 0:04:56.778 ********* 2026-04-21 19:26:03.094183 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-04-21 19:26:03.094222 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-21 19:26:03.094227 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-21 19:26:03.094231 | mon1 | 2026-04-21 19:26:03.094235 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-21 19:26:03.094239 | mon1 | Tuesday 21 April 2026 19:26:03 +0000 (0:00:00.726) 0:04:57.505 ********* 2026-04-21 19:26:03.673149 | mon1 | changed: [osd1] 2026-04-21 19:26:03.673219 | mon1 | 2026-04-21 19:26:03.673224 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-21 19:26:03.673230 | mon1 | Tuesday 21 April 2026 19:26:03 +0000 (0:00:00.580) 0:04:58.086 ********* 2026-04-21 19:26:04.269693 | mon1 | changed: [osd1] 2026-04-21 19:26:04.269747 | mon1 | 2026-04-21 19:26:04.269759 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-21 19:26:04.269769 | mon1 | Tuesday 21 April 2026 19:26:04 +0000 (0:00:00.586) 0:04:58.672 ********* 2026-04-21 19:26:04.269778 | mon1 | 2026-04-21 19:26:04.269787 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-21 19:26:04.269797 | mon1 | Tuesday 21 April 2026 19:26:04 +0000 (0:00:00.008) 0:04:58.681 ********* 2026-04-21 19:26:05.168022 | mon1 | ok: [osd1] 2026-04-21 19:26:05.168085 | mon1 | 2026-04-21 19:26:05.168092 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-21 19:26:05.168145 | mon1 | Tuesday 21 April 2026 19:26:05 +0000 (0:00:00.899) 0:04:59.581 ********* 2026-04-21 19:26:06.230353 | mon1 | changed: [osd1] 2026-04-21 19:26:06.230564 | mon1 | 2026-04-21 19:26:06.230970 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-21 19:26:06.231281 | mon1 | Tuesday 21 April 2026 19:26:06 +0000 (0:00:01.062) 0:05:00.644 ********* 2026-04-21 19:26:06.957431 | mon1 | changed: [osd1] 2026-04-21 19:26:06.957552 | mon1 | 2026-04-21 19:26:06.957867 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-21 19:26:06.958185 | mon1 | Tuesday 21 April 2026 19:26:06 +0000 (0:00:00.727) 0:05:01.371 ********* 2026-04-21 19:26:07.019250 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-21 19:26:07.019361 | mon1 | 2026-04-21 19:26:07.019412 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-21 19:26:07.019617 | mon1 | Tuesday 21 April 2026 19:26:07 +0000 (0:00:00.061) 0:05:01.433 ********* 2026-04-21 19:26:08.140341 | mon1 | ok: [osd1] 2026-04-21 19:26:08.140470 | mon1 | 2026-04-21 19:26:08.140768 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-21 19:26:08.141054 | mon1 | Tuesday 21 April 2026 19:26:08 +0000 (0:00:01.120) 0:05:02.554 ********* 2026-04-21 19:26:08.962846 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-21 19:26:08.963064 | mon1 | ok: [osd1] => (item=ssh) 2026-04-21 19:26:08.963530 | mon1 | 2026-04-21 19:26:08.963838 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-21 19:26:08.964136 | mon1 | Tuesday 21 April 2026 19:26:08 +0000 (0:00:00.822) 0:05:03.377 ********* 2026-04-21 19:26:09.350983 | mon1 | changed: [osd1] 2026-04-21 19:26:09.351064 | mon1 | 2026-04-21 19:26:09.351775 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-21 19:26:09.351858 | mon1 | Tuesday 21 April 2026 19:26:09 +0000 (0:00:00.387) 0:05:03.765 ********* 2026-04-21 19:26:09.591682 | mon1 | ok: [osd1] 2026-04-21 19:26:09.591744 | mon1 | 2026-04-21 19:26:09.591756 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-21 19:26:09.591766 | mon1 | Tuesday 21 April 2026 19:26:09 +0000 (0:00:00.239) 0:05:04.004 ********* 2026-04-21 19:26:09.976051 | mon1 | changed: [osd1] 2026-04-21 19:26:09.976094 | mon1 | 2026-04-21 19:26:09.976100 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-21 19:26:09.976115 | mon1 | Tuesday 21 April 2026 19:26:09 +0000 (0:00:00.382) 0:05:04.387 ********* 2026-04-21 19:26:10.240696 | mon1 | changed: [osd1] 2026-04-21 19:26:10.240763 | mon1 | 2026-04-21 19:26:10.240774 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-21 19:26:10.240784 | mon1 | Tuesday 21 April 2026 19:26:10 +0000 (0:00:00.266) 0:05:04.653 ********* 2026-04-21 19:26:10.516571 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-21 19:26:10.516631 | mon1 | 2026-04-21 19:26:10.516642 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-21 19:26:10.516652 | mon1 | Tuesday 21 April 2026 19:26:10 +0000 (0:00:00.275) 0:05:04.929 ********* 2026-04-21 19:26:10.568687 | mon1 | ok: [osd1] 2026-04-21 19:26:10.568732 | mon1 | 2026-04-21 19:26:10.568744 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:26:10.568754 | mon1 | Tuesday 21 April 2026 19:26:10 +0000 (0:00:00.052) 0:05:04.981 ********* 2026-04-21 19:26:10.641382 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-21 19:26:10.641429 | mon1 | 2026-04-21 19:26:10.641440 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:26:10.641449 | mon1 | Tuesday 21 April 2026 19:26:10 +0000 (0:00:00.072) 0:05:05.054 ********* 2026-04-21 19:26:16.959963 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:26:16.960707 | mon1 | 2026-04-21 19:26:16.960782 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:26:16.960796 | mon1 | Tuesday 21 April 2026 19:26:16 +0000 (0:00:06.319) 0:05:11.373 ********* 2026-04-21 19:26:17.024294 | mon1 | ok: [osd1] => (item=osd1) 2026-04-21 19:26:17.024336 | mon1 | 2026-04-21 19:26:17.024349 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:26:17.024361 | mon1 | Tuesday 21 April 2026 19:26:17 +0000 (0:00:00.064) 0:05:11.437 ********* 2026-04-21 19:26:17.396863 | mon1 | changed: [osd1] 2026-04-21 19:26:17.397082 | mon1 | 2026-04-21 19:26:17.397354 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:26:17.397616 | mon1 | Tuesday 21 April 2026 19:26:17 +0000 (0:00:00.372) 0:05:11.810 ********* 2026-04-21 19:26:26.880336 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:26:26.880618 | mon1 | 2026-04-21 19:26:26.880951 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-21 19:26:26.881236 | mon1 | Tuesday 21 April 2026 19:26:26 +0000 (0:00:09.484) 0:05:21.294 ********* 2026-04-21 19:26:28.554000 | mon1 | ok: [osd1] 2026-04-21 19:26:28.554080 | mon1 | 2026-04-21 19:26:28.554102 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-21 19:26:28.554254 | mon1 | Tuesday 21 April 2026 19:26:28 +0000 (0:00:01.673) 0:05:22.968 ********* 2026-04-21 19:27:19.536636 | mon1 | ok: [osd1] 2026-04-21 19:27:19.536717 | mon1 | 2026-04-21 19:27:19.536731 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-21 19:27:19.536803 | mon1 | Tuesday 21 April 2026 19:27:19 +0000 (0:00:50.981) 0:06:13.950 ********* 2026-04-21 19:28:58.058335 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-04-21 19:28:58.058446 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-04-21 19:28:58.058461 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-04-21 19:28:58.058473 | mon1 | 2026-04-21 19:28:58.058486 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-21 19:28:58.058498 | mon1 | Tuesday 21 April 2026 19:28:58 +0000 (0:01:38.520) 0:07:52.470 ********* 2026-04-21 19:29:04.522743 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:29:04.522792 | mon1 | 2026-04-21 19:29:04.522798 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-21 19:29:04.522804 | mon1 | Tuesday 21 April 2026 19:29:04 +0000 (0:00:06.465) 0:07:58.935 ********* 2026-04-21 19:29:10.938569 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:29:10.938645 | mon1 | 2026-04-21 19:29:10.938660 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-21 19:29:10.938673 | mon1 | Tuesday 21 April 2026 19:29:10 +0000 (0:00:06.415) 0:08:05.351 ********* 2026-04-21 19:29:11.063454 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-21 19:29:11.063508 | mon1 | 2026-04-21 19:29:11.063522 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-21 19:29:11.063535 | mon1 | Tuesday 21 April 2026 19:29:11 +0000 (0:00:00.125) 0:08:05.476 ********* 2026-04-21 19:29:11.116164 | mon1 | ok: [osd1] 2026-04-21 19:29:11.116196 | mon1 | 2026-04-21 19:29:11.116209 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-21 19:29:11.116221 | mon1 | Tuesday 21 April 2026 19:29:11 +0000 (0:00:00.052) 0:08:05.529 ********* 2026-04-21 19:29:17.475437 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:29:17.475526 | mon1 | 2026-04-21 19:29:17.475663 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-21 19:29:17.475775 | mon1 | Tuesday 21 April 2026 19:29:17 +0000 (0:00:06.359) 0:08:11.889 ********* 2026-04-21 19:29:17.523934 | mon1 | ok: [osd1] 2026-04-21 19:29:17.524000 | mon1 | 2026-04-21 19:29:17.524758 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-21 19:29:17.524847 | mon1 | Tuesday 21 April 2026 19:29:17 +0000 (0:00:00.048) 0:08:11.937 ********* 2026-04-21 19:29:17.569979 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:29:17.570045 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:29:17.570058 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:29:17.570069 | mon1 | skipping: [osd1] 2026-04-21 19:29:17.570081 | mon1 | 2026-04-21 19:29:17.570093 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-21 19:29:17.570288 | mon1 | Tuesday 21 April 2026 19:29:17 +0000 (0:00:00.045) 0:08:11.983 ********* 2026-04-21 19:29:17.607968 | mon1 | skipping: [osd1] 2026-04-21 19:29:17.608042 | mon1 | 2026-04-21 19:29:17.608093 | mon1 | PLAY RECAP ********************************************************************* 2026-04-21 19:29:17.609863 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-21 19:29:17.609900 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-04-21 19:29:17.609913 | mon1 | 2026-04-21 19:29:17.609925 | mon1 | 2026-04-21 19:29:17.609937 | mon1 | TASKS RECAP ******************************************************************** 2026-04-21 19:29:17.609949 | mon1 | Tuesday 21 April 2026 19:29:17 +0000 (0:00:00.039) 0:08:12.022 ********* 2026-04-21 19:29:17.609960 | mon1 | =============================================================================== 2026-04-21 19:29:17.610161 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 98.52s 2026-04-21 19:29:17.610585 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 95.02s 2026-04-21 19:29:17.610977 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 52.01s 2026-04-21 19:29:17.611328 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 50.98s 2026-04-21 19:29:17.611637 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.49s 2026-04-21 19:29:17.611973 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.44s 2026-04-21 19:29:17.612291 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.99s 2026-04-21 19:29:17.612592 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.48s 2026-04-21 19:29:17.612934 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.48s 2026-04-21 19:29:17.613253 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.46s 2026-04-21 19:29:17.613554 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.87s 2026-04-21 19:29:17.613902 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.93s 2026-04-21 19:29:17.614218 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.77s 2026-04-21 19:29:17.614558 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.49s 2026-04-21 19:29:17.614901 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.47s 2026-04-21 19:29:17.615215 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.42s 2026-04-21 19:29:17.615510 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.36s 2026-04-21 19:29:17.615877 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.32s 2026-04-21 19:29:17.616197 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.94s 2026-04-21 19:29:17.616494 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.55s 2026-04-21 19:29:17.726448 | mon1 | INFO [default > converge] Executed: Successful 2026-04-21 19:29:17.736724 | mon1 | INFO [default > idempotence] Executing 2026-04-21 19:29:18.770297 | mon1 | 2026-04-21 19:29:18.770626 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-21 19:29:18.770804 | mon1 | 2026-04-21 19:29:18.771023 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:29:18.771214 | mon1 | Tuesday 21 April 2026 19:29:18 +0000 (0:00:00.062) 0:00:00.062 ********* 2026-04-21 19:29:20.012015 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-21 19:29:20.012388 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:29:20.013358 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:29:20.013386 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:29:20.013396 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:29:20.025997 | mon1 | ok: [mon1] 2026-04-21 19:29:20.026059 | mon1 | 2026-04-21 19:29:20.026235 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:29:20.026481 | mon1 | Tuesday 21 April 2026 19:29:20 +0000 (0:00:01.255) 0:00:01.317 ********* 2026-04-21 19:29:20.406681 | mon1 | ok: [mon1] 2026-04-21 19:29:20.406930 | mon1 | 2026-04-21 19:29:20.407176 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:29:20.407419 | mon1 | Tuesday 21 April 2026 19:29:20 +0000 (0:00:00.380) 0:00:01.697 ********* 2026-04-21 19:29:20.447239 | mon1 | skipping: [mon1] 2026-04-21 19:29:20.447436 | mon1 | 2026-04-21 19:29:20.447689 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-21 19:29:20.447962 | mon1 | Tuesday 21 April 2026 19:29:20 +0000 (0:00:00.041) 0:00:01.739 ********* 2026-04-21 19:29:20.821155 | mon1 | ok: [mon1] 2026-04-21 19:29:20.821337 | mon1 | 2026-04-21 19:29:20.821596 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:29:20.821835 | mon1 | Tuesday 21 April 2026 19:29:20 +0000 (0:00:00.373) 0:00:02.113 ********* 2026-04-21 19:29:20.916054 | mon1 | ok: [mon1] => { 2026-04-21 19:29:20.916314 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-21 19:29:20.916516 | mon1 | } 2026-04-21 19:29:20.916769 | mon1 | 2026-04-21 19:29:20.917048 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:29:20.917284 | mon1 | Tuesday 21 April 2026 19:29:20 +0000 (0:00:00.095) 0:00:02.208 ********* 2026-04-21 19:29:21.428488 | mon1 | ok: [mon1] 2026-04-21 19:29:21.428705 | mon1 | 2026-04-21 19:29:21.429031 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:29:21.429369 | mon1 | Tuesday 21 April 2026 19:29:21 +0000 (0:00:00.511) 0:00:02.720 ********* 2026-04-21 19:29:21.478321 | mon1 | skipping: [mon1] 2026-04-21 19:29:21.478561 | mon1 | 2026-04-21 19:29:21.478842 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:29:21.479230 | mon1 | Tuesday 21 April 2026 19:29:21 +0000 (0:00:00.050) 0:00:02.770 ********* 2026-04-21 19:29:21.528293 | mon1 | skipping: [mon1] 2026-04-21 19:29:21.528536 | mon1 | 2026-04-21 19:29:21.528786 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:29:21.529092 | mon1 | Tuesday 21 April 2026 19:29:21 +0000 (0:00:00.050) 0:00:02.820 ********* 2026-04-21 19:29:21.781525 | mon1 | ok: [mon1] 2026-04-21 19:29:21.781673 | mon1 | 2026-04-21 19:29:21.782013 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:29:21.782261 | mon1 | Tuesday 21 April 2026 19:29:21 +0000 (0:00:00.252) 0:00:03.073 ********* 2026-04-21 19:29:23.198724 | mon1 | ok: [mon1] 2026-04-21 19:29:23.198765 | mon1 | 2026-04-21 19:29:23.198780 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:29:23.198786 | mon1 | Tuesday 21 April 2026 19:29:23 +0000 (0:00:01.417) 0:00:04.490 ********* 2026-04-21 19:29:23.399932 | mon1 | ok: [mon1] => { 2026-04-21 19:29:23.400919 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-21 19:29:23.400938 | mon1 | } 2026-04-21 19:29:23.400949 | mon1 | 2026-04-21 19:29:23.400959 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:29:23.401149 | mon1 | Tuesday 21 April 2026 19:29:23 +0000 (0:00:00.200) 0:00:04.690 ********* 2026-04-21 19:29:23.993566 | mon1 | ok: [mon1] 2026-04-21 19:29:23.993687 | mon1 | 2026-04-21 19:29:23.993884 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:29:23.994054 | mon1 | Tuesday 21 April 2026 19:29:23 +0000 (0:00:00.594) 0:00:05.285 ********* 2026-04-21 19:29:26.570720 | mon1 | ok: [mon1] 2026-04-21 19:29:26.570946 | mon1 | 2026-04-21 19:29:26.571195 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-21 19:29:26.571430 | mon1 | Tuesday 21 April 2026 19:29:26 +0000 (0:00:02.576) 0:00:07.861 ********* 2026-04-21 19:29:26.606710 | mon1 | skipping: [mon1] 2026-04-21 19:29:26.606938 | mon1 | 2026-04-21 19:29:26.607238 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-21 19:29:26.607437 | mon1 | Tuesday 21 April 2026 19:29:26 +0000 (0:00:00.037) 0:00:07.899 ********* 2026-04-21 19:29:26.642939 | mon1 | skipping: [mon1] 2026-04-21 19:29:26.643137 | mon1 | 2026-04-21 19:29:26.643400 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-21 19:29:26.643628 | mon1 | Tuesday 21 April 2026 19:29:26 +0000 (0:00:00.036) 0:00:07.935 ********* 2026-04-21 19:29:26.676859 | mon1 | skipping: [mon1] 2026-04-21 19:29:26.677069 | mon1 | 2026-04-21 19:29:26.677311 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-21 19:29:26.677549 | mon1 | Tuesday 21 April 2026 19:29:26 +0000 (0:00:00.033) 0:00:07.969 ********* 2026-04-21 19:29:27.791006 | mon1 | ok: [mon1] 2026-04-21 19:29:27.791073 | mon1 | 2026-04-21 19:29:27.791123 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-21 19:29:27.791145 | mon1 | Tuesday 21 April 2026 19:29:27 +0000 (0:00:01.112) 0:00:09.081 ********* 2026-04-21 19:29:28.356947 | mon1 | ok: [mon1] 2026-04-21 19:29:28.357012 | mon1 | 2026-04-21 19:29:28.357605 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-21 19:29:28.357627 | mon1 | Tuesday 21 April 2026 19:29:28 +0000 (0:00:00.566) 0:00:09.648 ********* 2026-04-21 19:29:29.531523 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-04-21 19:29:29.531585 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-21 19:29:29.531596 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-21 19:29:29.531605 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-21 19:29:29.531614 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-21 19:29:29.531623 | mon1 | 2026-04-21 19:29:29.531632 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-21 19:29:29.531641 | mon1 | Tuesday 21 April 2026 19:29:29 +0000 (0:00:01.172) 0:00:10.821 ********* 2026-04-21 19:29:30.271900 | mon1 | ok: [mon1] 2026-04-21 19:29:30.271974 | mon1 | 2026-04-21 19:29:30.271980 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-21 19:29:30.271985 | mon1 | Tuesday 21 April 2026 19:29:30 +0000 (0:00:00.732) 0:00:11.554 ********* 2026-04-21 19:29:30.271989 | mon1 | 2026-04-21 19:29:30.271998 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-21 19:29:30.272298 | mon1 | Tuesday 21 April 2026 19:29:30 +0000 (0:00:00.007) 0:00:11.561 ********* 2026-04-21 19:29:30.975062 | mon1 | ok: [mon1] 2026-04-21 19:29:30.975120 | mon1 | 2026-04-21 19:29:30.975127 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:29:30.975133 | mon1 | Tuesday 21 April 2026 19:29:30 +0000 (0:00:00.703) 0:00:12.265 ********* 2026-04-21 19:29:31.241467 | mon1 | ok: [mon1] 2026-04-21 19:29:31.241510 | mon1 | 2026-04-21 19:29:31.241521 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:29:31.241531 | mon1 | Tuesday 21 April 2026 19:29:31 +0000 (0:00:00.265) 0:00:12.531 ********* 2026-04-21 19:29:31.321645 | mon1 | ok: [mon1] => { 2026-04-21 19:29:31.321674 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-21 19:29:31.321685 | mon1 | } 2026-04-21 19:29:31.321694 | mon1 | 2026-04-21 19:29:31.321703 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:29:31.321712 | mon1 | Tuesday 21 April 2026 19:29:31 +0000 (0:00:00.080) 0:00:12.612 ********* 2026-04-21 19:29:31.788936 | mon1 | ok: [mon1] 2026-04-21 19:29:31.789030 | mon1 | 2026-04-21 19:29:31.789499 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:29:31.789557 | mon1 | Tuesday 21 April 2026 19:29:31 +0000 (0:00:00.467) 0:00:13.080 ********* 2026-04-21 19:29:35.141591 | mon1 | ok: [mon1] 2026-04-21 19:29:35.141634 | mon1 | 2026-04-21 19:29:35.141639 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-21 19:29:35.141643 | mon1 | Tuesday 21 April 2026 19:29:35 +0000 (0:00:03.351) 0:00:16.432 ********* 2026-04-21 19:29:36.257576 | mon1 | ok: [mon1] 2026-04-21 19:29:36.257700 | mon1 | 2026-04-21 19:29:36.257722 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-21 19:29:36.257847 | mon1 | Tuesday 21 April 2026 19:29:36 +0000 (0:00:01.117) 0:00:17.549 ********* 2026-04-21 19:29:36.626424 | mon1 | ok: [mon1] 2026-04-21 19:29:36.626536 | mon1 | 2026-04-21 19:29:36.626702 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-21 19:29:36.626908 | mon1 | Tuesday 21 April 2026 19:29:36 +0000 (0:00:00.367) 0:00:17.917 ********* 2026-04-21 19:29:37.194523 | mon1 | ok: [mon1] 2026-04-21 19:29:37.194594 | mon1 | 2026-04-21 19:29:37.194783 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-21 19:29:37.194984 | mon1 | Tuesday 21 April 2026 19:29:37 +0000 (0:00:00.568) 0:00:18.485 ********* 2026-04-21 19:29:37.890973 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-04-21 19:29:37.891024 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-21 19:29:37.891028 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-21 19:29:37.891033 | mon1 | 2026-04-21 19:29:37.891037 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-21 19:29:37.891042 | mon1 | Tuesday 21 April 2026 19:29:37 +0000 (0:00:00.695) 0:00:19.181 ********* 2026-04-21 19:29:38.452009 | mon1 | ok: [mon1] 2026-04-21 19:29:38.452097 | mon1 | 2026-04-21 19:29:38.452531 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-21 19:29:38.452589 | mon1 | Tuesday 21 April 2026 19:29:38 +0000 (0:00:00.561) 0:00:19.742 ********* 2026-04-21 19:29:39.020996 | mon1 | ok: [mon1] 2026-04-21 19:29:39.021059 | mon1 | 2026-04-21 19:29:39.021070 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-21 19:29:39.021079 | mon1 | Tuesday 21 April 2026 19:29:39 +0000 (0:00:00.560) 0:00:20.303 ********* 2026-04-21 19:29:39.021088 | mon1 | 2026-04-21 19:29:39.021628 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-21 19:29:39.021654 | mon1 | Tuesday 21 April 2026 19:29:39 +0000 (0:00:00.007) 0:00:20.310 ********* 2026-04-21 19:29:39.486467 | mon1 | ok: [mon1] 2026-04-21 19:29:39.486564 | mon1 | 2026-04-21 19:29:39.486576 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-21 19:29:39.486664 | mon1 | Tuesday 21 April 2026 19:29:39 +0000 (0:00:00.467) 0:00:20.778 ********* 2026-04-21 19:29:39.550674 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-21 19:29:39.550750 | mon1 | 2026-04-21 19:29:39.550761 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-21 19:29:39.550771 | mon1 | Tuesday 21 April 2026 19:29:39 +0000 (0:00:00.062) 0:00:20.841 ********* 2026-04-21 19:29:40.720958 | mon1 | ok: [mon1] 2026-04-21 19:29:40.721018 | mon1 | 2026-04-21 19:29:40.721420 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-21 19:29:40.721463 | mon1 | Tuesday 21 April 2026 19:29:40 +0000 (0:00:01.170) 0:00:22.012 ********* 2026-04-21 19:29:41.588920 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-04-21 19:29:41.588985 | mon1 | ok: [mon1] => (item=ssh) 2026-04-21 19:29:41.589634 | mon1 | 2026-04-21 19:29:41.589679 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-21 19:29:41.589690 | mon1 | Tuesday 21 April 2026 19:29:41 +0000 (0:00:00.867) 0:00:22.879 ********* 2026-04-21 19:29:41.982600 | mon1 | ok: [mon1] 2026-04-21 19:29:41.982692 | mon1 | 2026-04-21 19:29:41.982704 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-21 19:29:41.982715 | mon1 | Tuesday 21 April 2026 19:29:41 +0000 (0:00:00.393) 0:00:23.273 ********* 2026-04-21 19:29:42.233481 | mon1 | ok: [mon1] 2026-04-21 19:29:42.233555 | mon1 | 2026-04-21 19:29:42.233566 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-21 19:29:42.233576 | mon1 | Tuesday 21 April 2026 19:29:42 +0000 (0:00:00.250) 0:00:23.524 ********* 2026-04-21 19:29:42.686409 | mon1 | ok: [mon1] 2026-04-21 19:29:42.686472 | mon1 | 2026-04-21 19:29:42.686512 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-21 19:29:42.686522 | mon1 | Tuesday 21 April 2026 19:29:42 +0000 (0:00:00.451) 0:00:23.975 ********* 2026-04-21 19:29:43.081519 | mon1 | ok: [mon1] 2026-04-21 19:29:43.081581 | mon1 | 2026-04-21 19:29:43.081611 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-21 19:29:43.081621 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.396) 0:00:24.372 ********* 2026-04-21 19:29:43.169896 | mon1 | ok: [mon1] 2026-04-21 19:29:43.169987 | mon1 | 2026-04-21 19:29:43.170284 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-21 19:29:43.170535 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.088) 0:00:24.460 ********* 2026-04-21 19:29:43.456265 | mon1 | ok: [mon1] => (item=mon1) 2026-04-21 19:29:43.456336 | mon1 | 2026-04-21 19:29:43.456459 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-21 19:29:43.456575 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.288) 0:00:24.748 ********* 2026-04-21 19:29:43.501475 | mon1 | ok: [mon1] 2026-04-21 19:29:43.501538 | mon1 | 2026-04-21 19:29:43.501550 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-21 19:29:43.501561 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.042) 0:00:24.790 ********* 2026-04-21 19:29:43.545987 | mon1 | skipping: [mon1] 2026-04-21 19:29:43.546044 | mon1 | 2026-04-21 19:29:43.546225 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:29:43.546484 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.046) 0:00:24.837 ********* 2026-04-21 19:29:43.620431 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-21 19:29:43.620635 | mon1 | 2026-04-21 19:29:43.620910 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:29:43.621154 | mon1 | Tuesday 21 April 2026 19:29:43 +0000 (0:00:00.074) 0:00:24.912 ********* 2026-04-21 19:29:50.152419 | mon1 | ok: [mon1] 2026-04-21 19:29:50.152601 | mon1 | 2026-04-21 19:29:50.152892 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:29:50.153157 | mon1 | Tuesday 21 April 2026 19:29:50 +0000 (0:00:06.531) 0:00:31.444 ********* 2026-04-21 19:29:50.217888 | mon1 | ok: [mon1] => (item=mon1) 2026-04-21 19:29:50.218123 | mon1 | 2026-04-21 19:29:50.218381 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:29:50.218624 | mon1 | Tuesday 21 April 2026 19:29:50 +0000 (0:00:00.065) 0:00:31.510 ********* 2026-04-21 19:29:50.702715 | mon1 | ok: [mon1] 2026-04-21 19:29:50.702927 | mon1 | 2026-04-21 19:29:50.703200 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:29:50.703450 | mon1 | Tuesday 21 April 2026 19:29:50 +0000 (0:00:00.484) 0:00:31.994 ********* 2026-04-21 19:29:57.731908 | mon1 | ok: [mon1] 2026-04-21 19:29:57.731977 | mon1 | 2026-04-21 19:29:57.732251 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-21 19:29:57.732569 | mon1 | Tuesday 21 April 2026 19:29:57 +0000 (0:00:07.029) 0:00:39.023 ********* 2026-04-21 19:30:04.476143 | mon1 | ok: [mon1] 2026-04-21 19:30:04.476659 | mon1 | 2026-04-21 19:30:04.477580 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-21 19:30:04.477613 | mon1 | Tuesday 21 April 2026 19:30:04 +0000 (0:00:06.744) 0:00:45.767 ********* 2026-04-21 19:30:18.944714 | mon1 | ok: [mon1] 2026-04-21 19:30:18.944782 | mon1 | 2026-04-21 19:30:18.944796 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:30:18.944808 | mon1 | Tuesday 21 April 2026 19:30:18 +0000 (0:00:14.468) 0:01:00.235 ********* 2026-04-21 19:30:19.019366 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-04-21 19:30:19.019412 | mon1 | 2026-04-21 19:30:19.019426 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:30:19.019438 | mon1 | Tuesday 21 April 2026 19:30:19 +0000 (0:00:00.074) 0:01:00.310 ********* 2026-04-21 19:30:19.079355 | mon1 | skipping: [mon1] 2026-04-21 19:30:19.079413 | mon1 | 2026-04-21 19:30:19.079426 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:30:19.079439 | mon1 | Tuesday 21 April 2026 19:30:19 +0000 (0:00:00.060) 0:01:00.370 ********* 2026-04-21 19:30:19.133932 | mon1 | skipping: [mon1] => (item=mon1) 2026-04-21 19:30:19.133979 | mon1 | skipping: [mon1] 2026-04-21 19:30:19.133988 | mon1 | 2026-04-21 19:30:19.134260 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:30:19.134593 | mon1 | Tuesday 21 April 2026 19:30:19 +0000 (0:00:00.054) 0:01:00.425 ********* 2026-04-21 19:30:19.467649 | mon1 | ok: [mon1] 2026-04-21 19:30:19.467769 | mon1 | 2026-04-21 19:30:19.468002 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:30:19.468152 | mon1 | Tuesday 21 April 2026 19:30:19 +0000 (0:00:00.334) 0:01:00.759 ********* 2026-04-21 19:30:26.455007 | mon1 | ok: [mon1] 2026-04-21 19:30:26.455117 | mon1 | 2026-04-21 19:30:26.455132 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-21 19:30:26.455145 | mon1 | Tuesday 21 April 2026 19:30:26 +0000 (0:00:06.986) 0:01:07.746 ********* 2026-04-21 19:30:33.109981 | mon1 | ok: [mon1] 2026-04-21 19:30:33.110771 | mon1 | 2026-04-21 19:30:33.110878 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-21 19:30:33.110900 | mon1 | Tuesday 21 April 2026 19:30:33 +0000 (0:00:06.655) 0:01:14.401 ********* 2026-04-21 19:30:39.462713 | mon1 | ok: [mon1] 2026-04-21 19:30:39.462779 | mon1 | 2026-04-21 19:30:39.462794 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-21 19:30:39.462807 | mon1 | Tuesday 21 April 2026 19:30:39 +0000 (0:00:06.351) 0:01:20.753 ********* 2026-04-21 19:30:47.092897 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-04-21 19:30:47.093005 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-04-21 19:30:47.093019 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-04-21 19:30:47.093031 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-04-21 19:30:47.093043 | mon1 | 2026-04-21 19:30:47.093055 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-21 19:30:47.093067 | mon1 | 2026-04-21 19:30:47.093079 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:30:47.093304 | mon1 | Tuesday 21 April 2026 19:30:47 +0000 (0:00:07.629) 0:01:28.382 ********* 2026-04-21 19:30:48.366439 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-04-21 19:30:48.366883 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:30:48.367229 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:30:48.367559 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:30:48.367927 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:30:48.380212 | mon1 | ok: [osd1] 2026-04-21 19:30:48.380534 | mon1 | 2026-04-21 19:30:48.380955 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:30:48.381307 | mon1 | Tuesday 21 April 2026 19:30:48 +0000 (0:00:01.290) 0:01:29.672 ********* 2026-04-21 19:30:48.634635 | mon1 | ok: [osd1] 2026-04-21 19:30:48.635035 | mon1 | 2026-04-21 19:30:48.635369 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:30:48.635688 | mon1 | Tuesday 21 April 2026 19:30:48 +0000 (0:00:00.254) 0:01:29.926 ********* 2026-04-21 19:30:48.672362 | mon1 | skipping: [osd1] 2026-04-21 19:30:48.672689 | mon1 | 2026-04-21 19:30:48.673045 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-21 19:30:48.673361 | mon1 | Tuesday 21 April 2026 19:30:48 +0000 (0:00:00.038) 0:01:29.964 ********* 2026-04-21 19:30:48.954280 | mon1 | ok: [osd1] 2026-04-21 19:30:48.954655 | mon1 | 2026-04-21 19:30:48.955024 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:30:48.955358 | mon1 | Tuesday 21 April 2026 19:30:48 +0000 (0:00:00.281) 0:01:30.245 ********* 2026-04-21 19:30:49.044483 | mon1 | ok: [osd1] => { 2026-04-21 19:30:49.044919 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-21 19:30:49.045249 | mon1 | } 2026-04-21 19:30:49.045550 | mon1 | 2026-04-21 19:30:49.045966 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:30:49.046289 | mon1 | Tuesday 21 April 2026 19:30:49 +0000 (0:00:00.090) 0:01:30.336 ********* 2026-04-21 19:30:49.453035 | mon1 | ok: [osd1] 2026-04-21 19:30:49.453106 | mon1 | 2026-04-21 19:30:49.453127 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:30:49.453349 | mon1 | Tuesday 21 April 2026 19:30:49 +0000 (0:00:00.408) 0:01:30.744 ********* 2026-04-21 19:30:49.502463 | mon1 | skipping: [osd1] 2026-04-21 19:30:49.502651 | mon1 | 2026-04-21 19:30:49.502937 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:30:49.503188 | mon1 | Tuesday 21 April 2026 19:30:49 +0000 (0:00:00.050) 0:01:30.794 ********* 2026-04-21 19:30:49.548308 | mon1 | skipping: [osd1] 2026-04-21 19:30:49.548523 | mon1 | 2026-04-21 19:30:49.548783 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:30:49.549087 | mon1 | Tuesday 21 April 2026 19:30:49 +0000 (0:00:00.045) 0:01:30.840 ********* 2026-04-21 19:30:49.816388 | mon1 | ok: [osd1] 2026-04-21 19:30:49.816583 | mon1 | 2026-04-21 19:30:49.816918 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-21 19:30:49.817184 | mon1 | Tuesday 21 April 2026 19:30:49 +0000 (0:00:00.267) 0:01:31.108 ********* 2026-04-21 19:30:50.964663 | mon1 | ok: [osd1] 2026-04-21 19:30:50.964768 | mon1 | 2026-04-21 19:30:50.964780 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:30:50.964789 | mon1 | Tuesday 21 April 2026 19:30:50 +0000 (0:00:01.146) 0:01:32.254 ********* 2026-04-21 19:30:51.160965 | mon1 | ok: [osd1] => { 2026-04-21 19:30:51.161032 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-21 19:30:51.161042 | mon1 | } 2026-04-21 19:30:51.161051 | mon1 | 2026-04-21 19:30:51.161060 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:30:51.161069 | mon1 | Tuesday 21 April 2026 19:30:51 +0000 (0:00:00.196) 0:01:32.451 ********* 2026-04-21 19:30:51.710409 | mon1 | ok: [osd1] 2026-04-21 19:30:51.710464 | mon1 | 2026-04-21 19:30:51.710475 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:30:51.710485 | mon1 | Tuesday 21 April 2026 19:30:51 +0000 (0:00:00.549) 0:01:33.000 ********* 2026-04-21 19:30:54.005447 | mon1 | ok: [osd1] 2026-04-21 19:30:54.005512 | mon1 | 2026-04-21 19:30:54.005523 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-21 19:30:54.005533 | mon1 | Tuesday 21 April 2026 19:30:54 +0000 (0:00:02.295) 0:01:35.296 ********* 2026-04-21 19:30:54.047894 | mon1 | skipping: [osd1] 2026-04-21 19:30:54.047993 | mon1 | 2026-04-21 19:30:54.048003 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-21 19:30:54.048014 | mon1 | Tuesday 21 April 2026 19:30:54 +0000 (0:00:00.041) 0:01:35.338 ********* 2026-04-21 19:30:54.082162 | mon1 | skipping: [osd1] 2026-04-21 19:30:54.082193 | mon1 | 2026-04-21 19:30:54.082204 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-21 19:30:54.082213 | mon1 | Tuesday 21 April 2026 19:30:54 +0000 (0:00:00.034) 0:01:35.372 ********* 2026-04-21 19:30:54.115486 | mon1 | skipping: [osd1] 2026-04-21 19:30:54.115631 | mon1 | 2026-04-21 19:30:54.115880 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-21 19:30:54.116056 | mon1 | Tuesday 21 April 2026 19:30:54 +0000 (0:00:00.033) 0:01:35.406 ********* 2026-04-21 19:30:55.449461 | mon1 | ok: [osd1] 2026-04-21 19:30:55.449520 | mon1 | 2026-04-21 19:30:55.449530 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-21 19:30:55.449540 | mon1 | Tuesday 21 April 2026 19:30:55 +0000 (0:00:01.333) 0:01:36.740 ********* 2026-04-21 19:30:56.022687 | mon1 | ok: [osd1] 2026-04-21 19:30:56.022758 | mon1 | 2026-04-21 19:30:56.022987 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-21 19:30:56.023222 | mon1 | Tuesday 21 April 2026 19:30:56 +0000 (0:00:00.573) 0:01:37.314 ********* 2026-04-21 19:30:57.193287 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-04-21 19:30:57.193501 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-21 19:30:57.193744 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-21 19:30:57.194112 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-21 19:30:57.194370 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-21 19:30:57.194592 | mon1 | 2026-04-21 19:30:57.194909 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-21 19:30:57.195232 | mon1 | Tuesday 21 April 2026 19:30:57 +0000 (0:00:01.170) 0:01:38.484 ********* 2026-04-21 19:30:57.878478 | mon1 | ok: [osd1] 2026-04-21 19:30:57.878680 | mon1 | 2026-04-21 19:30:57.878980 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-21 19:30:57.879232 | mon1 | Tuesday 21 April 2026 19:30:57 +0000 (0:00:00.679) 0:01:39.164 ********* 2026-04-21 19:30:57.879461 | mon1 | 2026-04-21 19:30:57.879724 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-21 19:30:57.880026 | mon1 | Tuesday 21 April 2026 19:30:57 +0000 (0:00:00.006) 0:01:39.170 ********* 2026-04-21 19:30:58.331005 | mon1 | ok: [osd1] 2026-04-21 19:30:58.331097 | mon1 | 2026-04-21 19:30:58.331105 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-21 19:30:58.331202 | mon1 | Tuesday 21 April 2026 19:30:58 +0000 (0:00:00.452) 0:01:39.622 ********* 2026-04-21 19:30:58.603551 | mon1 | ok: [osd1] 2026-04-21 19:30:58.603901 | mon1 | 2026-04-21 19:30:58.604382 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-21 19:30:58.604754 | mon1 | Tuesday 21 April 2026 19:30:58 +0000 (0:00:00.272) 0:01:39.895 ********* 2026-04-21 19:30:58.696846 | mon1 | ok: [osd1] => { 2026-04-21 19:30:58.696971 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-21 19:30:58.697173 | mon1 | } 2026-04-21 19:30:58.697279 | mon1 | 2026-04-21 19:30:58.697521 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-21 19:30:58.697623 | mon1 | Tuesday 21 April 2026 19:30:58 +0000 (0:00:00.093) 0:01:39.988 ********* 2026-04-21 19:30:59.152085 | mon1 | ok: [osd1] 2026-04-21 19:30:59.152198 | mon1 | 2026-04-21 19:30:59.152209 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-21 19:30:59.152446 | mon1 | Tuesday 21 April 2026 19:30:59 +0000 (0:00:00.455) 0:01:40.444 ********* 2026-04-21 19:31:02.483907 | mon1 | ok: [osd1] 2026-04-21 19:31:02.484485 | mon1 | 2026-04-21 19:31:02.484728 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-21 19:31:02.485019 | mon1 | Tuesday 21 April 2026 19:31:02 +0000 (0:00:03.331) 0:01:43.775 ********* 2026-04-21 19:31:03.623901 | mon1 | ok: [osd1] 2026-04-21 19:31:03.624123 | mon1 | 2026-04-21 19:31:03.624394 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-21 19:31:03.624655 | mon1 | Tuesday 21 April 2026 19:31:03 +0000 (0:00:01.139) 0:01:44.915 ********* 2026-04-21 19:31:03.879094 | mon1 | ok: [osd1] 2026-04-21 19:31:03.879299 | mon1 | 2026-04-21 19:31:03.879589 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-21 19:31:03.879868 | mon1 | Tuesday 21 April 2026 19:31:03 +0000 (0:00:00.254) 0:01:45.170 ********* 2026-04-21 19:31:04.447711 | mon1 | ok: [osd1] 2026-04-21 19:31:04.447941 | mon1 | 2026-04-21 19:31:04.448251 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-21 19:31:04.448521 | mon1 | Tuesday 21 April 2026 19:31:04 +0000 (0:00:00.568) 0:01:45.739 ********* 2026-04-21 19:31:05.143043 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-04-21 19:31:05.143153 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-21 19:31:05.144104 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-21 19:31:05.144176 | mon1 | 2026-04-21 19:31:05.144187 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-21 19:31:05.144197 | mon1 | Tuesday 21 April 2026 19:31:05 +0000 (0:00:00.695) 0:01:46.434 ********* 2026-04-21 19:31:05.715332 | mon1 | ok: [osd1] 2026-04-21 19:31:05.715439 | mon1 | 2026-04-21 19:31:05.715453 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-21 19:31:05.715613 | mon1 | Tuesday 21 April 2026 19:31:05 +0000 (0:00:00.571) 0:01:47.006 ********* 2026-04-21 19:31:06.268158 | mon1 | ok: [osd1] 2026-04-21 19:31:06.268226 | mon1 | 2026-04-21 19:31:06.268237 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-21 19:31:06.268246 | mon1 | Tuesday 21 April 2026 19:31:06 +0000 (0:00:00.541) 0:01:47.548 ********* 2026-04-21 19:31:06.268255 | mon1 | 2026-04-21 19:31:06.268263 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-21 19:31:06.268271 | mon1 | Tuesday 21 April 2026 19:31:06 +0000 (0:00:00.009) 0:01:47.558 ********* 2026-04-21 19:31:06.736559 | mon1 | ok: [osd1] 2026-04-21 19:31:06.736627 | mon1 | 2026-04-21 19:31:06.736639 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-21 19:31:06.736679 | mon1 | Tuesday 21 April 2026 19:31:06 +0000 (0:00:00.469) 0:01:48.027 ********* 2026-04-21 19:31:06.805936 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-04-21 19:31:06.806056 | mon1 | 2026-04-21 19:31:06.806067 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-21 19:31:06.806077 | mon1 | Tuesday 21 April 2026 19:31:06 +0000 (0:00:00.069) 0:01:48.096 ********* 2026-04-21 19:31:07.913996 | mon1 | ok: [osd1] 2026-04-21 19:31:07.914059 | mon1 | 2026-04-21 19:31:07.914070 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-21 19:31:07.914080 | mon1 | Tuesday 21 April 2026 19:31:07 +0000 (0:00:01.107) 0:01:49.204 ********* 2026-04-21 19:31:08.739761 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-04-21 19:31:08.739850 | mon1 | ok: [osd1] => (item=ssh) 2026-04-21 19:31:08.739866 | mon1 | 2026-04-21 19:31:08.739875 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-21 19:31:08.739885 | mon1 | Tuesday 21 April 2026 19:31:08 +0000 (0:00:00.825) 0:01:50.030 ********* 2026-04-21 19:31:09.389476 | mon1 | ok: [osd1] 2026-04-21 19:31:09.389555 | mon1 | 2026-04-21 19:31:09.389567 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-21 19:31:09.389577 | mon1 | Tuesday 21 April 2026 19:31:09 +0000 (0:00:00.649) 0:01:50.679 ********* 2026-04-21 19:31:09.644957 | mon1 | ok: [osd1] 2026-04-21 19:31:09.645034 | mon1 | 2026-04-21 19:31:09.645612 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-21 19:31:09.645681 | mon1 | Tuesday 21 April 2026 19:31:09 +0000 (0:00:00.256) 0:01:50.936 ********* 2026-04-21 19:31:09.971561 | mon1 | ok: [osd1] 2026-04-21 19:31:09.971643 | mon1 | 2026-04-21 19:31:09.971654 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-21 19:31:09.971663 | mon1 | Tuesday 21 April 2026 19:31:09 +0000 (0:00:00.326) 0:01:51.262 ********* 2026-04-21 19:31:10.243954 | mon1 | ok: [osd1] 2026-04-21 19:31:10.244042 | mon1 | 2026-04-21 19:31:10.244053 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-21 19:31:10.244094 | mon1 | Tuesday 21 April 2026 19:31:10 +0000 (0:00:00.271) 0:01:51.534 ********* 2026-04-21 19:31:10.546442 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-04-21 19:31:10.546497 | mon1 | 2026-04-21 19:31:10.546508 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-21 19:31:10.546518 | mon1 | Tuesday 21 April 2026 19:31:10 +0000 (0:00:00.302) 0:01:51.836 ********* 2026-04-21 19:31:10.594673 | mon1 | ok: [osd1] 2026-04-21 19:31:10.594734 | mon1 | 2026-04-21 19:31:10.594747 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-04-21 19:31:10.594758 | mon1 | Tuesday 21 April 2026 19:31:10 +0000 (0:00:00.048) 0:01:51.885 ********* 2026-04-21 19:31:10.662407 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-04-21 19:31:10.662461 | mon1 | 2026-04-21 19:31:10.662472 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-21 19:31:10.662507 | mon1 | Tuesday 21 April 2026 19:31:10 +0000 (0:00:00.068) 0:01:51.953 ********* 2026-04-21 19:31:17.091389 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:31:17.091488 | mon1 | 2026-04-21 19:31:17.091509 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-21 19:31:17.091661 | mon1 | Tuesday 21 April 2026 19:31:17 +0000 (0:00:06.425) 0:01:58.378 ********* 2026-04-21 19:31:17.151792 | mon1 | ok: [osd1] => (item=osd1) 2026-04-21 19:31:17.151906 | mon1 | 2026-04-21 19:31:17.152275 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-21 19:31:17.152340 | mon1 | Tuesday 21 April 2026 19:31:17 +0000 (0:00:00.065) 0:01:58.443 ********* 2026-04-21 19:31:17.488686 | mon1 | ok: [osd1] 2026-04-21 19:31:17.488747 | mon1 | 2026-04-21 19:31:17.488761 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-21 19:31:17.488775 | mon1 | Tuesday 21 April 2026 19:31:17 +0000 (0:00:00.335) 0:01:58.779 ********* 2026-04-21 19:31:24.429400 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:31:24.429495 | mon1 | 2026-04-21 19:31:24.429516 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-21 19:31:24.429652 | mon1 | Tuesday 21 April 2026 19:31:24 +0000 (0:00:06.940) 0:02:05.719 ********* 2026-04-21 19:31:30.092159 | mon1 | ok: [osd1] 2026-04-21 19:31:30.092250 | mon1 | 2026-04-21 19:31:30.092317 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-21 19:31:30.092443 | mon1 | Tuesday 21 April 2026 19:31:30 +0000 (0:00:05.664) 0:02:11.384 ********* 2026-04-21 19:31:52.489421 | mon1 | ok: [osd1] 2026-04-21 19:31:52.489517 | mon1 | 2026-04-21 19:31:52.489530 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-21 19:31:52.489543 | mon1 | Tuesday 21 April 2026 19:31:52 +0000 (0:00:22.395) 0:02:33.780 ********* 2026-04-21 19:31:52.560604 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-04-21 19:31:52.560680 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-04-21 19:31:52.560688 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-04-21 19:31:52.560695 | mon1 | skipping: [osd1] 2026-04-21 19:31:52.560702 | mon1 | 2026-04-21 19:31:52.560710 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-21 19:31:52.560717 | mon1 | Tuesday 21 April 2026 19:31:52 +0000 (0:00:00.070) 0:02:33.850 ********* 2026-04-21 19:31:58.978956 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:31:58.979024 | mon1 | 2026-04-21 19:31:58.979424 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-21 19:31:58.979478 | mon1 | Tuesday 21 April 2026 19:31:58 +0000 (0:00:06.419) 0:02:40.270 ********* 2026-04-21 19:32:05.336521 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:32:05.336640 | mon1 | 2026-04-21 19:32:05.336844 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-21 19:32:05.337006 | mon1 | Tuesday 21 April 2026 19:32:05 +0000 (0:00:06.357) 0:02:46.627 ********* 2026-04-21 19:32:05.401857 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-04-21 19:32:05.401948 | mon1 | 2026-04-21 19:32:05.401963 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-21 19:32:05.401978 | mon1 | Tuesday 21 April 2026 19:32:05 +0000 (0:00:00.064) 0:02:46.692 ********* 2026-04-21 19:32:05.454924 | mon1 | ok: [osd1] 2026-04-21 19:32:05.455656 | mon1 | 2026-04-21 19:32:05.455721 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-21 19:32:05.455736 | mon1 | Tuesday 21 April 2026 19:32:05 +0000 (0:00:00.053) 0:02:46.746 ********* 2026-04-21 19:32:11.858406 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-04-21 19:32:11.858509 | mon1 | 2026-04-21 19:32:11.858535 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-21 19:32:11.858667 | mon1 | Tuesday 21 April 2026 19:32:11 +0000 (0:00:06.403) 0:02:53.149 ********* 2026-04-21 19:32:11.902509 | mon1 | ok: [osd1] 2026-04-21 19:32:11.902560 | mon1 | 2026-04-21 19:32:11.902570 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-21 19:32:11.902580 | mon1 | Tuesday 21 April 2026 19:32:11 +0000 (0:00:00.043) 0:02:53.193 ********* 2026-04-21 19:32:11.946239 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:32:11.946290 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:32:11.946299 | mon1 | skipping: [osd1] => (item=1) 2026-04-21 19:32:11.946307 | mon1 | skipping: [osd1] 2026-04-21 19:32:11.946316 | mon1 | 2026-04-21 19:32:11.946325 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-21 19:32:11.946334 | mon1 | Tuesday 21 April 2026 19:32:11 +0000 (0:00:00.042) 0:02:53.235 ********* 2026-04-21 19:32:11.990875 | mon1 | skipping: [osd1] 2026-04-21 19:32:11.990925 | mon1 | 2026-04-21 19:32:11.990935 | mon1 | PLAY RECAP ********************************************************************* 2026-04-21 19:32:11.990945 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-21 19:32:11.990953 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-04-21 19:32:11.990962 | mon1 | 2026-04-21 19:32:11.990970 | mon1 | 2026-04-21 19:32:11.990978 | mon1 | TASKS RECAP ******************************************************************** 2026-04-21 19:32:11.990986 | mon1 | Tuesday 21 April 2026 19:32:11 +0000 (0:00:00.044) 0:02:53.280 ********* 2026-04-21 19:32:11.990995 | mon1 | =============================================================================== 2026-04-21 19:32:11.991173 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.40s 2026-04-21 19:32:11.991475 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.47s 2026-04-21 19:32:11.991778 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.63s 2026-04-21 19:32:11.992111 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.03s 2026-04-21 19:32:11.992419 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.99s 2026-04-21 19:32:11.992732 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.94s 2026-04-21 19:32:11.993069 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.74s 2026-04-21 19:32:11.993436 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.66s 2026-04-21 19:32:11.993733 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.53s 2026-04-21 19:32:11.993947 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.43s 2026-04-21 19:32:11.994137 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.42s 2026-04-21 19:32:11.994321 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.40s 2026-04-21 19:32:11.994532 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.36s 2026-04-21 19:32:11.994728 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.35s 2026-04-21 19:32:11.994938 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.66s 2026-04-21 19:32:11.995130 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.35s 2026-04-21 19:32:11.995315 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.33s 2026-04-21 19:32:11.995503 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.58s 2026-04-21 19:32:11.995689 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.30s 2026-04-21 19:32:11.995897 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.42s 2026-04-21 19:32:12.096383 | mon1 | INFO [default > idempotence] Executed: Successful 2026-04-21 19:32:12.107920 | mon1 | INFO [default > side_effect] Executing 2026-04-21 19:32:12.108297 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-21 19:32:12.114062 | mon1 | INFO [default > verify] Executing 2026-04-21 19:32:12.915774 | mon1 | 2026-04-21 19:32:12.916204 | mon1 | PLAY [Verify] ****************************************************************** 2026-04-21 19:32:12.916505 | mon1 | 2026-04-21 19:32:12.916845 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-04-21 19:32:12.917186 | mon1 | Tuesday 21 April 2026 19:32:12 +0000 (0:00:00.009) 0:00:00.009 ********* 2026-04-21 19:32:14.202048 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-04-21 19:32:14.202094 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-04-21 19:32:14.202101 | mon1 | interpreter could change the meaning of that path. See 2026-04-21 19:32:14.202107 | mon1 | https://docs.ansible.com/ansible- 2026-04-21 19:32:14.202112 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-04-21 19:32:14.212764 | mon1 | ok: [mon1] 2026-04-21 19:32:14.212783 | mon1 | 2026-04-21 19:32:14.212790 | mon1 | TASK [Get cluster health status] *********************************************** 2026-04-21 19:32:14.212796 | mon1 | Tuesday 21 April 2026 19:32:14 +0000 (0:00:01.296) 0:00:01.306 ********* 2026-04-21 19:32:25.031216 | mon1 | ok: [mon1] 2026-04-21 19:32:25.031299 | mon1 | 2026-04-21 19:32:25.031314 | mon1 | TASK [Print cluster health status] ********************************************* 2026-04-21 19:32:25.031329 | mon1 | Tuesday 21 April 2026 19:32:25 +0000 (0:00:10.817) 0:00:12.124 ********* 2026-04-21 19:32:25.069660 | mon1 | ok: [mon1] => { 2026-04-21 19:32:25.069935 | mon1 | "_ceph_health": { 2026-04-21 19:32:25.070172 | mon1 | "changed": false, 2026-04-21 19:32:25.070394 | mon1 | "cmd": [ 2026-04-21 19:32:25.070633 | mon1 | "cephadm", 2026-04-21 19:32:25.070900 | mon1 | "shell", 2026-04-21 19:32:25.071134 | mon1 | "--", 2026-04-21 19:32:25.071361 | mon1 | "ceph", 2026-04-21 19:32:25.071630 | mon1 | "health" 2026-04-21 19:32:25.071905 | mon1 | ], 2026-04-21 19:32:25.072144 | mon1 | "delta": "0:00:10.472323", 2026-04-21 19:32:25.072383 | mon1 | "end": "2026-04-21 19:32:24.987087", 2026-04-21 19:32:25.072608 | mon1 | "failed": false, 2026-04-21 19:32:25.072885 | mon1 | "msg": "", 2026-04-21 19:32:25.073116 | mon1 | "rc": 0, 2026-04-21 19:32:25.073356 | mon1 | "start": "2026-04-21 19:32:14.514764", 2026-04-21 19:32:25.073616 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-04-21 19:32:25.073902 | mon1 | "stderr_lines": [ 2026-04-21 19:32:25.074144 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-04-21 19:32:25.074396 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-04-21 19:32:25.074618 | mon1 | ], 2026-04-21 19:32:25.074899 | mon1 | "stdout": "HEALTH_OK", 2026-04-21 19:32:25.075143 | mon1 | "stdout_lines": [ 2026-04-21 19:32:25.075369 | mon1 | "HEALTH_OK" 2026-04-21 19:32:25.075624 | mon1 | ] 2026-04-21 19:32:25.075909 | mon1 | } 2026-04-21 19:32:25.076140 | mon1 | } 2026-04-21 19:32:25.076352 | mon1 | 2026-04-21 19:32:25.076587 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-04-21 19:32:25.076827 | mon1 | Tuesday 21 April 2026 19:32:25 +0000 (0:00:00.039) 0:00:12.163 ********* 2026-04-21 19:32:25.102538 | mon1 | ok: [mon1] => { 2026-04-21 19:32:25.102796 | mon1 | "changed": false, 2026-04-21 19:32:25.103074 | mon1 | "msg": "All assertions passed" 2026-04-21 19:32:25.103300 | mon1 | } 2026-04-21 19:32:25.103572 | mon1 | 2026-04-21 19:32:25.103846 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-04-21 19:32:25.104087 | mon1 | Tuesday 21 April 2026 19:32:25 +0000 (0:00:00.032) 0:00:12.196 ********* 2026-04-21 19:32:33.240046 | mon1 | changed: [mon1] 2026-04-21 19:32:33.240106 | mon1 | 2026-04-21 19:32:33.240134 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-04-21 19:32:33.240249 | mon1 | Tuesday 21 April 2026 19:32:33 +0000 (0:00:08.136) 0:00:20.333 ********* 2026-04-21 19:32:36.189881 | mon1 | changed: [mon1] 2026-04-21 19:32:36.190094 | mon1 | 2026-04-21 19:32:36.190355 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-04-21 19:32:36.190617 | mon1 | Tuesday 21 April 2026 19:32:36 +0000 (0:00:02.950) 0:00:23.283 ********* 2026-04-21 19:32:37.602662 | mon1 | ok: [mon1] 2026-04-21 19:32:37.602722 | mon1 | 2026-04-21 19:32:37.602735 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-04-21 19:32:37.602748 | mon1 | Tuesday 21 April 2026 19:32:37 +0000 (0:00:01.411) 0:00:24.694 ********* 2026-04-21 19:32:37.646552 | mon1 | ok: [mon1] => { 2026-04-21 19:32:37.646592 | mon1 | "changed": false, 2026-04-21 19:32:37.646600 | mon1 | "msg": "All assertions passed" 2026-04-21 19:32:37.646606 | mon1 | } 2026-04-21 19:32:37.646613 | mon1 | 2026-04-21 19:32:37.646620 | mon1 | PLAY RECAP ********************************************************************* 2026-04-21 19:32:37.646628 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-21 19:32:37.646634 | mon1 | 2026-04-21 19:32:37.646640 | mon1 | 2026-04-21 19:32:37.646647 | mon1 | TASKS RECAP ******************************************************************** 2026-04-21 19:32:37.646653 | mon1 | Tuesday 21 April 2026 19:32:37 +0000 (0:00:00.044) 0:00:24.739 ********* 2026-04-21 19:32:37.646659 | mon1 | =============================================================================== 2026-04-21 19:32:37.646666 | mon1 | Get cluster health status ---------------------------------------------- 10.82s 2026-04-21 19:32:37.646672 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.14s 2026-04-21 19:32:37.646678 | mon1 | Create a test Ceph key -------------------------------------------------- 2.95s 2026-04-21 19:32:37.646685 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.41s 2026-04-21 19:32:37.646691 | mon1 | Gathering Facts --------------------------------------------------------- 1.30s 2026-04-21 19:32:37.646697 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-04-21 19:32:37.646704 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-04-21 19:32:37.646710 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-04-21 19:32:37.726956 | mon1 | INFO [default > verify] Executed: Successful 2026-04-21 19:32:37.733204 | mon1 | INFO [default > cleanup] Executing 2026-04-21 19:32:37.733521 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-21 19:32:37.739193 | mon1 | INFO [default > destroy] Executing 2026-04-21 19:32:37.739259 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-21 19:32:37.739359 | mon1 | INFO [default > destroy] Executed: Successful 2026-04-21 19:32:37.739787 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-04-21 19:32:38.289338 | mon1 | ok: Runtime: 0:12:48.617407 2026-04-21 19:32:38.304458 | 2026-04-21 19:32:38.304528 | PLAY RECAP 2026-04-21 19:32:38.304588 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-21 19:32:38.304617 | 2026-04-21 19:32:38.420747 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-21 19:32:38.426235 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-21 19:32:39.017918 | 2026-04-21 19:32:39.018525 | PLAY [all] 2026-04-21 19:32:39.032682 | 2026-04-21 19:32:39.032823 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-21 19:32:39.086439 | mon1 | ok 2026-04-21 19:32:39.092921 | osd1 | ok 2026-04-21 19:32:39.098256 | 2026-04-21 19:32:39.098329 | TASK [fetch-output : Set log path for single node] 2026-04-21 19:32:39.122667 | mon1 | skipping: Conditional result was False 2026-04-21 19:32:39.133742 | osd1 | skipping: Conditional result was False 2026-04-21 19:32:39.143668 | 2026-04-21 19:32:39.143740 | LOOP [fetch-output : Ensure local output dirs] 2026-04-21 19:32:39.526975 | mon1 -> localhost | changed: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/logs/mon1" 2026-04-21 19:32:39.535040 | osd1 -> localhost | changed: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/logs/osd1" 2026-04-21 19:32:39.733607 | mon1 -> localhost | changed: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/artifacts" 2026-04-21 19:32:39.754270 | osd1 -> localhost | ok: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/artifacts" 2026-04-21 19:32:39.952824 | mon1 -> localhost | changed: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/docs" 2026-04-21 19:32:39.962939 | osd1 -> localhost | ok: "/var/lib/zuul/builds/aa27d512de43437196b33cc8aa60235f/work/docs" 2026-04-21 19:32:39.963078 | osd1 -> localhost | changed: All items complete 2026-04-21 19:32:39.963150 | 2026-04-21 19:32:39.987306 | 2026-04-21 19:32:39.987471 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-21 19:32:40.628118 | osd1 | changed: .d..t...... ./ 2026-04-21 19:32:40.633336 | mon1 | changed: .d..t...... ./ 2026-04-21 19:32:41.097919 | mon1 | changed: .d..t...... ./ 2026-04-21 19:32:41.112330 | osd1 | changed: .d..t...... ./ 2026-04-21 19:32:41.564766 | mon1 | changed: .d..t...... ./ 2026-04-21 19:32:41.583230 | osd1 | changed: .d..t...... ./ 2026-04-21 19:32:41.583480 | osd1 | changed: All items complete 2026-04-21 19:32:41.583614 | 2026-04-21 19:32:41.611225 | 2026-04-21 19:32:41.611380 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-21 19:32:42.011358 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007161 2026-04-21 19:32:42.226001 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007976 2026-04-21 19:32:42.253294 | 2026-04-21 19:32:42.253434 | PLAY [all] 2026-04-21 19:32:42.260096 | 2026-04-21 19:32:42.260190 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-21 19:32:42.742289 | mon1 | changed 2026-04-21 19:32:42.935427 | osd1 | changed 2026-04-21 19:32:42.950235 | 2026-04-21 19:32:42.950287 | PLAY RECAP 2026-04-21 19:32:42.950337 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-21 19:32:42.950366 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-21 19:32:42.950401 | 2026-04-21 19:32:43.078709 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-21 19:32:43.081826 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-21 19:32:43.646923 | 2026-04-21 19:32:43.647081 | PLAY [localhost] 2026-04-21 19:32:43.661667 | 2026-04-21 19:32:43.661770 | TASK [Generate Zuul manifest] 2026-04-21 19:32:43.687191 | localhost | ok 2026-04-21 19:32:43.703619 | 2026-04-21 19:32:43.703699 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-21 19:32:44.010767 | localhost | changed 2026-04-21 19:32:44.023942 | 2026-04-21 19:32:44.024022 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-21 19:32:44.056705 | localhost | ok 2026-04-21 19:32:44.064721 | 2026-04-21 19:32:44.064788 | TASK [Upload logs] 2026-04-21 19:32:44.089138 | localhost | ok 2026-04-21 19:32:44.146530 | 2026-04-21 19:32:44.146649 | TASK [Set zuul-log-path fact] 2026-04-21 19:32:44.167571 | localhost | ok 2026-04-21 19:32:44.179729 | 2026-04-21 19:32:44.179840 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-21 19:32:44.211727 | localhost | ok 2026-04-21 19:32:44.220242 | 2026-04-21 19:32:44.220323 | TASK [upload-logs : Create log directories] 2026-04-21 19:32:44.618704 | localhost | changed 2026-04-21 19:32:44.626201 | 2026-04-21 19:32:44.626278 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-21 19:32:45.013884 | localhost -> localhost | ok: Runtime: 0:00:00.006105 2026-04-21 19:32:45.019711 | 2026-04-21 19:32:45.019781 | TASK [upload-logs : Upload logs to log server] 2026-04-21 19:32:45.471081 | localhost | Output suppressed because no_log was given 2026-04-21 19:32:45.474771 | 2026-04-21 19:32:45.474837 | LOOP [upload-logs : Compress console log and json output] 2026-04-21 19:32:45.520144 | localhost | skipping: Conditional result was False 2026-04-21 19:32:45.527234 | localhost | skipping: Conditional result was False 2026-04-21 19:32:45.539861 | 2026-04-21 19:32:45.540063 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-21 19:32:45.584144 | localhost | skipping: Conditional result was False 2026-04-21 19:32:45.584583 | 2026-04-21 19:32:45.588045 | localhost | skipping: Conditional result was False 2026-04-21 19:32:45.604340 | 2026-04-21 19:32:45.604549 | LOOP [upload-logs : Upload console log and json output]