2026-03-31 18:17:14.799029 | Job console starting 2026-03-31 18:17:15.366530 | Updating git repos 2026-03-31 18:17:15.390687 | Cloning repos into workspace 2026-03-31 18:17:16.489213 | Restoring repo states 2026-03-31 18:17:16.501130 | Merging changes 2026-03-31 18:17:17.135673 | Checking out repos 2026-03-31 18:17:17.479212 | Preparing playbooks 2026-03-31 18:17:28.275858 | Running Ansible setup 2026-03-31 18:17:33.937012 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:34.655607 | 2026-03-31 18:17:34.655771 | PLAY [localhost] 2026-03-31 18:17:34.664759 | 2026-03-31 18:17:34.664846 | TASK [Gathering Facts] 2026-03-31 18:17:35.802918 | localhost | ok 2026-03-31 18:17:35.812291 | 2026-03-31 18:17:35.812463 | TASK [Setup log path fact] 2026-03-31 18:17:35.830595 | localhost | ok 2026-03-31 18:17:35.846171 | 2026-03-31 18:17:35.846311 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:17:35.875241 | localhost | ok 2026-03-31 18:17:35.882742 | 2026-03-31 18:17:35.882825 | TASK [emit-job-header : Print job information] 2026-03-31 18:17:35.920549 | # Job Information 2026-03-31 18:17:35.920699 | Ansible Version: 2.16.16 2026-03-31 18:17:35.920732 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-03-31 18:17:35.920756 | Pipeline: check 2026-03-31 18:17:35.920776 | Executor: 0a8996d2b663 2026-03-31 18:17:35.920797 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/96 2026-03-31 18:17:35.920820 | Event ID: 55a9a070-2d11-11f1-9233-a3bfad3c5a11 2026-03-31 18:17:35.923590 | 2026-03-31 18:17:35.923662 | LOOP [emit-job-header : Print node information] 2026-03-31 18:17:36.020757 | localhost | ok: 2026-03-31 18:17:36.021221 | localhost | # Node Information 2026-03-31 18:17:36.021258 | localhost | Inventory Hostname: mon1 2026-03-31 18:17:36.021282 | localhost | Hostname: np0000161924 2026-03-31 18:17:36.021302 | localhost | Username: zuul 2026-03-31 18:17:36.021326 | localhost | Distro: Ubuntu 24.04 2026-03-31 18:17:36.021347 | localhost | Provider: yul1 2026-03-31 18:17:36.021367 | localhost | Region: ca-ymq-1 2026-03-31 18:17:36.021386 | localhost | Label: ubuntu-noble 2026-03-31 18:17:36.021405 | localhost | Product Name: OpenStack Nova 2026-03-31 18:17:36.021424 | localhost | Interface IP: 199.19.213.54 2026-03-31 18:17:36.071544 | localhost | ok: 2026-03-31 18:17:36.071662 | localhost | # Node Information 2026-03-31 18:17:36.071691 | localhost | Inventory Hostname: osd1 2026-03-31 18:17:36.071713 | localhost | Hostname: np0000161925 2026-03-31 18:17:36.071734 | localhost | Username: zuul 2026-03-31 18:17:36.071772 | localhost | Distro: Ubuntu 24.04 2026-03-31 18:17:36.071795 | localhost | Provider: yul1 2026-03-31 18:17:36.071815 | localhost | Region: ca-ymq-1 2026-03-31 18:17:36.071835 | localhost | Label: ubuntu-noble 2026-03-31 18:17:36.071855 | localhost | Product Name: OpenStack Nova 2026-03-31 18:17:36.071875 | localhost | Interface IP: 199.19.213.20 2026-03-31 18:17:36.090859 | 2026-03-31 18:17:36.091091 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-31 18:17:36.662792 | localhost -> localhost | changed 2026-03-31 18:17:36.667919 | 2026-03-31 18:17:36.667990 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-31 18:17:37.775104 | localhost -> localhost | changed 2026-03-31 18:17:37.781935 | 2026-03-31 18:17:37.782035 | PLAY [all] 2026-03-31 18:17:37.796128 | 2026-03-31 18:17:37.796274 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-31 18:17:38.182199 | mon1 -> localhost | ok 2026-03-31 18:17:38.195218 | 2026-03-31 18:17:38.195589 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-31 18:17:38.221997 | mon1 | ok 2026-03-31 18:17:38.359294 | osd1 | ok 2026-03-31 18:17:38.383143 | mon1 | included: /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-31 18:17:38.383240 | osd1 | included: /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-31 18:17:38.389611 | 2026-03-31 18:17:38.389675 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-31 18:17:39.267027 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-31 18:17:39.267190 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/a90fb7394f7f4da08bde4d7f288abc9f_id_rsa 2026-03-31 18:17:39.267223 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/a90fb7394f7f4da08bde4d7f288abc9f_id_rsa.pub 2026-03-31 18:17:39.267247 | mon1 -> localhost | The key fingerprint is: 2026-03-31 18:17:39.267271 | mon1 -> localhost | SHA256:YlQoYptGJpZrcQetmHLDO99+u3nT78uKRNnAhG+DaPo zuul-build-sshkey 2026-03-31 18:17:39.267292 | mon1 -> localhost | The key's randomart image is: 2026-03-31 18:17:39.267313 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-31 18:17:39.267334 | mon1 -> localhost | | ..o .... | 2026-03-31 18:17:39.267356 | mon1 -> localhost | |.+=..o...o | 2026-03-31 18:17:39.267376 | mon1 -> localhost | |.**+o... oo | 2026-03-31 18:17:39.267396 | mon1 -> localhost | |.=B. .o . ++ | 2026-03-31 18:17:39.267416 | mon1 -> localhost | |oo o oo S.o.. | 2026-03-31 18:17:39.267437 | mon1 -> localhost | | o .. . . | 2026-03-31 18:17:39.267457 | mon1 -> localhost | | o o .. | 2026-03-31 18:17:39.267477 | mon1 -> localhost | | . E .oo... | 2026-03-31 18:17:39.267497 | mon1 -> localhost | | ...++...+=. | 2026-03-31 18:17:39.267517 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-31 18:17:39.267565 | mon1 -> localhost | ok: Runtime: 0:00:00.380514 2026-03-31 18:17:39.274577 | 2026-03-31 18:17:39.302189 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-31 18:17:39.335814 | mon1 | ok 2026-03-31 18:17:39.341042 | osd1 | ok 2026-03-31 18:17:39.355897 | mon1 | included: /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-31 18:17:39.356008 | osd1 | included: /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-31 18:17:39.368232 | 2026-03-31 18:17:39.368346 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-31 18:17:39.417655 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:39.493497 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:39.519542 | 2026-03-31 18:17:39.519677 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-31 18:17:40.068663 | osd1 | changed 2026-03-31 18:17:40.435557 | mon1 | changed 2026-03-31 18:17:40.445338 | 2026-03-31 18:17:40.445479 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-31 18:17:40.700199 | osd1 | ok 2026-03-31 18:17:40.705254 | mon1 | ok 2026-03-31 18:17:40.714824 | 2026-03-31 18:17:40.714971 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-31 18:17:41.312876 | mon1 | changed 2026-03-31 18:17:41.387053 | osd1 | changed 2026-03-31 18:17:41.414282 | 2026-03-31 18:17:41.414430 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-31 18:17:42.025721 | mon1 | changed 2026-03-31 18:17:42.033624 | osd1 | changed 2026-03-31 18:17:42.042515 | 2026-03-31 18:17:42.042677 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-31 18:17:42.061514 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:42.079378 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:42.204632 | 2026-03-31 18:17:42.204740 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-31 18:17:42.788162 | mon1 -> localhost | changed 2026-03-31 18:17:42.809927 | 2026-03-31 18:17:42.810044 | TASK [add-build-sshkey : Add back temp key] 2026-03-31 18:17:43.260927 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/a90fb7394f7f4da08bde4d7f288abc9f_id_rsa (zuul-build-sshkey) 2026-03-31 18:17:43.261249 | mon1 -> localhost | ok: Runtime: 0:00:00.013853 2026-03-31 18:17:43.269891 | 2026-03-31 18:17:43.270020 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-31 18:17:43.640241 | mon1 | ok 2026-03-31 18:17:43.646582 | osd1 | ok 2026-03-31 18:17:43.654049 | 2026-03-31 18:17:43.654185 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-31 18:17:43.682609 | mon1 | skipping: Conditional result was False 2026-03-31 18:17:43.904840 | osd1 | skipping: Conditional result was False 2026-03-31 18:17:43.944913 | 2026-03-31 18:17:43.945095 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-31 18:17:44.305552 | osd1 | ok 2026-03-31 18:17:44.334543 | mon1 | ok 2026-03-31 18:17:44.341129 | 2026-03-31 18:17:44.341197 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-31 18:17:45.173215 | mon1 | Output suppressed because no_log was given 2026-03-31 18:17:45.258839 | osd1 | Output suppressed because no_log was given 2026-03-31 18:17:45.280543 | 2026-03-31 18:17:45.280667 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-31 18:17:45.512519 | osd1 | ok: "logs" 2026-03-31 18:17:45.512833 | osd1 | ok: All items complete 2026-03-31 18:17:45.512878 | 2026-03-31 18:17:45.527843 | mon1 | ok: "logs" 2026-03-31 18:17:45.705755 | osd1 | ok: "artifacts" 2026-03-31 18:17:45.732534 | mon1 | ok: "artifacts" 2026-03-31 18:17:45.889400 | osd1 | ok: "docs" 2026-03-31 18:17:45.924545 | mon1 | ok: "docs" 2026-03-31 18:17:45.943734 | 2026-03-31 18:17:46.134405 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-31 18:17:46.370289 | mon1 | changed: "logs" 2026-03-31 18:17:46.509296 | mon1 | ok: All items complete 2026-03-31 18:17:46.509534 | 2026-03-31 18:17:46.519948 | osd1 | changed: "logs" 2026-03-31 18:17:46.565444 | mon1 | changed: "artifacts" 2026-03-31 18:17:46.574551 | osd1 | changed: "artifacts" 2026-03-31 18:17:46.770993 | mon1 | changed: "docs" 2026-03-31 18:17:46.892835 | osd1 | changed: "docs" 2026-03-31 18:17:46.916767 | 2026-03-31 18:17:46.916897 | PLAY RECAP 2026-03-31 18:17:46.916966 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:46.917002 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-31 18:17:46.917028 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-31 18:17:46.917047 | 2026-03-31 18:17:47.083159 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-31 18:17:47.088125 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:47.839325 | 2026-03-31 18:17:47.839470 | PLAY [all] 2026-03-31 18:17:47.852101 | 2026-03-31 18:17:47.932057 | TASK [setup-uv : Extract archive] 2026-03-31 18:17:50.362094 | osd1 | changed 2026-03-31 18:17:50.521482 | mon1 | changed 2026-03-31 18:17:50.528486 | 2026-03-31 18:17:50.528642 | TASK [setup-uv : Print version] 2026-03-31 18:17:50.953020 | osd1 | uv 0.8.13 2026-03-31 18:17:50.947411 | mon1 | uv 0.8.13 2026-03-31 18:17:51.207193 | mon1 | ok: Runtime: 0:00:00.015395 2026-03-31 18:17:51.218502 | osd1 | ok: Runtime: 0:00:00.014611 2026-03-31 18:17:51.229861 | 2026-03-31 18:17:51.229958 | PLAY RECAP 2026-03-31 18:17:51.230005 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:51.230032 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:17:51.230052 | 2026-03-31 18:17:51.354602 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-31 18:17:51.361186 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:17:52.110856 | 2026-03-31 18:17:52.111130 | PLAY [all] 2026-03-31 18:17:52.129374 | 2026-03-31 18:17:52.129583 | TASK [Copy inventory file for Zuul] 2026-03-31 18:17:53.100503 | mon1 | changed 2026-03-31 18:17:53.106814 | 2026-03-31 18:17:53.106891 | TASK [Switch "ansible_host" to private IP] 2026-03-31 18:17:53.485519 | mon1 | changed: 2 replacements made 2026-03-31 18:17:53.491695 | 2026-03-31 18:17:53.491757 | TASK [Run Molecule scenario] 2026-03-31 18:17:53.962701 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-03-31 18:17:53.962822 | mon1 | Creating virtual environment at: .venv 2026-03-31 18:17:54.227755 | mon1 | Downloading netaddr (2.2MiB) 2026-03-31 18:17:54.228355 | mon1 | Downloading pygments (1.2MiB) 2026-03-31 18:17:54.229568 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-31 18:17:54.229770 | mon1 | Downloading cryptography (4.3MiB) 2026-03-31 18:17:54.403647 | mon1 | Downloading netaddr 2026-03-31 18:17:54.416195 | mon1 | Downloading cryptography 2026-03-31 18:17:54.478167 | mon1 | Downloading pygments 2026-03-31 18:17:54.655928 | mon1 | Downloading ansible-core 2026-03-31 18:17:54.699209 | mon1 | Installed 37 packages in 42ms 2026-03-31 18:17:55.485067 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-31 18:17:55.485192 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-31 18:17:56.110355 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-31 18:17:56.110488 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-31 18:18:10.763763 | mon1 | INFO [default > dependency] Executing 2026-03-31 18:18:10.764085 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-31 18:18:10.764427 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-31 18:18:10.764590 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-31 18:18:10.770782 | mon1 | INFO [default > cleanup] Executing 2026-03-31 18:18:10.771106 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:10.776864 | mon1 | INFO [default > destroy] Executing 2026-03-31 18:18:10.776963 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:18:10.777071 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-31 18:18:10.782805 | mon1 | INFO [default > syntax] Executing 2026-03-31 18:18:11.866953 | mon1 | 2026-03-31 18:18:11.867255 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-31 18:18:11.921340 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-31 18:18:11.932664 | mon1 | INFO [default > create] Executing 2026-03-31 18:18:11.934151 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:18:11.940056 | mon1 | INFO [default > prepare] Executing 2026-03-31 18:18:12.716091 | mon1 | 2026-03-31 18:18:12.716459 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-31 18:18:12.716657 | mon1 | 2026-03-31 18:18:12.716915 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:18:12.717212 | mon1 | Tuesday 31 March 2026 18:18:12 +0000 (0:00:00.033) 0:00:00.033 ********* 2026-03-31 18:18:13.991038 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:18:13.991126 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:18:13.991340 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:18:13.991545 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:18:13.991754 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:18:13.996060 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:18:13.996252 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:18:13.996464 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:18:13.996706 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:18:13.996889 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:18:14.004739 | mon1 | ok: [osd1] 2026-03-31 18:18:14.004951 | mon1 | ok: [mon1] 2026-03-31 18:18:14.005169 | mon1 | 2026-03-31 18:18:14.005451 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-31 18:18:14.005697 | mon1 | Tuesday 31 March 2026 18:18:14 +0000 (0:00:01.289) 0:00:01.322 ********* 2026-03-31 18:18:14.824882 | mon1 | changed: [mon1] 2026-03-31 18:18:14.825073 | mon1 | changed: [osd1] 2026-03-31 18:18:14.825301 | mon1 | 2026-03-31 18:18:14.825598 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-31 18:18:14.825857 | mon1 | Tuesday 31 March 2026 18:18:14 +0000 (0:00:00.819) 0:00:02.141 ********* 2026-03-31 18:18:15.133570 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-31 18:18:15.133753 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-31 18:18:15.133970 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-31 18:18:15.155532 | mon1 | changed: [mon1] 2026-03-31 18:18:15.155837 | mon1 | changed: [osd1] 2026-03-31 18:18:15.156089 | mon1 | 2026-03-31 18:18:15.156382 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-31 18:18:15.156671 | mon1 | Tuesday 31 March 2026 18:18:15 +0000 (0:00:00.329) 0:00:02.471 ********* 2026-03-31 18:19:21.059532 | mon1 | changed: [osd1] 2026-03-31 18:19:21.059632 | mon1 | changed: [mon1] 2026-03-31 18:19:21.059832 | mon1 | 2026-03-31 18:19:21.060023 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-31 18:19:21.060200 | mon1 | 2026-03-31 18:19:21.060426 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:19:21.060616 | mon1 | Tuesday 31 March 2026 18:19:21 +0000 (0:01:05.901) 0:01:08.372 ********* 2026-03-31 18:19:22.041071 | mon1 | ok: [osd1] 2026-03-31 18:19:22.041345 | mon1 | 2026-03-31 18:19:22.041749 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-31 18:19:22.042078 | mon1 | Tuesday 31 March 2026 18:19:22 +0000 (0:00:00.985) 0:01:09.358 ********* 2026-03-31 18:19:40.446679 | mon1 | changed: [osd1] 2026-03-31 18:19:40.447330 | mon1 | 2026-03-31 18:19:40.447395 | mon1 | TASK [Start up service] ******************************************************** 2026-03-31 18:19:40.447448 | mon1 | Tuesday 31 March 2026 18:19:40 +0000 (0:00:18.402) 0:01:27.760 ********* 2026-03-31 18:19:41.100418 | mon1 | ok: [osd1] 2026-03-31 18:19:41.100491 | mon1 | 2026-03-31 18:19:41.100804 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-31 18:19:41.101066 | mon1 | Tuesday 31 March 2026 18:19:41 +0000 (0:00:00.655) 0:01:28.416 ********* 2026-03-31 18:19:41.464586 | mon1 | ok: [osd1] 2026-03-31 18:19:41.464762 | mon1 | 2026-03-31 18:19:41.465018 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-31 18:19:41.465291 | mon1 | Tuesday 31 March 2026 18:19:41 +0000 (0:00:00.364) 0:01:28.781 ********* 2026-03-31 18:19:42.217187 | mon1 | changed: [osd1] 2026-03-31 18:19:42.217240 | mon1 | 2026-03-31 18:19:42.217247 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-31 18:19:42.217255 | mon1 | Tuesday 31 March 2026 18:19:42 +0000 (0:00:00.752) 0:01:29.533 ********* 2026-03-31 18:19:42.459497 | mon1 | ok: [osd1] 2026-03-31 18:19:42.459582 | mon1 | 2026-03-31 18:19:42.459721 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-31 18:19:42.459919 | mon1 | Tuesday 31 March 2026 18:19:42 +0000 (0:00:00.242) 0:01:29.776 ********* 2026-03-31 18:19:42.491568 | mon1 | skipping: [osd1] 2026-03-31 18:19:42.491666 | mon1 | 2026-03-31 18:19:42.491973 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-31 18:19:42.492232 | mon1 | Tuesday 31 March 2026 18:19:42 +0000 (0:00:00.032) 0:01:29.809 ********* 2026-03-31 18:19:43.202878 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:43.203083 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:43.203501 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:43.203861 | mon1 | 2026-03-31 18:19:43.204201 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-31 18:19:43.204583 | mon1 | Tuesday 31 March 2026 18:19:43 +0000 (0:00:00.710) 0:01:30.520 ********* 2026-03-31 18:19:43.978961 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:43.979092 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:43.979105 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:43.979259 | mon1 | 2026-03-31 18:19:43.979292 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-31 18:19:43.979456 | mon1 | Tuesday 31 March 2026 18:19:43 +0000 (0:00:00.776) 0:01:31.296 ********* 2026-03-31 18:19:44.834261 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:44.834586 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:44.834918 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:44.835182 | mon1 | 2026-03-31 18:19:44.835550 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-31 18:19:44.835898 | mon1 | Tuesday 31 March 2026 18:19:44 +0000 (0:00:00.854) 0:01:32.150 ********* 2026-03-31 18:19:46.303208 | mon1 | changed: [osd1] => (item=osd0) 2026-03-31 18:19:46.303479 | mon1 | changed: [osd1] => (item=osd1) 2026-03-31 18:19:46.303769 | mon1 | changed: [osd1] => (item=osd2) 2026-03-31 18:19:46.304015 | mon1 | 2026-03-31 18:19:46.304280 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-31 18:19:46.304579 | mon1 | Tuesday 31 March 2026 18:19:46 +0000 (0:00:01.469) 0:01:33.620 ********* 2026-03-31 18:19:47.630789 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-31 18:19:47.630856 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-31 18:19:47.630963 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-31 18:19:47.631088 | mon1 | 2026-03-31 18:19:47.631254 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:19:47.631518 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-31 18:19:47.631627 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-31 18:19:47.631819 | mon1 | 2026-03-31 18:19:47.631944 | mon1 | 2026-03-31 18:19:47.632098 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:19:47.632258 | mon1 | Tuesday 31 March 2026 18:19:47 +0000 (0:00:01.328) 0:01:34.948 ********* 2026-03-31 18:19:47.632436 | mon1 | =============================================================================== 2026-03-31 18:19:47.632595 | mon1 | Update apt cache ------------------------------------------------------- 65.90s 2026-03-31 18:19:47.632754 | mon1 | Install depedencies ---------------------------------------------------- 18.40s 2026-03-31 18:19:47.632924 | mon1 | Create a volume group for each loop device ------------------------------ 1.47s 2026-03-31 18:19:47.633079 | mon1 | Create a logical volume for each loop device ---------------------------- 1.33s 2026-03-31 18:19:47.633235 | mon1 | Gathering Facts --------------------------------------------------------- 1.29s 2026-03-31 18:19:47.633425 | mon1 | Gathering Facts --------------------------------------------------------- 0.99s 2026-03-31 18:19:47.633587 | mon1 | Start loop devices ------------------------------------------------------ 0.85s 2026-03-31 18:19:47.633747 | mon1 | Configure short hostname ------------------------------------------------ 0.82s 2026-03-31 18:19:47.633881 | mon1 | Set permissions on loopback devices ------------------------------------- 0.78s 2026-03-31 18:19:47.634019 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.75s 2026-03-31 18:19:47.634161 | mon1 | Create devices for Ceph ------------------------------------------------- 0.71s 2026-03-31 18:19:47.634306 | mon1 | Start up service -------------------------------------------------------- 0.66s 2026-03-31 18:19:47.634439 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s 2026-03-31 18:19:47.634572 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s 2026-03-31 18:19:47.634696 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s 2026-03-31 18:19:47.634856 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-31 18:19:47.704121 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-31 18:19:47.714858 | mon1 | INFO [default > converge] Executing 2026-03-31 18:19:48.665350 | mon1 | 2026-03-31 18:19:48.665486 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:19:48.665595 | mon1 | 2026-03-31 18:19:48.665727 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:19:48.665890 | mon1 | Tuesday 31 March 2026 18:19:48 +0000 (0:00:00.051) 0:00:00.051 ********* 2026-03-31 18:19:49.778486 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:19:49.778775 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:19:49.779123 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:19:49.779385 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:19:49.779656 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:19:49.789404 | mon1 | ok: [mon1] 2026-03-31 18:19:49.789685 | mon1 | 2026-03-31 18:19:49.789969 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:49.790252 | mon1 | Tuesday 31 March 2026 18:19:49 +0000 (0:00:01.123) 0:00:01.174 ********* 2026-03-31 18:19:50.180154 | mon1 | ok: [mon1] 2026-03-31 18:19:50.180248 | mon1 | 2026-03-31 18:19:50.180468 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:50.180616 | mon1 | Tuesday 31 March 2026 18:19:50 +0000 (0:00:00.390) 0:00:01.565 ********* 2026-03-31 18:19:50.224829 | mon1 | skipping: [mon1] 2026-03-31 18:19:50.224917 | mon1 | 2026-03-31 18:19:50.225095 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:19:50.225240 | mon1 | Tuesday 31 March 2026 18:19:50 +0000 (0:00:00.045) 0:00:01.610 ********* 2026-03-31 18:19:50.579518 | mon1 | changed: [mon1] 2026-03-31 18:19:50.579589 | mon1 | 2026-03-31 18:19:50.579792 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:50.579966 | mon1 | Tuesday 31 March 2026 18:19:50 +0000 (0:00:00.354) 0:00:01.965 ********* 2026-03-31 18:19:50.686857 | mon1 | ok: [mon1] => { 2026-03-31 18:19:50.687114 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:19:50.687389 | mon1 | } 2026-03-31 18:19:50.687776 | mon1 | 2026-03-31 18:19:50.688070 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:50.688473 | mon1 | Tuesday 31 March 2026 18:19:50 +0000 (0:00:00.107) 0:00:02.072 ********* 2026-03-31 18:19:51.476912 | mon1 | changed: [mon1] 2026-03-31 18:19:51.477124 | mon1 | 2026-03-31 18:19:51.477463 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:51.477756 | mon1 | Tuesday 31 March 2026 18:19:51 +0000 (0:00:00.789) 0:00:02.861 ********* 2026-03-31 18:19:51.524015 | mon1 | skipping: [mon1] 2026-03-31 18:19:51.524220 | mon1 | 2026-03-31 18:19:51.524504 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:51.524880 | mon1 | Tuesday 31 March 2026 18:19:51 +0000 (0:00:00.048) 0:00:02.910 ********* 2026-03-31 18:19:51.571685 | mon1 | skipping: [mon1] 2026-03-31 18:19:51.571949 | mon1 | 2026-03-31 18:19:51.572251 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:19:51.572571 | mon1 | Tuesday 31 March 2026 18:19:51 +0000 (0:00:00.047) 0:00:02.957 ********* 2026-03-31 18:19:51.829693 | mon1 | ok: [mon1] 2026-03-31 18:19:51.829905 | mon1 | 2026-03-31 18:19:51.830161 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:19:51.830420 | mon1 | Tuesday 31 March 2026 18:19:51 +0000 (0:00:00.258) 0:00:03.215 ********* 2026-03-31 18:19:52.923847 | mon1 | ok: [mon1] 2026-03-31 18:19:52.923913 | mon1 | 2026-03-31 18:19:52.925472 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:19:52.925528 | mon1 | Tuesday 31 March 2026 18:19:52 +0000 (0:00:01.094) 0:00:04.309 ********* 2026-03-31 18:19:53.167719 | mon1 | ok: [mon1] => { 2026-03-31 18:19:53.167990 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:19:53.168232 | mon1 | } 2026-03-31 18:19:53.168508 | mon1 | 2026-03-31 18:19:53.168789 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:19:53.169021 | mon1 | Tuesday 31 March 2026 18:19:53 +0000 (0:00:00.243) 0:00:04.553 ********* 2026-03-31 18:19:54.113621 | mon1 | changed: [mon1] 2026-03-31 18:19:54.113829 | mon1 | 2026-03-31 18:19:54.114077 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:19:54.114330 | mon1 | Tuesday 31 March 2026 18:19:54 +0000 (0:00:00.942) 0:00:05.495 ********* 2026-03-31 18:19:57.439342 | mon1 | changed: [mon1] 2026-03-31 18:19:57.439582 | mon1 | 2026-03-31 18:19:57.439864 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:19:57.440146 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:03.329) 0:00:08.825 ********* 2026-03-31 18:19:57.476906 | mon1 | skipping: [mon1] 2026-03-31 18:19:57.477071 | mon1 | 2026-03-31 18:19:57.477324 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:19:57.477605 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:00.037) 0:00:08.862 ********* 2026-03-31 18:19:57.513423 | mon1 | skipping: [mon1] 2026-03-31 18:19:57.513686 | mon1 | 2026-03-31 18:19:57.513943 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:19:57.514198 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:00.036) 0:00:08.899 ********* 2026-03-31 18:19:57.552573 | mon1 | skipping: [mon1] 2026-03-31 18:19:57.552657 | mon1 | 2026-03-31 18:19:57.552671 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:19:57.552693 | mon1 | Tuesday 31 March 2026 18:19:57 +0000 (0:00:00.038) 0:00:08.937 ********* 2026-03-31 18:20:29.658386 | mon1 | changed: [mon1] 2026-03-31 18:20:29.658439 | mon1 | 2026-03-31 18:20:29.658445 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:20:29.658451 | mon1 | Tuesday 31 March 2026 18:20:29 +0000 (0:00:32.106) 0:00:41.043 ********* 2026-03-31 18:20:30.376917 | mon1 | changed: [mon1] 2026-03-31 18:20:30.377004 | mon1 | 2026-03-31 18:20:30.377017 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:20:30.377030 | mon1 | Tuesday 31 March 2026 18:20:30 +0000 (0:00:00.717) 0:00:41.761 ********* 2026-03-31 18:20:31.499507 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:20:31.499588 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:20:31.499611 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:20:31.500959 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:20:31.501024 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:20:31.501038 | mon1 | 2026-03-31 18:20:31.501051 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:20:31.501062 | mon1 | Tuesday 31 March 2026 18:20:31 +0000 (0:00:01.122) 0:00:42.883 ********* 2026-03-31 18:20:32.268750 | mon1 | changed: [mon1] 2026-03-31 18:20:32.269998 | mon1 | 2026-03-31 18:20:32.270045 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:20:32.270053 | mon1 | Tuesday 31 March 2026 18:20:32 +0000 (0:00:00.756) 0:00:43.640 ********* 2026-03-31 18:20:32.270058 | mon1 | 2026-03-31 18:20:32.270504 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:20:32.270681 | mon1 | Tuesday 31 March 2026 18:20:32 +0000 (0:00:00.007) 0:00:43.648 ********* 2026-03-31 18:20:33.354454 | mon1 | ok: [mon1] 2026-03-31 18:20:33.354521 | mon1 | 2026-03-31 18:20:33.354896 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-31 18:20:33.354928 | mon1 | Tuesday 31 March 2026 18:20:33 +0000 (0:00:01.091) 0:00:44.739 ********* 2026-03-31 18:20:33.924892 | mon1 | changed: [mon1] 2026-03-31 18:20:33.925044 | mon1 | 2026-03-31 18:20:33.925057 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:20:33.925436 | mon1 | Tuesday 31 March 2026 18:20:33 +0000 (0:00:00.570) 0:00:45.310 ********* 2026-03-31 18:20:35.632908 | mon1 | changed: [mon1] 2026-03-31 18:20:35.632976 | mon1 | 2026-03-31 18:20:35.633184 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:20:35.633212 | mon1 | Tuesday 31 March 2026 18:20:35 +0000 (0:00:01.707) 0:00:47.018 ********* 2026-03-31 18:20:35.883043 | mon1 | ok: [mon1] 2026-03-31 18:20:35.883091 | mon1 | 2026-03-31 18:20:35.883101 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:20:35.883111 | mon1 | Tuesday 31 March 2026 18:20:35 +0000 (0:00:00.249) 0:00:47.267 ********* 2026-03-31 18:20:35.965824 | mon1 | ok: [mon1] => { 2026-03-31 18:20:35.965879 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:20:35.965891 | mon1 | } 2026-03-31 18:20:35.965903 | mon1 | 2026-03-31 18:20:35.965927 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:20:35.965950 | mon1 | Tuesday 31 March 2026 18:20:35 +0000 (0:00:00.081) 0:00:47.349 ********* 2026-03-31 18:20:37.734030 | mon1 | changed: [mon1] 2026-03-31 18:20:37.734076 | mon1 | 2026-03-31 18:20:37.734086 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:20:37.734096 | mon1 | Tuesday 31 March 2026 18:20:37 +0000 (0:00:01.768) 0:00:49.118 ********* 2026-03-31 18:20:42.354106 | mon1 | changed: [mon1] 2026-03-31 18:20:42.354185 | mon1 | 2026-03-31 18:20:42.354197 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:20:42.354208 | mon1 | Tuesday 31 March 2026 18:20:42 +0000 (0:00:04.620) 0:00:53.738 ********* 2026-03-31 18:20:43.680011 | mon1 | ok: [mon1] 2026-03-31 18:20:43.680064 | mon1 | 2026-03-31 18:20:43.680078 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:20:43.680091 | mon1 | Tuesday 31 March 2026 18:20:43 +0000 (0:00:01.325) 0:00:55.063 ********* 2026-03-31 18:20:44.101528 | mon1 | changed: [mon1] 2026-03-31 18:20:44.101615 | mon1 | 2026-03-31 18:20:44.101646 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:20:44.102012 | mon1 | Tuesday 31 March 2026 18:20:44 +0000 (0:00:00.422) 0:00:55.486 ********* 2026-03-31 18:20:44.732866 | mon1 | changed: [mon1] 2026-03-31 18:20:44.732939 | mon1 | 2026-03-31 18:20:44.733161 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:20:44.733201 | mon1 | Tuesday 31 March 2026 18:20:44 +0000 (0:00:00.630) 0:00:56.117 ********* 2026-03-31 18:20:45.414838 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-31 18:20:45.414922 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:20:45.415414 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:20:45.415451 | mon1 | 2026-03-31 18:20:45.415458 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:20:45.415463 | mon1 | Tuesday 31 March 2026 18:20:45 +0000 (0:00:00.681) 0:00:56.799 ********* 2026-03-31 18:20:45.986886 | mon1 | changed: [mon1] 2026-03-31 18:20:45.988451 | mon1 | 2026-03-31 18:20:45.988509 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:20:45.988524 | mon1 | Tuesday 31 March 2026 18:20:45 +0000 (0:00:00.572) 0:00:57.371 ********* 2026-03-31 18:20:46.557844 | mon1 | changed: [mon1] 2026-03-31 18:20:46.557916 | mon1 | 2026-03-31 18:20:46.558503 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:20:46.558572 | mon1 | Tuesday 31 March 2026 18:20:46 +0000 (0:00:00.564) 0:00:57.936 ********* 2026-03-31 18:20:46.558585 | mon1 | 2026-03-31 18:20:46.558598 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:20:46.558610 | mon1 | Tuesday 31 March 2026 18:20:46 +0000 (0:00:00.007) 0:00:57.943 ********* 2026-03-31 18:20:47.396555 | mon1 | ok: [mon1] 2026-03-31 18:20:47.396622 | mon1 | 2026-03-31 18:20:47.397055 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-31 18:20:47.397092 | mon1 | Tuesday 31 March 2026 18:20:47 +0000 (0:00:00.837) 0:00:58.781 ********* 2026-03-31 18:20:48.636489 | mon1 | changed: [mon1] 2026-03-31 18:20:48.636580 | mon1 | 2026-03-31 18:20:48.637180 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:20:48.637237 | mon1 | Tuesday 31 March 2026 18:20:48 +0000 (0:00:01.240) 0:01:00.021 ********* 2026-03-31 18:20:49.346006 | mon1 | changed: [mon1] 2026-03-31 18:20:49.346063 | mon1 | 2026-03-31 18:20:49.346077 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:20:49.346089 | mon1 | Tuesday 31 March 2026 18:20:49 +0000 (0:00:00.709) 0:01:00.730 ********* 2026-03-31 18:20:49.403746 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-31 18:20:49.403799 | mon1 | 2026-03-31 18:20:49.403822 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:20:49.404079 | mon1 | Tuesday 31 March 2026 18:20:49 +0000 (0:00:00.057) 0:01:00.788 ********* 2026-03-31 18:21:08.885437 | mon1 | changed: [mon1] 2026-03-31 18:21:08.885507 | mon1 | 2026-03-31 18:21:08.885521 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:21:08.885856 | mon1 | Tuesday 31 March 2026 18:21:08 +0000 (0:00:19.477) 0:01:20.265 ********* 2026-03-31 18:21:09.664925 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-31 18:21:09.664999 | mon1 | ok: [mon1] => (item=ssh) 2026-03-31 18:21:09.665561 | mon1 | 2026-03-31 18:21:09.665624 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:21:09.665633 | mon1 | Tuesday 31 March 2026 18:21:09 +0000 (0:00:00.784) 0:01:21.050 ********* 2026-03-31 18:21:10.092545 | mon1 | changed: [mon1] 2026-03-31 18:21:10.092643 | mon1 | 2026-03-31 18:21:10.092664 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:21:10.093016 | mon1 | Tuesday 31 March 2026 18:21:10 +0000 (0:00:00.427) 0:01:21.477 ********* 2026-03-31 18:21:10.366126 | mon1 | ok: [mon1] 2026-03-31 18:21:10.366189 | mon1 | 2026-03-31 18:21:10.366204 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:21:10.366218 | mon1 | Tuesday 31 March 2026 18:21:10 +0000 (0:00:00.272) 0:01:21.750 ********* 2026-03-31 18:21:10.927224 | mon1 | changed: [mon1] 2026-03-31 18:21:10.927275 | mon1 | 2026-03-31 18:21:10.927283 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:21:10.927291 | mon1 | Tuesday 31 March 2026 18:21:10 +0000 (0:00:00.560) 0:01:22.310 ********* 2026-03-31 18:21:11.307525 | mon1 | changed: [mon1] 2026-03-31 18:21:11.307880 | mon1 | 2026-03-31 18:21:11.308227 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:21:11.308579 | mon1 | Tuesday 31 March 2026 18:21:11 +0000 (0:00:00.382) 0:01:22.692 ********* 2026-03-31 18:21:11.436491 | mon1 | ok: [mon1] 2026-03-31 18:21:11.436840 | mon1 | 2026-03-31 18:21:11.437171 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:21:11.437515 | mon1 | Tuesday 31 March 2026 18:21:11 +0000 (0:00:00.129) 0:01:22.822 ********* 2026-03-31 18:21:11.692997 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:21:11.693406 | mon1 | 2026-03-31 18:21:11.693780 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:21:11.694126 | mon1 | Tuesday 31 March 2026 18:21:11 +0000 (0:00:00.256) 0:01:23.078 ********* 2026-03-31 18:21:11.741152 | mon1 | ok: [mon1] 2026-03-31 18:21:11.741507 | mon1 | 2026-03-31 18:21:11.741834 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:21:11.742146 | mon1 | Tuesday 31 March 2026 18:21:11 +0000 (0:00:00.048) 0:01:23.127 ********* 2026-03-31 18:21:11.863834 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-03-31 18:21:11.864817 | mon1 | 2026-03-31 18:21:11.864845 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-03-31 18:21:11.864856 | mon1 | Tuesday 31 March 2026 18:21:11 +0000 (0:00:00.122) 0:01:23.249 ********* 2026-03-31 18:21:12.199492 | mon1 | changed: [mon1] 2026-03-31 18:21:12.199552 | mon1 | 2026-03-31 18:21:12.199563 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-03-31 18:21:12.199574 | mon1 | Tuesday 31 March 2026 18:21:12 +0000 (0:00:00.334) 0:01:23.584 ********* 2026-03-31 18:21:12.993442 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-03-31 18:21:12.994852 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-03-31 18:21:12.994913 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-03-31 18:21:12.994924 | mon1 | 2026-03-31 18:21:12.994935 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-03-31 18:21:12.994945 | mon1 | Tuesday 31 March 2026 18:21:12 +0000 (0:00:00.794) 0:01:24.379 ********* 2026-03-31 18:22:47.251982 | mon1 | ok: [mon1] 2026-03-31 18:22:47.252043 | mon1 | 2026-03-31 18:22:47.252057 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-03-31 18:22:47.252070 | mon1 | Tuesday 31 March 2026 18:22:47 +0000 (0:01:34.257) 0:02:58.636 ********* 2026-03-31 18:22:47.500794 | mon1 | changed: [mon1] 2026-03-31 18:22:47.500847 | mon1 | 2026-03-31 18:22:47.500992 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-03-31 18:22:47.501130 | mon1 | Tuesday 31 March 2026 18:22:47 +0000 (0:00:00.249) 0:02:58.885 ********* 2026-03-31 18:22:47.540003 | mon1 | ok: [mon1] 2026-03-31 18:22:47.540047 | mon1 | 2026-03-31 18:22:47.540054 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:22:47.540060 | mon1 | Tuesday 31 March 2026 18:22:47 +0000 (0:00:00.039) 0:02:58.925 ********* 2026-03-31 18:22:47.617493 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:22:47.617536 | mon1 | 2026-03-31 18:22:47.618187 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:22:47.618245 | mon1 | Tuesday 31 March 2026 18:22:47 +0000 (0:00:00.077) 0:02:59.002 ********* 2026-03-31 18:22:54.252944 | mon1 | ok: [mon1] 2026-03-31 18:22:54.252998 | mon1 | 2026-03-31 18:22:54.253012 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:22:54.253024 | mon1 | Tuesday 31 March 2026 18:22:54 +0000 (0:00:06.635) 0:03:05.637 ********* 2026-03-31 18:22:54.313753 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:22:54.313786 | mon1 | 2026-03-31 18:22:54.313800 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:22:54.313812 | mon1 | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.060) 0:03:05.698 ********* 2026-03-31 18:22:54.755002 | mon1 | ok: [mon1] 2026-03-31 18:22:54.755050 | mon1 | 2026-03-31 18:22:54.755058 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:22:54.755067 | mon1 | Tuesday 31 March 2026 18:22:54 +0000 (0:00:00.441) 0:03:06.140 ********* 2026-03-31 18:23:01.669525 | mon1 | ok: [mon1] 2026-03-31 18:23:01.669614 | mon1 | 2026-03-31 18:23:01.670242 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:23:01.670305 | mon1 | Tuesday 31 March 2026 18:23:01 +0000 (0:00:06.914) 0:03:13.054 ********* 2026-03-31 18:23:49.944996 | mon1 | changed: [mon1] 2026-03-31 18:23:49.945067 | mon1 | 2026-03-31 18:23:49.945271 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:23:49.945487 | mon1 | Tuesday 31 March 2026 18:23:49 +0000 (0:00:48.273) 0:04:01.328 ********* 2026-03-31 18:24:04.292473 | mon1 | ok: [mon1] 2026-03-31 18:24:04.292537 | mon1 | 2026-03-31 18:24:04.292781 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:24:04.292816 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:14.350) 0:04:15.678 ********* 2026-03-31 18:24:04.362559 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:24:04.362823 | mon1 | 2026-03-31 18:24:04.363522 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:24:04.363574 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.069) 0:04:15.748 ********* 2026-03-31 18:24:04.417881 | mon1 | skipping: [mon1] 2026-03-31 18:24:04.418090 | mon1 | 2026-03-31 18:24:04.418358 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:24:04.418706 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.055) 0:04:15.803 ********* 2026-03-31 18:24:04.466687 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-31 18:24:04.466928 | mon1 | skipping: [mon1] 2026-03-31 18:24:04.467167 | mon1 | 2026-03-31 18:24:04.467495 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:24:04.467810 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.048) 0:04:15.852 ********* 2026-03-31 18:24:04.782698 | mon1 | ok: [mon1] 2026-03-31 18:24:04.782922 | mon1 | 2026-03-31 18:24:04.783203 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:24:04.783508 | mon1 | Tuesday 31 March 2026 18:24:04 +0000 (0:00:00.315) 0:04:16.168 ********* 2026-03-31 18:24:11.961957 | mon1 | ok: [mon1] 2026-03-31 18:24:11.962059 | mon1 | 2026-03-31 18:24:11.962210 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:24:11.962356 | mon1 | Tuesday 31 March 2026 18:24:11 +0000 (0:00:07.178) 0:04:23.346 ********* 2026-03-31 18:24:24.941467 | mon1 | changed: [mon1] 2026-03-31 18:24:24.941539 | mon1 | 2026-03-31 18:24:24.941559 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:24:24.941866 | mon1 | Tuesday 31 March 2026 18:24:24 +0000 (0:00:12.979) 0:04:36.326 ********* 2026-03-31 18:24:31.287000 | mon1 | ok: [mon1] 2026-03-31 18:24:31.287062 | mon1 | 2026-03-31 18:24:31.287076 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:24:31.287088 | mon1 | Tuesday 31 March 2026 18:24:31 +0000 (0:00:06.343) 0:04:42.670 ********* 2026-03-31 18:24:39.101708 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:24:39.101775 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-31 18:24:39.101782 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-03-31 18:24:39.101788 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-31 18:24:39.101794 | mon1 | 2026-03-31 18:24:39.101801 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:24:39.101808 | mon1 | 2026-03-31 18:24:39.101814 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:24:39.101820 | mon1 | Tuesday 31 March 2026 18:24:39 +0000 (0:00:07.813) 0:04:50.484 ********* 2026-03-31 18:24:40.319164 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:24:40.319662 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:24:40.320013 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:24:40.320341 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:24:40.320738 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:24:40.327849 | mon1 | ok: [osd1] 2026-03-31 18:24:40.327944 | mon1 | 2026-03-31 18:24:40.328063 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:24:40.328186 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:01.229) 0:04:51.713 ********* 2026-03-31 18:24:40.582774 | mon1 | ok: [osd1] 2026-03-31 18:24:40.582873 | mon1 | 2026-03-31 18:24:40.583027 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:24:40.583112 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:00.254) 0:04:51.967 ********* 2026-03-31 18:24:40.621439 | mon1 | skipping: [osd1] 2026-03-31 18:24:40.621514 | mon1 | 2026-03-31 18:24:40.621641 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:24:40.621758 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:00.039) 0:04:52.007 ********* 2026-03-31 18:24:40.882836 | mon1 | changed: [osd1] 2026-03-31 18:24:40.882905 | mon1 | 2026-03-31 18:24:40.883059 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:24:40.883204 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:00.259) 0:04:52.267 ********* 2026-03-31 18:24:40.945745 | mon1 | ok: [osd1] => { 2026-03-31 18:24:40.945868 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:24:40.946047 | mon1 | } 2026-03-31 18:24:40.946206 | mon1 | 2026-03-31 18:24:40.946386 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:24:40.946631 | mon1 | Tuesday 31 March 2026 18:24:40 +0000 (0:00:00.063) 0:04:52.331 ********* 2026-03-31 18:24:41.630915 | mon1 | changed: [osd1] 2026-03-31 18:24:41.630989 | mon1 | 2026-03-31 18:24:41.631180 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:24:41.631296 | mon1 | Tuesday 31 March 2026 18:24:41 +0000 (0:00:00.682) 0:04:53.014 ********* 2026-03-31 18:24:41.678804 | mon1 | skipping: [osd1] 2026-03-31 18:24:41.678875 | mon1 | 2026-03-31 18:24:41.678951 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:24:41.679062 | mon1 | Tuesday 31 March 2026 18:24:41 +0000 (0:00:00.050) 0:04:53.064 ********* 2026-03-31 18:24:41.730794 | mon1 | skipping: [osd1] 2026-03-31 18:24:41.730862 | mon1 | 2026-03-31 18:24:41.730958 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:24:41.731071 | mon1 | Tuesday 31 March 2026 18:24:41 +0000 (0:00:00.051) 0:04:53.116 ********* 2026-03-31 18:24:41.989729 | mon1 | ok: [osd1] 2026-03-31 18:24:41.989787 | mon1 | 2026-03-31 18:24:41.989943 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:24:41.990043 | mon1 | Tuesday 31 March 2026 18:24:41 +0000 (0:00:00.258) 0:04:53.374 ********* 2026-03-31 18:24:42.990776 | mon1 | ok: [osd1] 2026-03-31 18:24:42.990891 | mon1 | 2026-03-31 18:24:42.991023 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:24:42.991157 | mon1 | Tuesday 31 March 2026 18:24:42 +0000 (0:00:01.000) 0:04:54.374 ********* 2026-03-31 18:24:43.074787 | mon1 | ok: [osd1] => { 2026-03-31 18:24:43.074841 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:24:43.074962 | mon1 | } 2026-03-31 18:24:43.075061 | mon1 | 2026-03-31 18:24:43.075211 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:24:43.075324 | mon1 | Tuesday 31 March 2026 18:24:43 +0000 (0:00:00.085) 0:04:54.460 ********* 2026-03-31 18:24:44.244850 | mon1 | changed: [osd1] 2026-03-31 18:24:44.244923 | mon1 | 2026-03-31 18:24:44.245014 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:24:44.245127 | mon1 | Tuesday 31 March 2026 18:24:44 +0000 (0:00:01.167) 0:04:55.628 ********* 2026-03-31 18:24:47.155542 | mon1 | changed: [osd1] 2026-03-31 18:24:47.156414 | mon1 | 2026-03-31 18:24:47.156434 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:24:47.156441 | mon1 | Tuesday 31 March 2026 18:24:47 +0000 (0:00:02.912) 0:04:58.541 ********* 2026-03-31 18:24:47.186586 | mon1 | skipping: [osd1] 2026-03-31 18:24:47.186693 | mon1 | 2026-03-31 18:24:47.186708 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:24:47.186731 | mon1 | Tuesday 31 March 2026 18:24:47 +0000 (0:00:00.029) 0:04:58.571 ********* 2026-03-31 18:24:47.226593 | mon1 | skipping: [osd1] 2026-03-31 18:24:47.226700 | mon1 | 2026-03-31 18:24:47.226724 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:24:47.226957 | mon1 | Tuesday 31 March 2026 18:24:47 +0000 (0:00:00.040) 0:04:58.611 ********* 2026-03-31 18:24:47.263498 | mon1 | skipping: [osd1] 2026-03-31 18:24:47.263572 | mon1 | 2026-03-31 18:24:47.263586 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:24:47.263640 | mon1 | Tuesday 31 March 2026 18:24:47 +0000 (0:00:00.036) 0:04:58.647 ********* 2026-03-31 18:24:54.611207 | mon1 | changed: [osd1] 2026-03-31 18:24:54.611277 | mon1 | 2026-03-31 18:24:54.611283 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:24:54.611289 | mon1 | Tuesday 31 March 2026 18:24:54 +0000 (0:00:07.348) 0:05:05.996 ********* 2026-03-31 18:24:55.208781 | mon1 | changed: [osd1] 2026-03-31 18:24:55.208864 | mon1 | 2026-03-31 18:24:55.208879 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:24:55.208893 | mon1 | Tuesday 31 March 2026 18:24:55 +0000 (0:00:00.596) 0:05:06.592 ********* 2026-03-31 18:24:56.347030 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:24:56.347092 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:24:56.347106 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:24:56.347118 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:24:56.347130 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:24:56.347142 | mon1 | 2026-03-31 18:24:56.347154 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:24:56.347166 | mon1 | Tuesday 31 March 2026 18:24:56 +0000 (0:00:01.137) 0:05:07.730 ********* 2026-03-31 18:24:57.037778 | mon1 | changed: [osd1] 2026-03-31 18:24:57.037838 | mon1 | 2026-03-31 18:24:57.037852 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:24:57.037865 | mon1 | Tuesday 31 March 2026 18:24:57 +0000 (0:00:00.684) 0:05:08.414 ********* 2026-03-31 18:24:57.037876 | mon1 | 2026-03-31 18:24:57.037888 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:24:57.037899 | mon1 | Tuesday 31 March 2026 18:24:57 +0000 (0:00:00.006) 0:05:08.421 ********* 2026-03-31 18:24:57.968868 | mon1 | ok: [osd1] 2026-03-31 18:24:57.968925 | mon1 | 2026-03-31 18:24:57.968939 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-31 18:24:57.968951 | mon1 | Tuesday 31 March 2026 18:24:57 +0000 (0:00:00.931) 0:05:09.352 ********* 2026-03-31 18:24:58.555270 | mon1 | changed: [osd1] 2026-03-31 18:24:58.555353 | mon1 | 2026-03-31 18:24:58.555400 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:24:58.555414 | mon1 | Tuesday 31 March 2026 18:24:58 +0000 (0:00:00.585) 0:05:09.938 ********* 2026-03-31 18:24:59.289346 | mon1 | changed: [osd1] 2026-03-31 18:24:59.289465 | mon1 | 2026-03-31 18:24:59.289481 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:24:59.289495 | mon1 | Tuesday 31 March 2026 18:24:59 +0000 (0:00:00.733) 0:05:10.672 ********* 2026-03-31 18:24:59.550520 | mon1 | ok: [osd1] 2026-03-31 18:24:59.550590 | mon1 | 2026-03-31 18:24:59.550606 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:24:59.550627 | mon1 | Tuesday 31 March 2026 18:24:59 +0000 (0:00:00.261) 0:05:10.934 ********* 2026-03-31 18:24:59.619869 | mon1 | ok: [osd1] => { 2026-03-31 18:24:59.620168 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:24:59.620503 | mon1 | } 2026-03-31 18:24:59.620811 | mon1 | 2026-03-31 18:24:59.621192 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:24:59.621576 | mon1 | Tuesday 31 March 2026 18:24:59 +0000 (0:00:00.070) 0:05:11.004 ********* 2026-03-31 18:25:01.021025 | mon1 | changed: [osd1] 2026-03-31 18:25:01.021245 | mon1 | 2026-03-31 18:25:01.021682 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:25:01.022016 | mon1 | Tuesday 31 March 2026 18:25:01 +0000 (0:00:01.400) 0:05:12.405 ********* 2026-03-31 18:25:05.690398 | mon1 | changed: [osd1] 2026-03-31 18:25:05.690468 | mon1 | 2026-03-31 18:25:05.690475 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:25:05.690483 | mon1 | Tuesday 31 March 2026 18:25:05 +0000 (0:00:04.669) 0:05:17.075 ********* 2026-03-31 18:25:06.675909 | mon1 | ok: [osd1] 2026-03-31 18:25:06.675973 | mon1 | 2026-03-31 18:25:06.675988 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:25:06.676001 | mon1 | Tuesday 31 March 2026 18:25:06 +0000 (0:00:00.984) 0:05:18.060 ********* 2026-03-31 18:25:06.982809 | mon1 | changed: [osd1] 2026-03-31 18:25:06.982868 | mon1 | 2026-03-31 18:25:06.982880 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:25:06.982891 | mon1 | Tuesday 31 March 2026 18:25:06 +0000 (0:00:00.307) 0:05:18.367 ********* 2026-03-31 18:25:07.592581 | mon1 | changed: [osd1] 2026-03-31 18:25:07.592721 | mon1 | 2026-03-31 18:25:07.593076 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:25:07.593300 | mon1 | Tuesday 31 March 2026 18:25:07 +0000 (0:00:00.610) 0:05:18.977 ********* 2026-03-31 18:25:08.292715 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-03-31 18:25:08.292977 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:25:08.293311 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:25:08.293634 | mon1 | 2026-03-31 18:25:08.293944 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:25:08.294207 | mon1 | Tuesday 31 March 2026 18:25:08 +0000 (0:00:00.700) 0:05:19.678 ********* 2026-03-31 18:25:08.866914 | mon1 | changed: [osd1] 2026-03-31 18:25:08.867088 | mon1 | 2026-03-31 18:25:08.867347 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:25:08.867693 | mon1 | Tuesday 31 March 2026 18:25:08 +0000 (0:00:00.574) 0:05:20.252 ********* 2026-03-31 18:25:09.429539 | mon1 | changed: [osd1] 2026-03-31 18:25:09.429644 | mon1 | 2026-03-31 18:25:09.429669 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:25:09.430273 | mon1 | Tuesday 31 March 2026 18:25:09 +0000 (0:00:00.553) 0:05:20.806 ********* 2026-03-31 18:25:09.430326 | mon1 | 2026-03-31 18:25:09.430336 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-31 18:25:09.430344 | mon1 | Tuesday 31 March 2026 18:25:09 +0000 (0:00:00.008) 0:05:20.815 ********* 2026-03-31 18:25:10.341473 | mon1 | ok: [osd1] 2026-03-31 18:25:10.341522 | mon1 | 2026-03-31 18:25:10.341531 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-31 18:25:10.341540 | mon1 | Tuesday 31 March 2026 18:25:10 +0000 (0:00:00.911) 0:05:21.726 ********* 2026-03-31 18:25:11.268821 | mon1 | changed: [osd1] 2026-03-31 18:25:11.268881 | mon1 | 2026-03-31 18:25:11.268893 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:25:11.268903 | mon1 | Tuesday 31 March 2026 18:25:11 +0000 (0:00:00.927) 0:05:22.653 ********* 2026-03-31 18:25:11.994476 | mon1 | changed: [osd1] 2026-03-31 18:25:11.994580 | mon1 | 2026-03-31 18:25:11.994596 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:25:11.994609 | mon1 | Tuesday 31 March 2026 18:25:11 +0000 (0:00:00.724) 0:05:23.378 ********* 2026-03-31 18:25:12.051591 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-31 18:25:12.051677 | mon1 | 2026-03-31 18:25:12.052299 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:25:12.052414 | mon1 | Tuesday 31 March 2026 18:25:12 +0000 (0:00:00.058) 0:05:23.436 ********* 2026-03-31 18:25:13.096265 | mon1 | ok: [osd1] 2026-03-31 18:25:13.096316 | mon1 | 2026-03-31 18:25:13.096323 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:25:13.096330 | mon1 | Tuesday 31 March 2026 18:25:13 +0000 (0:00:01.045) 0:05:24.481 ********* 2026-03-31 18:25:13.935278 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-31 18:25:13.935403 | mon1 | ok: [osd1] => (item=ssh) 2026-03-31 18:25:13.935420 | mon1 | 2026-03-31 18:25:13.935430 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:25:13.935440 | mon1 | Tuesday 31 March 2026 18:25:13 +0000 (0:00:00.837) 0:05:25.319 ********* 2026-03-31 18:25:14.336630 | mon1 | changed: [osd1] 2026-03-31 18:25:14.336675 | mon1 | 2026-03-31 18:25:14.336682 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:25:14.336688 | mon1 | Tuesday 31 March 2026 18:25:14 +0000 (0:00:00.401) 0:05:25.721 ********* 2026-03-31 18:25:14.588997 | mon1 | ok: [osd1] 2026-03-31 18:25:14.589052 | mon1 | 2026-03-31 18:25:14.589064 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:25:14.589075 | mon1 | Tuesday 31 March 2026 18:25:14 +0000 (0:00:00.252) 0:05:25.973 ********* 2026-03-31 18:25:14.997442 | mon1 | changed: [osd1] 2026-03-31 18:25:14.997486 | mon1 | 2026-03-31 18:25:14.997493 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:25:14.997510 | mon1 | Tuesday 31 March 2026 18:25:14 +0000 (0:00:00.408) 0:05:26.382 ********* 2026-03-31 18:25:15.258744 | mon1 | changed: [osd1] 2026-03-31 18:25:15.258819 | mon1 | 2026-03-31 18:25:15.259451 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:25:15.259547 | mon1 | Tuesday 31 March 2026 18:25:15 +0000 (0:00:00.260) 0:05:26.643 ********* 2026-03-31 18:25:15.543483 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-31 18:25:15.543553 | mon1 | 2026-03-31 18:25:15.544183 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:25:15.544232 | mon1 | Tuesday 31 March 2026 18:25:15 +0000 (0:00:00.284) 0:05:26.927 ********* 2026-03-31 18:25:15.596875 | mon1 | ok: [osd1] 2026-03-31 18:25:15.597418 | mon1 | 2026-03-31 18:25:15.597459 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:25:15.597467 | mon1 | Tuesday 31 March 2026 18:25:15 +0000 (0:00:00.054) 0:05:26.981 ********* 2026-03-31 18:25:15.664918 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-31 18:25:15.665010 | mon1 | 2026-03-31 18:25:15.665433 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:25:15.665472 | mon1 | Tuesday 31 March 2026 18:25:15 +0000 (0:00:00.067) 0:05:27.049 ********* 2026-03-31 18:25:23.045547 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:25:23.045636 | mon1 | 2026-03-31 18:25:23.045659 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:25:23.045875 | mon1 | Tuesday 31 March 2026 18:25:23 +0000 (0:00:07.380) 0:05:34.430 ********* 2026-03-31 18:25:23.107519 | mon1 | ok: [osd1] => (item=osd1) 2026-03-31 18:25:23.107577 | mon1 | 2026-03-31 18:25:23.107591 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:25:23.107610 | mon1 | Tuesday 31 March 2026 18:25:23 +0000 (0:00:00.062) 0:05:34.492 ********* 2026-03-31 18:25:23.440077 | mon1 | changed: [osd1] 2026-03-31 18:25:23.440145 | mon1 | 2026-03-31 18:25:23.440585 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:25:23.440655 | mon1 | Tuesday 31 March 2026 18:25:23 +0000 (0:00:00.332) 0:05:34.825 ********* 2026-03-31 18:25:32.879477 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:25:32.879543 | mon1 | 2026-03-31 18:25:32.879932 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:25:32.879966 | mon1 | Tuesday 31 March 2026 18:25:32 +0000 (0:00:09.438) 0:05:44.264 ********* 2026-03-31 18:25:34.591445 | mon1 | ok: [osd1] 2026-03-31 18:25:34.591540 | mon1 | 2026-03-31 18:25:34.591554 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:25:34.591568 | mon1 | Tuesday 31 March 2026 18:25:34 +0000 (0:00:01.710) 0:05:45.974 ********* 2026-03-31 18:26:17.081342 | mon1 | ok: [osd1] 2026-03-31 18:26:17.081420 | mon1 | 2026-03-31 18:26:17.081428 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:26:17.081926 | mon1 | Tuesday 31 March 2026 18:26:17 +0000 (0:00:42.492) 0:06:28.466 ********* 2026-03-31 18:27:53.381711 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-03-31 18:27:53.381776 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-03-31 18:27:53.381790 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-03-31 18:27:53.381804 | mon1 | 2026-03-31 18:27:53.381818 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:27:53.381831 | mon1 | Tuesday 31 March 2026 18:27:53 +0000 (0:01:36.298) 0:08:04.765 ********* 2026-03-31 18:27:59.794443 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:27:59.794495 | mon1 | 2026-03-31 18:27:59.794504 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:27:59.794512 | mon1 | Tuesday 31 March 2026 18:27:59 +0000 (0:00:06.413) 0:08:11.179 ********* 2026-03-31 18:28:06.170838 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:28:06.170916 | mon1 | 2026-03-31 18:28:06.174422 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:28:06.174463 | mon1 | Tuesday 31 March 2026 18:28:06 +0000 (0:00:06.376) 0:08:17.556 ********* 2026-03-31 18:28:06.266337 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-31 18:28:06.266613 | mon1 | 2026-03-31 18:28:06.266872 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:28:06.267122 | mon1 | Tuesday 31 March 2026 18:28:06 +0000 (0:00:00.096) 0:08:17.652 ********* 2026-03-31 18:28:06.306600 | mon1 | ok: [osd1] 2026-03-31 18:28:06.306809 | mon1 | 2026-03-31 18:28:06.307058 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:28:06.307304 | mon1 | Tuesday 31 March 2026 18:28:06 +0000 (0:00:00.039) 0:08:17.692 ********* 2026-03-31 18:28:12.665255 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:28:12.665349 | mon1 | 2026-03-31 18:28:12.665523 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:28:12.665681 | mon1 | Tuesday 31 March 2026 18:28:12 +0000 (0:00:06.358) 0:08:24.050 ********* 2026-03-31 18:28:12.716620 | mon1 | ok: [osd1] 2026-03-31 18:28:12.716836 | mon1 | 2026-03-31 18:28:12.717115 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:28:12.717400 | mon1 | Tuesday 31 March 2026 18:28:12 +0000 (0:00:00.051) 0:08:24.101 ********* 2026-03-31 18:28:12.763548 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:28:12.763625 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:28:12.763716 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:28:12.763823 | mon1 | skipping: [osd1] 2026-03-31 18:28:12.763921 | mon1 | 2026-03-31 18:28:12.764038 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:28:12.764161 | mon1 | Tuesday 31 March 2026 18:28:12 +0000 (0:00:00.047) 0:08:24.149 ********* 2026-03-31 18:28:12.800502 | mon1 | skipping: [osd1] 2026-03-31 18:28:12.800564 | mon1 | 2026-03-31 18:28:12.800596 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:28:12.800616 | mon1 | mon1 : ok=59 changed=29 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-31 18:28:12.800881 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-03-31 18:28:12.801112 | mon1 | 2026-03-31 18:28:12.801342 | mon1 | 2026-03-31 18:28:12.801641 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:28:12.801934 | mon1 | Tuesday 31 March 2026 18:28:12 +0000 (0:00:00.036) 0:08:24.186 ********* 2026-03-31 18:28:12.802174 | mon1 | =============================================================================== 2026-03-31 18:28:12.802534 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 96.30s 2026-03-31 18:28:12.802819 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 94.26s 2026-03-31 18:28:12.803062 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 48.27s 2026-03-31 18:28:12.803319 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.49s 2026-03-31 18:28:12.803619 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 32.11s 2026-03-31 18:28:12.803882 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.48s 2026-03-31 18:28:12.804139 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.35s 2026-03-31 18:28:12.804435 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.98s 2026-03-31 18:28:12.804689 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.44s 2026-03-31 18:28:12.804949 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.81s 2026-03-31 18:28:12.805350 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 7.38s 2026-03-31 18:28:12.805707 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.35s 2026-03-31 18:28:12.805957 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.18s 2026-03-31 18:28:12.806217 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.91s 2026-03-31 18:28:12.806554 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.64s 2026-03-31 18:28:12.806840 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.41s 2026-03-31 18:28:12.807078 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.38s 2026-03-31 18:28:12.807356 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.36s 2026-03-31 18:28:12.807622 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.34s 2026-03-31 18:28:12.807876 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.67s 2026-03-31 18:28:12.945499 | mon1 | INFO [default > converge] Executed: Successful 2026-03-31 18:28:12.955851 | mon1 | INFO [default > idempotence] Executing 2026-03-31 18:28:13.942207 | mon1 | 2026-03-31 18:28:13.942490 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-31 18:28:13.942719 | mon1 | 2026-03-31 18:28:13.942967 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:28:13.943214 | mon1 | Tuesday 31 March 2026 18:28:13 +0000 (0:00:00.051) 0:00:00.051 ********* 2026-03-31 18:28:15.211567 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:28:15.211710 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:28:15.211899 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:28:15.212060 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:28:15.212221 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:28:15.223858 | mon1 | ok: [mon1] 2026-03-31 18:28:15.224103 | mon1 | 2026-03-31 18:28:15.224472 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:15.224810 | mon1 | Tuesday 31 March 2026 18:28:15 +0000 (0:00:01.281) 0:00:01.333 ********* 2026-03-31 18:28:15.592878 | mon1 | ok: [mon1] 2026-03-31 18:28:15.593200 | mon1 | 2026-03-31 18:28:15.593663 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:15.593987 | mon1 | Tuesday 31 March 2026 18:28:15 +0000 (0:00:00.368) 0:00:01.702 ********* 2026-03-31 18:28:15.637980 | mon1 | skipping: [mon1] 2026-03-31 18:28:15.638058 | mon1 | 2026-03-31 18:28:15.638242 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:28:15.638446 | mon1 | Tuesday 31 March 2026 18:28:15 +0000 (0:00:00.045) 0:00:01.747 ********* 2026-03-31 18:28:16.000051 | mon1 | ok: [mon1] 2026-03-31 18:28:16.000282 | mon1 | 2026-03-31 18:28:16.000650 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:16.000955 | mon1 | Tuesday 31 March 2026 18:28:15 +0000 (0:00:00.361) 0:00:02.109 ********* 2026-03-31 18:28:16.074051 | mon1 | ok: [mon1] => { 2026-03-31 18:28:16.074307 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:28:16.074655 | mon1 | } 2026-03-31 18:28:16.074962 | mon1 | 2026-03-31 18:28:16.075272 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:16.075626 | mon1 | Tuesday 31 March 2026 18:28:16 +0000 (0:00:00.074) 0:00:02.183 ********* 2026-03-31 18:28:16.566394 | mon1 | ok: [mon1] 2026-03-31 18:28:16.566570 | mon1 | 2026-03-31 18:28:16.566833 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:16.567083 | mon1 | Tuesday 31 March 2026 18:28:16 +0000 (0:00:00.492) 0:00:02.675 ********* 2026-03-31 18:28:16.620237 | mon1 | skipping: [mon1] 2026-03-31 18:28:16.620445 | mon1 | 2026-03-31 18:28:16.620720 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:16.620972 | mon1 | Tuesday 31 March 2026 18:28:16 +0000 (0:00:00.053) 0:00:02.729 ********* 2026-03-31 18:28:16.669859 | mon1 | skipping: [mon1] 2026-03-31 18:28:16.670037 | mon1 | 2026-03-31 18:28:16.670304 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:16.670607 | mon1 | Tuesday 31 March 2026 18:28:16 +0000 (0:00:00.049) 0:00:02.779 ********* 2026-03-31 18:28:16.938961 | mon1 | ok: [mon1] 2026-03-31 18:28:16.939289 | mon1 | 2026-03-31 18:28:16.939772 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:28:16.940438 | mon1 | Tuesday 31 March 2026 18:28:16 +0000 (0:00:00.268) 0:00:03.048 ********* 2026-03-31 18:28:18.152920 | mon1 | ok: [mon1] 2026-03-31 18:28:18.153004 | mon1 | 2026-03-31 18:28:18.153217 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:18.153355 | mon1 | Tuesday 31 March 2026 18:28:18 +0000 (0:00:01.213) 0:00:04.261 ********* 2026-03-31 18:28:18.361467 | mon1 | ok: [mon1] => { 2026-03-31 18:28:18.361717 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:28:18.361957 | mon1 | } 2026-03-31 18:28:18.362184 | mon1 | 2026-03-31 18:28:18.362517 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:18.362739 | mon1 | Tuesday 31 March 2026 18:28:18 +0000 (0:00:00.208) 0:00:04.470 ********* 2026-03-31 18:28:18.920809 | mon1 | ok: [mon1] 2026-03-31 18:28:18.920896 | mon1 | 2026-03-31 18:28:18.923469 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:18.923528 | mon1 | Tuesday 31 March 2026 18:28:18 +0000 (0:00:00.559) 0:00:05.030 ********* 2026-03-31 18:28:21.476793 | mon1 | ok: [mon1] 2026-03-31 18:28:21.476982 | mon1 | 2026-03-31 18:28:21.477455 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:28:21.477899 | mon1 | Tuesday 31 March 2026 18:28:21 +0000 (0:00:02.555) 0:00:07.585 ********* 2026-03-31 18:28:21.515580 | mon1 | skipping: [mon1] 2026-03-31 18:28:21.515629 | mon1 | 2026-03-31 18:28:21.515641 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:28:21.515650 | mon1 | Tuesday 31 March 2026 18:28:21 +0000 (0:00:00.038) 0:00:07.624 ********* 2026-03-31 18:28:21.560569 | mon1 | skipping: [mon1] 2026-03-31 18:28:21.560669 | mon1 | 2026-03-31 18:28:21.560694 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:28:21.560997 | mon1 | Tuesday 31 March 2026 18:28:21 +0000 (0:00:00.045) 0:00:07.669 ********* 2026-03-31 18:28:21.594633 | mon1 | skipping: [mon1] 2026-03-31 18:28:21.594671 | mon1 | 2026-03-31 18:28:21.594685 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:28:21.594697 | mon1 | Tuesday 31 March 2026 18:28:21 +0000 (0:00:00.033) 0:00:07.703 ********* 2026-03-31 18:28:22.619154 | mon1 | ok: [mon1] 2026-03-31 18:28:22.619246 | mon1 | 2026-03-31 18:28:22.619305 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:28:22.619315 | mon1 | Tuesday 31 March 2026 18:28:22 +0000 (0:00:01.023) 0:00:08.727 ********* 2026-03-31 18:28:23.167893 | mon1 | ok: [mon1] 2026-03-31 18:28:23.167941 | mon1 | 2026-03-31 18:28:23.167952 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:28:23.167961 | mon1 | Tuesday 31 March 2026 18:28:23 +0000 (0:00:00.549) 0:00:09.276 ********* 2026-03-31 18:28:24.413492 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:28:24.413566 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:28:24.414501 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:28:24.414538 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:28:24.414551 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:28:24.414563 | mon1 | 2026-03-31 18:28:24.415031 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:28:24.415098 | mon1 | Tuesday 31 March 2026 18:28:24 +0000 (0:00:01.245) 0:00:10.521 ********* 2026-03-31 18:28:25.097348 | mon1 | ok: [mon1] 2026-03-31 18:28:25.097420 | mon1 | 2026-03-31 18:28:25.097426 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:28:25.097431 | mon1 | Tuesday 31 March 2026 18:28:25 +0000 (0:00:00.674) 0:00:11.195 ********* 2026-03-31 18:28:25.097434 | mon1 | 2026-03-31 18:28:25.097438 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:28:25.097442 | mon1 | Tuesday 31 March 2026 18:28:25 +0000 (0:00:00.008) 0:00:11.204 ********* 2026-03-31 18:28:25.831792 | mon1 | ok: [mon1] 2026-03-31 18:28:25.831865 | mon1 | 2026-03-31 18:28:25.832076 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:28:25.832141 | mon1 | Tuesday 31 March 2026 18:28:25 +0000 (0:00:00.736) 0:00:11.940 ********* 2026-03-31 18:28:26.098451 | mon1 | ok: [mon1] 2026-03-31 18:28:26.098502 | mon1 | 2026-03-31 18:28:26.098513 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:28:26.098687 | mon1 | Tuesday 31 March 2026 18:28:26 +0000 (0:00:00.266) 0:00:12.207 ********* 2026-03-31 18:28:26.174724 | mon1 | ok: [mon1] => { 2026-03-31 18:28:26.174772 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:28:26.174779 | mon1 | } 2026-03-31 18:28:26.174784 | mon1 | 2026-03-31 18:28:26.174789 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:28:26.174794 | mon1 | Tuesday 31 March 2026 18:28:26 +0000 (0:00:00.075) 0:00:12.282 ********* 2026-03-31 18:28:26.643920 | mon1 | ok: [mon1] 2026-03-31 18:28:26.643971 | mon1 | 2026-03-31 18:28:26.643982 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:28:26.643992 | mon1 | Tuesday 31 March 2026 18:28:26 +0000 (0:00:00.468) 0:00:12.751 ********* 2026-03-31 18:28:29.985984 | mon1 | ok: [mon1] 2026-03-31 18:28:29.986038 | mon1 | 2026-03-31 18:28:29.986049 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:28:29.986059 | mon1 | Tuesday 31 March 2026 18:28:29 +0000 (0:00:03.342) 0:00:16.093 ********* 2026-03-31 18:28:31.031787 | mon1 | ok: [mon1] 2026-03-31 18:28:31.031885 | mon1 | 2026-03-31 18:28:31.032178 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:28:31.032190 | mon1 | Tuesday 31 March 2026 18:28:31 +0000 (0:00:01.046) 0:00:17.139 ********* 2026-03-31 18:28:31.386236 | mon1 | ok: [mon1] 2026-03-31 18:28:31.386300 | mon1 | 2026-03-31 18:28:31.386314 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:28:31.386334 | mon1 | Tuesday 31 March 2026 18:28:31 +0000 (0:00:00.353) 0:00:17.493 ********* 2026-03-31 18:28:31.927944 | mon1 | ok: [mon1] 2026-03-31 18:28:31.927990 | mon1 | 2026-03-31 18:28:31.928001 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:28:31.928030 | mon1 | Tuesday 31 March 2026 18:28:31 +0000 (0:00:00.542) 0:00:18.036 ********* 2026-03-31 18:28:32.651356 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-03-31 18:28:32.651403 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:28:32.651409 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:28:32.651413 | mon1 | 2026-03-31 18:28:32.651417 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:28:32.651422 | mon1 | Tuesday 31 March 2026 18:28:32 +0000 (0:00:00.722) 0:00:18.759 ********* 2026-03-31 18:28:33.194974 | mon1 | ok: [mon1] 2026-03-31 18:28:33.195560 | mon1 | 2026-03-31 18:28:33.195575 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:28:33.195581 | mon1 | Tuesday 31 March 2026 18:28:33 +0000 (0:00:00.545) 0:00:19.304 ********* 2026-03-31 18:28:33.745659 | mon1 | ok: [mon1] 2026-03-31 18:28:33.745720 | mon1 | 2026-03-31 18:28:33.747152 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:28:33.747208 | mon1 | Tuesday 31 March 2026 18:28:33 +0000 (0:00:00.540) 0:00:19.844 ********* 2026-03-31 18:28:33.747219 | mon1 | 2026-03-31 18:28:33.747229 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:28:33.747237 | mon1 | Tuesday 31 March 2026 18:28:33 +0000 (0:00:00.010) 0:00:19.854 ********* 2026-03-31 18:28:34.201531 | mon1 | ok: [mon1] 2026-03-31 18:28:34.201603 | mon1 | 2026-03-31 18:28:34.202310 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:28:34.202348 | mon1 | Tuesday 31 March 2026 18:28:34 +0000 (0:00:00.455) 0:00:20.310 ********* 2026-03-31 18:28:34.269950 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-31 18:28:34.270037 | mon1 | 2026-03-31 18:28:34.270116 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:28:34.270134 | mon1 | Tuesday 31 March 2026 18:28:34 +0000 (0:00:00.065) 0:00:20.375 ********* 2026-03-31 18:28:35.305398 | mon1 | ok: [mon1] 2026-03-31 18:28:35.305442 | mon1 | 2026-03-31 18:28:35.305449 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:28:35.305455 | mon1 | Tuesday 31 March 2026 18:28:35 +0000 (0:00:01.038) 0:00:21.413 ********* 2026-03-31 18:28:36.138870 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-03-31 18:28:36.138951 | mon1 | ok: [mon1] => (item=ssh) 2026-03-31 18:28:36.139273 | mon1 | 2026-03-31 18:28:36.139298 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:28:36.139304 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.834) 0:00:22.247 ********* 2026-03-31 18:28:36.520897 | mon1 | ok: [mon1] 2026-03-31 18:28:36.521010 | mon1 | 2026-03-31 18:28:36.521023 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:28:36.521033 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.380) 0:00:22.628 ********* 2026-03-31 18:28:36.767898 | mon1 | ok: [mon1] 2026-03-31 18:28:36.767934 | mon1 | 2026-03-31 18:28:36.767939 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:28:36.767943 | mon1 | Tuesday 31 March 2026 18:28:36 +0000 (0:00:00.247) 0:00:22.876 ********* 2026-03-31 18:28:37.245974 | mon1 | ok: [mon1] 2026-03-31 18:28:37.246020 | mon1 | 2026-03-31 18:28:37.246278 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:28:37.246289 | mon1 | Tuesday 31 March 2026 18:28:37 +0000 (0:00:00.476) 0:00:23.352 ********* 2026-03-31 18:28:37.596484 | mon1 | ok: [mon1] 2026-03-31 18:28:37.597447 | mon1 | 2026-03-31 18:28:37.597605 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-03-31 18:28:37.597623 | mon1 | Tuesday 31 March 2026 18:28:37 +0000 (0:00:00.352) 0:00:23.705 ********* 2026-03-31 18:28:37.668534 | mon1 | ok: [mon1] 2026-03-31 18:28:37.669477 | mon1 | 2026-03-31 18:28:37.669605 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-03-31 18:28:37.669620 | mon1 | Tuesday 31 March 2026 18:28:37 +0000 (0:00:00.071) 0:00:23.776 ********* 2026-03-31 18:28:37.959496 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:28:37.959547 | mon1 | 2026-03-31 18:28:37.960029 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-03-31 18:28:37.960076 | mon1 | Tuesday 31 March 2026 18:28:37 +0000 (0:00:00.291) 0:00:24.068 ********* 2026-03-31 18:28:38.012799 | mon1 | ok: [mon1] 2026-03-31 18:28:38.012833 | mon1 | 2026-03-31 18:28:38.012838 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-03-31 18:28:38.012971 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:00.052) 0:00:24.120 ********* 2026-03-31 18:28:38.057920 | mon1 | skipping: [mon1] 2026-03-31 18:28:38.057999 | mon1 | 2026-03-31 18:28:38.058259 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:28:38.058289 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:00.046) 0:00:24.166 ********* 2026-03-31 18:28:38.142013 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:28:38.142071 | mon1 | 2026-03-31 18:28:38.142083 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:28:38.142094 | mon1 | Tuesday 31 March 2026 18:28:38 +0000 (0:00:00.083) 0:00:24.250 ********* 2026-03-31 18:28:44.559480 | mon1 | ok: [mon1] 2026-03-31 18:28:44.559547 | mon1 | 2026-03-31 18:28:44.560095 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:28:44.560151 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:06.417) 0:00:30.667 ********* 2026-03-31 18:28:44.616314 | mon1 | ok: [mon1] => (item=mon1) 2026-03-31 18:28:44.616354 | mon1 | 2026-03-31 18:28:44.616383 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:28:44.616394 | mon1 | Tuesday 31 March 2026 18:28:44 +0000 (0:00:00.057) 0:00:30.725 ********* 2026-03-31 18:28:45.099190 | mon1 | ok: [mon1] 2026-03-31 18:28:45.099243 | mon1 | 2026-03-31 18:28:45.099256 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:28:45.099269 | mon1 | Tuesday 31 March 2026 18:28:45 +0000 (0:00:00.481) 0:00:31.206 ********* 2026-03-31 18:28:52.026795 | mon1 | ok: [mon1] 2026-03-31 18:28:52.026865 | mon1 | 2026-03-31 18:28:52.026947 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-03-31 18:28:52.027063 | mon1 | Tuesday 31 March 2026 18:28:52 +0000 (0:00:06.928) 0:00:38.134 ********* 2026-03-31 18:28:58.943675 | mon1 | ok: [mon1] 2026-03-31 18:28:58.944404 | mon1 | 2026-03-31 18:28:58.944424 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-03-31 18:28:58.944431 | mon1 | Tuesday 31 March 2026 18:28:58 +0000 (0:00:06.918) 0:00:45.053 ********* 2026-03-31 18:29:13.896081 | mon1 | ok: [mon1] 2026-03-31 18:29:13.896143 | mon1 | 2026-03-31 18:29:13.896158 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:29:13.896171 | mon1 | Tuesday 31 March 2026 18:29:13 +0000 (0:00:14.950) 0:01:00.004 ********* 2026-03-31 18:29:13.969356 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-03-31 18:29:13.969415 | mon1 | 2026-03-31 18:29:13.969422 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:29:13.969428 | mon1 | Tuesday 31 March 2026 18:29:13 +0000 (0:00:00.074) 0:01:00.078 ********* 2026-03-31 18:29:14.022563 | mon1 | skipping: [mon1] 2026-03-31 18:29:14.022869 | mon1 | 2026-03-31 18:29:14.022890 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:29:14.022908 | mon1 | Tuesday 31 March 2026 18:29:14 +0000 (0:00:00.052) 0:01:00.130 ********* 2026-03-31 18:29:14.070515 | mon1 | skipping: [mon1] => (item=mon1) 2026-03-31 18:29:14.070613 | mon1 | skipping: [mon1] 2026-03-31 18:29:14.070629 | mon1 | 2026-03-31 18:29:14.070643 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:29:14.070663 | mon1 | Tuesday 31 March 2026 18:29:14 +0000 (0:00:00.048) 0:01:00.179 ********* 2026-03-31 18:29:14.407478 | mon1 | ok: [mon1] 2026-03-31 18:29:14.408220 | mon1 | 2026-03-31 18:29:14.408252 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:29:14.408519 | mon1 | Tuesday 31 March 2026 18:29:14 +0000 (0:00:00.336) 0:01:00.515 ********* 2026-03-31 18:29:21.274782 | mon1 | ok: [mon1] 2026-03-31 18:29:21.274853 | mon1 | 2026-03-31 18:29:21.274974 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-03-31 18:29:21.275107 | mon1 | Tuesday 31 March 2026 18:29:21 +0000 (0:00:06.867) 0:01:07.383 ********* 2026-03-31 18:29:28.353519 | mon1 | ok: [mon1] 2026-03-31 18:29:28.353595 | mon1 | 2026-03-31 18:29:28.353611 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-03-31 18:29:28.353654 | mon1 | Tuesday 31 March 2026 18:29:28 +0000 (0:00:07.078) 0:01:14.462 ********* 2026-03-31 18:29:34.630700 | mon1 | ok: [mon1] 2026-03-31 18:29:34.630775 | mon1 | 2026-03-31 18:29:34.631422 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-03-31 18:29:34.631472 | mon1 | Tuesday 31 March 2026 18:29:34 +0000 (0:00:06.278) 0:01:20.740 ********* 2026-03-31 18:29:42.747431 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-03-31 18:29:42.748488 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-03-31 18:29:42.748529 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-03-31 18:29:42.748542 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-03-31 18:29:42.748556 | mon1 | 2026-03-31 18:29:42.748575 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-03-31 18:29:42.749170 | mon1 | 2026-03-31 18:29:42.749222 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:29:42.749335 | mon1 | Tuesday 31 March 2026 18:29:42 +0000 (0:00:08.115) 0:01:28.856 ********* 2026-03-31 18:29:43.967651 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-31 18:29:43.967710 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:29:43.967724 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:29:43.967737 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:29:43.967750 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:29:43.985098 | mon1 | ok: [osd1] 2026-03-31 18:29:43.985159 | mon1 | 2026-03-31 18:29:43.985175 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:29:43.985188 | mon1 | Tuesday 31 March 2026 18:29:43 +0000 (0:00:01.236) 0:01:30.092 ********* 2026-03-31 18:29:44.237011 | mon1 | ok: [osd1] 2026-03-31 18:29:44.237071 | mon1 | 2026-03-31 18:29:44.237087 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:29:44.237103 | mon1 | Tuesday 31 March 2026 18:29:44 +0000 (0:00:00.252) 0:01:30.345 ********* 2026-03-31 18:29:44.270535 | mon1 | skipping: [osd1] 2026-03-31 18:29:44.270602 | mon1 | 2026-03-31 18:29:44.270611 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-31 18:29:44.270619 | mon1 | Tuesday 31 March 2026 18:29:44 +0000 (0:00:00.033) 0:01:30.379 ********* 2026-03-31 18:29:44.522004 | mon1 | ok: [osd1] 2026-03-31 18:29:44.522063 | mon1 | 2026-03-31 18:29:44.522078 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:29:44.522092 | mon1 | Tuesday 31 March 2026 18:29:44 +0000 (0:00:00.251) 0:01:30.630 ********* 2026-03-31 18:29:44.601699 | mon1 | ok: [osd1] => { 2026-03-31 18:29:44.601740 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-31 18:29:44.601748 | mon1 | } 2026-03-31 18:29:44.601755 | mon1 | 2026-03-31 18:29:44.601762 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:29:44.601878 | mon1 | Tuesday 31 March 2026 18:29:44 +0000 (0:00:00.078) 0:01:30.708 ********* 2026-03-31 18:29:44.985846 | mon1 | ok: [osd1] 2026-03-31 18:29:44.985923 | mon1 | 2026-03-31 18:29:44.985942 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:29:44.986098 | mon1 | Tuesday 31 March 2026 18:29:44 +0000 (0:00:00.386) 0:01:31.095 ********* 2026-03-31 18:29:45.031531 | mon1 | skipping: [osd1] 2026-03-31 18:29:45.031577 | mon1 | 2026-03-31 18:29:45.031588 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:29:45.031837 | mon1 | Tuesday 31 March 2026 18:29:45 +0000 (0:00:00.044) 0:01:31.139 ********* 2026-03-31 18:29:45.073857 | mon1 | skipping: [osd1] 2026-03-31 18:29:45.073960 | mon1 | 2026-03-31 18:29:45.073970 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:29:45.074134 | mon1 | Tuesday 31 March 2026 18:29:45 +0000 (0:00:00.043) 0:01:31.183 ********* 2026-03-31 18:29:45.337956 | mon1 | ok: [osd1] 2026-03-31 18:29:45.338010 | mon1 | 2026-03-31 18:29:45.338021 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-31 18:29:45.338030 | mon1 | Tuesday 31 March 2026 18:29:45 +0000 (0:00:00.263) 0:01:31.446 ********* 2026-03-31 18:29:46.442541 | mon1 | ok: [osd1] 2026-03-31 18:29:46.442602 | mon1 | 2026-03-31 18:29:46.442620 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:29:46.442909 | mon1 | Tuesday 31 March 2026 18:29:46 +0000 (0:00:01.105) 0:01:32.551 ********* 2026-03-31 18:29:46.638826 | mon1 | ok: [osd1] => { 2026-03-31 18:29:46.638867 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-31 18:29:46.638874 | mon1 | } 2026-03-31 18:29:46.638880 | mon1 | 2026-03-31 18:29:46.638886 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:29:46.638892 | mon1 | Tuesday 31 March 2026 18:29:46 +0000 (0:00:00.194) 0:01:32.746 ********* 2026-03-31 18:29:47.158427 | mon1 | ok: [osd1] 2026-03-31 18:29:47.158976 | mon1 | 2026-03-31 18:29:47.159449 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:29:47.159485 | mon1 | Tuesday 31 March 2026 18:29:47 +0000 (0:00:00.518) 0:01:33.264 ********* 2026-03-31 18:29:49.901825 | mon1 | ok: [osd1] 2026-03-31 18:29:49.901896 | mon1 | 2026-03-31 18:29:49.901908 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-31 18:29:49.901919 | mon1 | Tuesday 31 March 2026 18:29:49 +0000 (0:00:02.744) 0:01:36.009 ********* 2026-03-31 18:29:49.937551 | mon1 | skipping: [osd1] 2026-03-31 18:29:49.937618 | mon1 | 2026-03-31 18:29:49.937633 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-31 18:29:49.937646 | mon1 | Tuesday 31 March 2026 18:29:49 +0000 (0:00:00.036) 0:01:36.045 ********* 2026-03-31 18:29:49.967349 | mon1 | skipping: [osd1] 2026-03-31 18:29:49.967658 | mon1 | 2026-03-31 18:29:49.967962 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-31 18:29:49.968222 | mon1 | Tuesday 31 March 2026 18:29:49 +0000 (0:00:00.030) 0:01:36.076 ********* 2026-03-31 18:29:50.004190 | mon1 | skipping: [osd1] 2026-03-31 18:29:50.004714 | mon1 | 2026-03-31 18:29:50.004737 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-31 18:29:50.004746 | mon1 | Tuesday 31 March 2026 18:29:50 +0000 (0:00:00.035) 0:01:36.111 ********* 2026-03-31 18:29:51.255424 | mon1 | ok: [osd1] 2026-03-31 18:29:51.255476 | mon1 | 2026-03-31 18:29:51.255486 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-31 18:29:51.255687 | mon1 | Tuesday 31 March 2026 18:29:51 +0000 (0:00:01.252) 0:01:37.364 ********* 2026-03-31 18:29:53.366139 | mon1 | ok: [osd1] 2026-03-31 18:29:53.366353 | mon1 | 2026-03-31 18:29:53.366655 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-31 18:29:53.366906 | mon1 | Tuesday 31 March 2026 18:29:53 +0000 (0:00:02.110) 0:01:39.474 ********* 2026-03-31 18:29:54.529525 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-03-31 18:29:54.530531 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-31 18:29:54.530594 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-31 18:29:54.530629 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-31 18:29:54.531499 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-31 18:29:54.531529 | mon1 | 2026-03-31 18:29:54.531539 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-31 18:29:54.531548 | mon1 | Tuesday 31 March 2026 18:29:54 +0000 (0:00:01.163) 0:01:40.638 ********* 2026-03-31 18:29:55.188517 | mon1 | ok: [osd1] 2026-03-31 18:29:55.189463 | mon1 | 2026-03-31 18:29:55.189544 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-31 18:29:55.189560 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:00.651) 0:01:41.290 ********* 2026-03-31 18:29:55.189599 | mon1 | 2026-03-31 18:29:55.189948 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-31 18:29:55.190277 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:00.007) 0:01:41.297 ********* 2026-03-31 18:29:55.631071 | mon1 | ok: [osd1] 2026-03-31 18:29:55.631381 | mon1 | 2026-03-31 18:29:55.631627 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-31 18:29:55.631947 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:00.443) 0:01:41.740 ********* 2026-03-31 18:29:55.890553 | mon1 | ok: [osd1] 2026-03-31 18:29:55.890957 | mon1 | 2026-03-31 18:29:55.891332 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-31 18:29:55.891783 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:00.259) 0:01:41.999 ********* 2026-03-31 18:29:55.969614 | mon1 | ok: [osd1] => { 2026-03-31 18:29:55.969684 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-31 18:29:55.969697 | mon1 | } 2026-03-31 18:29:55.969710 | mon1 | 2026-03-31 18:29:55.969728 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-31 18:29:55.969909 | mon1 | Tuesday 31 March 2026 18:29:55 +0000 (0:00:00.077) 0:01:42.077 ********* 2026-03-31 18:29:56.431917 | mon1 | ok: [osd1] 2026-03-31 18:29:56.432010 | mon1 | 2026-03-31 18:29:56.432038 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-31 18:29:56.432260 | mon1 | Tuesday 31 March 2026 18:29:56 +0000 (0:00:00.463) 0:01:42.541 ********* 2026-03-31 18:30:00.122693 | mon1 | ok: [osd1] 2026-03-31 18:30:00.122875 | mon1 | 2026-03-31 18:30:00.123160 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-31 18:30:00.123398 | mon1 | Tuesday 31 March 2026 18:30:00 +0000 (0:00:03.690) 0:01:46.232 ********* 2026-03-31 18:30:01.184473 | mon1 | ok: [osd1] 2026-03-31 18:30:01.184536 | mon1 | 2026-03-31 18:30:01.184557 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-31 18:30:01.184710 | mon1 | Tuesday 31 March 2026 18:30:01 +0000 (0:00:01.061) 0:01:47.293 ********* 2026-03-31 18:30:01.434983 | mon1 | ok: [osd1] 2026-03-31 18:30:01.435051 | mon1 | 2026-03-31 18:30:01.435065 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-31 18:30:01.435078 | mon1 | Tuesday 31 March 2026 18:30:01 +0000 (0:00:00.248) 0:01:47.542 ********* 2026-03-31 18:30:02.010479 | mon1 | ok: [osd1] 2026-03-31 18:30:02.010522 | mon1 | 2026-03-31 18:30:02.010531 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-31 18:30:02.010540 | mon1 | Tuesday 31 March 2026 18:30:02 +0000 (0:00:00.576) 0:01:48.119 ********* 2026-03-31 18:30:02.720786 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-03-31 18:30:02.720847 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-31 18:30:02.721010 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-31 18:30:02.721419 | mon1 | 2026-03-31 18:30:02.721455 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-31 18:30:02.721463 | mon1 | Tuesday 31 March 2026 18:30:02 +0000 (0:00:00.710) 0:01:48.830 ********* 2026-03-31 18:30:03.294389 | mon1 | ok: [osd1] 2026-03-31 18:30:03.294475 | mon1 | 2026-03-31 18:30:03.295242 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-31 18:30:03.295285 | mon1 | Tuesday 31 March 2026 18:30:03 +0000 (0:00:00.572) 0:01:49.402 ********* 2026-03-31 18:30:03.850964 | mon1 | ok: [osd1] 2026-03-31 18:30:03.851014 | mon1 | 2026-03-31 18:30:03.851021 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-31 18:30:03.851027 | mon1 | Tuesday 31 March 2026 18:30:03 +0000 (0:00:00.548) 0:01:49.950 ********* 2026-03-31 18:30:03.851032 | mon1 | 2026-03-31 18:30:03.851038 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-31 18:30:03.851043 | mon1 | Tuesday 31 March 2026 18:30:03 +0000 (0:00:00.007) 0:01:49.958 ********* 2026-03-31 18:30:04.323015 | mon1 | ok: [osd1] 2026-03-31 18:30:04.323089 | mon1 | 2026-03-31 18:30:04.323097 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-31 18:30:04.323133 | mon1 | Tuesday 31 March 2026 18:30:04 +0000 (0:00:00.472) 0:01:50.430 ********* 2026-03-31 18:30:04.379616 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-03-31 18:30:04.379673 | mon1 | 2026-03-31 18:30:04.379686 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-31 18:30:04.379695 | mon1 | Tuesday 31 March 2026 18:30:04 +0000 (0:00:00.056) 0:01:50.487 ********* 2026-03-31 18:30:05.426891 | mon1 | ok: [osd1] 2026-03-31 18:30:05.428432 | mon1 | 2026-03-31 18:30:05.428468 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-31 18:30:05.428473 | mon1 | Tuesday 31 March 2026 18:30:05 +0000 (0:00:01.048) 0:01:51.535 ********* 2026-03-31 18:30:06.268268 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-03-31 18:30:06.268306 | mon1 | ok: [osd1] => (item=ssh) 2026-03-31 18:30:06.268313 | mon1 | 2026-03-31 18:30:06.268318 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-31 18:30:06.268503 | mon1 | Tuesday 31 March 2026 18:30:06 +0000 (0:00:00.841) 0:01:52.376 ********* 2026-03-31 18:30:07.069019 | mon1 | ok: [osd1] 2026-03-31 18:30:07.069085 | mon1 | 2026-03-31 18:30:07.069143 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-03-31 18:30:07.069157 | mon1 | Tuesday 31 March 2026 18:30:07 +0000 (0:00:00.800) 0:01:53.176 ********* 2026-03-31 18:30:07.323987 | mon1 | ok: [osd1] 2026-03-31 18:30:07.324047 | mon1 | 2026-03-31 18:30:07.324061 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-03-31 18:30:07.324074 | mon1 | Tuesday 31 March 2026 18:30:07 +0000 (0:00:00.255) 0:01:53.432 ********* 2026-03-31 18:30:07.653538 | mon1 | ok: [osd1] 2026-03-31 18:30:07.653608 | mon1 | 2026-03-31 18:30:07.654174 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-03-31 18:30:07.654205 | mon1 | Tuesday 31 March 2026 18:30:07 +0000 (0:00:00.329) 0:01:53.762 ********* 2026-03-31 18:30:07.902414 | mon1 | ok: [osd1] 2026-03-31 18:30:07.902458 | mon1 | 2026-03-31 18:30:07.902466 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-03-31 18:30:07.902485 | mon1 | Tuesday 31 March 2026 18:30:07 +0000 (0:00:00.248) 0:01:54.010 ********* 2026-03-31 18:30:08.185542 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-03-31 18:30:08.185620 | mon1 | 2026-03-31 18:30:08.186299 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-03-31 18:30:08.186358 | mon1 | Tuesday 31 March 2026 18:30:08 +0000 (0:00:00.283) 0:01:54.293 ********* 2026-03-31 18:30:08.235915 | mon1 | ok: [osd1] 2026-03-31 18:30:08.236359 | mon1 | 2026-03-31 18:30:08.236420 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-03-31 18:30:08.236428 | mon1 | Tuesday 31 March 2026 18:30:08 +0000 (0:00:00.050) 0:01:54.344 ********* 2026-03-31 18:30:08.303977 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-03-31 18:30:08.304036 | mon1 | 2026-03-31 18:30:08.304049 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-03-31 18:30:08.304086 | mon1 | Tuesday 31 March 2026 18:30:08 +0000 (0:00:00.067) 0:01:54.412 ********* 2026-03-31 18:30:21.616152 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:30:21.616201 | mon1 | 2026-03-31 18:30:21.616211 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-03-31 18:30:21.616219 | mon1 | Tuesday 31 March 2026 18:30:21 +0000 (0:00:13.311) 0:02:07.724 ********* 2026-03-31 18:30:21.678085 | mon1 | ok: [osd1] => (item=osd1) 2026-03-31 18:30:21.678154 | mon1 | 2026-03-31 18:30:21.678168 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-03-31 18:30:21.678180 | mon1 | Tuesday 31 March 2026 18:30:21 +0000 (0:00:00.062) 0:02:07.786 ********* 2026-03-31 18:30:22.012956 | mon1 | ok: [osd1] 2026-03-31 18:30:22.013027 | mon1 | 2026-03-31 18:30:22.013154 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-03-31 18:30:22.013273 | mon1 | Tuesday 31 March 2026 18:30:22 +0000 (0:00:00.334) 0:02:08.121 ********* 2026-03-31 18:30:28.975130 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:30:28.975199 | mon1 | 2026-03-31 18:30:28.975213 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-03-31 18:30:28.975225 | mon1 | Tuesday 31 March 2026 18:30:28 +0000 (0:00:06.961) 0:02:15.083 ********* 2026-03-31 18:30:34.564035 | mon1 | ok: [osd1] 2026-03-31 18:30:34.564109 | mon1 | 2026-03-31 18:30:34.564122 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-03-31 18:30:34.564135 | mon1 | Tuesday 31 March 2026 18:30:34 +0000 (0:00:05.588) 0:02:20.671 ********* 2026-03-31 18:30:56.967477 | mon1 | ok: [osd1] 2026-03-31 18:30:56.967540 | mon1 | 2026-03-31 18:30:56.967857 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-03-31 18:30:56.968209 | mon1 | Tuesday 31 March 2026 18:30:56 +0000 (0:00:22.403) 0:02:43.075 ********* 2026-03-31 18:30:57.036881 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-03-31 18:30:57.037113 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-03-31 18:30:57.037311 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-03-31 18:30:57.037521 | mon1 | skipping: [osd1] 2026-03-31 18:30:57.038031 | mon1 | 2026-03-31 18:30:57.038045 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-03-31 18:30:57.038054 | mon1 | Tuesday 31 March 2026 18:30:57 +0000 (0:00:00.070) 0:02:43.145 ********* 2026-03-31 18:31:03.404875 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:31:03.406417 | mon1 | 2026-03-31 18:31:03.406439 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-03-31 18:31:03.406448 | mon1 | Tuesday 31 March 2026 18:31:03 +0000 (0:00:06.367) 0:02:49.512 ********* 2026-03-31 18:31:09.808256 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:31:09.808441 | mon1 | 2026-03-31 18:31:09.808915 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-03-31 18:31:09.809169 | mon1 | Tuesday 31 March 2026 18:31:09 +0000 (0:00:06.400) 0:02:55.912 ********* 2026-03-31 18:31:09.877436 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-03-31 18:31:09.877499 | mon1 | 2026-03-31 18:31:09.877510 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-03-31 18:31:09.877702 | mon1 | Tuesday 31 March 2026 18:31:09 +0000 (0:00:00.073) 0:02:55.986 ********* 2026-03-31 18:31:09.928569 | mon1 | ok: [osd1] 2026-03-31 18:31:09.928804 | mon1 | 2026-03-31 18:31:09.929055 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-03-31 18:31:09.929254 | mon1 | Tuesday 31 March 2026 18:31:09 +0000 (0:00:00.051) 0:02:56.037 ********* 2026-03-31 18:31:16.369025 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-03-31 18:31:16.369111 | mon1 | 2026-03-31 18:31:16.369239 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-03-31 18:31:16.369359 | mon1 | Tuesday 31 March 2026 18:31:16 +0000 (0:00:06.441) 0:03:02.478 ********* 2026-03-31 18:31:16.410479 | mon1 | ok: [osd1] 2026-03-31 18:31:16.410542 | mon1 | 2026-03-31 18:31:16.410671 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-03-31 18:31:16.410787 | mon1 | Tuesday 31 March 2026 18:31:16 +0000 (0:00:00.041) 0:03:02.520 ********* 2026-03-31 18:31:16.444461 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:31:16.444715 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:31:16.444984 | mon1 | skipping: [osd1] => (item=1) 2026-03-31 18:31:16.445248 | mon1 | skipping: [osd1] 2026-03-31 18:31:16.445511 | mon1 | 2026-03-31 18:31:16.445817 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-03-31 18:31:16.446076 | mon1 | Tuesday 31 March 2026 18:31:16 +0000 (0:00:00.033) 0:03:02.554 ********* 2026-03-31 18:31:16.484443 | mon1 | skipping: [osd1] 2026-03-31 18:31:16.484668 | mon1 | 2026-03-31 18:31:16.484913 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:31:16.485171 | mon1 | mon1 : ok=49 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-31 18:31:16.485480 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-03-31 18:31:16.485711 | mon1 | 2026-03-31 18:31:16.485912 | mon1 | 2026-03-31 18:31:16.486206 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:31:16.486470 | mon1 | Tuesday 31 March 2026 18:31:16 +0000 (0:00:00.040) 0:03:02.594 ********* 2026-03-31 18:31:16.486701 | mon1 | =============================================================================== 2026-03-31 18:31:16.486942 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.40s 2026-03-31 18:31:16.487193 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.95s 2026-03-31 18:31:16.487485 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ----- 13.31s 2026-03-31 18:31:16.487739 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.12s 2026-03-31 18:31:16.487983 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 7.08s 2026-03-31 18:31:16.488236 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.96s 2026-03-31 18:31:16.488512 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.93s 2026-03-31 18:31:16.488758 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.92s 2026-03-31 18:31:16.488999 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.87s 2026-03-31 18:31:16.489238 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.44s 2026-03-31 18:31:16.489514 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.42s 2026-03-31 18:31:16.489755 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.40s 2026-03-31 18:31:16.489994 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.37s 2026-03-31 18:31:16.490266 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.28s 2026-03-31 18:31:16.490536 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.59s 2026-03-31 18:31:16.490779 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.69s 2026-03-31 18:31:16.491019 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s 2026-03-31 18:31:16.491262 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.74s 2026-03-31 18:31:16.491539 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.56s 2026-03-31 18:31:16.491796 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 2.11s 2026-03-31 18:31:16.586761 | mon1 | INFO [default > idempotence] Executed: Successful 2026-03-31 18:31:16.598004 | mon1 | INFO [default > side_effect] Executing 2026-03-31 18:31:16.598276 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:31:16.605447 | mon1 | INFO [default > verify] Executing 2026-03-31 18:31:17.419859 | mon1 | 2026-03-31 18:31:17.420190 | mon1 | PLAY [Verify] ****************************************************************** 2026-03-31 18:31:17.420535 | mon1 | 2026-03-31 18:31:17.420862 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-31 18:31:17.421064 | mon1 | Tuesday 31 March 2026 18:31:17 +0000 (0:00:00.011) 0:00:00.011 ********* 2026-03-31 18:31:18.671424 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-31 18:31:18.671823 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-03-31 18:31:18.672204 | mon1 | interpreter could change the meaning of that path. See 2026-03-31 18:31:18.672546 | mon1 | https://docs.ansible.com/ansible- 2026-03-31 18:31:18.672872 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-31 18:31:18.680114 | mon1 | ok: [mon1] 2026-03-31 18:31:18.680389 | mon1 | 2026-03-31 18:31:18.680729 | mon1 | TASK [Get cluster health status] *********************************************** 2026-03-31 18:31:18.681082 | mon1 | Tuesday 31 March 2026 18:31:18 +0000 (0:00:01.260) 0:00:01.272 ********* 2026-03-31 18:31:29.434331 | mon1 | ok: [mon1] 2026-03-31 18:31:29.434598 | mon1 | 2026-03-31 18:31:29.434865 | mon1 | TASK [Print cluster health status] ********************************************* 2026-03-31 18:31:29.435142 | mon1 | Tuesday 31 March 2026 18:31:29 +0000 (0:00:10.744) 0:00:12.017 ********* 2026-03-31 18:31:29.476095 | mon1 | ok: [mon1] => { 2026-03-31 18:31:29.476403 | mon1 | "_ceph_health": { 2026-03-31 18:31:29.476744 | mon1 | "changed": false, 2026-03-31 18:31:29.477058 | mon1 | "cmd": [ 2026-03-31 18:31:29.477382 | mon1 | "cephadm", 2026-03-31 18:31:29.477703 | mon1 | "shell", 2026-03-31 18:31:29.478002 | mon1 | "--", 2026-03-31 18:31:29.478307 | mon1 | "ceph", 2026-03-31 18:31:29.478600 | mon1 | "health" 2026-03-31 18:31:29.478883 | mon1 | ], 2026-03-31 18:31:29.479168 | mon1 | "delta": "0:00:10.408433", 2026-03-31 18:31:29.479520 | mon1 | "end": "2026-03-31 18:31:29.383774", 2026-03-31 18:31:29.479760 | mon1 | "failed": false, 2026-03-31 18:31:29.479928 | mon1 | "msg": "", 2026-03-31 18:31:29.480100 | mon1 | "rc": 0, 2026-03-31 18:31:29.480266 | mon1 | "start": "2026-03-31 18:31:18.975341", 2026-03-31 18:31:29.480486 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-03-31 18:31:29.480639 | mon1 | "stderr_lines": [ 2026-03-31 18:31:29.480803 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-03-31 18:31:29.480976 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-03-31 18:31:29.481145 | mon1 | ], 2026-03-31 18:31:29.481323 | mon1 | "stdout": "HEALTH_OK", 2026-03-31 18:31:29.481508 | mon1 | "stdout_lines": [ 2026-03-31 18:31:29.481663 | mon1 | "HEALTH_OK" 2026-03-31 18:31:29.481814 | mon1 | ] 2026-03-31 18:31:29.481966 | mon1 | } 2026-03-31 18:31:29.482131 | mon1 | } 2026-03-31 18:31:29.482282 | mon1 | 2026-03-31 18:31:29.482472 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-03-31 18:31:29.482637 | mon1 | Tuesday 31 March 2026 18:31:29 +0000 (0:00:00.050) 0:00:12.067 ********* 2026-03-31 18:31:29.514402 | mon1 | ok: [mon1] => { 2026-03-31 18:31:29.514742 | mon1 | "changed": false, 2026-03-31 18:31:29.515049 | mon1 | "msg": "All assertions passed" 2026-03-31 18:31:29.515335 | mon1 | } 2026-03-31 18:31:29.515710 | mon1 | 2026-03-31 18:31:29.516027 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-03-31 18:31:29.516345 | mon1 | Tuesday 31 March 2026 18:31:29 +0000 (0:00:00.038) 0:00:12.105 ********* 2026-03-31 18:31:37.848249 | mon1 | changed: [mon1] 2026-03-31 18:31:37.848293 | mon1 | 2026-03-31 18:31:37.848306 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-03-31 18:31:37.848312 | mon1 | Tuesday 31 March 2026 18:31:37 +0000 (0:00:08.334) 0:00:20.440 ********* 2026-03-31 18:31:40.887267 | mon1 | changed: [mon1] 2026-03-31 18:31:40.887333 | mon1 | 2026-03-31 18:31:40.887347 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-03-31 18:31:40.887360 | mon1 | Tuesday 31 March 2026 18:31:40 +0000 (0:00:03.037) 0:00:23.477 ********* 2026-03-31 18:31:42.359440 | mon1 | ok: [mon1] 2026-03-31 18:31:42.359511 | mon1 | 2026-03-31 18:31:42.359520 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-03-31 18:31:42.359528 | mon1 | Tuesday 31 March 2026 18:31:42 +0000 (0:00:01.472) 0:00:24.950 ********* 2026-03-31 18:31:42.401532 | mon1 | ok: [mon1] => { 2026-03-31 18:31:42.401594 | mon1 | "changed": false, 2026-03-31 18:31:42.401642 | mon1 | "msg": "All assertions passed" 2026-03-31 18:31:42.401656 | mon1 | } 2026-03-31 18:31:42.401668 | mon1 | 2026-03-31 18:31:42.401680 | mon1 | PLAY RECAP ********************************************************************* 2026-03-31 18:31:42.401704 | mon1 | mon1 : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-31 18:31:42.401716 | mon1 | 2026-03-31 18:31:42.401727 | mon1 | 2026-03-31 18:31:42.401746 | mon1 | TASKS RECAP ******************************************************************** 2026-03-31 18:31:42.401761 | mon1 | Tuesday 31 March 2026 18:31:42 +0000 (0:00:00.040) 0:00:24.990 ********* 2026-03-31 18:31:42.402436 | mon1 | =============================================================================== 2026-03-31 18:31:42.402481 | mon1 | Get cluster health status ---------------------------------------------- 10.75s 2026-03-31 18:31:42.402490 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.33s 2026-03-31 18:31:42.402631 | mon1 | Create a test Ceph key -------------------------------------------------- 3.04s 2026-03-31 18:31:42.402843 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.47s 2026-03-31 18:31:42.403049 | mon1 | Gathering Facts --------------------------------------------------------- 1.26s 2026-03-31 18:31:42.403266 | mon1 | Print cluster health status --------------------------------------------- 0.05s 2026-03-31 18:31:42.403514 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-03-31 18:31:42.403705 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-03-31 18:31:42.474019 | mon1 | INFO [default > verify] Executed: Successful 2026-03-31 18:31:42.483803 | mon1 | INFO [default > cleanup] Executing 2026-03-31 18:31:42.484315 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-31 18:31:42.492924 | mon1 | INFO [default > destroy] Executing 2026-03-31 18:31:42.492964 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-31 18:31:42.493056 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-31 18:31:42.493504 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-03-31 18:31:42.959395 | mon1 | ok: Runtime: 0:13:48.699177 2026-03-31 18:31:42.977374 | 2026-03-31 18:31:42.977452 | PLAY RECAP 2026-03-31 18:31:42.977513 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-31 18:31:42.977554 | 2026-03-31 18:31:43.108683 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-31 18:31:43.112453 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:31:43.840783 | 2026-03-31 18:31:43.840992 | PLAY [all] 2026-03-31 18:31:43.857988 | 2026-03-31 18:31:43.858149 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-31 18:31:43.910950 | mon1 | ok 2026-03-31 18:31:43.929630 | osd1 | ok 2026-03-31 18:31:43.938416 | 2026-03-31 18:31:43.938624 | TASK [fetch-output : Set log path for single node] 2026-03-31 18:31:43.968555 | mon1 | skipping: Conditional result was False 2026-03-31 18:31:43.980008 | osd1 | skipping: Conditional result was False 2026-03-31 18:31:43.989731 | 2026-03-31 18:31:43.989884 | LOOP [fetch-output : Ensure local output dirs] 2026-03-31 18:31:44.382112 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/logs/mon1" 2026-03-31 18:31:44.397872 | osd1 -> localhost | changed: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/logs/osd1" 2026-03-31 18:31:44.626330 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/artifacts" 2026-03-31 18:31:44.660061 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/artifacts" 2026-03-31 18:31:44.842113 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/docs" 2026-03-31 18:31:44.872695 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a90fb7394f7f4da08bde4d7f288abc9f/work/docs" 2026-03-31 18:31:44.872821 | osd1 -> localhost | changed: All items complete 2026-03-31 18:31:44.872880 | 2026-03-31 18:31:44.887604 | 2026-03-31 18:31:44.887767 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-31 18:31:45.520124 | osd1 | changed: .d..t...... ./ 2026-03-31 18:31:45.527020 | mon1 | changed: .d..t...... ./ 2026-03-31 18:31:46.006492 | mon1 | ok 2026-03-31 18:31:46.013106 | osd1 | changed: .d..t...... ./ 2026-03-31 18:31:46.483069 | mon1 | changed: .d..t...... ./ 2026-03-31 18:31:46.525542 | osd1 | ok 2026-03-31 18:31:46.525676 | osd1 | changed: All items complete 2026-03-31 18:31:46.525717 | 2026-03-31 18:31:46.549273 | 2026-03-31 18:31:46.549365 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-31 18:31:47.029174 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.049758 2026-03-31 18:31:47.354146 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007279 2026-03-31 18:31:47.381532 | 2026-03-31 18:31:47.381668 | PLAY [all] 2026-03-31 18:31:47.389882 | 2026-03-31 18:31:47.390021 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-31 18:31:47.923733 | mon1 | changed 2026-03-31 18:31:48.133637 | osd1 | changed 2026-03-31 18:31:48.158768 | 2026-03-31 18:31:48.158857 | PLAY RECAP 2026-03-31 18:31:48.158921 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-31 18:31:48.158971 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-31 18:31:48.159112 | 2026-03-31 18:31:48.325645 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-31 18:31:48.452762 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-31 18:31:49.189163 | 2026-03-31 18:31:49.189354 | PLAY [localhost] 2026-03-31 18:31:49.200938 | 2026-03-31 18:31:49.201091 | TASK [Generate Zuul manifest] 2026-03-31 18:31:49.224377 | localhost | ok 2026-03-31 18:31:49.479582 | 2026-03-31 18:31:49.479742 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-31 18:31:50.064712 | localhost | changed 2026-03-31 18:31:50.077577 | 2026-03-31 18:31:50.077725 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-31 18:31:50.110886 | localhost | ok 2026-03-31 18:31:50.118644 | 2026-03-31 18:31:50.118795 | TASK [Upload logs] 2026-03-31 18:31:50.153628 | localhost | ok 2026-03-31 18:31:50.221270 | 2026-03-31 18:31:50.221434 | TASK [Set zuul-log-path fact] 2026-03-31 18:31:50.247206 | localhost | ok 2026-03-31 18:31:50.263793 | 2026-03-31 18:31:50.263965 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-31 18:31:50.297093 | localhost | ok 2026-03-31 18:31:50.304114 | 2026-03-31 18:31:50.304199 | TASK [upload-logs : Create log directories] 2026-03-31 18:31:50.725731 | localhost | changed 2026-03-31 18:31:50.732266 | 2026-03-31 18:31:50.732338 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-31 18:31:51.182895 | localhost -> localhost | ok: Runtime: 0:00:00.005288 2026-03-31 18:31:51.189743 | 2026-03-31 18:31:51.189836 | TASK [upload-logs : Upload logs to log server] 2026-03-31 18:31:51.743666 | localhost | Output suppressed because no_log was given 2026-03-31 18:31:51.748154 | 2026-03-31 18:31:51.748233 | LOOP [upload-logs : Compress console log and json output] 2026-03-31 18:31:51.793897 | localhost | skipping: Conditional result was False 2026-03-31 18:31:51.801666 | localhost | skipping: Conditional result was False 2026-03-31 18:31:51.816603 | 2026-03-31 18:31:51.816834 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-31 18:31:51.859712 | localhost | skipping: Conditional result was False 2026-03-31 18:31:51.860149 | 2026-03-31 18:31:51.863633 | localhost | skipping: Conditional result was False 2026-03-31 18:31:51.882196 | 2026-03-31 18:31:51.882377 | LOOP [upload-logs : Upload console log and json output]