2026-08-18 05:38:02.043118 | Job console starting 2026-08-18 05:38:02.057927 | Updating git repos 2026-08-18 05:38:02.086096 | Cloning repos into workspace 2026-08-18 05:38:02.120647 | Restoring repo states 2026-08-18 05:38:02.129117 | Merging changes 2026-08-18 05:38:02.478239 | Checking out repos 2026-08-18 05:38:02.521401 | Preparing playbooks 2026-08-18 05:38:03.597261 | Running Ansible setup 2026-08-18 05:38:07.595848 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 05:38:08.192544 | 2026-08-18 05:38:08.192687 | PLAY [localhost] 2026-08-18 05:38:08.200682 | 2026-08-18 05:38:08.200763 | TASK [Gathering Facts] 2026-08-18 05:38:09.049263 | localhost | ok 2026-08-18 05:38:09.058170 | 2026-08-18 05:38:09.058247 | TASK [Setup log path fact] 2026-08-18 05:38:09.078482 | localhost | ok 2026-08-18 05:38:09.089761 | 2026-08-18 05:38:09.089826 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 05:38:09.120626 | localhost | ok 2026-08-18 05:38:09.128984 | 2026-08-18 05:38:09.129084 | TASK [emit-job-header : Print job information] 2026-08-18 05:38:09.171403 | # Job Information 2026-08-18 05:38:09.171642 | Ansible Version: 2.16.18 2026-08-18 05:38:09.171713 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-08-18 05:38:09.171763 | Pipeline: check 2026-08-18 05:38:09.171826 | Executor: 2d72f0692154 2026-08-18 05:38:09.171872 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 05:38:09.171923 | Event ID: 7c110b90-9ac6-11f1-85b5-54147ae66214 2026-08-18 05:38:09.178007 | 2026-08-18 05:38:09.178143 | LOOP [emit-job-header : Print node information] 2026-08-18 05:38:09.277778 | localhost | ok: 2026-08-18 05:38:09.278322 | localhost | # Node Information 2026-08-18 05:38:09.278430 | localhost | Inventory Hostname: mon1 2026-08-18 05:38:09.278488 | localhost | Hostname: np0000189928 2026-08-18 05:38:09.278535 | localhost | Username: zuul 2026-08-18 05:38:09.278657 | localhost | Distro: Ubuntu 22.04 2026-08-18 05:38:09.278710 | localhost | Provider: yul1 2026-08-18 05:38:09.278757 | localhost | Region: ca-ymq-1 2026-08-18 05:38:09.278803 | localhost | Label: ubuntu-jammy 2026-08-18 05:38:09.278847 | localhost | Product Name: OpenStack Nova 2026-08-18 05:38:09.278891 | localhost | Interface IP: 199.204.45.210 2026-08-18 05:38:09.322415 | localhost | ok: 2026-08-18 05:38:09.322523 | localhost | # Node Information 2026-08-18 05:38:09.322581 | localhost | Inventory Hostname: osd1 2026-08-18 05:38:09.322628 | localhost | Hostname: np0000189929 2026-08-18 05:38:09.322672 | localhost | Username: zuul 2026-08-18 05:38:09.322715 | localhost | Distro: Ubuntu 22.04 2026-08-18 05:38:09.322757 | localhost | Provider: yul1 2026-08-18 05:38:09.322798 | localhost | Region: ca-ymq-1 2026-08-18 05:38:09.322840 | localhost | Label: ubuntu-jammy 2026-08-18 05:38:09.322881 | localhost | Product Name: OpenStack Nova 2026-08-18 05:38:09.322923 | localhost | Interface IP: 199.204.45.61 2026-08-18 05:38:09.341814 | 2026-08-18 05:38:09.341988 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 05:38:09.712996 | localhost -> localhost | changed 2026-08-18 05:38:09.722890 | 2026-08-18 05:38:09.723896 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 05:38:10.541533 | localhost -> localhost | changed 2026-08-18 05:38:10.556140 | 2026-08-18 05:38:10.556536 | PLAY [all] 2026-08-18 05:38:10.564688 | 2026-08-18 05:38:10.564774 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 05:38:10.809605 | mon1 -> localhost | ok 2026-08-18 05:38:10.828208 | 2026-08-18 05:38:10.828414 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 05:38:10.862455 | mon1 | ok 2026-08-18 05:38:10.867723 | osd1 | ok 2026-08-18 05:38:10.886262 | mon1 | included: /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 05:38:10.886315 | osd1 | included: /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 05:38:10.898585 | 2026-08-18 05:38:10.898786 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 05:38:12.192039 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-18 05:38:12.192318 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/836068ffdd5046dd96272990b1663e48_id_rsa 2026-08-18 05:38:12.192387 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/836068ffdd5046dd96272990b1663e48_id_rsa.pub 2026-08-18 05:38:12.192440 | mon1 -> localhost | The key fingerprint is: 2026-08-18 05:38:12.192536 | mon1 -> localhost | SHA256:qjakP2l6MEbGcz+vc0Su4uyhdYcbHLH1qVd1F09+pLw zuul-build-sshkey 2026-08-18 05:38:12.192589 | mon1 -> localhost | The key's randomart image is: 2026-08-18 05:38:12.192635 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-18 05:38:12.192680 | mon1 -> localhost | | .o| 2026-08-18 05:38:12.192726 | mon1 -> localhost | | . =o| 2026-08-18 05:38:12.192764 | mon1 -> localhost | | . . . + *| 2026-08-18 05:38:12.192786 | mon1 -> localhost | | = . +.. . . oo| 2026-08-18 05:38:12.192806 | mon1 -> localhost | | o o .ooS o . E | 2026-08-18 05:38:12.192826 | mon1 -> localhost | | + ..o+o. . | 2026-08-18 05:38:12.192846 | mon1 -> localhost | | . =o.*=o . | 2026-08-18 05:38:12.192865 | mon1 -> localhost | | .+O+o+o. | 2026-08-18 05:38:12.192885 | mon1 -> localhost | | oO*+o+ | 2026-08-18 05:38:12.192905 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-18 05:38:12.192971 | mon1 -> localhost | ok: Runtime: 0:00:00.855385 2026-08-18 05:38:12.198075 | 2026-08-18 05:38:12.198139 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 05:38:12.231699 | mon1 | ok 2026-08-18 05:38:12.238354 | osd1 | ok 2026-08-18 05:38:12.250951 | mon1 | included: /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 05:38:12.250995 | osd1 | included: /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 05:38:12.260899 | 2026-08-18 05:38:12.260977 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 05:38:12.286909 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:12.298310 | osd1 | skipping: Conditional result was False 2026-08-18 05:38:12.307414 | 2026-08-18 05:38:12.307502 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 05:38:12.727386 | osd1 | changed 2026-08-18 05:38:12.743808 | mon1 | changed 2026-08-18 05:38:12.750392 | 2026-08-18 05:38:12.750481 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 05:38:12.947088 | mon1 | ok 2026-08-18 05:38:12.965161 | osd1 | ok 2026-08-18 05:38:12.971902 | 2026-08-18 05:38:12.971992 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 05:38:13.466605 | osd1 | changed 2026-08-18 05:38:13.471279 | mon1 | changed 2026-08-18 05:38:13.476496 | 2026-08-18 05:38:13.476565 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 05:38:13.991291 | osd1 | changed 2026-08-18 05:38:13.995753 | mon1 | changed 2026-08-18 05:38:14.000570 | 2026-08-18 05:38:14.000632 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 05:38:14.025268 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:14.036060 | osd1 | skipping: Conditional result was False 2026-08-18 05:38:14.041487 | 2026-08-18 05:38:14.041553 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 05:38:14.338860 | mon1 -> localhost | changed 2026-08-18 05:38:14.360695 | 2026-08-18 05:38:14.360767 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 05:38:14.615361 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/836068ffdd5046dd96272990b1663e48_id_rsa (zuul-build-sshkey) 2026-08-18 05:38:14.615620 | mon1 -> localhost | ok: Runtime: 0:00:00.009120 2026-08-18 05:38:14.621497 | 2026-08-18 05:38:14.621560 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 05:38:14.895800 | osd1 | ok 2026-08-18 05:38:14.905035 | mon1 | ok 2026-08-18 05:38:14.909971 | 2026-08-18 05:38:14.910037 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 05:38:14.937252 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:14.948306 | osd1 | skipping: Conditional result was False 2026-08-18 05:38:14.970658 | 2026-08-18 05:38:14.970771 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 05:38:15.250938 | mon1 | ok 2026-08-18 05:38:15.256465 | osd1 | ok 2026-08-18 05:38:15.261803 | 2026-08-18 05:38:15.261868 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 05:38:15.954859 | mon1 | Output suppressed because no_log was given 2026-08-18 05:38:15.958958 | osd1 | Output suppressed because no_log was given 2026-08-18 05:38:15.971299 | 2026-08-18 05:38:15.971367 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 05:38:16.166376 | osd1 | ok: "logs" 2026-08-18 05:38:16.166751 | osd1 | ok: All items complete 2026-08-18 05:38:16.166792 | 2026-08-18 05:38:16.180244 | mon1 | ok: "logs" 2026-08-18 05:38:16.329038 | osd1 | ok: "artifacts" 2026-08-18 05:38:16.363121 | mon1 | ok: "artifacts" 2026-08-18 05:38:16.484021 | osd1 | ok: "docs" 2026-08-18 05:38:16.516066 | mon1 | ok: "docs" 2026-08-18 05:38:16.527861 | 2026-08-18 05:38:16.528051 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 05:38:16.717469 | mon1 | changed: "logs" 2026-08-18 05:38:16.717889 | mon1 | ok: All items complete 2026-08-18 05:38:16.717937 | 2026-08-18 05:38:16.734100 | osd1 | changed: "logs" 2026-08-18 05:38:16.874459 | mon1 | changed: "artifacts" 2026-08-18 05:38:16.894103 | osd1 | changed: "artifacts" 2026-08-18 05:38:17.034358 | mon1 | changed: "docs" 2026-08-18 05:38:17.063099 | osd1 | changed: "docs" 2026-08-18 05:38:17.075030 | 2026-08-18 05:38:17.075085 | PLAY RECAP 2026-08-18 05:38:17.075136 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 05:38:17.075167 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 05:38:17.075193 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 05:38:17.075213 | 2026-08-18 05:38:17.223774 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 05:38:17.226394 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 05:38:17.828468 | 2026-08-18 05:38:17.828606 | PLAY [all] 2026-08-18 05:38:17.839653 | 2026-08-18 05:38:17.839767 | TASK [setup-uv : Extract archive] 2026-08-18 05:38:20.112193 | osd1 | changed 2026-08-18 05:38:20.325505 | mon1 | changed 2026-08-18 05:38:20.333689 | 2026-08-18 05:38:20.333799 | TASK [setup-uv : Print version] 2026-08-18 05:38:20.733156 | mon1 | uv 0.8.13 2026-08-18 05:38:20.724980 | osd1 | uv 0.8.13 2026-08-18 05:38:20.898790 | osd1 | ok: Runtime: 0:00:00.011415 2026-08-18 05:38:20.909987 | mon1 | ok: Runtime: 0:00:00.016879 2026-08-18 05:38:20.923376 | 2026-08-18 05:38:20.923443 | TASK [Install Ansible collection siblings] 2026-08-18 05:38:21.314072 | mon1 | ok: 2026-08-18 05:38:21.314335 | mon1 | Skipping community.general: no checked-out sibling 2026-08-18 05:38:21.314375 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 05:38:21.314404 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 05:38:21.317053 | 2026-08-18 05:38:21.317112 | PLAY RECAP 2026-08-18 05:38:21.317163 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 05:38:21.317227 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 05:38:21.317247 | 2026-08-18 05:38:21.472645 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 05:38:21.478754 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 05:38:22.057412 | 2026-08-18 05:38:22.057581 | PLAY [all] 2026-08-18 05:38:22.068846 | 2026-08-18 05:38:22.068926 | LOOP [Check inventory directories] 2026-08-18 05:38:22.418463 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 05:38:22.574228 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 05:38:22.734117 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 05:38:22.753440 | 2026-08-18 05:38:22.753640 | LOOP [Copy inventory file for Zuul] 2026-08-18 05:38:23.553130 | mon1 | changed: 2026-08-18 05:38:23.553375 | mon1 | { 2026-08-18 05:38:23.553413 | mon1 | "ansible_loop_var": "item", 2026-08-18 05:38:23.553444 | mon1 | "changed": false, 2026-08-18 05:38:23.553472 | mon1 | "failed": false, 2026-08-18 05:38:23.553503 | mon1 | "invocation": { 2026-08-18 05:38:23.553529 | mon1 | "module_args": { 2026-08-18 05:38:23.553555 | mon1 | "checksum_algorithm": "sha1", 2026-08-18 05:38:23.553579 | mon1 | "follow": true, 2026-08-18 05:38:23.553604 | mon1 | "get_attributes": true, 2026-08-18 05:38:23.553630 | mon1 | "get_checksum": true, 2026-08-18 05:38:23.553654 | mon1 | "get_mime": true, 2026-08-18 05:38:23.553678 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 05:38:23.553703 | mon1 | } 2026-08-18 05:38:23.553727 | mon1 | }, 2026-08-18 05:38:23.553751 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 05:38:23.553774 | mon1 | "stat": { 2026-08-18 05:38:23.553798 | mon1 | "atime": 1787031495.8472972, 2026-08-18 05:38:23.553822 | mon1 | "attr_flags": "e", 2026-08-18 05:38:23.553846 | mon1 | "attributes": [ 2026-08-18 05:38:23.553870 | mon1 | "extents" 2026-08-18 05:38:23.553894 | mon1 | ], 2026-08-18 05:38:23.553917 | mon1 | "block_size": 4096, 2026-08-18 05:38:23.553941 | mon1 | "blocks": 8, 2026-08-18 05:38:23.553964 | mon1 | "charset": "unknown", 2026-08-18 05:38:23.553990 | mon1 | "ctime": 1787031495.8552985, 2026-08-18 05:38:23.554014 | mon1 | "dev": 64513, 2026-08-18 05:38:23.554038 | mon1 | "device_type": 0, 2026-08-18 05:38:23.554062 | mon1 | "executable": true, 2026-08-18 05:38:23.554085 | mon1 | "exists": true, 2026-08-18 05:38:23.554108 | mon1 | "gid": 1000, 2026-08-18 05:38:23.554131 | mon1 | "gr_name": "zuul", 2026-08-18 05:38:23.554154 | mon1 | "inode": 1042461, 2026-08-18 05:38:23.554177 | mon1 | "isblk": false, 2026-08-18 05:38:23.554201 | mon1 | "ischr": false, 2026-08-18 05:38:23.554224 | mon1 | "isdir": true, 2026-08-18 05:38:23.554248 | mon1 | "isfifo": false, 2026-08-18 05:38:23.554271 | mon1 | "isgid": false, 2026-08-18 05:38:23.554294 | mon1 | "islnk": false, 2026-08-18 05:38:23.554317 | mon1 | "isreg": false, 2026-08-18 05:38:23.554340 | mon1 | "issock": false, 2026-08-18 05:38:23.554363 | mon1 | "isuid": false, 2026-08-18 05:38:23.554386 | mon1 | "mimetype": "unknown", 2026-08-18 05:38:23.554409 | mon1 | "mode": "0755", 2026-08-18 05:38:23.554432 | mon1 | "mtime": 1787031482.144618, 2026-08-18 05:38:23.554455 | mon1 | "nlink": 10, 2026-08-18 05:38:23.554478 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 05:38:23.554501 | mon1 | "pw_name": "zuul", 2026-08-18 05:38:23.554548 | mon1 | "readable": true, 2026-08-18 05:38:23.554573 | mon1 | "rgrp": true, 2026-08-18 05:38:23.554597 | mon1 | "roth": true, 2026-08-18 05:38:23.554623 | mon1 | "rusr": true, 2026-08-18 05:38:23.554647 | mon1 | "size": 4096, 2026-08-18 05:38:23.554683 | mon1 | "uid": 1000, 2026-08-18 05:38:23.554708 | mon1 | "version": "1243290912", 2026-08-18 05:38:23.554732 | mon1 | "wgrp": false, 2026-08-18 05:38:23.554758 | mon1 | "woth": false, 2026-08-18 05:38:23.554782 | mon1 | "writeable": true, 2026-08-18 05:38:23.554806 | mon1 | "wusr": true, 2026-08-18 05:38:23.554830 | mon1 | "xgrp": true, 2026-08-18 05:38:23.554853 | mon1 | "xoth": true, 2026-08-18 05:38:23.554877 | mon1 | "xusr": true 2026-08-18 05:38:23.554900 | mon1 | } 2026-08-18 05:38:23.554924 | mon1 | } 2026-08-18 05:38:23.554972 | mon1 | ok: All items complete 2026-08-18 05:38:23.555001 | 2026-08-18 05:38:23.556669 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:23.557512 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:23.576019 | 2026-08-18 05:38:23.576199 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 05:38:23.925448 | mon1 | changed: 2 replacements made 2026-08-18 05:38:23.926715 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:23.927298 | mon1 | skipping: Conditional result was False 2026-08-18 05:38:23.947666 | 2026-08-18 05:38:23.947867 | TASK [Run Molecule scenario] 2026-08-18 05:38:24.636873 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-18 05:38:25.495394 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-18 05:38:25.689599 | mon1 | Using CPython 3.13.7 2026-08-18 05:38:25.689710 | mon1 | Creating virtual environment at: .venv 2026-08-18 05:38:25.921412 | mon1 | Downloading pygments (1.2MiB) 2026-08-18 05:38:25.921782 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-18 05:38:25.922058 | mon1 | Downloading cryptography (4.3MiB) 2026-08-18 05:38:25.922336 | mon1 | Downloading netaddr (2.2MiB) 2026-08-18 05:38:26.099205 | mon1 | Downloading netaddr 2026-08-18 05:38:26.109611 | mon1 | Downloading cryptography 2026-08-18 05:38:26.150049 | mon1 | Downloading pygments 2026-08-18 05:38:26.261595 | mon1 | Downloading ansible-core 2026-08-18 05:38:26.292644 | mon1 | Installed 36 packages in 30ms 2026-08-18 05:38:27.412073 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 05:38:27.412177 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 05:38:28.031182 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 05:38:28.031297 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 05:38:44.918621 | mon1 | INFO [default > dependency] Executing 2026-08-18 05:38:44.918787 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 05:38:44.918804 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 05:38:44.918982 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 05:38:44.925943 | mon1 | INFO [default > cleanup] Executing 2026-08-18 05:38:44.926207 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 05:38:44.931172 | mon1 | INFO [default > destroy] Executing 2026-08-18 05:38:44.931207 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 05:38:44.931278 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-18 05:38:44.936161 | mon1 | INFO [default > syntax] Executing 2026-08-18 05:38:45.940531 | mon1 | 2026-08-18 05:38:45.940838 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 05:38:45.994407 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-18 05:38:46.005104 | mon1 | INFO [default > create] Executing 2026-08-18 05:38:46.007210 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 05:38:46.014274 | mon1 | INFO [default > prepare] Executing 2026-08-18 05:38:46.664834 | mon1 | 2026-08-18 05:38:46.665006 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-18 05:38:46.665256 | mon1 | 2026-08-18 05:38:46.665514 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:38:46.665737 | mon1 | Tuesday 18 August 2026 05:38:46 +0000 (0:00:00.030) 0:00:00.030 ******** 2026-08-18 05:38:47.791304 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 05:38:47.791422 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:38:47.791563 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:38:47.791714 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:38:47.791855 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:38:47.807490 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 05:38:47.807732 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:38:47.807937 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:38:47.808138 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:38:47.808345 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:38:47.816529 | mon1 | ok: [mon1] 2026-08-18 05:38:47.816662 | mon1 | ok: [osd1] 2026-08-18 05:38:47.816795 | mon1 | 2026-08-18 05:38:47.816936 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-18 05:38:47.817079 | mon1 | Tuesday 18 August 2026 05:38:47 +0000 (0:00:01.152) 0:00:01.183 ******** 2026-08-18 05:38:48.521913 | mon1 | changed: [mon1] 2026-08-18 05:38:48.521989 | mon1 | changed: [osd1] 2026-08-18 05:38:48.522127 | mon1 | 2026-08-18 05:38:48.522261 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 05:38:48.522446 | mon1 | Tuesday 18 August 2026 05:38:48 +0000 (0:00:00.705) 0:00:01.888 ******** 2026-08-18 05:38:48.815789 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 05:38:48.816024 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 05:38:48.816257 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 05:38:48.844471 | mon1 | changed: [mon1] 2026-08-18 05:38:48.844603 | mon1 | changed: [osd1] 2026-08-18 05:38:48.844721 | mon1 | 2026-08-18 05:38:48.844855 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-18 05:38:48.844988 | mon1 | Tuesday 18 August 2026 05:38:48 +0000 (0:00:00.322) 0:00:02.210 ******** 2026-08-18 05:38:55.802494 | mon1 | changed: [osd1] 2026-08-18 05:38:55.802633 | mon1 | changed: [mon1] 2026-08-18 05:38:55.802820 | mon1 | 2026-08-18 05:38:55.803021 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 05:38:55.803201 | mon1 | 2026-08-18 05:38:55.803395 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:38:55.803584 | mon1 | Tuesday 18 August 2026 05:38:55 +0000 (0:00:06.958) 0:00:09.169 ******** 2026-08-18 05:38:56.483719 | mon1 | ok: [osd1] 2026-08-18 05:38:56.483917 | mon1 | 2026-08-18 05:38:56.484216 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-18 05:38:56.484509 | mon1 | Tuesday 18 August 2026 05:38:56 +0000 (0:00:00.680) 0:00:09.849 ******** 2026-08-18 05:39:15.172642 | mon1 | changed: [osd1] 2026-08-18 05:39:15.172841 | mon1 | 2026-08-18 05:39:15.173063 | mon1 | TASK [Start up service] ******************************************************** 2026-08-18 05:39:15.173271 | mon1 | Tuesday 18 August 2026 05:39:15 +0000 (0:00:18.689) 0:00:28.539 ******** 2026-08-18 05:39:15.713136 | mon1 | ok: [osd1] 2026-08-18 05:39:15.713273 | mon1 | 2026-08-18 05:39:15.713483 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 05:39:15.713688 | mon1 | Tuesday 18 August 2026 05:39:15 +0000 (0:00:00.540) 0:00:29.079 ******** 2026-08-18 05:39:16.002824 | mon1 | ok: [osd1] 2026-08-18 05:39:16.002906 | mon1 | 2026-08-18 05:39:16.003142 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 05:39:16.003356 | mon1 | Tuesday 18 August 2026 05:39:16 +0000 (0:00:00.289) 0:00:29.369 ******** 2026-08-18 05:39:16.616734 | mon1 | changed: [osd1] 2026-08-18 05:39:16.616807 | mon1 | 2026-08-18 05:39:16.617083 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 05:39:16.617247 | mon1 | Tuesday 18 August 2026 05:39:16 +0000 (0:00:00.613) 0:00:29.982 ******** 2026-08-18 05:39:16.793286 | mon1 | ok: [osd1] 2026-08-18 05:39:16.793362 | mon1 | 2026-08-18 05:39:16.793598 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 05:39:16.793793 | mon1 | Tuesday 18 August 2026 05:39:16 +0000 (0:00:00.176) 0:00:30.159 ******** 2026-08-18 05:39:16.816228 | mon1 | skipping: [osd1] 2026-08-18 05:39:16.816417 | mon1 | 2026-08-18 05:39:16.816626 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 05:39:16.816791 | mon1 | Tuesday 18 August 2026 05:39:16 +0000 (0:00:00.023) 0:00:30.183 ******** 2026-08-18 05:39:17.334469 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 05:39:17.334661 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 05:39:17.334866 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 05:39:17.335055 | mon1 | 2026-08-18 05:39:17.335267 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 05:39:17.335472 | mon1 | Tuesday 18 August 2026 05:39:17 +0000 (0:00:00.517) 0:00:30.700 ******** 2026-08-18 05:39:17.929153 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 05:39:17.929314 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 05:39:17.929512 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 05:39:17.929700 | mon1 | 2026-08-18 05:39:17.929908 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-18 05:39:17.930116 | mon1 | Tuesday 18 August 2026 05:39:17 +0000 (0:00:00.594) 0:00:31.295 ******** 2026-08-18 05:39:18.636293 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 05:39:18.636445 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 05:39:18.636728 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 05:39:18.636920 | mon1 | 2026-08-18 05:39:18.637135 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 05:39:18.637348 | mon1 | Tuesday 18 August 2026 05:39:18 +0000 (0:00:00.707) 0:00:32.002 ******** 2026-08-18 05:39:21.753562 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 05:39:21.753688 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 05:39:21.753881 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 05:39:21.754065 | mon1 | 2026-08-18 05:39:21.754272 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 05:39:21.754500 | mon1 | Tuesday 18 August 2026 05:39:21 +0000 (0:00:03.116) 0:00:35.119 ******** 2026-08-18 05:39:23.734453 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-18 05:39:23.734642 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-18 05:39:23.734860 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-18 05:39:23.735057 | mon1 | 2026-08-18 05:39:23.735264 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 05:39:23.735505 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-18 05:39:23.735719 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 05:39:23.735914 | mon1 | 2026-08-18 05:39:23.736099 | mon1 | 2026-08-18 05:39:23.736297 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 05:39:23.736502 | mon1 | Tuesday 18 August 2026 05:39:23 +0000 (0:00:01.981) 0:00:37.101 ******** 2026-08-18 05:39:23.736686 | mon1 | =============================================================================== 2026-08-18 05:39:23.736916 | mon1 | Install depedencies ---------------------------------------------------- 18.69s 2026-08-18 05:39:23.737118 | mon1 | Update apt cache -------------------------------------------------------- 6.96s 2026-08-18 05:39:23.737324 | mon1 | Create a volume group for each loop device ------------------------------ 3.12s 2026-08-18 05:39:23.737528 | mon1 | Create a logical volume for each loop device ---------------------------- 1.98s 2026-08-18 05:39:23.737827 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s 2026-08-18 05:39:23.738033 | mon1 | Start loop devices ------------------------------------------------------ 0.71s 2026-08-18 05:39:23.738222 | mon1 | Configure short hostname ------------------------------------------------ 0.71s 2026-08-18 05:39:23.738461 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s 2026-08-18 05:39:23.738650 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.61s 2026-08-18 05:39:23.738898 | mon1 | Set permissions on loopback devices ------------------------------------- 0.59s 2026-08-18 05:39:23.739080 | mon1 | Start up service -------------------------------------------------------- 0.54s 2026-08-18 05:39:23.739217 | mon1 | Create devices for Ceph ------------------------------------------------- 0.52s 2026-08-18 05:39:23.739360 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.32s 2026-08-18 05:39:23.739491 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.29s 2026-08-18 05:39:23.739625 | mon1 | Get list of all loopback devices ---------------------------------------- 0.18s 2026-08-18 05:39:23.739756 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-08-18 05:39:23.823067 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-18 05:39:23.832687 | mon1 | INFO [default > converge] Executing 2026-08-18 05:39:24.679909 | mon1 | 2026-08-18 05:39:24.680006 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 05:39:24.680126 | mon1 | 2026-08-18 05:39:24.680250 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:39:24.680393 | mon1 | Tuesday 18 August 2026 05:39:24 +0000 (0:00:00.046) 0:00:00.046 ******** 2026-08-18 05:39:25.697486 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 05:39:25.697642 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:39:25.697848 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:39:25.698054 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:39:25.698258 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:39:25.708018 | mon1 | ok: [mon1] 2026-08-18 05:39:25.708058 | mon1 | 2026-08-18 05:39:25.708217 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:39:25.708350 | mon1 | Tuesday 18 August 2026 05:39:25 +0000 (0:00:01.028) 0:00:01.074 ******** 2026-08-18 05:39:26.003904 | mon1 | ok: [mon1] 2026-08-18 05:39:26.004071 | mon1 | 2026-08-18 05:39:26.004287 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:39:26.004490 | mon1 | Tuesday 18 August 2026 05:39:26 +0000 (0:00:00.295) 0:00:01.370 ******** 2026-08-18 05:39:26.036696 | mon1 | skipping: [mon1] 2026-08-18 05:39:26.036873 | mon1 | 2026-08-18 05:39:26.037077 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:39:26.037231 | mon1 | Tuesday 18 August 2026 05:39:26 +0000 (0:00:00.033) 0:00:01.403 ******** 2026-08-18 05:39:26.337292 | mon1 | changed: [mon1] 2026-08-18 05:39:26.337339 | mon1 | 2026-08-18 05:39:26.337453 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:39:26.337544 | mon1 | Tuesday 18 August 2026 05:39:26 +0000 (0:00:00.300) 0:00:01.703 ******** 2026-08-18 05:39:26.462141 | mon1 | ok: [mon1] => { 2026-08-18 05:39:26.462221 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:39:26.462231 | mon1 | } 2026-08-18 05:39:26.462270 | mon1 | 2026-08-18 05:39:26.462360 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:39:26.462477 | mon1 | Tuesday 18 August 2026 05:39:26 +0000 (0:00:00.124) 0:00:01.828 ******** 2026-08-18 05:39:27.257700 | mon1 | changed: [mon1] 2026-08-18 05:39:27.257865 | mon1 | 2026-08-18 05:39:27.258133 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:39:27.258334 | mon1 | Tuesday 18 August 2026 05:39:27 +0000 (0:00:00.795) 0:00:02.623 ******** 2026-08-18 05:39:27.304757 | mon1 | skipping: [mon1] 2026-08-18 05:39:27.304861 | mon1 | 2026-08-18 05:39:27.305098 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:39:27.305318 | mon1 | Tuesday 18 August 2026 05:39:27 +0000 (0:00:00.047) 0:00:02.671 ******** 2026-08-18 05:39:27.343515 | mon1 | skipping: [mon1] 2026-08-18 05:39:27.343755 | mon1 | 2026-08-18 05:39:27.344063 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:39:27.344307 | mon1 | Tuesday 18 August 2026 05:39:27 +0000 (0:00:00.038) 0:00:02.709 ******** 2026-08-18 05:39:27.550860 | mon1 | ok: [mon1] 2026-08-18 05:39:27.550953 | mon1 | 2026-08-18 05:39:27.551072 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:39:27.551198 | mon1 | Tuesday 18 August 2026 05:39:27 +0000 (0:00:00.207) 0:00:02.916 ******** 2026-08-18 05:39:28.871480 | mon1 | ok: [mon1] 2026-08-18 05:39:28.871659 | mon1 | 2026-08-18 05:39:28.871940 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:39:28.872164 | mon1 | Tuesday 18 August 2026 05:39:28 +0000 (0:00:01.320) 0:00:04.237 ******** 2026-08-18 05:39:28.949194 | mon1 | ok: [mon1] => { 2026-08-18 05:39:28.949370 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:39:28.949617 | mon1 | } 2026-08-18 05:39:28.949760 | mon1 | 2026-08-18 05:39:28.949968 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:39:28.950173 | mon1 | Tuesday 18 August 2026 05:39:28 +0000 (0:00:00.078) 0:00:04.315 ******** 2026-08-18 05:39:29.805246 | mon1 | changed: [mon1] 2026-08-18 05:39:29.805421 | mon1 | 2026-08-18 05:39:29.805663 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:39:29.805879 | mon1 | Tuesday 18 August 2026 05:39:29 +0000 (0:00:00.855) 0:00:05.171 ******** 2026-08-18 05:39:32.759311 | mon1 | changed: [mon1] 2026-08-18 05:39:32.759830 | mon1 | 2026-08-18 05:39:32.760132 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:39:32.760404 | mon1 | Tuesday 18 August 2026 05:39:32 +0000 (0:00:02.953) 0:00:08.124 ******** 2026-08-18 05:39:32.791303 | mon1 | skipping: [mon1] 2026-08-18 05:39:32.791661 | mon1 | 2026-08-18 05:39:32.791947 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:39:32.792221 | mon1 | Tuesday 18 August 2026 05:39:32 +0000 (0:00:00.029) 0:00:08.154 ******** 2026-08-18 05:39:32.815045 | mon1 | skipping: [mon1] 2026-08-18 05:39:32.815386 | mon1 | 2026-08-18 05:39:32.815696 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:39:32.815985 | mon1 | Tuesday 18 August 2026 05:39:32 +0000 (0:00:00.023) 0:00:08.178 ******** 2026-08-18 05:39:32.833699 | mon1 | skipping: [mon1] 2026-08-18 05:39:32.833839 | mon1 | 2026-08-18 05:39:32.834027 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:39:32.834154 | mon1 | Tuesday 18 August 2026 05:39:32 +0000 (0:00:00.021) 0:00:08.199 ******** 2026-08-18 05:39:38.658636 | mon1 | changed: [mon1] 2026-08-18 05:39:38.658741 | mon1 | 2026-08-18 05:39:38.658893 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:39:38.659118 | mon1 | Tuesday 18 August 2026 05:39:38 +0000 (0:00:05.824) 0:00:14.024 ******** 2026-08-18 05:39:39.283091 | mon1 | changed: [mon1] 2026-08-18 05:39:39.283188 | mon1 | 2026-08-18 05:39:39.283219 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:39:39.283332 | mon1 | Tuesday 18 August 2026 05:39:39 +0000 (0:00:00.624) 0:00:14.649 ******** 2026-08-18 05:39:40.209316 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:39:40.209367 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:39:40.209374 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:39:40.209379 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:39:40.209385 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:39:40.209390 | mon1 | 2026-08-18 05:39:40.209395 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:39:40.209399 | mon1 | Tuesday 18 August 2026 05:39:40 +0000 (0:00:00.925) 0:00:15.574 ******** 2026-08-18 05:39:40.848061 | mon1 | changed: [mon1] 2026-08-18 05:39:40.848136 | mon1 | 2026-08-18 05:39:40.848152 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:39:40.848568 | mon1 | Tuesday 18 August 2026 05:39:40 +0000 (0:00:00.632) 0:00:16.207 ******** 2026-08-18 05:39:40.848756 | mon1 | 2026-08-18 05:39:40.848763 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 05:39:40.848768 | mon1 | Tuesday 18 August 2026 05:39:40 +0000 (0:00:00.006) 0:00:16.214 ******** 2026-08-18 05:39:41.736919 | mon1 | ok: [mon1] 2026-08-18 05:39:41.737003 | mon1 | 2026-08-18 05:39:41.737312 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 05:39:41.737368 | mon1 | Tuesday 18 August 2026 05:39:41 +0000 (0:00:00.888) 0:00:17.102 ******** 2026-08-18 05:39:42.178961 | mon1 | changed: [mon1] 2026-08-18 05:39:42.179062 | mon1 | 2026-08-18 05:39:42.179078 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:39:42.179232 | mon1 | Tuesday 18 August 2026 05:39:42 +0000 (0:00:00.442) 0:00:17.545 ******** 2026-08-18 05:39:42.710078 | mon1 | changed: [mon1] 2026-08-18 05:39:42.710156 | mon1 | 2026-08-18 05:39:42.710213 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:39:42.710352 | mon1 | Tuesday 18 August 2026 05:39:42 +0000 (0:00:00.531) 0:00:18.076 ******** 2026-08-18 05:39:42.919391 | mon1 | ok: [mon1] 2026-08-18 05:39:42.919486 | mon1 | 2026-08-18 05:39:42.919503 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:39:42.919634 | mon1 | Tuesday 18 August 2026 05:39:42 +0000 (0:00:00.209) 0:00:18.285 ******** 2026-08-18 05:39:42.989563 | mon1 | ok: [mon1] => { 2026-08-18 05:39:42.989634 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:39:42.990105 | mon1 | } 2026-08-18 05:39:42.990193 | mon1 | 2026-08-18 05:39:42.990203 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:39:42.990210 | mon1 | Tuesday 18 August 2026 05:39:42 +0000 (0:00:00.070) 0:00:18.355 ******** 2026-08-18 05:39:43.762903 | mon1 | changed: [mon1] 2026-08-18 05:39:43.763007 | mon1 | 2026-08-18 05:39:43.763024 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:39:43.763189 | mon1 | Tuesday 18 August 2026 05:39:43 +0000 (0:00:00.773) 0:00:19.129 ******** 2026-08-18 05:39:48.222821 | mon1 | changed: [mon1] 2026-08-18 05:39:48.222876 | mon1 | 2026-08-18 05:39:48.222882 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:39:48.222887 | mon1 | Tuesday 18 August 2026 05:39:48 +0000 (0:00:04.459) 0:00:23.588 ******** 2026-08-18 05:39:49.441823 | mon1 | ok: [mon1] 2026-08-18 05:39:49.441908 | mon1 | 2026-08-18 05:39:49.442158 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:39:49.442229 | mon1 | Tuesday 18 August 2026 05:39:49 +0000 (0:00:01.219) 0:00:24.807 ******** 2026-08-18 05:39:49.836737 | mon1 | changed: [mon1] 2026-08-18 05:39:49.836832 | mon1 | 2026-08-18 05:39:49.837144 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:39:49.837246 | mon1 | Tuesday 18 August 2026 05:39:49 +0000 (0:00:00.394) 0:00:25.202 ******** 2026-08-18 05:39:50.306048 | mon1 | changed: [mon1] 2026-08-18 05:39:50.306112 | mon1 | 2026-08-18 05:39:50.306468 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:39:50.306524 | mon1 | Tuesday 18 August 2026 05:39:50 +0000 (0:00:00.469) 0:00:25.672 ******** 2026-08-18 05:39:50.914494 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 05:39:50.914738 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:39:50.914754 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:39:50.914774 | mon1 | 2026-08-18 05:39:50.914785 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:39:50.914978 | mon1 | Tuesday 18 August 2026 05:39:50 +0000 (0:00:00.606) 0:00:26.279 ******** 2026-08-18 05:39:51.377282 | mon1 | changed: [mon1] 2026-08-18 05:39:51.377462 | mon1 | 2026-08-18 05:39:51.377709 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:39:51.377972 | mon1 | Tuesday 18 August 2026 05:39:51 +0000 (0:00:00.464) 0:00:26.743 ******** 2026-08-18 05:39:51.845763 | mon1 | changed: [mon1] 2026-08-18 05:39:51.845952 | mon1 | 2026-08-18 05:39:51.846176 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:39:51.846403 | mon1 | Tuesday 18 August 2026 05:39:51 +0000 (0:00:00.460) 0:00:27.203 ******** 2026-08-18 05:39:51.846602 | mon1 | 2026-08-18 05:39:51.846821 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 05:39:51.847003 | mon1 | Tuesday 18 August 2026 05:39:51 +0000 (0:00:00.007) 0:00:27.211 ******** 2026-08-18 05:39:52.503565 | mon1 | ok: [mon1] 2026-08-18 05:39:52.503652 | mon1 | 2026-08-18 05:39:52.503992 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 05:39:52.504059 | mon1 | Tuesday 18 August 2026 05:39:52 +0000 (0:00:00.657) 0:00:27.869 ******** 2026-08-18 05:39:53.209846 | mon1 | changed: [mon1] 2026-08-18 05:39:53.209909 | mon1 | 2026-08-18 05:39:53.209995 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:39:53.210104 | mon1 | Tuesday 18 August 2026 05:39:53 +0000 (0:00:00.706) 0:00:28.576 ******** 2026-08-18 05:39:53.769331 | mon1 | changed: [mon1] 2026-08-18 05:39:53.769417 | mon1 | 2026-08-18 05:39:53.769439 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:39:53.769597 | mon1 | Tuesday 18 August 2026 05:39:53 +0000 (0:00:00.559) 0:00:29.135 ******** 2026-08-18 05:39:53.817223 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:39:53.817328 | mon1 | 2026-08-18 05:39:53.817339 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:39:53.817441 | mon1 | Tuesday 18 August 2026 05:39:53 +0000 (0:00:00.047) 0:00:29.183 ******** 2026-08-18 05:40:17.934955 | mon1 | changed: [mon1] 2026-08-18 05:40:17.935040 | mon1 | 2026-08-18 05:40:17.935054 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:40:17.935179 | mon1 | Tuesday 18 August 2026 05:40:17 +0000 (0:00:24.117) 0:00:53.301 ******** 2026-08-18 05:40:18.679693 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 05:40:18.679780 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 05:40:18.680179 | mon1 | 2026-08-18 05:40:18.680377 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:40:18.680387 | mon1 | Tuesday 18 August 2026 05:40:18 +0000 (0:00:00.744) 0:00:54.045 ******** 2026-08-18 05:40:20.705297 | mon1 | changed: [mon1] 2026-08-18 05:40:20.705396 | mon1 | 2026-08-18 05:40:20.705671 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:40:20.705732 | mon1 | Tuesday 18 August 2026 05:40:20 +0000 (0:00:02.025) 0:00:56.071 ******** 2026-08-18 05:40:20.904582 | mon1 | ok: [mon1] 2026-08-18 05:40:20.904658 | mon1 | 2026-08-18 05:40:20.904890 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:40:20.904951 | mon1 | Tuesday 18 August 2026 05:40:20 +0000 (0:00:00.199) 0:00:56.270 ******** 2026-08-18 05:40:21.319684 | mon1 | changed: [mon1] 2026-08-18 05:40:21.319777 | mon1 | 2026-08-18 05:40:21.319792 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:40:21.319936 | mon1 | Tuesday 18 August 2026 05:40:21 +0000 (0:00:00.415) 0:00:56.686 ******** 2026-08-18 05:40:21.622188 | mon1 | changed: [mon1] 2026-08-18 05:40:21.622249 | mon1 | 2026-08-18 05:40:21.622465 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-18 05:40:21.622503 | mon1 | Tuesday 18 August 2026 05:40:21 +0000 (0:00:00.302) 0:00:56.988 ******** 2026-08-18 05:40:21.750406 | mon1 | ok: [mon1] 2026-08-18 05:40:21.750455 | mon1 | 2026-08-18 05:40:21.750672 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-18 05:40:21.750687 | mon1 | Tuesday 18 August 2026 05:40:21 +0000 (0:00:00.127) 0:00:57.116 ******** 2026-08-18 05:40:21.959866 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 05:40:21.959927 | mon1 | 2026-08-18 05:40:21.960264 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-18 05:40:21.960325 | mon1 | Tuesday 18 August 2026 05:40:21 +0000 (0:00:00.209) 0:00:57.325 ******** 2026-08-18 05:40:22.011134 | mon1 | ok: [mon1] 2026-08-18 05:40:22.011536 | mon1 | 2026-08-18 05:40:22.011564 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-18 05:40:22.011573 | mon1 | Tuesday 18 August 2026 05:40:22 +0000 (0:00:00.051) 0:00:57.377 ******** 2026-08-18 05:40:22.096073 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-08-18 05:40:22.096159 | mon1 | 2026-08-18 05:40:22.096171 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-08-18 05:40:22.096181 | mon1 | Tuesday 18 August 2026 05:40:22 +0000 (0:00:00.084) 0:00:57.461 ******** 2026-08-18 05:40:22.408103 | mon1 | changed: [mon1] 2026-08-18 05:40:22.408180 | mon1 | 2026-08-18 05:40:22.408192 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-08-18 05:40:22.408346 | mon1 | Tuesday 18 August 2026 05:40:22 +0000 (0:00:00.311) 0:00:57.773 ******** 2026-08-18 05:40:23.098271 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-08-18 05:40:23.098494 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-08-18 05:40:23.098525 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-08-18 05:40:23.098716 | mon1 | 2026-08-18 05:40:23.099117 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-08-18 05:40:23.099134 | mon1 | Tuesday 18 August 2026 05:40:23 +0000 (0:00:00.690) 0:00:58.464 ******** 2026-08-18 05:41:50.127418 | mon1 | ok: [mon1] 2026-08-18 05:41:50.127508 | mon1 | 2026-08-18 05:41:50.127522 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-08-18 05:41:50.127542 | mon1 | Tuesday 18 August 2026 05:41:50 +0000 (0:01:27.027) 0:02:25.491 ******** 2026-08-18 05:41:50.358430 | mon1 | changed: [mon1] 2026-08-18 05:41:50.358523 | mon1 | 2026-08-18 05:41:50.358568 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-08-18 05:41:50.358760 | mon1 | Tuesday 18 August 2026 05:41:50 +0000 (0:00:00.232) 0:02:25.724 ******** 2026-08-18 05:41:50.396985 | mon1 | ok: [mon1] 2026-08-18 05:41:50.397060 | mon1 | 2026-08-18 05:41:50.397116 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:41:50.397207 | mon1 | Tuesday 18 August 2026 05:41:50 +0000 (0:00:00.038) 0:02:25.763 ******** 2026-08-18 05:41:50.462761 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-18 05:41:50.462831 | mon1 | 2026-08-18 05:41:50.462889 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:41:50.462978 | mon1 | Tuesday 18 August 2026 05:41:50 +0000 (0:00:00.065) 0:02:25.829 ******** 2026-08-18 05:41:52.108300 | mon1 | ok: [mon1] 2026-08-18 05:41:52.108401 | mon1 | 2026-08-18 05:41:52.108466 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:41:52.108574 | mon1 | Tuesday 18 August 2026 05:41:52 +0000 (0:00:01.644) 0:02:27.474 ******** 2026-08-18 05:41:52.167778 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 05:41:52.167836 | mon1 | 2026-08-18 05:41:52.167922 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:41:52.168004 | mon1 | Tuesday 18 August 2026 05:41:52 +0000 (0:00:00.060) 0:02:27.534 ******** 2026-08-18 05:41:52.537390 | mon1 | ok: [mon1] 2026-08-18 05:41:52.537475 | mon1 | 2026-08-18 05:41:52.537598 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:41:52.537698 | mon1 | Tuesday 18 August 2026 05:41:52 +0000 (0:00:00.369) 0:02:27.903 ******** 2026-08-18 05:41:54.767261 | mon1 | ok: [mon1] 2026-08-18 05:41:54.767362 | mon1 | 2026-08-18 05:41:54.767422 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-18 05:41:54.767559 | mon1 | Tuesday 18 August 2026 05:41:54 +0000 (0:00:02.230) 0:02:30.133 ******** 2026-08-18 05:41:58.012038 | mon1 | changed: [mon1] 2026-08-18 05:41:58.012142 | mon1 | 2026-08-18 05:41:58.012160 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-18 05:41:58.012330 | mon1 | Tuesday 18 August 2026 05:41:58 +0000 (0:00:03.244) 0:02:33.378 ******** 2026-08-18 05:41:59.637506 | mon1 | ok: [mon1] 2026-08-18 05:41:59.637625 | mon1 | 2026-08-18 05:41:59.637664 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:41:59.637730 | mon1 | Tuesday 18 August 2026 05:41:59 +0000 (0:00:01.624) 0:02:35.002 ******** 2026-08-18 05:41:59.705549 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-18 05:41:59.705618 | mon1 | 2026-08-18 05:41:59.705625 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:41:59.705631 | mon1 | Tuesday 18 August 2026 05:41:59 +0000 (0:00:00.068) 0:02:35.071 ******** 2026-08-18 05:41:59.750135 | mon1 | skipping: [mon1] 2026-08-18 05:41:59.750192 | mon1 | 2026-08-18 05:41:59.750200 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:41:59.750208 | mon1 | Tuesday 18 August 2026 05:41:59 +0000 (0:00:00.044) 0:02:35.115 ******** 2026-08-18 05:41:59.796392 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 05:41:59.796446 | mon1 | skipping: [mon1] 2026-08-18 05:41:59.796455 | mon1 | 2026-08-18 05:41:59.796462 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:41:59.796469 | mon1 | Tuesday 18 August 2026 05:41:59 +0000 (0:00:00.046) 0:02:35.161 ******** 2026-08-18 05:42:00.062625 | mon1 | ok: [mon1] 2026-08-18 05:42:00.062704 | mon1 | 2026-08-18 05:42:00.063003 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:42:00.063480 | mon1 | Tuesday 18 August 2026 05:42:00 +0000 (0:00:00.266) 0:02:35.428 ******** 2026-08-18 05:42:02.242883 | mon1 | ok: [mon1] 2026-08-18 05:42:02.242956 | mon1 | 2026-08-18 05:42:02.242963 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-18 05:42:02.242969 | mon1 | Tuesday 18 August 2026 05:42:02 +0000 (0:00:02.180) 0:02:37.608 ******** 2026-08-18 05:42:05.118661 | mon1 | changed: [mon1] 2026-08-18 05:42:05.118783 | mon1 | 2026-08-18 05:42:05.118797 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-18 05:42:05.118811 | mon1 | Tuesday 18 August 2026 05:42:05 +0000 (0:00:02.876) 0:02:40.484 ******** 2026-08-18 05:42:06.744781 | mon1 | ok: [mon1] 2026-08-18 05:42:06.744902 | mon1 | 2026-08-18 05:42:06.744918 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-18 05:42:06.745021 | mon1 | Tuesday 18 August 2026 05:42:06 +0000 (0:00:01.626) 0:02:42.111 ******** 2026-08-18 05:42:15.250079 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 05:42:15.250132 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 05:42:15.250138 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 05:42:15.250143 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 05:42:15.250148 | mon1 | 2026-08-18 05:42:15.250152 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 05:42:15.250157 | mon1 | 2026-08-18 05:42:15.250161 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:42:15.250166 | mon1 | Tuesday 18 August 2026 05:42:15 +0000 (0:00:08.504) 0:02:50.616 ******** 2026-08-18 05:42:16.343458 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 05:42:16.343524 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:42:16.343533 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:42:16.343540 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:42:16.343547 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:42:16.344422 | mon1 | ok: [osd1] 2026-08-18 05:42:16.344443 | mon1 | 2026-08-18 05:42:16.344451 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:42:16.344458 | mon1 | Tuesday 18 August 2026 05:42:16 +0000 (0:00:01.093) 0:02:51.709 ******** 2026-08-18 05:42:16.538217 | mon1 | ok: [osd1] 2026-08-18 05:42:16.538270 | mon1 | 2026-08-18 05:42:16.538366 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:42:16.538533 | mon1 | Tuesday 18 August 2026 05:42:16 +0000 (0:00:00.195) 0:02:51.904 ******** 2026-08-18 05:42:16.568313 | mon1 | skipping: [osd1] 2026-08-18 05:42:16.568404 | mon1 | 2026-08-18 05:42:16.568507 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:42:16.568603 | mon1 | Tuesday 18 August 2026 05:42:16 +0000 (0:00:00.030) 0:02:51.934 ******** 2026-08-18 05:42:16.764436 | mon1 | changed: [osd1] 2026-08-18 05:42:16.764501 | mon1 | 2026-08-18 05:42:16.764630 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:42:16.764756 | mon1 | Tuesday 18 August 2026 05:42:16 +0000 (0:00:00.195) 0:02:52.130 ******** 2026-08-18 05:42:16.815129 | mon1 | ok: [osd1] => { 2026-08-18 05:42:16.815239 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:42:16.815403 | mon1 | } 2026-08-18 05:42:16.815558 | mon1 | 2026-08-18 05:42:16.815694 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:42:16.815825 | mon1 | Tuesday 18 August 2026 05:42:16 +0000 (0:00:00.050) 0:02:52.181 ******** 2026-08-18 05:42:17.456940 | mon1 | changed: [osd1] 2026-08-18 05:42:17.457012 | mon1 | 2026-08-18 05:42:17.457086 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:42:17.457185 | mon1 | Tuesday 18 August 2026 05:42:17 +0000 (0:00:00.641) 0:02:52.822 ******** 2026-08-18 05:42:17.500595 | mon1 | skipping: [osd1] 2026-08-18 05:42:17.501474 | mon1 | 2026-08-18 05:42:17.501500 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:42:17.501512 | mon1 | Tuesday 18 August 2026 05:42:17 +0000 (0:00:00.044) 0:02:52.866 ******** 2026-08-18 05:42:17.541763 | mon1 | skipping: [osd1] 2026-08-18 05:42:17.541838 | mon1 | 2026-08-18 05:42:17.541895 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:42:17.541995 | mon1 | Tuesday 18 August 2026 05:42:17 +0000 (0:00:00.041) 0:02:52.908 ******** 2026-08-18 05:42:17.747639 | mon1 | ok: [osd1] 2026-08-18 05:42:17.747736 | mon1 | 2026-08-18 05:42:17.747751 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:42:17.747898 | mon1 | Tuesday 18 August 2026 05:42:17 +0000 (0:00:00.205) 0:02:53.113 ******** 2026-08-18 05:42:18.956002 | mon1 | ok: [osd1] 2026-08-18 05:42:18.956134 | mon1 | 2026-08-18 05:42:18.956150 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:42:18.956162 | mon1 | Tuesday 18 August 2026 05:42:18 +0000 (0:00:01.208) 0:02:54.322 ******** 2026-08-18 05:42:19.008928 | mon1 | ok: [osd1] => { 2026-08-18 05:42:19.009014 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:42:19.009029 | mon1 | } 2026-08-18 05:42:19.009353 | mon1 | 2026-08-18 05:42:19.009416 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:42:19.009424 | mon1 | Tuesday 18 August 2026 05:42:19 +0000 (0:00:00.053) 0:02:54.375 ******** 2026-08-18 05:42:19.780667 | mon1 | changed: [osd1] 2026-08-18 05:42:19.780751 | mon1 | 2026-08-18 05:42:19.780814 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:42:19.780927 | mon1 | Tuesday 18 August 2026 05:42:19 +0000 (0:00:00.771) 0:02:55.147 ******** 2026-08-18 05:42:22.425998 | mon1 | changed: [osd1] 2026-08-18 05:42:22.426089 | mon1 | 2026-08-18 05:42:22.426326 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:42:22.426478 | mon1 | Tuesday 18 August 2026 05:42:22 +0000 (0:00:02.645) 0:02:57.792 ******** 2026-08-18 05:42:22.461804 | mon1 | skipping: [osd1] 2026-08-18 05:42:22.461873 | mon1 | 2026-08-18 05:42:22.462082 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:42:22.462123 | mon1 | Tuesday 18 August 2026 05:42:22 +0000 (0:00:00.035) 0:02:57.827 ******** 2026-08-18 05:42:22.489775 | mon1 | skipping: [osd1] 2026-08-18 05:42:22.490220 | mon1 | 2026-08-18 05:42:22.490292 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:42:22.490301 | mon1 | Tuesday 18 August 2026 05:42:22 +0000 (0:00:00.028) 0:02:57.855 ******** 2026-08-18 05:42:22.521655 | mon1 | skipping: [osd1] 2026-08-18 05:42:22.521729 | mon1 | 2026-08-18 05:42:22.522077 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:42:22.522111 | mon1 | Tuesday 18 August 2026 05:42:22 +0000 (0:00:00.031) 0:02:57.887 ******** 2026-08-18 05:42:27.820864 | mon1 | changed: [osd1] 2026-08-18 05:42:27.820968 | mon1 | 2026-08-18 05:42:27.821267 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:42:27.821328 | mon1 | Tuesday 18 August 2026 05:42:27 +0000 (0:00:05.299) 0:03:03.186 ******** 2026-08-18 05:42:28.277252 | mon1 | changed: [osd1] 2026-08-18 05:42:28.277352 | mon1 | 2026-08-18 05:42:28.277613 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:42:28.277670 | mon1 | Tuesday 18 August 2026 05:42:28 +0000 (0:00:00.456) 0:03:03.643 ******** 2026-08-18 05:42:29.209536 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:42:29.209635 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:42:29.209699 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:42:29.210178 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:42:29.210235 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:42:29.210241 | mon1 | 2026-08-18 05:42:29.210246 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:42:29.210251 | mon1 | Tuesday 18 August 2026 05:42:29 +0000 (0:00:00.932) 0:03:04.575 ******** 2026-08-18 05:42:29.738484 | mon1 | changed: [osd1] 2026-08-18 05:42:29.738551 | mon1 | 2026-08-18 05:42:29.738571 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:42:29.738612 | mon1 | Tuesday 18 August 2026 05:42:29 +0000 (0:00:00.521) 0:03:05.097 ******** 2026-08-18 05:42:29.738918 | mon1 | 2026-08-18 05:42:29.738972 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 05:42:29.738979 | mon1 | Tuesday 18 August 2026 05:42:29 +0000 (0:00:00.007) 0:03:05.104 ******** 2026-08-18 05:42:30.389189 | mon1 | ok: [osd1] 2026-08-18 05:42:30.389291 | mon1 | 2026-08-18 05:42:30.389375 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 05:42:30.389500 | mon1 | Tuesday 18 August 2026 05:42:30 +0000 (0:00:00.650) 0:03:05.755 ******** 2026-08-18 05:42:30.841912 | mon1 | changed: [osd1] 2026-08-18 05:42:30.842122 | mon1 | 2026-08-18 05:42:30.842361 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:42:30.842689 | mon1 | Tuesday 18 August 2026 05:42:30 +0000 (0:00:00.452) 0:03:06.207 ******** 2026-08-18 05:42:31.404315 | mon1 | changed: [osd1] 2026-08-18 05:42:31.404480 | mon1 | 2026-08-18 05:42:31.404692 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:42:31.404947 | mon1 | Tuesday 18 August 2026 05:42:31 +0000 (0:00:00.562) 0:03:06.770 ******** 2026-08-18 05:42:31.598160 | mon1 | ok: [osd1] 2026-08-18 05:42:31.598447 | mon1 | 2026-08-18 05:42:31.598715 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:42:31.598923 | mon1 | Tuesday 18 August 2026 05:42:31 +0000 (0:00:00.193) 0:03:06.964 ******** 2026-08-18 05:42:31.647548 | mon1 | ok: [osd1] => { 2026-08-18 05:42:31.647800 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:42:31.648009 | mon1 | } 2026-08-18 05:42:31.648213 | mon1 | 2026-08-18 05:42:31.648433 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:42:31.648644 | mon1 | Tuesday 18 August 2026 05:42:31 +0000 (0:00:00.049) 0:03:07.013 ******** 2026-08-18 05:42:48.276668 | mon1 | FAILED - RETRYING: [osd1]: Download item (4 retries left). 2026-08-18 05:42:48.276749 | mon1 | changed: [osd1] 2026-08-18 05:42:48.276757 | mon1 | 2026-08-18 05:42:48.276764 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:42:48.276788 | mon1 | Tuesday 18 August 2026 05:42:48 +0000 (0:00:16.628) 0:03:23.642 ******** 2026-08-18 05:42:52.688522 | mon1 | changed: [osd1] 2026-08-18 05:42:52.688620 | mon1 | 2026-08-18 05:42:52.688745 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:42:52.688877 | mon1 | Tuesday 18 August 2026 05:42:52 +0000 (0:00:04.412) 0:03:28.054 ******** 2026-08-18 05:42:53.889027 | mon1 | ok: [osd1] 2026-08-18 05:42:53.889128 | mon1 | 2026-08-18 05:42:53.889142 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:42:53.889286 | mon1 | Tuesday 18 August 2026 05:42:53 +0000 (0:00:01.200) 0:03:29.255 ******** 2026-08-18 05:42:54.124596 | mon1 | changed: [osd1] 2026-08-18 05:42:54.124717 | mon1 | 2026-08-18 05:42:54.124730 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:42:54.124806 | mon1 | Tuesday 18 August 2026 05:42:54 +0000 (0:00:00.235) 0:03:29.490 ******** 2026-08-18 05:42:54.575454 | mon1 | changed: [osd1] 2026-08-18 05:42:54.575642 | mon1 | 2026-08-18 05:42:54.575778 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:42:54.575908 | mon1 | Tuesday 18 August 2026 05:42:54 +0000 (0:00:00.450) 0:03:29.941 ******** 2026-08-18 05:42:55.135593 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 05:42:55.135702 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:42:55.135717 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:42:55.135730 | mon1 | 2026-08-18 05:42:55.135920 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:42:55.136007 | mon1 | Tuesday 18 August 2026 05:42:55 +0000 (0:00:00.560) 0:03:30.501 ******** 2026-08-18 05:42:55.581271 | mon1 | changed: [osd1] 2026-08-18 05:42:55.581389 | mon1 | 2026-08-18 05:42:55.581402 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:42:55.581472 | mon1 | Tuesday 18 August 2026 05:42:55 +0000 (0:00:00.445) 0:03:30.947 ******** 2026-08-18 05:42:56.019627 | mon1 | changed: [osd1] 2026-08-18 05:42:56.019759 | mon1 | 2026-08-18 05:42:56.019773 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:42:56.019843 | mon1 | Tuesday 18 August 2026 05:42:56 +0000 (0:00:00.432) 0:03:31.379 ******** 2026-08-18 05:42:56.020148 | mon1 | 2026-08-18 05:42:56.020210 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 05:42:56.020217 | mon1 | Tuesday 18 August 2026 05:42:56 +0000 (0:00:00.006) 0:03:31.386 ******** 2026-08-18 05:42:56.693520 | mon1 | ok: [osd1] 2026-08-18 05:42:56.693621 | mon1 | 2026-08-18 05:42:56.693694 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 05:42:56.693869 | mon1 | Tuesday 18 August 2026 05:42:56 +0000 (0:00:00.673) 0:03:32.059 ******** 2026-08-18 05:42:57.494534 | mon1 | changed: [osd1] 2026-08-18 05:42:57.494649 | mon1 | 2026-08-18 05:42:57.494663 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:42:57.494787 | mon1 | Tuesday 18 August 2026 05:42:57 +0000 (0:00:00.801) 0:03:32.860 ******** 2026-08-18 05:42:58.035291 | mon1 | changed: [osd1] 2026-08-18 05:42:58.035386 | mon1 | 2026-08-18 05:42:58.035398 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:42:58.035486 | mon1 | Tuesday 18 August 2026 05:42:58 +0000 (0:00:00.540) 0:03:33.401 ******** 2026-08-18 05:42:58.080317 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:42:58.080376 | mon1 | 2026-08-18 05:42:58.080382 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:42:58.080393 | mon1 | Tuesday 18 August 2026 05:42:58 +0000 (0:00:00.044) 0:03:33.446 ******** 2026-08-18 05:43:02.551166 | mon1 | changed: [osd1] 2026-08-18 05:43:02.551278 | mon1 | 2026-08-18 05:43:02.551299 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:43:02.551338 | mon1 | Tuesday 18 August 2026 05:43:02 +0000 (0:00:04.471) 0:03:37.917 ******** 2026-08-18 05:43:03.222752 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-18 05:43:03.222848 | mon1 | ok: [osd1] => (item=sshd) 2026-08-18 05:43:03.222864 | mon1 | 2026-08-18 05:43:03.223138 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:43:03.223211 | mon1 | Tuesday 18 August 2026 05:43:03 +0000 (0:00:00.671) 0:03:38.588 ******** 2026-08-18 05:43:04.200688 | mon1 | changed: [osd1] 2026-08-18 05:43:04.200805 | mon1 | 2026-08-18 05:43:04.200822 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:43:04.201041 | mon1 | Tuesday 18 August 2026 05:43:04 +0000 (0:00:00.977) 0:03:39.566 ******** 2026-08-18 05:43:04.406926 | mon1 | ok: [osd1] 2026-08-18 05:43:04.406990 | mon1 | 2026-08-18 05:43:04.407844 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:43:04.407936 | mon1 | Tuesday 18 August 2026 05:43:04 +0000 (0:00:00.206) 0:03:39.773 ******** 2026-08-18 05:43:04.704487 | mon1 | changed: [osd1] 2026-08-18 05:43:04.704586 | mon1 | 2026-08-18 05:43:04.704603 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:43:04.704792 | mon1 | Tuesday 18 August 2026 05:43:04 +0000 (0:00:00.296) 0:03:40.070 ******** 2026-08-18 05:43:04.916483 | mon1 | changed: [osd1] 2026-08-18 05:43:04.916617 | mon1 | 2026-08-18 05:43:04.916640 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-18 05:43:04.916661 | mon1 | Tuesday 18 August 2026 05:43:04 +0000 (0:00:00.212) 0:03:40.282 ******** 2026-08-18 05:43:05.142658 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-18 05:43:05.142776 | mon1 | 2026-08-18 05:43:05.142789 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-18 05:43:05.142859 | mon1 | Tuesday 18 August 2026 05:43:05 +0000 (0:00:00.226) 0:03:40.508 ******** 2026-08-18 05:43:05.193680 | mon1 | ok: [osd1] 2026-08-18 05:43:05.193746 | mon1 | 2026-08-18 05:43:05.194103 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:43:05.194193 | mon1 | Tuesday 18 August 2026 05:43:05 +0000 (0:00:00.050) 0:03:40.559 ******** 2026-08-18 05:43:05.251580 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-18 05:43:05.251626 | mon1 | 2026-08-18 05:43:05.251888 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:43:05.251930 | mon1 | Tuesday 18 August 2026 05:43:05 +0000 (0:00:00.058) 0:03:40.617 ******** 2026-08-18 05:43:06.856992 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:43:06.857072 | mon1 | 2026-08-18 05:43:06.857451 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:43:06.857510 | mon1 | Tuesday 18 August 2026 05:43:06 +0000 (0:00:01.605) 0:03:42.223 ******** 2026-08-18 05:43:06.903899 | mon1 | ok: [osd1] => (item=osd1) 2026-08-18 05:43:06.903985 | mon1 | 2026-08-18 05:43:06.904210 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:43:06.904234 | mon1 | Tuesday 18 August 2026 05:43:06 +0000 (0:00:00.047) 0:03:42.270 ******** 2026-08-18 05:43:07.149737 | mon1 | changed: [osd1] 2026-08-18 05:43:07.149804 | mon1 | 2026-08-18 05:43:07.149822 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:43:07.149836 | mon1 | Tuesday 18 August 2026 05:43:07 +0000 (0:00:00.245) 0:03:42.516 ******** 2026-08-18 05:43:12.258164 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:43:12.258274 | mon1 | 2026-08-18 05:43:12.258287 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-18 05:43:12.258443 | mon1 | Tuesday 18 August 2026 05:43:12 +0000 (0:00:05.108) 0:03:47.624 ******** 2026-08-18 05:43:12.951883 | mon1 | ok: [osd1] 2026-08-18 05:43:12.951986 | mon1 | 2026-08-18 05:43:12.952000 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-18 05:43:12.952095 | mon1 | Tuesday 18 August 2026 05:43:12 +0000 (0:00:00.693) 0:03:48.317 ******** 2026-08-18 05:43:54.244978 | mon1 | ok: [osd1] 2026-08-18 05:43:54.245062 | mon1 | 2026-08-18 05:43:54.245121 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-18 05:43:54.245265 | mon1 | Tuesday 18 August 2026 05:43:54 +0000 (0:00:41.293) 0:04:29.611 ******** 2026-08-18 05:44:33.654487 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 05:44:33.654577 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 05:44:33.654587 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 05:44:33.654597 | mon1 | 2026-08-18 05:44:33.654605 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-18 05:44:33.654614 | mon1 | Tuesday 18 August 2026 05:44:33 +0000 (0:00:39.408) 0:05:09.020 ******** 2026-08-18 05:44:35.403200 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:44:35.403283 | mon1 | 2026-08-18 05:44:35.403593 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-18 05:44:35.403665 | mon1 | Tuesday 18 August 2026 05:44:35 +0000 (0:00:01.749) 0:05:10.769 ******** 2026-08-18 05:44:36.978367 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:44:36.978476 | mon1 | 2026-08-18 05:44:36.978743 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-18 05:44:36.978804 | mon1 | Tuesday 18 August 2026 05:44:36 +0000 (0:00:01.575) 0:05:12.344 ******** 2026-08-18 05:44:37.024791 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-18 05:44:37.024865 | mon1 | 2026-08-18 05:44:37.025129 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-18 05:44:37.025194 | mon1 | Tuesday 18 August 2026 05:44:37 +0000 (0:00:00.046) 0:05:12.391 ******** 2026-08-18 05:44:37.067863 | mon1 | ok: [osd1] 2026-08-18 05:44:37.067934 | mon1 | 2026-08-18 05:44:37.068200 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-18 05:44:37.068228 | mon1 | Tuesday 18 August 2026 05:44:37 +0000 (0:00:00.043) 0:05:12.434 ******** 2026-08-18 05:44:38.683524 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:44:38.683626 | mon1 | 2026-08-18 05:44:38.683643 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-18 05:44:38.683821 | mon1 | Tuesday 18 August 2026 05:44:38 +0000 (0:00:01.615) 0:05:14.049 ******** 2026-08-18 05:44:38.723931 | mon1 | ok: [osd1] 2026-08-18 05:44:38.724377 | mon1 | 2026-08-18 05:44:38.724440 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-18 05:44:38.724448 | mon1 | Tuesday 18 August 2026 05:44:38 +0000 (0:00:00.040) 0:05:14.090 ******** 2026-08-18 05:44:38.757554 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-08-18 05:44:38.771746 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:44:38.771844 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:44:38.771931 | mon1 | 2026-08-18 05:44:38.772160 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-08-18 05:44:38.772203 | mon1 | Tuesday 18 August 2026 05:44:38 +0000 (0:00:00.048) 0:05:14.138 ******** 2026-08-18 05:44:38.804285 | mon1 | skipping: [osd1] 2026-08-18 05:44:38.804725 | mon1 | 2026-08-18 05:44:38.804777 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-08-18 05:44:38.804785 | mon1 | Tuesday 18 August 2026 05:44:38 +0000 (0:00:00.032) 0:05:14.170 ******** 2026-08-18 05:44:43.839222 | mon1 | Pausing for 5 seconds 2026-08-18 05:44:43.839427 | mon1 | ok: [osd1] 2026-08-18 05:44:43.839553 | mon1 | 2026-08-18 05:44:43.839696 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-08-18 05:44:43.839827 | mon1 | Tuesday 18 August 2026 05:44:43 +0000 (0:00:05.033) 0:05:19.204 ******** 2026-08-18 05:44:43.887646 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-18 05:44:43.887752 | mon1 | 2026-08-18 05:44:43.887869 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-18 05:44:43.888071 | mon1 | Tuesday 18 August 2026 05:44:43 +0000 (0:00:00.049) 0:05:19.253 ******** 2026-08-18 05:44:43.935156 | mon1 | ok: [osd1] 2026-08-18 05:44:43.935243 | mon1 | 2026-08-18 05:44:43.935396 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-18 05:44:43.935622 | mon1 | Tuesday 18 August 2026 05:44:43 +0000 (0:00:00.047) 0:05:19.301 ******** 2026-08-18 05:44:45.476317 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:44:45.476423 | mon1 | 2026-08-18 05:44:45.476481 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-18 05:44:45.476622 | mon1 | Tuesday 18 August 2026 05:44:45 +0000 (0:00:01.541) 0:05:20.842 ******** 2026-08-18 05:44:45.520466 | mon1 | ok: [osd1] 2026-08-18 05:44:45.520578 | mon1 | 2026-08-18 05:44:45.520656 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-18 05:44:45.520765 | mon1 | Tuesday 18 August 2026 05:44:45 +0000 (0:00:00.044) 0:05:20.886 ******** 2026-08-18 05:44:45.558723 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:44:45.559548 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:44:45.559596 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:44:45.559603 | mon1 | skipping: [osd1] 2026-08-18 05:44:45.559610 | mon1 | 2026-08-18 05:44:45.559617 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-18 05:44:45.559624 | mon1 | Tuesday 18 August 2026 05:44:45 +0000 (0:00:00.037) 0:05:20.924 ******** 2026-08-18 05:44:45.617888 | mon1 | skipping: [osd1] 2026-08-18 05:44:45.617976 | mon1 | 2026-08-18 05:44:45.618485 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-18 05:44:45.618550 | mon1 | 2026-08-18 05:44:45.618558 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:44:45.618565 | mon1 | Tuesday 18 August 2026 05:44:45 +0000 (0:00:00.059) 0:05:20.984 ******** 2026-08-18 05:44:46.498879 | mon1 | ok: [mon1] 2026-08-18 05:44:46.499028 | mon1 | 2026-08-18 05:44:46.499240 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:44:46.499448 | mon1 | Tuesday 18 August 2026 05:44:46 +0000 (0:00:00.880) 0:05:21.864 ******** 2026-08-18 05:44:46.694518 | mon1 | ok: [mon1] 2026-08-18 05:44:46.694669 | mon1 | 2026-08-18 05:44:46.694940 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:44:46.695169 | mon1 | Tuesday 18 August 2026 05:44:46 +0000 (0:00:00.195) 0:05:22.060 ******** 2026-08-18 05:44:46.724352 | mon1 | skipping: [mon1] 2026-08-18 05:44:46.724541 | mon1 | 2026-08-18 05:44:46.724757 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:44:46.724916 | mon1 | Tuesday 18 August 2026 05:44:46 +0000 (0:00:00.030) 0:05:22.090 ******** 2026-08-18 05:44:46.925415 | mon1 | ok: [mon1] 2026-08-18 05:44:46.925592 | mon1 | 2026-08-18 05:44:46.925858 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:44:46.926085 | mon1 | Tuesday 18 August 2026 05:44:46 +0000 (0:00:00.200) 0:05:22.291 ******** 2026-08-18 05:44:46.976163 | mon1 | ok: [mon1] => { 2026-08-18 05:44:46.976388 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:44:46.976592 | mon1 | } 2026-08-18 05:44:46.976733 | mon1 | 2026-08-18 05:44:46.976946 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:44:46.977152 | mon1 | Tuesday 18 August 2026 05:44:46 +0000 (0:00:00.051) 0:05:22.342 ******** 2026-08-18 05:44:47.276522 | mon1 | ok: [mon1] 2026-08-18 05:44:47.276717 | mon1 | 2026-08-18 05:44:47.276958 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:44:47.277245 | mon1 | Tuesday 18 August 2026 05:44:47 +0000 (0:00:00.300) 0:05:22.642 ******** 2026-08-18 05:44:47.314417 | mon1 | skipping: [mon1] 2026-08-18 05:44:47.314678 | mon1 | 2026-08-18 05:44:47.314959 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:44:47.315238 | mon1 | Tuesday 18 August 2026 05:44:47 +0000 (0:00:00.037) 0:05:22.680 ******** 2026-08-18 05:44:47.348900 | mon1 | skipping: [mon1] 2026-08-18 05:44:47.349048 | mon1 | 2026-08-18 05:44:47.349286 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:44:47.349529 | mon1 | Tuesday 18 August 2026 05:44:47 +0000 (0:00:00.035) 0:05:22.715 ******** 2026-08-18 05:44:47.549069 | mon1 | ok: [mon1] 2026-08-18 05:44:47.549181 | mon1 | 2026-08-18 05:44:47.549194 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:44:47.549217 | mon1 | Tuesday 18 August 2026 05:44:47 +0000 (0:00:00.199) 0:05:22.914 ******** 2026-08-18 05:44:48.641009 | mon1 | ok: [mon1] 2026-08-18 05:44:48.641098 | mon1 | 2026-08-18 05:44:48.641376 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:44:48.641400 | mon1 | Tuesday 18 August 2026 05:44:48 +0000 (0:00:01.092) 0:05:24.007 ******** 2026-08-18 05:44:48.702012 | mon1 | ok: [mon1] => { 2026-08-18 05:44:48.702110 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:44:48.702214 | mon1 | } 2026-08-18 05:44:48.702308 | mon1 | 2026-08-18 05:44:48.702468 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:44:48.702557 | mon1 | Tuesday 18 August 2026 05:44:48 +0000 (0:00:00.061) 0:05:24.068 ******** 2026-08-18 05:44:49.020670 | mon1 | ok: [mon1] 2026-08-18 05:44:49.020737 | mon1 | 2026-08-18 05:44:49.020743 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:44:49.020748 | mon1 | Tuesday 18 August 2026 05:44:49 +0000 (0:00:00.318) 0:05:24.386 ******** 2026-08-18 05:44:50.888529 | mon1 | ok: [mon1] 2026-08-18 05:44:50.888627 | mon1 | 2026-08-18 05:44:50.888643 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:44:50.888830 | mon1 | Tuesday 18 August 2026 05:44:50 +0000 (0:00:01.867) 0:05:26.254 ******** 2026-08-18 05:44:50.924489 | mon1 | skipping: [mon1] 2026-08-18 05:44:50.924600 | mon1 | 2026-08-18 05:44:50.924617 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:44:50.924771 | mon1 | Tuesday 18 August 2026 05:44:50 +0000 (0:00:00.035) 0:05:26.290 ******** 2026-08-18 05:44:50.952673 | mon1 | skipping: [mon1] 2026-08-18 05:44:50.952782 | mon1 | 2026-08-18 05:44:50.953097 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:44:50.953134 | mon1 | Tuesday 18 August 2026 05:44:50 +0000 (0:00:00.028) 0:05:26.318 ******** 2026-08-18 05:44:50.983048 | mon1 | skipping: [mon1] 2026-08-18 05:44:50.983447 | mon1 | 2026-08-18 05:44:50.983483 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:44:50.983493 | mon1 | Tuesday 18 August 2026 05:44:50 +0000 (0:00:00.030) 0:05:26.348 ******** 2026-08-18 05:44:52.374705 | mon1 | ok: [mon1] 2026-08-18 05:44:52.374873 | mon1 | 2026-08-18 05:44:52.374879 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:44:52.375029 | mon1 | Tuesday 18 August 2026 05:44:52 +0000 (0:00:01.391) 0:05:27.740 ******** 2026-08-18 05:44:52.781895 | mon1 | ok: [mon1] 2026-08-18 05:44:52.781951 | mon1 | 2026-08-18 05:44:52.781958 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:44:52.781963 | mon1 | Tuesday 18 August 2026 05:44:52 +0000 (0:00:00.407) 0:05:28.147 ******** 2026-08-18 05:44:53.665409 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:44:53.665495 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:44:53.665558 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:44:53.666095 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:44:53.666153 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:44:53.666170 | mon1 | 2026-08-18 05:44:53.666175 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:44:53.666180 | mon1 | Tuesday 18 August 2026 05:44:53 +0000 (0:00:00.883) 0:05:29.031 ******** 2026-08-18 05:44:54.177676 | mon1 | ok: [mon1] 2026-08-18 05:44:54.177761 | mon1 | 2026-08-18 05:44:54.178426 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:44:54.178530 | mon1 | Tuesday 18 August 2026 05:44:54 +0000 (0:00:00.505) 0:05:29.537 ******** 2026-08-18 05:44:54.178543 | mon1 | 2026-08-18 05:44:54.178551 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:44:54.178557 | mon1 | Tuesday 18 August 2026 05:44:54 +0000 (0:00:00.005) 0:05:29.543 ******** 2026-08-18 05:44:54.528947 | mon1 | ok: [mon1] 2026-08-18 05:44:54.529022 | mon1 | 2026-08-18 05:44:54.529080 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:44:54.529222 | mon1 | Tuesday 18 August 2026 05:44:54 +0000 (0:00:00.351) 0:05:29.895 ******** 2026-08-18 05:44:54.722935 | mon1 | ok: [mon1] 2026-08-18 05:44:54.723021 | mon1 | 2026-08-18 05:44:54.723222 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:44:54.723278 | mon1 | Tuesday 18 August 2026 05:44:54 +0000 (0:00:00.194) 0:05:30.089 ******** 2026-08-18 05:44:54.777101 | mon1 | ok: [mon1] => { 2026-08-18 05:44:54.777185 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:44:54.777587 | mon1 | } 2026-08-18 05:44:54.777636 | mon1 | 2026-08-18 05:44:54.777641 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:44:54.777647 | mon1 | Tuesday 18 August 2026 05:44:54 +0000 (0:00:00.054) 0:05:30.143 ******** 2026-08-18 05:44:55.142116 | mon1 | ok: [mon1] 2026-08-18 05:44:55.142202 | mon1 | 2026-08-18 05:44:55.142231 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:44:55.142243 | mon1 | Tuesday 18 August 2026 05:44:55 +0000 (0:00:00.364) 0:05:30.508 ******** 2026-08-18 05:44:58.158714 | mon1 | ok: [mon1] 2026-08-18 05:44:58.158799 | mon1 | 2026-08-18 05:44:58.159095 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:44:58.159118 | mon1 | Tuesday 18 August 2026 05:44:58 +0000 (0:00:03.016) 0:05:33.524 ******** 2026-08-18 05:44:59.131361 | mon1 | ok: [mon1] 2026-08-18 05:44:59.131436 | mon1 | 2026-08-18 05:44:59.131655 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:44:59.131708 | mon1 | Tuesday 18 August 2026 05:44:59 +0000 (0:00:00.972) 0:05:34.497 ******** 2026-08-18 05:44:59.322582 | mon1 | ok: [mon1] 2026-08-18 05:44:59.322664 | mon1 | 2026-08-18 05:44:59.322684 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:44:59.323020 | mon1 | Tuesday 18 August 2026 05:44:59 +0000 (0:00:00.190) 0:05:34.688 ******** 2026-08-18 05:44:59.733160 | mon1 | ok: [mon1] 2026-08-18 05:44:59.733248 | mon1 | 2026-08-18 05:44:59.733550 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:44:59.733611 | mon1 | Tuesday 18 August 2026 05:44:59 +0000 (0:00:00.410) 0:05:35.099 ******** 2026-08-18 05:45:00.297841 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 05:45:00.297959 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:45:00.298492 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:45:00.298528 | mon1 | 2026-08-18 05:45:00.298540 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:45:00.298667 | mon1 | Tuesday 18 August 2026 05:45:00 +0000 (0:00:00.564) 0:05:35.663 ******** 2026-08-18 05:45:00.703528 | mon1 | ok: [mon1] 2026-08-18 05:45:00.703601 | mon1 | 2026-08-18 05:45:00.703863 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:45:00.703922 | mon1 | Tuesday 18 August 2026 05:45:00 +0000 (0:00:00.405) 0:05:36.069 ******** 2026-08-18 05:45:01.112026 | mon1 | ok: [mon1] 2026-08-18 05:45:01.112113 | mon1 | 2026-08-18 05:45:01.112126 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:45:01.112534 | mon1 | Tuesday 18 August 2026 05:45:01 +0000 (0:00:00.403) 0:05:36.472 ******** 2026-08-18 05:45:01.112591 | mon1 | 2026-08-18 05:45:01.112597 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:45:01.112607 | mon1 | Tuesday 18 August 2026 05:45:01 +0000 (0:00:00.005) 0:05:36.478 ******** 2026-08-18 05:45:01.444621 | mon1 | ok: [mon1] 2026-08-18 05:45:01.444695 | mon1 | 2026-08-18 05:45:01.444845 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:45:01.444862 | mon1 | Tuesday 18 August 2026 05:45:01 +0000 (0:00:00.332) 0:05:36.811 ******** 2026-08-18 05:45:01.484268 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:45:01.484394 | mon1 | 2026-08-18 05:45:01.484539 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:45:01.484690 | mon1 | Tuesday 18 August 2026 05:45:01 +0000 (0:00:00.039) 0:05:36.850 ******** 2026-08-18 05:45:02.493469 | mon1 | ok: [mon1] 2026-08-18 05:45:02.493556 | mon1 | 2026-08-18 05:45:02.493936 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:45:02.494008 | mon1 | Tuesday 18 August 2026 05:45:02 +0000 (0:00:01.008) 0:05:37.859 ******** 2026-08-18 05:45:03.150269 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 05:45:03.150365 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 05:45:03.150846 | mon1 | 2026-08-18 05:45:03.150907 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:45:03.150915 | mon1 | Tuesday 18 August 2026 05:45:03 +0000 (0:00:00.656) 0:05:38.516 ******** 2026-08-18 05:45:04.062734 | mon1 | ok: [mon1] 2026-08-18 05:45:04.062819 | mon1 | 2026-08-18 05:45:04.063182 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:45:04.063285 | mon1 | Tuesday 18 August 2026 05:45:04 +0000 (0:00:00.912) 0:05:39.428 ******** 2026-08-18 05:45:04.258901 | mon1 | ok: [mon1] 2026-08-18 05:45:04.258992 | mon1 | 2026-08-18 05:45:04.259013 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:45:04.259151 | mon1 | Tuesday 18 August 2026 05:45:04 +0000 (0:00:00.196) 0:05:39.625 ******** 2026-08-18 05:45:04.500948 | mon1 | ok: [mon1] 2026-08-18 05:45:04.501001 | mon1 | 2026-08-18 05:45:04.501007 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:45:04.501012 | mon1 | Tuesday 18 August 2026 05:45:04 +0000 (0:00:00.241) 0:05:39.867 ******** 2026-08-18 05:45:04.699308 | mon1 | ok: [mon1] 2026-08-18 05:45:04.699383 | mon1 | 2026-08-18 05:45:04.699472 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-18 05:45:04.699610 | mon1 | Tuesday 18 August 2026 05:45:04 +0000 (0:00:00.198) 0:05:40.065 ******** 2026-08-18 05:45:07.403398 | mon1 | changed: [mon1] 2026-08-18 05:45:07.403462 | mon1 | 2026-08-18 05:45:07.403563 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 05:45:07.403675 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-08-18 05:45:07.403785 | mon1 | osd1 : ok=58 changed=24 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-08-18 05:45:07.403878 | mon1 | 2026-08-18 05:45:07.403957 | mon1 | 2026-08-18 05:45:07.404053 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 05:45:07.404151 | mon1 | Tuesday 18 August 2026 05:45:07 +0000 (0:00:02.704) 0:05:42.770 ******** 2026-08-18 05:45:07.404240 | mon1 | =============================================================================== 2026-08-18 05:45:07.404336 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 87.03s 2026-08-18 05:45:07.404432 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 41.29s 2026-08-18 05:45:07.404537 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 39.41s 2026-08-18 05:45:07.404632 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 24.12s 2026-08-18 05:45:07.404725 | mon1 | vexxhost.containers.download_artifact : Download item ------------------ 16.63s 2026-08-18 05:45:07.404821 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.50s 2026-08-18 05:45:07.404918 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.82s 2026-08-18 05:45:07.405016 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.30s 2026-08-18 05:45:07.405111 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.11s 2026-08-18 05:45:07.405205 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.03s 2026-08-18 05:45:07.405299 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.47s 2026-08-18 05:45:07.405583 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.46s 2026-08-18 05:45:07.405685 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.41s 2026-08-18 05:45:07.405779 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.24s 2026-08-18 05:45:07.405873 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.02s 2026-08-18 05:45:07.405968 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.95s 2026-08-18 05:45:07.406064 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 2.88s 2026-08-18 05:45:07.406158 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 2.70s 2026-08-18 05:45:07.406255 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.65s 2026-08-18 05:45:07.406347 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.23s 2026-08-18 05:45:07.569731 | mon1 | INFO [default > converge] Executed: Successful 2026-08-18 05:45:07.579440 | mon1 | INFO [default > idempotence] Executing 2026-08-18 05:45:08.466495 | mon1 | 2026-08-18 05:45:08.466832 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 05:45:08.467061 | mon1 | 2026-08-18 05:45:08.467280 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:45:08.467491 | mon1 | Tuesday 18 August 2026 05:45:08 +0000 (0:00:00.047) 0:00:00.047 ******** 2026-08-18 05:45:09.615680 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 05:45:09.616385 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:45:09.616402 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:45:09.616432 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:45:09.616652 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:45:09.627046 | mon1 | ok: [mon1] 2026-08-18 05:45:09.627231 | mon1 | 2026-08-18 05:45:09.627443 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:45:09.627649 | mon1 | Tuesday 18 August 2026 05:45:09 +0000 (0:00:01.160) 0:00:01.208 ******** 2026-08-18 05:45:09.911771 | mon1 | ok: [mon1] 2026-08-18 05:45:09.911870 | mon1 | 2026-08-18 05:45:09.911968 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:09.912094 | mon1 | Tuesday 18 August 2026 05:45:09 +0000 (0:00:00.284) 0:00:01.492 ******** 2026-08-18 05:45:09.944596 | mon1 | skipping: [mon1] 2026-08-18 05:45:09.944708 | mon1 | 2026-08-18 05:45:09.944844 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:45:09.944975 | mon1 | Tuesday 18 August 2026 05:45:09 +0000 (0:00:00.032) 0:00:01.525 ******** 2026-08-18 05:45:10.251415 | mon1 | ok: [mon1] 2026-08-18 05:45:10.251579 | mon1 | 2026-08-18 05:45:10.251813 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:45:10.252038 | mon1 | Tuesday 18 August 2026 05:45:10 +0000 (0:00:00.306) 0:00:01.832 ******** 2026-08-18 05:45:10.318268 | mon1 | ok: [mon1] => { 2026-08-18 05:45:10.318455 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:45:10.318700 | mon1 | } 2026-08-18 05:45:10.318890 | mon1 | 2026-08-18 05:45:10.319103 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:45:10.319309 | mon1 | Tuesday 18 August 2026 05:45:10 +0000 (0:00:00.066) 0:00:01.899 ******** 2026-08-18 05:45:10.756831 | mon1 | ok: [mon1] 2026-08-18 05:45:10.756902 | mon1 | 2026-08-18 05:45:10.756916 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:45:10.756938 | mon1 | Tuesday 18 August 2026 05:45:10 +0000 (0:00:00.437) 0:00:02.336 ******** 2026-08-18 05:45:10.793443 | mon1 | skipping: [mon1] 2026-08-18 05:45:10.793489 | mon1 | 2026-08-18 05:45:10.793603 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:10.793695 | mon1 | Tuesday 18 August 2026 05:45:10 +0000 (0:00:00.038) 0:00:02.374 ******** 2026-08-18 05:45:10.832050 | mon1 | skipping: [mon1] 2026-08-18 05:45:10.832090 | mon1 | 2026-08-18 05:45:10.832189 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:45:10.832277 | mon1 | Tuesday 18 August 2026 05:45:10 +0000 (0:00:00.038) 0:00:02.413 ******** 2026-08-18 05:45:11.024649 | mon1 | ok: [mon1] 2026-08-18 05:45:11.024724 | mon1 | 2026-08-18 05:45:11.024882 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:11.024899 | mon1 | Tuesday 18 August 2026 05:45:11 +0000 (0:00:00.192) 0:00:02.605 ******** 2026-08-18 05:45:12.148023 | mon1 | ok: [mon1] 2026-08-18 05:45:12.148086 | mon1 | 2026-08-18 05:45:12.148223 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:45:12.148417 | mon1 | Tuesday 18 August 2026 05:45:12 +0000 (0:00:01.123) 0:00:03.729 ******** 2026-08-18 05:45:12.222883 | mon1 | ok: [mon1] => { 2026-08-18 05:45:12.222935 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:45:12.222946 | mon1 | } 2026-08-18 05:45:12.222957 | mon1 | 2026-08-18 05:45:12.222974 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:45:12.222984 | mon1 | Tuesday 18 August 2026 05:45:12 +0000 (0:00:00.073) 0:00:03.802 ******** 2026-08-18 05:45:12.560714 | mon1 | ok: [mon1] 2026-08-18 05:45:12.560810 | mon1 | 2026-08-18 05:45:12.560830 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:45:12.560844 | mon1 | Tuesday 18 August 2026 05:45:12 +0000 (0:00:00.337) 0:00:04.140 ******** 2026-08-18 05:45:14.760118 | mon1 | ok: [mon1] 2026-08-18 05:45:14.760205 | mon1 | 2026-08-18 05:45:14.760218 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:45:14.760230 | mon1 | Tuesday 18 August 2026 05:45:14 +0000 (0:00:02.199) 0:00:06.340 ******** 2026-08-18 05:45:14.793162 | mon1 | skipping: [mon1] 2026-08-18 05:45:14.793195 | mon1 | 2026-08-18 05:45:14.793206 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:45:14.793216 | mon1 | Tuesday 18 August 2026 05:45:14 +0000 (0:00:00.033) 0:00:06.373 ******** 2026-08-18 05:45:14.823584 | mon1 | skipping: [mon1] 2026-08-18 05:45:14.823621 | mon1 | 2026-08-18 05:45:14.823632 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:45:14.823643 | mon1 | Tuesday 18 August 2026 05:45:14 +0000 (0:00:00.030) 0:00:06.403 ******** 2026-08-18 05:45:14.853726 | mon1 | skipping: [mon1] 2026-08-18 05:45:14.853757 | mon1 | 2026-08-18 05:45:14.853767 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:45:14.853777 | mon1 | Tuesday 18 August 2026 05:45:14 +0000 (0:00:00.030) 0:00:06.434 ******** 2026-08-18 05:45:16.162531 | mon1 | ok: [mon1] 2026-08-18 05:45:16.162610 | mon1 | 2026-08-18 05:45:16.162622 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:45:16.162661 | mon1 | Tuesday 18 August 2026 05:45:16 +0000 (0:00:01.308) 0:00:07.742 ******** 2026-08-18 05:45:16.594545 | mon1 | ok: [mon1] 2026-08-18 05:45:16.594623 | mon1 | 2026-08-18 05:45:16.594637 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:45:16.594745 | mon1 | Tuesday 18 August 2026 05:45:16 +0000 (0:00:00.433) 0:00:08.175 ******** 2026-08-18 05:45:17.539311 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:45:17.539394 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:45:17.539411 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:45:17.539960 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:45:17.540023 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:45:17.540029 | mon1 | 2026-08-18 05:45:17.540035 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:45:17.540040 | mon1 | Tuesday 18 August 2026 05:45:17 +0000 (0:00:00.944) 0:00:09.120 ******** 2026-08-18 05:45:18.126049 | mon1 | ok: [mon1] 2026-08-18 05:45:18.126121 | mon1 | 2026-08-18 05:45:18.126486 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:45:18.126529 | mon1 | Tuesday 18 August 2026 05:45:18 +0000 (0:00:00.580) 0:00:09.700 ******** 2026-08-18 05:45:18.126545 | mon1 | 2026-08-18 05:45:18.126563 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:45:18.126579 | mon1 | Tuesday 18 August 2026 05:45:18 +0000 (0:00:00.006) 0:00:09.707 ******** 2026-08-18 05:45:18.726421 | mon1 | ok: [mon1] 2026-08-18 05:45:18.726478 | mon1 | 2026-08-18 05:45:18.726483 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:45:18.726489 | mon1 | Tuesday 18 August 2026 05:45:18 +0000 (0:00:00.599) 0:00:10.307 ******** 2026-08-18 05:45:18.932649 | mon1 | ok: [mon1] 2026-08-18 05:45:18.932722 | mon1 | 2026-08-18 05:45:18.932965 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:45:18.933035 | mon1 | Tuesday 18 August 2026 05:45:18 +0000 (0:00:00.206) 0:00:10.513 ******** 2026-08-18 05:45:19.001472 | mon1 | ok: [mon1] => { 2026-08-18 05:45:19.002033 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:45:19.002101 | mon1 | } 2026-08-18 05:45:19.002108 | mon1 | 2026-08-18 05:45:19.002113 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:45:19.002119 | mon1 | Tuesday 18 August 2026 05:45:19 +0000 (0:00:00.068) 0:00:10.582 ******** 2026-08-18 05:45:19.352818 | mon1 | ok: [mon1] 2026-08-18 05:45:19.352906 | mon1 | 2026-08-18 05:45:19.352966 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:45:19.353132 | mon1 | Tuesday 18 August 2026 05:45:19 +0000 (0:00:00.351) 0:00:10.933 ******** 2026-08-18 05:45:22.411430 | mon1 | ok: [mon1] 2026-08-18 05:45:22.411525 | mon1 | 2026-08-18 05:45:22.411540 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:45:22.411714 | mon1 | Tuesday 18 August 2026 05:45:22 +0000 (0:00:03.059) 0:00:13.992 ******** 2026-08-18 05:45:23.934783 | mon1 | ok: [mon1] 2026-08-18 05:45:23.934869 | mon1 | 2026-08-18 05:45:23.934928 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:45:23.935098 | mon1 | Tuesday 18 August 2026 05:45:23 +0000 (0:00:01.522) 0:00:15.515 ******** 2026-08-18 05:45:24.245148 | mon1 | ok: [mon1] 2026-08-18 05:45:24.245249 | mon1 | 2026-08-18 05:45:24.245262 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:45:24.245436 | mon1 | Tuesday 18 August 2026 05:45:24 +0000 (0:00:00.310) 0:00:15.826 ******** 2026-08-18 05:45:24.717803 | mon1 | ok: [mon1] 2026-08-18 05:45:24.717890 | mon1 | 2026-08-18 05:45:24.718175 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:45:24.718272 | mon1 | Tuesday 18 August 2026 05:45:24 +0000 (0:00:00.472) 0:00:16.298 ******** 2026-08-18 05:45:25.291392 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 05:45:25.292017 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:45:25.292038 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:45:25.292045 | mon1 | 2026-08-18 05:45:25.292052 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:45:25.292058 | mon1 | Tuesday 18 August 2026 05:45:25 +0000 (0:00:00.574) 0:00:16.872 ******** 2026-08-18 05:45:25.732642 | mon1 | ok: [mon1] 2026-08-18 05:45:25.732724 | mon1 | 2026-08-18 05:45:25.732969 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:45:25.733037 | mon1 | Tuesday 18 August 2026 05:45:25 +0000 (0:00:00.440) 0:00:17.313 ******** 2026-08-18 05:45:26.176088 | mon1 | ok: [mon1] 2026-08-18 05:45:26.176160 | mon1 | 2026-08-18 05:45:26.176167 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:45:26.176174 | mon1 | Tuesday 18 August 2026 05:45:26 +0000 (0:00:00.436) 0:00:17.749 ******** 2026-08-18 05:45:26.176181 | mon1 | 2026-08-18 05:45:26.176187 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:45:26.176193 | mon1 | Tuesday 18 August 2026 05:45:26 +0000 (0:00:00.006) 0:00:17.755 ******** 2026-08-18 05:45:26.546369 | mon1 | ok: [mon1] 2026-08-18 05:45:26.546717 | mon1 | 2026-08-18 05:45:26.546732 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:45:26.546743 | mon1 | Tuesday 18 August 2026 05:45:26 +0000 (0:00:00.370) 0:00:18.126 ******** 2026-08-18 05:45:26.589565 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:45:26.589660 | mon1 | 2026-08-18 05:45:26.589682 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:45:26.589694 | mon1 | Tuesday 18 August 2026 05:45:26 +0000 (0:00:00.044) 0:00:18.171 ******** 2026-08-18 05:45:27.597742 | mon1 | ok: [mon1] 2026-08-18 05:45:27.597844 | mon1 | 2026-08-18 05:45:27.597858 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:45:27.598008 | mon1 | Tuesday 18 August 2026 05:45:27 +0000 (0:00:01.007) 0:00:19.179 ******** 2026-08-18 05:45:28.243145 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 05:45:28.243223 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 05:45:28.243568 | mon1 | 2026-08-18 05:45:28.243636 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:45:28.243642 | mon1 | Tuesday 18 August 2026 05:45:28 +0000 (0:00:00.645) 0:00:19.824 ******** 2026-08-18 05:45:29.176627 | mon1 | ok: [mon1] 2026-08-18 05:45:29.176704 | mon1 | 2026-08-18 05:45:29.177017 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:45:29.177074 | mon1 | Tuesday 18 August 2026 05:45:29 +0000 (0:00:00.933) 0:00:20.757 ******** 2026-08-18 05:45:29.379978 | mon1 | ok: [mon1] 2026-08-18 05:45:29.380057 | mon1 | 2026-08-18 05:45:29.380272 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:45:29.380317 | mon1 | Tuesday 18 August 2026 05:45:29 +0000 (0:00:00.203) 0:00:20.961 ******** 2026-08-18 05:45:29.768896 | mon1 | ok: [mon1] 2026-08-18 05:45:29.768963 | mon1 | 2026-08-18 05:45:29.769098 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:45:29.769247 | mon1 | Tuesday 18 August 2026 05:45:29 +0000 (0:00:00.389) 0:00:21.350 ******** 2026-08-18 05:45:30.111346 | mon1 | ok: [mon1] 2026-08-18 05:45:30.111437 | mon1 | 2026-08-18 05:45:30.111503 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-18 05:45:30.111647 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.341) 0:00:21.692 ******** 2026-08-18 05:45:30.228647 | mon1 | ok: [mon1] 2026-08-18 05:45:30.228754 | mon1 | 2026-08-18 05:45:30.228826 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-18 05:45:30.229019 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.117) 0:00:21.809 ******** 2026-08-18 05:45:30.513497 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 05:45:30.513576 | mon1 | 2026-08-18 05:45:30.513770 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-18 05:45:30.513832 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.285) 0:00:22.094 ******** 2026-08-18 05:45:30.559424 | mon1 | ok: [mon1] 2026-08-18 05:45:30.559507 | mon1 | 2026-08-18 05:45:30.559738 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-18 05:45:30.559801 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.045) 0:00:22.140 ******** 2026-08-18 05:45:30.595619 | mon1 | skipping: [mon1] 2026-08-18 05:45:30.595684 | mon1 | 2026-08-18 05:45:30.595753 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:45:30.595850 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.036) 0:00:22.177 ******** 2026-08-18 05:45:30.659288 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-18 05:45:30.659346 | mon1 | 2026-08-18 05:45:30.659417 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:45:30.659507 | mon1 | Tuesday 18 August 2026 05:45:30 +0000 (0:00:00.063) 0:00:22.240 ******** 2026-08-18 05:45:32.368455 | mon1 | ok: [mon1] 2026-08-18 05:45:32.368555 | mon1 | 2026-08-18 05:45:32.368619 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:45:32.368763 | mon1 | Tuesday 18 August 2026 05:45:32 +0000 (0:00:01.708) 0:00:23.949 ******** 2026-08-18 05:45:32.419716 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 05:45:32.420111 | mon1 | 2026-08-18 05:45:32.420144 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:45:32.420150 | mon1 | Tuesday 18 August 2026 05:45:32 +0000 (0:00:00.051) 0:00:24.000 ******** 2026-08-18 05:45:32.787104 | mon1 | ok: [mon1] 2026-08-18 05:45:32.787196 | mon1 | 2026-08-18 05:45:32.787567 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:45:32.787625 | mon1 | Tuesday 18 August 2026 05:45:32 +0000 (0:00:00.367) 0:00:24.368 ******** 2026-08-18 05:45:35.041576 | mon1 | ok: [mon1] 2026-08-18 05:45:35.041661 | mon1 | 2026-08-18 05:45:35.041719 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-18 05:45:35.041852 | mon1 | Tuesday 18 August 2026 05:45:35 +0000 (0:00:02.254) 0:00:26.622 ******** 2026-08-18 05:45:36.637712 | mon1 | ok: [mon1] 2026-08-18 05:45:36.637768 | mon1 | 2026-08-18 05:45:36.637774 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-18 05:45:36.637779 | mon1 | Tuesday 18 August 2026 05:45:36 +0000 (0:00:01.595) 0:00:28.218 ******** 2026-08-18 05:45:38.336698 | mon1 | ok: [mon1] 2026-08-18 05:45:38.336806 | mon1 | 2026-08-18 05:45:38.336819 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:45:38.336973 | mon1 | Tuesday 18 August 2026 05:45:38 +0000 (0:00:01.699) 0:00:29.917 ******** 2026-08-18 05:45:38.397678 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-18 05:45:38.397753 | mon1 | 2026-08-18 05:45:38.397968 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:45:38.398030 | mon1 | Tuesday 18 August 2026 05:45:38 +0000 (0:00:00.060) 0:00:29.978 ******** 2026-08-18 05:45:38.446935 | mon1 | skipping: [mon1] 2026-08-18 05:45:38.447019 | mon1 | 2026-08-18 05:45:38.447279 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:45:38.447339 | mon1 | Tuesday 18 August 2026 05:45:38 +0000 (0:00:00.049) 0:00:30.027 ******** 2026-08-18 05:45:38.487695 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 05:45:38.487751 | mon1 | skipping: [mon1] 2026-08-18 05:45:38.488069 | mon1 | 2026-08-18 05:45:38.488130 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:45:38.488136 | mon1 | Tuesday 18 August 2026 05:45:38 +0000 (0:00:00.040) 0:00:30.068 ******** 2026-08-18 05:45:38.744042 | mon1 | ok: [mon1] 2026-08-18 05:45:38.744108 | mon1 | 2026-08-18 05:45:38.744383 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:45:38.744456 | mon1 | Tuesday 18 August 2026 05:45:38 +0000 (0:00:00.255) 0:00:30.324 ******** 2026-08-18 05:45:41.037752 | mon1 | ok: [mon1] 2026-08-18 05:45:41.037847 | mon1 | 2026-08-18 05:45:41.037903 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-18 05:45:41.038046 | mon1 | Tuesday 18 August 2026 05:45:41 +0000 (0:00:02.294) 0:00:32.618 ******** 2026-08-18 05:45:42.513808 | mon1 | ok: [mon1] 2026-08-18 05:45:42.513898 | mon1 | 2026-08-18 05:45:42.514104 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-18 05:45:42.514157 | mon1 | Tuesday 18 August 2026 05:45:42 +0000 (0:00:01.476) 0:00:34.095 ******** 2026-08-18 05:45:44.079818 | mon1 | ok: [mon1] 2026-08-18 05:45:44.079910 | mon1 | 2026-08-18 05:45:44.079969 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-18 05:45:44.080092 | mon1 | Tuesday 18 August 2026 05:45:44 +0000 (0:00:01.566) 0:00:35.661 ******** 2026-08-18 05:45:52.568593 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 05:45:52.568679 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 05:45:52.568759 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 05:45:52.568854 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 05:45:52.568936 | mon1 | 2026-08-18 05:45:52.569029 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 05:45:52.569105 | mon1 | 2026-08-18 05:45:52.569198 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:45:52.569289 | mon1 | Tuesday 18 August 2026 05:45:52 +0000 (0:00:08.488) 0:00:44.149 ******** 2026-08-18 05:45:53.664711 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 05:45:53.664879 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:45:53.665101 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:45:53.665322 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:45:53.665539 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:45:53.675578 | mon1 | ok: [osd1] 2026-08-18 05:45:53.675739 | mon1 | 2026-08-18 05:45:53.675940 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:45:53.676142 | mon1 | Tuesday 18 August 2026 05:45:53 +0000 (0:00:01.106) 0:00:45.256 ******** 2026-08-18 05:45:53.871422 | mon1 | ok: [osd1] 2026-08-18 05:45:53.871510 | mon1 | 2026-08-18 05:45:53.871792 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:53.872003 | mon1 | Tuesday 18 August 2026 05:45:53 +0000 (0:00:00.195) 0:00:45.452 ******** 2026-08-18 05:45:53.905799 | mon1 | skipping: [osd1] 2026-08-18 05:45:53.905950 | mon1 | 2026-08-18 05:45:53.906163 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:45:53.906369 | mon1 | Tuesday 18 August 2026 05:45:53 +0000 (0:00:00.034) 0:00:45.487 ******** 2026-08-18 05:45:54.105248 | mon1 | ok: [osd1] 2026-08-18 05:45:54.105380 | mon1 | 2026-08-18 05:45:54.105613 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:45:54.105887 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.199) 0:00:45.686 ******** 2026-08-18 05:45:54.170812 | mon1 | ok: [osd1] => { 2026-08-18 05:45:54.170976 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:45:54.171167 | mon1 | } 2026-08-18 05:45:54.171348 | mon1 | 2026-08-18 05:45:54.171558 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:45:54.171761 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.065) 0:00:45.751 ******** 2026-08-18 05:45:54.473902 | mon1 | ok: [osd1] 2026-08-18 05:45:54.474071 | mon1 | 2026-08-18 05:45:54.474353 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:45:54.474709 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.302) 0:00:46.054 ******** 2026-08-18 05:45:54.510074 | mon1 | skipping: [osd1] 2026-08-18 05:45:54.510203 | mon1 | 2026-08-18 05:45:54.510431 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:54.510665 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.036) 0:00:46.091 ******** 2026-08-18 05:45:54.548742 | mon1 | skipping: [osd1] 2026-08-18 05:45:54.548787 | mon1 | 2026-08-18 05:45:54.549011 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:45:54.549208 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.038) 0:00:46.129 ******** 2026-08-18 05:45:54.745543 | mon1 | ok: [osd1] 2026-08-18 05:45:54.745626 | mon1 | 2026-08-18 05:45:54.745638 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:45:54.745648 | mon1 | Tuesday 18 August 2026 05:45:54 +0000 (0:00:00.195) 0:00:46.325 ******** 2026-08-18 05:45:55.874972 | mon1 | ok: [osd1] 2026-08-18 05:45:55.875027 | mon1 | 2026-08-18 05:45:55.875033 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:45:55.875038 | mon1 | Tuesday 18 August 2026 05:45:55 +0000 (0:00:01.130) 0:00:47.456 ******** 2026-08-18 05:45:55.939536 | mon1 | ok: [osd1] => { 2026-08-18 05:45:55.940051 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:45:55.940105 | mon1 | } 2026-08-18 05:45:55.940111 | mon1 | 2026-08-18 05:45:55.940116 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:45:55.940121 | mon1 | Tuesday 18 August 2026 05:45:55 +0000 (0:00:00.064) 0:00:47.520 ******** 2026-08-18 05:45:56.290859 | mon1 | ok: [osd1] 2026-08-18 05:45:56.290941 | mon1 | 2026-08-18 05:45:56.291000 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:45:56.291133 | mon1 | Tuesday 18 August 2026 05:45:56 +0000 (0:00:00.351) 0:00:47.871 ******** 2026-08-18 05:45:58.188673 | mon1 | ok: [osd1] 2026-08-18 05:45:58.188755 | mon1 | 2026-08-18 05:45:58.188957 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:45:58.188976 | mon1 | Tuesday 18 August 2026 05:45:58 +0000 (0:00:01.897) 0:00:49.769 ******** 2026-08-18 05:45:58.212325 | mon1 | skipping: [osd1] 2026-08-18 05:45:58.212386 | mon1 | 2026-08-18 05:45:58.212511 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:45:58.212620 | mon1 | Tuesday 18 August 2026 05:45:58 +0000 (0:00:00.024) 0:00:49.793 ******** 2026-08-18 05:45:58.245312 | mon1 | skipping: [osd1] 2026-08-18 05:45:58.245631 | mon1 | 2026-08-18 05:45:58.245688 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:45:58.245694 | mon1 | Tuesday 18 August 2026 05:45:58 +0000 (0:00:00.032) 0:00:49.826 ******** 2026-08-18 05:45:58.267847 | mon1 | skipping: [osd1] 2026-08-18 05:45:58.267978 | mon1 | 2026-08-18 05:45:58.268269 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:45:58.268294 | mon1 | Tuesday 18 August 2026 05:45:58 +0000 (0:00:00.022) 0:00:49.848 ******** 2026-08-18 05:45:59.392672 | mon1 | ok: [osd1] 2026-08-18 05:45:59.392775 | mon1 | 2026-08-18 05:45:59.392843 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:45:59.393043 | mon1 | Tuesday 18 August 2026 05:45:59 +0000 (0:00:01.124) 0:00:50.973 ******** 2026-08-18 05:45:59.800740 | mon1 | ok: [osd1] 2026-08-18 05:45:59.800849 | mon1 | 2026-08-18 05:45:59.800873 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:45:59.800886 | mon1 | Tuesday 18 August 2026 05:45:59 +0000 (0:00:00.408) 0:00:51.381 ******** 2026-08-18 05:46:00.685054 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:46:00.685158 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:46:00.685227 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:46:00.685920 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:46:00.686008 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:46:00.686020 | mon1 | 2026-08-18 05:46:00.686029 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:46:00.686037 | mon1 | Tuesday 18 August 2026 05:46:00 +0000 (0:00:00.884) 0:00:52.266 ******** 2026-08-18 05:46:01.196722 | mon1 | ok: [osd1] 2026-08-18 05:46:01.196802 | mon1 | 2026-08-18 05:46:01.196817 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:46:01.197252 | mon1 | Tuesday 18 August 2026 05:46:01 +0000 (0:00:00.504) 0:00:52.770 ******** 2026-08-18 05:46:01.197308 | mon1 | 2026-08-18 05:46:01.197314 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:46:01.197319 | mon1 | Tuesday 18 August 2026 05:46:01 +0000 (0:00:00.007) 0:00:52.777 ******** 2026-08-18 05:46:01.558109 | mon1 | ok: [osd1] 2026-08-18 05:46:01.558201 | mon1 | 2026-08-18 05:46:01.558216 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:46:01.558417 | mon1 | Tuesday 18 August 2026 05:46:01 +0000 (0:00:00.360) 0:00:53.138 ******** 2026-08-18 05:46:01.761827 | mon1 | ok: [osd1] 2026-08-18 05:46:01.761927 | mon1 | 2026-08-18 05:46:01.761936 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:46:01.762069 | mon1 | Tuesday 18 August 2026 05:46:01 +0000 (0:00:00.203) 0:00:53.342 ******** 2026-08-18 05:46:01.839334 | mon1 | ok: [osd1] => { 2026-08-18 05:46:01.839383 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:46:01.839392 | mon1 | } 2026-08-18 05:46:01.839399 | mon1 | 2026-08-18 05:46:01.839405 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:46:01.839412 | mon1 | Tuesday 18 August 2026 05:46:01 +0000 (0:00:00.076) 0:00:53.419 ******** 2026-08-18 05:46:02.187635 | mon1 | ok: [osd1] 2026-08-18 05:46:02.187753 | mon1 | 2026-08-18 05:46:02.187766 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:46:02.187833 | mon1 | Tuesday 18 August 2026 05:46:02 +0000 (0:00:00.349) 0:00:53.768 ******** 2026-08-18 05:46:05.265932 | mon1 | ok: [osd1] 2026-08-18 05:46:05.266056 | mon1 | 2026-08-18 05:46:05.266069 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:46:05.266085 | mon1 | Tuesday 18 August 2026 05:46:05 +0000 (0:00:03.078) 0:00:56.847 ******** 2026-08-18 05:46:06.398245 | mon1 | ok: [osd1] 2026-08-18 05:46:06.398356 | mon1 | 2026-08-18 05:46:06.398866 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:46:06.398947 | mon1 | Tuesday 18 August 2026 05:46:06 +0000 (0:00:01.131) 0:00:57.978 ******** 2026-08-18 05:46:06.586772 | mon1 | ok: [osd1] 2026-08-18 05:46:06.586861 | mon1 | 2026-08-18 05:46:06.586874 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:46:06.586998 | mon1 | Tuesday 18 August 2026 05:46:06 +0000 (0:00:00.189) 0:00:58.167 ******** 2026-08-18 05:46:06.998364 | mon1 | ok: [osd1] 2026-08-18 05:46:06.998499 | mon1 | 2026-08-18 05:46:06.998512 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:46:06.998692 | mon1 | Tuesday 18 August 2026 05:46:06 +0000 (0:00:00.411) 0:00:58.579 ******** 2026-08-18 05:46:07.531268 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 05:46:07.531365 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:46:07.531679 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:46:07.531759 | mon1 | 2026-08-18 05:46:07.531779 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:46:07.531857 | mon1 | Tuesday 18 August 2026 05:46:07 +0000 (0:00:00.532) 0:00:59.112 ******** 2026-08-18 05:46:07.955475 | mon1 | ok: [osd1] 2026-08-18 05:46:07.955574 | mon1 | 2026-08-18 05:46:07.955591 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:46:07.955690 | mon1 | Tuesday 18 August 2026 05:46:07 +0000 (0:00:00.424) 0:00:59.536 ******** 2026-08-18 05:46:08.377291 | mon1 | ok: [osd1] 2026-08-18 05:46:08.377375 | mon1 | 2026-08-18 05:46:08.377388 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:46:08.377721 | mon1 | Tuesday 18 August 2026 05:46:08 +0000 (0:00:00.415) 0:00:59.951 ******** 2026-08-18 05:46:08.377739 | mon1 | 2026-08-18 05:46:08.377744 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:46:08.377749 | mon1 | Tuesday 18 August 2026 05:46:08 +0000 (0:00:00.006) 0:00:59.958 ******** 2026-08-18 05:46:08.733932 | mon1 | ok: [osd1] 2026-08-18 05:46:08.734012 | mon1 | 2026-08-18 05:46:08.734024 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:46:08.734120 | mon1 | Tuesday 18 August 2026 05:46:08 +0000 (0:00:00.356) 0:01:00.314 ******** 2026-08-18 05:46:08.770953 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:46:08.771017 | mon1 | 2026-08-18 05:46:08.771264 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:46:08.771320 | mon1 | Tuesday 18 August 2026 05:46:08 +0000 (0:00:00.037) 0:01:00.352 ******** 2026-08-18 05:46:09.840562 | mon1 | ok: [osd1] 2026-08-18 05:46:09.840653 | mon1 | 2026-08-18 05:46:09.840666 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:46:09.840772 | mon1 | Tuesday 18 August 2026 05:46:09 +0000 (0:00:01.069) 0:01:01.421 ******** 2026-08-18 05:46:10.459082 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-18 05:46:10.459184 | mon1 | ok: [osd1] => (item=sshd) 2026-08-18 05:46:10.459198 | mon1 | 2026-08-18 05:46:10.459553 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:46:10.459620 | mon1 | Tuesday 18 August 2026 05:46:10 +0000 (0:00:00.618) 0:01:02.040 ******** 2026-08-18 05:46:11.437827 | mon1 | ok: [osd1] 2026-08-18 05:46:11.437917 | mon1 | 2026-08-18 05:46:11.438183 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:46:11.438244 | mon1 | Tuesday 18 August 2026 05:46:11 +0000 (0:00:00.978) 0:01:03.018 ******** 2026-08-18 05:46:11.631036 | mon1 | ok: [osd1] 2026-08-18 05:46:11.631107 | mon1 | 2026-08-18 05:46:11.631159 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:46:11.631303 | mon1 | Tuesday 18 August 2026 05:46:11 +0000 (0:00:00.193) 0:01:03.212 ******** 2026-08-18 05:46:11.865699 | mon1 | ok: [osd1] 2026-08-18 05:46:11.865808 | mon1 | 2026-08-18 05:46:11.865887 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:46:11.866044 | mon1 | Tuesday 18 August 2026 05:46:11 +0000 (0:00:00.234) 0:01:03.446 ******** 2026-08-18 05:46:12.066622 | mon1 | ok: [osd1] 2026-08-18 05:46:12.066708 | mon1 | 2026-08-18 05:46:12.066760 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-18 05:46:12.066886 | mon1 | Tuesday 18 August 2026 05:46:12 +0000 (0:00:00.201) 0:01:03.647 ******** 2026-08-18 05:46:12.303504 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-18 05:46:12.303591 | mon1 | 2026-08-18 05:46:12.303609 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-18 05:46:12.303767 | mon1 | Tuesday 18 August 2026 05:46:12 +0000 (0:00:00.236) 0:01:03.884 ******** 2026-08-18 05:46:12.353466 | mon1 | ok: [osd1] 2026-08-18 05:46:12.353780 | mon1 | 2026-08-18 05:46:12.353833 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-18 05:46:12.353839 | mon1 | Tuesday 18 August 2026 05:46:12 +0000 (0:00:00.049) 0:01:03.934 ******** 2026-08-18 05:46:12.408761 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-18 05:46:12.408808 | mon1 | 2026-08-18 05:46:12.408913 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-18 05:46:12.408999 | mon1 | Tuesday 18 August 2026 05:46:12 +0000 (0:00:00.055) 0:01:03.990 ******** 2026-08-18 05:46:14.016049 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:46:14.016138 | mon1 | 2026-08-18 05:46:14.016488 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-18 05:46:14.016555 | mon1 | Tuesday 18 August 2026 05:46:14 +0000 (0:00:01.606) 0:01:05.596 ******** 2026-08-18 05:46:14.064205 | mon1 | ok: [osd1] => (item=osd1) 2026-08-18 05:46:14.065009 | mon1 | 2026-08-18 05:46:14.065075 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-18 05:46:14.065088 | mon1 | Tuesday 18 August 2026 05:46:14 +0000 (0:00:00.048) 0:01:05.644 ******** 2026-08-18 05:46:14.323369 | mon1 | ok: [osd1] 2026-08-18 05:46:14.323467 | mon1 | 2026-08-18 05:46:14.323480 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-18 05:46:14.323597 | mon1 | Tuesday 18 August 2026 05:46:14 +0000 (0:00:00.259) 0:01:05.904 ******** 2026-08-18 05:46:16.518088 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:46:16.518174 | mon1 | 2026-08-18 05:46:16.518218 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-18 05:46:16.518314 | mon1 | Tuesday 18 August 2026 05:46:16 +0000 (0:00:02.194) 0:01:08.098 ******** 2026-08-18 05:46:22.133012 | mon1 | ok: [osd1] 2026-08-18 05:46:22.133097 | mon1 | 2026-08-18 05:46:22.133157 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-18 05:46:22.133236 | mon1 | Tuesday 18 August 2026 05:46:22 +0000 (0:00:05.615) 0:01:13.714 ******** 2026-08-18 05:46:23.514299 | mon1 | ok: [osd1] 2026-08-18 05:46:23.514863 | mon1 | 2026-08-18 05:46:23.514890 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-18 05:46:23.514898 | mon1 | Tuesday 18 August 2026 05:46:23 +0000 (0:00:01.380) 0:01:15.095 ******** 2026-08-18 05:46:23.592994 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 05:46:23.593885 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 05:46:23.593968 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 05:46:23.593978 | mon1 | skipping: [osd1] 2026-08-18 05:46:23.593989 | mon1 | 2026-08-18 05:46:23.594008 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-18 05:46:23.594018 | mon1 | Tuesday 18 August 2026 05:46:23 +0000 (0:00:00.078) 0:01:15.173 ******** 2026-08-18 05:46:25.442981 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:46:25.443049 | mon1 | 2026-08-18 05:46:25.443055 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-18 05:46:25.443066 | mon1 | Tuesday 18 August 2026 05:46:25 +0000 (0:00:01.850) 0:01:17.023 ******** 2026-08-18 05:46:27.166195 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:46:27.166264 | mon1 | 2026-08-18 05:46:27.166271 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-18 05:46:27.166277 | mon1 | Tuesday 18 August 2026 05:46:27 +0000 (0:00:01.723) 0:01:18.746 ******** 2026-08-18 05:46:27.225447 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-18 05:46:27.225492 | mon1 | 2026-08-18 05:46:27.225760 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-18 05:46:27.225822 | mon1 | Tuesday 18 August 2026 05:46:27 +0000 (0:00:00.059) 0:01:18.806 ******** 2026-08-18 05:46:27.264082 | mon1 | ok: [osd1] 2026-08-18 05:46:27.264444 | mon1 | 2026-08-18 05:46:27.264511 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-18 05:46:27.264519 | mon1 | Tuesday 18 August 2026 05:46:27 +0000 (0:00:00.038) 0:01:18.845 ******** 2026-08-18 05:46:28.894451 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 05:46:28.894509 | mon1 | 2026-08-18 05:46:28.894515 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-18 05:46:28.894520 | mon1 | Tuesday 18 August 2026 05:46:28 +0000 (0:00:01.630) 0:01:20.475 ******** 2026-08-18 05:46:28.936769 | mon1 | ok: [osd1] 2026-08-18 05:46:28.936868 | mon1 | 2026-08-18 05:46:28.937219 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-18 05:46:28.937293 | mon1 | Tuesday 18 August 2026 05:46:28 +0000 (0:00:00.041) 0:01:20.517 ******** 2026-08-18 05:46:28.983988 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:46:28.984693 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:46:28.984768 | mon1 | skipping: [osd1] => (item=1) 2026-08-18 05:46:28.984774 | mon1 | skipping: [osd1] 2026-08-18 05:46:28.984780 | mon1 | 2026-08-18 05:46:28.984785 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-18 05:46:28.984791 | mon1 | Tuesday 18 August 2026 05:46:28 +0000 (0:00:00.047) 0:01:20.564 ******** 2026-08-18 05:46:29.061065 | mon1 | skipping: [osd1] 2026-08-18 05:46:29.061111 | mon1 | 2026-08-18 05:46:29.061510 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-18 05:46:29.061569 | mon1 | 2026-08-18 05:46:29.061575 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:46:29.061580 | mon1 | Tuesday 18 August 2026 05:46:29 +0000 (0:00:00.077) 0:01:20.642 ******** 2026-08-18 05:46:29.940961 | mon1 | ok: [mon1] 2026-08-18 05:46:29.941036 | mon1 | 2026-08-18 05:46:29.941325 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:46:29.941399 | mon1 | Tuesday 18 August 2026 05:46:29 +0000 (0:00:00.879) 0:01:21.521 ******** 2026-08-18 05:46:30.149905 | mon1 | ok: [mon1] 2026-08-18 05:46:30.150008 | mon1 | 2026-08-18 05:46:30.150021 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:46:30.150160 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.209) 0:01:21.731 ******** 2026-08-18 05:46:30.185346 | mon1 | skipping: [mon1] 2026-08-18 05:46:30.185381 | mon1 | 2026-08-18 05:46:30.185387 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 05:46:30.185393 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.035) 0:01:21.766 ******** 2026-08-18 05:46:30.387372 | mon1 | ok: [mon1] 2026-08-18 05:46:30.387425 | mon1 | 2026-08-18 05:46:30.387431 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:46:30.387436 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.201) 0:01:21.968 ******** 2026-08-18 05:46:30.461826 | mon1 | ok: [mon1] => { 2026-08-18 05:46:30.461891 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 05:46:30.461899 | mon1 | } 2026-08-18 05:46:30.461905 | mon1 | 2026-08-18 05:46:30.461911 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:46:30.461918 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.073) 0:01:22.042 ******** 2026-08-18 05:46:30.771039 | mon1 | ok: [mon1] 2026-08-18 05:46:30.771094 | mon1 | 2026-08-18 05:46:30.771100 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:46:30.771105 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.309) 0:01:22.351 ******** 2026-08-18 05:46:30.810253 | mon1 | skipping: [mon1] 2026-08-18 05:46:30.810315 | mon1 | 2026-08-18 05:46:30.810321 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:46:30.810326 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.039) 0:01:22.391 ******** 2026-08-18 05:46:30.850680 | mon1 | skipping: [mon1] 2026-08-18 05:46:30.850793 | mon1 | 2026-08-18 05:46:30.850806 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:46:30.850817 | mon1 | Tuesday 18 August 2026 05:46:30 +0000 (0:00:00.040) 0:01:22.431 ******** 2026-08-18 05:46:31.054518 | mon1 | ok: [mon1] 2026-08-18 05:46:31.054620 | mon1 | 2026-08-18 05:46:31.054634 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 05:46:31.054796 | mon1 | Tuesday 18 August 2026 05:46:31 +0000 (0:00:00.203) 0:01:22.635 ******** 2026-08-18 05:46:32.102772 | mon1 | ok: [mon1] 2026-08-18 05:46:32.102872 | mon1 | 2026-08-18 05:46:32.102888 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:46:32.103061 | mon1 | Tuesday 18 August 2026 05:46:32 +0000 (0:00:01.048) 0:01:23.683 ******** 2026-08-18 05:46:32.176687 | mon1 | ok: [mon1] => { 2026-08-18 05:46:32.176815 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 05:46:32.177286 | mon1 | } 2026-08-18 05:46:32.177323 | mon1 | 2026-08-18 05:46:32.177329 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:46:32.177335 | mon1 | Tuesday 18 August 2026 05:46:32 +0000 (0:00:00.073) 0:01:23.757 ******** 2026-08-18 05:46:32.529191 | mon1 | ok: [mon1] 2026-08-18 05:46:32.529299 | mon1 | 2026-08-18 05:46:32.529618 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:46:32.529686 | mon1 | Tuesday 18 August 2026 05:46:32 +0000 (0:00:00.352) 0:01:24.110 ******** 2026-08-18 05:46:34.475173 | mon1 | ok: [mon1] 2026-08-18 05:46:34.475253 | mon1 | 2026-08-18 05:46:34.475266 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 05:46:34.475394 | mon1 | Tuesday 18 August 2026 05:46:34 +0000 (0:00:01.946) 0:01:26.056 ******** 2026-08-18 05:46:34.499221 | mon1 | skipping: [mon1] 2026-08-18 05:46:34.499559 | mon1 | 2026-08-18 05:46:34.499624 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 05:46:34.499630 | mon1 | Tuesday 18 August 2026 05:46:34 +0000 (0:00:00.024) 0:01:26.080 ******** 2026-08-18 05:46:34.524822 | mon1 | skipping: [mon1] 2026-08-18 05:46:34.524908 | mon1 | 2026-08-18 05:46:34.525142 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 05:46:34.525347 | mon1 | Tuesday 18 August 2026 05:46:34 +0000 (0:00:00.025) 0:01:26.106 ******** 2026-08-18 05:46:34.551614 | mon1 | skipping: [mon1] 2026-08-18 05:46:34.551755 | mon1 | 2026-08-18 05:46:34.552052 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 05:46:34.552078 | mon1 | Tuesday 18 August 2026 05:46:34 +0000 (0:00:00.026) 0:01:26.132 ******** 2026-08-18 05:46:35.595932 | mon1 | ok: [mon1] 2026-08-18 05:46:35.596013 | mon1 | 2026-08-18 05:46:35.596187 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 05:46:35.596203 | mon1 | Tuesday 18 August 2026 05:46:35 +0000 (0:00:01.044) 0:01:27.177 ******** 2026-08-18 05:46:35.997195 | mon1 | ok: [mon1] 2026-08-18 05:46:35.997277 | mon1 | 2026-08-18 05:46:35.997593 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 05:46:35.997656 | mon1 | Tuesday 18 August 2026 05:46:35 +0000 (0:00:00.401) 0:01:27.578 ******** 2026-08-18 05:46:36.884881 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 05:46:36.884970 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 05:46:36.885563 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 05:46:36.885619 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 05:46:36.885626 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 05:46:36.885632 | mon1 | 2026-08-18 05:46:36.885636 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 05:46:36.885641 | mon1 | Tuesday 18 August 2026 05:46:36 +0000 (0:00:00.887) 0:01:28.466 ******** 2026-08-18 05:46:37.381066 | mon1 | ok: [mon1] 2026-08-18 05:46:37.381139 | mon1 | 2026-08-18 05:46:37.381219 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 05:46:37.381667 | mon1 | Tuesday 18 August 2026 05:46:37 +0000 (0:00:00.490) 0:01:28.956 ******** 2026-08-18 05:46:37.381764 | mon1 | 2026-08-18 05:46:37.381770 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 05:46:37.381775 | mon1 | Tuesday 18 August 2026 05:46:37 +0000 (0:00:00.005) 0:01:28.962 ******** 2026-08-18 05:46:37.699732 | mon1 | ok: [mon1] 2026-08-18 05:46:37.699810 | mon1 | 2026-08-18 05:46:37.699870 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 05:46:37.700003 | mon1 | Tuesday 18 August 2026 05:46:37 +0000 (0:00:00.318) 0:01:29.280 ******** 2026-08-18 05:46:37.883245 | mon1 | ok: [mon1] 2026-08-18 05:46:37.883315 | mon1 | 2026-08-18 05:46:37.883384 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 05:46:37.883489 | mon1 | Tuesday 18 August 2026 05:46:37 +0000 (0:00:00.183) 0:01:29.464 ******** 2026-08-18 05:46:37.949449 | mon1 | ok: [mon1] => { 2026-08-18 05:46:37.949557 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 05:46:37.949650 | mon1 | } 2026-08-18 05:46:37.949984 | mon1 | 2026-08-18 05:46:37.950044 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 05:46:37.950050 | mon1 | Tuesday 18 August 2026 05:46:37 +0000 (0:00:00.066) 0:01:29.530 ******** 2026-08-18 05:46:38.310161 | mon1 | ok: [mon1] 2026-08-18 05:46:38.310253 | mon1 | 2026-08-18 05:46:38.310266 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 05:46:38.310420 | mon1 | Tuesday 18 August 2026 05:46:38 +0000 (0:00:00.360) 0:01:29.891 ******** 2026-08-18 05:46:41.353662 | mon1 | ok: [mon1] 2026-08-18 05:46:41.353761 | mon1 | 2026-08-18 05:46:41.353777 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 05:46:41.354200 | mon1 | Tuesday 18 August 2026 05:46:41 +0000 (0:00:03.043) 0:01:32.934 ******** 2026-08-18 05:46:42.419784 | mon1 | ok: [mon1] 2026-08-18 05:46:42.419869 | mon1 | 2026-08-18 05:46:42.419930 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 05:46:42.420068 | mon1 | Tuesday 18 August 2026 05:46:42 +0000 (0:00:01.066) 0:01:34.000 ******** 2026-08-18 05:46:42.621496 | mon1 | ok: [mon1] 2026-08-18 05:46:42.621578 | mon1 | 2026-08-18 05:46:42.621671 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 05:46:42.621825 | mon1 | Tuesday 18 August 2026 05:46:42 +0000 (0:00:00.201) 0:01:34.202 ******** 2026-08-18 05:46:43.039787 | mon1 | ok: [mon1] 2026-08-18 05:46:43.039861 | mon1 | 2026-08-18 05:46:43.039874 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 05:46:43.039884 | mon1 | Tuesday 18 August 2026 05:46:43 +0000 (0:00:00.417) 0:01:34.619 ******** 2026-08-18 05:46:43.603831 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 05:46:43.603993 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 05:46:43.604000 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 05:46:43.604011 | mon1 | 2026-08-18 05:46:43.604140 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 05:46:43.604369 | mon1 | Tuesday 18 August 2026 05:46:43 +0000 (0:00:00.564) 0:01:35.184 ******** 2026-08-18 05:46:44.029064 | mon1 | ok: [mon1] 2026-08-18 05:46:44.029225 | mon1 | 2026-08-18 05:46:44.029442 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 05:46:44.029646 | mon1 | Tuesday 18 August 2026 05:46:44 +0000 (0:00:00.425) 0:01:35.609 ******** 2026-08-18 05:46:44.469697 | mon1 | ok: [mon1] 2026-08-18 05:46:44.469769 | mon1 | 2026-08-18 05:46:44.469844 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 05:46:44.469940 | mon1 | Tuesday 18 August 2026 05:46:44 +0000 (0:00:00.435) 0:01:36.045 ******** 2026-08-18 05:46:44.470024 | mon1 | 2026-08-18 05:46:44.470116 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 05:46:44.470201 | mon1 | Tuesday 18 August 2026 05:46:44 +0000 (0:00:00.005) 0:01:36.050 ******** 2026-08-18 05:46:44.809018 | mon1 | ok: [mon1] 2026-08-18 05:46:44.809078 | mon1 | 2026-08-18 05:46:44.809273 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 05:46:44.809324 | mon1 | Tuesday 18 August 2026 05:46:44 +0000 (0:00:00.339) 0:01:36.390 ******** 2026-08-18 05:46:44.849739 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 05:46:44.849827 | mon1 | 2026-08-18 05:46:44.850021 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 05:46:44.850080 | mon1 | Tuesday 18 August 2026 05:46:44 +0000 (0:00:00.040) 0:01:36.430 ******** 2026-08-18 05:46:46.157561 | mon1 | ok: [mon1] 2026-08-18 05:46:46.157637 | mon1 | 2026-08-18 05:46:46.157886 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 05:46:46.157935 | mon1 | Tuesday 18 August 2026 05:46:46 +0000 (0:00:01.307) 0:01:37.738 ******** 2026-08-18 05:46:46.814797 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 05:46:46.814861 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 05:46:46.814917 | mon1 | 2026-08-18 05:46:46.815134 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-18 05:46:46.815181 | mon1 | Tuesday 18 August 2026 05:46:46 +0000 (0:00:00.657) 0:01:38.395 ******** 2026-08-18 05:46:47.824847 | mon1 | ok: [mon1] 2026-08-18 05:46:47.824949 | mon1 | 2026-08-18 05:46:47.824957 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 05:46:47.825091 | mon1 | Tuesday 18 August 2026 05:46:47 +0000 (0:00:01.010) 0:01:39.406 ******** 2026-08-18 05:46:48.041265 | mon1 | ok: [mon1] 2026-08-18 05:46:48.041330 | mon1 | 2026-08-18 05:46:48.041597 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-18 05:46:48.041687 | mon1 | Tuesday 18 August 2026 05:46:48 +0000 (0:00:00.215) 0:01:39.621 ******** 2026-08-18 05:46:48.275192 | mon1 | ok: [mon1] 2026-08-18 05:46:48.275264 | mon1 | 2026-08-18 05:46:48.275552 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-18 05:46:48.275607 | mon1 | Tuesday 18 August 2026 05:46:48 +0000 (0:00:00.234) 0:01:39.856 ******** 2026-08-18 05:46:48.471003 | mon1 | ok: [mon1] 2026-08-18 05:46:48.471095 | mon1 | 2026-08-18 05:46:48.471159 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-18 05:46:48.471314 | mon1 | Tuesday 18 August 2026 05:46:48 +0000 (0:00:00.195) 0:01:40.052 ******** 2026-08-18 05:46:49.937577 | mon1 | ok: [mon1] 2026-08-18 05:46:49.937647 | mon1 | 2026-08-18 05:46:49.938529 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 05:46:49.938602 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-08-18 05:46:49.938615 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-18 05:46:49.938625 | mon1 | 2026-08-18 05:46:49.938636 | mon1 | 2026-08-18 05:46:49.938645 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 05:46:49.938655 | mon1 | Tuesday 18 August 2026 05:46:49 +0000 (0:00:01.466) 0:01:41.518 ******** 2026-08-18 05:46:49.938664 | mon1 | =============================================================================== 2026-08-18 05:46:49.938682 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.49s 2026-08-18 05:46:49.938692 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.62s 2026-08-18 05:46:49.938704 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s 2026-08-18 05:46:49.939900 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.06s 2026-08-18 05:46:49.939969 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.04s 2026-08-18 05:46:49.939981 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.29s 2026-08-18 05:46:49.939990 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.25s 2026-08-18 05:46:49.940000 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.20s 2026-08-18 05:46:49.940009 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.19s 2026-08-18 05:46:49.940018 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.95s 2026-08-18 05:46:49.940027 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.90s 2026-08-18 05:46:49.940057 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.85s 2026-08-18 05:46:49.940067 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 1.72s 2026-08-18 05:46:49.940076 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.71s 2026-08-18 05:46:49.940085 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 1.70s 2026-08-18 05:46:49.940102 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.63s 2026-08-18 05:46:49.940111 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.61s 2026-08-18 05:46:49.940392 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 1.60s 2026-08-18 05:46:49.940439 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 1.57s 2026-08-18 05:46:49.940445 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.52s 2026-08-18 05:46:50.047340 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-18 05:46:50.055988 | mon1 | INFO [default > side_effect] Executing 2026-08-18 05:46:50.056917 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 05:46:50.061890 | mon1 | INFO [default > verify] Executing 2026-08-18 05:46:50.665334 | mon1 | 2026-08-18 05:46:50.665658 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-18 05:46:50.665946 | mon1 | 2026-08-18 05:46:50.666217 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 05:46:50.666557 | mon1 | Tuesday 18 August 2026 05:46:50 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-08-18 05:46:51.835199 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 05:46:51.835296 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 05:46:51.835306 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 05:46:51.835313 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 05:46:51.835321 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 05:46:51.845832 | mon1 | ok: [mon1] 2026-08-18 05:46:51.845882 | mon1 | 2026-08-18 05:46:51.845893 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-18 05:46:51.845904 | mon1 | Tuesday 18 August 2026 05:46:51 +0000 (0:00:01.179) 0:00:01.186 ******** 2026-08-18 05:46:57.451953 | mon1 | ok: [mon1] 2026-08-18 05:46:57.452171 | mon1 | 2026-08-18 05:46:57.452322 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-18 05:46:57.452637 | mon1 | Tuesday 18 August 2026 05:46:57 +0000 (0:00:05.606) 0:00:06.793 ******** 2026-08-18 05:46:57.486421 | mon1 | ok: [mon1] 2026-08-18 05:46:57.486574 | mon1 | 2026-08-18 05:46:57.486720 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-18 05:46:57.486920 | mon1 | Tuesday 18 August 2026 05:46:57 +0000 (0:00:00.034) 0:00:06.828 ******** 2026-08-18 05:46:57.514999 | mon1 | ok: [mon1] => { 2026-08-18 05:46:57.515102 | mon1 | "changed": false, 2026-08-18 05:46:57.515248 | mon1 | "msg": "All assertions passed" 2026-08-18 05:46:57.515386 | mon1 | } 2026-08-18 05:46:57.515502 | mon1 | 2026-08-18 05:46:57.515634 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-18 05:46:57.515753 | mon1 | Tuesday 18 August 2026 05:46:57 +0000 (0:00:00.028) 0:00:06.856 ******** 2026-08-18 05:46:58.976043 | mon1 | ok: [mon1] 2026-08-18 05:46:58.976213 | mon1 | 2026-08-18 05:46:58.976424 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-18 05:46:58.976629 | mon1 | Tuesday 18 August 2026 05:46:58 +0000 (0:00:01.461) 0:00:08.317 ******** 2026-08-18 05:46:59.005204 | mon1 | ok: [mon1] => { 2026-08-18 05:46:59.005397 | mon1 | "_ceph_health": { 2026-08-18 05:46:59.005591 | mon1 | "changed": false, 2026-08-18 05:46:59.005817 | mon1 | "cmd": [ 2026-08-18 05:46:59.006033 | mon1 | "cephadm", 2026-08-18 05:46:59.006223 | mon1 | "shell", 2026-08-18 05:46:59.006462 | mon1 | "--", 2026-08-18 05:46:59.006677 | mon1 | "ceph", 2026-08-18 05:46:59.006861 | mon1 | "health" 2026-08-18 05:46:59.007070 | mon1 | ], 2026-08-18 05:46:59.007271 | mon1 | "delta": "0:00:01.278827", 2026-08-18 05:46:59.007503 | mon1 | "end": "2026-08-18 05:46:58.939937", 2026-08-18 05:46:59.007712 | mon1 | "failed": false, 2026-08-18 05:46:59.007902 | mon1 | "msg": "", 2026-08-18 05:46:59.008115 | mon1 | "rc": 0, 2026-08-18 05:46:59.008334 | mon1 | "start": "2026-08-18 05:46:57.661110", 2026-08-18 05:46:59.008561 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-18 05:46:59.008776 | mon1 | "stderr_lines": [ 2026-08-18 05:46:59.008970 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 05:46:59.009198 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-18 05:46:59.009415 | mon1 | ], 2026-08-18 05:46:59.009612 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 05:46:59.009859 | mon1 | "stdout_lines": [ 2026-08-18 05:46:59.010051 | mon1 | "HEALTH_OK" 2026-08-18 05:46:59.010216 | mon1 | ] 2026-08-18 05:46:59.010333 | mon1 | } 2026-08-18 05:46:59.010471 | mon1 | } 2026-08-18 05:46:59.010578 | mon1 | 2026-08-18 05:46:59.010710 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-18 05:46:59.010829 | mon1 | Tuesday 18 August 2026 05:46:59 +0000 (0:00:00.029) 0:00:08.347 ******** 2026-08-18 05:46:59.033404 | mon1 | ok: [mon1] => { 2026-08-18 05:46:59.033575 | mon1 | "changed": false, 2026-08-18 05:46:59.033814 | mon1 | "msg": "All assertions passed" 2026-08-18 05:46:59.034036 | mon1 | } 2026-08-18 05:46:59.034218 | mon1 | 2026-08-18 05:46:59.034443 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-18 05:46:59.034651 | mon1 | Tuesday 18 August 2026 05:46:59 +0000 (0:00:00.028) 0:00:08.375 ******** 2026-08-18 05:47:07.160783 | mon1 | changed: [mon1] 2026-08-18 05:47:07.160851 | mon1 | 2026-08-18 05:47:07.160863 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-18 05:47:07.160873 | mon1 | Tuesday 18 August 2026 05:47:07 +0000 (0:00:08.126) 0:00:16.501 ******** 2026-08-18 05:47:10.127559 | mon1 | changed: [mon1] 2026-08-18 05:47:10.127670 | mon1 | 2026-08-18 05:47:10.127974 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-18 05:47:10.128029 | mon1 | Tuesday 18 August 2026 05:47:10 +0000 (0:00:02.967) 0:00:19.469 ******** 2026-08-18 05:47:11.724657 | mon1 | ok: [mon1] 2026-08-18 05:47:11.724734 | mon1 | 2026-08-18 05:47:11.725094 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-18 05:47:11.725140 | mon1 | Tuesday 18 August 2026 05:47:11 +0000 (0:00:01.597) 0:00:21.066 ******** 2026-08-18 05:47:11.765134 | mon1 | ok: [mon1] => { 2026-08-18 05:47:11.765882 | mon1 | "changed": false, 2026-08-18 05:47:11.765933 | mon1 | "msg": "All assertions passed" 2026-08-18 05:47:11.765941 | mon1 | } 2026-08-18 05:47:11.765948 | mon1 | 2026-08-18 05:47:11.765954 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-18 05:47:11.765961 | mon1 | Tuesday 18 August 2026 05:47:11 +0000 (0:00:00.040) 0:00:21.106 ******** 2026-08-18 05:47:11.946481 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 05:47:11.953276 | mon1 | 2026-08-18 05:47:11.953323 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 05:47:11.953332 | mon1 | mon1 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 05:47:11.953339 | mon1 | 2026-08-18 05:47:11.953344 | mon1 | 2026-08-18 05:47:11.953350 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 05:47:11.953356 | mon1 | Tuesday 18 August 2026 05:47:11 +0000 (0:00:00.183) 0:00:21.289 ******** 2026-08-18 05:47:11.953375 | mon1 | =============================================================================== 2026-08-18 05:47:11.953381 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.13s 2026-08-18 05:47:11.953387 | mon1 | List locally deployed Ceph daemons -------------------------------------- 5.61s 2026-08-18 05:47:11.953393 | mon1 | Create a test Ceph key -------------------------------------------------- 2.97s 2026-08-18 05:47:11.953398 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.60s 2026-08-18 05:47:11.953404 | mon1 | Get cluster health status ----------------------------------------------- 1.46s 2026-08-18 05:47:11.953410 | mon1 | Gathering Facts --------------------------------------------------------- 1.18s 2026-08-18 05:47:11.953415 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.18s 2026-08-18 05:47:11.953421 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-08-18 05:47:11.953426 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.03s 2026-08-18 05:47:11.953432 | mon1 | Print cluster health status --------------------------------------------- 0.03s 2026-08-18 05:47:11.953437 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.03s 2026-08-18 05:47:11.953443 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-08-18 05:47:12.012697 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 05:47:12.012944 | mon1 | ERROR [default > verify] Executed: Failed 2026-08-18 05:47:12.013123 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 05:47:22.474714 | mon1 | ERROR 2026-08-18 05:47:22.474946 | mon1 | { 2026-08-18 05:47:22.474988 | mon1 | "delta": "0:08:47.779679", 2026-08-18 05:47:22.475018 | mon1 | "end": "2026-08-18 05:47:12.081557", 2026-08-18 05:47:22.475044 | mon1 | "msg": "non-zero return code", 2026-08-18 05:47:22.475069 | mon1 | "rc": 2, 2026-08-18 05:47:22.475094 | mon1 | "start": "2026-08-18 05:38:24.301878" 2026-08-18 05:47:22.475118 | mon1 | } failure 2026-08-18 05:47:22.493992 | 2026-08-18 05:47:22.494049 | PLAY RECAP 2026-08-18 05:47:22.494096 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-18 05:47:22.494119 | 2026-08-18 05:47:22.688452 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 05:47:22.692129 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 05:47:25.001786 | 2026-08-18 05:47:25.001941 | PLAY [all] 2026-08-18 05:47:25.013880 | 2026-08-18 05:47:25.013980 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 05:47:25.320425 | osd1 | ok 2026-08-18 05:47:25.324656 | mon1 | ok 2026-08-18 05:47:25.328945 | 2026-08-18 05:47:25.329069 | TASK [fetch-output : Set log path for single node] 2026-08-18 05:47:25.362456 | mon1 | skipping: Conditional result was False 2026-08-18 05:47:25.363238 | osd1 | skipping: Conditional result was False 2026-08-18 05:47:25.371689 | 2026-08-18 05:47:25.371794 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 05:47:25.948424 | mon1 -> localhost | changed: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/logs/mon1" 2026-08-18 05:47:25.950500 | osd1 -> localhost | changed: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/logs/osd1" 2026-08-18 05:47:26.150483 | mon1 -> localhost | changed: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/artifacts" 2026-08-18 05:47:26.160637 | osd1 -> localhost | ok: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/artifacts" 2026-08-18 05:47:26.346911 | mon1 -> localhost | changed: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/docs" 2026-08-18 05:47:26.384582 | osd1 -> localhost | ok: "/var/lib/zuul/builds/836068ffdd5046dd96272990b1663e48/work/docs" 2026-08-18 05:47:26.384707 | osd1 -> localhost | changed: All items complete 2026-08-18 05:47:26.384769 | 2026-08-18 05:47:26.405364 | 2026-08-18 05:47:26.405512 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 05:47:27.500183 | osd1 | changed: .d..t...... ./ 2026-08-18 05:47:27.506916 | mon1 | changed: .d..t...... ./ 2026-08-18 05:47:27.953446 | mon1 | changed: .d..t...... ./ 2026-08-18 05:47:27.994579 | osd1 | ok 2026-08-18 05:47:28.405757 | mon1 | changed: .d..t...... ./ 2026-08-18 05:47:28.467734 | osd1 | changed: .d..t...... ./ 2026-08-18 05:47:28.467859 | osd1 | changed: All items complete 2026-08-18 05:47:28.467915 | 2026-08-18 05:47:28.499989 | 2026-08-18 05:47:28.500499 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 05:47:28.894869 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008643 2026-08-18 05:47:29.449681 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007740 2026-08-18 05:47:29.473739 | 2026-08-18 05:47:29.473896 | PLAY [all] 2026-08-18 05:47:29.480705 | 2026-08-18 05:47:29.480771 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 05:47:29.877829 | mon1 | changed 2026-08-18 05:47:30.070801 | osd1 | changed 2026-08-18 05:47:30.082276 | 2026-08-18 05:47:30.082322 | PLAY RECAP 2026-08-18 05:47:30.082364 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 05:47:30.082393 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 05:47:30.082412 | 2026-08-18 05:47:30.218551 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 05:47:30.223992 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 05:47:30.787381 | 2026-08-18 05:47:30.787523 | PLAY [localhost] 2026-08-18 05:47:30.797330 | 2026-08-18 05:47:30.797401 | TASK [Generate Zuul manifest] 2026-08-18 05:47:30.817964 | localhost | ok 2026-08-18 05:47:30.833755 | 2026-08-18 05:47:30.833843 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 05:47:31.228330 | localhost | changed 2026-08-18 05:47:31.241701 | 2026-08-18 05:47:31.241777 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 05:47:31.365629 | localhost | ok 2026-08-18 05:47:31.373897 | 2026-08-18 05:47:31.373965 | TASK [Upload logs] 2026-08-18 05:47:31.395719 | localhost | ok 2026-08-18 05:47:31.455756 | 2026-08-18 05:47:31.455889 | TASK [Set zuul-log-path fact] 2026-08-18 05:47:31.477222 | localhost | ok 2026-08-18 05:47:31.490799 | 2026-08-18 05:47:31.490863 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 05:47:31.522114 | localhost | ok 2026-08-18 05:47:31.531666 | 2026-08-18 05:47:31.531758 | TASK [upload-logs : Create log directories] 2026-08-18 05:47:31.921269 | localhost | changed 2026-08-18 05:47:31.927975 | 2026-08-18 05:47:31.928046 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 05:47:32.345766 | localhost -> localhost | ok: Runtime: 0:00:00.004662 2026-08-18 05:47:32.351514 | 2026-08-18 05:47:32.351584 | TASK [upload-logs : Upload logs to log server] 2026-08-18 05:47:32.795527 | localhost | Output suppressed because no_log was given 2026-08-18 05:47:32.800601 | 2026-08-18 05:47:32.800688 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 05:47:32.883499 | localhost | skipping: Conditional result was False 2026-08-18 05:47:32.890466 | localhost | skipping: Conditional result was False 2026-08-18 05:47:32.904163 | 2026-08-18 05:47:32.904335 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 05:47:32.982495 | localhost | skipping: Conditional result was False 2026-08-18 05:47:32.982861 | 2026-08-18 05:47:32.986761 | localhost | skipping: Conditional result was False 2026-08-18 05:47:33.034308 | 2026-08-18 05:47:33.034458 | LOOP [upload-logs : Upload console log and json output]