2026-08-31 07:12:45.821930 | Job console starting 2026-08-31 07:12:45.835924 | Updating git repos 2026-08-31 07:12:45.884301 | Cloning repos into workspace 2026-08-31 07:12:46.073229 | Restoring repo states 2026-08-31 07:12:46.082068 | Merging changes 2026-08-31 07:12:46.577804 | Checking out repos 2026-08-31 07:12:46.616210 | Preparing playbooks 2026-08-31 07:12:47.767492 | Running Ansible setup 2026-08-31 07:12:54.373164 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-31 07:12:55.024560 | 2026-08-31 07:12:55.024701 | PLAY [localhost] 2026-08-31 07:12:55.032791 | 2026-08-31 07:12:55.032861 | TASK [Gathering Facts] 2026-08-31 07:12:55.992193 | localhost | ok 2026-08-31 07:12:56.002982 | 2026-08-31 07:12:56.003084 | TASK [Setup log path fact] 2026-08-31 07:12:56.022489 | localhost | ok 2026-08-31 07:12:56.034135 | 2026-08-31 07:12:56.034203 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-31 07:12:56.063877 | localhost | ok 2026-08-31 07:12:56.071846 | 2026-08-31 07:12:56.071914 | TASK [emit-job-header : Print job information] 2026-08-31 07:12:56.111717 | # Job Information 2026-08-31 07:12:56.111867 | Ansible Version: 2.16.18 2026-08-31 07:12:56.111914 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-08-31 07:12:56.111946 | Pipeline: check 2026-08-31 07:12:56.111976 | Executor: 2d72f0692154 2026-08-31 07:12:56.112005 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/42 2026-08-31 07:12:56.112038 | Event ID: a0ac6f60-a509-11f1-83dd-be8986908f68 2026-08-31 07:12:56.115791 | 2026-08-31 07:12:56.115860 | LOOP [emit-job-header : Print node information] 2026-08-31 07:12:56.241253 | localhost | ok: 2026-08-31 07:12:56.241510 | localhost | # Node Information 2026-08-31 07:12:56.241552 | localhost | Inventory Hostname: mon1 2026-08-31 07:12:56.241584 | localhost | Hostname: np0000191583 2026-08-31 07:12:56.241613 | localhost | Username: zuul 2026-08-31 07:12:56.241646 | localhost | Distro: Ubuntu 24.04 2026-08-31 07:12:56.241675 | localhost | Provider: yul1 2026-08-31 07:12:56.241703 | localhost | Region: ca-ymq-1 2026-08-31 07:12:56.241730 | localhost | Label: ubuntu-noble 2026-08-31 07:12:56.241757 | localhost | Product Name: OpenStack Nova 2026-08-31 07:12:56.241784 | localhost | Interface IP: 162.253.55.75 2026-08-31 07:12:56.302917 | localhost | ok: 2026-08-31 07:12:56.303269 | localhost | # Node Information 2026-08-31 07:12:56.303352 | localhost | Inventory Hostname: osd1 2026-08-31 07:12:56.303414 | localhost | Hostname: np0000191584 2026-08-31 07:12:56.303463 | localhost | Username: zuul 2026-08-31 07:12:56.303507 | localhost | Distro: Ubuntu 24.04 2026-08-31 07:12:56.303551 | localhost | Provider: yul1 2026-08-31 07:12:56.303593 | localhost | Region: ca-ymq-1 2026-08-31 07:12:56.303636 | localhost | Label: ubuntu-noble 2026-08-31 07:12:56.303671 | localhost | Product Name: OpenStack Nova 2026-08-31 07:12:56.303701 | localhost | Interface IP: 162.253.55.45 2026-08-31 07:12:56.323454 | 2026-08-31 07:12:56.323616 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-31 07:12:56.774504 | localhost -> localhost | changed 2026-08-31 07:12:56.782399 | 2026-08-31 07:12:56.782755 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-31 07:12:57.737872 | localhost -> localhost | changed 2026-08-31 07:12:57.756336 | 2026-08-31 07:12:57.756396 | PLAY [all] 2026-08-31 07:12:57.768523 | 2026-08-31 07:12:57.768705 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-31 07:12:58.017619 | mon1 -> localhost | ok 2026-08-31 07:12:58.029919 | 2026-08-31 07:12:58.030012 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-31 07:12:58.066255 | mon1 | ok 2026-08-31 07:12:58.070757 | osd1 | ok 2026-08-31 07:12:58.089979 | mon1 | included: /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-31 07:12:58.090033 | osd1 | included: /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-31 07:12:58.097118 | 2026-08-31 07:12:58.097182 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-31 07:12:59.207925 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-31 07:12:59.208129 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/e64ee756bf6044c6bd4e1a6f5947ece1_id_rsa 2026-08-31 07:12:59.208161 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/e64ee756bf6044c6bd4e1a6f5947ece1_id_rsa.pub 2026-08-31 07:12:59.208184 | mon1 -> localhost | The key fingerprint is: 2026-08-31 07:12:59.208206 | mon1 -> localhost | SHA256:GtKL5Z6Dz2L1TTWPcOigt343YrA5LfJjY0EVNcNWaC0 zuul-build-sshkey 2026-08-31 07:12:59.208227 | mon1 -> localhost | The key's randomart image is: 2026-08-31 07:12:59.208248 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-31 07:12:59.208269 | mon1 -> localhost | | .+++. | 2026-08-31 07:12:59.208290 | mon1 -> localhost | | . Eo. | 2026-08-31 07:12:59.208310 | mon1 -> localhost | | . + . | 2026-08-31 07:12:59.208331 | mon1 -> localhost | | . o o + | 2026-08-31 07:12:59.208350 | mon1 -> localhost | | . +oSo + + | 2026-08-31 07:12:59.208369 | mon1 -> localhost | | =o++ o . . | 2026-08-31 07:12:59.208389 | mon1 -> localhost | | .o+o X | 2026-08-31 07:12:59.208408 | mon1 -> localhost | | +oo.% * o | 2026-08-31 07:12:59.208427 | mon1 -> localhost | | . o=BoB o . | 2026-08-31 07:12:59.208446 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-31 07:12:59.208510 | mon1 -> localhost | ok: Runtime: 0:00:00.661021 2026-08-31 07:12:59.214755 | 2026-08-31 07:12:59.214821 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-31 07:12:59.253042 | mon1 | ok 2026-08-31 07:12:59.259079 | osd1 | ok 2026-08-31 07:12:59.272496 | mon1 | included: /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-31 07:12:59.272568 | osd1 | included: /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-31 07:12:59.284708 | 2026-08-31 07:12:59.284854 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-31 07:12:59.315289 | mon1 | skipping: Conditional result was False 2026-08-31 07:12:59.326708 | osd1 | skipping: Conditional result was False 2026-08-31 07:12:59.338939 | 2026-08-31 07:12:59.339749 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-31 07:12:59.881061 | mon1 | changed 2026-08-31 07:13:00.335052 | osd1 | changed 2026-08-31 07:13:00.343481 | 2026-08-31 07:13:00.343541 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-31 07:13:01.724984 | osd1 | ok 2026-08-31 07:13:01.948756 | mon1 | ok 2026-08-31 07:13:01.955750 | 2026-08-31 07:13:01.955823 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-31 07:13:03.908602 | osd1 | changed 2026-08-31 07:13:04.070073 | mon1 | changed 2026-08-31 07:13:04.076837 | 2026-08-31 07:13:04.076908 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-31 07:13:04.684469 | osd1 | changed 2026-08-31 07:13:04.713599 | mon1 | changed 2026-08-31 07:13:04.720358 | 2026-08-31 07:13:04.720423 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-31 07:13:04.745835 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:04.757276 | osd1 | skipping: Conditional result was False 2026-08-31 07:13:04.767786 | 2026-08-31 07:13:04.767851 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-31 07:13:05.157283 | mon1 -> localhost | changed 2026-08-31 07:13:05.181062 | 2026-08-31 07:13:05.181145 | TASK [add-build-sshkey : Add back temp key] 2026-08-31 07:13:05.465611 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/e64ee756bf6044c6bd4e1a6f5947ece1_id_rsa (zuul-build-sshkey) 2026-08-31 07:13:05.465830 | mon1 -> localhost | ok: Runtime: 0:00:00.014996 2026-08-31 07:13:05.471594 | 2026-08-31 07:13:05.471657 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-31 07:13:05.809256 | mon1 | ok 2026-08-31 07:13:05.817141 | osd1 | ok 2026-08-31 07:13:05.822198 | 2026-08-31 07:13:05.822266 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-31 07:13:05.848087 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:05.859202 | osd1 | skipping: Conditional result was False 2026-08-31 07:13:05.878652 | 2026-08-31 07:13:05.878718 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-31 07:13:06.230308 | osd1 | ok 2026-08-31 07:13:06.260701 | mon1 | ok 2026-08-31 07:13:06.269967 | 2026-08-31 07:13:06.270032 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-31 07:13:07.082256 | mon1 | Output suppressed because no_log was given 2026-08-31 07:13:07.138542 | osd1 | Output suppressed because no_log was given 2026-08-31 07:13:07.153379 | 2026-08-31 07:13:07.153439 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-31 07:13:07.412264 | mon1 | ok: "logs" 2026-08-31 07:13:07.412660 | mon1 | ok: All items complete 2026-08-31 07:13:07.412710 | 2026-08-31 07:13:07.418179 | osd1 | ok: "logs" 2026-08-31 07:13:07.625910 | mon1 | ok: "artifacts" 2026-08-31 07:13:07.634263 | osd1 | ok: "artifacts" 2026-08-31 07:13:07.824313 | mon1 | ok: "docs" 2026-08-31 07:13:07.864855 | osd1 | ok: "docs" 2026-08-31 07:13:07.883091 | 2026-08-31 07:13:07.883244 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-31 07:13:08.124840 | mon1 | changed: "logs" 2026-08-31 07:13:08.125195 | mon1 | ok: All items complete 2026-08-31 07:13:08.125237 | 2026-08-31 07:13:08.134494 | osd1 | changed: "logs" 2026-08-31 07:13:08.312213 | osd1 | changed: "artifacts" 2026-08-31 07:13:08.318060 | mon1 | changed: "artifacts" 2026-08-31 07:13:08.512246 | mon1 | changed: "docs" 2026-08-31 07:13:08.553746 | osd1 | changed: "docs" 2026-08-31 07:13:08.576762 | 2026-08-31 07:13:08.576897 | PLAY RECAP 2026-08-31 07:13:08.576947 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:13:08.577010 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-31 07:13:08.577036 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-31 07:13:08.577053 | 2026-08-31 07:13:08.752570 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-31 07:13:08.762269 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-31 07:13:09.407820 | 2026-08-31 07:13:09.407978 | PLAY [all] 2026-08-31 07:13:09.419521 | 2026-08-31 07:13:09.419602 | TASK [setup-uv : Extract archive] 2026-08-31 07:13:11.972587 | osd1 | changed 2026-08-31 07:13:12.045713 | mon1 | changed 2026-08-31 07:13:12.052163 | 2026-08-31 07:13:12.052247 | TASK [setup-uv : Print version] 2026-08-31 07:13:12.503832 | osd1 | uv 0.8.13 2026-08-31 07:13:12.491906 | mon1 | uv 0.8.13 2026-08-31 07:13:12.621277 | mon1 | ok: Runtime: 0:00:00.019094 2026-08-31 07:13:12.631501 | osd1 | ok: Runtime: 0:00:00.018328 2026-08-31 07:13:12.646696 | 2026-08-31 07:13:12.646768 | TASK [Install Ansible collection siblings] 2026-08-31 07:13:13.082043 | mon1 | ok: 2026-08-31 07:13:13.082268 | mon1 | Skipping community.general: no checked-out sibling 2026-08-31 07:13:13.082309 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-31 07:13:13.082338 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-31 07:13:13.084798 | 2026-08-31 07:13:13.084864 | PLAY RECAP 2026-08-31 07:13:13.084926 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:13:13.085003 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:13:13.085036 | 2026-08-31 07:13:13.274930 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-31 07:13:13.278490 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-31 07:13:13.940889 | 2026-08-31 07:13:13.941053 | PLAY [all] 2026-08-31 07:13:13.953069 | 2026-08-31 07:13:13.953144 | LOOP [Check inventory directories] 2026-08-31 07:13:14.348635 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-31 07:13:14.527690 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-31 07:13:14.707295 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-31 07:13:14.722293 | 2026-08-31 07:13:14.722511 | LOOP [Copy inventory file for Zuul] 2026-08-31 07:13:15.703674 | mon1 | changed: 2026-08-31 07:13:15.703925 | mon1 | { 2026-08-31 07:13:15.703965 | mon1 | "ansible_loop_var": "item", 2026-08-31 07:13:15.703999 | mon1 | "changed": false, 2026-08-31 07:13:15.704028 | mon1 | "failed": false, 2026-08-31 07:13:15.704063 | mon1 | "invocation": { 2026-08-31 07:13:15.704092 | mon1 | "module_args": { 2026-08-31 07:13:15.704119 | mon1 | "checksum_algorithm": "sha1", 2026-08-31 07:13:15.704146 | mon1 | "follow": true, 2026-08-31 07:13:15.704172 | mon1 | "get_attributes": true, 2026-08-31 07:13:15.704200 | mon1 | "get_checksum": true, 2026-08-31 07:13:15.704226 | mon1 | "get_mime": true, 2026-08-31 07:13:15.704252 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-31 07:13:15.704278 | mon1 | } 2026-08-31 07:13:15.704304 | mon1 | }, 2026-08-31 07:13:15.704329 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-31 07:13:15.704354 | mon1 | "stat": { 2026-08-31 07:13:15.704380 | mon1 | "atime": 1788160386.9775665, 2026-08-31 07:13:15.704406 | mon1 | "attr_flags": "e", 2026-08-31 07:13:15.704432 | mon1 | "attributes": [ 2026-08-31 07:13:15.704457 | mon1 | "extents" 2026-08-31 07:13:15.704483 | mon1 | ], 2026-08-31 07:13:15.704508 | mon1 | "block_size": 4096, 2026-08-31 07:13:15.704534 | mon1 | "blocks": 8, 2026-08-31 07:13:15.704560 | mon1 | "charset": "unknown", 2026-08-31 07:13:15.704587 | mon1 | "ctime": 1788160386.9875665, 2026-08-31 07:13:15.704613 | mon1 | "dev": 64769, 2026-08-31 07:13:15.704639 | mon1 | "device_type": 0, 2026-08-31 07:13:15.704665 | mon1 | "executable": true, 2026-08-31 07:13:15.704690 | mon1 | "exists": true, 2026-08-31 07:13:15.704715 | mon1 | "gid": 1000, 2026-08-31 07:13:15.704739 | mon1 | "gr_name": "zuul", 2026-08-31 07:13:15.704764 | mon1 | "inode": 1034272, 2026-08-31 07:13:15.704789 | mon1 | "isblk": false, 2026-08-31 07:13:15.704815 | mon1 | "ischr": false, 2026-08-31 07:13:15.704840 | mon1 | "isdir": true, 2026-08-31 07:13:15.704865 | mon1 | "isfifo": false, 2026-08-31 07:13:15.704890 | mon1 | "isgid": false, 2026-08-31 07:13:15.704914 | mon1 | "islnk": false, 2026-08-31 07:13:15.704939 | mon1 | "isreg": false, 2026-08-31 07:13:15.704992 | mon1 | "issock": false, 2026-08-31 07:13:15.705018 | mon1 | "isuid": false, 2026-08-31 07:13:15.705043 | mon1 | "mimetype": "unknown", 2026-08-31 07:13:15.705068 | mon1 | "mode": "0755", 2026-08-31 07:13:15.705093 | mon1 | "mtime": 1788160366.1020675, 2026-08-31 07:13:15.705118 | mon1 | "nlink": 10, 2026-08-31 07:13:15.705143 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-31 07:13:15.705169 | mon1 | "pw_name": "zuul", 2026-08-31 07:13:15.705195 | mon1 | "readable": true, 2026-08-31 07:13:15.705220 | mon1 | "rgrp": true, 2026-08-31 07:13:15.705246 | mon1 | "roth": true, 2026-08-31 07:13:15.705270 | mon1 | "rusr": true, 2026-08-31 07:13:15.705295 | mon1 | "size": 4096, 2026-08-31 07:13:15.705332 | mon1 | "uid": 1000, 2026-08-31 07:13:15.705359 | mon1 | "version": "3677319059", 2026-08-31 07:13:15.705385 | mon1 | "wgrp": false, 2026-08-31 07:13:15.705413 | mon1 | "woth": false, 2026-08-31 07:13:15.705438 | mon1 | "writeable": true, 2026-08-31 07:13:15.705463 | mon1 | "wusr": true, 2026-08-31 07:13:15.705488 | mon1 | "xgrp": true, 2026-08-31 07:13:15.705512 | mon1 | "xoth": true, 2026-08-31 07:13:15.705536 | mon1 | "xusr": true 2026-08-31 07:13:15.705561 | mon1 | } 2026-08-31 07:13:15.705586 | mon1 | } 2026-08-31 07:13:15.705633 | mon1 | ok: All items complete 2026-08-31 07:13:15.705664 | 2026-08-31 07:13:15.707458 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:15.708312 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:15.724916 | 2026-08-31 07:13:15.725102 | LOOP [Switch "ansible_host" to private IP] 2026-08-31 07:13:16.946478 | mon1 | changed: 2 replacements made 2026-08-31 07:13:16.948277 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:16.949228 | mon1 | skipping: Conditional result was False 2026-08-31 07:13:16.974235 | 2026-08-31 07:13:16.974410 | TASK [Run Molecule scenario] 2026-08-31 07:13:17.513530 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-08-31 07:13:17.513648 | mon1 | Creating virtual environment at: .venv 2026-08-31 07:13:20.186944 | mon1 | Downloading pygments (1.2MiB) 2026-08-31 07:13:20.187142 | mon1 | Downloading netaddr (2.2MiB) 2026-08-31 07:13:20.187595 | mon1 | Downloading cryptography (4.3MiB) 2026-08-31 07:13:20.187868 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-31 07:13:20.371120 | mon1 | Downloading netaddr 2026-08-31 07:13:20.384159 | mon1 | Downloading cryptography 2026-08-31 07:13:20.437843 | mon1 | Downloading pygments 2026-08-31 07:13:20.615577 | mon1 | Downloading ansible-core 2026-08-31 07:13:20.683519 | mon1 | Installed 37 packages in 67ms 2026-08-31 07:13:21.449732 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-31 07:13:21.449844 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-31 07:13:22.112663 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-31 07:13:22.112744 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-31 07:18:10.058954 | mon1 | INFO [default > dependency] Executing 2026-08-31 07:18:10.059125 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-31 07:18:10.059410 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-31 07:18:10.059568 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-31 07:18:10.065893 | mon1 | INFO [default > cleanup] Executing 2026-08-31 07:18:10.066232 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:18:10.072692 | mon1 | INFO [default > destroy] Executing 2026-08-31 07:18:10.072748 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-31 07:18:10.072826 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-31 07:18:10.081074 | mon1 | INFO [default > syntax] Executing 2026-08-31 07:18:11.207669 | mon1 | 2026-08-31 07:18:11.208124 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-31 07:18:11.265425 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-31 07:18:11.280901 | mon1 | INFO [default > create] Executing 2026-08-31 07:18:11.283019 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:18:11.289799 | mon1 | INFO [default > prepare] Executing 2026-08-31 07:18:12.107029 | mon1 | 2026-08-31 07:18:12.107223 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-31 07:18:12.107543 | mon1 | 2026-08-31 07:18:12.107827 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:18:12.108060 | mon1 | Monday 31 August 2026 07:18:12 +0000 (0:00:00.033) 0:00:00.033 ********* 2026-08-31 07:18:14.514334 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:18:14.514426 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:18:14.514574 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:18:14.514715 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:18:14.514864 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:18:14.522727 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:18:14.522821 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:18:14.522962 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:18:14.523148 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:18:14.523352 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:18:14.536194 | mon1 | ok: [mon1] 2026-08-31 07:18:14.536302 | mon1 | ok: [osd1] 2026-08-31 07:18:14.536484 | mon1 | 2026-08-31 07:18:14.536631 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-31 07:18:14.536784 | mon1 | Monday 31 August 2026 07:18:14 +0000 (0:00:02.432) 0:00:02.465 ********* 2026-08-31 07:18:15.394261 | mon1 | changed: [mon1] 2026-08-31 07:18:15.394344 | mon1 | changed: [osd1] 2026-08-31 07:18:15.394537 | mon1 | 2026-08-31 07:18:15.394777 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-31 07:18:15.395018 | mon1 | Monday 31 August 2026 07:18:15 +0000 (0:00:00.856) 0:00:03.322 ********* 2026-08-31 07:18:15.766340 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-31 07:18:15.766577 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-31 07:18:15.766806 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-31 07:18:15.786391 | mon1 | changed: [mon1] 2026-08-31 07:18:15.786610 | mon1 | changed: [osd1] 2026-08-31 07:18:15.786810 | mon1 | 2026-08-31 07:18:15.787028 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-31 07:18:15.787290 | mon1 | Monday 31 August 2026 07:18:15 +0000 (0:00:00.393) 0:00:03.715 ********* 2026-08-31 07:18:21.722502 | mon1 | changed: [osd1] 2026-08-31 07:18:21.722710 | mon1 | changed: [mon1] 2026-08-31 07:18:21.722920 | mon1 | 2026-08-31 07:18:21.723253 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-31 07:18:21.723538 | mon1 | 2026-08-31 07:18:21.723795 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:18:21.723980 | mon1 | Monday 31 August 2026 07:18:21 +0000 (0:00:05.935) 0:00:09.651 ********* 2026-08-31 07:18:22.630063 | mon1 | ok: [osd1] 2026-08-31 07:18:22.630263 | mon1 | 2026-08-31 07:18:22.630506 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-31 07:18:22.630738 | mon1 | Monday 31 August 2026 07:18:22 +0000 (0:00:00.907) 0:00:10.559 ********* 2026-08-31 07:18:43.802924 | mon1 | changed: [osd1] 2026-08-31 07:18:43.803043 | mon1 | 2026-08-31 07:18:43.803060 | mon1 | TASK [Start up service] ******************************************************** 2026-08-31 07:18:43.803077 | mon1 | Monday 31 August 2026 07:18:43 +0000 (0:00:21.170) 0:00:31.729 ********* 2026-08-31 07:18:44.509425 | mon1 | ok: [osd1] 2026-08-31 07:18:44.509544 | mon1 | 2026-08-31 07:18:44.509792 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-31 07:18:44.510062 | mon1 | Monday 31 August 2026 07:18:44 +0000 (0:00:00.708) 0:00:32.438 ********* 2026-08-31 07:18:44.931185 | mon1 | ok: [osd1] 2026-08-31 07:18:44.931277 | mon1 | 2026-08-31 07:18:44.931383 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-31 07:18:44.931549 | mon1 | Monday 31 August 2026 07:18:44 +0000 (0:00:00.422) 0:00:32.860 ********* 2026-08-31 07:18:45.853443 | mon1 | changed: [osd1] 2026-08-31 07:18:45.853525 | mon1 | 2026-08-31 07:18:45.853820 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-31 07:18:45.854145 | mon1 | Monday 31 August 2026 07:18:45 +0000 (0:00:00.921) 0:00:33.781 ********* 2026-08-31 07:18:46.131982 | mon1 | ok: [osd1] 2026-08-31 07:18:46.132344 | mon1 | 2026-08-31 07:18:46.132647 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-31 07:18:46.133011 | mon1 | Monday 31 August 2026 07:18:46 +0000 (0:00:00.279) 0:00:34.060 ********* 2026-08-31 07:18:46.168910 | mon1 | skipping: [osd1] 2026-08-31 07:18:46.169246 | mon1 | 2026-08-31 07:18:46.169575 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-31 07:18:46.169845 | mon1 | Monday 31 August 2026 07:18:46 +0000 (0:00:00.037) 0:00:34.097 ********* 2026-08-31 07:18:46.945012 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:18:46.945116 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:18:46.945240 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:18:46.945334 | mon1 | 2026-08-31 07:18:46.945445 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-31 07:18:46.945557 | mon1 | Monday 31 August 2026 07:18:46 +0000 (0:00:00.776) 0:00:34.874 ********* 2026-08-31 07:18:47.829151 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:18:47.829305 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:18:47.829318 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:18:47.829433 | mon1 | 2026-08-31 07:18:47.829580 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-31 07:18:47.829681 | mon1 | Monday 31 August 2026 07:18:47 +0000 (0:00:00.883) 0:00:35.758 ********* 2026-08-31 07:18:48.793108 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:18:48.793286 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:18:48.793510 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:18:48.793712 | mon1 | 2026-08-31 07:18:48.794122 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-31 07:18:48.795851 | mon1 | Monday 31 August 2026 07:18:48 +0000 (0:00:00.963) 0:00:36.721 ********* 2026-08-31 07:18:50.498869 | mon1 | changed: [osd1] => (item=osd0) 2026-08-31 07:18:50.499042 | mon1 | changed: [osd1] => (item=osd1) 2026-08-31 07:18:50.499312 | mon1 | changed: [osd1] => (item=osd2) 2026-08-31 07:18:50.499531 | mon1 | 2026-08-31 07:18:50.499777 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-31 07:18:50.499981 | mon1 | Monday 31 August 2026 07:18:50 +0000 (0:00:01.705) 0:00:38.427 ********* 2026-08-31 07:18:52.099249 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-31 07:18:52.100371 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-31 07:18:52.100441 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-31 07:18:52.100451 | mon1 | 2026-08-31 07:18:52.100461 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:18:52.100478 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-31 07:18:52.101174 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-31 07:18:52.101238 | mon1 | 2026-08-31 07:18:52.101248 | mon1 | 2026-08-31 07:18:52.101263 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:18:52.101539 | mon1 | Monday 31 August 2026 07:18:52 +0000 (0:00:01.601) 0:00:40.029 ********* 2026-08-31 07:18:52.103260 | mon1 | =============================================================================== 2026-08-31 07:18:52.103297 | mon1 | Install depedencies ---------------------------------------------------- 21.17s 2026-08-31 07:18:52.103306 | mon1 | Update apt cache -------------------------------------------------------- 5.94s 2026-08-31 07:18:52.103314 | mon1 | Gathering Facts --------------------------------------------------------- 2.43s 2026-08-31 07:18:52.103322 | mon1 | Create a volume group for each loop device ------------------------------ 1.71s 2026-08-31 07:18:52.103330 | mon1 | Create a logical volume for each loop device ---------------------------- 1.60s 2026-08-31 07:18:52.103338 | mon1 | Start loop devices ------------------------------------------------------ 0.96s 2026-08-31 07:18:52.105140 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.92s 2026-08-31 07:18:52.105187 | mon1 | Gathering Facts --------------------------------------------------------- 0.91s 2026-08-31 07:18:52.105197 | mon1 | Set permissions on loopback devices ------------------------------------- 0.88s 2026-08-31 07:18:52.105206 | mon1 | Configure short hostname ------------------------------------------------ 0.86s 2026-08-31 07:18:52.105216 | mon1 | Create devices for Ceph ------------------------------------------------- 0.78s 2026-08-31 07:18:52.105224 | mon1 | Start up service -------------------------------------------------------- 0.71s 2026-08-31 07:18:52.105233 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.42s 2026-08-31 07:18:52.105242 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.39s 2026-08-31 07:18:52.105459 | mon1 | Get list of all loopback devices ---------------------------------------- 0.28s 2026-08-31 07:18:52.105744 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.04s 2026-08-31 07:18:52.212134 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-31 07:18:52.225861 | mon1 | INFO [default > converge] Executing 2026-08-31 07:18:53.418797 | mon1 | 2026-08-31 07:18:53.419257 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-31 07:18:53.419544 | mon1 | 2026-08-31 07:18:53.419894 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:18:53.420245 | mon1 | Monday 31 August 2026 07:18:53 +0000 (0:00:00.057) 0:00:00.057 ********* 2026-08-31 07:18:54.707942 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:18:54.708193 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:18:54.708461 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:18:54.708666 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:18:54.708934 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:18:54.728851 | mon1 | ok: [mon1] 2026-08-31 07:18:54.729031 | mon1 | 2026-08-31 07:18:54.729297 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:18:54.729512 | mon1 | Monday 31 August 2026 07:18:54 +0000 (0:00:01.309) 0:00:01.367 ********* 2026-08-31 07:18:55.128561 | mon1 | ok: [mon1] 2026-08-31 07:18:55.128624 | mon1 | 2026-08-31 07:18:55.128721 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:55.128845 | mon1 | Monday 31 August 2026 07:18:55 +0000 (0:00:00.400) 0:00:01.767 ********* 2026-08-31 07:18:55.178030 | mon1 | skipping: [mon1] 2026-08-31 07:18:55.178124 | mon1 | 2026-08-31 07:18:55.178196 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:18:55.178297 | mon1 | Monday 31 August 2026 07:18:55 +0000 (0:00:00.049) 0:00:01.817 ********* 2026-08-31 07:18:55.580157 | mon1 | changed: [mon1] 2026-08-31 07:18:55.580208 | mon1 | 2026-08-31 07:18:55.580543 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:18:55.580889 | mon1 | Monday 31 August 2026 07:18:55 +0000 (0:00:00.401) 0:00:02.218 ********* 2026-08-31 07:18:55.686937 | mon1 | ok: [mon1] => { 2026-08-31 07:18:55.687212 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:18:55.687479 | mon1 | } 2026-08-31 07:18:55.687814 | mon1 | 2026-08-31 07:18:55.688102 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:18:55.688336 | mon1 | Monday 31 August 2026 07:18:55 +0000 (0:00:00.107) 0:00:02.325 ********* 2026-08-31 07:18:56.441362 | mon1 | changed: [mon1] 2026-08-31 07:18:56.441454 | mon1 | 2026-08-31 07:18:56.441985 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:18:56.442045 | mon1 | Monday 31 August 2026 07:18:56 +0000 (0:00:00.753) 0:00:03.078 ********* 2026-08-31 07:18:56.503122 | mon1 | skipping: [mon1] 2026-08-31 07:18:56.503210 | mon1 | 2026-08-31 07:18:56.503229 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:56.503472 | mon1 | Monday 31 August 2026 07:18:56 +0000 (0:00:00.060) 0:00:03.139 ********* 2026-08-31 07:18:56.553637 | mon1 | skipping: [mon1] 2026-08-31 07:18:56.553677 | mon1 | 2026-08-31 07:18:56.553687 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:18:56.553696 | mon1 | Monday 31 August 2026 07:18:56 +0000 (0:00:00.051) 0:00:03.191 ********* 2026-08-31 07:18:56.872677 | mon1 | ok: [mon1] 2026-08-31 07:18:56.872760 | mon1 | 2026-08-31 07:18:56.872771 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:18:56.872780 | mon1 | Monday 31 August 2026 07:18:56 +0000 (0:00:00.319) 0:00:03.510 ********* 2026-08-31 07:18:58.282959 | mon1 | ok: [mon1] 2026-08-31 07:18:58.283799 | mon1 | 2026-08-31 07:18:58.283886 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:18:58.283897 | mon1 | Monday 31 August 2026 07:18:58 +0000 (0:00:01.410) 0:00:04.920 ********* 2026-08-31 07:18:58.539910 | mon1 | ok: [mon1] => { 2026-08-31 07:18:58.539974 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:18:58.540008 | mon1 | } 2026-08-31 07:18:58.540014 | mon1 | 2026-08-31 07:18:58.540019 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:18:58.540025 | mon1 | Monday 31 August 2026 07:18:58 +0000 (0:00:00.256) 0:00:05.176 ********* 2026-08-31 07:18:59.521900 | mon1 | changed: [mon1] 2026-08-31 07:18:59.521963 | mon1 | 2026-08-31 07:18:59.521976 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:18:59.521988 | mon1 | Monday 31 August 2026 07:18:59 +0000 (0:00:00.981) 0:00:06.158 ********* 2026-08-31 07:19:02.930019 | mon1 | changed: [mon1] 2026-08-31 07:19:02.930138 | mon1 | 2026-08-31 07:19:02.930161 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:19:02.930174 | mon1 | Monday 31 August 2026 07:19:02 +0000 (0:00:03.408) 0:00:09.566 ********* 2026-08-31 07:19:02.975188 | mon1 | skipping: [mon1] 2026-08-31 07:19:02.975477 | mon1 | 2026-08-31 07:19:02.976143 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:19:02.976171 | mon1 | Monday 31 August 2026 07:19:02 +0000 (0:00:00.045) 0:00:09.612 ********* 2026-08-31 07:19:03.020513 | mon1 | skipping: [mon1] 2026-08-31 07:19:03.020575 | mon1 | 2026-08-31 07:19:03.020581 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:19:03.020586 | mon1 | Monday 31 August 2026 07:19:03 +0000 (0:00:00.045) 0:00:09.658 ********* 2026-08-31 07:19:03.062385 | mon1 | skipping: [mon1] 2026-08-31 07:19:03.062428 | mon1 | 2026-08-31 07:19:03.062436 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:19:03.062442 | mon1 | Monday 31 August 2026 07:19:03 +0000 (0:00:00.042) 0:00:09.700 ********* 2026-08-31 07:19:12.666217 | mon1 | changed: [mon1] 2026-08-31 07:19:12.666318 | mon1 | 2026-08-31 07:19:12.666796 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:19:12.666897 | mon1 | Monday 31 August 2026 07:19:12 +0000 (0:00:09.602) 0:00:19.303 ********* 2026-08-31 07:19:13.440850 | mon1 | changed: [mon1] 2026-08-31 07:19:13.440911 | mon1 | 2026-08-31 07:19:13.440927 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:19:13.440940 | mon1 | Monday 31 August 2026 07:19:13 +0000 (0:00:00.773) 0:00:20.077 ********* 2026-08-31 07:19:14.728912 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:19:14.728983 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:19:14.728992 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:19:14.728999 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:19:14.729006 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:19:14.729015 | mon1 | 2026-08-31 07:19:14.729023 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:19:14.729030 | mon1 | Monday 31 August 2026 07:19:14 +0000 (0:00:01.288) 0:00:21.366 ********* 2026-08-31 07:19:15.648920 | mon1 | changed: [mon1] 2026-08-31 07:19:15.648992 | mon1 | 2026-08-31 07:19:15.649006 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:19:15.649018 | mon1 | Monday 31 August 2026 07:19:15 +0000 (0:00:00.901) 0:00:22.267 ********* 2026-08-31 07:19:15.649029 | mon1 | 2026-08-31 07:19:15.649041 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:19:15.649052 | mon1 | Monday 31 August 2026 07:19:15 +0000 (0:00:00.016) 0:00:22.284 ********* 2026-08-31 07:19:16.892133 | mon1 | ok: [mon1] 2026-08-31 07:19:16.892236 | mon1 | 2026-08-31 07:19:16.892250 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-31 07:19:16.892262 | mon1 | Monday 31 August 2026 07:19:16 +0000 (0:00:01.245) 0:00:23.529 ********* 2026-08-31 07:19:17.570897 | mon1 | changed: [mon1] 2026-08-31 07:19:17.570983 | mon1 | 2026-08-31 07:19:17.571003 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:19:17.571008 | mon1 | Monday 31 August 2026 07:19:17 +0000 (0:00:00.680) 0:00:24.209 ********* 2026-08-31 07:19:18.372173 | mon1 | changed: [mon1] 2026-08-31 07:19:18.372243 | mon1 | 2026-08-31 07:19:18.372254 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:19:18.372263 | mon1 | Monday 31 August 2026 07:19:18 +0000 (0:00:00.800) 0:00:25.009 ********* 2026-08-31 07:19:18.664999 | mon1 | ok: [mon1] 2026-08-31 07:19:18.665065 | mon1 | 2026-08-31 07:19:18.665071 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:19:18.665077 | mon1 | Monday 31 August 2026 07:19:18 +0000 (0:00:00.293) 0:00:25.303 ********* 2026-08-31 07:19:18.803448 | mon1 | ok: [mon1] => { 2026-08-31 07:19:18.803526 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:19:18.803537 | mon1 | } 2026-08-31 07:19:18.803547 | mon1 | 2026-08-31 07:19:18.803557 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:19:18.803567 | mon1 | Monday 31 August 2026 07:19:18 +0000 (0:00:00.137) 0:00:25.440 ********* 2026-08-31 07:19:22.869024 | mon1 | changed: [mon1] 2026-08-31 07:19:22.869137 | mon1 | 2026-08-31 07:19:22.869171 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:19:22.869184 | mon1 | Monday 31 August 2026 07:19:22 +0000 (0:00:04.065) 0:00:29.505 ********* 2026-08-31 07:19:27.694659 | mon1 | changed: [mon1] 2026-08-31 07:19:27.694738 | mon1 | 2026-08-31 07:19:27.694748 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:19:27.694756 | mon1 | Monday 31 August 2026 07:19:27 +0000 (0:00:04.826) 0:00:34.332 ********* 2026-08-31 07:19:28.886523 | mon1 | ok: [mon1] 2026-08-31 07:19:28.886591 | mon1 | 2026-08-31 07:19:28.886600 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:19:28.886609 | mon1 | Monday 31 August 2026 07:19:28 +0000 (0:00:01.191) 0:00:35.523 ********* 2026-08-31 07:19:29.401762 | mon1 | changed: [mon1] 2026-08-31 07:19:29.401836 | mon1 | 2026-08-31 07:19:29.401853 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:19:29.401869 | mon1 | Monday 31 August 2026 07:19:29 +0000 (0:00:00.514) 0:00:36.038 ********* 2026-08-31 07:19:30.089917 | mon1 | changed: [mon1] 2026-08-31 07:19:30.089982 | mon1 | 2026-08-31 07:19:30.089996 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:19:30.090010 | mon1 | Monday 31 August 2026 07:19:30 +0000 (0:00:00.689) 0:00:36.727 ********* 2026-08-31 07:19:30.959369 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:19:30.959463 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:19:30.959476 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:19:30.959489 | mon1 | 2026-08-31 07:19:30.959509 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:19:30.959647 | mon1 | Monday 31 August 2026 07:19:30 +0000 (0:00:00.869) 0:00:37.596 ********* 2026-08-31 07:19:31.612732 | mon1 | changed: [mon1] 2026-08-31 07:19:31.612794 | mon1 | 2026-08-31 07:19:31.612807 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:19:31.612820 | mon1 | Monday 31 August 2026 07:19:31 +0000 (0:00:00.653) 0:00:38.250 ********* 2026-08-31 07:19:32.293764 | mon1 | changed: [mon1] 2026-08-31 07:19:32.293814 | mon1 | 2026-08-31 07:19:32.293822 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:19:32.293831 | mon1 | Monday 31 August 2026 07:19:32 +0000 (0:00:00.667) 0:00:38.917 ********* 2026-08-31 07:19:32.293838 | mon1 | 2026-08-31 07:19:32.293846 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:19:32.293853 | mon1 | Monday 31 August 2026 07:19:32 +0000 (0:00:00.013) 0:00:38.931 ********* 2026-08-31 07:19:33.314262 | mon1 | ok: [mon1] 2026-08-31 07:19:33.314321 | mon1 | 2026-08-31 07:19:33.314329 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-31 07:19:33.314337 | mon1 | Monday 31 August 2026 07:19:33 +0000 (0:00:01.019) 0:00:39.950 ********* 2026-08-31 07:19:34.394992 | mon1 | changed: [mon1] 2026-08-31 07:19:34.395060 | mon1 | 2026-08-31 07:19:34.395074 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:19:34.395151 | mon1 | Monday 31 August 2026 07:19:34 +0000 (0:00:01.082) 0:00:41.032 ********* 2026-08-31 07:19:36.247047 | mon1 | changed: [mon1] 2026-08-31 07:19:36.247168 | mon1 | 2026-08-31 07:19:36.247182 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:19:36.247195 | mon1 | Monday 31 August 2026 07:19:36 +0000 (0:00:01.851) 0:00:42.883 ********* 2026-08-31 07:19:36.330883 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:19:36.330950 | mon1 | 2026-08-31 07:19:36.330964 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:19:36.330976 | mon1 | Monday 31 August 2026 07:19:36 +0000 (0:00:00.083) 0:00:42.967 ********* 2026-08-31 07:19:57.187222 | mon1 | changed: [mon1] 2026-08-31 07:19:57.187288 | mon1 | 2026-08-31 07:19:57.187294 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:19:57.187450 | mon1 | Monday 31 August 2026 07:19:57 +0000 (0:00:20.857) 0:01:03.825 ********* 2026-08-31 07:19:58.017846 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:19:58.017905 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:19:58.017919 | mon1 | 2026-08-31 07:19:58.017931 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:19:58.017944 | mon1 | Monday 31 August 2026 07:19:58 +0000 (0:00:00.829) 0:01:04.655 ********* 2026-08-31 07:19:59.015820 | mon1 | changed: [mon1] 2026-08-31 07:19:59.015902 | mon1 | 2026-08-31 07:19:59.015920 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:19:59.015936 | mon1 | Monday 31 August 2026 07:19:59 +0000 (0:00:00.997) 0:01:05.653 ********* 2026-08-31 07:19:59.316185 | mon1 | ok: [mon1] 2026-08-31 07:19:59.316259 | mon1 | 2026-08-31 07:19:59.316440 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:19:59.316679 | mon1 | Monday 31 August 2026 07:19:59 +0000 (0:00:00.301) 0:01:05.954 ********* 2026-08-31 07:19:59.886626 | mon1 | changed: [mon1] 2026-08-31 07:19:59.886873 | mon1 | 2026-08-31 07:19:59.887242 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:19:59.887497 | mon1 | Monday 31 August 2026 07:19:59 +0000 (0:00:00.571) 0:01:06.525 ********* 2026-08-31 07:20:00.263172 | mon1 | changed: [mon1] 2026-08-31 07:20:00.263384 | mon1 | 2026-08-31 07:20:00.263672 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-31 07:20:00.263916 | mon1 | Monday 31 August 2026 07:20:00 +0000 (0:00:00.376) 0:01:06.901 ********* 2026-08-31 07:20:00.429898 | mon1 | ok: [mon1] 2026-08-31 07:20:00.430135 | mon1 | 2026-08-31 07:20:00.430391 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-31 07:20:00.430626 | mon1 | Monday 31 August 2026 07:20:00 +0000 (0:00:00.166) 0:01:07.068 ********* 2026-08-31 07:20:00.715003 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:20:00.715293 | mon1 | 2026-08-31 07:20:00.715533 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-31 07:20:00.715759 | mon1 | Monday 31 August 2026 07:20:00 +0000 (0:00:00.285) 0:01:07.353 ********* 2026-08-31 07:20:00.788423 | mon1 | ok: [mon1] 2026-08-31 07:20:00.788628 | mon1 | 2026-08-31 07:20:00.788910 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-31 07:20:00.789313 | mon1 | Monday 31 August 2026 07:20:00 +0000 (0:00:00.073) 0:01:07.427 ********* 2026-08-31 07:20:00.885446 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-08-31 07:20:00.885691 | mon1 | 2026-08-31 07:20:00.886044 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-08-31 07:20:00.886365 | mon1 | Monday 31 August 2026 07:20:00 +0000 (0:00:00.097) 0:01:07.524 ********* 2026-08-31 07:20:01.233724 | mon1 | changed: [mon1] 2026-08-31 07:20:01.233841 | mon1 | 2026-08-31 07:20:01.233923 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-08-31 07:20:01.234048 | mon1 | Monday 31 August 2026 07:20:01 +0000 (0:00:00.348) 0:01:07.872 ********* 2026-08-31 07:20:02.047593 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-08-31 07:20:02.047991 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-08-31 07:20:02.048332 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-08-31 07:20:02.048562 | mon1 | 2026-08-31 07:20:02.048838 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-08-31 07:20:02.049157 | mon1 | Monday 31 August 2026 07:20:02 +0000 (0:00:00.813) 0:01:08.686 ********* 2026-08-31 07:21:38.006658 | mon1 | ok: [mon1] 2026-08-31 07:21:38.006739 | mon1 | 2026-08-31 07:21:38.006754 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-08-31 07:21:38.006762 | mon1 | Monday 31 August 2026 07:21:37 +0000 (0:01:35.950) 0:02:44.636 ********* 2026-08-31 07:21:38.340768 | mon1 | changed: [mon1] 2026-08-31 07:21:38.340848 | mon1 | 2026-08-31 07:21:38.340890 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-08-31 07:21:38.341010 | mon1 | Monday 31 August 2026 07:21:38 +0000 (0:00:00.342) 0:02:44.979 ********* 2026-08-31 07:21:38.391832 | mon1 | ok: [mon1] 2026-08-31 07:21:38.391899 | mon1 | 2026-08-31 07:21:38.392014 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:21:38.392158 | mon1 | Monday 31 August 2026 07:21:38 +0000 (0:00:00.051) 0:02:45.030 ********* 2026-08-31 07:21:38.483488 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:21:38.483675 | mon1 | 2026-08-31 07:21:38.484122 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:21:38.484428 | mon1 | Monday 31 August 2026 07:21:38 +0000 (0:00:00.092) 0:02:45.122 ********* 2026-08-31 07:21:40.355159 | mon1 | ok: [mon1] 2026-08-31 07:21:40.355232 | mon1 | 2026-08-31 07:21:40.355243 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:21:40.355254 | mon1 | Monday 31 August 2026 07:21:40 +0000 (0:00:01.869) 0:02:46.992 ********* 2026-08-31 07:21:40.441549 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:21:40.441646 | mon1 | 2026-08-31 07:21:40.441796 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:21:40.441941 | mon1 | Monday 31 August 2026 07:21:40 +0000 (0:00:00.087) 0:02:47.079 ********* 2026-08-31 07:21:40.939014 | mon1 | ok: [mon1] 2026-08-31 07:21:40.939260 | mon1 | 2026-08-31 07:21:40.939520 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:21:40.939774 | mon1 | Monday 31 August 2026 07:21:40 +0000 (0:00:00.498) 0:02:47.578 ********* 2026-08-31 07:21:43.766481 | mon1 | ok: [mon1] 2026-08-31 07:21:43.766577 | mon1 | 2026-08-31 07:21:43.766816 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-31 07:21:43.767075 | mon1 | Monday 31 August 2026 07:21:43 +0000 (0:00:02.826) 0:02:50.404 ********* 2026-08-31 07:21:47.585272 | mon1 | changed: [mon1] 2026-08-31 07:21:47.585323 | mon1 | 2026-08-31 07:21:47.585792 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-31 07:21:47.585823 | mon1 | Monday 31 August 2026 07:21:47 +0000 (0:00:03.819) 0:02:54.223 ********* 2026-08-31 07:21:49.506634 | mon1 | ok: [mon1] 2026-08-31 07:21:49.506767 | mon1 | 2026-08-31 07:21:49.506785 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:21:49.506806 | mon1 | Monday 31 August 2026 07:21:49 +0000 (0:00:01.920) 0:02:56.144 ********* 2026-08-31 07:21:49.589048 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:21:49.589191 | mon1 | 2026-08-31 07:21:49.589203 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:21:49.589365 | mon1 | Monday 31 August 2026 07:21:49 +0000 (0:00:00.084) 0:02:56.228 ********* 2026-08-31 07:21:49.665811 | mon1 | skipping: [mon1] 2026-08-31 07:21:49.666026 | mon1 | 2026-08-31 07:21:49.666349 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:21:49.666592 | mon1 | Monday 31 August 2026 07:21:49 +0000 (0:00:00.075) 0:02:56.303 ********* 2026-08-31 07:21:49.730768 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-31 07:21:49.730954 | mon1 | skipping: [mon1] 2026-08-31 07:21:49.731256 | mon1 | 2026-08-31 07:21:49.731498 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:21:49.731728 | mon1 | Monday 31 August 2026 07:21:49 +0000 (0:00:00.064) 0:02:56.368 ********* 2026-08-31 07:21:50.107902 | mon1 | ok: [mon1] 2026-08-31 07:21:50.108517 | mon1 | 2026-08-31 07:21:50.108537 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:21:50.108671 | mon1 | Monday 31 August 2026 07:21:50 +0000 (0:00:00.377) 0:02:56.745 ********* 2026-08-31 07:21:52.929301 | mon1 | ok: [mon1] 2026-08-31 07:21:52.929369 | mon1 | 2026-08-31 07:21:52.929378 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-31 07:21:52.929386 | mon1 | Monday 31 August 2026 07:21:52 +0000 (0:00:02.821) 0:02:59.567 ********* 2026-08-31 07:21:56.438491 | mon1 | changed: [mon1] 2026-08-31 07:21:56.438591 | mon1 | 2026-08-31 07:21:56.438905 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-31 07:21:56.439266 | mon1 | Monday 31 August 2026 07:21:56 +0000 (0:00:03.508) 0:03:03.076 ********* 2026-08-31 07:21:58.277013 | mon1 | ok: [mon1] 2026-08-31 07:21:58.277680 | mon1 | 2026-08-31 07:21:58.277698 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-31 07:21:58.277707 | mon1 | Monday 31 August 2026 07:21:58 +0000 (0:00:01.839) 0:03:04.915 ********* 2026-08-31 07:22:05.991506 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-31 07:22:05.991563 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-31 07:22:05.991577 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-31 07:22:05.991588 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-31 07:22:05.991600 | mon1 | 2026-08-31 07:22:05.991613 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-31 07:22:05.991625 | mon1 | 2026-08-31 07:22:05.991637 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:22:05.991648 | mon1 | Monday 31 August 2026 07:22:05 +0000 (0:00:07.713) 0:03:12.628 ********* 2026-08-31 07:22:07.308847 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:22:07.308925 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:22:07.308944 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:22:07.308959 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:22:07.308974 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:22:07.319141 | mon1 | ok: [osd1] 2026-08-31 07:22:07.319178 | mon1 | 2026-08-31 07:22:07.319184 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:22:07.319190 | mon1 | Monday 31 August 2026 07:22:07 +0000 (0:00:01.327) 0:03:13.956 ********* 2026-08-31 07:22:07.617130 | mon1 | ok: [osd1] 2026-08-31 07:22:07.617176 | mon1 | 2026-08-31 07:22:07.617185 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:22:07.617231 | mon1 | Monday 31 August 2026 07:22:07 +0000 (0:00:00.298) 0:03:14.255 ********* 2026-08-31 07:22:07.663720 | mon1 | skipping: [osd1] 2026-08-31 07:22:07.663920 | mon1 | 2026-08-31 07:22:07.664216 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:22:07.664472 | mon1 | Monday 31 August 2026 07:22:07 +0000 (0:00:00.047) 0:03:14.303 ********* 2026-08-31 07:22:07.988310 | mon1 | changed: [osd1] 2026-08-31 07:22:07.988480 | mon1 | 2026-08-31 07:22:07.988718 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:22:07.988946 | mon1 | Monday 31 August 2026 07:22:07 +0000 (0:00:00.323) 0:03:14.626 ********* 2026-08-31 07:22:08.082507 | mon1 | ok: [osd1] => { 2026-08-31 07:22:08.082778 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:22:08.083036 | mon1 | } 2026-08-31 07:22:08.083317 | mon1 | 2026-08-31 07:22:08.085645 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:22:08.085676 | mon1 | Monday 31 August 2026 07:22:08 +0000 (0:00:00.094) 0:03:14.721 ********* 2026-08-31 07:22:08.872929 | mon1 | changed: [osd1] 2026-08-31 07:22:08.873163 | mon1 | 2026-08-31 07:22:08.873479 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:22:08.873715 | mon1 | Monday 31 August 2026 07:22:08 +0000 (0:00:00.789) 0:03:15.510 ********* 2026-08-31 07:22:08.936552 | mon1 | skipping: [osd1] 2026-08-31 07:22:08.936746 | mon1 | 2026-08-31 07:22:08.936990 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:22:08.937360 | mon1 | Monday 31 August 2026 07:22:08 +0000 (0:00:00.065) 0:03:15.575 ********* 2026-08-31 07:22:09.009180 | mon1 | skipping: [osd1] 2026-08-31 07:22:09.009247 | mon1 | 2026-08-31 07:22:09.009336 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:22:09.009517 | mon1 | Monday 31 August 2026 07:22:09 +0000 (0:00:00.072) 0:03:15.647 ********* 2026-08-31 07:22:09.309257 | mon1 | ok: [osd1] 2026-08-31 07:22:09.309436 | mon1 | 2026-08-31 07:22:09.309690 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:22:09.309922 | mon1 | Monday 31 August 2026 07:22:09 +0000 (0:00:00.299) 0:03:15.947 ********* 2026-08-31 07:22:10.460462 | mon1 | ok: [osd1] 2026-08-31 07:22:10.460940 | mon1 | 2026-08-31 07:22:10.460956 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:22:10.461196 | mon1 | Monday 31 August 2026 07:22:10 +0000 (0:00:01.150) 0:03:17.098 ********* 2026-08-31 07:22:10.577684 | mon1 | ok: [osd1] => { 2026-08-31 07:22:10.579164 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:22:10.579199 | mon1 | } 2026-08-31 07:22:10.579209 | mon1 | 2026-08-31 07:22:10.579232 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:22:10.579241 | mon1 | Monday 31 August 2026 07:22:10 +0000 (0:00:00.117) 0:03:17.216 ********* 2026-08-31 07:22:11.586074 | mon1 | changed: [osd1] 2026-08-31 07:22:11.586174 | mon1 | 2026-08-31 07:22:11.586188 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:22:11.586200 | mon1 | Monday 31 August 2026 07:22:11 +0000 (0:00:01.007) 0:03:18.223 ********* 2026-08-31 07:22:14.674048 | mon1 | changed: [osd1] 2026-08-31 07:22:14.674168 | mon1 | 2026-08-31 07:22:14.674187 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:22:14.674203 | mon1 | Monday 31 August 2026 07:22:14 +0000 (0:00:03.087) 0:03:21.311 ********* 2026-08-31 07:22:14.719852 | mon1 | skipping: [osd1] 2026-08-31 07:22:14.719921 | mon1 | 2026-08-31 07:22:14.719935 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:22:14.719947 | mon1 | Monday 31 August 2026 07:22:14 +0000 (0:00:00.044) 0:03:21.356 ********* 2026-08-31 07:22:14.764599 | mon1 | skipping: [osd1] 2026-08-31 07:22:14.764667 | mon1 | 2026-08-31 07:22:14.764680 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:22:14.764693 | mon1 | Monday 31 August 2026 07:22:14 +0000 (0:00:00.045) 0:03:21.402 ********* 2026-08-31 07:22:14.810260 | mon1 | skipping: [osd1] 2026-08-31 07:22:14.810319 | mon1 | 2026-08-31 07:22:14.810339 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:22:14.810650 | mon1 | Monday 31 August 2026 07:22:14 +0000 (0:00:00.045) 0:03:21.448 ********* 2026-08-31 07:22:22.931494 | mon1 | changed: [osd1] 2026-08-31 07:22:22.931587 | mon1 | 2026-08-31 07:22:22.931594 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:22:22.931602 | mon1 | Monday 31 August 2026 07:22:22 +0000 (0:00:08.120) 0:03:29.569 ********* 2026-08-31 07:22:23.541761 | mon1 | changed: [osd1] 2026-08-31 07:22:23.541817 | mon1 | 2026-08-31 07:22:23.541830 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:22:23.541844 | mon1 | Monday 31 August 2026 07:22:23 +0000 (0:00:00.609) 0:03:30.179 ********* 2026-08-31 07:22:24.821818 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:22:24.823608 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:22:24.823642 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:22:24.823655 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:22:24.823666 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:22:24.823678 | mon1 | 2026-08-31 07:22:24.823690 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:22:24.823701 | mon1 | Monday 31 August 2026 07:22:24 +0000 (0:00:01.280) 0:03:31.459 ********* 2026-08-31 07:22:25.617255 | mon1 | changed: [osd1] 2026-08-31 07:22:25.617345 | mon1 | 2026-08-31 07:22:25.617359 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:22:25.617372 | mon1 | Monday 31 August 2026 07:22:25 +0000 (0:00:00.782) 0:03:32.241 ********* 2026-08-31 07:22:25.617383 | mon1 | 2026-08-31 07:22:25.617402 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:22:25.617505 | mon1 | Monday 31 August 2026 07:22:25 +0000 (0:00:00.012) 0:03:32.254 ********* 2026-08-31 07:22:26.570634 | mon1 | ok: [osd1] 2026-08-31 07:22:26.570823 | mon1 | 2026-08-31 07:22:26.571191 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-31 07:22:26.571547 | mon1 | Monday 31 August 2026 07:22:26 +0000 (0:00:00.955) 0:03:33.209 ********* 2026-08-31 07:22:27.253179 | mon1 | changed: [osd1] 2026-08-31 07:22:27.253380 | mon1 | 2026-08-31 07:22:27.253622 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:22:27.254013 | mon1 | Monday 31 August 2026 07:22:27 +0000 (0:00:00.682) 0:03:33.892 ********* 2026-08-31 07:22:28.080300 | mon1 | changed: [osd1] 2026-08-31 07:22:28.080392 | mon1 | 2026-08-31 07:22:28.080406 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:22:28.080534 | mon1 | Monday 31 August 2026 07:22:28 +0000 (0:00:00.825) 0:03:34.717 ********* 2026-08-31 07:22:28.390798 | mon1 | ok: [osd1] 2026-08-31 07:22:28.391000 | mon1 | 2026-08-31 07:22:28.391306 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:22:28.391625 | mon1 | Monday 31 August 2026 07:22:28 +0000 (0:00:00.310) 0:03:35.028 ********* 2026-08-31 07:22:28.479425 | mon1 | ok: [osd1] => { 2026-08-31 07:22:28.479461 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:22:28.479467 | mon1 | } 2026-08-31 07:22:28.479473 | mon1 | 2026-08-31 07:22:28.479486 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:22:28.479492 | mon1 | Monday 31 August 2026 07:22:28 +0000 (0:00:00.088) 0:03:35.117 ********* 2026-08-31 07:22:30.392256 | mon1 | changed: [osd1] 2026-08-31 07:22:30.392316 | mon1 | 2026-08-31 07:22:30.392667 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:22:30.392699 | mon1 | Monday 31 August 2026 07:22:30 +0000 (0:00:01.912) 0:03:37.030 ********* 2026-08-31 07:22:35.119070 | mon1 | changed: [osd1] 2026-08-31 07:22:35.119196 | mon1 | 2026-08-31 07:22:35.119205 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:22:35.119213 | mon1 | Monday 31 August 2026 07:22:35 +0000 (0:00:04.725) 0:03:41.755 ********* 2026-08-31 07:22:36.108197 | mon1 | ok: [osd1] 2026-08-31 07:22:36.108272 | mon1 | 2026-08-31 07:22:36.108745 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:22:36.108783 | mon1 | Monday 31 August 2026 07:22:36 +0000 (0:00:00.990) 0:03:42.745 ********* 2026-08-31 07:22:36.470883 | mon1 | changed: [osd1] 2026-08-31 07:22:36.471186 | mon1 | 2026-08-31 07:22:36.471483 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:22:36.471732 | mon1 | Monday 31 August 2026 07:22:36 +0000 (0:00:00.363) 0:03:43.109 ********* 2026-08-31 07:22:37.165586 | mon1 | changed: [osd1] 2026-08-31 07:22:37.165648 | mon1 | 2026-08-31 07:22:37.165655 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:22:37.165661 | mon1 | Monday 31 August 2026 07:22:37 +0000 (0:00:00.693) 0:03:43.802 ********* 2026-08-31 07:22:37.960281 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-31 07:22:37.960360 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:22:37.960371 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:22:37.960380 | mon1 | 2026-08-31 07:22:37.960389 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:22:37.960470 | mon1 | Monday 31 August 2026 07:22:37 +0000 (0:00:00.794) 0:03:44.596 ********* 2026-08-31 07:22:38.600809 | mon1 | changed: [osd1] 2026-08-31 07:22:38.601116 | mon1 | 2026-08-31 07:22:38.601382 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:22:38.601638 | mon1 | Monday 31 August 2026 07:22:38 +0000 (0:00:00.641) 0:03:45.238 ********* 2026-08-31 07:22:39.263636 | mon1 | changed: [osd1] 2026-08-31 07:22:39.263821 | mon1 | 2026-08-31 07:22:39.264120 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:22:39.264354 | mon1 | Monday 31 August 2026 07:22:39 +0000 (0:00:00.650) 0:03:45.889 ********* 2026-08-31 07:22:39.264560 | mon1 | 2026-08-31 07:22:39.264794 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-31 07:22:39.265044 | mon1 | Monday 31 August 2026 07:22:39 +0000 (0:00:00.012) 0:03:45.902 ********* 2026-08-31 07:22:40.231155 | mon1 | ok: [osd1] 2026-08-31 07:22:40.231225 | mon1 | 2026-08-31 07:22:40.231421 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-31 07:22:40.231651 | mon1 | Monday 31 August 2026 07:22:40 +0000 (0:00:00.966) 0:03:46.869 ********* 2026-08-31 07:22:41.453610 | mon1 | changed: [osd1] 2026-08-31 07:22:41.454306 | mon1 | 2026-08-31 07:22:41.454377 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:22:41.454527 | mon1 | Monday 31 August 2026 07:22:41 +0000 (0:00:01.223) 0:03:48.092 ********* 2026-08-31 07:22:42.218795 | mon1 | changed: [osd1] 2026-08-31 07:22:42.218988 | mon1 | 2026-08-31 07:22:42.219553 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:22:42.219608 | mon1 | Monday 31 August 2026 07:22:42 +0000 (0:00:00.764) 0:03:48.856 ********* 2026-08-31 07:22:42.309198 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:22:42.309252 | mon1 | 2026-08-31 07:22:42.309277 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:22:42.309580 | mon1 | Monday 31 August 2026 07:22:42 +0000 (0:00:00.089) 0:03:48.946 ********* 2026-08-31 07:22:43.418734 | mon1 | ok: [osd1] 2026-08-31 07:22:43.418804 | mon1 | 2026-08-31 07:22:43.418817 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:22:43.418830 | mon1 | Monday 31 August 2026 07:22:43 +0000 (0:00:01.109) 0:03:50.055 ********* 2026-08-31 07:22:44.412227 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-31 07:22:44.412489 | mon1 | ok: [osd1] => (item=ssh) 2026-08-31 07:22:44.412496 | mon1 | 2026-08-31 07:22:44.412501 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:22:44.412505 | mon1 | Monday 31 August 2026 07:22:44 +0000 (0:00:00.994) 0:03:51.050 ********* 2026-08-31 07:22:45.376331 | mon1 | changed: [osd1] 2026-08-31 07:22:45.376383 | mon1 | 2026-08-31 07:22:45.376390 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:22:45.376396 | mon1 | Monday 31 August 2026 07:22:45 +0000 (0:00:00.963) 0:03:52.014 ********* 2026-08-31 07:22:45.649697 | mon1 | ok: [osd1] 2026-08-31 07:22:45.649756 | mon1 | 2026-08-31 07:22:45.649766 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:22:45.649776 | mon1 | Monday 31 August 2026 07:22:45 +0000 (0:00:00.273) 0:03:52.287 ********* 2026-08-31 07:22:46.116615 | mon1 | changed: [osd1] 2026-08-31 07:22:46.116668 | mon1 | 2026-08-31 07:22:46.116678 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:22:46.116703 | mon1 | Monday 31 August 2026 07:22:46 +0000 (0:00:00.466) 0:03:52.754 ********* 2026-08-31 07:22:46.443361 | mon1 | changed: [osd1] 2026-08-31 07:22:46.443414 | mon1 | 2026-08-31 07:22:46.443420 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-31 07:22:46.443425 | mon1 | Monday 31 August 2026 07:22:46 +0000 (0:00:00.326) 0:03:53.080 ********* 2026-08-31 07:22:46.796215 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-31 07:22:46.796272 | mon1 | 2026-08-31 07:22:46.796281 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-31 07:22:46.796289 | mon1 | Monday 31 August 2026 07:22:46 +0000 (0:00:00.352) 0:03:53.433 ********* 2026-08-31 07:22:46.869623 | mon1 | ok: [osd1] 2026-08-31 07:22:46.869676 | mon1 | 2026-08-31 07:22:46.869690 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:22:46.869974 | mon1 | Monday 31 August 2026 07:22:46 +0000 (0:00:00.074) 0:03:53.507 ********* 2026-08-31 07:22:46.954203 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-31 07:22:46.954287 | mon1 | 2026-08-31 07:22:46.954301 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:22:46.954321 | mon1 | Monday 31 August 2026 07:22:46 +0000 (0:00:00.084) 0:03:53.592 ********* 2026-08-31 07:22:48.769011 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:22:48.769065 | mon1 | 2026-08-31 07:22:48.769071 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:22:48.769077 | mon1 | Monday 31 August 2026 07:22:48 +0000 (0:00:01.814) 0:03:55.406 ********* 2026-08-31 07:22:48.853162 | mon1 | ok: [osd1] => (item=osd1) 2026-08-31 07:22:48.853786 | mon1 | 2026-08-31 07:22:48.853831 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:22:48.853845 | mon1 | Monday 31 August 2026 07:22:48 +0000 (0:00:00.084) 0:03:55.490 ********* 2026-08-31 07:22:49.257614 | mon1 | changed: [osd1] 2026-08-31 07:22:49.257679 | mon1 | 2026-08-31 07:22:49.257693 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:22:49.257705 | mon1 | Monday 31 August 2026 07:22:49 +0000 (0:00:00.403) 0:03:55.894 ********* 2026-08-31 07:22:55.240769 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:22:55.240836 | mon1 | 2026-08-31 07:22:55.240850 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-31 07:22:55.240862 | mon1 | Monday 31 August 2026 07:22:55 +0000 (0:00:05.983) 0:04:01.877 ********* 2026-08-31 07:22:56.208034 | mon1 | ok: [osd1] 2026-08-31 07:22:56.208129 | mon1 | 2026-08-31 07:22:56.208151 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-31 07:22:56.208166 | mon1 | Monday 31 August 2026 07:22:56 +0000 (0:00:00.966) 0:04:02.844 ********* 2026-08-31 07:23:44.990522 | mon1 | ok: [osd1] 2026-08-31 07:23:44.990587 | mon1 | 2026-08-31 07:23:44.990738 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-31 07:23:44.990823 | mon1 | Monday 31 August 2026 07:23:44 +0000 (0:00:48.784) 0:04:51.628 ********* 2026-08-31 07:24:31.731412 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-31 07:24:31.731580 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-31 07:24:31.732600 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-31 07:24:31.732666 | mon1 | 2026-08-31 07:24:31.732681 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-31 07:24:31.732693 | mon1 | Monday 31 August 2026 07:24:31 +0000 (0:00:46.740) 0:05:38.369 ********* 2026-08-31 07:24:33.730317 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:24:33.730417 | mon1 | 2026-08-31 07:24:33.730451 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-31 07:24:33.730766 | mon1 | Monday 31 August 2026 07:24:33 +0000 (0:00:01.998) 0:05:40.367 ********* 2026-08-31 07:24:35.621970 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:24:35.622069 | mon1 | 2026-08-31 07:24:35.622125 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-31 07:24:35.622143 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:01.891) 0:05:42.259 ********* 2026-08-31 07:24:35.712215 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:24:35.712287 | mon1 | 2026-08-31 07:24:35.712295 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:24:35.712302 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.091) 0:05:42.350 ********* 2026-08-31 07:24:35.781000 | mon1 | ok: [osd1] 2026-08-31 07:24:35.781036 | mon1 | 2026-08-31 07:24:35.781042 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:24:35.781048 | mon1 | Monday 31 August 2026 07:24:35 +0000 (0:00:00.068) 0:05:42.419 ********* 2026-08-31 07:24:37.623160 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:24:37.623292 | mon1 | 2026-08-31 07:24:37.623311 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:24:37.623326 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:01.840) 0:05:44.259 ********* 2026-08-31 07:24:37.697928 | mon1 | ok: [osd1] 2026-08-31 07:24:37.697995 | mon1 | 2026-08-31 07:24:37.698009 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:24:37.698023 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:00.074) 0:05:44.334 ********* 2026-08-31 07:24:37.750490 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-08-31 07:24:37.772254 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:24:37.772332 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:24:37.773541 | mon1 | 2026-08-31 07:24:37.773578 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-08-31 07:24:37.773596 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:00.075) 0:05:44.409 ********* 2026-08-31 07:24:37.827277 | mon1 | skipping: [osd1] 2026-08-31 07:24:37.827338 | mon1 | 2026-08-31 07:24:37.827351 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-08-31 07:24:37.827364 | mon1 | Monday 31 August 2026 07:24:37 +0000 (0:00:00.054) 0:05:44.464 ********* 2026-08-31 07:24:42.894247 | mon1 | Pausing for 5 seconds 2026-08-31 07:24:42.894309 | mon1 | ok: [osd1] 2026-08-31 07:24:42.894323 | mon1 | 2026-08-31 07:24:42.894335 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-08-31 07:24:42.894347 | mon1 | Monday 31 August 2026 07:24:42 +0000 (0:00:05.066) 0:05:49.530 ********* 2026-08-31 07:24:42.983204 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:24:42.983254 | mon1 | 2026-08-31 07:24:42.983266 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:24:42.983300 | mon1 | Monday 31 August 2026 07:24:42 +0000 (0:00:00.091) 0:05:49.621 ********* 2026-08-31 07:24:43.058319 | mon1 | ok: [osd1] 2026-08-31 07:24:43.058427 | mon1 | 2026-08-31 07:24:43.058437 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:24:43.058456 | mon1 | Monday 31 August 2026 07:24:43 +0000 (0:00:00.075) 0:05:49.696 ********* 2026-08-31 07:24:44.937997 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:24:44.938057 | mon1 | 2026-08-31 07:24:44.938071 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:24:44.938123 | mon1 | Monday 31 August 2026 07:24:44 +0000 (0:00:01.879) 0:05:51.575 ********* 2026-08-31 07:24:45.006974 | mon1 | ok: [osd1] 2026-08-31 07:24:45.007016 | mon1 | 2026-08-31 07:24:45.007030 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:24:45.007043 | mon1 | Monday 31 August 2026 07:24:45 +0000 (0:00:00.069) 0:05:51.644 ********* 2026-08-31 07:24:45.065268 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:24:45.065322 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:24:45.065328 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:24:45.065337 | mon1 | skipping: [osd1] 2026-08-31 07:24:45.066207 | mon1 | 2026-08-31 07:24:45.066258 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-31 07:24:45.066271 | mon1 | Monday 31 August 2026 07:24:45 +0000 (0:00:00.058) 0:05:51.703 ********* 2026-08-31 07:24:45.156309 | mon1 | skipping: [osd1] 2026-08-31 07:24:45.156380 | mon1 | 2026-08-31 07:24:45.156393 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-31 07:24:45.156405 | mon1 | 2026-08-31 07:24:45.156417 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:24:45.156436 | mon1 | Monday 31 August 2026 07:24:45 +0000 (0:00:00.091) 0:05:51.794 ********* 2026-08-31 07:24:46.230279 | mon1 | ok: [mon1] 2026-08-31 07:24:46.230359 | mon1 | 2026-08-31 07:24:46.230883 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:46.230914 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:01.074) 0:05:52.868 ********* 2026-08-31 07:24:46.536836 | mon1 | ok: [mon1] 2026-08-31 07:24:46.536952 | mon1 | 2026-08-31 07:24:46.537257 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:46.537479 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:00.306) 0:05:53.175 ********* 2026-08-31 07:24:46.585750 | mon1 | skipping: [mon1] 2026-08-31 07:24:46.585809 | mon1 | 2026-08-31 07:24:46.585822 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:24:46.585835 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:00.048) 0:05:53.223 ********* 2026-08-31 07:24:46.887059 | mon1 | ok: [mon1] 2026-08-31 07:24:46.887158 | mon1 | 2026-08-31 07:24:46.887172 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:46.887179 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:00.301) 0:05:53.525 ********* 2026-08-31 07:24:46.973207 | mon1 | ok: [mon1] => { 2026-08-31 07:24:46.973271 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:24:46.973279 | mon1 | } 2026-08-31 07:24:46.973286 | mon1 | 2026-08-31 07:24:46.973293 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:46.973305 | mon1 | Monday 31 August 2026 07:24:46 +0000 (0:00:00.085) 0:05:53.610 ********* 2026-08-31 07:24:47.376457 | mon1 | ok: [mon1] 2026-08-31 07:24:47.377545 | mon1 | 2026-08-31 07:24:47.377585 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:47.377599 | mon1 | Monday 31 August 2026 07:24:47 +0000 (0:00:00.404) 0:05:54.014 ********* 2026-08-31 07:24:47.433303 | mon1 | skipping: [mon1] 2026-08-31 07:24:47.433351 | mon1 | 2026-08-31 07:24:47.433358 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:47.433364 | mon1 | Monday 31 August 2026 07:24:47 +0000 (0:00:00.057) 0:05:54.071 ********* 2026-08-31 07:24:47.489704 | mon1 | skipping: [mon1] 2026-08-31 07:24:47.489811 | mon1 | 2026-08-31 07:24:47.490045 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:47.490290 | mon1 | Monday 31 August 2026 07:24:47 +0000 (0:00:00.054) 0:05:54.126 ********* 2026-08-31 07:24:47.771884 | mon1 | ok: [mon1] 2026-08-31 07:24:47.771969 | mon1 | 2026-08-31 07:24:47.772359 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:24:47.772398 | mon1 | Monday 31 August 2026 07:24:47 +0000 (0:00:00.284) 0:05:54.411 ********* 2026-08-31 07:24:48.823940 | mon1 | ok: [mon1] 2026-08-31 07:24:48.823971 | mon1 | 2026-08-31 07:24:48.823976 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:48.823980 | mon1 | Monday 31 August 2026 07:24:48 +0000 (0:00:01.051) 0:05:55.462 ********* 2026-08-31 07:24:48.934190 | mon1 | ok: [mon1] => { 2026-08-31 07:24:48.934239 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:24:48.934541 | mon1 | } 2026-08-31 07:24:48.934811 | mon1 | 2026-08-31 07:24:48.935151 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:48.935450 | mon1 | Monday 31 August 2026 07:24:48 +0000 (0:00:00.109) 0:05:55.571 ********* 2026-08-31 07:24:49.390073 | mon1 | ok: [mon1] 2026-08-31 07:24:49.391313 | mon1 | 2026-08-31 07:24:49.391389 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:49.391407 | mon1 | Monday 31 August 2026 07:24:49 +0000 (0:00:00.456) 0:05:56.028 ********* 2026-08-31 07:24:51.666013 | mon1 | ok: [mon1] 2026-08-31 07:24:51.666152 | mon1 | 2026-08-31 07:24:51.666172 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:24:51.666185 | mon1 | Monday 31 August 2026 07:24:51 +0000 (0:00:02.275) 0:05:58.303 ********* 2026-08-31 07:24:51.709962 | mon1 | skipping: [mon1] 2026-08-31 07:24:51.709995 | mon1 | 2026-08-31 07:24:51.710008 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:24:51.710020 | mon1 | Monday 31 August 2026 07:24:51 +0000 (0:00:00.044) 0:05:58.348 ********* 2026-08-31 07:24:51.753309 | mon1 | skipping: [mon1] 2026-08-31 07:24:51.753382 | mon1 | 2026-08-31 07:24:51.753421 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:24:51.753441 | mon1 | Monday 31 August 2026 07:24:51 +0000 (0:00:00.042) 0:05:58.391 ********* 2026-08-31 07:24:51.801312 | mon1 | skipping: [mon1] 2026-08-31 07:24:51.801375 | mon1 | 2026-08-31 07:24:51.801391 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:24:51.801405 | mon1 | Monday 31 August 2026 07:24:51 +0000 (0:00:00.047) 0:05:58.438 ********* 2026-08-31 07:24:52.780256 | mon1 | ok: [mon1] 2026-08-31 07:24:52.780317 | mon1 | 2026-08-31 07:24:52.780331 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:24:52.780343 | mon1 | Monday 31 August 2026 07:24:52 +0000 (0:00:00.978) 0:05:59.417 ********* 2026-08-31 07:24:53.419674 | mon1 | ok: [mon1] 2026-08-31 07:24:53.419751 | mon1 | 2026-08-31 07:24:53.420023 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:24:53.420437 | mon1 | Monday 31 August 2026 07:24:53 +0000 (0:00:00.640) 0:06:00.058 ********* 2026-08-31 07:24:54.645229 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:24:54.645296 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:24:54.645312 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:24:54.645326 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:24:54.645341 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:24:54.646151 | mon1 | 2026-08-31 07:24:54.646234 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:24:54.646337 | mon1 | Monday 31 August 2026 07:24:54 +0000 (0:00:01.223) 0:06:01.281 ********* 2026-08-31 07:24:55.399786 | mon1 | ok: [mon1] 2026-08-31 07:24:55.400256 | mon1 | 2026-08-31 07:24:55.400645 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:24:55.401008 | mon1 | Monday 31 August 2026 07:24:55 +0000 (0:00:00.746) 0:06:02.027 ********* 2026-08-31 07:24:55.401397 | mon1 | 2026-08-31 07:24:55.401764 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:24:55.402207 | mon1 | Monday 31 August 2026 07:24:55 +0000 (0:00:00.010) 0:06:02.038 ********* 2026-08-31 07:24:55.903810 | mon1 | ok: [mon1] 2026-08-31 07:24:55.904715 | mon1 | 2026-08-31 07:24:55.904747 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:24:55.904762 | mon1 | Monday 31 August 2026 07:24:55 +0000 (0:00:00.504) 0:06:02.542 ********* 2026-08-31 07:24:56.208325 | mon1 | ok: [mon1] 2026-08-31 07:24:56.208405 | mon1 | 2026-08-31 07:24:56.208416 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:24:56.208426 | mon1 | Monday 31 August 2026 07:24:56 +0000 (0:00:00.303) 0:06:02.845 ********* 2026-08-31 07:24:56.291244 | mon1 | ok: [mon1] => { 2026-08-31 07:24:56.291287 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:24:56.292405 | mon1 | } 2026-08-31 07:24:56.292468 | mon1 | 2026-08-31 07:24:56.292483 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:24:56.292495 | mon1 | Monday 31 August 2026 07:24:56 +0000 (0:00:00.083) 0:06:02.929 ********* 2026-08-31 07:24:56.774253 | mon1 | ok: [mon1] 2026-08-31 07:24:56.774296 | mon1 | 2026-08-31 07:24:56.774305 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:24:56.774631 | mon1 | Monday 31 August 2026 07:24:56 +0000 (0:00:00.482) 0:06:03.412 ********* 2026-08-31 07:25:00.220879 | mon1 | ok: [mon1] 2026-08-31 07:25:00.220930 | mon1 | 2026-08-31 07:25:00.220936 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:25:00.220942 | mon1 | Monday 31 August 2026 07:25:00 +0000 (0:00:03.447) 0:06:06.859 ********* 2026-08-31 07:25:01.244884 | mon1 | ok: [mon1] 2026-08-31 07:25:01.244956 | mon1 | 2026-08-31 07:25:01.244971 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:25:01.245014 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:01.022) 0:06:07.881 ********* 2026-08-31 07:25:01.547236 | mon1 | ok: [mon1] 2026-08-31 07:25:01.547341 | mon1 | 2026-08-31 07:25:01.547355 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:25:01.547377 | mon1 | Monday 31 August 2026 07:25:01 +0000 (0:00:00.302) 0:06:08.184 ********* 2026-08-31 07:25:02.156021 | mon1 | ok: [mon1] 2026-08-31 07:25:02.156141 | mon1 | 2026-08-31 07:25:02.156159 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:25:02.156172 | mon1 | Monday 31 August 2026 07:25:02 +0000 (0:00:00.608) 0:06:08.792 ********* 2026-08-31 07:25:02.966251 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:25:02.966331 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:25:02.966339 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:25:02.966346 | mon1 | 2026-08-31 07:25:02.966352 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:25:02.966360 | mon1 | Monday 31 August 2026 07:25:02 +0000 (0:00:00.811) 0:06:09.604 ********* 2026-08-31 07:25:03.539669 | mon1 | ok: [mon1] 2026-08-31 07:25:03.539758 | mon1 | 2026-08-31 07:25:03.539774 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:25:03.539788 | mon1 | Monday 31 August 2026 07:25:03 +0000 (0:00:00.572) 0:06:10.176 ********* 2026-08-31 07:25:04.197371 | mon1 | ok: [mon1] 2026-08-31 07:25:04.197505 | mon1 | 2026-08-31 07:25:04.197526 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:25:04.197603 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.645) 0:06:10.821 ********* 2026-08-31 07:25:04.197618 | mon1 | 2026-08-31 07:25:04.198121 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:25:04.198207 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.013) 0:06:10.834 ********* 2026-08-31 07:25:04.760014 | mon1 | ok: [mon1] 2026-08-31 07:25:04.760147 | mon1 | 2026-08-31 07:25:04.760170 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:25:04.760183 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.562) 0:06:11.397 ********* 2026-08-31 07:25:04.856202 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:25:04.856943 | mon1 | 2026-08-31 07:25:04.857020 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:25:04.857031 | mon1 | Monday 31 August 2026 07:25:04 +0000 (0:00:00.095) 0:06:11.493 ********* 2026-08-31 07:25:06.106214 | mon1 | ok: [mon1] 2026-08-31 07:25:06.106306 | mon1 | 2026-08-31 07:25:06.106976 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:25:06.107059 | mon1 | Monday 31 August 2026 07:25:06 +0000 (0:00:01.250) 0:06:12.743 ********* 2026-08-31 07:25:07.058793 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:25:07.058843 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:25:07.058852 | mon1 | 2026-08-31 07:25:07.058860 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:25:07.058869 | mon1 | Monday 31 August 2026 07:25:07 +0000 (0:00:00.952) 0:06:13.696 ********* 2026-08-31 07:25:07.908164 | mon1 | ok: [mon1] 2026-08-31 07:25:07.908819 | mon1 | 2026-08-31 07:25:07.908882 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:25:07.908899 | mon1 | Monday 31 August 2026 07:25:07 +0000 (0:00:00.848) 0:06:14.544 ********* 2026-08-31 07:25:08.207787 | mon1 | ok: [mon1] 2026-08-31 07:25:08.207907 | mon1 | 2026-08-31 07:25:08.208136 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:25:08.208315 | mon1 | Monday 31 August 2026 07:25:08 +0000 (0:00:00.298) 0:06:14.843 ********* 2026-08-31 07:25:08.530487 | mon1 | ok: [mon1] 2026-08-31 07:25:08.530529 | mon1 | 2026-08-31 07:25:08.530535 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:25:08.530541 | mon1 | Monday 31 August 2026 07:25:08 +0000 (0:00:00.325) 0:06:15.169 ********* 2026-08-31 07:25:08.808366 | mon1 | ok: [mon1] 2026-08-31 07:25:08.808528 | mon1 | 2026-08-31 07:25:08.808615 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-31 07:25:08.808905 | mon1 | Monday 31 August 2026 07:25:08 +0000 (0:00:00.277) 0:06:15.446 ********* 2026-08-31 07:25:12.383190 | mon1 | changed: [mon1] 2026-08-31 07:25:12.383282 | mon1 | 2026-08-31 07:25:12.383300 | mon1 | PLAY [Upgrade check] *********************************************************** 2026-08-31 07:25:12.383317 | mon1 | 2026-08-31 07:25:12.383333 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:25:12.383401 | mon1 | Monday 31 August 2026 07:25:12 +0000 (0:00:03.573) 0:06:19.020 ********* 2026-08-31 07:25:13.467165 | mon1 | ok: [mon1] 2026-08-31 07:25:13.467538 | mon1 | 2026-08-31 07:25:13.467902 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:13.468260 | mon1 | Monday 31 August 2026 07:25:13 +0000 (0:00:01.085) 0:06:20.105 ********* 2026-08-31 07:25:13.767268 | mon1 | ok: [mon1] 2026-08-31 07:25:13.767604 | mon1 | 2026-08-31 07:25:13.767933 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:13.768241 | mon1 | Monday 31 August 2026 07:25:13 +0000 (0:00:00.299) 0:06:20.405 ********* 2026-08-31 07:25:13.821730 | mon1 | skipping: [mon1] 2026-08-31 07:25:13.821793 | mon1 | 2026-08-31 07:25:13.822005 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:25:13.822144 | mon1 | Monday 31 August 2026 07:25:13 +0000 (0:00:00.054) 0:06:20.460 ********* 2026-08-31 07:25:14.165228 | mon1 | ok: [mon1] 2026-08-31 07:25:14.165287 | mon1 | 2026-08-31 07:25:14.165315 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:14.165325 | mon1 | Monday 31 August 2026 07:25:14 +0000 (0:00:00.342) 0:06:20.802 ********* 2026-08-31 07:25:14.263294 | mon1 | ok: [mon1] => { 2026-08-31 07:25:14.263358 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:25:14.263363 | mon1 | } 2026-08-31 07:25:14.263368 | mon1 | 2026-08-31 07:25:14.263373 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:14.263546 | mon1 | Monday 31 August 2026 07:25:14 +0000 (0:00:00.098) 0:06:20.900 ********* 2026-08-31 07:25:14.704314 | mon1 | ok: [mon1] 2026-08-31 07:25:14.704370 | mon1 | 2026-08-31 07:25:14.704376 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:14.704387 | mon1 | Monday 31 August 2026 07:25:14 +0000 (0:00:00.441) 0:06:21.341 ********* 2026-08-31 07:25:14.765315 | mon1 | skipping: [mon1] 2026-08-31 07:25:14.765410 | mon1 | 2026-08-31 07:25:14.765417 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:14.765424 | mon1 | Monday 31 August 2026 07:25:14 +0000 (0:00:00.061) 0:06:21.403 ********* 2026-08-31 07:25:14.825439 | mon1 | skipping: [mon1] 2026-08-31 07:25:14.825552 | mon1 | 2026-08-31 07:25:14.825635 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:14.825935 | mon1 | Monday 31 August 2026 07:25:14 +0000 (0:00:00.060) 0:06:21.463 ********* 2026-08-31 07:25:15.120275 | mon1 | ok: [mon1] 2026-08-31 07:25:15.120336 | mon1 | 2026-08-31 07:25:15.120841 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:15.120911 | mon1 | Monday 31 August 2026 07:25:15 +0000 (0:00:00.294) 0:06:21.758 ********* 2026-08-31 07:25:16.168328 | mon1 | ok: [mon1] 2026-08-31 07:25:16.168379 | mon1 | 2026-08-31 07:25:16.168389 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:16.168405 | mon1 | Monday 31 August 2026 07:25:16 +0000 (0:00:01.048) 0:06:22.806 ********* 2026-08-31 07:25:16.277319 | mon1 | ok: [mon1] => { 2026-08-31 07:25:16.277418 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:25:16.277432 | mon1 | } 2026-08-31 07:25:16.278227 | mon1 | 2026-08-31 07:25:16.278296 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:16.278308 | mon1 | Monday 31 August 2026 07:25:16 +0000 (0:00:00.108) 0:06:22.915 ********* 2026-08-31 07:25:16.759553 | mon1 | ok: [mon1] 2026-08-31 07:25:16.759616 | mon1 | 2026-08-31 07:25:16.759630 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:16.759642 | mon1 | Monday 31 August 2026 07:25:16 +0000 (0:00:00.482) 0:06:23.397 ********* 2026-08-31 07:25:19.046200 | mon1 | ok: [mon1] 2026-08-31 07:25:19.046297 | mon1 | 2026-08-31 07:25:19.046312 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:25:19.046327 | mon1 | Monday 31 August 2026 07:25:19 +0000 (0:00:02.286) 0:06:25.683 ********* 2026-08-31 07:25:19.095029 | mon1 | skipping: [mon1] 2026-08-31 07:25:19.095144 | mon1 | 2026-08-31 07:25:19.095162 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:25:19.095175 | mon1 | Monday 31 August 2026 07:25:19 +0000 (0:00:00.049) 0:06:25.732 ********* 2026-08-31 07:25:19.140639 | mon1 | skipping: [mon1] 2026-08-31 07:25:19.140716 | mon1 | 2026-08-31 07:25:19.140731 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:25:19.140744 | mon1 | Monday 31 August 2026 07:25:19 +0000 (0:00:00.045) 0:06:25.778 ********* 2026-08-31 07:25:19.191535 | mon1 | skipping: [mon1] 2026-08-31 07:25:19.191635 | mon1 | 2026-08-31 07:25:19.191652 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:25:19.191719 | mon1 | Monday 31 August 2026 07:25:19 +0000 (0:00:00.050) 0:06:25.828 ********* 2026-08-31 07:25:20.432236 | mon1 | ok: [mon1] 2026-08-31 07:25:20.432308 | mon1 | 2026-08-31 07:25:20.432688 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:25:20.432769 | mon1 | Monday 31 August 2026 07:25:20 +0000 (0:00:01.241) 0:06:27.070 ********* 2026-08-31 07:25:21.097743 | mon1 | ok: [mon1] 2026-08-31 07:25:21.097849 | mon1 | 2026-08-31 07:25:21.097864 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:25:21.097877 | mon1 | Monday 31 August 2026 07:25:21 +0000 (0:00:00.665) 0:06:27.735 ********* 2026-08-31 07:25:22.507184 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:25:22.509232 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:25:22.509331 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:25:22.509345 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:25:22.509357 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:25:22.509369 | mon1 | 2026-08-31 07:25:22.509382 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:25:22.509393 | mon1 | Monday 31 August 2026 07:25:22 +0000 (0:00:01.409) 0:06:29.144 ********* 2026-08-31 07:25:23.309244 | mon1 | ok: [mon1] 2026-08-31 07:25:23.309288 | mon1 | 2026-08-31 07:25:23.309294 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:25:23.309299 | mon1 | Monday 31 August 2026 07:25:23 +0000 (0:00:00.792) 0:06:29.937 ********* 2026-08-31 07:25:23.309307 | mon1 | 2026-08-31 07:25:23.309832 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:25:23.309863 | mon1 | Monday 31 August 2026 07:25:23 +0000 (0:00:00.009) 0:06:29.946 ********* 2026-08-31 07:25:23.795049 | mon1 | ok: [mon1] 2026-08-31 07:25:23.795158 | mon1 | 2026-08-31 07:25:23.795172 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:23.795187 | mon1 | Monday 31 August 2026 07:25:23 +0000 (0:00:00.486) 0:06:30.432 ********* 2026-08-31 07:25:24.110122 | mon1 | ok: [mon1] 2026-08-31 07:25:24.110189 | mon1 | 2026-08-31 07:25:24.110203 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:24.110216 | mon1 | Monday 31 August 2026 07:25:24 +0000 (0:00:00.314) 0:06:30.747 ********* 2026-08-31 07:25:24.172816 | mon1 | ok: [mon1] => { 2026-08-31 07:25:24.172866 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:25:24.172879 | mon1 | } 2026-08-31 07:25:24.172891 | mon1 | 2026-08-31 07:25:24.172904 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:24.172916 | mon1 | Monday 31 August 2026 07:25:24 +0000 (0:00:00.062) 0:06:30.809 ********* 2026-08-31 07:25:24.682843 | mon1 | ok: [mon1] 2026-08-31 07:25:24.682913 | mon1 | 2026-08-31 07:25:24.682920 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:24.682939 | mon1 | Monday 31 August 2026 07:25:24 +0000 (0:00:00.510) 0:06:31.320 ********* 2026-08-31 07:25:28.148345 | mon1 | ok: [mon1] 2026-08-31 07:25:28.148413 | mon1 | 2026-08-31 07:25:28.148426 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:25:28.148439 | mon1 | Monday 31 August 2026 07:25:28 +0000 (0:00:03.465) 0:06:34.786 ********* 2026-08-31 07:25:29.187034 | mon1 | ok: [mon1] 2026-08-31 07:25:29.187160 | mon1 | 2026-08-31 07:25:29.187178 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:25:29.187191 | mon1 | Monday 31 August 2026 07:25:29 +0000 (0:00:01.037) 0:06:35.823 ********* 2026-08-31 07:25:29.476204 | mon1 | ok: [mon1] 2026-08-31 07:25:29.478611 | mon1 | 2026-08-31 07:25:29.478651 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:25:29.478666 | mon1 | Monday 31 August 2026 07:25:29 +0000 (0:00:00.289) 0:06:36.113 ********* 2026-08-31 07:25:30.091962 | mon1 | ok: [mon1] 2026-08-31 07:25:30.092010 | mon1 | 2026-08-31 07:25:30.092021 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:25:30.092030 | mon1 | Monday 31 August 2026 07:25:30 +0000 (0:00:00.614) 0:06:36.728 ********* 2026-08-31 07:25:30.930202 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:25:30.931591 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:25:30.931648 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:25:30.931659 | mon1 | 2026-08-31 07:25:30.931668 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:25:30.931678 | mon1 | Monday 31 August 2026 07:25:30 +0000 (0:00:00.839) 0:06:37.567 ********* 2026-08-31 07:25:31.593289 | mon1 | ok: [mon1] 2026-08-31 07:25:31.593340 | mon1 | 2026-08-31 07:25:31.593350 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:25:31.593566 | mon1 | Monday 31 August 2026 07:25:31 +0000 (0:00:00.662) 0:06:38.230 ********* 2026-08-31 07:25:32.201282 | mon1 | ok: [mon1] 2026-08-31 07:25:32.201375 | mon1 | 2026-08-31 07:25:32.201387 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:25:32.202187 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.600) 0:06:38.830 ********* 2026-08-31 07:25:32.202222 | mon1 | 2026-08-31 07:25:32.202233 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:25:32.202408 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.008) 0:06:38.839 ********* 2026-08-31 07:25:32.725300 | mon1 | ok: [mon1] 2026-08-31 07:25:32.725381 | mon1 | 2026-08-31 07:25:32.725912 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:25:32.725957 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.524) 0:06:39.363 ********* 2026-08-31 07:25:32.808357 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:25:32.808428 | mon1 | 2026-08-31 07:25:32.808924 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:25:32.808968 | mon1 | Monday 31 August 2026 07:25:32 +0000 (0:00:00.083) 0:06:39.446 ********* 2026-08-31 07:25:33.989911 | mon1 | ok: [mon1] 2026-08-31 07:25:33.989986 | mon1 | 2026-08-31 07:25:33.990000 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:25:33.990012 | mon1 | Monday 31 August 2026 07:25:33 +0000 (0:00:01.181) 0:06:40.627 ********* 2026-08-31 07:25:34.898163 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:25:34.898231 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:25:34.898242 | mon1 | 2026-08-31 07:25:34.898250 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:25:34.898258 | mon1 | Monday 31 August 2026 07:25:34 +0000 (0:00:00.908) 0:06:41.536 ********* 2026-08-31 07:25:38.850018 | mon1 | ok: [mon1] 2026-08-31 07:25:38.850073 | mon1 | 2026-08-31 07:25:38.850133 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:25:38.850152 | mon1 | Monday 31 August 2026 07:25:38 +0000 (0:00:03.951) 0:06:45.488 ********* 2026-08-31 07:25:39.153270 | mon1 | ok: [mon1] 2026-08-31 07:25:39.153351 | mon1 | 2026-08-31 07:25:39.153367 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:25:39.153386 | mon1 | Monday 31 August 2026 07:25:39 +0000 (0:00:00.302) 0:06:45.790 ********* 2026-08-31 07:25:40.532315 | mon1 | ok: [mon1] 2026-08-31 07:25:40.532390 | mon1 | 2026-08-31 07:25:40.532404 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:25:40.532416 | mon1 | Monday 31 August 2026 07:25:40 +0000 (0:00:01.378) 0:06:47.169 ********* 2026-08-31 07:25:40.808559 | mon1 | ok: [mon1] 2026-08-31 07:25:40.808656 | mon1 | 2026-08-31 07:25:40.808670 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] ************************** 2026-08-31 07:25:40.808705 | mon1 | Monday 31 August 2026 07:25:40 +0000 (0:00:00.276) 0:06:47.446 ********* 2026-08-31 07:25:42.786820 | mon1 | ok: [mon1] 2026-08-31 07:25:42.786886 | mon1 | 2026-08-31 07:25:42.786900 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] ********************* 2026-08-31 07:25:42.786912 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:01.976) 0:06:49.423 ********* 2026-08-31 07:25:42.851639 | mon1 | ok: [mon1] 2026-08-31 07:25:42.851684 | mon1 | 2026-08-31 07:25:42.851698 | mon1 | TASK [vexxhost.ceph.upgrade_check : Run upgrade] ******************************* 2026-08-31 07:25:42.851710 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:00.065) 0:06:49.488 ********* 2026-08-31 07:25:42.884396 | mon1 | skipping: [mon1] 2026-08-31 07:25:42.884430 | mon1 | 2026-08-31 07:25:42.884442 | mon1 | TASK [vexxhost.ceph.upgrade_check : Wait until Ceph upgraded] ****************** 2026-08-31 07:25:42.884454 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:00.033) 0:06:49.522 ********* 2026-08-31 07:25:42.925179 | mon1 | skipping: [mon1] 2026-08-31 07:25:42.925450 | mon1 | 2026-08-31 07:25:42.927258 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:25:42.927289 | mon1 | mon1 : ok=128 changed=30 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 2026-08-31 07:25:42.927302 | mon1 | osd1 : ok=58 changed=23 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-08-31 07:25:42.927315 | mon1 | 2026-08-31 07:25:42.927327 | mon1 | 2026-08-31 07:25:42.927339 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:25:42.927350 | mon1 | Monday 31 August 2026 07:25:42 +0000 (0:00:00.041) 0:06:49.563 ********* 2026-08-31 07:25:42.927858 | mon1 | =============================================================================== 2026-08-31 07:25:42.928182 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 95.95s 2026-08-31 07:25:42.928477 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 48.78s 2026-08-31 07:25:42.928838 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 46.74s 2026-08-31 07:25:42.929171 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 20.86s 2026-08-31 07:25:42.929465 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.60s 2026-08-31 07:25:42.929774 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.12s 2026-08-31 07:25:42.930061 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.71s 2026-08-31 07:25:42.930382 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.98s 2026-08-31 07:25:42.930840 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.07s 2026-08-31 07:25:42.931226 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.83s 2026-08-31 07:25:42.931535 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.73s 2026-08-31 07:25:42.931884 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 4.07s 2026-08-31 07:25:42.932653 | mon1 | vexxhost.ceph.cephadm : Download "cephadm" ------------------------------ 3.95s 2026-08-31 07:25:42.932972 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.82s 2026-08-31 07:25:42.933364 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 3.57s 2026-08-31 07:25:42.933696 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.51s 2026-08-31 07:25:42.933983 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.47s 2026-08-31 07:25:42.934297 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.45s 2026-08-31 07:25:42.934606 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.41s 2026-08-31 07:25:42.934892 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.09s 2026-08-31 07:25:43.067169 | mon1 | INFO [default > converge] Executed: Successful 2026-08-31 07:25:43.079976 | mon1 | INFO [default > idempotence] Executing 2026-08-31 07:25:44.189165 | mon1 | 2026-08-31 07:25:44.189255 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-31 07:25:44.189270 | mon1 | 2026-08-31 07:25:44.189282 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:25:44.189295 | mon1 | Monday 31 August 2026 07:25:44 +0000 (0:00:00.053) 0:00:00.053 ********* 2026-08-31 07:25:45.567217 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:25:45.568285 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:25:45.568343 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:25:45.568372 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:25:45.568381 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:25:45.584011 | mon1 | ok: [mon1] 2026-08-31 07:25:45.584061 | mon1 | 2026-08-31 07:25:45.584070 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:45.584077 | mon1 | Monday 31 August 2026 07:25:45 +0000 (0:00:01.395) 0:00:01.449 ********* 2026-08-31 07:25:45.950277 | mon1 | ok: [mon1] 2026-08-31 07:25:45.950332 | mon1 | 2026-08-31 07:25:45.950343 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:45.950457 | mon1 | Monday 31 August 2026 07:25:45 +0000 (0:00:00.366) 0:00:01.815 ********* 2026-08-31 07:25:45.991290 | mon1 | skipping: [mon1] 2026-08-31 07:25:45.991364 | mon1 | 2026-08-31 07:25:45.991657 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:25:45.991694 | mon1 | Monday 31 August 2026 07:25:45 +0000 (0:00:00.041) 0:00:01.857 ********* 2026-08-31 07:25:46.324210 | mon1 | ok: [mon1] 2026-08-31 07:25:46.324252 | mon1 | 2026-08-31 07:25:46.324257 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:46.324262 | mon1 | Monday 31 August 2026 07:25:46 +0000 (0:00:00.331) 0:00:02.189 ********* 2026-08-31 07:25:46.406843 | mon1 | ok: [mon1] => { 2026-08-31 07:25:46.406889 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:25:46.406894 | mon1 | } 2026-08-31 07:25:46.406899 | mon1 | 2026-08-31 07:25:46.406903 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:46.406908 | mon1 | Monday 31 August 2026 07:25:46 +0000 (0:00:00.082) 0:00:02.271 ********* 2026-08-31 07:25:46.940799 | mon1 | ok: [mon1] 2026-08-31 07:25:46.940834 | mon1 | 2026-08-31 07:25:46.940842 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:46.940848 | mon1 | Monday 31 August 2026 07:25:46 +0000 (0:00:00.534) 0:00:02.805 ********* 2026-08-31 07:25:47.013342 | mon1 | skipping: [mon1] 2026-08-31 07:25:47.013414 | mon1 | 2026-08-31 07:25:47.013425 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:47.013434 | mon1 | Monday 31 August 2026 07:25:47 +0000 (0:00:00.072) 0:00:02.878 ********* 2026-08-31 07:25:47.067302 | mon1 | skipping: [mon1] 2026-08-31 07:25:47.067362 | mon1 | 2026-08-31 07:25:47.067395 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:47.067562 | mon1 | Monday 31 August 2026 07:25:47 +0000 (0:00:00.054) 0:00:02.932 ********* 2026-08-31 07:25:47.369116 | mon1 | ok: [mon1] 2026-08-31 07:25:47.369145 | mon1 | 2026-08-31 07:25:47.369150 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:25:47.369154 | mon1 | Monday 31 August 2026 07:25:47 +0000 (0:00:00.302) 0:00:03.234 ********* 2026-08-31 07:25:48.490459 | mon1 | ok: [mon1] 2026-08-31 07:25:48.490556 | mon1 | 2026-08-31 07:25:48.490570 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:48.490583 | mon1 | Monday 31 August 2026 07:25:48 +0000 (0:00:01.121) 0:00:04.355 ********* 2026-08-31 07:25:48.742254 | mon1 | ok: [mon1] => { 2026-08-31 07:25:48.742316 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:25:48.742349 | mon1 | } 2026-08-31 07:25:48.742364 | mon1 | 2026-08-31 07:25:48.742886 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:48.742911 | mon1 | Monday 31 August 2026 07:25:48 +0000 (0:00:00.251) 0:00:04.607 ********* 2026-08-31 07:25:49.355355 | mon1 | ok: [mon1] 2026-08-31 07:25:49.355404 | mon1 | 2026-08-31 07:25:49.355414 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:49.355424 | mon1 | Monday 31 August 2026 07:25:49 +0000 (0:00:00.612) 0:00:05.219 ********* 2026-08-31 07:25:52.044143 | mon1 | ok: [mon1] 2026-08-31 07:25:52.044189 | mon1 | 2026-08-31 07:25:52.044195 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:25:52.044202 | mon1 | Monday 31 August 2026 07:25:52 +0000 (0:00:02.689) 0:00:07.909 ********* 2026-08-31 07:25:52.080051 | mon1 | skipping: [mon1] 2026-08-31 07:25:52.080108 | mon1 | 2026-08-31 07:25:52.080115 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:25:52.080120 | mon1 | Monday 31 August 2026 07:25:52 +0000 (0:00:00.035) 0:00:07.945 ********* 2026-08-31 07:25:52.113779 | mon1 | skipping: [mon1] 2026-08-31 07:25:52.113932 | mon1 | 2026-08-31 07:25:52.114137 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:25:52.114323 | mon1 | Monday 31 August 2026 07:25:52 +0000 (0:00:00.034) 0:00:07.979 ********* 2026-08-31 07:25:52.156198 | mon1 | skipping: [mon1] 2026-08-31 07:25:52.156249 | mon1 | 2026-08-31 07:25:52.156306 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:25:52.156592 | mon1 | Monday 31 August 2026 07:25:52 +0000 (0:00:00.041) 0:00:08.020 ********* 2026-08-31 07:25:53.249046 | mon1 | ok: [mon1] 2026-08-31 07:25:53.249132 | mon1 | 2026-08-31 07:25:53.249152 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:25:53.249161 | mon1 | Monday 31 August 2026 07:25:53 +0000 (0:00:01.091) 0:00:09.112 ********* 2026-08-31 07:25:53.876203 | mon1 | ok: [mon1] 2026-08-31 07:25:53.876238 | mon1 | 2026-08-31 07:25:53.876244 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:25:53.876335 | mon1 | Monday 31 August 2026 07:25:53 +0000 (0:00:00.628) 0:00:09.741 ********* 2026-08-31 07:25:55.194974 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:25:55.195033 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:25:55.195043 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:25:55.195052 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:25:55.195060 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:25:55.195069 | mon1 | 2026-08-31 07:25:55.195078 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:25:55.195124 | mon1 | Monday 31 August 2026 07:25:55 +0000 (0:00:01.315) 0:00:11.056 ********* 2026-08-31 07:25:55.982245 | mon1 | ok: [mon1] 2026-08-31 07:25:55.982359 | mon1 | 2026-08-31 07:25:55.983484 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:25:55.983553 | mon1 | Monday 31 August 2026 07:25:55 +0000 (0:00:00.773) 0:00:11.830 ********* 2026-08-31 07:25:55.983563 | mon1 | 2026-08-31 07:25:55.983573 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:25:55.983581 | mon1 | Monday 31 August 2026 07:25:55 +0000 (0:00:00.016) 0:00:11.846 ********* 2026-08-31 07:25:56.816988 | mon1 | ok: [mon1] 2026-08-31 07:25:56.817017 | mon1 | 2026-08-31 07:25:56.817022 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:25:56.817027 | mon1 | Monday 31 August 2026 07:25:56 +0000 (0:00:00.836) 0:00:12.682 ********* 2026-08-31 07:25:57.108145 | mon1 | ok: [mon1] 2026-08-31 07:25:57.108181 | mon1 | 2026-08-31 07:25:57.108205 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:25:57.108211 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.290) 0:00:12.973 ********* 2026-08-31 07:25:57.248170 | mon1 | ok: [mon1] => { 2026-08-31 07:25:57.248223 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:25:57.248233 | mon1 | } 2026-08-31 07:25:57.248242 | mon1 | 2026-08-31 07:25:57.248251 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:25:57.248260 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.138) 0:00:13.111 ********* 2026-08-31 07:25:57.736739 | mon1 | ok: [mon1] 2026-08-31 07:25:57.736769 | mon1 | 2026-08-31 07:25:57.736774 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:25:57.736779 | mon1 | Monday 31 August 2026 07:25:57 +0000 (0:00:00.488) 0:00:13.600 ********* 2026-08-31 07:26:01.209937 | mon1 | ok: [mon1] 2026-08-31 07:26:01.210023 | mon1 | 2026-08-31 07:26:01.210030 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:26:01.210036 | mon1 | Monday 31 August 2026 07:26:01 +0000 (0:00:03.474) 0:00:17.074 ********* 2026-08-31 07:26:02.235031 | mon1 | ok: [mon1] 2026-08-31 07:26:02.235118 | mon1 | 2026-08-31 07:26:02.235131 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:26:02.235138 | mon1 | Monday 31 August 2026 07:26:02 +0000 (0:00:01.024) 0:00:18.099 ********* 2026-08-31 07:26:02.674260 | mon1 | ok: [mon1] 2026-08-31 07:26:02.674301 | mon1 | 2026-08-31 07:26:02.674307 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:26:02.674314 | mon1 | Monday 31 August 2026 07:26:02 +0000 (0:00:00.438) 0:00:18.538 ********* 2026-08-31 07:26:03.315779 | mon1 | ok: [mon1] 2026-08-31 07:26:03.315833 | mon1 | 2026-08-31 07:26:03.315843 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:26:03.315852 | mon1 | Monday 31 August 2026 07:26:03 +0000 (0:00:00.641) 0:00:19.179 ********* 2026-08-31 07:26:04.105926 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:26:04.105992 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:26:04.106003 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:26:04.106009 | mon1 | 2026-08-31 07:26:04.106015 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:26:04.106021 | mon1 | Monday 31 August 2026 07:26:04 +0000 (0:00:00.789) 0:00:19.969 ********* 2026-08-31 07:26:04.717682 | mon1 | ok: [mon1] 2026-08-31 07:26:04.717717 | mon1 | 2026-08-31 07:26:04.717724 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:26:04.717731 | mon1 | Monday 31 August 2026 07:26:04 +0000 (0:00:00.611) 0:00:20.581 ********* 2026-08-31 07:26:05.363561 | mon1 | ok: [mon1] 2026-08-31 07:26:05.363621 | mon1 | 2026-08-31 07:26:05.363626 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:26:05.363632 | mon1 | Monday 31 August 2026 07:26:05 +0000 (0:00:00.584) 0:00:21.166 ********* 2026-08-31 07:26:05.363636 | mon1 | 2026-08-31 07:26:05.363641 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:26:05.363645 | mon1 | Monday 31 August 2026 07:26:05 +0000 (0:00:00.062) 0:00:21.228 ********* 2026-08-31 07:26:05.880423 | mon1 | ok: [mon1] 2026-08-31 07:26:05.880469 | mon1 | 2026-08-31 07:26:05.880476 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:26:05.880482 | mon1 | Monday 31 August 2026 07:26:05 +0000 (0:00:00.516) 0:00:21.744 ********* 2026-08-31 07:26:05.990897 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:26:05.990990 | mon1 | 2026-08-31 07:26:05.991000 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:26:05.991010 | mon1 | Monday 31 August 2026 07:26:05 +0000 (0:00:00.109) 0:00:21.854 ********* 2026-08-31 07:26:07.249967 | mon1 | ok: [mon1] 2026-08-31 07:26:07.250022 | mon1 | 2026-08-31 07:26:07.250053 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:26:07.250065 | mon1 | Monday 31 August 2026 07:26:07 +0000 (0:00:01.259) 0:00:23.113 ********* 2026-08-31 07:26:08.223378 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:26:08.223486 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:26:08.223497 | mon1 | 2026-08-31 07:26:08.223516 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:26:08.223785 | mon1 | Monday 31 August 2026 07:26:08 +0000 (0:00:00.974) 0:00:24.087 ********* 2026-08-31 07:26:09.154935 | mon1 | ok: [mon1] 2026-08-31 07:26:09.154976 | mon1 | 2026-08-31 07:26:09.154980 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:26:09.154985 | mon1 | Monday 31 August 2026 07:26:09 +0000 (0:00:00.932) 0:00:25.020 ********* 2026-08-31 07:26:09.472773 | mon1 | ok: [mon1] 2026-08-31 07:26:09.472806 | mon1 | 2026-08-31 07:26:09.472811 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:26:09.472815 | mon1 | Monday 31 August 2026 07:26:09 +0000 (0:00:00.317) 0:00:25.337 ********* 2026-08-31 07:26:09.977325 | mon1 | ok: [mon1] 2026-08-31 07:26:09.977384 | mon1 | 2026-08-31 07:26:09.977826 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:26:09.977849 | mon1 | Monday 31 August 2026 07:26:09 +0000 (0:00:00.504) 0:00:25.842 ********* 2026-08-31 07:26:10.372938 | mon1 | ok: [mon1] 2026-08-31 07:26:10.373008 | mon1 | 2026-08-31 07:26:10.373015 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-31 07:26:10.373022 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:00.396) 0:00:26.238 ********* 2026-08-31 07:26:10.483307 | mon1 | ok: [mon1] 2026-08-31 07:26:10.483356 | mon1 | 2026-08-31 07:26:10.483362 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-31 07:26:10.483367 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:00.109) 0:00:26.348 ********* 2026-08-31 07:26:10.840795 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:26:10.840849 | mon1 | 2026-08-31 07:26:10.840861 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-31 07:26:10.840871 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:00.356) 0:00:26.704 ********* 2026-08-31 07:26:10.903416 | mon1 | ok: [mon1] 2026-08-31 07:26:10.903460 | mon1 | 2026-08-31 07:26:10.903467 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-31 07:26:10.903472 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:00.061) 0:00:26.766 ********* 2026-08-31 07:26:10.962486 | mon1 | skipping: [mon1] 2026-08-31 07:26:10.962543 | mon1 | 2026-08-31 07:26:10.962550 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:26:10.962557 | mon1 | Monday 31 August 2026 07:26:10 +0000 (0:00:00.060) 0:00:26.826 ********* 2026-08-31 07:26:11.054785 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:26:11.054843 | mon1 | 2026-08-31 07:26:11.055040 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:26:11.055241 | mon1 | Monday 31 August 2026 07:26:11 +0000 (0:00:00.092) 0:00:26.919 ********* 2026-08-31 07:26:13.066936 | mon1 | ok: [mon1] 2026-08-31 07:26:13.067036 | mon1 | 2026-08-31 07:26:13.067055 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:26:13.067072 | mon1 | Monday 31 August 2026 07:26:13 +0000 (0:00:02.010) 0:00:28.930 ********* 2026-08-31 07:26:13.165002 | mon1 | ok: [mon1] => (item=mon1) 2026-08-31 07:26:13.165123 | mon1 | 2026-08-31 07:26:13.165141 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:26:13.165154 | mon1 | Monday 31 August 2026 07:26:13 +0000 (0:00:00.098) 0:00:29.028 ********* 2026-08-31 07:26:13.660326 | mon1 | ok: [mon1] 2026-08-31 07:26:13.660417 | mon1 | 2026-08-31 07:26:13.660903 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:26:13.661004 | mon1 | Monday 31 August 2026 07:26:13 +0000 (0:00:00.496) 0:00:29.525 ********* 2026-08-31 07:26:16.507666 | mon1 | ok: [mon1] 2026-08-31 07:26:16.507778 | mon1 | 2026-08-31 07:26:16.507822 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-31 07:26:16.507919 | mon1 | Monday 31 August 2026 07:26:16 +0000 (0:00:02.846) 0:00:32.371 ********* 2026-08-31 07:26:18.593307 | mon1 | ok: [mon1] 2026-08-31 07:26:18.593397 | mon1 | 2026-08-31 07:26:18.593406 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-31 07:26:18.593582 | mon1 | Monday 31 August 2026 07:26:18 +0000 (0:00:02.087) 0:00:34.458 ********* 2026-08-31 07:26:20.646328 | mon1 | ok: [mon1] 2026-08-31 07:26:20.646420 | mon1 | 2026-08-31 07:26:20.646435 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:26:20.646455 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:02.053) 0:00:36.511 ********* 2026-08-31 07:26:20.753428 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-31 07:26:20.753538 | mon1 | 2026-08-31 07:26:20.753562 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:26:20.753578 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.106) 0:00:36.618 ********* 2026-08-31 07:26:20.829345 | mon1 | skipping: [mon1] 2026-08-31 07:26:20.829439 | mon1 | 2026-08-31 07:26:20.829452 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:26:20.829470 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.075) 0:00:36.694 ********* 2026-08-31 07:26:20.915324 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-31 07:26:20.915406 | mon1 | skipping: [mon1] 2026-08-31 07:26:20.915433 | mon1 | 2026-08-31 07:26:20.915961 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:26:20.916037 | mon1 | Monday 31 August 2026 07:26:20 +0000 (0:00:00.086) 0:00:36.780 ********* 2026-08-31 07:26:21.348229 | mon1 | ok: [mon1] 2026-08-31 07:26:21.348677 | mon1 | 2026-08-31 07:26:21.349311 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:26:21.349340 | mon1 | Monday 31 August 2026 07:26:21 +0000 (0:00:00.432) 0:00:37.213 ********* 2026-08-31 07:26:24.230307 | mon1 | ok: [mon1] 2026-08-31 07:26:24.230382 | mon1 | 2026-08-31 07:26:24.230397 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-31 07:26:24.230613 | mon1 | Monday 31 August 2026 07:26:24 +0000 (0:00:02.882) 0:00:40.095 ********* 2026-08-31 07:26:26.134391 | mon1 | ok: [mon1] 2026-08-31 07:26:26.134477 | mon1 | 2026-08-31 07:26:26.134506 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-31 07:26:26.134741 | mon1 | Monday 31 August 2026 07:26:26 +0000 (0:00:01.903) 0:00:41.999 ********* 2026-08-31 07:26:28.160285 | mon1 | ok: [mon1] 2026-08-31 07:26:28.160352 | mon1 | 2026-08-31 07:26:28.160894 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-31 07:26:28.160969 | mon1 | Monday 31 August 2026 07:26:28 +0000 (0:00:02.025) 0:00:44.024 ********* 2026-08-31 07:26:36.293993 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-31 07:26:36.294128 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-31 07:26:36.294150 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-31 07:26:36.294175 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-31 07:26:36.294199 | mon1 | 2026-08-31 07:26:36.294214 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-31 07:26:36.294229 | mon1 | 2026-08-31 07:26:36.294242 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:26:36.294256 | mon1 | Monday 31 August 2026 07:26:36 +0000 (0:00:08.133) 0:00:52.157 ********* 2026-08-31 07:26:37.613181 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-31 07:26:37.613258 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:26:37.614127 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:26:37.614232 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:26:37.614246 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:26:37.634430 | mon1 | ok: [osd1] 2026-08-31 07:26:37.634500 | mon1 | 2026-08-31 07:26:37.634512 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:37.634522 | mon1 | Monday 31 August 2026 07:26:37 +0000 (0:00:01.339) 0:00:53.497 ********* 2026-08-31 07:26:37.925389 | mon1 | ok: [osd1] 2026-08-31 07:26:37.925441 | mon1 | 2026-08-31 07:26:37.925448 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:37.925476 | mon1 | Monday 31 August 2026 07:26:37 +0000 (0:00:00.291) 0:00:53.789 ********* 2026-08-31 07:26:37.990942 | mon1 | skipping: [osd1] 2026-08-31 07:26:37.991048 | mon1 | 2026-08-31 07:26:37.991058 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:26:37.991069 | mon1 | Monday 31 August 2026 07:26:37 +0000 (0:00:00.065) 0:00:53.855 ********* 2026-08-31 07:26:38.307229 | mon1 | ok: [osd1] 2026-08-31 07:26:38.307314 | mon1 | 2026-08-31 07:26:38.307918 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:38.307987 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:00.316) 0:00:54.172 ********* 2026-08-31 07:26:38.414859 | mon1 | ok: [osd1] => { 2026-08-31 07:26:38.415316 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:26:38.415573 | mon1 | } 2026-08-31 07:26:38.415894 | mon1 | 2026-08-31 07:26:38.416303 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:38.416601 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:00.107) 0:00:54.279 ********* 2026-08-31 07:26:38.828702 | mon1 | ok: [osd1] 2026-08-31 07:26:38.828760 | mon1 | 2026-08-31 07:26:38.828770 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:38.828779 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:00.413) 0:00:54.692 ********* 2026-08-31 07:26:38.881215 | mon1 | skipping: [osd1] 2026-08-31 07:26:38.881253 | mon1 | 2026-08-31 07:26:38.881258 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:38.881263 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:00.053) 0:00:54.746 ********* 2026-08-31 07:26:38.937182 | mon1 | skipping: [osd1] 2026-08-31 07:26:38.937534 | mon1 | 2026-08-31 07:26:38.937995 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:38.938440 | mon1 | Monday 31 August 2026 07:26:38 +0000 (0:00:00.056) 0:00:54.802 ********* 2026-08-31 07:26:39.233044 | mon1 | ok: [osd1] 2026-08-31 07:26:39.233130 | mon1 | 2026-08-31 07:26:39.233145 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:26:39.233154 | mon1 | Monday 31 August 2026 07:26:39 +0000 (0:00:00.295) 0:00:55.097 ********* 2026-08-31 07:26:40.325120 | mon1 | ok: [osd1] 2026-08-31 07:26:40.325169 | mon1 | 2026-08-31 07:26:40.325179 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:40.325188 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:01.092) 0:00:56.189 ********* 2026-08-31 07:26:40.559202 | mon1 | ok: [osd1] => { 2026-08-31 07:26:40.560576 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:26:40.560643 | mon1 | } 2026-08-31 07:26:40.560656 | mon1 | 2026-08-31 07:26:40.560667 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:40.560678 | mon1 | Monday 31 August 2026 07:26:40 +0000 (0:00:00.234) 0:00:56.424 ********* 2026-08-31 07:26:41.123242 | mon1 | ok: [osd1] 2026-08-31 07:26:41.123313 | mon1 | 2026-08-31 07:26:41.123398 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:41.123765 | mon1 | Monday 31 August 2026 07:26:41 +0000 (0:00:00.563) 0:00:56.988 ********* 2026-08-31 07:26:43.515242 | mon1 | ok: [osd1] 2026-08-31 07:26:43.515319 | mon1 | 2026-08-31 07:26:43.515737 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:26:43.515783 | mon1 | Monday 31 August 2026 07:26:43 +0000 (0:00:02.391) 0:00:59.379 ********* 2026-08-31 07:26:43.565384 | mon1 | skipping: [osd1] 2026-08-31 07:26:43.565504 | mon1 | 2026-08-31 07:26:43.565517 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:26:43.565540 | mon1 | Monday 31 August 2026 07:26:43 +0000 (0:00:00.050) 0:00:59.430 ********* 2026-08-31 07:26:43.613228 | mon1 | skipping: [osd1] 2026-08-31 07:26:43.613320 | mon1 | 2026-08-31 07:26:43.613955 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:26:43.613983 | mon1 | Monday 31 August 2026 07:26:43 +0000 (0:00:00.048) 0:00:59.478 ********* 2026-08-31 07:26:43.660218 | mon1 | skipping: [osd1] 2026-08-31 07:26:43.661444 | mon1 | 2026-08-31 07:26:43.661506 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:26:43.661553 | mon1 | Monday 31 August 2026 07:26:43 +0000 (0:00:00.047) 0:00:59.525 ********* 2026-08-31 07:26:44.692869 | mon1 | ok: [osd1] 2026-08-31 07:26:44.692944 | mon1 | 2026-08-31 07:26:44.692950 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:26:44.692954 | mon1 | Monday 31 August 2026 07:26:44 +0000 (0:00:01.032) 0:01:00.558 ********* 2026-08-31 07:26:45.356049 | mon1 | ok: [osd1] 2026-08-31 07:26:45.356156 | mon1 | 2026-08-31 07:26:45.356168 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:26:45.356178 | mon1 | Monday 31 August 2026 07:26:45 +0000 (0:00:00.660) 0:01:01.219 ********* 2026-08-31 07:26:46.657287 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:26:46.657355 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:26:46.657365 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:26:46.657374 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:26:46.657383 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:26:46.658125 | mon1 | 2026-08-31 07:26:46.658174 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:26:46.658185 | mon1 | Monday 31 August 2026 07:26:46 +0000 (0:00:01.301) 0:01:02.520 ********* 2026-08-31 07:26:47.424400 | mon1 | ok: [osd1] 2026-08-31 07:26:47.424453 | mon1 | 2026-08-31 07:26:47.424463 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:26:47.424473 | mon1 | Monday 31 August 2026 07:26:47 +0000 (0:00:00.757) 0:01:03.278 ********* 2026-08-31 07:26:47.424481 | mon1 | 2026-08-31 07:26:47.424490 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:26:47.424498 | mon1 | Monday 31 August 2026 07:26:47 +0000 (0:00:00.009) 0:01:03.287 ********* 2026-08-31 07:26:47.952312 | mon1 | ok: [osd1] 2026-08-31 07:26:47.952386 | mon1 | 2026-08-31 07:26:47.952397 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:26:47.952527 | mon1 | Monday 31 August 2026 07:26:47 +0000 (0:00:00.529) 0:01:03.817 ********* 2026-08-31 07:26:48.294237 | mon1 | ok: [osd1] 2026-08-31 07:26:48.294285 | mon1 | 2026-08-31 07:26:48.294290 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:26:48.294422 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.341) 0:01:04.158 ********* 2026-08-31 07:26:48.380302 | mon1 | ok: [osd1] => { 2026-08-31 07:26:48.380371 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:26:48.380388 | mon1 | } 2026-08-31 07:26:48.381419 | mon1 | 2026-08-31 07:26:48.381477 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:26:48.381488 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.086) 0:01:04.245 ********* 2026-08-31 07:26:48.844171 | mon1 | ok: [osd1] 2026-08-31 07:26:48.844212 | mon1 | 2026-08-31 07:26:48.844217 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:26:48.844244 | mon1 | Monday 31 August 2026 07:26:48 +0000 (0:00:00.464) 0:01:04.709 ********* 2026-08-31 07:26:52.271273 | mon1 | ok: [osd1] 2026-08-31 07:26:52.271332 | mon1 | 2026-08-31 07:26:52.271339 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:26:52.271345 | mon1 | Monday 31 August 2026 07:26:52 +0000 (0:00:03.426) 0:01:08.135 ********* 2026-08-31 07:26:53.651633 | mon1 | ok: [osd1] 2026-08-31 07:26:53.651714 | mon1 | 2026-08-31 07:26:53.651723 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:26:53.651730 | mon1 | Monday 31 August 2026 07:26:53 +0000 (0:00:01.379) 0:01:09.515 ********* 2026-08-31 07:26:53.951576 | mon1 | ok: [osd1] 2026-08-31 07:26:53.951659 | mon1 | 2026-08-31 07:26:53.951670 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:26:53.951681 | mon1 | Monday 31 August 2026 07:26:53 +0000 (0:00:00.300) 0:01:09.816 ********* 2026-08-31 07:26:54.556042 | mon1 | ok: [osd1] 2026-08-31 07:26:54.556103 | mon1 | 2026-08-31 07:26:54.556111 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:26:54.556134 | mon1 | Monday 31 August 2026 07:26:54 +0000 (0:00:00.604) 0:01:10.421 ********* 2026-08-31 07:26:55.372973 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-31 07:26:55.373077 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:26:55.373126 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:26:55.373137 | mon1 | 2026-08-31 07:26:55.373147 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:26:55.373158 | mon1 | Monday 31 August 2026 07:26:55 +0000 (0:00:00.814) 0:01:11.235 ********* 2026-08-31 07:26:56.007147 | mon1 | ok: [osd1] 2026-08-31 07:26:56.007237 | mon1 | 2026-08-31 07:26:56.007248 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:26:56.007258 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.635) 0:01:11.871 ********* 2026-08-31 07:26:56.651534 | mon1 | ok: [osd1] 2026-08-31 07:26:56.651647 | mon1 | 2026-08-31 07:26:56.651659 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:26:56.651669 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.630) 0:01:12.501 ********* 2026-08-31 07:26:56.653170 | mon1 | 2026-08-31 07:26:56.653709 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:26:56.653734 | mon1 | Monday 31 August 2026 07:26:56 +0000 (0:00:00.013) 0:01:12.515 ********* 2026-08-31 07:26:57.166808 | mon1 | ok: [osd1] 2026-08-31 07:26:57.166918 | mon1 | 2026-08-31 07:26:57.167071 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:26:57.167313 | mon1 | Monday 31 August 2026 07:26:57 +0000 (0:00:00.515) 0:01:13.031 ********* 2026-08-31 07:26:57.239195 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:26:57.239261 | mon1 | 2026-08-31 07:26:57.239577 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:26:57.239633 | mon1 | Monday 31 August 2026 07:26:57 +0000 (0:00:00.072) 0:01:13.104 ********* 2026-08-31 07:26:58.276813 | mon1 | ok: [osd1] 2026-08-31 07:26:58.277068 | mon1 | 2026-08-31 07:26:58.277367 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:26:58.277613 | mon1 | Monday 31 August 2026 07:26:58 +0000 (0:00:01.037) 0:01:14.141 ********* 2026-08-31 07:26:59.146066 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-31 07:26:59.146148 | mon1 | ok: [osd1] => (item=ssh) 2026-08-31 07:26:59.146160 | mon1 | 2026-08-31 07:26:59.146170 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:26:59.146179 | mon1 | Monday 31 August 2026 07:26:59 +0000 (0:00:00.868) 0:01:15.010 ********* 2026-08-31 07:27:01.078183 | mon1 | ok: [osd1] 2026-08-31 07:27:01.078247 | mon1 | 2026-08-31 07:27:01.078284 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:27:01.078296 | mon1 | Monday 31 August 2026 07:27:01 +0000 (0:00:01.931) 0:01:16.941 ********* 2026-08-31 07:27:01.380940 | mon1 | ok: [osd1] 2026-08-31 07:27:01.380997 | mon1 | 2026-08-31 07:27:01.381010 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:27:01.381022 | mon1 | Monday 31 August 2026 07:27:01 +0000 (0:00:00.303) 0:01:17.244 ********* 2026-08-31 07:27:01.754004 | mon1 | ok: [osd1] 2026-08-31 07:27:01.754069 | mon1 | 2026-08-31 07:27:01.754078 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:27:01.754109 | mon1 | Monday 31 August 2026 07:27:01 +0000 (0:00:00.372) 0:01:17.617 ********* 2026-08-31 07:27:02.075733 | mon1 | ok: [osd1] 2026-08-31 07:27:02.075847 | mon1 | 2026-08-31 07:27:02.075909 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-31 07:27:02.076117 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.323) 0:01:17.940 ********* 2026-08-31 07:27:02.419215 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-31 07:27:02.419295 | mon1 | 2026-08-31 07:27:02.419307 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-31 07:27:02.419318 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.342) 0:01:18.282 ********* 2026-08-31 07:27:02.483040 | mon1 | ok: [osd1] 2026-08-31 07:27:02.483184 | mon1 | 2026-08-31 07:27:02.483453 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-31 07:27:02.483846 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.064) 0:01:18.347 ********* 2026-08-31 07:27:02.556262 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-31 07:27:02.556334 | mon1 | 2026-08-31 07:27:02.556864 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-31 07:27:02.556913 | mon1 | Monday 31 August 2026 07:27:02 +0000 (0:00:00.074) 0:01:18.421 ********* 2026-08-31 07:27:04.452541 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:27:04.452586 | mon1 | 2026-08-31 07:27:04.452595 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-31 07:27:04.452602 | mon1 | Monday 31 August 2026 07:27:04 +0000 (0:00:01.895) 0:01:20.316 ********* 2026-08-31 07:27:04.538074 | mon1 | ok: [osd1] => (item=osd1) 2026-08-31 07:27:04.538184 | mon1 | 2026-08-31 07:27:04.538212 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-31 07:27:04.538241 | mon1 | Monday 31 August 2026 07:27:04 +0000 (0:00:00.085) 0:01:20.402 ********* 2026-08-31 07:27:04.956273 | mon1 | ok: [osd1] 2026-08-31 07:27:04.956388 | mon1 | 2026-08-31 07:27:04.956407 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-31 07:27:04.956424 | mon1 | Monday 31 August 2026 07:27:04 +0000 (0:00:00.417) 0:01:20.820 ********* 2026-08-31 07:27:07.743684 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:27:07.743804 | mon1 | 2026-08-31 07:27:07.744180 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-31 07:27:07.744240 | mon1 | Monday 31 August 2026 07:27:07 +0000 (0:00:02.788) 0:01:23.609 ********* 2026-08-31 07:27:14.029058 | mon1 | ok: [osd1] 2026-08-31 07:27:14.029166 | mon1 | 2026-08-31 07:27:14.029180 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-31 07:27:14.029192 | mon1 | Monday 31 August 2026 07:27:14 +0000 (0:00:06.283) 0:01:29.893 ********* 2026-08-31 07:27:15.694173 | mon1 | ok: [osd1] 2026-08-31 07:27:15.694257 | mon1 | 2026-08-31 07:27:15.694281 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-31 07:27:15.694313 | mon1 | Monday 31 August 2026 07:27:15 +0000 (0:00:01.664) 0:01:31.557 ********* 2026-08-31 07:27:15.792338 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-31 07:27:15.792436 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-31 07:27:15.792450 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-31 07:27:15.792503 | mon1 | skipping: [osd1] 2026-08-31 07:27:15.792562 | mon1 | 2026-08-31 07:27:15.793143 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-31 07:27:15.793289 | mon1 | Monday 31 August 2026 07:27:15 +0000 (0:00:00.099) 0:01:31.656 ********* 2026-08-31 07:27:17.808930 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:27:17.809320 | mon1 | 2026-08-31 07:27:17.809673 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-31 07:27:17.810011 | mon1 | Monday 31 August 2026 07:27:17 +0000 (0:00:02.018) 0:01:33.674 ********* 2026-08-31 07:27:19.815302 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:27:19.815379 | mon1 | 2026-08-31 07:27:19.815393 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-31 07:27:19.815414 | mon1 | Monday 31 August 2026 07:27:19 +0000 (0:00:02.004) 0:01:35.679 ********* 2026-08-31 07:27:19.910978 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-31 07:27:19.911028 | mon1 | 2026-08-31 07:27:19.911036 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-31 07:27:19.911042 | mon1 | Monday 31 August 2026 07:27:19 +0000 (0:00:00.096) 0:01:35.775 ********* 2026-08-31 07:27:19.999824 | mon1 | ok: [osd1] 2026-08-31 07:27:19.999997 | mon1 | 2026-08-31 07:27:20.000275 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-31 07:27:20.000577 | mon1 | Monday 31 August 2026 07:27:19 +0000 (0:00:00.088) 0:01:35.864 ********* 2026-08-31 07:27:21.935715 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-31 07:27:21.935794 | mon1 | 2026-08-31 07:27:21.935948 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-31 07:27:21.936137 | mon1 | Monday 31 August 2026 07:27:21 +0000 (0:00:01.936) 0:01:37.800 ********* 2026-08-31 07:27:22.009748 | mon1 | ok: [osd1] 2026-08-31 07:27:22.009802 | mon1 | 2026-08-31 07:27:22.009817 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-31 07:27:22.009830 | mon1 | Monday 31 August 2026 07:27:22 +0000 (0:00:00.073) 0:01:37.873 ********* 2026-08-31 07:27:22.072251 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:27:22.072304 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:27:22.072317 | mon1 | skipping: [osd1] => (item=1) 2026-08-31 07:27:22.072330 | mon1 | skipping: [osd1] 2026-08-31 07:27:22.072342 | mon1 | 2026-08-31 07:27:22.072402 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-31 07:27:22.072747 | mon1 | Monday 31 August 2026 07:27:22 +0000 (0:00:00.062) 0:01:37.936 ********* 2026-08-31 07:27:22.193535 | mon1 | skipping: [osd1] 2026-08-31 07:27:22.193606 | mon1 | 2026-08-31 07:27:22.193625 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-31 07:27:22.193641 | mon1 | 2026-08-31 07:27:22.193657 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:27:22.193670 | mon1 | Monday 31 August 2026 07:27:22 +0000 (0:00:00.121) 0:01:38.058 ********* 2026-08-31 07:27:23.278185 | mon1 | ok: [mon1] 2026-08-31 07:27:23.278242 | mon1 | 2026-08-31 07:27:23.278276 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:27:23.278293 | mon1 | Monday 31 August 2026 07:27:23 +0000 (0:00:01.083) 0:01:39.141 ********* 2026-08-31 07:27:23.587663 | mon1 | ok: [mon1] 2026-08-31 07:27:23.587744 | mon1 | 2026-08-31 07:27:23.587766 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:23.587780 | mon1 | Monday 31 August 2026 07:27:23 +0000 (0:00:00.310) 0:01:39.452 ********* 2026-08-31 07:27:23.643027 | mon1 | skipping: [mon1] 2026-08-31 07:27:23.643113 | mon1 | 2026-08-31 07:27:23.643127 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:27:23.643137 | mon1 | Monday 31 August 2026 07:27:23 +0000 (0:00:00.054) 0:01:39.507 ********* 2026-08-31 07:27:23.945861 | mon1 | ok: [mon1] 2026-08-31 07:27:23.945985 | mon1 | 2026-08-31 07:27:23.946603 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:27:23.946654 | mon1 | Monday 31 August 2026 07:27:23 +0000 (0:00:00.303) 0:01:39.810 ********* 2026-08-31 07:27:24.043234 | mon1 | ok: [mon1] => { 2026-08-31 07:27:24.043282 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:27:24.043286 | mon1 | } 2026-08-31 07:27:24.043291 | mon1 | 2026-08-31 07:27:24.043295 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:27:24.043551 | mon1 | Monday 31 August 2026 07:27:24 +0000 (0:00:00.096) 0:01:39.906 ********* 2026-08-31 07:27:24.499934 | mon1 | ok: [mon1] 2026-08-31 07:27:24.499995 | mon1 | 2026-08-31 07:27:24.500005 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:27:24.500014 | mon1 | Monday 31 August 2026 07:27:24 +0000 (0:00:00.456) 0:01:40.362 ********* 2026-08-31 07:27:24.566890 | mon1 | skipping: [mon1] 2026-08-31 07:27:24.566948 | mon1 | 2026-08-31 07:27:24.566959 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:24.566968 | mon1 | Monday 31 August 2026 07:27:24 +0000 (0:00:00.068) 0:01:40.431 ********* 2026-08-31 07:27:24.624959 | mon1 | skipping: [mon1] 2026-08-31 07:27:24.625014 | mon1 | 2026-08-31 07:27:24.625026 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:27:24.625037 | mon1 | Monday 31 August 2026 07:27:24 +0000 (0:00:00.057) 0:01:40.489 ********* 2026-08-31 07:27:24.953191 | mon1 | ok: [mon1] 2026-08-31 07:27:24.954009 | mon1 | 2026-08-31 07:27:24.954181 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:24.954651 | mon1 | Monday 31 August 2026 07:27:24 +0000 (0:00:00.329) 0:01:40.818 ********* 2026-08-31 07:27:26.004910 | mon1 | ok: [mon1] 2026-08-31 07:27:26.006249 | mon1 | 2026-08-31 07:27:26.006317 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:27:26.006333 | mon1 | Monday 31 August 2026 07:27:26 +0000 (0:00:01.052) 0:01:41.870 ********* 2026-08-31 07:27:26.269286 | mon1 | ok: [mon1] => { 2026-08-31 07:27:26.269362 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:27:26.270429 | mon1 | } 2026-08-31 07:27:26.270488 | mon1 | 2026-08-31 07:27:26.270500 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:27:26.270510 | mon1 | Monday 31 August 2026 07:27:26 +0000 (0:00:00.264) 0:01:42.135 ********* 2026-08-31 07:27:26.885596 | mon1 | ok: [mon1] 2026-08-31 07:27:26.885646 | mon1 | 2026-08-31 07:27:26.885653 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:27:26.885659 | mon1 | Monday 31 August 2026 07:27:26 +0000 (0:00:00.614) 0:01:42.749 ********* 2026-08-31 07:27:29.305305 | mon1 | ok: [mon1] 2026-08-31 07:27:29.305437 | mon1 | 2026-08-31 07:27:29.306017 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:27:29.306064 | mon1 | Monday 31 August 2026 07:27:29 +0000 (0:00:02.410) 0:01:45.160 ********* 2026-08-31 07:27:29.335334 | mon1 | skipping: [mon1] 2026-08-31 07:27:29.335442 | mon1 | 2026-08-31 07:27:29.335844 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:27:29.335872 | mon1 | Monday 31 August 2026 07:27:29 +0000 (0:00:00.040) 0:01:45.200 ********* 2026-08-31 07:27:29.382317 | mon1 | skipping: [mon1] 2026-08-31 07:27:29.382412 | mon1 | 2026-08-31 07:27:29.382429 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:27:29.382746 | mon1 | Monday 31 August 2026 07:27:29 +0000 (0:00:00.046) 0:01:45.247 ********* 2026-08-31 07:27:29.428287 | mon1 | skipping: [mon1] 2026-08-31 07:27:29.428394 | mon1 | 2026-08-31 07:27:29.428405 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:27:29.428415 | mon1 | Monday 31 August 2026 07:27:29 +0000 (0:00:00.046) 0:01:45.293 ********* 2026-08-31 07:27:30.450245 | mon1 | ok: [mon1] 2026-08-31 07:27:30.450388 | mon1 | 2026-08-31 07:27:30.450406 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:27:30.450418 | mon1 | Monday 31 August 2026 07:27:30 +0000 (0:00:01.021) 0:01:46.315 ********* 2026-08-31 07:27:31.071250 | mon1 | ok: [mon1] 2026-08-31 07:27:31.071317 | mon1 | 2026-08-31 07:27:31.071326 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:27:31.071371 | mon1 | Monday 31 August 2026 07:27:31 +0000 (0:00:00.621) 0:01:46.937 ********* 2026-08-31 07:27:32.407155 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:27:32.409110 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:27:32.409161 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:27:32.409172 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:27:32.409181 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:27:32.409192 | mon1 | 2026-08-31 07:27:32.409201 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:27:32.409211 | mon1 | Monday 31 August 2026 07:27:32 +0000 (0:00:01.334) 0:01:48.271 ********* 2026-08-31 07:27:33.185290 | mon1 | ok: [mon1] 2026-08-31 07:27:33.185364 | mon1 | 2026-08-31 07:27:33.185375 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:27:33.185385 | mon1 | Monday 31 August 2026 07:27:33 +0000 (0:00:00.763) 0:01:49.035 ********* 2026-08-31 07:27:33.185394 | mon1 | 2026-08-31 07:27:33.185403 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:27:33.185418 | mon1 | Monday 31 August 2026 07:27:33 +0000 (0:00:00.013) 0:01:49.048 ********* 2026-08-31 07:27:33.679864 | mon1 | ok: [mon1] 2026-08-31 07:27:33.680148 | mon1 | 2026-08-31 07:27:33.680569 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:27:33.680991 | mon1 | Monday 31 August 2026 07:27:33 +0000 (0:00:00.496) 0:01:49.545 ********* 2026-08-31 07:27:33.981824 | mon1 | ok: [mon1] 2026-08-31 07:27:33.981882 | mon1 | 2026-08-31 07:27:33.981893 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:27:33.981903 | mon1 | Monday 31 August 2026 07:27:33 +0000 (0:00:00.300) 0:01:49.846 ********* 2026-08-31 07:27:34.088413 | mon1 | ok: [mon1] => { 2026-08-31 07:27:34.088480 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:27:34.088493 | mon1 | } 2026-08-31 07:27:34.088506 | mon1 | 2026-08-31 07:27:34.088518 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:27:34.088531 | mon1 | Monday 31 August 2026 07:27:34 +0000 (0:00:00.105) 0:01:49.951 ********* 2026-08-31 07:27:34.580190 | mon1 | ok: [mon1] 2026-08-31 07:27:34.581116 | mon1 | 2026-08-31 07:27:34.581174 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:27:34.581184 | mon1 | Monday 31 August 2026 07:27:34 +0000 (0:00:00.493) 0:01:50.445 ********* 2026-08-31 07:27:38.033569 | mon1 | ok: [mon1] 2026-08-31 07:27:38.033647 | mon1 | 2026-08-31 07:27:38.036776 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:27:38.036811 | mon1 | Monday 31 August 2026 07:27:38 +0000 (0:00:03.452) 0:01:53.898 ********* 2026-08-31 07:27:39.108632 | mon1 | ok: [mon1] 2026-08-31 07:27:39.108689 | mon1 | 2026-08-31 07:27:39.108700 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:27:39.108710 | mon1 | Monday 31 August 2026 07:27:39 +0000 (0:00:01.075) 0:01:54.973 ********* 2026-08-31 07:27:39.361915 | mon1 | ok: [mon1] 2026-08-31 07:27:39.361952 | mon1 | 2026-08-31 07:27:39.361957 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:27:39.361961 | mon1 | Monday 31 August 2026 07:27:39 +0000 (0:00:00.253) 0:01:55.227 ********* 2026-08-31 07:27:39.991285 | mon1 | ok: [mon1] 2026-08-31 07:27:39.991584 | mon1 | 2026-08-31 07:27:39.991608 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:27:39.991932 | mon1 | Monday 31 August 2026 07:27:39 +0000 (0:00:00.627) 0:01:55.855 ********* 2026-08-31 07:27:40.795797 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:27:40.795841 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:27:40.795848 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:27:40.795854 | mon1 | 2026-08-31 07:27:40.795869 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:27:40.795874 | mon1 | Monday 31 August 2026 07:27:40 +0000 (0:00:00.803) 0:01:56.658 ********* 2026-08-31 07:27:41.398716 | mon1 | ok: [mon1] 2026-08-31 07:27:41.398768 | mon1 | 2026-08-31 07:27:41.398779 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:27:41.398788 | mon1 | Monday 31 August 2026 07:27:41 +0000 (0:00:00.604) 0:01:57.263 ********* 2026-08-31 07:27:42.004512 | mon1 | ok: [mon1] 2026-08-31 07:27:42.004600 | mon1 | 2026-08-31 07:27:42.004611 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:27:42.004621 | mon1 | Monday 31 August 2026 07:27:41 +0000 (0:00:00.591) 0:01:57.854 ********* 2026-08-31 07:27:42.004629 | mon1 | 2026-08-31 07:27:42.004638 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:27:42.004646 | mon1 | Monday 31 August 2026 07:27:41 +0000 (0:00:00.013) 0:01:57.867 ********* 2026-08-31 07:27:42.502720 | mon1 | ok: [mon1] 2026-08-31 07:27:42.502778 | mon1 | 2026-08-31 07:27:42.502788 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:27:42.502797 | mon1 | Monday 31 August 2026 07:27:42 +0000 (0:00:00.498) 0:01:58.366 ********* 2026-08-31 07:27:42.568773 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:27:42.568828 | mon1 | 2026-08-31 07:27:42.568837 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:27:42.568846 | mon1 | Monday 31 August 2026 07:27:42 +0000 (0:00:00.067) 0:01:58.433 ********* 2026-08-31 07:27:44.623286 | mon1 | ok: [mon1] 2026-08-31 07:27:44.623362 | mon1 | 2026-08-31 07:27:44.623374 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:27:44.623597 | mon1 | Monday 31 August 2026 07:27:44 +0000 (0:00:02.054) 0:02:00.487 ********* 2026-08-31 07:27:45.534127 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:27:45.534190 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:27:45.534197 | mon1 | 2026-08-31 07:27:45.534202 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:27:45.534207 | mon1 | Monday 31 August 2026 07:27:45 +0000 (0:00:00.911) 0:02:01.398 ********* 2026-08-31 07:27:46.530919 | mon1 | ok: [mon1] 2026-08-31 07:27:46.530966 | mon1 | 2026-08-31 07:27:46.530971 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:27:46.530977 | mon1 | Monday 31 August 2026 07:27:46 +0000 (0:00:00.996) 0:02:02.395 ********* 2026-08-31 07:27:46.813904 | mon1 | ok: [mon1] 2026-08-31 07:27:46.813931 | mon1 | 2026-08-31 07:27:46.813936 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:27:46.813941 | mon1 | Monday 31 August 2026 07:27:46 +0000 (0:00:00.283) 0:02:02.679 ********* 2026-08-31 07:27:47.178232 | mon1 | ok: [mon1] 2026-08-31 07:27:47.178736 | mon1 | 2026-08-31 07:27:47.178750 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:27:47.178757 | mon1 | Monday 31 August 2026 07:27:47 +0000 (0:00:00.362) 0:02:03.041 ********* 2026-08-31 07:27:47.507253 | mon1 | ok: [mon1] 2026-08-31 07:27:47.507330 | mon1 | 2026-08-31 07:27:47.507341 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-31 07:27:47.507351 | mon1 | Monday 31 August 2026 07:27:47 +0000 (0:00:00.331) 0:02:03.372 ********* 2026-08-31 07:27:49.470632 | mon1 | ok: [mon1] 2026-08-31 07:27:49.470709 | mon1 | 2026-08-31 07:27:49.470905 | mon1 | PLAY [Upgrade check] *********************************************************** 2026-08-31 07:27:49.471048 | mon1 | 2026-08-31 07:27:49.471270 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:27:49.471413 | mon1 | Monday 31 August 2026 07:27:49 +0000 (0:00:01.964) 0:02:05.336 ********* 2026-08-31 07:27:50.521673 | mon1 | ok: [mon1] 2026-08-31 07:27:50.521743 | mon1 | 2026-08-31 07:27:50.521759 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:27:50.521772 | mon1 | Monday 31 August 2026 07:27:50 +0000 (0:00:01.048) 0:02:06.385 ********* 2026-08-31 07:27:50.823373 | mon1 | ok: [mon1] 2026-08-31 07:27:50.823424 | mon1 | 2026-08-31 07:27:50.823435 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:50.823443 | mon1 | Monday 31 August 2026 07:27:50 +0000 (0:00:00.302) 0:02:06.688 ********* 2026-08-31 07:27:50.881009 | mon1 | skipping: [mon1] 2026-08-31 07:27:50.881076 | mon1 | 2026-08-31 07:27:50.881154 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-31 07:27:50.881173 | mon1 | Monday 31 August 2026 07:27:50 +0000 (0:00:00.057) 0:02:06.745 ********* 2026-08-31 07:27:51.203197 | mon1 | ok: [mon1] 2026-08-31 07:27:51.203244 | mon1 | 2026-08-31 07:27:51.203253 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:27:51.203261 | mon1 | Monday 31 August 2026 07:27:51 +0000 (0:00:00.322) 0:02:07.067 ********* 2026-08-31 07:27:51.314810 | mon1 | ok: [mon1] => { 2026-08-31 07:27:51.314882 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-31 07:27:51.314896 | mon1 | } 2026-08-31 07:27:51.314909 | mon1 | 2026-08-31 07:27:51.314922 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:27:51.314935 | mon1 | Monday 31 August 2026 07:27:51 +0000 (0:00:00.109) 0:02:07.177 ********* 2026-08-31 07:27:51.727275 | mon1 | ok: [mon1] 2026-08-31 07:27:51.727339 | mon1 | 2026-08-31 07:27:51.727727 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:27:51.727781 | mon1 | Monday 31 August 2026 07:27:51 +0000 (0:00:00.412) 0:02:07.590 ********* 2026-08-31 07:27:51.780263 | mon1 | skipping: [mon1] 2026-08-31 07:27:51.780305 | mon1 | 2026-08-31 07:27:51.780314 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:51.780323 | mon1 | Monday 31 August 2026 07:27:51 +0000 (0:00:00.054) 0:02:07.645 ********* 2026-08-31 07:27:51.828748 | mon1 | skipping: [mon1] 2026-08-31 07:27:51.828806 | mon1 | 2026-08-31 07:27:51.828820 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:27:51.828833 | mon1 | Monday 31 August 2026 07:27:51 +0000 (0:00:00.048) 0:02:07.693 ********* 2026-08-31 07:27:52.110128 | mon1 | ok: [mon1] 2026-08-31 07:27:52.110176 | mon1 | 2026-08-31 07:27:52.123192 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-31 07:27:52.123448 | mon1 | Monday 31 August 2026 07:27:52 +0000 (0:00:00.279) 0:02:07.973 ********* 2026-08-31 07:27:53.084351 | mon1 | ok: [mon1] 2026-08-31 07:27:53.084728 | mon1 | 2026-08-31 07:27:53.085058 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:27:53.085442 | mon1 | Monday 31 August 2026 07:27:53 +0000 (0:00:00.975) 0:02:08.948 ********* 2026-08-31 07:27:53.310923 | mon1 | ok: [mon1] => { 2026-08-31 07:27:53.311406 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-31 07:27:53.311749 | mon1 | } 2026-08-31 07:27:53.312043 | mon1 | 2026-08-31 07:27:53.312491 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:27:53.312894 | mon1 | Monday 31 August 2026 07:27:53 +0000 (0:00:00.227) 0:02:09.176 ********* 2026-08-31 07:27:53.894743 | mon1 | ok: [mon1] 2026-08-31 07:27:53.895139 | mon1 | 2026-08-31 07:27:53.895501 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:27:53.895838 | mon1 | Monday 31 August 2026 07:27:53 +0000 (0:00:00.583) 0:02:09.760 ********* 2026-08-31 07:27:56.245058 | mon1 | ok: [mon1] 2026-08-31 07:27:56.245520 | mon1 | 2026-08-31 07:27:56.245879 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-31 07:27:56.246282 | mon1 | Monday 31 August 2026 07:27:56 +0000 (0:00:02.350) 0:02:12.110 ********* 2026-08-31 07:27:56.283669 | mon1 | skipping: [mon1] 2026-08-31 07:27:56.284140 | mon1 | 2026-08-31 07:27:56.284557 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-31 07:27:56.284934 | mon1 | Monday 31 August 2026 07:27:56 +0000 (0:00:00.038) 0:02:12.149 ********* 2026-08-31 07:27:56.331264 | mon1 | skipping: [mon1] 2026-08-31 07:27:56.331662 | mon1 | 2026-08-31 07:27:56.332019 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-31 07:27:56.332410 | mon1 | Monday 31 August 2026 07:27:56 +0000 (0:00:00.047) 0:02:12.196 ********* 2026-08-31 07:27:56.371121 | mon1 | skipping: [mon1] 2026-08-31 07:27:56.371512 | mon1 | 2026-08-31 07:27:56.371864 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-31 07:27:56.372247 | mon1 | Monday 31 August 2026 07:27:56 +0000 (0:00:00.040) 0:02:12.237 ********* 2026-08-31 07:27:57.438786 | mon1 | ok: [mon1] 2026-08-31 07:27:57.439664 | mon1 | 2026-08-31 07:27:57.439687 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-31 07:27:57.439696 | mon1 | Monday 31 August 2026 07:27:57 +0000 (0:00:01.066) 0:02:13.304 ********* 2026-08-31 07:27:58.028661 | mon1 | ok: [mon1] 2026-08-31 07:27:58.028712 | mon1 | 2026-08-31 07:27:58.028722 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-31 07:27:58.028732 | mon1 | Monday 31 August 2026 07:27:58 +0000 (0:00:00.588) 0:02:13.892 ********* 2026-08-31 07:27:59.236765 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-31 07:27:59.236828 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-31 07:27:59.236842 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-31 07:27:59.236854 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-31 07:27:59.236865 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-31 07:27:59.236877 | mon1 | 2026-08-31 07:27:59.236889 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-31 07:27:59.236900 | mon1 | Monday 31 August 2026 07:27:59 +0000 (0:00:01.207) 0:02:15.099 ********* 2026-08-31 07:27:59.974195 | mon1 | ok: [mon1] 2026-08-31 07:27:59.974256 | mon1 | 2026-08-31 07:27:59.974315 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-31 07:27:59.975422 | mon1 | Monday 31 August 2026 07:27:59 +0000 (0:00:00.728) 0:02:15.828 ********* 2026-08-31 07:27:59.975485 | mon1 | 2026-08-31 07:27:59.975497 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-31 07:27:59.975506 | mon1 | Monday 31 August 2026 07:27:59 +0000 (0:00:00.011) 0:02:15.839 ********* 2026-08-31 07:28:00.476642 | mon1 | ok: [mon1] 2026-08-31 07:28:00.476694 | mon1 | 2026-08-31 07:28:00.476704 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-31 07:28:00.476714 | mon1 | Monday 31 August 2026 07:28:00 +0000 (0:00:00.500) 0:02:16.340 ********* 2026-08-31 07:28:00.788272 | mon1 | ok: [mon1] 2026-08-31 07:28:00.788324 | mon1 | 2026-08-31 07:28:00.788336 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-31 07:28:00.788346 | mon1 | Monday 31 August 2026 07:28:00 +0000 (0:00:00.311) 0:02:16.651 ********* 2026-08-31 07:28:00.893901 | mon1 | ok: [mon1] => { 2026-08-31 07:28:00.893948 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-31 07:28:00.893954 | mon1 | } 2026-08-31 07:28:00.893960 | mon1 | 2026-08-31 07:28:00.893965 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-31 07:28:00.894003 | mon1 | Monday 31 August 2026 07:28:00 +0000 (0:00:00.105) 0:02:16.757 ********* 2026-08-31 07:28:01.368912 | mon1 | ok: [mon1] 2026-08-31 07:28:01.368960 | mon1 | 2026-08-31 07:28:01.368988 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-31 07:28:01.368992 | mon1 | Monday 31 August 2026 07:28:01 +0000 (0:00:00.476) 0:02:17.234 ********* 2026-08-31 07:28:04.813125 | mon1 | ok: [mon1] 2026-08-31 07:28:04.813186 | mon1 | 2026-08-31 07:28:04.813196 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-31 07:28:04.813206 | mon1 | Monday 31 August 2026 07:28:04 +0000 (0:00:03.442) 0:02:20.676 ********* 2026-08-31 07:28:05.861799 | mon1 | ok: [mon1] 2026-08-31 07:28:05.861855 | mon1 | 2026-08-31 07:28:05.861865 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-31 07:28:05.861875 | mon1 | Monday 31 August 2026 07:28:05 +0000 (0:00:01.049) 0:02:21.725 ********* 2026-08-31 07:28:06.157165 | mon1 | ok: [mon1] 2026-08-31 07:28:06.157214 | mon1 | 2026-08-31 07:28:06.158017 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-31 07:28:06.158048 | mon1 | Monday 31 August 2026 07:28:06 +0000 (0:00:00.296) 0:02:22.022 ********* 2026-08-31 07:28:06.750557 | mon1 | ok: [mon1] 2026-08-31 07:28:06.750621 | mon1 | 2026-08-31 07:28:06.750800 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-31 07:28:06.750969 | mon1 | Monday 31 August 2026 07:28:06 +0000 (0:00:00.594) 0:02:22.616 ********* 2026-08-31 07:28:07.487999 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-31 07:28:07.489366 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-31 07:28:07.489437 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-31 07:28:07.489447 | mon1 | 2026-08-31 07:28:07.489457 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-31 07:28:07.489467 | mon1 | Monday 31 August 2026 07:28:07 +0000 (0:00:00.735) 0:02:23.351 ********* 2026-08-31 07:28:08.079878 | mon1 | ok: [mon1] 2026-08-31 07:28:08.079971 | mon1 | 2026-08-31 07:28:08.079982 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-31 07:28:08.079991 | mon1 | Monday 31 August 2026 07:28:08 +0000 (0:00:00.591) 0:02:23.943 ********* 2026-08-31 07:28:08.684290 | mon1 | ok: [mon1] 2026-08-31 07:28:08.684342 | mon1 | 2026-08-31 07:28:08.684353 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-31 07:28:08.684362 | mon1 | Monday 31 August 2026 07:28:08 +0000 (0:00:00.591) 0:02:24.534 ********* 2026-08-31 07:28:08.684371 | mon1 | 2026-08-31 07:28:08.684379 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-31 07:28:08.684387 | mon1 | Monday 31 August 2026 07:28:08 +0000 (0:00:00.012) 0:02:24.547 ********* 2026-08-31 07:28:09.176704 | mon1 | ok: [mon1] 2026-08-31 07:28:09.176762 | mon1 | 2026-08-31 07:28:09.176772 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-31 07:28:09.176782 | mon1 | Monday 31 August 2026 07:28:09 +0000 (0:00:00.492) 0:02:25.040 ********* 2026-08-31 07:28:09.258316 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-31 07:28:09.258361 | mon1 | 2026-08-31 07:28:09.258367 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-31 07:28:09.258373 | mon1 | Monday 31 August 2026 07:28:09 +0000 (0:00:00.082) 0:02:25.123 ********* 2026-08-31 07:28:10.400923 | mon1 | ok: [mon1] 2026-08-31 07:28:10.400960 | mon1 | 2026-08-31 07:28:10.400965 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-31 07:28:10.400970 | mon1 | Monday 31 August 2026 07:28:10 +0000 (0:00:01.142) 0:02:26.265 ********* 2026-08-31 07:28:12.296906 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-31 07:28:12.296959 | mon1 | ok: [mon1] => (item=ssh) 2026-08-31 07:28:12.296971 | mon1 | 2026-08-31 07:28:12.296982 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-31 07:28:12.297014 | mon1 | Monday 31 August 2026 07:28:12 +0000 (0:00:01.895) 0:02:28.160 ********* 2026-08-31 07:28:13.008200 | mon1 | ok: [mon1] 2026-08-31 07:28:13.008259 | mon1 | 2026-08-31 07:28:13.008706 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-31 07:28:13.008733 | mon1 | Monday 31 August 2026 07:28:13 +0000 (0:00:00.712) 0:02:28.872 ********* 2026-08-31 07:28:13.297808 | mon1 | ok: [mon1] 2026-08-31 07:28:13.298152 | mon1 | 2026-08-31 07:28:13.298447 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-31 07:28:13.298729 | mon1 | Monday 31 August 2026 07:28:13 +0000 (0:00:00.288) 0:02:29.161 ********* 2026-08-31 07:28:13.624217 | mon1 | ok: [mon1] 2026-08-31 07:28:13.624338 | mon1 | 2026-08-31 07:28:13.624506 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-31 07:28:13.624691 | mon1 | Monday 31 August 2026 07:28:13 +0000 (0:00:00.329) 0:02:29.490 ********* 2026-08-31 07:28:13.920164 | mon1 | ok: [mon1] 2026-08-31 07:28:13.920215 | mon1 | 2026-08-31 07:28:13.920550 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] ************************** 2026-08-31 07:28:13.920953 | mon1 | Monday 31 August 2026 07:28:13 +0000 (0:00:00.295) 0:02:29.785 ********* 2026-08-31 07:28:15.879658 | mon1 | ok: [mon1] 2026-08-31 07:28:15.881196 | mon1 | 2026-08-31 07:28:15.881252 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] ********************* 2026-08-31 07:28:15.881267 | mon1 | Monday 31 August 2026 07:28:15 +0000 (0:00:01.958) 0:02:31.744 ********* 2026-08-31 07:28:15.955224 | mon1 | ok: [mon1] 2026-08-31 07:28:15.955319 | mon1 | 2026-08-31 07:28:15.955335 | mon1 | TASK [vexxhost.ceph.upgrade_check : Run upgrade] ******************************* 2026-08-31 07:28:15.955351 | mon1 | Monday 31 August 2026 07:28:15 +0000 (0:00:00.074) 0:02:31.818 ********* 2026-08-31 07:28:16.000247 | mon1 | skipping: [mon1] 2026-08-31 07:28:16.000381 | mon1 | 2026-08-31 07:28:16.000406 | mon1 | TASK [vexxhost.ceph.upgrade_check : Wait until Ceph upgraded] ****************** 2026-08-31 07:28:16.000634 | mon1 | Monday 31 August 2026 07:28:15 +0000 (0:00:00.046) 0:02:31.865 ********* 2026-08-31 07:28:16.039177 | mon1 | skipping: [mon1] 2026-08-31 07:28:16.039213 | mon1 | 2026-08-31 07:28:16.039223 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:28:16.039235 | mon1 | mon1 : ok=118 changed=0 unreachable=0 failed=0 skipped=23 rescued=0 ignored=0 2026-08-31 07:28:16.039243 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-31 07:28:16.039253 | mon1 | 2026-08-31 07:28:16.039261 | mon1 | 2026-08-31 07:28:16.039270 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:28:16.039280 | mon1 | Monday 31 August 2026 07:28:16 +0000 (0:00:00.038) 0:02:31.903 ********* 2026-08-31 07:28:16.039293 | mon1 | =============================================================================== 2026-08-31 07:28:16.039420 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.13s 2026-08-31 07:28:16.039562 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 6.28s 2026-08-31 07:28:16.039702 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.47s 2026-08-31 07:28:16.039861 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.45s 2026-08-31 07:28:16.040030 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.44s 2026-08-31 07:28:16.040189 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.43s 2026-08-31 07:28:16.040326 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.88s 2026-08-31 07:28:16.040465 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.85s 2026-08-31 07:28:16.040604 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.79s 2026-08-31 07:28:16.040742 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.69s 2026-08-31 07:28:16.040899 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.41s 2026-08-31 07:28:16.041037 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.39s 2026-08-31 07:28:16.041207 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.35s 2026-08-31 07:28:16.041347 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 2.09s 2026-08-31 07:28:16.041488 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 2.05s 2026-08-31 07:28:16.041624 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 2.05s 2026-08-31 07:28:16.041762 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 2.03s 2026-08-31 07:28:16.041920 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 2.02s 2026-08-31 07:28:16.042062 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 2.01s 2026-08-31 07:28:16.042224 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 2.00s 2026-08-31 07:28:16.136691 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-31 07:28:16.151246 | mon1 | INFO [default > side_effect] Executing 2026-08-31 07:28:16.151904 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:28:16.164907 | mon1 | INFO [default > verify] Executing 2026-08-31 07:28:16.931258 | mon1 | 2026-08-31 07:28:16.931335 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-31 07:28:16.931462 | mon1 | 2026-08-31 07:28:16.931584 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-31 07:28:16.931725 | mon1 | Monday 31 August 2026 07:28:16 +0000 (0:00:00.008) 0:00:00.008 ********* 2026-08-31 07:28:18.342947 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-31 07:28:18.343291 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-31 07:28:18.343424 | mon1 | interpreter could change the meaning of that path. See 2026-08-31 07:28:18.343634 | mon1 | https://docs.ansible.com/ansible- 2026-08-31 07:28:18.343881 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-31 07:28:18.357898 | mon1 | ok: [mon1] 2026-08-31 07:28:18.358131 | mon1 | 2026-08-31 07:28:18.358420 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-31 07:28:18.358669 | mon1 | Monday 31 August 2026 07:28:18 +0000 (0:00:01.425) 0:00:01.434 ********* 2026-08-31 07:28:24.501645 | mon1 | ok: [mon1] 2026-08-31 07:28:24.501828 | mon1 | 2026-08-31 07:28:24.502066 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-31 07:28:24.503160 | mon1 | Monday 31 August 2026 07:28:24 +0000 (0:00:06.141) 0:00:07.575 ********* 2026-08-31 07:28:24.568268 | mon1 | ok: [mon1] 2026-08-31 07:28:24.568338 | mon1 | 2026-08-31 07:28:24.568348 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-31 07:28:24.568357 | mon1 | Monday 31 August 2026 07:28:24 +0000 (0:00:00.068) 0:00:07.643 ********* 2026-08-31 07:28:24.614771 | mon1 | ok: [mon1] => { 2026-08-31 07:28:24.614937 | mon1 | "changed": false, 2026-08-31 07:28:24.615213 | mon1 | "msg": "All assertions passed" 2026-08-31 07:28:24.615417 | mon1 | } 2026-08-31 07:28:24.615619 | mon1 | 2026-08-31 07:28:24.615867 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-31 07:28:24.616121 | mon1 | Monday 31 August 2026 07:28:24 +0000 (0:00:00.047) 0:00:07.691 ********* 2026-08-31 07:28:26.537235 | mon1 | ok: [mon1] 2026-08-31 07:28:26.537638 | mon1 | 2026-08-31 07:28:26.537684 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-31 07:28:26.537921 | mon1 | Monday 31 August 2026 07:28:26 +0000 (0:00:01.921) 0:00:09.612 ********* 2026-08-31 07:28:26.596737 | mon1 | ok: [mon1] => { 2026-08-31 07:28:26.596895 | mon1 | "_ceph_health": { 2026-08-31 07:28:26.597106 | mon1 | "changed": false, 2026-08-31 07:28:26.597320 | mon1 | "cmd": [ 2026-08-31 07:28:26.597485 | mon1 | "cephadm", 2026-08-31 07:28:26.597635 | mon1 | "shell", 2026-08-31 07:28:26.597798 | mon1 | "--", 2026-08-31 07:28:26.597942 | mon1 | "ceph", 2026-08-31 07:28:26.598111 | mon1 | "health" 2026-08-31 07:28:26.598267 | mon1 | ], 2026-08-31 07:28:26.598419 | mon1 | "delta": "0:00:01.619012", 2026-08-31 07:28:26.598590 | mon1 | "end": "2026-08-31 07:28:26.466449", 2026-08-31 07:28:26.598807 | mon1 | "failed": false, 2026-08-31 07:28:26.598958 | mon1 | "msg": "", 2026-08-31 07:28:26.599181 | mon1 | "rc": 0, 2026-08-31 07:28:26.599381 | mon1 | "start": "2026-08-31 07:28:24.847437", 2026-08-31 07:28:26.599579 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-31 07:28:26.599843 | mon1 | "stderr_lines": [ 2026-08-31 07:28:26.600041 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-31 07:28:26.600228 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-31 07:28:26.600367 | mon1 | ], 2026-08-31 07:28:26.600516 | mon1 | "stdout": "HEALTH_OK", 2026-08-31 07:28:26.600673 | mon1 | "stdout_lines": [ 2026-08-31 07:28:26.600820 | mon1 | "HEALTH_OK" 2026-08-31 07:28:26.600961 | mon1 | ] 2026-08-31 07:28:26.601130 | mon1 | } 2026-08-31 07:28:26.601300 | mon1 | } 2026-08-31 07:28:26.601507 | mon1 | 2026-08-31 07:28:26.601765 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-31 07:28:26.601947 | mon1 | Monday 31 August 2026 07:28:26 +0000 (0:00:00.059) 0:00:09.672 ********* 2026-08-31 07:28:26.650013 | mon1 | ok: [mon1] => { 2026-08-31 07:28:26.650241 | mon1 | "changed": false, 2026-08-31 07:28:26.650484 | mon1 | "msg": "All assertions passed" 2026-08-31 07:28:26.650929 | mon1 | } 2026-08-31 07:28:26.651180 | mon1 | 2026-08-31 07:28:26.651415 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-31 07:28:26.651694 | mon1 | Monday 31 August 2026 07:28:26 +0000 (0:00:00.053) 0:00:09.725 ********* 2026-08-31 07:28:33.361965 | mon1 | changed: [mon1] 2026-08-31 07:28:33.362160 | mon1 | 2026-08-31 07:28:33.362434 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-31 07:28:33.362933 | mon1 | Monday 31 August 2026 07:28:33 +0000 (0:00:06.711) 0:00:16.437 ********* 2026-08-31 07:28:36.120917 | mon1 | changed: [mon1] 2026-08-31 07:28:36.121233 | mon1 | 2026-08-31 07:28:36.121564 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-31 07:28:36.121857 | mon1 | Monday 31 August 2026 07:28:36 +0000 (0:00:02.759) 0:00:19.197 ********* 2026-08-31 07:28:37.515243 | mon1 | ok: [mon1] 2026-08-31 07:28:37.515324 | mon1 | 2026-08-31 07:28:37.515339 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-31 07:28:37.515352 | mon1 | Monday 31 August 2026 07:28:37 +0000 (0:00:01.392) 0:00:20.589 ********* 2026-08-31 07:28:37.588457 | mon1 | ok: [mon1] => { 2026-08-31 07:28:37.588525 | mon1 | "changed": false, 2026-08-31 07:28:37.588539 | mon1 | "msg": "All assertions passed" 2026-08-31 07:28:37.588551 | mon1 | } 2026-08-31 07:28:37.588563 | mon1 | 2026-08-31 07:28:37.588575 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-31 07:28:37.588587 | mon1 | Monday 31 August 2026 07:28:37 +0000 (0:00:00.073) 0:00:20.662 ********* 2026-08-31 07:28:38.857871 | mon1 | ok: [mon1] 2026-08-31 07:28:38.857930 | mon1 | 2026-08-31 07:28:38.857945 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-08-31 07:28:38.857959 | mon1 | Monday 31 August 2026 07:28:38 +0000 (0:00:01.268) 0:00:21.930 ********* 2026-08-31 07:28:38.909146 | mon1 | ok: [mon1] => { 2026-08-31 07:28:38.909220 | mon1 | "changed": false, 2026-08-31 07:28:38.909227 | mon1 | "msg": "All assertions passed" 2026-08-31 07:28:38.909232 | mon1 | } 2026-08-31 07:28:38.909238 | mon1 | 2026-08-31 07:28:38.909244 | mon1 | PLAY RECAP ********************************************************************* 2026-08-31 07:28:38.909274 | mon1 | mon1 : ok=13 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-31 07:28:38.909278 | mon1 | 2026-08-31 07:28:38.909281 | mon1 | 2026-08-31 07:28:38.909285 | mon1 | TASKS RECAP ******************************************************************** 2026-08-31 07:28:38.909290 | mon1 | Monday 31 August 2026 07:28:38 +0000 (0:00:00.052) 0:00:21.983 ********* 2026-08-31 07:28:38.909294 | mon1 | =============================================================================== 2026-08-31 07:28:38.909297 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.71s 2026-08-31 07:28:38.909301 | mon1 | List locally deployed Ceph daemons -------------------------------------- 6.14s 2026-08-31 07:28:38.909305 | mon1 | Create a test Ceph key -------------------------------------------------- 2.76s 2026-08-31 07:28:38.909309 | mon1 | Get cluster health status ----------------------------------------------- 1.92s 2026-08-31 07:28:38.909313 | mon1 | Gathering Facts --------------------------------------------------------- 1.43s 2026-08-31 07:28:38.909317 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.39s 2026-08-31 07:28:38.909320 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.27s 2026-08-31 07:28:38.909324 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.07s 2026-08-31 07:28:38.909328 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.07s 2026-08-31 07:28:38.909332 | mon1 | Print cluster health status --------------------------------------------- 0.06s 2026-08-31 07:28:38.909336 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.05s 2026-08-31 07:28:38.909404 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-08-31 07:28:38.909543 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.05s 2026-08-31 07:28:39.003592 | mon1 | INFO [default > verify] Executed: Successful 2026-08-31 07:28:39.017816 | mon1 | INFO [default > cleanup] Executing 2026-08-31 07:28:39.018565 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-31 07:28:39.031915 | mon1 | INFO [default > destroy] Executing 2026-08-31 07:28:39.032193 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-31 07:28:39.032434 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-31 07:28:39.033194 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-08-31 07:28:39.565198 | mon1 | ok: Runtime: 0:15:21.762139 2026-08-31 07:28:39.583816 | 2026-08-31 07:28:39.583879 | PLAY RECAP 2026-08-31 07:28:39.583926 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-31 07:28:39.583948 | 2026-08-31 07:28:39.782931 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-31 07:28:39.786653 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-31 07:28:40.572310 | 2026-08-31 07:28:40.572453 | PLAY [all] 2026-08-31 07:28:40.587419 | 2026-08-31 07:28:40.587513 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-31 07:28:40.653601 | mon1 | ok 2026-08-31 07:28:40.658438 | osd1 | ok 2026-08-31 07:28:40.663213 | 2026-08-31 07:28:40.663289 | TASK [fetch-output : Set log path for single node] 2026-08-31 07:28:40.688226 | mon1 | skipping: Conditional result was False 2026-08-31 07:28:40.699499 | osd1 | skipping: Conditional result was False 2026-08-31 07:28:40.708707 | 2026-08-31 07:28:40.708804 | LOOP [fetch-output : Ensure local output dirs] 2026-08-31 07:28:41.095249 | mon1 -> localhost | changed: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/logs/mon1" 2026-08-31 07:28:41.100200 | osd1 -> localhost | changed: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/logs/osd1" 2026-08-31 07:28:41.305603 | osd1 -> localhost | changed: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/artifacts" 2026-08-31 07:28:41.315510 | mon1 -> localhost | ok: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/artifacts" 2026-08-31 07:28:41.522663 | osd1 -> localhost | changed: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/docs" 2026-08-31 07:28:41.529951 | mon1 -> localhost | ok: "/var/lib/zuul/builds/e64ee756bf6044c6bd4e1a6f5947ece1/work/docs" 2026-08-31 07:28:41.530034 | mon1 -> localhost | changed: All items complete 2026-08-31 07:28:41.530075 | 2026-08-31 07:28:41.549592 | 2026-08-31 07:28:41.549748 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-31 07:28:42.233705 | osd1 | changed: .d..t...... ./ 2026-08-31 07:28:42.239994 | mon1 | changed: .d..t...... ./ 2026-08-31 07:28:42.718703 | osd1 | changed: .d..t...... ./ 2026-08-31 07:28:42.807523 | mon1 | ok 2026-08-31 07:28:43.211367 | osd1 | changed: .d..t...... ./ 2026-08-31 07:28:43.297789 | mon1 | ok 2026-08-31 07:28:43.297953 | mon1 | changed: All items complete 2026-08-31 07:28:43.297998 | 2026-08-31 07:28:43.325754 | 2026-08-31 07:28:43.325961 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-31 07:28:43.741757 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008681 2026-08-31 07:28:44.000594 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006745 2026-08-31 07:28:44.028652 | 2026-08-31 07:28:44.028832 | PLAY [all] 2026-08-31 07:28:44.039758 | 2026-08-31 07:28:44.039903 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-31 07:28:44.537561 | mon1 | changed 2026-08-31 07:28:44.760514 | osd1 | changed 2026-08-31 07:28:44.771254 | 2026-08-31 07:28:44.771313 | PLAY RECAP 2026-08-31 07:28:44.771362 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-31 07:28:44.771391 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-31 07:28:44.771411 | 2026-08-31 07:28:44.968442 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-31 07:28:44.972273 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-31 07:28:45.580123 | 2026-08-31 07:28:45.580272 | PLAY [localhost] 2026-08-31 07:28:45.590587 | 2026-08-31 07:28:45.590659 | TASK [Generate Zuul manifest] 2026-08-31 07:28:45.613877 | localhost | ok 2026-08-31 07:28:45.649886 | 2026-08-31 07:28:45.649977 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-31 07:28:46.028592 | localhost | changed 2026-08-31 07:28:46.042726 | 2026-08-31 07:28:46.042859 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-31 07:28:46.074763 | localhost | ok 2026-08-31 07:28:46.082012 | 2026-08-31 07:28:46.082080 | TASK [Upload logs] 2026-08-31 07:28:46.103676 | localhost | ok 2026-08-31 07:28:46.199782 | 2026-08-31 07:28:46.199901 | TASK [Set zuul-log-path fact] 2026-08-31 07:28:46.225575 | localhost | ok 2026-08-31 07:28:46.260779 | 2026-08-31 07:28:46.260854 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-31 07:28:46.292956 | localhost | ok 2026-08-31 07:28:46.301603 | 2026-08-31 07:28:46.301670 | TASK [upload-logs : Create log directories] 2026-08-31 07:28:46.713772 | localhost | changed 2026-08-31 07:28:46.719074 | 2026-08-31 07:28:46.719150 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-31 07:28:47.118404 | localhost -> localhost | ok: Runtime: 0:00:00.005724 2026-08-31 07:28:47.124003 | 2026-08-31 07:28:47.124074 | TASK [upload-logs : Upload logs to log server] 2026-08-31 07:28:47.590069 | localhost | Output suppressed because no_log was given 2026-08-31 07:28:47.595329 | 2026-08-31 07:28:47.595403 | LOOP [upload-logs : Compress console log and json output] 2026-08-31 07:28:47.688782 | localhost | skipping: Conditional result was False 2026-08-31 07:28:47.695363 | localhost | skipping: Conditional result was False 2026-08-31 07:28:47.712881 | 2026-08-31 07:28:47.713075 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-31 07:28:47.801733 | localhost | skipping: Conditional result was False 2026-08-31 07:28:47.802214 | 2026-08-31 07:28:47.805982 | localhost | skipping: Conditional result was False 2026-08-31 07:28:47.871311 | 2026-08-31 07:28:47.871490 | LOOP [upload-logs : Upload console log and json output]