2026-08-18 11:40:18.544923 | Job console starting 2026-08-18 11:40:18.571224 | Updating git repos 2026-08-18 11:40:18.592753 | Cloning repos into workspace 2026-08-18 11:40:18.631081 | Restoring repo states 2026-08-18 11:40:18.651506 | Merging changes 2026-08-18 11:40:19.144026 | Checking out repos 2026-08-18 11:40:19.203507 | Preparing playbooks 2026-08-18 11:40:20.750699 | Running Ansible setup 2026-08-18 11:40:26.366199 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 11:40:27.007372 | 2026-08-18 11:40:27.007530 | PLAY [localhost] 2026-08-18 11:40:27.015962 | 2026-08-18 11:40:27.016048 | TASK [Gathering Facts] 2026-08-18 11:40:27.952866 | localhost | ok 2026-08-18 11:40:27.968183 | 2026-08-18 11:40:27.968569 | TASK [Setup log path fact] 2026-08-18 11:40:27.987271 | localhost | ok 2026-08-18 11:40:27.998009 | 2026-08-18 11:40:27.998100 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 11:40:28.028378 | localhost | ok 2026-08-18 11:40:28.038125 | 2026-08-18 11:40:28.038314 | TASK [emit-job-header : Print job information] 2026-08-18 11:40:28.082939 | # Job Information 2026-08-18 11:40:28.083249 | Ansible Version: 2.16.18 2026-08-18 11:40:28.083293 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-08-18 11:40:28.083317 | Pipeline: check 2026-08-18 11:40:28.083355 | Executor: 2d72f0692154 2026-08-18 11:40:28.083376 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 11:40:28.083400 | Event ID: 10edcc30-9af9-11f1-8cfe-0e8dec461e98 2026-08-18 11:40:28.086449 | 2026-08-18 11:40:28.086532 | LOOP [emit-job-header : Print node information] 2026-08-18 11:40:28.185666 | localhost | ok: 2026-08-18 11:40:28.186356 | localhost | # Node Information 2026-08-18 11:40:28.186461 | localhost | Inventory Hostname: mon1 2026-08-18 11:40:28.186513 | localhost | Hostname: np0000189968 2026-08-18 11:40:28.186558 | localhost | Username: zuul 2026-08-18 11:40:28.186622 | localhost | Distro: Ubuntu 22.04 2026-08-18 11:40:28.186667 | localhost | Provider: yul1 2026-08-18 11:40:28.186710 | localhost | Region: ca-ymq-1 2026-08-18 11:40:28.186749 | localhost | Label: ubuntu-jammy 2026-08-18 11:40:28.186790 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:28.186858 | localhost | Interface IP: 199.19.213.237 2026-08-18 11:40:28.229474 | localhost | ok: 2026-08-18 11:40:28.229599 | localhost | # Node Information 2026-08-18 11:40:28.229627 | localhost | Inventory Hostname: mon2 2026-08-18 11:40:28.229656 | localhost | Hostname: np0000189969 2026-08-18 11:40:28.229680 | localhost | Username: zuul 2026-08-18 11:40:28.229701 | localhost | Distro: Ubuntu 22.04 2026-08-18 11:40:28.229721 | localhost | Provider: yul1 2026-08-18 11:40:28.229740 | localhost | Region: ca-ymq-1 2026-08-18 11:40:28.229759 | localhost | Label: ubuntu-jammy 2026-08-18 11:40:28.229778 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:28.229797 | localhost | Interface IP: 199.19.213.199 2026-08-18 11:40:28.331948 | localhost | ok: 2026-08-18 11:40:28.332101 | localhost | # Node Information 2026-08-18 11:40:28.332137 | localhost | Inventory Hostname: mon3 2026-08-18 11:40:28.332168 | localhost | Hostname: np0000189970 2026-08-18 11:40:28.332197 | localhost | Username: zuul 2026-08-18 11:40:28.332228 | localhost | Distro: Ubuntu 22.04 2026-08-18 11:40:28.332256 | localhost | Provider: yul1 2026-08-18 11:40:28.332283 | localhost | Region: ca-ymq-1 2026-08-18 11:40:28.332310 | localhost | Label: ubuntu-jammy 2026-08-18 11:40:28.332336 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:28.332363 | localhost | Interface IP: 199.19.213.84 2026-08-18 11:40:28.380941 | localhost | ok: 2026-08-18 11:40:28.381098 | localhost | # Node Information 2026-08-18 11:40:28.381164 | localhost | Inventory Hostname: osd1 2026-08-18 11:40:28.381212 | localhost | Hostname: np0000189971 2026-08-18 11:40:28.381256 | localhost | Username: zuul 2026-08-18 11:40:28.381306 | localhost | Distro: Ubuntu 22.04 2026-08-18 11:40:28.381350 | localhost | Provider: yul1 2026-08-18 11:40:28.381393 | localhost | Region: ca-ymq-1 2026-08-18 11:40:28.381453 | localhost | Label: ubuntu-jammy 2026-08-18 11:40:28.381498 | localhost | Product Name: OpenStack Nova 2026-08-18 11:40:28.381545 | localhost | Interface IP: 199.19.213.217 2026-08-18 11:40:28.395533 | 2026-08-18 11:40:28.395683 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 11:40:28.787236 | localhost -> localhost | changed 2026-08-18 11:40:28.793951 | 2026-08-18 11:40:28.794059 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 11:40:29.600782 | localhost -> localhost | changed 2026-08-18 11:40:29.612213 | 2026-08-18 11:40:29.612296 | PLAY [all] 2026-08-18 11:40:29.622307 | 2026-08-18 11:40:29.622376 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 11:40:29.850614 | mon1 -> localhost | ok 2026-08-18 11:40:29.860360 | 2026-08-18 11:40:29.860454 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 11:40:29.895415 | mon1 | ok 2026-08-18 11:40:29.911829 | mon2 | ok 2026-08-18 11:40:29.916106 | mon3 | ok 2026-08-18 11:40:29.932227 | osd1 | ok 2026-08-18 11:40:29.958935 | mon1 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:29.959054 | mon2 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:29.959080 | mon3 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:29.959099 | osd1 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 11:40:29.966210 | 2026-08-18 11:40:29.966271 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 11:40:30.831027 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-18 11:40:30.831221 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/c6f64d7b5f1d482885fef9dd894a9818_id_rsa 2026-08-18 11:40:30.831250 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/c6f64d7b5f1d482885fef9dd894a9818_id_rsa.pub 2026-08-18 11:40:30.831273 | mon1 -> localhost | The key fingerprint is: 2026-08-18 11:40:30.831295 | mon1 -> localhost | SHA256:t6kVtW/87Q9eWmAK1QGYT8w/sDGwHJfCYvsLvDdzQMA zuul-build-sshkey 2026-08-18 11:40:30.831316 | mon1 -> localhost | The key's randomart image is: 2026-08-18 11:40:30.831336 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-18 11:40:30.831356 | mon1 -> localhost | | . .o*oo. | 2026-08-18 11:40:30.831377 | mon1 -> localhost | | E.=+O. . | 2026-08-18 11:40:30.831397 | mon1 -> localhost | | . +o+o*. | 2026-08-18 11:40:30.831416 | mon1 -> localhost | | . .oo.o | 2026-08-18 11:40:30.831436 | mon1 -> localhost | | .So+ . o. | 2026-08-18 11:40:30.831455 | mon1 -> localhost | | o.o= = . | 2026-08-18 11:40:30.831477 | mon1 -> localhost | | o+o. = o| 2026-08-18 11:40:30.831497 | mon1 -> localhost | | .o= .o *.| 2026-08-18 11:40:30.831516 | mon1 -> localhost | | .. + o.*| 2026-08-18 11:40:30.831535 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-18 11:40:30.831602 | mon1 -> localhost | ok: Runtime: 0:00:00.424303 2026-08-18 11:40:30.846747 | 2026-08-18 11:40:30.847012 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 11:40:30.886608 | mon1 | ok 2026-08-18 11:40:30.920570 | mon2 | ok 2026-08-18 11:40:30.931173 | mon3 | ok 2026-08-18 11:40:30.935852 | osd1 | ok 2026-08-18 11:40:30.959904 | mon1 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:30.959974 | mon2 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:30.960000 | mon3 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:30.960018 | osd1 | included: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 11:40:31.019317 | 2026-08-18 11:40:31.019486 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 11:40:31.049068 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:31.063601 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:31.074827 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:31.085424 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:31.097221 | 2026-08-18 11:40:31.097330 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 11:40:31.483328 | mon3 | changed 2026-08-18 11:40:31.489997 | osd1 | changed 2026-08-18 11:40:31.496904 | mon1 | changed 2026-08-18 11:40:31.504533 | mon2 | changed 2026-08-18 11:40:31.512313 | 2026-08-18 11:40:31.512495 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 11:40:31.701047 | mon1 | ok 2026-08-18 11:40:31.723408 | mon2 | ok 2026-08-18 11:40:31.730351 | mon3 | ok 2026-08-18 11:40:31.746551 | osd1 | ok 2026-08-18 11:40:31.752669 | 2026-08-18 11:40:31.752733 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 11:40:32.241139 | mon3 | changed 2026-08-18 11:40:32.245796 | mon1 | changed 2026-08-18 11:40:32.249927 | mon2 | changed 2026-08-18 11:40:32.266775 | osd1 | changed 2026-08-18 11:40:32.275034 | 2026-08-18 11:40:32.277379 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 11:40:32.713817 | mon1 | changed 2026-08-18 11:40:32.733685 | mon2 | changed 2026-08-18 11:40:32.770262 | osd1 | changed 2026-08-18 11:40:32.789686 | mon3 | changed 2026-08-18 11:40:32.794941 | 2026-08-18 11:40:32.795005 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 11:40:32.825650 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:32.840620 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:32.843345 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:32.863953 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:32.875432 | 2026-08-18 11:40:32.875502 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 11:40:33.265892 | mon1 -> localhost | changed 2026-08-18 11:40:33.298412 | 2026-08-18 11:40:33.298533 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 11:40:33.587069 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/c6f64d7b5f1d482885fef9dd894a9818_id_rsa (zuul-build-sshkey) 2026-08-18 11:40:33.587293 | mon1 -> localhost | ok: Runtime: 0:00:00.013858 2026-08-18 11:40:33.594758 | 2026-08-18 11:40:33.594819 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 11:40:33.898825 | mon2 | ok 2026-08-18 11:40:33.905001 | osd1 | ok 2026-08-18 11:40:33.911420 | mon3 | ok 2026-08-18 11:40:33.915259 | mon1 | ok 2026-08-18 11:40:33.919838 | 2026-08-18 11:40:33.919901 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 11:40:33.961235 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:33.963624 | mon2 | skipping: Conditional result was False 2026-08-18 11:40:33.963826 | mon3 | skipping: Conditional result was False 2026-08-18 11:40:33.984324 | osd1 | skipping: Conditional result was False 2026-08-18 11:40:34.012608 | 2026-08-18 11:40:34.012687 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 11:40:34.344267 | osd1 | ok 2026-08-18 11:40:34.348769 | mon3 | ok 2026-08-18 11:40:34.352670 | mon1 | ok 2026-08-18 11:40:34.356446 | mon2 | ok 2026-08-18 11:40:34.361887 | 2026-08-18 11:40:34.361951 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 11:40:35.056552 | mon1 | Output suppressed because no_log was given 2026-08-18 11:40:35.085528 | mon3 | Output suppressed because no_log was given 2026-08-18 11:40:35.100681 | osd1 | Output suppressed because no_log was given 2026-08-18 11:40:35.114997 | mon2 | Output suppressed because no_log was given 2026-08-18 11:40:35.136906 | 2026-08-18 11:40:35.137003 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 11:40:35.325471 | mon1 | ok: "logs" 2026-08-18 11:40:35.325749 | mon1 | ok: All items complete 2026-08-18 11:40:35.325777 | 2026-08-18 11:40:35.331755 | mon2 | ok: "logs" 2026-08-18 11:40:35.335792 | mon3 | ok: "logs" 2026-08-18 11:40:35.354087 | osd1 | ok: "logs" 2026-08-18 11:40:35.480750 | mon1 | ok: "artifacts" 2026-08-18 11:40:35.484824 | mon2 | ok: "artifacts" 2026-08-18 11:40:35.498444 | mon3 | ok: "artifacts" 2026-08-18 11:40:35.527784 | osd1 | ok: "artifacts" 2026-08-18 11:40:35.633696 | mon1 | ok: "docs" 2026-08-18 11:40:35.639872 | mon2 | ok: "docs" 2026-08-18 11:40:35.652501 | mon3 | ok: "docs" 2026-08-18 11:40:35.652586 | mon3 | ok: All items complete 2026-08-18 11:40:35.652621 | 2026-08-18 11:40:35.714469 | osd1 | ok: "docs" 2026-08-18 11:40:35.730949 | 2026-08-18 11:40:35.731111 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 11:40:35.919394 | mon1 | changed: "logs" 2026-08-18 11:40:35.919662 | mon1 | ok: All items complete 2026-08-18 11:40:35.919691 | 2026-08-18 11:40:35.937126 | mon2 | changed: "logs" 2026-08-18 11:40:35.941280 | mon3 | changed: "logs" 2026-08-18 11:40:35.948577 | osd1 | changed: "logs" 2026-08-18 11:40:36.082096 | mon1 | changed: "artifacts" 2026-08-18 11:40:36.089066 | mon2 | changed: "artifacts" 2026-08-18 11:40:36.098928 | osd1 | changed: "artifacts" 2026-08-18 11:40:36.109370 | mon3 | changed: "artifacts" 2026-08-18 11:40:36.248774 | mon2 | changed: "docs" 2026-08-18 11:40:36.266998 | mon1 | changed: "docs" 2026-08-18 11:40:36.273803 | osd1 | changed: "docs" 2026-08-18 11:40:36.302126 | mon3 | changed: "docs" 2026-08-18 11:40:36.302205 | mon3 | changed: All items complete 2026-08-18 11:40:36.302238 | 2026-08-18 11:40:36.331491 | 2026-08-18 11:40:36.331629 | PLAY RECAP 2026-08-18 11:40:36.331680 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:36.331710 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:36.331735 | mon2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:36.331758 | mon3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:36.331782 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 11:40:36.331822 | 2026-08-18 11:40:36.500313 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 11:40:36.507515 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 11:40:37.101653 | 2026-08-18 11:40:37.101792 | PLAY [all] 2026-08-18 11:40:37.113510 | 2026-08-18 11:40:37.113596 | TASK [setup-uv : Extract archive] 2026-08-18 11:40:39.281342 | mon2 | changed 2026-08-18 11:40:39.286075 | mon1 | changed 2026-08-18 11:40:39.290313 | mon3 | changed 2026-08-18 11:40:39.309860 | osd1 | changed 2026-08-18 11:40:39.317150 | 2026-08-18 11:40:39.317220 | TASK [setup-uv : Print version] 2026-08-18 11:40:39.719502 | mon1 | uv 0.8.13 2026-08-18 11:40:39.730166 | mon2 | uv 0.8.13 2026-08-18 11:40:39.724210 | osd1 | uv 0.8.13 2026-08-18 11:40:39.734085 | mon3 | uv 0.8.13 2026-08-18 11:40:39.913404 | mon1 | ok: Runtime: 0:00:00.010381 2026-08-18 11:40:39.964521 | osd1 | ok: Runtime: 0:00:00.014289 2026-08-18 11:40:39.972209 | mon3 | ok: Runtime: 0:00:00.010667 2026-08-18 11:40:39.980299 | mon2 | ok: Runtime: 0:00:00.012081 2026-08-18 11:40:40.002808 | 2026-08-18 11:40:40.002978 | TASK [Install Ansible collection siblings] 2026-08-18 11:40:40.322923 | mon1 | ok: 2026-08-18 11:40:40.323196 | mon1 | Skipping community.crypto: no checked-out sibling 2026-08-18 11:40:40.323245 | mon1 | Skipping community.docker: no checked-out sibling 2026-08-18 11:40:40.323276 | mon1 | Skipping community.general: no checked-out sibling 2026-08-18 11:40:40.323307 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 11:40:40.323384 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 11:40:40.326651 | 2026-08-18 11:40:40.326725 | PLAY RECAP 2026-08-18 11:40:40.326805 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:40.326855 | mon2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:40.326890 | mon3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:40.326925 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:40:40.326953 | 2026-08-18 11:40:40.490867 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 11:40:40.497566 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 11:40:41.119531 | 2026-08-18 11:40:41.119665 | PLAY [all] 2026-08-18 11:40:41.132211 | 2026-08-18 11:40:41.132287 | LOOP [Check inventory directories] 2026-08-18 11:40:41.456389 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 11:40:41.619670 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 11:40:41.766246 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 11:40:41.785713 | 2026-08-18 11:40:41.785927 | LOOP [Copy inventory file for Zuul] 2026-08-18 11:40:42.554042 | mon1 | changed: 2026-08-18 11:40:42.554275 | mon1 | { 2026-08-18 11:40:42.554316 | mon1 | "ansible_loop_var": "item", 2026-08-18 11:40:42.554349 | mon1 | "changed": false, 2026-08-18 11:40:42.554378 | mon1 | "failed": false, 2026-08-18 11:40:42.554411 | mon1 | "invocation": { 2026-08-18 11:40:42.554439 | mon1 | "module_args": { 2026-08-18 11:40:42.554466 | mon1 | "checksum_algorithm": "sha1", 2026-08-18 11:40:42.554493 | mon1 | "follow": true, 2026-08-18 11:40:42.554519 | mon1 | "get_attributes": true, 2026-08-18 11:40:42.554548 | mon1 | "get_checksum": true, 2026-08-18 11:40:42.554575 | mon1 | "get_mime": true, 2026-08-18 11:40:42.554601 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 11:40:42.554627 | mon1 | } 2026-08-18 11:40:42.554653 | mon1 | }, 2026-08-18 11:40:42.554680 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 11:40:42.554706 | mon1 | "stat": { 2026-08-18 11:40:42.554733 | mon1 | "atime": 1787053234.943809, 2026-08-18 11:40:42.554760 | mon1 | "attr_flags": "e", 2026-08-18 11:40:42.554786 | mon1 | "attributes": [ 2026-08-18 11:40:42.554813 | mon1 | "extents" 2026-08-18 11:40:42.554838 | mon1 | ], 2026-08-18 11:40:42.554865 | mon1 | "block_size": 4096, 2026-08-18 11:40:42.554890 | mon1 | "blocks": 8, 2026-08-18 11:40:42.554916 | mon1 | "charset": "unknown", 2026-08-18 11:40:42.554945 | mon1 | "ctime": 1787053234.9518092, 2026-08-18 11:40:42.554971 | mon1 | "dev": 64513, 2026-08-18 11:40:42.554998 | mon1 | "device_type": 0, 2026-08-18 11:40:42.555024 | mon1 | "executable": true, 2026-08-18 11:40:42.555050 | mon1 | "exists": true, 2026-08-18 11:40:42.555076 | mon1 | "gid": 1000, 2026-08-18 11:40:42.555102 | mon1 | "gr_name": "zuul", 2026-08-18 11:40:42.555127 | mon1 | "inode": 1042461, 2026-08-18 11:40:42.555153 | mon1 | "isblk": false, 2026-08-18 11:40:42.555180 | mon1 | "ischr": false, 2026-08-18 11:40:42.555206 | mon1 | "isdir": true, 2026-08-18 11:40:42.555245 | mon1 | "isfifo": false, 2026-08-18 11:40:42.555272 | mon1 | "isgid": false, 2026-08-18 11:40:42.555297 | mon1 | "islnk": false, 2026-08-18 11:40:42.555323 | mon1 | "isreg": false, 2026-08-18 11:40:42.555348 | mon1 | "issock": false, 2026-08-18 11:40:42.555373 | mon1 | "isuid": false, 2026-08-18 11:40:42.555398 | mon1 | "mimetype": "unknown", 2026-08-18 11:40:42.555424 | mon1 | "mode": "0755", 2026-08-18 11:40:42.555449 | mon1 | "mtime": 1787053219.0929844, 2026-08-18 11:40:42.555475 | mon1 | "nlink": 10, 2026-08-18 11:40:42.555501 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 11:40:42.555526 | mon1 | "pw_name": "zuul", 2026-08-18 11:40:42.555556 | mon1 | "readable": true, 2026-08-18 11:40:42.555582 | mon1 | "rgrp": true, 2026-08-18 11:40:42.555608 | mon1 | "roth": true, 2026-08-18 11:40:42.555633 | mon1 | "rusr": true, 2026-08-18 11:40:42.555659 | mon1 | "size": 4096, 2026-08-18 11:40:42.555684 | mon1 | "uid": 1000, 2026-08-18 11:40:42.555710 | mon1 | "version": "2131065703", 2026-08-18 11:40:42.555736 | mon1 | "wgrp": false, 2026-08-18 11:40:42.555765 | mon1 | "woth": false, 2026-08-18 11:40:42.555791 | mon1 | "writeable": true, 2026-08-18 11:40:42.555817 | mon1 | "wusr": true, 2026-08-18 11:40:42.555843 | mon1 | "xgrp": true, 2026-08-18 11:40:42.555868 | mon1 | "xoth": true, 2026-08-18 11:40:42.555894 | mon1 | "xusr": true 2026-08-18 11:40:42.555919 | mon1 | } 2026-08-18 11:40:42.555945 | mon1 | } 2026-08-18 11:40:42.555995 | mon1 | ok: All items complete 2026-08-18 11:40:42.556026 | 2026-08-18 11:40:42.558036 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:42.558924 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:42.573990 | 2026-08-18 11:40:42.574148 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 11:40:42.915536 | mon1 | changed: 4 replacements made 2026-08-18 11:40:42.917415 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:42.919998 | mon1 | skipping: Conditional result was False 2026-08-18 11:40:42.938878 | 2026-08-18 11:40:42.939037 | TASK [Run Molecule scenario] 2026-08-18 11:40:43.535727 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-18 11:40:44.218031 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-18 11:40:44.434813 | mon1 | Using CPython 3.13.7 2026-08-18 11:40:44.434885 | mon1 | Creating virtual environment at: .venv 2026-08-18 11:40:44.496903 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-18 11:40:44.497172 | mon1 | Downloading cryptography (4.3MiB) 2026-08-18 11:40:44.498306 | mon1 | Downloading netaddr (2.2MiB) 2026-08-18 11:40:44.499193 | mon1 | Downloading pygments (1.2MiB) 2026-08-18 11:40:44.702963 | mon1 | Downloading netaddr 2026-08-18 11:40:44.711314 | mon1 | Downloading cryptography 2026-08-18 11:40:44.755332 | mon1 | Downloading pygments 2026-08-18 11:40:44.880417 | mon1 | Downloading ansible-core 2026-08-18 11:40:44.909174 | mon1 | Installed 42 packages in 28ms 2026-08-18 11:40:45.987903 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 11:40:45.987985 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 11:40:46.599042 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 11:40:46.599140 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 11:41:14.971312 | mon1 | INFO [default > dependency] Executing 2026-08-18 11:41:14.971529 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 11:41:14.971773 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 11:41:14.971921 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 11:41:14.978977 | mon1 | INFO [default > cleanup] Executing 2026-08-18 11:41:14.979382 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:41:14.984914 | mon1 | INFO [default > destroy] Executing 2026-08-18 11:41:14.984974 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 11:41:14.985049 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-18 11:41:14.989935 | mon1 | INFO [default > syntax] Executing 2026-08-18 11:41:16.159077 | mon1 | 2026-08-18 11:41:16.159345 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 11:41:16.223297 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-18 11:41:16.235179 | mon1 | INFO [default > create] Executing 2026-08-18 11:41:16.236574 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:41:16.241853 | mon1 | INFO [default > prepare] Executing 2026-08-18 11:41:16.928967 | mon1 | 2026-08-18 11:41:16.929152 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-18 11:41:16.929357 | mon1 | 2026-08-18 11:41:16.929624 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:41:16.929873 | mon1 | Tuesday 18 August 2026 11:41:16 +0000 (0:00:00.032) 0:00:00.032 ******** 2026-08-18 11:41:18.080998 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:41:18.081218 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:41:18.081436 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:18.081648 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:18.081904 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:18.085804 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:41:18.086073 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:41:18.086271 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:18.086471 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:18.086675 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:18.092302 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:41:18.092502 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:41:18.092703 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:18.092896 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:18.093093 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:18.097590 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:41:18.097788 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:41:18.098016 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:41:18.098204 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:41:18.098412 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:41:18.104748 | mon1 | ok: [mon1] 2026-08-18 11:41:18.105068 | mon1 | ok: [mon3] 2026-08-18 11:41:18.105353 | mon1 | ok: [osd1] 2026-08-18 11:41:18.105658 | mon1 | ok: [mon2] 2026-08-18 11:41:18.105990 | mon1 | 2026-08-18 11:41:18.106303 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-18 11:41:18.106533 | mon1 | Tuesday 18 August 2026 11:41:18 +0000 (0:00:01.176) 0:00:01.208 ******** 2026-08-18 11:41:18.806939 | mon1 | changed: [mon2] 2026-08-18 11:41:18.807125 | mon1 | changed: [mon3] 2026-08-18 11:41:18.807333 | mon1 | changed: [osd1] 2026-08-18 11:41:18.807536 | mon1 | changed: [mon1] 2026-08-18 11:41:18.807728 | mon1 | 2026-08-18 11:41:18.807936 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 11:41:18.808140 | mon1 | Tuesday 18 August 2026 11:41:18 +0000 (0:00:00.701) 0:00:01.910 ******** 2026-08-18 11:41:19.087643 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 11:41:19.087728 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 11:41:19.087739 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 11:41:19.102446 | mon1 | changed: [osd1] 2026-08-18 11:41:19.102501 | mon1 | changed: [mon3] 2026-08-18 11:41:19.102513 | mon1 | changed: [mon2] 2026-08-18 11:41:19.102522 | mon1 | changed: [mon1] 2026-08-18 11:41:19.102533 | mon1 | 2026-08-18 11:41:19.102544 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-18 11:41:19.102554 | mon1 | Tuesday 18 August 2026 11:41:19 +0000 (0:00:00.294) 0:00:02.205 ******** 2026-08-18 11:41:26.393119 | mon1 | changed: [mon2] 2026-08-18 11:41:26.393189 | mon1 | changed: [mon1] 2026-08-18 11:41:26.393202 | mon1 | changed: [mon3] 2026-08-18 11:41:26.393212 | mon1 | changed: [osd1] 2026-08-18 11:41:26.393223 | mon1 | 2026-08-18 11:41:26.393235 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 11:41:26.393246 | mon1 | 2026-08-18 11:41:26.393257 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:41:26.393270 | mon1 | Tuesday 18 August 2026 11:41:26 +0000 (0:00:07.290) 0:00:09.495 ******** 2026-08-18 11:41:27.127028 | mon1 | ok: [mon3] 2026-08-18 11:41:27.127094 | mon1 | ok: [mon2] 2026-08-18 11:41:27.127105 | mon1 | ok: [mon1] 2026-08-18 11:41:27.127114 | mon1 | ok: [osd1] 2026-08-18 11:41:27.127123 | mon1 | 2026-08-18 11:41:27.127140 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-18 11:41:27.127231 | mon1 | Tuesday 18 August 2026 11:41:27 +0000 (0:00:00.734) 0:00:10.230 ******** 2026-08-18 11:41:50.038303 | mon1 | changed: [mon2] 2026-08-18 11:41:50.038429 | mon1 | changed: [mon1] 2026-08-18 11:41:50.038446 | mon1 | changed: [osd1] 2026-08-18 11:41:50.038592 | mon1 | changed: [mon3] 2026-08-18 11:41:50.038711 | mon1 | 2026-08-18 11:41:50.038844 | mon1 | TASK [Start up service] ******************************************************** 2026-08-18 11:41:50.039036 | mon1 | Tuesday 18 August 2026 11:41:50 +0000 (0:00:22.911) 0:00:33.142 ******** 2026-08-18 11:41:50.665010 | mon1 | ok: [mon1] 2026-08-18 11:41:50.665185 | mon1 | ok: [osd1] 2026-08-18 11:41:50.665386 | mon1 | ok: [mon3] 2026-08-18 11:41:50.665599 | mon1 | ok: [mon2] 2026-08-18 11:41:50.665788 | mon1 | 2026-08-18 11:41:50.666090 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 11:41:50.666332 | mon1 | Tuesday 18 August 2026 11:41:50 +0000 (0:00:00.626) 0:00:33.768 ******** 2026-08-18 11:41:50.987481 | mon1 | ok: [mon3] 2026-08-18 11:41:50.987912 | mon1 | ok: [mon2] 2026-08-18 11:41:50.988117 | mon1 | ok: [osd1] 2026-08-18 11:41:50.988304 | mon1 | ok: [mon1] 2026-08-18 11:41:50.988483 | mon1 | 2026-08-18 11:41:50.988693 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 11:41:50.988898 | mon1 | Tuesday 18 August 2026 11:41:50 +0000 (0:00:00.322) 0:00:34.091 ******** 2026-08-18 11:41:51.643058 | mon1 | changed: [mon1] 2026-08-18 11:41:51.643264 | mon1 | changed: [osd1] 2026-08-18 11:41:51.643479 | mon1 | changed: [mon3] 2026-08-18 11:41:51.643749 | mon1 | changed: [mon2] 2026-08-18 11:41:51.643949 | mon1 | 2026-08-18 11:41:51.644170 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 11:41:51.644386 | mon1 | Tuesday 18 August 2026 11:41:51 +0000 (0:00:00.655) 0:00:34.747 ******** 2026-08-18 11:41:51.886358 | mon1 | ok: [mon1] 2026-08-18 11:41:51.886541 | mon1 | ok: [mon2] 2026-08-18 11:41:51.886751 | mon1 | ok: [osd1] 2026-08-18 11:41:51.886964 | mon1 | ok: [mon3] 2026-08-18 11:41:51.887169 | mon1 | 2026-08-18 11:41:51.887390 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 11:41:51.887631 | mon1 | Tuesday 18 August 2026 11:41:51 +0000 (0:00:00.243) 0:00:34.990 ******** 2026-08-18 11:41:51.906422 | mon1 | skipping: [mon1] 2026-08-18 11:41:51.925780 | mon1 | skipping: [mon2] 2026-08-18 11:41:51.925898 | mon1 | skipping: [mon3] 2026-08-18 11:41:51.926023 | mon1 | skipping: [osd1] 2026-08-18 11:41:51.926154 | mon1 | 2026-08-18 11:41:51.926291 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 11:41:51.926416 | mon1 | Tuesday 18 August 2026 11:41:51 +0000 (0:00:00.039) 0:00:35.029 ******** 2026-08-18 11:41:53.510035 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:53.510238 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:53.510506 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:53.510906 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:53.511185 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:53.511393 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:53.511675 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:53.511898 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:53.512103 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:53.512310 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:53.512536 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:53.512754 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:53.512939 | mon1 | 2026-08-18 11:41:53.513149 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 11:41:53.513355 | mon1 | Tuesday 18 August 2026 11:41:53 +0000 (0:00:01.584) 0:00:36.614 ******** 2026-08-18 11:41:54.178570 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:54.178752 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:54.178819 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:54.178956 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:54.179096 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:54.179212 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:54.179333 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:54.179453 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:54.179578 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:54.179714 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:54.179820 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:54.179940 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:54.180049 | mon1 | 2026-08-18 11:41:54.180173 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-18 11:41:54.180296 | mon1 | Tuesday 18 August 2026 11:41:54 +0000 (0:00:00.668) 0:00:37.282 ******** 2026-08-18 11:41:54.901190 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:54.901390 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:54.901614 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:54.901834 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:54.902056 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:54.902296 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:54.902488 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:54.902712 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:54.902901 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:54.903161 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:54.903369 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:54.903574 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:54.903770 | mon1 | 2026-08-18 11:41:54.903991 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 11:41:54.904210 | mon1 | Tuesday 18 August 2026 11:41:54 +0000 (0:00:00.721) 0:00:38.004 ******** 2026-08-18 11:41:58.181877 | mon1 | changed: [mon3] => (item=osd0) 2026-08-18 11:41:58.181959 | mon1 | changed: [osd1] => (item=osd0) 2026-08-18 11:41:58.182098 | mon1 | changed: [mon1] => (item=osd0) 2026-08-18 11:41:58.182224 | mon1 | changed: [mon2] => (item=osd0) 2026-08-18 11:41:58.182348 | mon1 | changed: [mon3] => (item=osd1) 2026-08-18 11:41:58.182471 | mon1 | changed: [mon1] => (item=osd1) 2026-08-18 11:41:58.182595 | mon1 | changed: [osd1] => (item=osd1) 2026-08-18 11:41:58.182721 | mon1 | changed: [mon2] => (item=osd1) 2026-08-18 11:41:58.182837 | mon1 | changed: [mon3] => (item=osd2) 2026-08-18 11:41:58.183037 | mon1 | changed: [mon1] => (item=osd2) 2026-08-18 11:41:58.183123 | mon1 | changed: [osd1] => (item=osd2) 2026-08-18 11:41:58.183251 | mon1 | changed: [mon2] => (item=osd2) 2026-08-18 11:41:58.183368 | mon1 | 2026-08-18 11:41:58.183501 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 11:41:58.183637 | mon1 | Tuesday 18 August 2026 11:41:58 +0000 (0:00:03.281) 0:00:41.286 ******** 2026-08-18 11:42:00.188684 | mon1 | changed: [mon2] => (item=ceph-mon2-osd0) 2026-08-18 11:42:00.188799 | mon1 | changed: [mon3] => (item=ceph-mon3-osd0) 2026-08-18 11:42:00.188940 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-18 11:42:00.189073 | mon1 | changed: [mon1] => (item=ceph-mon1-osd0) 2026-08-18 11:42:00.189214 | mon1 | changed: [mon2] => (item=ceph-mon2-osd1) 2026-08-18 11:42:00.189337 | mon1 | changed: [mon3] => (item=ceph-mon3-osd1) 2026-08-18 11:42:00.189471 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-18 11:42:00.189590 | mon1 | changed: [mon1] => (item=ceph-mon1-osd1) 2026-08-18 11:42:00.189715 | mon1 | changed: [mon2] => (item=ceph-mon2-osd2) 2026-08-18 11:42:00.189842 | mon1 | changed: [mon3] => (item=ceph-mon3-osd2) 2026-08-18 11:42:00.189967 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-18 11:42:00.190094 | mon1 | changed: [mon1] => (item=ceph-mon1-osd2) 2026-08-18 11:42:00.190214 | mon1 | 2026-08-18 11:42:00.190349 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:42:00.190486 | mon1 | mon1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:00.190626 | mon1 | mon2 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:00.190770 | mon1 | mon3 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:00.190907 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 11:42:00.191048 | mon1 | 2026-08-18 11:42:00.191160 | mon1 | 2026-08-18 11:42:00.191290 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:42:00.191420 | mon1 | Tuesday 18 August 2026 11:42:00 +0000 (0:00:02.007) 0:00:43.293 ******** 2026-08-18 11:42:00.191545 | mon1 | =============================================================================== 2026-08-18 11:42:00.191670 | mon1 | Install depedencies ---------------------------------------------------- 22.91s 2026-08-18 11:42:00.191796 | mon1 | Update apt cache -------------------------------------------------------- 7.29s 2026-08-18 11:42:00.191979 | mon1 | Create a volume group for each loop device ------------------------------ 3.28s 2026-08-18 11:42:00.192106 | mon1 | Create a logical volume for each loop device ---------------------------- 2.01s 2026-08-18 11:42:00.192234 | mon1 | Create devices for Ceph ------------------------------------------------- 1.58s 2026-08-18 11:42:00.192359 | mon1 | Gathering Facts --------------------------------------------------------- 1.18s 2026-08-18 11:42:00.192504 | mon1 | Gathering Facts --------------------------------------------------------- 0.73s 2026-08-18 11:42:00.192605 | mon1 | Start loop devices ------------------------------------------------------ 0.72s 2026-08-18 11:42:00.192724 | mon1 | Configure short hostname ------------------------------------------------ 0.70s 2026-08-18 11:42:00.192852 | mon1 | Set permissions on loopback devices ------------------------------------- 0.67s 2026-08-18 11:42:00.192976 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s 2026-08-18 11:42:00.193102 | mon1 | Start up service -------------------------------------------------------- 0.63s 2026-08-18 11:42:00.193228 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-08-18 11:42:00.193354 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s 2026-08-18 11:42:00.193477 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s 2026-08-18 11:42:00.193603 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.04s 2026-08-18 11:42:00.277658 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-18 11:42:00.289293 | mon1 | INFO [default > converge] Executing 2026-08-18 11:42:01.311579 | mon1 | 2026-08-18 11:42:01.311668 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 11:42:01.311736 | mon1 | 2026-08-18 11:42:01.311881 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:42:01.312030 | mon1 | Tuesday 18 August 2026 11:42:01 +0000 (0:00:00.052) 0:00:00.052 ******** 2026-08-18 11:42:02.451098 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:42:02.451172 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:42:02.451264 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:02.451357 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:02.451450 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:02.495842 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:42:02.495953 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:42:02.496042 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:02.496134 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:02.496227 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:02.500688 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:42:02.500834 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:42:02.500965 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:42:02.501091 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:42:02.501228 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:42:02.553136 | mon1 | ok: [mon1] 2026-08-18 11:42:02.553331 | mon1 | ok: [mon3] 2026-08-18 11:42:02.553513 | mon1 | ok: [mon2] 2026-08-18 11:42:02.553698 | mon1 | 2026-08-18 11:42:02.553947 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:02.554201 | mon1 | Tuesday 18 August 2026 11:42:02 +0000 (0:00:01.241) 0:00:01.294 ******** 2026-08-18 11:42:02.938057 | mon1 | ok: [mon1] 2026-08-18 11:42:02.938244 | mon1 | ok: [mon2] 2026-08-18 11:42:02.938252 | mon1 | ok: [mon3] 2026-08-18 11:42:02.938261 | mon1 | 2026-08-18 11:42:02.938363 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:02.938458 | mon1 | Tuesday 18 August 2026 11:42:02 +0000 (0:00:00.384) 0:00:01.679 ******** 2026-08-18 11:42:02.969717 | mon1 | skipping: [mon1] 2026-08-18 11:42:03.017337 | mon1 | skipping: [mon2] 2026-08-18 11:42:03.017511 | mon1 | skipping: [mon3] 2026-08-18 11:42:03.017698 | mon1 | 2026-08-18 11:42:03.017935 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:42:03.018140 | mon1 | Tuesday 18 August 2026 11:42:03 +0000 (0:00:00.078) 0:00:01.758 ******** 2026-08-18 11:42:03.342406 | mon1 | changed: [mon1] 2026-08-18 11:42:03.342466 | mon1 | changed: [mon3] 2026-08-18 11:42:03.342644 | mon1 | changed: [mon2] 2026-08-18 11:42:03.342786 | mon1 | 2026-08-18 11:42:03.342925 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:03.343116 | mon1 | Tuesday 18 August 2026 11:42:03 +0000 (0:00:00.325) 0:00:02.083 ******** 2026-08-18 11:42:03.443621 | mon1 | ok: [mon1] => { 2026-08-18 11:42:03.443812 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:03.444016 | mon1 | } 2026-08-18 11:42:03.444216 | mon1 | ok: [mon2] => { 2026-08-18 11:42:03.444433 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:03.444621 | mon1 | } 2026-08-18 11:42:03.444820 | mon1 | ok: [mon3] => { 2026-08-18 11:42:03.445017 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:42:03.445214 | mon1 | } 2026-08-18 11:42:03.445391 | mon1 | 2026-08-18 11:42:03.445594 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:03.445788 | mon1 | Tuesday 18 August 2026 11:42:03 +0000 (0:00:00.101) 0:00:02.184 ******** 2026-08-18 11:42:04.265381 | mon1 | changed: [mon1] 2026-08-18 11:42:04.265505 | mon1 | changed: [mon3] 2026-08-18 11:42:04.265517 | mon1 | changed: [mon2] 2026-08-18 11:42:04.265527 | mon1 | 2026-08-18 11:42:04.265537 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:04.265680 | mon1 | Tuesday 18 August 2026 11:42:04 +0000 (0:00:00.821) 0:00:03.005 ******** 2026-08-18 11:42:04.366927 | mon1 | skipping: [mon1] 2026-08-18 11:42:04.367079 | mon1 | skipping: [mon2] 2026-08-18 11:42:04.367306 | mon1 | skipping: [mon3] 2026-08-18 11:42:04.367496 | mon1 | 2026-08-18 11:42:04.367725 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:04.367917 | mon1 | Tuesday 18 August 2026 11:42:04 +0000 (0:00:00.102) 0:00:03.108 ******** 2026-08-18 11:42:04.465211 | mon1 | skipping: [mon1] 2026-08-18 11:42:04.465313 | mon1 | skipping: [mon2] 2026-08-18 11:42:04.465436 | mon1 | skipping: [mon3] 2026-08-18 11:42:04.465555 | mon1 | 2026-08-18 11:42:04.465689 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:04.465817 | mon1 | Tuesday 18 August 2026 11:42:04 +0000 (0:00:00.098) 0:00:03.206 ******** 2026-08-18 11:42:04.717305 | mon1 | ok: [mon2] 2026-08-18 11:42:04.717434 | mon1 | ok: [mon1] 2026-08-18 11:42:04.717651 | mon1 | ok: [mon3] 2026-08-18 11:42:04.717838 | mon1 | 2026-08-18 11:42:04.718095 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:42:04.718286 | mon1 | Tuesday 18 August 2026 11:42:04 +0000 (0:00:00.251) 0:00:03.458 ******** 2026-08-18 11:42:06.034271 | mon1 | ok: [mon2] 2026-08-18 11:42:06.034342 | mon1 | ok: [mon3] 2026-08-18 11:42:06.034353 | mon1 | ok: [mon1] 2026-08-18 11:42:06.034363 | mon1 | 2026-08-18 11:42:06.034373 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:06.034382 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:01.316) 0:00:04.774 ******** 2026-08-18 11:42:06.139865 | mon1 | ok: [mon1] => { 2026-08-18 11:42:06.139977 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:06.141170 | mon1 | } 2026-08-18 11:42:06.141190 | mon1 | ok: [mon2] => { 2026-08-18 11:42:06.141197 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:06.141234 | mon1 | } 2026-08-18 11:42:06.141240 | mon1 | ok: [mon3] => { 2026-08-18 11:42:06.141245 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:42:06.141251 | mon1 | } 2026-08-18 11:42:06.141257 | mon1 | 2026-08-18 11:42:06.141263 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:06.141269 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:00.106) 0:00:04.881 ******** 2026-08-18 11:42:06.951136 | mon1 | changed: [mon1] 2026-08-18 11:42:06.951220 | mon1 | changed: [mon3] 2026-08-18 11:42:06.951371 | mon1 | changed: [mon2] 2026-08-18 11:42:06.951584 | mon1 | 2026-08-18 11:42:06.951760 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:06.951928 | mon1 | Tuesday 18 August 2026 11:42:06 +0000 (0:00:00.811) 0:00:05.692 ******** 2026-08-18 11:42:10.781638 | mon1 | changed: [mon2] 2026-08-18 11:42:10.781891 | mon1 | changed: [mon3] 2026-08-18 11:42:10.781903 | mon1 | changed: [mon1] 2026-08-18 11:42:10.781913 | mon1 | 2026-08-18 11:42:10.781967 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:42:10.782096 | mon1 | Tuesday 18 August 2026 11:42:10 +0000 (0:00:03.830) 0:00:09.523 ******** 2026-08-18 11:42:10.817030 | mon1 | skipping: [mon1] 2026-08-18 11:42:10.848420 | mon1 | skipping: [mon2] 2026-08-18 11:42:10.848528 | mon1 | skipping: [mon3] 2026-08-18 11:42:10.848826 | mon1 | 2026-08-18 11:42:10.848933 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:42:10.848941 | mon1 | Tuesday 18 August 2026 11:42:10 +0000 (0:00:00.066) 0:00:09.590 ******** 2026-08-18 11:42:10.882962 | mon1 | skipping: [mon1] 2026-08-18 11:42:10.914572 | mon1 | skipping: [mon2] 2026-08-18 11:42:10.915166 | mon1 | skipping: [mon3] 2026-08-18 11:42:10.915271 | mon1 | 2026-08-18 11:42:10.915283 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:42:10.915294 | mon1 | Tuesday 18 August 2026 11:42:10 +0000 (0:00:00.065) 0:00:09.655 ******** 2026-08-18 11:42:10.945787 | mon1 | skipping: [mon1] 2026-08-18 11:42:10.975391 | mon1 | skipping: [mon2] 2026-08-18 11:42:10.975470 | mon1 | skipping: [mon3] 2026-08-18 11:42:10.975550 | mon1 | 2026-08-18 11:42:10.975862 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:42:10.975916 | mon1 | Tuesday 18 August 2026 11:42:10 +0000 (0:00:00.060) 0:00:09.716 ******** 2026-08-18 11:42:16.698005 | mon1 | changed: [mon1] 2026-08-18 11:42:16.699057 | mon1 | changed: [mon3] 2026-08-18 11:42:16.699280 | mon1 | changed: [mon2] 2026-08-18 11:42:16.699293 | mon1 | 2026-08-18 11:42:16.699303 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:42:16.699322 | mon1 | Tuesday 18 August 2026 11:42:16 +0000 (0:00:05.721) 0:00:15.438 ******** 2026-08-18 11:42:17.279096 | mon1 | changed: [mon1] 2026-08-18 11:42:17.279173 | mon1 | changed: [mon3] 2026-08-18 11:42:17.279185 | mon1 | changed: [mon2] 2026-08-18 11:42:17.279195 | mon1 | 2026-08-18 11:42:17.279214 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:42:17.279353 | mon1 | Tuesday 18 August 2026 11:42:17 +0000 (0:00:00.581) 0:00:16.020 ******** 2026-08-18 11:42:18.224075 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:18.224172 | mon1 | changed: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:18.226258 | mon1 | changed: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:42:18.226321 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:18.226330 | mon1 | changed: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:18.226336 | mon1 | changed: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:42:18.226342 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:18.226347 | mon1 | changed: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:18.226353 | mon1 | changed: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:42:18.226358 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:18.226371 | mon1 | changed: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:18.226377 | mon1 | changed: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:42:18.226383 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:18.226399 | mon1 | changed: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:18.226405 | mon1 | changed: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:42:18.226411 | mon1 | 2026-08-18 11:42:18.226417 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:42:18.226423 | mon1 | Tuesday 18 August 2026 11:42:18 +0000 (0:00:00.945) 0:00:16.965 ******** 2026-08-18 11:42:18.874738 | mon1 | changed: [mon1] 2026-08-18 11:42:18.874833 | mon1 | changed: [mon3] 2026-08-18 11:42:18.875135 | mon1 | changed: [mon2] 2026-08-18 11:42:18.875269 | mon1 | 2026-08-18 11:42:18.875289 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:18.876574 | mon1 | Tuesday 18 August 2026 11:42:18 +0000 (0:00:00.626) 0:00:17.591 ******** 2026-08-18 11:42:18.876644 | mon1 | 2026-08-18 11:42:18.876650 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:18.876654 | mon1 | Tuesday 18 August 2026 11:42:18 +0000 (0:00:00.007) 0:00:17.599 ******** 2026-08-18 11:42:18.876659 | mon1 | 2026-08-18 11:42:18.876663 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:42:18.876667 | mon1 | Tuesday 18 August 2026 11:42:18 +0000 (0:00:00.006) 0:00:17.606 ******** 2026-08-18 11:42:18.876671 | mon1 | 2026-08-18 11:42:18.876676 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:42:18.876680 | mon1 | Tuesday 18 August 2026 11:42:18 +0000 (0:00:00.009) 0:00:17.615 ******** 2026-08-18 11:42:19.940527 | mon1 | ok: [mon3] 2026-08-18 11:42:19.940649 | mon1 | ok: [mon1] 2026-08-18 11:42:19.940663 | mon1 | ok: [mon2] 2026-08-18 11:42:19.940711 | mon1 | 2026-08-18 11:42:19.940994 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 11:42:19.941065 | mon1 | Tuesday 18 August 2026 11:42:19 +0000 (0:00:01.066) 0:00:18.682 ******** 2026-08-18 11:42:20.472154 | mon1 | changed: [mon1] 2026-08-18 11:42:20.472259 | mon1 | changed: [mon3] 2026-08-18 11:42:20.472792 | mon1 | changed: [mon2] 2026-08-18 11:42:20.472850 | mon1 | 2026-08-18 11:42:20.472858 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:42:20.472864 | mon1 | Tuesday 18 August 2026 11:42:20 +0000 (0:00:00.531) 0:00:19.213 ******** 2026-08-18 11:42:21.049076 | mon1 | changed: [mon1] 2026-08-18 11:42:21.049159 | mon1 | changed: [mon2] 2026-08-18 11:42:21.049173 | mon1 | changed: [mon3] 2026-08-18 11:42:21.049498 | mon1 | 2026-08-18 11:42:21.049550 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:42:21.049556 | mon1 | Tuesday 18 August 2026 11:42:21 +0000 (0:00:00.577) 0:00:19.790 ******** 2026-08-18 11:42:21.301257 | mon1 | ok: [mon1] 2026-08-18 11:42:21.301333 | mon1 | ok: [mon2] 2026-08-18 11:42:21.301346 | mon1 | ok: [mon3] 2026-08-18 11:42:21.301680 | mon1 | 2026-08-18 11:42:21.301731 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:21.301737 | mon1 | Tuesday 18 August 2026 11:42:21 +0000 (0:00:00.252) 0:00:20.042 ******** 2026-08-18 11:42:21.401293 | mon1 | ok: [mon1] => { 2026-08-18 11:42:21.401374 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:21.401432 | mon1 | } 2026-08-18 11:42:21.402311 | mon1 | ok: [mon2] => { 2026-08-18 11:42:21.402362 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:21.402368 | mon1 | } 2026-08-18 11:42:21.402373 | mon1 | ok: [mon3] => { 2026-08-18 11:42:21.402377 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:42:21.402381 | mon1 | } 2026-08-18 11:42:21.402386 | mon1 | 2026-08-18 11:42:21.402390 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:21.402395 | mon1 | Tuesday 18 August 2026 11:42:21 +0000 (0:00:00.100) 0:00:20.142 ******** 2026-08-18 11:42:22.302001 | mon1 | changed: [mon2] 2026-08-18 11:42:22.302079 | mon1 | changed: [mon1] 2026-08-18 11:42:22.302655 | mon1 | changed: [mon3] 2026-08-18 11:42:22.302713 | mon1 | 2026-08-18 11:42:22.302722 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:22.302729 | mon1 | Tuesday 18 August 2026 11:42:22 +0000 (0:00:00.900) 0:00:21.043 ******** 2026-08-18 11:42:26.825380 | mon1 | changed: [mon1] 2026-08-18 11:42:26.825462 | mon1 | changed: [mon2] 2026-08-18 11:42:26.825858 | mon1 | changed: [mon3] 2026-08-18 11:42:26.825909 | mon1 | 2026-08-18 11:42:26.825914 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:42:26.825919 | mon1 | Tuesday 18 August 2026 11:42:26 +0000 (0:00:04.523) 0:00:25.567 ******** 2026-08-18 11:42:27.864227 | mon1 | ok: [mon1] 2026-08-18 11:42:27.864309 | mon1 | ok: [mon3] 2026-08-18 11:42:27.864832 | mon1 | ok: [mon2] 2026-08-18 11:42:27.864885 | mon1 | 2026-08-18 11:42:27.864893 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:42:27.864899 | mon1 | Tuesday 18 August 2026 11:42:27 +0000 (0:00:01.038) 0:00:26.605 ******** 2026-08-18 11:42:28.173968 | mon1 | changed: [mon1] 2026-08-18 11:42:28.174625 | mon1 | changed: [mon3] 2026-08-18 11:42:28.174725 | mon1 | changed: [mon2] 2026-08-18 11:42:28.174734 | mon1 | 2026-08-18 11:42:28.174740 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:42:28.174747 | mon1 | Tuesday 18 August 2026 11:42:28 +0000 (0:00:00.309) 0:00:26.915 ******** 2026-08-18 11:42:28.680787 | mon1 | changed: [mon1] 2026-08-18 11:42:28.680861 | mon1 | changed: [mon3] 2026-08-18 11:42:28.680917 | mon1 | changed: [mon2] 2026-08-18 11:42:28.681236 | mon1 | 2026-08-18 11:42:28.681281 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:42:28.681287 | mon1 | Tuesday 18 August 2026 11:42:28 +0000 (0:00:00.507) 0:00:27.422 ******** 2026-08-18 11:42:29.243345 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:29.243426 | mon1 | changed: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:29.244330 | mon1 | changed: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:42:29.244382 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:29.244389 | mon1 | changed: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:29.244393 | mon1 | changed: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:42:29.244397 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:29.244401 | mon1 | changed: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:29.244405 | mon1 | changed: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:42:29.244410 | mon1 | 2026-08-18 11:42:29.244414 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:42:29.244418 | mon1 | Tuesday 18 August 2026 11:42:29 +0000 (0:00:00.562) 0:00:27.985 ******** 2026-08-18 11:42:29.719137 | mon1 | changed: [mon1] 2026-08-18 11:42:29.719215 | mon1 | changed: [mon2] 2026-08-18 11:42:29.719604 | mon1 | changed: [mon3] 2026-08-18 11:42:29.719652 | mon1 | 2026-08-18 11:42:29.719658 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:42:29.719663 | mon1 | Tuesday 18 August 2026 11:42:29 +0000 (0:00:00.475) 0:00:28.460 ******** 2026-08-18 11:42:30.243045 | mon1 | changed: [mon2] 2026-08-18 11:42:30.243121 | mon1 | changed: [mon1] 2026-08-18 11:42:30.243166 | mon1 | changed: [mon3] 2026-08-18 11:42:30.244267 | mon1 | 2026-08-18 11:42:30.244320 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:30.244326 | mon1 | Tuesday 18 August 2026 11:42:30 +0000 (0:00:00.502) 0:00:28.963 ******** 2026-08-18 11:42:30.244330 | mon1 | 2026-08-18 11:42:30.244334 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:30.244338 | mon1 | Tuesday 18 August 2026 11:42:30 +0000 (0:00:00.007) 0:00:28.970 ******** 2026-08-18 11:42:30.244342 | mon1 | 2026-08-18 11:42:30.244346 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:42:30.244350 | mon1 | Tuesday 18 August 2026 11:42:30 +0000 (0:00:00.007) 0:00:28.978 ******** 2026-08-18 11:42:30.244365 | mon1 | 2026-08-18 11:42:30.244369 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:42:30.244373 | mon1 | Tuesday 18 August 2026 11:42:30 +0000 (0:00:00.006) 0:00:28.984 ******** 2026-08-18 11:42:31.005829 | mon1 | ok: [mon1] 2026-08-18 11:42:31.005943 | mon1 | ok: [mon2] 2026-08-18 11:42:31.005955 | mon1 | ok: [mon3] 2026-08-18 11:42:31.005965 | mon1 | 2026-08-18 11:42:31.006190 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 11:42:31.006252 | mon1 | Tuesday 18 August 2026 11:42:31 +0000 (0:00:00.762) 0:00:29.747 ******** 2026-08-18 11:42:32.089185 | mon1 | changed: [mon2] 2026-08-18 11:42:32.089236 | mon1 | changed: [mon1] 2026-08-18 11:42:32.089241 | mon1 | changed: [mon3] 2026-08-18 11:42:32.089246 | mon1 | 2026-08-18 11:42:32.089250 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:42:32.089255 | mon1 | Tuesday 18 August 2026 11:42:32 +0000 (0:00:01.081) 0:00:30.829 ******** 2026-08-18 11:42:32.672920 | mon1 | changed: [mon1] 2026-08-18 11:42:32.672992 | mon1 | changed: [mon2] 2026-08-18 11:42:32.673355 | mon1 | changed: [mon3] 2026-08-18 11:42:32.673398 | mon1 | 2026-08-18 11:42:32.673404 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:42:32.673409 | mon1 | Tuesday 18 August 2026 11:42:32 +0000 (0:00:00.585) 0:00:31.414 ******** 2026-08-18 11:42:32.733672 | mon1 | ok: [mon1] => { 2026-08-18 11:42:32.735071 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:32.735138 | mon1 | } 2026-08-18 11:42:32.735150 | mon1 | ok: [mon2] => { 2026-08-18 11:42:32.735161 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:32.735171 | mon1 | } 2026-08-18 11:42:32.735181 | mon1 | ok: [mon3] => { 2026-08-18 11:42:32.735191 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:42:32.735201 | mon1 | } 2026-08-18 11:42:32.735211 | mon1 | 2026-08-18 11:42:32.735221 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:42:32.735239 | mon1 | Tuesday 18 August 2026 11:42:32 +0000 (0:00:00.060) 0:00:31.475 ******** 2026-08-18 11:42:34.429764 | mon1 | changed: [mon3] 2026-08-18 11:42:34.429812 | mon1 | changed: [mon1] 2026-08-18 11:42:34.429819 | mon1 | changed: [mon2] 2026-08-18 11:42:34.429825 | mon1 | 2026-08-18 11:42:34.429831 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:42:34.429838 | mon1 | Tuesday 18 August 2026 11:42:34 +0000 (0:00:01.695) 0:00:33.170 ******** 2026-08-18 11:42:34.455253 | mon1 | skipping: [mon1] 2026-08-18 11:42:34.514897 | mon1 | skipping: [mon2] 2026-08-18 11:42:34.515864 | mon1 | skipping: [mon3] 2026-08-18 11:42:34.515898 | mon1 | 2026-08-18 11:42:34.515910 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:42:34.515920 | mon1 | Tuesday 18 August 2026 11:42:34 +0000 (0:00:00.085) 0:00:33.255 ******** 2026-08-18 11:42:34.550080 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:42:34.593958 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:42:34.594060 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:42:34.594146 | mon1 | 2026-08-18 11:42:34.594386 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:42:34.594435 | mon1 | Tuesday 18 August 2026 11:42:34 +0000 (0:00:00.079) 0:00:33.335 ******** 2026-08-18 11:42:39.655937 | mon1 | changed: [mon1] 2026-08-18 11:42:39.656063 | mon1 | changed: [mon3] 2026-08-18 11:42:39.656547 | mon1 | changed: [mon2] 2026-08-18 11:42:39.656596 | mon1 | 2026-08-18 11:42:39.656604 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:42:39.656618 | mon1 | Tuesday 18 August 2026 11:42:39 +0000 (0:00:05.061) 0:00:38.397 ******** 2026-08-18 11:42:41.350908 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:42:41.351043 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:42:41.352046 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:42:41.352096 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:42:41.352103 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:42:41.352109 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:42:41.352115 | mon1 | 2026-08-18 11:42:41.352121 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:42:41.352128 | mon1 | Tuesday 18 August 2026 11:42:41 +0000 (0:00:01.695) 0:00:40.092 ******** 2026-08-18 11:42:41.578878 | mon1 | ok: [mon1] 2026-08-18 11:42:41.579007 | mon1 | ok: [mon2] 2026-08-18 11:42:41.579028 | mon1 | ok: [mon3] 2026-08-18 11:42:41.579321 | mon1 | 2026-08-18 11:42:41.579364 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:42:41.579370 | mon1 | Tuesday 18 August 2026 11:42:41 +0000 (0:00:00.228) 0:00:40.320 ******** 2026-08-18 11:42:42.016369 | mon1 | changed: [mon2] 2026-08-18 11:42:42.016983 | mon1 | changed: [mon1] 2026-08-18 11:42:42.017005 | mon1 | changed: [mon3] 2026-08-18 11:42:42.017012 | mon1 | 2026-08-18 11:42:42.017018 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:42:42.017025 | mon1 | Tuesday 18 August 2026 11:42:42 +0000 (0:00:00.437) 0:00:40.757 ******** 2026-08-18 11:42:42.524422 | mon1 | changed: [mon1] 2026-08-18 11:42:42.524513 | mon1 | changed: [mon2] 2026-08-18 11:42:42.525041 | mon1 | changed: [mon3] 2026-08-18 11:42:42.525184 | mon1 | 2026-08-18 11:42:42.525192 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:42:42.525199 | mon1 | Tuesday 18 August 2026 11:42:42 +0000 (0:00:00.508) 0:00:41.265 ******** 2026-08-18 11:42:42.595295 | mon1 | skipping: [mon1] 2026-08-18 11:42:42.596015 | mon1 | skipping: [mon2] 2026-08-18 11:42:42.596060 | mon1 | skipping: [mon3] 2026-08-18 11:42:42.596068 | mon1 | 2026-08-18 11:42:42.596075 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:42:42.596082 | mon1 | Tuesday 18 August 2026 11:42:42 +0000 (0:00:00.070) 0:00:41.336 ******** 2026-08-18 11:43:22.299270 | mon1 | changed: [mon1] 2026-08-18 11:43:22.299346 | mon1 | changed: [mon3] 2026-08-18 11:43:22.299739 | mon1 | changed: [mon2] 2026-08-18 11:43:22.299792 | mon1 | 2026-08-18 11:43:22.299798 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:43:22.299803 | mon1 | Tuesday 18 August 2026 11:43:22 +0000 (0:00:39.704) 0:01:21.040 ******** 2026-08-18 11:43:22.804582 | mon1 | changed: [mon1] 2026-08-18 11:43:22.804634 | mon1 | changed: [mon2] 2026-08-18 11:43:22.804642 | mon1 | changed: [mon3] 2026-08-18 11:43:22.804651 | mon1 | 2026-08-18 11:43:22.804658 | mon1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 11:43:22.804667 | mon1 | Tuesday 18 August 2026 11:43:22 +0000 (0:00:00.503) 0:01:21.544 ******** 2026-08-18 11:43:22.930330 | mon1 | ok: [mon3] 2026-08-18 11:43:22.930365 | mon1 | ok: [mon2] 2026-08-18 11:43:22.930370 | mon1 | ok: [mon1] 2026-08-18 11:43:22.930375 | mon1 | 2026-08-18 11:43:22.930380 | mon1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 11:43:22.930385 | mon1 | Tuesday 18 August 2026 11:43:22 +0000 (0:00:00.126) 0:01:21.671 ******** 2026-08-18 11:43:23.001385 | mon1 | ok: [mon1] => { 2026-08-18 11:43:23.001430 | mon1 | "changed": false, 2026-08-18 11:43:23.001436 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:23.001441 | mon1 | } 2026-08-18 11:43:23.001445 | mon1 | ok: [mon2] => { 2026-08-18 11:43:23.001449 | mon1 | "changed": false, 2026-08-18 11:43:23.001453 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:23.001457 | mon1 | } 2026-08-18 11:43:23.001462 | mon1 | ok: [mon3] => { 2026-08-18 11:43:23.001466 | mon1 | "changed": false, 2026-08-18 11:43:23.001470 | mon1 | "msg": "All assertions passed" 2026-08-18 11:43:23.001474 | mon1 | } 2026-08-18 11:43:23.001478 | mon1 | 2026-08-18 11:43:23.001482 | mon1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 11:43:23.001487 | mon1 | Tuesday 18 August 2026 11:43:22 +0000 (0:00:00.070) 0:01:21.741 ******** 2026-08-18 11:43:23.066320 | mon1 | ok: [mon1] 2026-08-18 11:43:23.066362 | mon1 | ok: [mon2] 2026-08-18 11:43:23.066367 | mon1 | ok: [mon3] 2026-08-18 11:43:23.066371 | mon1 | 2026-08-18 11:43:23.066376 | mon1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 11:43:23.066381 | mon1 | Tuesday 18 August 2026 11:43:23 +0000 (0:00:00.065) 0:01:21.807 ******** 2026-08-18 11:43:23.627650 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:43:23.627726 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:43:23.628220 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:43:23.628271 | mon1 | 2026-08-18 11:43:23.628278 | mon1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 11:43:23.628284 | mon1 | Tuesday 18 August 2026 11:43:23 +0000 (0:00:00.561) 0:01:22.369 ******** 2026-08-18 11:43:23.700081 | mon1 | ok: [mon1] 2026-08-18 11:43:23.700549 | mon1 | ok: [mon2] 2026-08-18 11:43:23.701013 | mon1 | ok: [mon3] 2026-08-18 11:43:23.701059 | mon1 | 2026-08-18 11:43:23.701065 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:43:23.701070 | mon1 | Tuesday 18 August 2026 11:43:23 +0000 (0:00:00.072) 0:01:22.441 ******** 2026-08-18 11:43:23.818212 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for mon1, mon2, mon3 2026-08-18 11:43:23.818348 | mon1 | 2026-08-18 11:43:23.818388 | mon1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 11:43:23.818402 | mon1 | Tuesday 18 August 2026 11:43:23 +0000 (0:00:00.117) 0:01:22.559 ******** 2026-08-18 11:43:24.023872 | mon1 | skipping: [mon2] 2026-08-18 11:43:24.024009 | mon1 | skipping: [mon3] 2026-08-18 11:43:24.024022 | mon1 | changed: [mon1] 2026-08-18 11:43:24.024035 | mon1 | 2026-08-18 11:43:24.024305 | mon1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 11:43:24.024369 | mon1 | Tuesday 18 August 2026 11:43:24 +0000 (0:00:00.205) 0:01:22.765 ******** 2026-08-18 11:43:24.065765 | mon1 | skipping: [mon1] 2026-08-18 11:43:24.095818 | mon1 | skipping: [mon2] 2026-08-18 11:43:24.095866 | mon1 | skipping: [mon3] 2026-08-18 11:43:24.096208 | mon1 | 2026-08-18 11:43:24.096338 | mon1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 11:43:24.096346 | mon1 | Tuesday 18 August 2026 11:43:24 +0000 (0:00:00.071) 0:01:22.837 ******** 2026-08-18 11:43:24.134950 | mon1 | skipping: [mon1] 2026-08-18 11:43:24.167114 | mon1 | skipping: [mon2] 2026-08-18 11:43:24.167173 | mon1 | skipping: [mon3] 2026-08-18 11:43:24.167562 | mon1 | 2026-08-18 11:43:24.167628 | mon1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 11:43:24.167635 | mon1 | Tuesday 18 August 2026 11:43:24 +0000 (0:00:00.071) 0:01:22.908 ******** 2026-08-18 11:43:25.892339 | mon1 | skipping: [mon2] 2026-08-18 11:43:25.892408 | mon1 | skipping: [mon3] 2026-08-18 11:43:25.892806 | mon1 | changed: [mon1] 2026-08-18 11:43:25.892850 | mon1 | 2026-08-18 11:43:25.892856 | mon1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 11:43:25.892861 | mon1 | Tuesday 18 August 2026 11:43:25 +0000 (0:00:01.725) 0:01:24.633 ******** 2026-08-18 11:43:26.170284 | mon1 | skipping: [mon2] 2026-08-18 11:43:26.170358 | mon1 | skipping: [mon3] 2026-08-18 11:43:26.170744 | mon1 | changed: [mon1] 2026-08-18 11:43:26.170793 | mon1 | 2026-08-18 11:43:26.170801 | mon1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 11:43:26.170808 | mon1 | Tuesday 18 August 2026 11:43:26 +0000 (0:00:00.278) 0:01:24.911 ******** 2026-08-18 11:43:26.203700 | mon1 | skipping: [mon1] 2026-08-18 11:43:26.230127 | mon1 | skipping: [mon2] 2026-08-18 11:43:26.230605 | mon1 | skipping: [mon3] 2026-08-18 11:43:26.230653 | mon1 | 2026-08-18 11:43:26.230659 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:43:26.230666 | mon1 | Tuesday 18 August 2026 11:43:26 +0000 (0:00:00.059) 0:01:24.971 ******** 2026-08-18 11:44:06.588878 | mon1 | skipping: [mon2] 2026-08-18 11:44:06.588961 | mon1 | skipping: [mon3] 2026-08-18 11:44:06.588976 | mon1 | changed: [mon1] 2026-08-18 11:44:06.589285 | mon1 | 2026-08-18 11:44:06.589321 | mon1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 11:44:06.589327 | mon1 | Tuesday 18 August 2026 11:44:06 +0000 (0:00:40.359) 0:02:05.330 ******** 2026-08-18 11:44:06.794228 | mon1 | skipping: [mon2] 2026-08-18 11:44:06.794298 | mon1 | skipping: [mon3] 2026-08-18 11:44:06.794729 | mon1 | changed: [mon1] 2026-08-18 11:44:06.794771 | mon1 | 2026-08-18 11:44:06.794777 | mon1 | TASK [Register this monitor host] ********************************************** 2026-08-18 11:44:06.794782 | mon1 | Tuesday 18 August 2026 11:44:06 +0000 (0:00:00.204) 0:02:05.535 ******** 2026-08-18 11:44:06.924265 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:44:06.924343 | mon1 | 2026-08-18 11:44:06.924355 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:44:06.924486 | mon1 | Tuesday 18 August 2026 11:44:06 +0000 (0:00:00.130) 0:02:05.665 ******** 2026-08-18 11:44:08.436025 | mon1 | ok: [mon1] 2026-08-18 11:44:08.436106 | mon1 | 2026-08-18 11:44:08.436262 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:44:08.436406 | mon1 | Tuesday 18 August 2026 11:44:08 +0000 (0:00:01.510) 0:02:07.176 ******** 2026-08-18 11:44:08.511694 | mon1 | ok: [mon1] 2026-08-18 11:44:08.512900 | mon1 | ok: [mon2] 2026-08-18 11:44:08.512951 | mon1 | ok: [mon3] 2026-08-18 11:44:08.512962 | mon1 | 2026-08-18 11:44:08.512973 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:44:08.512984 | mon1 | Tuesday 18 August 2026 11:44:08 +0000 (0:00:00.075) 0:02:07.252 ******** 2026-08-18 11:44:08.579967 | mon1 | ok: [mon1] => { 2026-08-18 11:44:08.580058 | mon1 | "changed": false, 2026-08-18 11:44:08.580194 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:08.580325 | mon1 | } 2026-08-18 11:44:08.580493 | mon1 | ok: [mon2] => { 2026-08-18 11:44:08.580653 | mon1 | "changed": false, 2026-08-18 11:44:08.580788 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:08.580914 | mon1 | } 2026-08-18 11:44:08.581044 | mon1 | ok: [mon3] => { 2026-08-18 11:44:08.581171 | mon1 | "changed": false, 2026-08-18 11:44:08.581300 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:08.581422 | mon1 | } 2026-08-18 11:44:08.581539 | mon1 | 2026-08-18 11:44:08.581668 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:44:08.581765 | mon1 | Tuesday 18 August 2026 11:44:08 +0000 (0:00:00.068) 0:02:07.321 ******** 2026-08-18 11:44:08.952730 | mon1 | changed: [mon2] 2026-08-18 11:44:08.952846 | mon1 | changed: [mon3] 2026-08-18 11:44:08.952858 | mon1 | ok: [mon1] 2026-08-18 11:44:08.953028 | mon1 | 2026-08-18 11:44:08.953124 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:44:08.953251 | mon1 | Tuesday 18 August 2026 11:44:08 +0000 (0:00:00.372) 0:02:07.694 ******** 2026-08-18 11:44:09.021479 | mon1 | ok: [mon1] 2026-08-18 11:44:09.021526 | mon1 | ok: [mon2] 2026-08-18 11:44:09.021604 | mon1 | ok: [mon3] 2026-08-18 11:44:09.021687 | mon1 | 2026-08-18 11:44:09.021788 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:44:09.021890 | mon1 | Tuesday 18 August 2026 11:44:09 +0000 (0:00:00.068) 0:02:07.763 ******** 2026-08-18 11:44:09.127299 | mon1 | ok: [mon1] 2026-08-18 11:44:09.127388 | mon1 | ok: [mon2] 2026-08-18 11:44:09.127479 | mon1 | ok: [mon3] 2026-08-18 11:44:09.127597 | mon1 | 2026-08-18 11:44:09.127742 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:44:09.127873 | mon1 | Tuesday 18 August 2026 11:44:09 +0000 (0:00:00.105) 0:02:07.868 ******** 2026-08-18 11:44:09.203238 | mon1 | ok: [mon1] => { 2026-08-18 11:44:09.203321 | mon1 | "changed": false, 2026-08-18 11:44:09.203638 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:09.203683 | mon1 | } 2026-08-18 11:44:09.203690 | mon1 | ok: [mon2] => { 2026-08-18 11:44:09.204661 | mon1 | "changed": false, 2026-08-18 11:44:09.204674 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:09.204679 | mon1 | } 2026-08-18 11:44:09.204683 | mon1 | ok: [mon3] => { 2026-08-18 11:44:09.204687 | mon1 | "changed": false, 2026-08-18 11:44:09.204702 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:09.204706 | mon1 | } 2026-08-18 11:44:09.204711 | mon1 | 2026-08-18 11:44:09.204716 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:44:09.204721 | mon1 | Tuesday 18 August 2026 11:44:09 +0000 (0:00:00.076) 0:02:07.944 ******** 2026-08-18 11:44:34.683118 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:34.683182 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:34.683194 | mon1 | changed: [mon1] 2026-08-18 11:44:34.683222 | mon1 | 2026-08-18 11:44:34.683449 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:44:34.683727 | mon1 | Tuesday 18 August 2026 11:44:34 +0000 (0:00:25.479) 0:02:33.423 ******** 2026-08-18 11:44:34.781684 | mon1 | skipping: [mon1] 2026-08-18 11:44:34.781862 | mon1 | skipping: [mon2] 2026-08-18 11:44:34.782056 | mon1 | skipping: [mon3] 2026-08-18 11:44:34.782242 | mon1 | 2026-08-18 11:44:34.782455 | mon1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 11:44:34.782704 | mon1 | Tuesday 18 August 2026 11:44:34 +0000 (0:00:00.099) 0:02:33.523 ******** 2026-08-18 11:44:37.776094 | mon1 | changed: [mon1] 2026-08-18 11:44:37.776175 | mon1 | 2026-08-18 11:44:37.776408 | mon1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 11:44:37.776459 | mon1 | Tuesday 18 August 2026 11:44:37 +0000 (0:00:02.994) 0:02:36.517 ******** 2026-08-18 11:44:39.471038 | mon1 | ok: [mon1] 2026-08-18 11:44:39.471099 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:39.471111 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:39.471120 | mon1 | 2026-08-18 11:44:39.471130 | mon1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 11:44:39.471147 | mon1 | Tuesday 18 August 2026 11:44:39 +0000 (0:00:01.694) 0:02:38.212 ******** 2026-08-18 11:44:40.061346 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:44:40.061386 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:44:40.061393 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:44:40.061399 | mon1 | 2026-08-18 11:44:40.061405 | mon1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 11:44:40.061411 | mon1 | Tuesday 18 August 2026 11:44:40 +0000 (0:00:00.590) 0:02:38.802 ******** 2026-08-18 11:44:40.141193 | mon1 | ok: [mon1] 2026-08-18 11:44:40.141250 | mon1 | ok: [mon2] 2026-08-18 11:44:40.141344 | mon1 | ok: [mon3] 2026-08-18 11:44:40.141612 | mon1 | 2026-08-18 11:44:40.141664 | mon1 | TASK [Register this manager host] ********************************************** 2026-08-18 11:44:40.141746 | mon1 | Tuesday 18 August 2026 11:44:40 +0000 (0:00:00.080) 0:02:38.882 ******** 2026-08-18 11:44:40.261330 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:44:40.261396 | mon1 | 2026-08-18 11:44:40.261649 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:44:40.261738 | mon1 | Tuesday 18 August 2026 11:44:40 +0000 (0:00:00.119) 0:02:39.002 ******** 2026-08-18 11:44:41.705989 | mon1 | ok: [mon1] 2026-08-18 11:44:41.706055 | mon1 | 2026-08-18 11:44:41.706140 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:44:41.706240 | mon1 | Tuesday 18 August 2026 11:44:41 +0000 (0:00:01.445) 0:02:40.447 ******** 2026-08-18 11:44:41.789143 | mon1 | ok: [mon1] 2026-08-18 11:44:41.789216 | mon1 | ok: [mon2] 2026-08-18 11:44:41.789581 | mon1 | ok: [mon3] 2026-08-18 11:44:41.789627 | mon1 | 2026-08-18 11:44:41.789633 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:44:41.789638 | mon1 | Tuesday 18 August 2026 11:44:41 +0000 (0:00:00.082) 0:02:40.530 ******** 2026-08-18 11:44:41.851947 | mon1 | ok: [mon1] => { 2026-08-18 11:44:41.852006 | mon1 | "changed": false, 2026-08-18 11:44:41.853184 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:41.853230 | mon1 | } 2026-08-18 11:44:41.853236 | mon1 | ok: [mon2] => { 2026-08-18 11:44:41.853241 | mon1 | "changed": false, 2026-08-18 11:44:41.853255 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:41.853259 | mon1 | } 2026-08-18 11:44:41.853263 | mon1 | ok: [mon3] => { 2026-08-18 11:44:41.853267 | mon1 | "changed": false, 2026-08-18 11:44:41.853271 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:41.853275 | mon1 | } 2026-08-18 11:44:41.853280 | mon1 | 2026-08-18 11:44:41.853284 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:44:41.853289 | mon1 | Tuesday 18 August 2026 11:44:41 +0000 (0:00:00.063) 0:02:40.593 ******** 2026-08-18 11:44:42.131621 | mon1 | ok: [mon1] 2026-08-18 11:44:42.131690 | mon1 | ok: [mon2] 2026-08-18 11:44:42.131751 | mon1 | ok: [mon3] 2026-08-18 11:44:42.132064 | mon1 | 2026-08-18 11:44:42.132109 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:44:42.132116 | mon1 | Tuesday 18 August 2026 11:44:42 +0000 (0:00:00.279) 0:02:40.873 ******** 2026-08-18 11:44:42.206362 | mon1 | ok: [mon1] 2026-08-18 11:44:42.206427 | mon1 | ok: [mon2] 2026-08-18 11:44:42.206819 | mon1 | ok: [mon3] 2026-08-18 11:44:42.206868 | mon1 | 2026-08-18 11:44:42.206874 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:44:42.206879 | mon1 | Tuesday 18 August 2026 11:44:42 +0000 (0:00:00.074) 0:02:40.947 ******** 2026-08-18 11:44:42.314771 | mon1 | ok: [mon1] 2026-08-18 11:44:42.314844 | mon1 | ok: [mon2] 2026-08-18 11:44:42.314901 | mon1 | ok: [mon3] 2026-08-18 11:44:42.315031 | mon1 | 2026-08-18 11:44:42.315145 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:44:42.315240 | mon1 | Tuesday 18 August 2026 11:44:42 +0000 (0:00:00.108) 0:02:41.056 ******** 2026-08-18 11:44:42.389818 | mon1 | ok: [mon1] => { 2026-08-18 11:44:42.389996 | mon1 | "changed": false, 2026-08-18 11:44:42.390210 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:42.390411 | mon1 | } 2026-08-18 11:44:42.390619 | mon1 | ok: [mon2] => { 2026-08-18 11:44:42.390837 | mon1 | "changed": false, 2026-08-18 11:44:42.391083 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:42.391279 | mon1 | } 2026-08-18 11:44:42.391490 | mon1 | ok: [mon3] => { 2026-08-18 11:44:42.391755 | mon1 | "changed": false, 2026-08-18 11:44:42.392030 | mon1 | "msg": "All assertions passed" 2026-08-18 11:44:42.392296 | mon1 | } 2026-08-18 11:44:42.392583 | mon1 | 2026-08-18 11:44:42.392864 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:44:42.393146 | mon1 | Tuesday 18 August 2026 11:44:42 +0000 (0:00:00.074) 0:02:41.131 ******** 2026-08-18 11:44:43.984262 | mon1 | ok: [mon1] 2026-08-18 11:44:43.984361 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:43.984464 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:43.984549 | mon1 | 2026-08-18 11:44:43.984657 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:44:43.984748 | mon1 | Tuesday 18 August 2026 11:44:43 +0000 (0:00:01.594) 0:02:42.725 ******** 2026-08-18 11:44:44.076272 | mon1 | skipping: [mon1] 2026-08-18 11:44:44.076408 | mon1 | skipping: [mon2] 2026-08-18 11:44:44.076528 | mon1 | skipping: [mon3] 2026-08-18 11:44:44.076648 | mon1 | 2026-08-18 11:44:44.076789 | mon1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 11:44:44.076938 | mon1 | Tuesday 18 August 2026 11:44:44 +0000 (0:00:00.091) 0:02:42.817 ******** 2026-08-18 11:44:50.441242 | mon1 | changed: [mon1] 2026-08-18 11:44:50.441380 | mon1 | 2026-08-18 11:44:50.441618 | mon1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 11:44:50.441843 | mon1 | Tuesday 18 August 2026 11:44:50 +0000 (0:00:06.364) 0:02:49.182 ******** 2026-08-18 11:44:52.028811 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:52.028883 | mon1 | ok: [mon1] 2026-08-18 11:44:52.028895 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:44:52.028905 | mon1 | 2026-08-18 11:44:52.028916 | mon1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 11:44:52.028926 | mon1 | Tuesday 18 August 2026 11:44:52 +0000 (0:00:01.586) 0:02:50.768 ******** 2026-08-18 11:44:59.779163 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 11:44:59.779314 | mon1 | changed: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 11:44:59.779328 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 11:44:59.779339 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 11:44:59.779350 | mon1 | 2026-08-18 11:44:59.779362 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 11:44:59.779386 | mon1 | 2026-08-18 11:44:59.779395 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:44:59.779405 | mon1 | Tuesday 18 August 2026 11:44:59 +0000 (0:00:07.751) 0:02:58.520 ******** 2026-08-18 11:45:00.945944 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:45:00.946012 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:45:00.946084 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:45:00.946170 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:45:00.946261 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:45:00.997638 | mon1 | ok: [mon1] 2026-08-18 11:45:00.997686 | mon1 | ok: [mon2] 2026-08-18 11:45:00.997691 | mon1 | ok: [mon3] 2026-08-18 11:45:00.997695 | mon1 | ok: [osd1] 2026-08-18 11:45:00.997699 | mon1 | 2026-08-18 11:45:00.997705 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:00.997710 | mon1 | Tuesday 18 August 2026 11:45:00 +0000 (0:00:01.218) 0:02:59.738 ******** 2026-08-18 11:45:01.242279 | mon1 | ok: [mon1] 2026-08-18 11:45:01.242324 | mon1 | ok: [mon2] 2026-08-18 11:45:01.242329 | mon1 | ok: [mon3] 2026-08-18 11:45:01.242333 | mon1 | ok: [osd1] 2026-08-18 11:45:01.242338 | mon1 | 2026-08-18 11:45:01.242342 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:01.242348 | mon1 | Tuesday 18 August 2026 11:45:01 +0000 (0:00:00.244) 0:02:59.983 ******** 2026-08-18 11:45:01.283436 | mon1 | skipping: [mon1] 2026-08-18 11:45:01.338853 | mon1 | skipping: [mon2] 2026-08-18 11:45:01.338915 | mon1 | skipping: [mon3] 2026-08-18 11:45:01.338926 | mon1 | skipping: [osd1] 2026-08-18 11:45:01.338935 | mon1 | 2026-08-18 11:45:01.338945 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:45:01.338955 | mon1 | Tuesday 18 August 2026 11:45:01 +0000 (0:00:00.094) 0:03:00.078 ******** 2026-08-18 11:45:01.600796 | mon1 | ok: [mon1] 2026-08-18 11:45:01.600839 | mon1 | ok: [mon2] 2026-08-18 11:45:01.600844 | mon1 | ok: [mon3] 2026-08-18 11:45:01.600848 | mon1 | changed: [osd1] 2026-08-18 11:45:01.600853 | mon1 | 2026-08-18 11:45:01.600858 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:01.600862 | mon1 | Tuesday 18 August 2026 11:45:01 +0000 (0:00:00.263) 0:03:00.342 ******** 2026-08-18 11:45:01.687169 | mon1 | ok: [mon1] => { 2026-08-18 11:45:01.687225 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:01.687233 | mon1 | } 2026-08-18 11:45:01.687240 | mon1 | ok: [mon2] => { 2026-08-18 11:45:01.687246 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:01.687252 | mon1 | } 2026-08-18 11:45:01.687258 | mon1 | ok: [mon3] => { 2026-08-18 11:45:01.687264 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:01.687270 | mon1 | } 2026-08-18 11:45:01.687276 | mon1 | ok: [osd1] => { 2026-08-18 11:45:01.687282 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:45:01.687288 | mon1 | } 2026-08-18 11:45:01.687294 | mon1 | 2026-08-18 11:45:01.687300 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:01.687307 | mon1 | Tuesday 18 August 2026 11:45:01 +0000 (0:00:00.084) 0:03:00.426 ******** 2026-08-18 11:45:02.279247 | mon1 | ok: [mon1] 2026-08-18 11:45:02.279319 | mon1 | ok: [mon2] 2026-08-18 11:45:02.279330 | mon1 | ok: [mon3] 2026-08-18 11:45:02.279340 | mon1 | changed: [osd1] 2026-08-18 11:45:02.279349 | mon1 | 2026-08-18 11:45:02.279359 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:02.279400 | mon1 | Tuesday 18 August 2026 11:45:02 +0000 (0:00:00.593) 0:03:01.019 ******** 2026-08-18 11:45:02.305731 | mon1 | skipping: [mon1] 2026-08-18 11:45:02.390880 | mon1 | skipping: [mon2] 2026-08-18 11:45:02.390969 | mon1 | skipping: [mon3] 2026-08-18 11:45:02.391023 | mon1 | skipping: [osd1] 2026-08-18 11:45:02.391126 | mon1 | 2026-08-18 11:45:02.391344 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:02.391396 | mon1 | Tuesday 18 August 2026 11:45:02 +0000 (0:00:00.112) 0:03:01.132 ******** 2026-08-18 11:45:02.431099 | mon1 | skipping: [mon1] 2026-08-18 11:45:02.504468 | mon1 | skipping: [mon2] 2026-08-18 11:45:02.504519 | mon1 | skipping: [mon3] 2026-08-18 11:45:02.504963 | mon1 | skipping: [osd1] 2026-08-18 11:45:02.505008 | mon1 | 2026-08-18 11:45:02.505014 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:02.505019 | mon1 | Tuesday 18 August 2026 11:45:02 +0000 (0:00:00.113) 0:03:01.245 ******** 2026-08-18 11:45:02.762223 | mon1 | ok: [mon1] 2026-08-18 11:45:02.762291 | mon1 | ok: [mon3] 2026-08-18 11:45:02.762346 | mon1 | ok: [mon2] 2026-08-18 11:45:02.762780 | mon1 | ok: [osd1] 2026-08-18 11:45:02.762830 | mon1 | 2026-08-18 11:45:02.762836 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:45:02.762841 | mon1 | Tuesday 18 August 2026 11:45:02 +0000 (0:00:00.257) 0:03:01.503 ******** 2026-08-18 11:45:04.176606 | mon1 | ok: [mon1] 2026-08-18 11:45:04.176677 | mon1 | ok: [mon3] 2026-08-18 11:45:04.176734 | mon1 | ok: [mon2] 2026-08-18 11:45:04.177112 | mon1 | ok: [osd1] 2026-08-18 11:45:04.177327 | mon1 | 2026-08-18 11:45:04.177334 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:04.177339 | mon1 | Tuesday 18 August 2026 11:45:04 +0000 (0:00:01.414) 0:03:02.918 ******** 2026-08-18 11:45:04.279167 | mon1 | ok: [mon1] => { 2026-08-18 11:45:04.279241 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:04.279254 | mon1 | } 2026-08-18 11:45:04.279264 | mon1 | ok: [mon2] => { 2026-08-18 11:45:04.279274 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:04.279284 | mon1 | } 2026-08-18 11:45:04.279294 | mon1 | ok: [mon3] => { 2026-08-18 11:45:04.279317 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:04.279327 | mon1 | } 2026-08-18 11:45:04.279336 | mon1 | ok: [osd1] => { 2026-08-18 11:45:04.279346 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:45:04.279356 | mon1 | } 2026-08-18 11:45:04.279366 | mon1 | 2026-08-18 11:45:04.279384 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:04.279395 | mon1 | Tuesday 18 August 2026 11:45:04 +0000 (0:00:00.101) 0:03:03.019 ******** 2026-08-18 11:45:05.045119 | mon1 | ok: [mon1] 2026-08-18 11:45:05.045196 | mon1 | ok: [mon2] 2026-08-18 11:45:05.045909 | mon1 | ok: [mon3] 2026-08-18 11:45:05.045952 | mon1 | changed: [osd1] 2026-08-18 11:45:05.045960 | mon1 | 2026-08-18 11:45:05.045967 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:05.045973 | mon1 | Tuesday 18 August 2026 11:45:05 +0000 (0:00:00.766) 0:03:03.786 ******** 2026-08-18 11:45:07.850997 | mon1 | ok: [mon1] 2026-08-18 11:45:07.851067 | mon1 | ok: [mon2] 2026-08-18 11:45:07.851601 | mon1 | ok: [mon3] 2026-08-18 11:45:07.851687 | mon1 | changed: [osd1] 2026-08-18 11:45:07.851696 | mon1 | 2026-08-18 11:45:07.851703 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:45:07.851711 | mon1 | Tuesday 18 August 2026 11:45:07 +0000 (0:00:02.805) 0:03:06.591 ******** 2026-08-18 11:45:07.889035 | mon1 | skipping: [mon1] 2026-08-18 11:45:07.901445 | mon1 | skipping: [mon2] 2026-08-18 11:45:07.930932 | mon1 | skipping: [mon3] 2026-08-18 11:45:07.931046 | mon1 | skipping: [osd1] 2026-08-18 11:45:07.931374 | mon1 | 2026-08-18 11:45:07.931438 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:45:07.931456 | mon1 | Tuesday 18 August 2026 11:45:07 +0000 (0:00:00.080) 0:03:06.672 ******** 2026-08-18 11:45:07.972540 | mon1 | skipping: [mon1] 2026-08-18 11:45:08.002470 | mon1 | skipping: [mon2] 2026-08-18 11:45:08.002538 | mon1 | skipping: [mon3] 2026-08-18 11:45:08.003162 | mon1 | skipping: [osd1] 2026-08-18 11:45:08.003213 | mon1 | 2026-08-18 11:45:08.003221 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:45:08.003228 | mon1 | Tuesday 18 August 2026 11:45:08 +0000 (0:00:00.071) 0:03:06.744 ******** 2026-08-18 11:45:08.029355 | mon1 | skipping: [mon1] 2026-08-18 11:45:08.042085 | mon1 | skipping: [mon2] 2026-08-18 11:45:08.070175 | mon1 | skipping: [mon3] 2026-08-18 11:45:08.070196 | mon1 | skipping: [osd1] 2026-08-18 11:45:08.070204 | mon1 | 2026-08-18 11:45:08.070212 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:45:08.070219 | mon1 | Tuesday 18 August 2026 11:45:08 +0000 (0:00:00.067) 0:03:06.811 ******** 2026-08-18 11:45:13.258478 | mon1 | ok: [mon2] 2026-08-18 11:45:13.258588 | mon1 | ok: [mon3] 2026-08-18 11:45:13.258601 | mon1 | ok: [mon1] 2026-08-18 11:45:13.258611 | mon1 | changed: [osd1] 2026-08-18 11:45:13.258622 | mon1 | 2026-08-18 11:45:13.258672 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:45:13.258813 | mon1 | Tuesday 18 August 2026 11:45:13 +0000 (0:00:05.188) 0:03:11.999 ******** 2026-08-18 11:45:13.775784 | mon1 | ok: [mon1] 2026-08-18 11:45:13.776808 | mon1 | ok: [mon2] 2026-08-18 11:45:13.776837 | mon1 | ok: [mon3] 2026-08-18 11:45:13.776846 | mon1 | changed: [osd1] 2026-08-18 11:45:13.776855 | mon1 | 2026-08-18 11:45:13.776864 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:45:13.776873 | mon1 | Tuesday 18 August 2026 11:45:13 +0000 (0:00:00.517) 0:03:12.517 ******** 2026-08-18 11:45:14.737435 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:14.737551 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:14.739075 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:14.739142 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:45:14.739157 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:14.739171 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:14.739183 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:14.739193 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:45:14.739204 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:14.739215 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:14.739225 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:14.739237 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:45:14.739248 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:14.739267 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:14.739277 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:14.740412 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:45:14.740433 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:14.740441 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:14.740447 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:14.740452 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:45:14.740458 | mon1 | 2026-08-18 11:45:14.740464 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:45:14.740482 | mon1 | Tuesday 18 August 2026 11:45:14 +0000 (0:00:00.961) 0:03:13.478 ******** 2026-08-18 11:45:15.347946 | mon1 | ok: [mon2] 2026-08-18 11:45:15.348023 | mon1 | ok: [mon1] 2026-08-18 11:45:15.348080 | mon1 | ok: [mon3] 2026-08-18 11:45:15.349471 | mon1 | changed: [osd1] 2026-08-18 11:45:15.349513 | mon1 | 2026-08-18 11:45:15.349518 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:15.349523 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.588) 0:03:14.067 ******** 2026-08-18 11:45:15.349528 | mon1 | 2026-08-18 11:45:15.349532 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:15.349536 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.006) 0:03:14.074 ******** 2026-08-18 11:45:15.349540 | mon1 | 2026-08-18 11:45:15.349543 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:15.349547 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.004) 0:03:14.079 ******** 2026-08-18 11:45:15.349551 | mon1 | 2026-08-18 11:45:15.349555 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:45:15.349559 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.005) 0:03:14.084 ******** 2026-08-18 11:45:15.349563 | mon1 | 2026-08-18 11:45:15.349567 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:45:15.349571 | mon1 | Tuesday 18 August 2026 11:45:15 +0000 (0:00:00.005) 0:03:14.089 ******** 2026-08-18 11:45:16.016054 | mon1 | ok: [osd1] 2026-08-18 11:45:16.016100 | mon1 | 2026-08-18 11:45:16.016105 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 11:45:16.016110 | mon1 | Tuesday 18 August 2026 11:45:16 +0000 (0:00:00.667) 0:03:14.757 ******** 2026-08-18 11:45:16.460940 | mon1 | changed: [osd1] 2026-08-18 11:45:16.461002 | mon1 | 2026-08-18 11:45:16.461121 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:45:16.461261 | mon1 | Tuesday 18 August 2026 11:45:16 +0000 (0:00:00.445) 0:03:15.202 ******** 2026-08-18 11:45:17.076642 | mon1 | ok: [mon1] 2026-08-18 11:45:17.076727 | mon1 | ok: [mon2] 2026-08-18 11:45:17.076782 | mon1 | ok: [mon3] 2026-08-18 11:45:17.077155 | mon1 | changed: [osd1] 2026-08-18 11:45:17.077198 | mon1 | 2026-08-18 11:45:17.077203 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:45:17.077214 | mon1 | Tuesday 18 August 2026 11:45:17 +0000 (0:00:00.615) 0:03:15.818 ******** 2026-08-18 11:45:17.331549 | mon1 | ok: [mon1] 2026-08-18 11:45:17.331627 | mon1 | ok: [mon3] 2026-08-18 11:45:17.332153 | mon1 | ok: [mon2] 2026-08-18 11:45:17.332199 | mon1 | ok: [osd1] 2026-08-18 11:45:17.332205 | mon1 | 2026-08-18 11:45:17.332210 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:17.332215 | mon1 | Tuesday 18 August 2026 11:45:17 +0000 (0:00:00.254) 0:03:16.073 ******** 2026-08-18 11:45:17.413731 | mon1 | ok: [mon1] => { 2026-08-18 11:45:17.413824 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:17.415111 | mon1 | } 2026-08-18 11:45:17.415154 | mon1 | ok: [mon2] => { 2026-08-18 11:45:17.415168 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:17.415181 | mon1 | } 2026-08-18 11:45:17.415193 | mon1 | ok: [mon3] => { 2026-08-18 11:45:17.415206 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:17.415218 | mon1 | } 2026-08-18 11:45:17.415229 | mon1 | ok: [osd1] => { 2026-08-18 11:45:17.415241 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:45:17.415260 | mon1 | } 2026-08-18 11:45:17.415272 | mon1 | 2026-08-18 11:45:17.415460 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:17.415505 | mon1 | Tuesday 18 August 2026 11:45:17 +0000 (0:00:00.082) 0:03:16.155 ******** 2026-08-18 11:45:18.442724 | mon1 | ok: [mon1] 2026-08-18 11:45:18.442807 | mon1 | ok: [mon2] 2026-08-18 11:45:18.443027 | mon1 | ok: [mon3] 2026-08-18 11:45:18.443435 | mon1 | changed: [osd1] 2026-08-18 11:45:18.443459 | mon1 | 2026-08-18 11:45:18.443464 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:18.443469 | mon1 | Tuesday 18 August 2026 11:45:18 +0000 (0:00:01.028) 0:03:17.184 ******** 2026-08-18 11:45:22.936700 | mon1 | ok: [mon2] 2026-08-18 11:45:22.936767 | mon1 | ok: [mon1] 2026-08-18 11:45:22.936778 | mon1 | ok: [mon3] 2026-08-18 11:45:22.936787 | mon1 | changed: [osd1] 2026-08-18 11:45:22.936797 | mon1 | 2026-08-18 11:45:22.936806 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:45:22.936816 | mon1 | Tuesday 18 August 2026 11:45:22 +0000 (0:00:04.492) 0:03:21.676 ******** 2026-08-18 11:45:24.004474 | mon1 | ok: [mon2] 2026-08-18 11:45:24.004548 | mon1 | ok: [mon1] 2026-08-18 11:45:24.004559 | mon1 | ok: [mon3] 2026-08-18 11:45:24.004568 | mon1 | ok: [osd1] 2026-08-18 11:45:24.004577 | mon1 | 2026-08-18 11:45:24.004587 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:45:24.004597 | mon1 | Tuesday 18 August 2026 11:45:24 +0000 (0:00:01.067) 0:03:22.744 ******** 2026-08-18 11:45:24.306630 | mon1 | ok: [mon1] 2026-08-18 11:45:24.306702 | mon1 | ok: [mon2] 2026-08-18 11:45:24.306822 | mon1 | ok: [mon3] 2026-08-18 11:45:24.307096 | mon1 | changed: [osd1] 2026-08-18 11:45:24.307271 | mon1 | 2026-08-18 11:45:24.307729 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:45:24.307876 | mon1 | Tuesday 18 August 2026 11:45:24 +0000 (0:00:00.303) 0:03:23.047 ******** 2026-08-18 11:45:24.795936 | mon1 | ok: [mon1] 2026-08-18 11:45:24.796005 | mon1 | ok: [mon2] 2026-08-18 11:45:24.796160 | mon1 | ok: [mon3] 2026-08-18 11:45:24.796286 | mon1 | changed: [osd1] 2026-08-18 11:45:24.796479 | mon1 | 2026-08-18 11:45:24.796612 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:45:24.796744 | mon1 | Tuesday 18 August 2026 11:45:24 +0000 (0:00:00.489) 0:03:23.537 ******** 2026-08-18 11:45:25.372589 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:25.372691 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:25.372826 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:25.372953 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:45:25.373087 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:25.373220 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:25.373375 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:25.373483 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:45:25.373652 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:25.373776 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:25.373904 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:25.374030 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:45:25.374153 | mon1 | 2026-08-18 11:45:25.374291 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:45:25.374445 | mon1 | Tuesday 18 August 2026 11:45:25 +0000 (0:00:00.576) 0:03:24.113 ******** 2026-08-18 11:45:25.873632 | mon1 | ok: [mon2] 2026-08-18 11:45:25.873814 | mon1 | ok: [mon1] 2026-08-18 11:45:25.874038 | mon1 | ok: [mon3] 2026-08-18 11:45:25.874262 | mon1 | changed: [osd1] 2026-08-18 11:45:25.874535 | mon1 | 2026-08-18 11:45:25.874776 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:45:25.875039 | mon1 | Tuesday 18 August 2026 11:45:25 +0000 (0:00:00.500) 0:03:24.614 ******** 2026-08-18 11:45:26.387044 | mon1 | ok: [mon1] 2026-08-18 11:45:26.387109 | mon1 | ok: [mon3] 2026-08-18 11:45:26.387120 | mon1 | ok: [mon2] 2026-08-18 11:45:26.387129 | mon1 | changed: [osd1] 2026-08-18 11:45:26.388337 | mon1 | 2026-08-18 11:45:26.388381 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:26.388387 | mon1 | Tuesday 18 August 2026 11:45:26 +0000 (0:00:00.490) 0:03:25.105 ******** 2026-08-18 11:45:26.388391 | mon1 | 2026-08-18 11:45:26.388395 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:26.388415 | mon1 | Tuesday 18 August 2026 11:45:26 +0000 (0:00:00.006) 0:03:25.111 ******** 2026-08-18 11:45:26.389371 | mon1 | 2026-08-18 11:45:26.389379 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:26.389383 | mon1 | Tuesday 18 August 2026 11:45:26 +0000 (0:00:00.005) 0:03:25.117 ******** 2026-08-18 11:45:26.389387 | mon1 | 2026-08-18 11:45:26.389390 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:45:26.390268 | mon1 | Tuesday 18 August 2026 11:45:26 +0000 (0:00:00.005) 0:03:25.122 ******** 2026-08-18 11:45:26.390334 | mon1 | 2026-08-18 11:45:26.390346 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 11:45:26.390355 | mon1 | Tuesday 18 August 2026 11:45:26 +0000 (0:00:00.005) 0:03:25.127 ******** 2026-08-18 11:45:27.117432 | mon1 | ok: [osd1] 2026-08-18 11:45:27.117528 | mon1 | 2026-08-18 11:45:27.117540 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 11:45:27.117653 | mon1 | Tuesday 18 August 2026 11:45:27 +0000 (0:00:00.731) 0:03:25.858 ******** 2026-08-18 11:45:27.933209 | mon1 | changed: [osd1] 2026-08-18 11:45:27.933296 | mon1 | 2026-08-18 11:45:27.933331 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:45:27.933450 | mon1 | Tuesday 18 August 2026 11:45:27 +0000 (0:00:00.816) 0:03:26.674 ******** 2026-08-18 11:45:28.504869 | mon1 | ok: [mon1] 2026-08-18 11:45:28.504910 | mon1 | ok: [mon2] 2026-08-18 11:45:28.504915 | mon1 | ok: [mon3] 2026-08-18 11:45:28.504920 | mon1 | changed: [osd1] 2026-08-18 11:45:28.504924 | mon1 | 2026-08-18 11:45:28.504929 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:45:28.504933 | mon1 | Tuesday 18 August 2026 11:45:28 +0000 (0:00:00.571) 0:03:27.245 ******** 2026-08-18 11:45:28.537148 | mon1 | ok: [mon1] => { 2026-08-18 11:45:28.537191 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:28.537197 | mon1 | } 2026-08-18 11:45:28.562248 | mon1 | ok: [mon2] => { 2026-08-18 11:45:28.562267 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:28.562272 | mon1 | } 2026-08-18 11:45:28.562276 | mon1 | ok: [mon3] => { 2026-08-18 11:45:28.562280 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:28.562284 | mon1 | } 2026-08-18 11:45:28.562288 | mon1 | ok: [osd1] => { 2026-08-18 11:45:28.562291 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:45:28.562295 | mon1 | } 2026-08-18 11:45:28.562299 | mon1 | 2026-08-18 11:45:28.562303 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:45:28.562307 | mon1 | Tuesday 18 August 2026 11:45:28 +0000 (0:00:00.057) 0:03:27.303 ******** 2026-08-18 11:45:29.859662 | mon1 | ok: [mon1] 2026-08-18 11:45:29.859803 | mon1 | ok: [mon2] 2026-08-18 11:45:29.859818 | mon1 | ok: [mon3] 2026-08-18 11:45:29.860395 | mon1 | changed: [osd1] 2026-08-18 11:45:29.860455 | mon1 | 2026-08-18 11:45:29.860463 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:45:29.860471 | mon1 | Tuesday 18 August 2026 11:45:29 +0000 (0:00:01.297) 0:03:28.601 ******** 2026-08-18 11:45:29.896440 | mon1 | skipping: [mon1] 2026-08-18 11:45:29.911024 | mon1 | skipping: [mon2] 2026-08-18 11:45:29.969657 | mon1 | skipping: [mon3] 2026-08-18 11:45:29.969709 | mon1 | skipping: [osd1] 2026-08-18 11:45:29.969715 | mon1 | 2026-08-18 11:45:29.969720 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:45:29.969726 | mon1 | Tuesday 18 August 2026 11:45:29 +0000 (0:00:00.108) 0:03:28.709 ******** 2026-08-18 11:45:30.017208 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:45:30.061564 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:45:30.061655 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:45:30.062120 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:45:30.062207 | mon1 | 2026-08-18 11:45:30.062214 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:45:30.062221 | mon1 | Tuesday 18 August 2026 11:45:30 +0000 (0:00:00.092) 0:03:28.802 ******** 2026-08-18 11:45:35.545675 | mon1 | ok: [mon1] 2026-08-18 11:45:35.545785 | mon1 | ok: [mon2] 2026-08-18 11:45:35.546483 | mon1 | ok: [mon3] 2026-08-18 11:45:35.546535 | mon1 | changed: [osd1] 2026-08-18 11:45:35.546544 | mon1 | 2026-08-18 11:45:35.546552 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:45:35.546558 | mon1 | Tuesday 18 August 2026 11:45:35 +0000 (0:00:05.484) 0:03:34.287 ******** 2026-08-18 11:45:36.253803 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:45:36.253871 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:45:36.254770 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-18 11:45:36.254847 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:45:36.254852 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:45:36.254856 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:45:36.254861 | mon1 | ok: [osd1] => (item=sshd) 2026-08-18 11:45:36.254865 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:45:36.254870 | mon1 | 2026-08-18 11:45:36.254875 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:45:36.254880 | mon1 | Tuesday 18 August 2026 11:45:36 +0000 (0:00:00.707) 0:03:34.994 ******** 2026-08-18 11:45:36.484436 | mon1 | ok: [mon1] 2026-08-18 11:45:36.484539 | mon1 | ok: [mon2] 2026-08-18 11:45:36.485438 | mon1 | ok: [mon3] 2026-08-18 11:45:36.485468 | mon1 | ok: [osd1] 2026-08-18 11:45:36.485478 | mon1 | 2026-08-18 11:45:36.485488 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:45:36.485497 | mon1 | Tuesday 18 August 2026 11:45:36 +0000 (0:00:00.230) 0:03:35.225 ******** 2026-08-18 11:45:36.837545 | mon1 | ok: [mon1] 2026-08-18 11:45:36.837668 | mon1 | ok: [mon2] 2026-08-18 11:45:36.837680 | mon1 | ok: [mon3] 2026-08-18 11:45:36.838255 | mon1 | changed: [osd1] 2026-08-18 11:45:36.838328 | mon1 | 2026-08-18 11:45:36.838338 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:45:36.838348 | mon1 | Tuesday 18 August 2026 11:45:36 +0000 (0:00:00.352) 0:03:35.578 ******** 2026-08-18 11:45:37.334301 | mon1 | ok: [mon2] 2026-08-18 11:45:37.334374 | mon1 | ok: [mon1] 2026-08-18 11:45:37.335102 | mon1 | ok: [mon3] 2026-08-18 11:45:37.335153 | mon1 | changed: [osd1] 2026-08-18 11:45:37.335162 | mon1 | 2026-08-18 11:45:37.335171 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:45:37.335186 | mon1 | Tuesday 18 August 2026 11:45:37 +0000 (0:00:00.497) 0:03:36.075 ******** 2026-08-18 11:45:37.372022 | mon1 | skipping: [mon1] 2026-08-18 11:45:37.400345 | mon1 | skipping: [mon2] 2026-08-18 11:45:37.400415 | mon1 | skipping: [mon3] 2026-08-18 11:45:37.400783 | mon1 | skipping: [osd1] 2026-08-18 11:45:37.400827 | mon1 | 2026-08-18 11:45:37.400833 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:45:37.400838 | mon1 | Tuesday 18 August 2026 11:45:37 +0000 (0:00:00.066) 0:03:36.141 ******** 2026-08-18 11:46:16.530918 | mon1 | ok: [mon1] 2026-08-18 11:46:16.531002 | mon1 | ok: [mon2] 2026-08-18 11:46:16.531468 | mon1 | ok: [mon3] 2026-08-18 11:46:16.531484 | mon1 | changed: [osd1] 2026-08-18 11:46:16.531489 | mon1 | 2026-08-18 11:46:16.531494 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:46:16.531499 | mon1 | Tuesday 18 August 2026 11:46:16 +0000 (0:00:39.130) 0:04:15.272 ******** 2026-08-18 11:46:17.044176 | mon1 | ok: [mon1] 2026-08-18 11:46:17.044250 | mon1 | ok: [mon2] 2026-08-18 11:46:17.044385 | mon1 | ok: [mon3] 2026-08-18 11:46:17.044458 | mon1 | changed: [osd1] 2026-08-18 11:46:17.044738 | mon1 | 2026-08-18 11:46:17.044753 | mon1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 11:46:17.044759 | mon1 | Tuesday 18 August 2026 11:46:17 +0000 (0:00:00.513) 0:04:15.785 ******** 2026-08-18 11:46:17.598585 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:46:17.598673 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:46:17.599114 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:46:17.599173 | mon1 | 2026-08-18 11:46:17.599185 | mon1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 11:46:17.599195 | mon1 | Tuesday 18 August 2026 11:46:17 +0000 (0:00:00.553) 0:04:16.339 ******** 2026-08-18 11:46:17.644454 | mon1 | ok: [mon1] 2026-08-18 11:46:17.686237 | mon1 | ok: [mon2] 2026-08-18 11:46:17.686295 | mon1 | ok: [mon3] 2026-08-18 11:46:17.686392 | mon1 | ok: [osd1] 2026-08-18 11:46:17.686766 | mon1 | 2026-08-18 11:46:17.686806 | mon1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 11:46:17.686812 | mon1 | Tuesday 18 August 2026 11:46:17 +0000 (0:00:00.088) 0:04:16.427 ******** 2026-08-18 11:46:17.727315 | mon1 | ok: [mon1] 2026-08-18 11:46:17.763689 | mon1 | ok: [mon2] 2026-08-18 11:46:17.763727 | mon1 | ok: [mon3] 2026-08-18 11:46:17.764139 | mon1 | ok: [osd1] 2026-08-18 11:46:17.764183 | mon1 | 2026-08-18 11:46:17.764189 | mon1 | TASK [Register this OSD host] ************************************************** 2026-08-18 11:46:17.764195 | mon1 | Tuesday 18 August 2026 11:46:17 +0000 (0:00:00.077) 0:04:16.505 ******** 2026-08-18 11:46:17.891036 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3, osd1 2026-08-18 11:46:17.891088 | mon1 | 2026-08-18 11:46:17.891321 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:46:17.891365 | mon1 | Tuesday 18 August 2026 11:46:17 +0000 (0:00:00.127) 0:04:16.632 ******** 2026-08-18 11:46:19.331078 | mon1 | ok: [mon1] 2026-08-18 11:46:19.331174 | mon1 | 2026-08-18 11:46:19.331500 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:46:19.331552 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:01.439) 0:04:18.072 ******** 2026-08-18 11:46:19.367438 | mon1 | ok: [mon1] 2026-08-18 11:46:19.402772 | mon1 | ok: [mon2] 2026-08-18 11:46:19.402847 | mon1 | ok: [mon3] 2026-08-18 11:46:19.402863 | mon1 | ok: [osd1] 2026-08-18 11:46:19.403127 | mon1 | 2026-08-18 11:46:19.403197 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:46:19.403245 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:00.072) 0:04:18.144 ******** 2026-08-18 11:46:19.441153 | mon1 | ok: [mon1] => { 2026-08-18 11:46:19.441228 | mon1 | "changed": false, 2026-08-18 11:46:19.441437 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:19.441487 | mon1 | } 2026-08-18 11:46:19.479034 | mon1 | ok: [mon2] => { 2026-08-18 11:46:19.479110 | mon1 | "changed": false, 2026-08-18 11:46:19.480295 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:19.480327 | mon1 | } 2026-08-18 11:46:19.480332 | mon1 | ok: [mon3] => { 2026-08-18 11:46:19.480337 | mon1 | "changed": false, 2026-08-18 11:46:19.480341 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:19.480345 | mon1 | } 2026-08-18 11:46:19.480349 | mon1 | ok: [osd1] => { 2026-08-18 11:46:19.480353 | mon1 | "changed": false, 2026-08-18 11:46:19.480357 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:19.480361 | mon1 | } 2026-08-18 11:46:19.480365 | mon1 | 2026-08-18 11:46:19.480370 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:46:19.480374 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:00.076) 0:04:18.220 ******** 2026-08-18 11:46:19.760312 | mon1 | ok: [mon1] 2026-08-18 11:46:19.760388 | mon1 | ok: [mon2] 2026-08-18 11:46:19.760842 | mon1 | ok: [mon3] 2026-08-18 11:46:19.760885 | mon1 | changed: [osd1] 2026-08-18 11:46:19.760891 | mon1 | 2026-08-18 11:46:19.760895 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:46:19.760900 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:00.281) 0:04:18.502 ******** 2026-08-18 11:46:19.835637 | mon1 | ok: [mon1] 2026-08-18 11:46:19.835701 | mon1 | ok: [mon2] 2026-08-18 11:46:19.836179 | mon1 | ok: [mon3] 2026-08-18 11:46:19.836226 | mon1 | ok: [osd1] 2026-08-18 11:46:19.836232 | mon1 | 2026-08-18 11:46:19.836237 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:46:19.836254 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:00.075) 0:04:18.577 ******** 2026-08-18 11:46:19.939294 | mon1 | ok: [mon1] 2026-08-18 11:46:19.939365 | mon1 | ok: [mon2] 2026-08-18 11:46:19.940095 | mon1 | ok: [mon3] 2026-08-18 11:46:19.940144 | mon1 | ok: [osd1] 2026-08-18 11:46:19.940152 | mon1 | 2026-08-18 11:46:19.940158 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:46:19.940165 | mon1 | Tuesday 18 August 2026 11:46:19 +0000 (0:00:00.103) 0:04:18.680 ******** 2026-08-18 11:46:19.975746 | mon1 | ok: [mon1] => { 2026-08-18 11:46:19.975833 | mon1 | "changed": false, 2026-08-18 11:46:19.976061 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:19.976109 | mon1 | } 2026-08-18 11:46:20.015252 | mon1 | ok: [mon2] => { 2026-08-18 11:46:20.015326 | mon1 | "changed": false, 2026-08-18 11:46:20.016482 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:20.016520 | mon1 | } 2026-08-18 11:46:20.016525 | mon1 | ok: [mon3] => { 2026-08-18 11:46:20.016530 | mon1 | "changed": false, 2026-08-18 11:46:20.016534 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:20.016538 | mon1 | } 2026-08-18 11:46:20.016542 | mon1 | ok: [osd1] => { 2026-08-18 11:46:20.016546 | mon1 | "changed": false, 2026-08-18 11:46:20.016550 | mon1 | "msg": "All assertions passed" 2026-08-18 11:46:20.016554 | mon1 | } 2026-08-18 11:46:20.016558 | mon1 | 2026-08-18 11:46:20.016562 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:46:20.016567 | mon1 | Tuesday 18 August 2026 11:46:20 +0000 (0:00:00.076) 0:04:18.756 ******** 2026-08-18 11:46:29.794468 | mon1 | ok: [mon1] 2026-08-18 11:46:29.794540 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:29.795044 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:29.795080 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:46:29.795091 | mon1 | 2026-08-18 11:46:29.795101 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:46:29.795111 | mon1 | Tuesday 18 August 2026 11:46:29 +0000 (0:00:09.779) 0:04:28.536 ******** 2026-08-18 11:46:29.893101 | mon1 | skipping: [mon1] 2026-08-18 11:46:29.893165 | mon1 | skipping: [mon2] 2026-08-18 11:46:29.893622 | mon1 | skipping: [mon3] 2026-08-18 11:46:29.893665 | mon1 | skipping: [osd1] 2026-08-18 11:46:29.893670 | mon1 | 2026-08-18 11:46:29.893675 | mon1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 11:46:29.893680 | mon1 | Tuesday 18 August 2026 11:46:29 +0000 (0:00:00.098) 0:04:28.634 ******** 2026-08-18 11:46:29.922108 | mon1 | skipping: [mon1] 2026-08-18 11:46:29.922232 | mon1 | 2026-08-18 11:46:29.922371 | mon1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 11:46:29.922578 | mon1 | Tuesday 18 August 2026 11:46:29 +0000 (0:00:00.028) 0:04:28.663 ******** 2026-08-18 11:46:32.957963 | mon1 | ok: [mon2] 2026-08-18 11:46:32.958032 | mon1 | ok: [mon1] 2026-08-18 11:46:32.958096 | mon1 | ok: [mon3] 2026-08-18 11:46:32.958502 | mon1 | ok: [osd1] 2026-08-18 11:46:32.958545 | mon1 | 2026-08-18 11:46:32.958551 | mon1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 11:46:32.958556 | mon1 | Tuesday 18 August 2026 11:46:32 +0000 (0:00:03.036) 0:04:31.699 ******** 2026-08-18 11:48:50.067673 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd0/data) 2026-08-18 11:48:50.067803 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd0/data) 2026-08-18 11:48:50.067815 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd0/data) 2026-08-18 11:48:50.067842 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 11:48:50.067851 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd1/data) 2026-08-18 11:48:50.067860 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd1/data) 2026-08-18 11:48:50.067869 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd1/data) 2026-08-18 11:48:50.067878 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 11:48:50.067910 | mon1 | changed: [mon2 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon2-osd2/data) 2026-08-18 11:48:50.067920 | mon1 | changed: [mon1] => (item=/dev/ceph-mon1-osd2/data) 2026-08-18 11:48:50.067932 | mon1 | changed: [mon3 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-mon3-osd2/data) 2026-08-18 11:48:50.068353 | mon1 | changed: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 11:48:50.068426 | mon1 | 2026-08-18 11:48:50.068436 | mon1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 11:48:50.068442 | mon1 | Tuesday 18 August 2026 11:48:50 +0000 (0:02:17.108) 0:06:48.808 ******** 2026-08-18 11:48:58.297971 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:48:58.298065 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:48:58.298116 | mon1 | ok: [mon1] 2026-08-18 11:48:58.298648 | mon1 | FAILED - RETRYING: [osd1 -> mon1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 11:48:58.298665 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:48:58.298670 | mon1 | 2026-08-18 11:48:58.298676 | mon1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 11:48:58.298681 | mon1 | Tuesday 18 August 2026 11:48:58 +0000 (0:00:08.230) 0:06:57.039 ******** 2026-08-18 11:48:58.382607 | mon1 | skipping: [mon1] 2026-08-18 11:48:58.382695 | mon1 | 2026-08-18 11:48:58.382742 | mon1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 11:48:58.383128 | mon1 | 2026-08-18 11:48:58.383240 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:48:58.383264 | mon1 | Tuesday 18 August 2026 11:48:58 +0000 (0:00:00.084) 0:06:57.124 ******** 2026-08-18 11:48:59.479892 | mon1 | ok: [mon1] 2026-08-18 11:48:59.479990 | mon1 | ok: [mon2] 2026-08-18 11:48:59.480006 | mon1 | ok: [mon3] 2026-08-18 11:48:59.480364 | mon1 | 2026-08-18 11:48:59.480427 | mon1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 11:48:59.480434 | mon1 | Tuesday 18 August 2026 11:48:59 +0000 (0:00:01.096) 0:06:58.220 ******** 2026-08-18 11:49:00.057979 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:49:00.058090 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:49:00.058169 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:49:00.058621 | mon1 | 2026-08-18 11:49:00.058696 | mon1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 11:49:00.058705 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.577) 0:06:58.798 ******** 2026-08-18 11:49:00.143345 | mon1 | ok: [mon1] 2026-08-18 11:49:00.143421 | mon1 | ok: [mon2] 2026-08-18 11:49:00.143478 | mon1 | ok: [mon3] 2026-08-18 11:49:00.143804 | mon1 | 2026-08-18 11:49:00.143882 | mon1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 11:49:00.143889 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.085) 0:06:58.884 ******** 2026-08-18 11:49:00.199561 | mon1 | ok: [mon1] 2026-08-18 11:49:00.200665 | mon1 | ok: [mon2] 2026-08-18 11:49:00.200746 | mon1 | ok: [mon3] 2026-08-18 11:49:00.200758 | mon1 | 2026-08-18 11:49:00.200769 | mon1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 11:49:00.200780 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.055) 0:06:58.940 ******** 2026-08-18 11:49:00.265596 | mon1 | skipping: [mon1] 2026-08-18 11:49:00.266119 | mon1 | skipping: [mon2] 2026-08-18 11:49:00.266185 | mon1 | skipping: [mon3] 2026-08-18 11:49:00.266191 | mon1 | 2026-08-18 11:49:00.266196 | mon1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 11:49:00.266202 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.066) 0:06:59.006 ******** 2026-08-18 11:49:00.318199 | mon1 | skipping: [mon1] 2026-08-18 11:49:00.318361 | mon1 | skipping: [mon2] 2026-08-18 11:49:00.318602 | mon1 | skipping: [mon3] 2026-08-18 11:49:00.318767 | mon1 | 2026-08-18 11:49:00.318978 | mon1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 11:49:00.319235 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.052) 0:06:59.059 ******** 2026-08-18 11:49:00.375343 | mon1 | skipping: [mon1] 2026-08-18 11:49:00.375431 | mon1 | skipping: [mon2] 2026-08-18 11:49:00.375577 | mon1 | skipping: [mon3] 2026-08-18 11:49:00.375762 | mon1 | 2026-08-18 11:49:00.375897 | mon1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 11:49:00.376111 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.057) 0:06:59.116 ******** 2026-08-18 11:49:00.424658 | mon1 | skipping: [mon1] 2026-08-18 11:49:00.424753 | mon1 | skipping: [mon2] 2026-08-18 11:49:00.424864 | mon1 | skipping: [mon3] 2026-08-18 11:49:00.425079 | mon1 | 2026-08-18 11:49:00.425252 | mon1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 11:49:00.425421 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.049) 0:06:59.166 ******** 2026-08-18 11:49:00.492830 | mon1 | skipping: [mon1] 2026-08-18 11:49:00.493171 | mon1 | skipping: [mon2] 2026-08-18 11:49:00.493425 | mon1 | skipping: [mon3] 2026-08-18 11:49:00.493663 | mon1 | 2026-08-18 11:49:00.493937 | mon1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 11:49:00.494197 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.067) 0:06:59.233 ******** 2026-08-18 11:49:00.575953 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for mon1, mon2, mon3 2026-08-18 11:49:00.576361 | mon1 | 2026-08-18 11:49:00.576675 | mon1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 11:49:00.576952 | mon1 | Tuesday 18 August 2026 11:49:00 +0000 (0:00:00.081) 0:06:59.315 ******** 2026-08-18 11:49:02.120541 | mon1 | ok: [mon1] 2026-08-18 11:49:02.120628 | mon1 | 2026-08-18 11:49:02.120693 | mon1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 11:49:02.120876 | mon1 | Tuesday 18 August 2026 11:49:02 +0000 (0:00:01.546) 0:07:00.861 ******** 2026-08-18 11:49:03.770030 | mon1 | ok: [mon1] 2026-08-18 11:49:03.770126 | mon1 | 2026-08-18 11:49:03.770139 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 11:49:03.770150 | mon1 | Tuesday 18 August 2026 11:49:03 +0000 (0:00:01.648) 0:07:02.509 ******** 2026-08-18 11:49:03.810026 | mon1 | skipping: [mon1] 2026-08-18 11:49:03.810070 | mon1 | 2026-08-18 11:49:03.810077 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 11:49:03.810083 | mon1 | Tuesday 18 August 2026 11:49:03 +0000 (0:00:00.040) 0:07:02.550 ******** 2026-08-18 11:49:03.848108 | mon1 | skipping: [mon1] 2026-08-18 11:49:03.848198 | mon1 | 2026-08-18 11:49:03.848449 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:49:03.848521 | mon1 | Tuesday 18 August 2026 11:49:03 +0000 (0:00:00.038) 0:07:02.589 ******** 2026-08-18 11:49:03.886906 | mon1 | skipping: [mon1] 2026-08-18 11:49:03.887348 | mon1 | 2026-08-18 11:49:03.887380 | mon1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 11:49:03.887388 | mon1 | Tuesday 18 August 2026 11:49:03 +0000 (0:00:00.039) 0:07:02.628 ******** 2026-08-18 11:49:05.700818 | mon1 | changed: [mon1] 2026-08-18 11:49:05.700913 | mon1 | 2026-08-18 11:49:05.701234 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:49:05.701287 | mon1 | Tuesday 18 August 2026 11:49:05 +0000 (0:00:01.813) 0:07:04.442 ******** 2026-08-18 11:49:05.744042 | mon1 | ok: [mon1] 2026-08-18 11:49:05.744519 | mon1 | 2026-08-18 11:49:05.744571 | mon1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 11:49:05.744580 | mon1 | Tuesday 18 August 2026 11:49:05 +0000 (0:00:00.042) 0:07:04.485 ******** 2026-08-18 11:49:12.619713 | mon1 | changed: [mon1] => (item=ceph mgr module disable dashboard) 2026-08-18 11:49:12.619777 | mon1 | changed: [mon1] => (item=ceph mgr module enable dashboard) 2026-08-18 11:49:12.619783 | mon1 | changed: [mon1] => (item=ceph orch reconfig mgr) 2026-08-18 11:49:12.619787 | mon1 | 2026-08-18 11:49:12.619792 | mon1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 11:49:12.619809 | mon1 | Tuesday 18 August 2026 11:49:12 +0000 (0:00:06.875) 0:07:11.360 ******** 2026-08-18 11:49:12.704286 | mon1 | skipping: [mon1] 2026-08-18 11:49:12.704346 | mon1 | skipping: [mon2] 2026-08-18 11:49:12.704351 | mon1 | skipping: [mon3] 2026-08-18 11:49:12.704356 | mon1 | 2026-08-18 11:49:12.704360 | mon1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 11:49:12.704365 | mon1 | 2026-08-18 11:49:12.704369 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:49:12.704373 | mon1 | Tuesday 18 August 2026 11:49:12 +0000 (0:00:00.084) 0:07:11.445 ******** 2026-08-18 11:49:13.665560 | mon1 | ok: [mon1] 2026-08-18 11:49:13.665639 | mon1 | ok: [mon2] 2026-08-18 11:49:13.665649 | mon1 | ok: [mon3] 2026-08-18 11:49:13.665659 | mon1 | 2026-08-18 11:49:13.665669 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:13.665678 | mon1 | Tuesday 18 August 2026 11:49:13 +0000 (0:00:00.960) 0:07:12.405 ******** 2026-08-18 11:49:13.909520 | mon1 | ok: [mon2] 2026-08-18 11:49:13.909613 | mon1 | ok: [mon1] 2026-08-18 11:49:13.909624 | mon1 | ok: [mon3] 2026-08-18 11:49:13.909634 | mon1 | 2026-08-18 11:49:13.909643 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:13.909653 | mon1 | Tuesday 18 August 2026 11:49:13 +0000 (0:00:00.243) 0:07:12.649 ******** 2026-08-18 11:49:13.985922 | mon1 | skipping: [mon1] 2026-08-18 11:49:13.986009 | mon1 | skipping: [mon2] 2026-08-18 11:49:13.986019 | mon1 | skipping: [mon3] 2026-08-18 11:49:13.986028 | mon1 | 2026-08-18 11:49:13.986038 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:49:13.986048 | mon1 | Tuesday 18 August 2026 11:49:13 +0000 (0:00:00.076) 0:07:12.725 ******** 2026-08-18 11:49:14.224998 | mon1 | ok: [mon2] 2026-08-18 11:49:14.225083 | mon1 | ok: [mon1] 2026-08-18 11:49:14.225091 | mon1 | ok: [mon3] 2026-08-18 11:49:14.225099 | mon1 | 2026-08-18 11:49:14.225107 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:14.225115 | mon1 | Tuesday 18 August 2026 11:49:14 +0000 (0:00:00.239) 0:07:12.965 ******** 2026-08-18 11:49:14.310342 | mon1 | ok: [mon1] => { 2026-08-18 11:49:14.310426 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:14.310438 | mon1 | } 2026-08-18 11:49:14.310448 | mon1 | ok: [mon2] => { 2026-08-18 11:49:14.310457 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:14.310466 | mon1 | } 2026-08-18 11:49:14.310475 | mon1 | ok: [mon3] => { 2026-08-18 11:49:14.310484 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:14.310492 | mon1 | } 2026-08-18 11:49:14.310501 | mon1 | 2026-08-18 11:49:14.310510 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:14.310520 | mon1 | Tuesday 18 August 2026 11:49:14 +0000 (0:00:00.084) 0:07:13.049 ******** 2026-08-18 11:49:14.661786 | mon1 | ok: [mon2] 2026-08-18 11:49:14.661852 | mon1 | ok: [mon1] 2026-08-18 11:49:14.661859 | mon1 | ok: [mon3] 2026-08-18 11:49:14.661865 | mon1 | 2026-08-18 11:49:14.661871 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:14.661884 | mon1 | Tuesday 18 August 2026 11:49:14 +0000 (0:00:00.353) 0:07:13.402 ******** 2026-08-18 11:49:14.758894 | mon1 | skipping: [mon1] 2026-08-18 11:49:14.758977 | mon1 | skipping: [mon2] 2026-08-18 11:49:14.758983 | mon1 | skipping: [mon3] 2026-08-18 11:49:14.758987 | mon1 | 2026-08-18 11:49:14.758992 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:14.758997 | mon1 | Tuesday 18 August 2026 11:49:14 +0000 (0:00:00.097) 0:07:13.500 ******** 2026-08-18 11:49:14.863089 | mon1 | skipping: [mon1] 2026-08-18 11:49:14.863123 | mon1 | skipping: [mon2] 2026-08-18 11:49:14.863133 | mon1 | skipping: [mon3] 2026-08-18 11:49:14.863142 | mon1 | 2026-08-18 11:49:14.863151 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:14.863160 | mon1 | Tuesday 18 August 2026 11:49:14 +0000 (0:00:00.103) 0:07:13.603 ******** 2026-08-18 11:49:15.106352 | mon1 | ok: [mon2] 2026-08-18 11:49:15.106432 | mon1 | ok: [mon1] 2026-08-18 11:49:15.106443 | mon1 | ok: [mon3] 2026-08-18 11:49:15.106454 | mon1 | 2026-08-18 11:49:15.106464 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:15.106473 | mon1 | Tuesday 18 August 2026 11:49:15 +0000 (0:00:00.242) 0:07:13.846 ******** 2026-08-18 11:49:16.319107 | mon1 | ok: [mon2] 2026-08-18 11:49:16.319484 | mon1 | ok: [mon1] 2026-08-18 11:49:16.319497 | mon1 | ok: [mon3] 2026-08-18 11:49:16.319518 | mon1 | 2026-08-18 11:49:16.319529 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:16.319677 | mon1 | Tuesday 18 August 2026 11:49:16 +0000 (0:00:01.213) 0:07:15.059 ******** 2026-08-18 11:49:16.420062 | mon1 | ok: [mon1] => { 2026-08-18 11:49:16.420414 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:16.420740 | mon1 | } 2026-08-18 11:49:16.420988 | mon1 | ok: [mon2] => { 2026-08-18 11:49:16.421239 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:16.421467 | mon1 | } 2026-08-18 11:49:16.421686 | mon1 | ok: [mon3] => { 2026-08-18 11:49:16.421920 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:16.422144 | mon1 | } 2026-08-18 11:49:16.422345 | mon1 | 2026-08-18 11:49:16.423188 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:16.423352 | mon1 | Tuesday 18 August 2026 11:49:16 +0000 (0:00:00.101) 0:07:15.160 ******** 2026-08-18 11:49:16.789365 | mon1 | ok: [mon2] 2026-08-18 11:49:16.789565 | mon1 | ok: [mon1] 2026-08-18 11:49:16.789775 | mon1 | ok: [mon3] 2026-08-18 11:49:16.789971 | mon1 | 2026-08-18 11:49:16.790196 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:16.790415 | mon1 | Tuesday 18 August 2026 11:49:16 +0000 (0:00:00.369) 0:07:15.530 ******** 2026-08-18 11:49:18.785202 | mon1 | ok: [mon2] 2026-08-18 11:49:18.785294 | mon1 | ok: [mon3] 2026-08-18 11:49:18.785305 | mon1 | ok: [mon1] 2026-08-18 11:49:18.785314 | mon1 | 2026-08-18 11:49:18.785324 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:49:18.785333 | mon1 | Tuesday 18 August 2026 11:49:18 +0000 (0:00:01.994) 0:07:17.525 ******** 2026-08-18 11:49:18.812507 | mon1 | skipping: [mon1] 2026-08-18 11:49:18.838628 | mon1 | skipping: [mon2] 2026-08-18 11:49:18.838728 | mon1 | skipping: [mon3] 2026-08-18 11:49:18.838855 | mon1 | 2026-08-18 11:49:18.839009 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:49:18.839176 | mon1 | Tuesday 18 August 2026 11:49:18 +0000 (0:00:00.054) 0:07:17.580 ******** 2026-08-18 11:49:18.893625 | mon1 | skipping: [mon1] 2026-08-18 11:49:18.893716 | mon1 | skipping: [mon2] 2026-08-18 11:49:18.893775 | mon1 | skipping: [mon3] 2026-08-18 11:49:18.893863 | mon1 | 2026-08-18 11:49:18.893965 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:49:18.894061 | mon1 | Tuesday 18 August 2026 11:49:18 +0000 (0:00:00.055) 0:07:17.635 ******** 2026-08-18 11:49:18.956218 | mon1 | skipping: [mon1] 2026-08-18 11:49:18.956310 | mon1 | skipping: [mon2] 2026-08-18 11:49:18.956323 | mon1 | skipping: [mon3] 2026-08-18 11:49:18.956440 | mon1 | 2026-08-18 11:49:18.956543 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:49:18.956670 | mon1 | Tuesday 18 August 2026 11:49:18 +0000 (0:00:00.061) 0:07:17.696 ******** 2026-08-18 11:49:20.124792 | mon1 | ok: [mon2] 2026-08-18 11:49:20.124876 | mon1 | ok: [mon3] 2026-08-18 11:49:20.125292 | mon1 | ok: [mon1] 2026-08-18 11:49:20.125354 | mon1 | 2026-08-18 11:49:20.125363 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:49:20.125371 | mon1 | Tuesday 18 August 2026 11:49:20 +0000 (0:00:01.168) 0:07:18.865 ******** 2026-08-18 11:49:20.616882 | mon1 | ok: [mon1] 2026-08-18 11:49:20.617439 | mon1 | ok: [mon2] 2026-08-18 11:49:20.617511 | mon1 | ok: [mon3] 2026-08-18 11:49:20.617530 | mon1 | 2026-08-18 11:49:20.617924 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:49:20.617961 | mon1 | Tuesday 18 August 2026 11:49:20 +0000 (0:00:00.492) 0:07:19.357 ******** 2026-08-18 11:49:21.577608 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:21.577735 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:21.577747 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:21.579186 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:21.579277 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:21.579287 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:21.579297 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:21.579306 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:21.579315 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:21.579329 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:21.579347 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:21.579356 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:21.579365 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:21.579375 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:21.579383 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:21.579392 | mon1 | 2026-08-18 11:49:21.579402 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:49:21.579419 | mon1 | Tuesday 18 August 2026 11:49:21 +0000 (0:00:00.961) 0:07:20.318 ******** 2026-08-18 11:49:22.173477 | mon1 | ok: [mon1] 2026-08-18 11:49:22.173580 | mon1 | ok: [mon2] 2026-08-18 11:49:22.173594 | mon1 | ok: [mon3] 2026-08-18 11:49:22.174741 | mon1 | 2026-08-18 11:49:22.174803 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:22.174810 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.579) 0:07:20.898 ******** 2026-08-18 11:49:22.174814 | mon1 | 2026-08-18 11:49:22.174818 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:22.174821 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.005) 0:07:20.904 ******** 2026-08-18 11:49:22.174825 | mon1 | 2026-08-18 11:49:22.174829 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:22.174833 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.005) 0:07:20.909 ******** 2026-08-18 11:49:22.174837 | mon1 | 2026-08-18 11:49:22.174841 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:49:22.174845 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.005) 0:07:20.915 ******** 2026-08-18 11:49:22.598388 | mon1 | ok: [mon2] 2026-08-18 11:49:22.598495 | mon1 | ok: [mon1] 2026-08-18 11:49:22.598506 | mon1 | ok: [mon3] 2026-08-18 11:49:22.598844 | mon1 | 2026-08-18 11:49:22.598916 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:22.598922 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.424) 0:07:21.339 ******** 2026-08-18 11:49:22.846604 | mon1 | ok: [mon1] 2026-08-18 11:49:22.846702 | mon1 | ok: [mon3] 2026-08-18 11:49:22.846715 | mon1 | ok: [mon2] 2026-08-18 11:49:22.847078 | mon1 | 2026-08-18 11:49:22.847153 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:22.847160 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.248) 0:07:21.587 ******** 2026-08-18 11:49:22.931571 | mon1 | ok: [mon1] => { 2026-08-18 11:49:22.932942 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:22.933006 | mon1 | } 2026-08-18 11:49:22.933025 | mon1 | ok: [mon2] => { 2026-08-18 11:49:22.933031 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:22.933035 | mon1 | } 2026-08-18 11:49:22.933039 | mon1 | ok: [mon3] => { 2026-08-18 11:49:22.933044 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:22.933047 | mon1 | } 2026-08-18 11:49:22.933052 | mon1 | 2026-08-18 11:49:22.933056 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:22.933062 | mon1 | Tuesday 18 August 2026 11:49:22 +0000 (0:00:00.084) 0:07:21.672 ******** 2026-08-18 11:49:23.313117 | mon1 | ok: [mon2] 2026-08-18 11:49:23.313214 | mon1 | ok: [mon1] 2026-08-18 11:49:23.313228 | mon1 | ok: [mon3] 2026-08-18 11:49:23.313610 | mon1 | 2026-08-18 11:49:23.313676 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:23.313682 | mon1 | Tuesday 18 August 2026 11:49:23 +0000 (0:00:00.381) 0:07:22.054 ******** 2026-08-18 11:49:26.539091 | mon1 | ok: [mon2] 2026-08-18 11:49:26.539195 | mon1 | ok: [mon3] 2026-08-18 11:49:26.539206 | mon1 | ok: [mon1] 2026-08-18 11:49:26.539543 | mon1 | 2026-08-18 11:49:26.539612 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:49:26.539619 | mon1 | Tuesday 18 August 2026 11:49:26 +0000 (0:00:03.225) 0:07:25.279 ******** 2026-08-18 11:49:27.871461 | mon1 | ok: [mon2] 2026-08-18 11:49:27.871578 | mon1 | ok: [mon3] 2026-08-18 11:49:27.871590 | mon1 | ok: [mon1] 2026-08-18 11:49:27.871928 | mon1 | 2026-08-18 11:49:27.871997 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:49:27.872003 | mon1 | Tuesday 18 August 2026 11:49:27 +0000 (0:00:01.332) 0:07:26.612 ******** 2026-08-18 11:49:28.097953 | mon1 | ok: [mon1] 2026-08-18 11:49:28.098054 | mon1 | ok: [mon3] 2026-08-18 11:49:28.098670 | mon1 | ok: [mon2] 2026-08-18 11:49:28.098981 | mon1 | 2026-08-18 11:49:28.099018 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:49:28.099025 | mon1 | Tuesday 18 August 2026 11:49:28 +0000 (0:00:00.226) 0:07:26.838 ******** 2026-08-18 11:49:28.574858 | mon1 | ok: [mon2] 2026-08-18 11:49:28.574975 | mon1 | ok: [mon1] 2026-08-18 11:49:28.575048 | mon1 | ok: [mon3] 2026-08-18 11:49:28.575457 | mon1 | 2026-08-18 11:49:28.575520 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:49:28.575527 | mon1 | Tuesday 18 August 2026 11:49:28 +0000 (0:00:00.477) 0:07:27.316 ******** 2026-08-18 11:49:29.184838 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:29.184905 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:29.184912 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:29.184918 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:29.184926 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:29.184932 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:29.184939 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:29.184945 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:29.184950 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:29.184956 | mon1 | 2026-08-18 11:49:29.184962 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:49:29.184969 | mon1 | Tuesday 18 August 2026 11:49:29 +0000 (0:00:00.607) 0:07:27.924 ******** 2026-08-18 11:49:29.643944 | mon1 | ok: [mon1] 2026-08-18 11:49:29.644038 | mon1 | ok: [mon2] 2026-08-18 11:49:29.644052 | mon1 | ok: [mon3] 2026-08-18 11:49:29.644415 | mon1 | 2026-08-18 11:49:29.644479 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:49:29.644486 | mon1 | Tuesday 18 August 2026 11:49:29 +0000 (0:00:00.461) 0:07:28.385 ******** 2026-08-18 11:49:30.138548 | mon1 | ok: [mon3] 2026-08-18 11:49:30.138638 | mon1 | ok: [mon1] 2026-08-18 11:49:30.138651 | mon1 | ok: [mon2] 2026-08-18 11:49:30.139223 | mon1 | 2026-08-18 11:49:30.139321 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:30.139365 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.477) 0:07:28.863 ******** 2026-08-18 11:49:30.139376 | mon1 | 2026-08-18 11:49:30.139398 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:30.139408 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.005) 0:07:28.868 ******** 2026-08-18 11:49:30.139418 | mon1 | 2026-08-18 11:49:30.139431 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:30.139992 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.005) 0:07:28.873 ******** 2026-08-18 11:49:30.140018 | mon1 | 2026-08-18 11:49:30.140025 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:49:30.140030 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.005) 0:07:28.879 ******** 2026-08-18 11:49:30.534336 | mon1 | ok: [mon1] 2026-08-18 11:49:30.534401 | mon1 | ok: [mon3] 2026-08-18 11:49:30.534419 | mon1 | ok: [mon2] 2026-08-18 11:49:30.534425 | mon1 | 2026-08-18 11:49:30.534430 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:30.534435 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.395) 0:07:29.274 ******** 2026-08-18 11:49:30.599153 | mon1 | ok: [mon1] => { 2026-08-18 11:49:30.599247 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:30.599260 | mon1 | } 2026-08-18 11:49:30.599280 | mon1 | ok: [mon2] => { 2026-08-18 11:49:30.599290 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:30.600045 | mon1 | } 2026-08-18 11:49:30.600112 | mon1 | ok: [mon3] => { 2026-08-18 11:49:30.600119 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:30.600125 | mon1 | } 2026-08-18 11:49:30.600130 | mon1 | 2026-08-18 11:49:30.600134 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:30.600139 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.065) 0:07:29.340 ******** 2026-08-18 11:49:30.909656 | mon1 | ok: [mon1] 2026-08-18 11:49:30.909791 | mon1 | ok: [mon2] 2026-08-18 11:49:30.909807 | mon1 | ok: [mon3] 2026-08-18 11:49:30.910171 | mon1 | 2026-08-18 11:49:30.910237 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:30.910244 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.310) 0:07:29.650 ******** 2026-08-18 11:49:30.943270 | mon1 | skipping: [mon1] 2026-08-18 11:49:30.989667 | mon1 | skipping: [mon2] 2026-08-18 11:49:30.989760 | mon1 | skipping: [mon3] 2026-08-18 11:49:30.989771 | mon1 | 2026-08-18 11:49:30.989884 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:49:30.989986 | mon1 | Tuesday 18 August 2026 11:49:30 +0000 (0:00:00.080) 0:07:29.731 ******** 2026-08-18 11:49:31.028483 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:31.076248 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:31.076444 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:31.076645 | mon1 | 2026-08-18 11:49:31.076870 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:49:31.077100 | mon1 | Tuesday 18 August 2026 11:49:31 +0000 (0:00:00.086) 0:07:29.817 ******** 2026-08-18 11:49:32.338593 | mon1 | ok: [mon3] 2026-08-18 11:49:32.338760 | mon1 | ok: [mon2] 2026-08-18 11:49:32.338995 | mon1 | ok: [mon1] 2026-08-18 11:49:32.339215 | mon1 | 2026-08-18 11:49:32.339552 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:49:32.339788 | mon1 | Tuesday 18 August 2026 11:49:32 +0000 (0:00:01.261) 0:07:31.079 ******** 2026-08-18 11:49:33.018359 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:49:33.018546 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:49:33.018783 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:49:33.019036 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:49:33.019269 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:49:33.019513 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:49:33.019706 | mon1 | 2026-08-18 11:49:33.019964 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:49:33.020185 | mon1 | Tuesday 18 August 2026 11:49:33 +0000 (0:00:00.679) 0:07:31.759 ******** 2026-08-18 11:49:33.259445 | mon1 | ok: [mon2] 2026-08-18 11:49:33.259543 | mon1 | ok: [mon1] 2026-08-18 11:49:33.259685 | mon1 | ok: [mon3] 2026-08-18 11:49:33.259822 | mon1 | 2026-08-18 11:49:33.259931 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:49:33.260028 | mon1 | Tuesday 18 August 2026 11:49:33 +0000 (0:00:00.241) 0:07:32.000 ******** 2026-08-18 11:49:33.547783 | mon1 | ok: [mon2] 2026-08-18 11:49:33.547902 | mon1 | ok: [mon1] 2026-08-18 11:49:33.548113 | mon1 | ok: [mon3] 2026-08-18 11:49:33.548387 | mon1 | 2026-08-18 11:49:33.548714 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:49:33.548962 | mon1 | Tuesday 18 August 2026 11:49:33 +0000 (0:00:00.288) 0:07:32.288 ******** 2026-08-18 11:49:33.997030 | mon1 | ok: [mon3] 2026-08-18 11:49:33.997129 | mon1 | ok: [mon2] 2026-08-18 11:49:33.997140 | mon1 | ok: [mon1] 2026-08-18 11:49:33.997212 | mon1 | 2026-08-18 11:49:33.997308 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:49:33.997406 | mon1 | Tuesday 18 August 2026 11:49:33 +0000 (0:00:00.449) 0:07:32.738 ******** 2026-08-18 11:49:34.067563 | mon1 | skipping: [mon1] 2026-08-18 11:49:34.067768 | mon1 | skipping: [mon2] 2026-08-18 11:49:34.068048 | mon1 | skipping: [mon3] 2026-08-18 11:49:34.068320 | mon1 | 2026-08-18 11:49:34.068625 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:49:34.068878 | mon1 | Tuesday 18 August 2026 11:49:34 +0000 (0:00:00.070) 0:07:32.808 ******** 2026-08-18 11:49:34.439783 | mon1 | ok: [mon2] 2026-08-18 11:49:34.439982 | mon1 | ok: [mon1] 2026-08-18 11:49:34.440210 | mon1 | ok: [mon3] 2026-08-18 11:49:34.440419 | mon1 | 2026-08-18 11:49:34.440680 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:49:34.440918 | mon1 | Tuesday 18 August 2026 11:49:34 +0000 (0:00:00.372) 0:07:33.180 ******** 2026-08-18 11:49:34.935176 | mon1 | ok: [mon2] 2026-08-18 11:49:34.935335 | mon1 | ok: [mon3] 2026-08-18 11:49:34.935550 | mon1 | ok: [mon1] 2026-08-18 11:49:34.935751 | mon1 | 2026-08-18 11:49:34.935978 | mon1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 11:49:34.936253 | mon1 | Tuesday 18 August 2026 11:49:34 +0000 (0:00:00.495) 0:07:33.676 ******** 2026-08-18 11:49:35.003323 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 11:49:35.003436 | mon1 | skipping: [mon1] => (item=mon2) 2026-08-18 11:49:35.003679 | mon1 | skipping: [mon1] => (item=mon3) 2026-08-18 11:49:35.003863 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.004049 | mon1 | 2026-08-18 11:49:35.004272 | mon1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 11:49:35.004515 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.067) 0:07:33.744 ******** 2026-08-18 11:49:35.041979 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.073392 | mon1 | skipping: [mon2] 2026-08-18 11:49:35.073594 | mon1 | skipping: [mon3] 2026-08-18 11:49:35.073806 | mon1 | 2026-08-18 11:49:35.074033 | mon1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 11:49:35.074243 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.070) 0:07:33.814 ******** 2026-08-18 11:49:35.105824 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.138995 | mon1 | skipping: [mon2] 2026-08-18 11:49:35.139151 | mon1 | skipping: [mon3] 2026-08-18 11:49:35.139346 | mon1 | 2026-08-18 11:49:35.139629 | mon1 | TASK [Register this RGW host] ************************************************** 2026-08-18 11:49:35.140034 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.065) 0:07:33.880 ******** 2026-08-18 11:49:35.214867 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.214988 | mon1 | skipping: [mon2] 2026-08-18 11:49:35.215222 | mon1 | skipping: [mon3] 2026-08-18 11:49:35.215396 | mon1 | 2026-08-18 11:49:35.215611 | mon1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 11:49:35.215818 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.075) 0:07:33.955 ******** 2026-08-18 11:49:35.243094 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.243248 | mon1 | 2026-08-18 11:49:35.243457 | mon1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 11:49:35.243662 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.028) 0:07:33.984 ******** 2026-08-18 11:49:35.272057 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.272202 | mon1 | 2026-08-18 11:49:35.272440 | mon1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 11:49:35.272647 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.028) 0:07:34.013 ******** 2026-08-18 11:49:35.357436 | mon1 | skipping: [mon1] 2026-08-18 11:49:35.357597 | mon1 | 2026-08-18 11:49:35.357836 | mon1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 11:49:35.358070 | mon1 | 2026-08-18 11:49:35.358363 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:49:35.358593 | mon1 | Tuesday 18 August 2026 11:49:35 +0000 (0:00:00.085) 0:07:34.098 ******** 2026-08-18 11:49:36.353978 | mon1 | ok: [mon2] 2026-08-18 11:49:36.354253 | mon1 | ok: [mon3] 2026-08-18 11:49:36.354386 | mon1 | ok: [mon1] 2026-08-18 11:49:36.354581 | mon1 | 2026-08-18 11:49:36.354903 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:36.355161 | mon1 | Tuesday 18 August 2026 11:49:36 +0000 (0:00:00.996) 0:07:35.095 ******** 2026-08-18 11:49:36.590511 | mon1 | ok: [mon2] 2026-08-18 11:49:36.590769 | mon1 | ok: [mon1] 2026-08-18 11:49:36.591107 | mon1 | ok: [mon3] 2026-08-18 11:49:36.591354 | mon1 | 2026-08-18 11:49:36.591631 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:36.592015 | mon1 | Tuesday 18 August 2026 11:49:36 +0000 (0:00:00.236) 0:07:35.331 ******** 2026-08-18 11:49:36.682062 | mon1 | skipping: [mon1] 2026-08-18 11:49:36.682160 | mon1 | skipping: [mon2] 2026-08-18 11:49:36.682241 | mon1 | skipping: [mon3] 2026-08-18 11:49:36.682357 | mon1 | 2026-08-18 11:49:36.682495 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:49:36.682628 | mon1 | Tuesday 18 August 2026 11:49:36 +0000 (0:00:00.091) 0:07:35.423 ******** 2026-08-18 11:49:36.932728 | mon1 | ok: [mon1] 2026-08-18 11:49:36.932907 | mon1 | ok: [mon2] 2026-08-18 11:49:36.933123 | mon1 | ok: [mon3] 2026-08-18 11:49:36.933334 | mon1 | 2026-08-18 11:49:36.933547 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:36.933825 | mon1 | Tuesday 18 August 2026 11:49:36 +0000 (0:00:00.250) 0:07:35.673 ******** 2026-08-18 11:49:37.014507 | mon1 | ok: [mon1] => { 2026-08-18 11:49:37.014726 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:37.014991 | mon1 | } 2026-08-18 11:49:37.015213 | mon1 | ok: [mon2] => { 2026-08-18 11:49:37.015464 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:37.015658 | mon1 | } 2026-08-18 11:49:37.015875 | mon1 | ok: [mon3] => { 2026-08-18 11:49:37.016108 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:49:37.016312 | mon1 | } 2026-08-18 11:49:37.016511 | mon1 | 2026-08-18 11:49:37.016751 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:37.017035 | mon1 | Tuesday 18 August 2026 11:49:37 +0000 (0:00:00.081) 0:07:35.755 ******** 2026-08-18 11:49:37.350815 | mon1 | ok: [mon1] 2026-08-18 11:49:37.351108 | mon1 | ok: [mon3] 2026-08-18 11:49:37.351375 | mon1 | ok: [mon2] 2026-08-18 11:49:37.351597 | mon1 | 2026-08-18 11:49:37.351842 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:37.352067 | mon1 | Tuesday 18 August 2026 11:49:37 +0000 (0:00:00.336) 0:07:36.092 ******** 2026-08-18 11:49:37.447034 | mon1 | skipping: [mon1] 2026-08-18 11:49:37.447270 | mon1 | skipping: [mon2] 2026-08-18 11:49:37.447483 | mon1 | skipping: [mon3] 2026-08-18 11:49:37.447677 | mon1 | 2026-08-18 11:49:37.447896 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:37.448108 | mon1 | Tuesday 18 August 2026 11:49:37 +0000 (0:00:00.096) 0:07:36.188 ******** 2026-08-18 11:49:37.538736 | mon1 | skipping: [mon1] 2026-08-18 11:49:37.538885 | mon1 | skipping: [mon2] 2026-08-18 11:49:37.539136 | mon1 | skipping: [mon3] 2026-08-18 11:49:37.539324 | mon1 | 2026-08-18 11:49:37.539583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:37.539790 | mon1 | Tuesday 18 August 2026 11:49:37 +0000 (0:00:00.091) 0:07:36.279 ******** 2026-08-18 11:49:37.782700 | mon1 | ok: [mon1] 2026-08-18 11:49:37.782784 | mon1 | ok: [mon2] 2026-08-18 11:49:37.782911 | mon1 | ok: [mon3] 2026-08-18 11:49:37.783074 | mon1 | 2026-08-18 11:49:37.783225 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:49:37.783366 | mon1 | Tuesday 18 August 2026 11:49:37 +0000 (0:00:00.244) 0:07:36.523 ******** 2026-08-18 11:49:39.022923 | mon1 | ok: [mon2] 2026-08-18 11:49:39.023211 | mon1 | ok: [mon3] 2026-08-18 11:49:39.023452 | mon1 | ok: [mon1] 2026-08-18 11:49:39.023657 | mon1 | 2026-08-18 11:49:39.023938 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:39.024189 | mon1 | Tuesday 18 August 2026 11:49:39 +0000 (0:00:01.239) 0:07:37.763 ******** 2026-08-18 11:49:39.120983 | mon1 | ok: [mon1] => { 2026-08-18 11:49:39.121139 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:39.121345 | mon1 | } 2026-08-18 11:49:39.121581 | mon1 | ok: [mon3] => { 2026-08-18 11:49:39.121825 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:39.122029 | mon1 | } 2026-08-18 11:49:39.122222 | mon1 | ok: [mon2] => { 2026-08-18 11:49:39.122446 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:49:39.122640 | mon1 | } 2026-08-18 11:49:39.122828 | mon1 | 2026-08-18 11:49:39.123107 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:39.123308 | mon1 | Tuesday 18 August 2026 11:49:39 +0000 (0:00:00.097) 0:07:37.861 ******** 2026-08-18 11:49:39.523444 | mon1 | ok: [mon1] 2026-08-18 11:49:39.523538 | mon1 | ok: [mon2] 2026-08-18 11:49:39.523553 | mon1 | ok: [mon3] 2026-08-18 11:49:39.523670 | mon1 | 2026-08-18 11:49:39.523765 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:39.523863 | mon1 | Tuesday 18 August 2026 11:49:39 +0000 (0:00:00.402) 0:07:38.264 ******** 2026-08-18 11:49:41.529841 | mon1 | ok: [mon2] 2026-08-18 11:49:41.529945 | mon1 | ok: [mon3] 2026-08-18 11:49:41.529957 | mon1 | ok: [mon1] 2026-08-18 11:49:41.529967 | mon1 | 2026-08-18 11:49:41.529977 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:49:41.529987 | mon1 | Tuesday 18 August 2026 11:49:41 +0000 (0:00:02.006) 0:07:40.270 ******** 2026-08-18 11:49:41.594329 | mon1 | skipping: [mon1] 2026-08-18 11:49:41.594447 | mon1 | skipping: [mon2] 2026-08-18 11:49:41.594976 | mon1 | skipping: [mon3] 2026-08-18 11:49:41.595064 | mon1 | 2026-08-18 11:49:41.595074 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:49:41.595083 | mon1 | Tuesday 18 August 2026 11:49:41 +0000 (0:00:00.065) 0:07:40.335 ******** 2026-08-18 11:49:41.631061 | mon1 | skipping: [mon1] 2026-08-18 11:49:41.662177 | mon1 | skipping: [mon2] 2026-08-18 11:49:41.662268 | mon1 | skipping: [mon3] 2026-08-18 11:49:41.662705 | mon1 | 2026-08-18 11:49:41.662770 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:49:41.662779 | mon1 | Tuesday 18 August 2026 11:49:41 +0000 (0:00:00.067) 0:07:40.403 ******** 2026-08-18 11:49:41.696575 | mon1 | skipping: [mon1] 2026-08-18 11:49:41.729309 | mon1 | skipping: [mon2] 2026-08-18 11:49:41.729386 | mon1 | skipping: [mon3] 2026-08-18 11:49:41.729400 | mon1 | 2026-08-18 11:49:41.729531 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:49:41.729674 | mon1 | Tuesday 18 August 2026 11:49:41 +0000 (0:00:00.067) 0:07:40.470 ******** 2026-08-18 11:49:43.152220 | mon1 | ok: [mon2] 2026-08-18 11:49:43.152332 | mon1 | ok: [mon3] 2026-08-18 11:49:43.152932 | mon1 | ok: [mon1] 2026-08-18 11:49:43.153010 | mon1 | 2026-08-18 11:49:43.153033 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:49:43.153041 | mon1 | Tuesday 18 August 2026 11:49:43 +0000 (0:00:01.422) 0:07:41.893 ******** 2026-08-18 11:49:43.669494 | mon1 | ok: [mon2] 2026-08-18 11:49:43.669562 | mon1 | ok: [mon1] 2026-08-18 11:49:43.669567 | mon1 | ok: [mon3] 2026-08-18 11:49:43.669571 | mon1 | 2026-08-18 11:49:43.669576 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:49:43.669581 | mon1 | Tuesday 18 August 2026 11:49:43 +0000 (0:00:00.517) 0:07:42.410 ******** 2026-08-18 11:49:44.644347 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:44.644434 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:44.646034 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:49:44.646391 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:44.646400 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:44.646404 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:49:44.646409 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:44.646414 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:44.646418 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:49:44.646422 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:44.646428 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:44.646432 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:49:44.646437 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:44.646442 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:44.646446 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:49:44.646451 | mon1 | 2026-08-18 11:49:44.646455 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:49:44.646460 | mon1 | Tuesday 18 August 2026 11:49:44 +0000 (0:00:00.974) 0:07:43.385 ******** 2026-08-18 11:49:45.222033 | mon1 | ok: [mon2] 2026-08-18 11:49:45.222130 | mon1 | ok: [mon1] 2026-08-18 11:49:45.223064 | mon1 | ok: [mon3] 2026-08-18 11:49:45.223149 | mon1 | 2026-08-18 11:49:45.223157 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:45.223164 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.561) 0:07:43.946 ******** 2026-08-18 11:49:45.223169 | mon1 | 2026-08-18 11:49:45.223175 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:45.223181 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.005) 0:07:43.952 ******** 2026-08-18 11:49:45.223186 | mon1 | 2026-08-18 11:49:45.223199 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:49:45.223631 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.005) 0:07:43.957 ******** 2026-08-18 11:49:45.223700 | mon1 | 2026-08-18 11:49:45.223706 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:49:45.223710 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.005) 0:07:43.963 ******** 2026-08-18 11:49:45.647365 | mon1 | ok: [mon2] 2026-08-18 11:49:45.647450 | mon1 | ok: [mon3] 2026-08-18 11:49:45.647800 | mon1 | ok: [mon1] 2026-08-18 11:49:45.647816 | mon1 | 2026-08-18 11:49:45.647822 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:49:45.647832 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.425) 0:07:44.388 ******** 2026-08-18 11:49:45.887868 | mon1 | ok: [mon1] 2026-08-18 11:49:45.887945 | mon1 | ok: [mon2] 2026-08-18 11:49:45.887950 | mon1 | ok: [mon3] 2026-08-18 11:49:45.887954 | mon1 | 2026-08-18 11:49:45.887959 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:45.887964 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.240) 0:07:44.628 ******** 2026-08-18 11:49:45.985408 | mon1 | ok: [mon1] => { 2026-08-18 11:49:45.986478 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:45.986492 | mon1 | } 2026-08-18 11:49:45.986497 | mon1 | ok: [mon2] => { 2026-08-18 11:49:45.986501 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:45.986506 | mon1 | } 2026-08-18 11:49:45.986509 | mon1 | ok: [mon3] => { 2026-08-18 11:49:45.986513 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:49:45.986518 | mon1 | } 2026-08-18 11:49:45.986522 | mon1 | 2026-08-18 11:49:45.986526 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:45.986530 | mon1 | Tuesday 18 August 2026 11:49:45 +0000 (0:00:00.097) 0:07:44.726 ******** 2026-08-18 11:49:46.358778 | mon1 | ok: [mon2] 2026-08-18 11:49:46.358861 | mon1 | ok: [mon1] 2026-08-18 11:49:46.358872 | mon1 | ok: [mon3] 2026-08-18 11:49:46.358881 | mon1 | 2026-08-18 11:49:46.358891 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:46.358901 | mon1 | Tuesday 18 August 2026 11:49:46 +0000 (0:00:00.371) 0:07:45.098 ******** 2026-08-18 11:49:49.572316 | mon1 | ok: [mon1] 2026-08-18 11:49:49.572380 | mon1 | ok: [mon2] 2026-08-18 11:49:49.572385 | mon1 | ok: [mon3] 2026-08-18 11:49:49.572389 | mon1 | 2026-08-18 11:49:49.572394 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:49:49.572399 | mon1 | Tuesday 18 August 2026 11:49:49 +0000 (0:00:03.214) 0:07:48.313 ******** 2026-08-18 11:49:50.779110 | mon1 | ok: [mon2] 2026-08-18 11:49:50.779199 | mon1 | ok: [mon3] 2026-08-18 11:49:50.779209 | mon1 | ok: [mon1] 2026-08-18 11:49:50.779219 | mon1 | 2026-08-18 11:49:50.779229 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:49:50.779238 | mon1 | Tuesday 18 August 2026 11:49:50 +0000 (0:00:01.205) 0:07:49.519 ******** 2026-08-18 11:49:51.079662 | mon1 | ok: [mon1] 2026-08-18 11:49:51.079844 | mon1 | ok: [mon2] 2026-08-18 11:49:51.080174 | mon1 | ok: [mon3] 2026-08-18 11:49:51.080395 | mon1 | 2026-08-18 11:49:51.080618 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:49:51.080843 | mon1 | Tuesday 18 August 2026 11:49:51 +0000 (0:00:00.301) 0:07:49.820 ******** 2026-08-18 11:49:51.539180 | mon1 | ok: [mon2] 2026-08-18 11:49:51.540171 | mon1 | ok: [mon1] 2026-08-18 11:49:51.540194 | mon1 | ok: [mon3] 2026-08-18 11:49:51.540205 | mon1 | 2026-08-18 11:49:51.540214 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:49:51.540224 | mon1 | Tuesday 18 August 2026 11:49:51 +0000 (0:00:00.459) 0:07:50.280 ******** 2026-08-18 11:49:52.124255 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:52.124436 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:52.124654 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:49:52.124879 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:52.125098 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:52.125309 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:49:52.125518 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:52.125716 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:52.125919 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:49:52.126105 | mon1 | 2026-08-18 11:49:52.126369 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:49:52.126721 | mon1 | Tuesday 18 August 2026 11:49:52 +0000 (0:00:00.585) 0:07:50.865 ******** 2026-08-18 11:49:52.570264 | mon1 | ok: [mon2] 2026-08-18 11:49:52.570392 | mon1 | ok: [mon1] 2026-08-18 11:49:52.570521 | mon1 | ok: [mon3] 2026-08-18 11:49:52.570641 | mon1 | 2026-08-18 11:49:52.570777 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:49:52.570906 | mon1 | Tuesday 18 August 2026 11:49:52 +0000 (0:00:00.446) 0:07:51.311 ******** 2026-08-18 11:49:53.058064 | mon1 | ok: [mon3] 2026-08-18 11:49:53.058280 | mon1 | ok: [mon2] 2026-08-18 11:49:53.058577 | mon1 | ok: [mon1] 2026-08-18 11:49:53.058806 | mon1 | 2026-08-18 11:49:53.059137 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:53.059381 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.468) 0:07:51.780 ******** 2026-08-18 11:49:53.059575 | mon1 | 2026-08-18 11:49:53.059794 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:53.060031 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.007) 0:07:51.787 ******** 2026-08-18 11:49:53.060228 | mon1 | 2026-08-18 11:49:53.060443 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:49:53.060652 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.005) 0:07:51.793 ******** 2026-08-18 11:49:53.060839 | mon1 | 2026-08-18 11:49:53.061067 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:49:53.061352 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.005) 0:07:51.799 ******** 2026-08-18 11:49:53.498451 | mon1 | ok: [mon2] 2026-08-18 11:49:53.498560 | mon1 | ok: [mon3] 2026-08-18 11:49:53.498569 | mon1 | ok: [mon1] 2026-08-18 11:49:53.498576 | mon1 | 2026-08-18 11:49:53.498583 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:49:53.498590 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.439) 0:07:52.238 ******** 2026-08-18 11:49:53.563522 | mon1 | ok: [mon1] => { 2026-08-18 11:49:53.563658 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:53.564328 | mon1 | } 2026-08-18 11:49:53.564355 | mon1 | ok: [mon2] => { 2026-08-18 11:49:53.564366 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:53.564375 | mon1 | } 2026-08-18 11:49:53.564387 | mon1 | ok: [mon3] => { 2026-08-18 11:49:53.565254 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:49:53.565277 | mon1 | } 2026-08-18 11:49:53.565284 | mon1 | 2026-08-18 11:49:53.565289 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:49:53.565295 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.065) 0:07:52.304 ******** 2026-08-18 11:49:53.880343 | mon1 | ok: [mon2] 2026-08-18 11:49:53.880420 | mon1 | ok: [mon1] 2026-08-18 11:49:53.880995 | mon1 | ok: [mon3] 2026-08-18 11:49:53.881062 | mon1 | 2026-08-18 11:49:53.881069 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:49:53.881076 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.316) 0:07:52.621 ******** 2026-08-18 11:49:53.914501 | mon1 | skipping: [mon1] 2026-08-18 11:49:53.968421 | mon1 | skipping: [mon2] 2026-08-18 11:49:53.968494 | mon1 | skipping: [mon3] 2026-08-18 11:49:53.968549 | mon1 | 2026-08-18 11:49:53.968649 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:49:53.968790 | mon1 | Tuesday 18 August 2026 11:49:53 +0000 (0:00:00.088) 0:07:52.710 ******** 2026-08-18 11:49:54.048578 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:54.048665 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:54.049090 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:49:54.049149 | mon1 | 2026-08-18 11:49:54.049155 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:49:54.049160 | mon1 | Tuesday 18 August 2026 11:49:54 +0000 (0:00:00.079) 0:07:52.789 ******** 2026-08-18 11:49:55.193058 | mon1 | ok: [mon2] 2026-08-18 11:49:55.193174 | mon1 | ok: [mon1] 2026-08-18 11:49:55.193225 | mon1 | ok: [mon3] 2026-08-18 11:49:55.193699 | mon1 | 2026-08-18 11:49:55.193767 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:49:55.193776 | mon1 | Tuesday 18 August 2026 11:49:55 +0000 (0:00:01.144) 0:07:53.934 ******** 2026-08-18 11:49:55.890124 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:49:55.890191 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:49:55.890198 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:49:55.890204 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:49:55.890209 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:49:55.890215 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:49:55.890221 | mon1 | 2026-08-18 11:49:55.890228 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:49:55.890234 | mon1 | Tuesday 18 August 2026 11:49:55 +0000 (0:00:00.696) 0:07:54.630 ******** 2026-08-18 11:49:56.111110 | mon1 | ok: [mon2] 2026-08-18 11:49:56.111185 | mon1 | ok: [mon1] 2026-08-18 11:49:56.111198 | mon1 | ok: [mon3] 2026-08-18 11:49:56.111664 | mon1 | 2026-08-18 11:49:56.111735 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:49:56.111743 | mon1 | Tuesday 18 August 2026 11:49:56 +0000 (0:00:00.221) 0:07:54.851 ******** 2026-08-18 11:49:56.393785 | mon1 | ok: [mon1] 2026-08-18 11:49:56.393880 | mon1 | ok: [mon2] 2026-08-18 11:49:56.394431 | mon1 | ok: [mon3] 2026-08-18 11:49:56.394505 | mon1 | 2026-08-18 11:49:56.394513 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:49:56.394520 | mon1 | Tuesday 18 August 2026 11:49:56 +0000 (0:00:00.282) 0:07:55.134 ******** 2026-08-18 11:49:56.846034 | mon1 | ok: [mon2] 2026-08-18 11:49:56.846128 | mon1 | ok: [mon1] 2026-08-18 11:49:56.846618 | mon1 | ok: [mon3] 2026-08-18 11:49:56.846718 | mon1 | 2026-08-18 11:49:56.846732 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:49:56.846743 | mon1 | Tuesday 18 August 2026 11:49:56 +0000 (0:00:00.452) 0:07:55.587 ******** 2026-08-18 11:49:56.882390 | mon1 | skipping: [mon1] 2026-08-18 11:49:56.915439 | mon1 | skipping: [mon2] 2026-08-18 11:49:56.915506 | mon1 | skipping: [mon3] 2026-08-18 11:49:56.915645 | mon1 | 2026-08-18 11:49:56.915980 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:49:56.916054 | mon1 | Tuesday 18 August 2026 11:49:56 +0000 (0:00:00.069) 0:07:55.656 ******** 2026-08-18 11:49:57.305849 | mon1 | ok: [mon1] 2026-08-18 11:49:57.305949 | mon1 | ok: [mon3] 2026-08-18 11:49:57.306373 | mon1 | ok: [mon2] 2026-08-18 11:49:57.306465 | mon1 | 2026-08-18 11:49:57.306489 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:49:57.306500 | mon1 | Tuesday 18 August 2026 11:49:57 +0000 (0:00:00.390) 0:07:56.047 ******** 2026-08-18 11:49:57.822187 | mon1 | ok: [mon2] 2026-08-18 11:49:57.822290 | mon1 | ok: [mon3] 2026-08-18 11:49:57.822302 | mon1 | ok: [mon1] 2026-08-18 11:49:57.822625 | mon1 | 2026-08-18 11:49:57.822698 | mon1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 11:49:57.822704 | mon1 | Tuesday 18 August 2026 11:49:57 +0000 (0:00:00.516) 0:07:56.563 ******** 2026-08-18 11:49:58.435855 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:49:58.436317 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:49:58.436328 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:49:58.436334 | mon1 | 2026-08-18 11:49:58.436340 | mon1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 11:49:58.436347 | mon1 | Tuesday 18 August 2026 11:49:58 +0000 (0:00:00.612) 0:07:57.176 ******** 2026-08-18 11:49:58.514549 | mon1 | ok: [mon1] 2026-08-18 11:49:58.514645 | mon1 | ok: [mon2] 2026-08-18 11:49:58.515010 | mon1 | ok: [mon3] 2026-08-18 11:49:58.515042 | mon1 | 2026-08-18 11:49:58.515061 | mon1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 11:49:58.515278 | mon1 | Tuesday 18 August 2026 11:49:58 +0000 (0:00:00.079) 0:07:57.255 ******** 2026-08-18 11:49:58.587157 | mon1 | ok: [mon1] 2026-08-18 11:49:58.587263 | mon1 | ok: [mon2] 2026-08-18 11:49:58.587865 | mon1 | ok: [mon3] 2026-08-18 11:49:58.587954 | mon1 | 2026-08-18 11:49:58.587963 | mon1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 11:49:58.587971 | mon1 | Tuesday 18 August 2026 11:49:58 +0000 (0:00:00.072) 0:07:57.328 ******** 2026-08-18 11:49:58.621233 | mon1 | skipping: [mon1] 2026-08-18 11:49:58.621288 | mon1 | 2026-08-18 11:49:58.621648 | mon1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 11:49:58.621717 | mon1 | Tuesday 18 August 2026 11:49:58 +0000 (0:00:00.033) 0:07:57.362 ******** 2026-08-18 11:50:01.680322 | mon1 | changed: [mon1] => (item=ceph-exporter) 2026-08-18 11:50:01.680416 | mon1 | 2026-08-18 11:50:01.680479 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:50:01.683098 | mon1 | mon1 : ok=213 changed=38 unreachable=0 failed=0 skipped=57 rescued=0 ignored=0 2026-08-18 11:50:01.683205 | mon1 | mon2 : ok=191 changed=28 unreachable=0 failed=0 skipped=52 rescued=0 ignored=0 2026-08-18 11:50:01.683217 | mon1 | mon3 : ok=191 changed=28 unreachable=0 failed=0 skipped=52 rescued=0 ignored=0 2026-08-18 11:50:01.683227 | mon1 | osd1 : ok=53 changed=28 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-18 11:50:01.683236 | mon1 | 2026-08-18 11:50:01.683246 | mon1 | 2026-08-18 11:50:01.683256 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:50:01.683266 | mon1 | Tuesday 18 August 2026 11:50:01 +0000 (0:00:03.059) 0:08:00.421 ******** 2026-08-18 11:50:01.683280 | mon1 | =============================================================================== 2026-08-18 11:50:01.683289 | mon1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 137.11s 2026-08-18 11:50:01.683297 | mon1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 40.36s 2026-08-18 11:50:01.683306 | mon1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 39.70s 2026-08-18 11:50:01.683315 | mon1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 39.13s 2026-08-18 11:50:01.683324 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 25.48s 2026-08-18 11:50:01.683332 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 9.78s 2026-08-18 11:50:01.683342 | mon1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 8.23s 2026-08-18 11:50:01.683351 | mon1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 7.75s 2026-08-18 11:50:01.683360 | mon1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 6.88s 2026-08-18 11:50:01.683369 | mon1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 6.36s 2026-08-18 11:50:01.683378 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.72s 2026-08-18 11:50:01.683386 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.48s 2026-08-18 11:50:01.683395 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.19s 2026-08-18 11:50:01.683404 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.06s 2026-08-18 11:50:01.683413 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.52s 2026-08-18 11:50:01.683421 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.49s 2026-08-18 11:50:01.683430 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.83s 2026-08-18 11:50:01.683449 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.23s 2026-08-18 11:50:01.683458 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.21s 2026-08-18 11:50:01.683467 | mon1 | vexxhost.ceph.monitoring : Apply the monitoring service specs ----------- 3.06s 2026-08-18 11:50:01.847963 | mon1 | INFO [default > converge] Executed: Successful 2026-08-18 11:50:01.856621 | mon1 | INFO [default > idempotence] Executing 2026-08-18 11:50:02.879494 | mon1 | 2026-08-18 11:50:02.879708 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 11:50:02.879919 | mon1 | 2026-08-18 11:50:02.880150 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:50:02.880368 | mon1 | Tuesday 18 August 2026 11:50:02 +0000 (0:00:00.053) 0:00:00.053 ******** 2026-08-18 11:50:04.088746 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:50:04.088874 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:50:04.089032 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:50:04.089162 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:50:04.089310 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:50:04.093340 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:50:04.093473 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:50:04.093612 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:50:04.093773 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:50:04.093901 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:50:04.159168 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:50:04.159370 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:50:04.159590 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:50:04.159848 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:50:04.160167 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:50:04.222126 | mon1 | ok: [mon2] 2026-08-18 11:50:04.222264 | mon1 | ok: [mon3] 2026-08-18 11:50:04.222502 | mon1 | ok: [mon1] 2026-08-18 11:50:04.222714 | mon1 | 2026-08-18 11:50:04.222986 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:50:04.223221 | mon1 | Tuesday 18 August 2026 11:50:04 +0000 (0:00:01.342) 0:00:01.396 ******** 2026-08-18 11:50:04.632669 | mon1 | ok: [mon2] 2026-08-18 11:50:04.632843 | mon1 | ok: [mon3] 2026-08-18 11:50:04.633062 | mon1 | ok: [mon1] 2026-08-18 11:50:04.633269 | mon1 | 2026-08-18 11:50:04.633510 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:04.633734 | mon1 | Tuesday 18 August 2026 11:50:04 +0000 (0:00:00.410) 0:00:01.806 ******** 2026-08-18 11:50:04.714912 | mon1 | skipping: [mon1] 2026-08-18 11:50:04.715098 | mon1 | skipping: [mon2] 2026-08-18 11:50:04.715315 | mon1 | skipping: [mon3] 2026-08-18 11:50:04.715513 | mon1 | 2026-08-18 11:50:04.715745 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:50:04.716004 | mon1 | Tuesday 18 August 2026 11:50:04 +0000 (0:00:00.082) 0:00:01.889 ******** 2026-08-18 11:50:05.058837 | mon1 | ok: [mon1] 2026-08-18 11:50:05.059037 | mon1 | ok: [mon3] 2026-08-18 11:50:05.059281 | mon1 | ok: [mon2] 2026-08-18 11:50:05.059493 | mon1 | 2026-08-18 11:50:05.059771 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:05.060054 | mon1 | Tuesday 18 August 2026 11:50:05 +0000 (0:00:00.343) 0:00:02.232 ******** 2026-08-18 11:50:05.170846 | mon1 | ok: [mon1] => { 2026-08-18 11:50:05.170925 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:05.170934 | mon1 | } 2026-08-18 11:50:05.170961 | mon1 | ok: [mon2] => { 2026-08-18 11:50:05.170968 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:05.170974 | mon1 | } 2026-08-18 11:50:05.170979 | mon1 | ok: [mon3] => { 2026-08-18 11:50:05.170985 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:05.170991 | mon1 | } 2026-08-18 11:50:05.170997 | mon1 | 2026-08-18 11:50:05.171011 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:05.171018 | mon1 | Tuesday 18 August 2026 11:50:05 +0000 (0:00:00.110) 0:00:02.343 ******** 2026-08-18 11:50:05.638752 | mon1 | ok: [mon2] 2026-08-18 11:50:05.638884 | mon1 | ok: [mon3] 2026-08-18 11:50:05.639556 | mon1 | ok: [mon1] 2026-08-18 11:50:05.639622 | mon1 | 2026-08-18 11:50:05.639631 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:05.639641 | mon1 | Tuesday 18 August 2026 11:50:05 +0000 (0:00:00.469) 0:00:02.812 ******** 2026-08-18 11:50:05.676290 | mon1 | skipping: [mon1] 2026-08-18 11:50:05.740842 | mon1 | skipping: [mon2] 2026-08-18 11:50:05.740912 | mon1 | skipping: [mon3] 2026-08-18 11:50:05.741267 | mon1 | 2026-08-18 11:50:05.741334 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:05.741341 | mon1 | Tuesday 18 August 2026 11:50:05 +0000 (0:00:00.102) 0:00:02.915 ******** 2026-08-18 11:50:05.782279 | mon1 | skipping: [mon1] 2026-08-18 11:50:05.857926 | mon1 | skipping: [mon2] 2026-08-18 11:50:05.857961 | mon1 | skipping: [mon3] 2026-08-18 11:50:05.857966 | mon1 | 2026-08-18 11:50:05.857972 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:50:05.857977 | mon1 | Tuesday 18 August 2026 11:50:05 +0000 (0:00:00.116) 0:00:03.031 ******** 2026-08-18 11:50:06.119127 | mon1 | ok: [mon1] 2026-08-18 11:50:06.119177 | mon1 | ok: [mon2] 2026-08-18 11:50:06.119182 | mon1 | ok: [mon3] 2026-08-18 11:50:06.119186 | mon1 | 2026-08-18 11:50:06.119191 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:06.119196 | mon1 | Tuesday 18 August 2026 11:50:06 +0000 (0:00:00.260) 0:00:03.292 ******** 2026-08-18 11:50:07.455439 | mon1 | ok: [mon2] 2026-08-18 11:50:07.455539 | mon1 | ok: [mon3] 2026-08-18 11:50:07.455583 | mon1 | ok: [mon1] 2026-08-18 11:50:07.455672 | mon1 | 2026-08-18 11:50:07.455776 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:07.455874 | mon1 | Tuesday 18 August 2026 11:50:07 +0000 (0:00:01.336) 0:00:04.629 ******** 2026-08-18 11:50:07.574969 | mon1 | ok: [mon1] => { 2026-08-18 11:50:07.575773 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:07.575841 | mon1 | } 2026-08-18 11:50:07.575853 | mon1 | ok: [mon2] => { 2026-08-18 11:50:07.575863 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:07.575902 | mon1 | } 2026-08-18 11:50:07.575912 | mon1 | ok: [mon3] => { 2026-08-18 11:50:07.575928 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:07.575937 | mon1 | } 2026-08-18 11:50:07.576163 | mon1 | 2026-08-18 11:50:07.576206 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:07.576301 | mon1 | Tuesday 18 August 2026 11:50:07 +0000 (0:00:00.119) 0:00:04.749 ******** 2026-08-18 11:50:07.967473 | mon1 | ok: [mon1] 2026-08-18 11:50:07.967569 | mon1 | ok: [mon2] 2026-08-18 11:50:07.967602 | mon1 | ok: [mon3] 2026-08-18 11:50:07.967699 | mon1 | 2026-08-18 11:50:07.967801 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:07.967901 | mon1 | Tuesday 18 August 2026 11:50:07 +0000 (0:00:00.392) 0:00:05.141 ******** 2026-08-18 11:50:10.227377 | mon1 | ok: [mon2] 2026-08-18 11:50:10.227550 | mon1 | ok: [mon3] 2026-08-18 11:50:10.227760 | mon1 | ok: [mon1] 2026-08-18 11:50:10.227969 | mon1 | 2026-08-18 11:50:10.228207 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:50:10.228431 | mon1 | Tuesday 18 August 2026 11:50:10 +0000 (0:00:02.259) 0:00:07.401 ******** 2026-08-18 11:50:10.289270 | mon1 | skipping: [mon1] 2026-08-18 11:50:10.289459 | mon1 | skipping: [mon2] 2026-08-18 11:50:10.289673 | mon1 | skipping: [mon3] 2026-08-18 11:50:10.289891 | mon1 | 2026-08-18 11:50:10.290185 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:50:10.290407 | mon1 | Tuesday 18 August 2026 11:50:10 +0000 (0:00:00.062) 0:00:07.463 ******** 2026-08-18 11:50:10.360066 | mon1 | skipping: [mon1] 2026-08-18 11:50:10.360235 | mon1 | skipping: [mon2] 2026-08-18 11:50:10.360444 | mon1 | skipping: [mon3] 2026-08-18 11:50:10.360650 | mon1 | 2026-08-18 11:50:10.360875 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:50:10.361076 | mon1 | Tuesday 18 August 2026 11:50:10 +0000 (0:00:00.070) 0:00:07.533 ******** 2026-08-18 11:50:10.423766 | mon1 | skipping: [mon1] 2026-08-18 11:50:10.424010 | mon1 | skipping: [mon2] 2026-08-18 11:50:10.424239 | mon1 | skipping: [mon3] 2026-08-18 11:50:10.424444 | mon1 | 2026-08-18 11:50:10.424681 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:50:10.424901 | mon1 | Tuesday 18 August 2026 11:50:10 +0000 (0:00:00.063) 0:00:07.597 ******** 2026-08-18 11:50:11.513165 | mon1 | ok: [mon3] 2026-08-18 11:50:11.513231 | mon1 | ok: [mon2] 2026-08-18 11:50:11.513242 | mon1 | ok: [mon1] 2026-08-18 11:50:11.513251 | mon1 | 2026-08-18 11:50:11.513261 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:50:11.513278 | mon1 | Tuesday 18 August 2026 11:50:11 +0000 (0:00:01.088) 0:00:08.686 ******** 2026-08-18 11:50:12.001965 | mon1 | ok: [mon2] 2026-08-18 11:50:12.002063 | mon1 | ok: [mon1] 2026-08-18 11:50:12.002074 | mon1 | ok: [mon3] 2026-08-18 11:50:12.002424 | mon1 | 2026-08-18 11:50:12.002497 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:50:12.002503 | mon1 | Tuesday 18 August 2026 11:50:12 +0000 (0:00:00.490) 0:00:09.176 ******** 2026-08-18 11:50:12.969991 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:50:12.970086 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:50:12.970098 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:50:12.970108 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:50:12.970120 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:50:12.970130 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:50:12.970140 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:50:12.970150 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:50:12.970160 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:50:12.970170 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:50:12.970180 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:50:12.970190 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:50:12.970200 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:50:12.970673 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:50:12.971043 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:50:12.971664 | mon1 | 2026-08-18 11:50:12.971690 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:50:12.971702 | mon1 | Tuesday 18 August 2026 11:50:12 +0000 (0:00:00.963) 0:00:10.140 ******** 2026-08-18 11:50:13.540714 | mon1 | ok: [mon1] 2026-08-18 11:50:13.540793 | mon1 | ok: [mon2] 2026-08-18 11:50:13.540804 | mon1 | ok: [mon3] 2026-08-18 11:50:13.540820 | mon1 | 2026-08-18 11:50:13.541022 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:50:13.541237 | mon1 | Tuesday 18 August 2026 11:50:13 +0000 (0:00:00.551) 0:00:10.691 ******** 2026-08-18 11:50:13.541425 | mon1 | 2026-08-18 11:50:13.541713 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:50:13.541935 | mon1 | Tuesday 18 August 2026 11:50:13 +0000 (0:00:00.007) 0:00:10.699 ******** 2026-08-18 11:50:13.542113 | mon1 | 2026-08-18 11:50:13.542323 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:50:13.542534 | mon1 | Tuesday 18 August 2026 11:50:13 +0000 (0:00:00.006) 0:00:10.706 ******** 2026-08-18 11:50:13.542750 | mon1 | 2026-08-18 11:50:13.542992 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:50:13.543191 | mon1 | Tuesday 18 August 2026 11:50:13 +0000 (0:00:00.007) 0:00:10.713 ******** 2026-08-18 11:50:14.127344 | mon1 | ok: [mon2] 2026-08-18 11:50:14.127604 | mon1 | ok: [mon3] 2026-08-18 11:50:14.127849 | mon1 | ok: [mon1] 2026-08-18 11:50:14.128061 | mon1 | 2026-08-18 11:50:14.128286 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:50:14.128506 | mon1 | Tuesday 18 August 2026 11:50:14 +0000 (0:00:00.587) 0:00:11.301 ******** 2026-08-18 11:50:14.365166 | mon1 | ok: [mon1] 2026-08-18 11:50:14.365333 | mon1 | ok: [mon2] 2026-08-18 11:50:14.365661 | mon1 | ok: [mon3] 2026-08-18 11:50:14.365841 | mon1 | 2026-08-18 11:50:14.366078 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:14.366299 | mon1 | Tuesday 18 August 2026 11:50:14 +0000 (0:00:00.237) 0:00:11.539 ******** 2026-08-18 11:50:14.466434 | mon1 | ok: [mon1] => { 2026-08-18 11:50:14.466618 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:50:14.466842 | mon1 | } 2026-08-18 11:50:14.467142 | mon1 | ok: [mon2] => { 2026-08-18 11:50:14.467384 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:50:14.467582 | mon1 | } 2026-08-18 11:50:14.467774 | mon1 | ok: [mon3] => { 2026-08-18 11:50:14.468100 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:50:14.468305 | mon1 | } 2026-08-18 11:50:14.468520 | mon1 | 2026-08-18 11:50:14.468715 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:14.468922 | mon1 | Tuesday 18 August 2026 11:50:14 +0000 (0:00:00.101) 0:00:11.640 ******** 2026-08-18 11:50:14.857066 | mon1 | ok: [mon2] 2026-08-18 11:50:14.857231 | mon1 | ok: [mon3] 2026-08-18 11:50:14.857471 | mon1 | ok: [mon1] 2026-08-18 11:50:14.857660 | mon1 | 2026-08-18 11:50:14.857886 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:14.858097 | mon1 | Tuesday 18 August 2026 11:50:14 +0000 (0:00:00.390) 0:00:12.030 ******** 2026-08-18 11:50:19.047148 | mon1 | ok: [mon3] 2026-08-18 11:50:19.047244 | mon1 | ok: [mon2] 2026-08-18 11:50:19.047299 | mon1 | ok: [mon1] 2026-08-18 11:50:19.047379 | mon1 | 2026-08-18 11:50:19.047487 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:50:19.047583 | mon1 | Tuesday 18 August 2026 11:50:19 +0000 (0:00:04.190) 0:00:16.221 ******** 2026-08-18 11:50:20.244043 | mon1 | ok: [mon2] 2026-08-18 11:50:20.244124 | mon1 | ok: [mon3] 2026-08-18 11:50:20.244135 | mon1 | ok: [mon1] 2026-08-18 11:50:20.244669 | mon1 | 2026-08-18 11:50:20.244748 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:50:20.244760 | mon1 | Tuesday 18 August 2026 11:50:20 +0000 (0:00:01.196) 0:00:17.417 ******** 2026-08-18 11:50:20.562518 | mon1 | ok: [mon3] 2026-08-18 11:50:20.562609 | mon1 | ok: [mon2] 2026-08-18 11:50:20.562664 | mon1 | ok: [mon1] 2026-08-18 11:50:20.562997 | mon1 | 2026-08-18 11:50:20.563057 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:50:20.563064 | mon1 | Tuesday 18 August 2026 11:50:20 +0000 (0:00:00.319) 0:00:17.736 ******** 2026-08-18 11:50:21.031316 | mon1 | ok: [mon1] 2026-08-18 11:50:21.031409 | mon1 | ok: [mon2] 2026-08-18 11:50:21.032029 | mon1 | ok: [mon3] 2026-08-18 11:50:21.032105 | mon1 | 2026-08-18 11:50:21.032122 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:50:21.032130 | mon1 | Tuesday 18 August 2026 11:50:21 +0000 (0:00:00.468) 0:00:18.204 ******** 2026-08-18 11:50:21.631921 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:50:21.632012 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:50:21.632107 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:50:21.632935 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:50:21.632992 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:50:21.632998 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:50:21.633002 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:50:21.633057 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:50:21.633062 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:50:21.633066 | mon1 | 2026-08-18 11:50:21.633071 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:50:21.633076 | mon1 | Tuesday 18 August 2026 11:50:21 +0000 (0:00:00.601) 0:00:18.806 ******** 2026-08-18 11:50:22.069929 | mon1 | ok: [mon1] 2026-08-18 11:50:22.070008 | mon1 | ok: [mon3] 2026-08-18 11:50:22.070381 | mon1 | ok: [mon2] 2026-08-18 11:50:22.070442 | mon1 | 2026-08-18 11:50:22.070448 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:50:22.070453 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.438) 0:00:19.244 ******** 2026-08-18 11:50:22.560983 | mon1 | ok: [mon1] 2026-08-18 11:50:22.561040 | mon1 | ok: [mon2] 2026-08-18 11:50:22.562512 | mon1 | ok: [mon3] 2026-08-18 11:50:22.562607 | mon1 | 2026-08-18 11:50:22.562620 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:50:22.562631 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.465) 0:00:19.709 ******** 2026-08-18 11:50:22.562653 | mon1 | 2026-08-18 11:50:22.562662 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:50:22.562860 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.010) 0:00:19.719 ******** 2026-08-18 11:50:22.563063 | mon1 | 2026-08-18 11:50:22.563160 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:50:22.563545 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.008) 0:00:19.727 ******** 2026-08-18 11:50:22.563573 | mon1 | 2026-08-18 11:50:22.563584 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:50:22.563597 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.007) 0:00:19.735 ******** 2026-08-18 11:50:22.972288 | mon1 | ok: [mon1] 2026-08-18 11:50:22.972388 | mon1 | ok: [mon2] 2026-08-18 11:50:22.972399 | mon1 | ok: [mon3] 2026-08-18 11:50:22.972492 | mon1 | 2026-08-18 11:50:22.972593 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:22.972704 | mon1 | Tuesday 18 August 2026 11:50:22 +0000 (0:00:00.411) 0:00:20.146 ******** 2026-08-18 11:50:23.040218 | mon1 | ok: [mon1] => { 2026-08-18 11:50:23.040321 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:50:23.040333 | mon1 | } 2026-08-18 11:50:23.040434 | mon1 | ok: [mon2] => { 2026-08-18 11:50:23.040528 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:50:23.040622 | mon1 | } 2026-08-18 11:50:23.040720 | mon1 | ok: [mon3] => { 2026-08-18 11:50:23.040808 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:50:23.040896 | mon1 | } 2026-08-18 11:50:23.040982 | mon1 | 2026-08-18 11:50:23.041079 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:23.041183 | mon1 | Tuesday 18 August 2026 11:50:23 +0000 (0:00:00.068) 0:00:20.214 ******** 2026-08-18 11:50:23.338654 | mon1 | ok: [mon1] 2026-08-18 11:50:23.338755 | mon1 | ok: [mon3] 2026-08-18 11:50:23.338766 | mon1 | ok: [mon2] 2026-08-18 11:50:23.339107 | mon1 | 2026-08-18 11:50:23.339200 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:23.339220 | mon1 | Tuesday 18 August 2026 11:50:23 +0000 (0:00:00.298) 0:00:20.512 ******** 2026-08-18 11:50:23.376851 | mon1 | skipping: [mon1] 2026-08-18 11:50:23.434634 | mon1 | skipping: [mon2] 2026-08-18 11:50:23.434714 | mon1 | skipping: [mon3] 2026-08-18 11:50:23.435100 | mon1 | 2026-08-18 11:50:23.435163 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:50:23.435170 | mon1 | Tuesday 18 August 2026 11:50:23 +0000 (0:00:00.095) 0:00:20.608 ******** 2026-08-18 11:50:23.476686 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:50:23.525176 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:50:23.525676 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:50:23.526065 | mon1 | 2026-08-18 11:50:23.526181 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:50:23.526282 | mon1 | Tuesday 18 August 2026 11:50:23 +0000 (0:00:00.090) 0:00:20.698 ******** 2026-08-18 11:50:24.733331 | mon1 | ok: [mon3] 2026-08-18 11:50:24.733557 | mon1 | ok: [mon2] 2026-08-18 11:50:24.733823 | mon1 | ok: [mon1] 2026-08-18 11:50:24.734030 | mon1 | 2026-08-18 11:50:24.734253 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:50:24.734473 | mon1 | Tuesday 18 August 2026 11:50:24 +0000 (0:00:01.208) 0:00:21.907 ******** 2026-08-18 11:50:25.433735 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:50:25.433878 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:50:25.434091 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:50:25.434274 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:50:25.434469 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:50:25.434664 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:50:25.434844 | mon1 | 2026-08-18 11:50:25.435220 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:50:25.435420 | mon1 | Tuesday 18 August 2026 11:50:25 +0000 (0:00:00.700) 0:00:22.607 ******** 2026-08-18 11:50:25.670917 | mon1 | ok: [mon1] 2026-08-18 11:50:25.671198 | mon1 | ok: [mon2] 2026-08-18 11:50:25.671500 | mon1 | ok: [mon3] 2026-08-18 11:50:25.671809 | mon1 | 2026-08-18 11:50:25.672106 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:50:25.672408 | mon1 | Tuesday 18 August 2026 11:50:25 +0000 (0:00:00.237) 0:00:22.844 ******** 2026-08-18 11:50:26.099333 | mon1 | ok: [mon3] 2026-08-18 11:50:26.099503 | mon1 | ok: [mon2] 2026-08-18 11:50:26.099684 | mon1 | ok: [mon1] 2026-08-18 11:50:26.099867 | mon1 | 2026-08-18 11:50:26.100089 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:50:26.100291 | mon1 | Tuesday 18 August 2026 11:50:26 +0000 (0:00:00.428) 0:00:23.273 ******** 2026-08-18 11:50:26.568744 | mon1 | ok: [mon3] 2026-08-18 11:50:26.568902 | mon1 | ok: [mon2] 2026-08-18 11:50:26.569091 | mon1 | ok: [mon1] 2026-08-18 11:50:26.569454 | mon1 | 2026-08-18 11:50:26.569730 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:50:26.569933 | mon1 | Tuesday 18 August 2026 11:50:26 +0000 (0:00:00.469) 0:00:23.742 ******** 2026-08-18 11:50:26.625511 | mon1 | skipping: [mon1] 2026-08-18 11:50:26.625629 | mon1 | skipping: [mon2] 2026-08-18 11:50:26.625837 | mon1 | skipping: [mon3] 2026-08-18 11:50:26.626010 | mon1 | 2026-08-18 11:50:26.626220 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:50:26.626421 | mon1 | Tuesday 18 August 2026 11:50:26 +0000 (0:00:00.057) 0:00:23.799 ******** 2026-08-18 11:50:27.217147 | mon1 | ok: [mon3] 2026-08-18 11:50:27.217230 | mon1 | ok: [mon2] 2026-08-18 11:50:27.217241 | mon1 | ok: [mon1] 2026-08-18 11:50:27.217250 | mon1 | 2026-08-18 11:50:27.217261 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:50:27.217270 | mon1 | Tuesday 18 August 2026 11:50:27 +0000 (0:00:00.590) 0:00:24.389 ******** 2026-08-18 11:50:27.713591 | mon1 | ok: [mon1] 2026-08-18 11:50:27.713752 | mon1 | ok: [mon3] 2026-08-18 11:50:27.713765 | mon1 | ok: [mon2] 2026-08-18 11:50:27.713835 | mon1 | 2026-08-18 11:50:27.713942 | mon1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 11:50:27.714045 | mon1 | Tuesday 18 August 2026 11:50:27 +0000 (0:00:00.497) 0:00:24.887 ******** 2026-08-18 11:50:27.829413 | mon1 | ok: [mon1] 2026-08-18 11:50:27.829572 | mon1 | ok: [mon2] 2026-08-18 11:50:27.829884 | mon1 | ok: [mon3] 2026-08-18 11:50:27.830098 | mon1 | 2026-08-18 11:50:27.830358 | mon1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 11:50:27.830571 | mon1 | Tuesday 18 August 2026 11:50:27 +0000 (0:00:00.115) 0:00:25.003 ******** 2026-08-18 11:50:27.907874 | mon1 | ok: [mon1] => { 2026-08-18 11:50:27.908067 | mon1 | "changed": false, 2026-08-18 11:50:27.908283 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:27.908545 | mon1 | } 2026-08-18 11:50:27.908771 | mon1 | ok: [mon2] => { 2026-08-18 11:50:27.908971 | mon1 | "changed": false, 2026-08-18 11:50:27.909197 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:27.909396 | mon1 | } 2026-08-18 11:50:27.909597 | mon1 | ok: [mon3] => { 2026-08-18 11:50:27.909838 | mon1 | "changed": false, 2026-08-18 11:50:27.910046 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:27.910254 | mon1 | } 2026-08-18 11:50:27.910439 | mon1 | 2026-08-18 11:50:27.910655 | mon1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 11:50:27.910862 | mon1 | Tuesday 18 August 2026 11:50:27 +0000 (0:00:00.078) 0:00:25.082 ******** 2026-08-18 11:50:27.983284 | mon1 | ok: [mon1] 2026-08-18 11:50:27.983472 | mon1 | ok: [mon2] 2026-08-18 11:50:27.983676 | mon1 | ok: [mon3] 2026-08-18 11:50:27.983868 | mon1 | 2026-08-18 11:50:27.984086 | mon1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 11:50:27.984295 | mon1 | Tuesday 18 August 2026 11:50:27 +0000 (0:00:00.075) 0:00:25.157 ******** 2026-08-18 11:50:28.603188 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:50:28.603399 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:50:28.603648 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:50:28.603857 | mon1 | 2026-08-18 11:50:28.604106 | mon1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 11:50:28.604369 | mon1 | Tuesday 18 August 2026 11:50:28 +0000 (0:00:00.619) 0:00:25.776 ******** 2026-08-18 11:50:28.687624 | mon1 | ok: [mon1] 2026-08-18 11:50:28.687785 | mon1 | ok: [mon2] 2026-08-18 11:50:28.687996 | mon1 | ok: [mon3] 2026-08-18 11:50:28.688199 | mon1 | 2026-08-18 11:50:28.688452 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 11:50:28.688723 | mon1 | Tuesday 18 August 2026 11:50:28 +0000 (0:00:00.084) 0:00:25.861 ******** 2026-08-18 11:50:28.763021 | mon1 | skipping: [mon1] 2026-08-18 11:50:28.763188 | mon1 | skipping: [mon2] 2026-08-18 11:50:28.763398 | mon1 | skipping: [mon3] 2026-08-18 11:50:28.763623 | mon1 | 2026-08-18 11:50:28.763818 | mon1 | TASK [Register this monitor host] ********************************************** 2026-08-18 11:50:28.764031 | mon1 | Tuesday 18 August 2026 11:50:28 +0000 (0:00:00.075) 0:00:25.936 ******** 2026-08-18 11:50:28.883289 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:50:28.883427 | mon1 | 2026-08-18 11:50:28.883644 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:50:28.883852 | mon1 | Tuesday 18 August 2026 11:50:28 +0000 (0:00:00.120) 0:00:26.057 ******** 2026-08-18 11:50:30.509245 | mon1 | ok: [mon1] 2026-08-18 11:50:30.509341 | mon1 | 2026-08-18 11:50:30.509464 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:50:30.509593 | mon1 | Tuesday 18 August 2026 11:50:30 +0000 (0:00:01.625) 0:00:27.683 ******** 2026-08-18 11:50:30.588429 | mon1 | ok: [mon1] 2026-08-18 11:50:30.588649 | mon1 | ok: [mon2] 2026-08-18 11:50:30.588885 | mon1 | ok: [mon3] 2026-08-18 11:50:30.589100 | mon1 | 2026-08-18 11:50:30.589339 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:50:30.589580 | mon1 | Tuesday 18 August 2026 11:50:30 +0000 (0:00:00.079) 0:00:27.762 ******** 2026-08-18 11:50:30.663426 | mon1 | ok: [mon1] => { 2026-08-18 11:50:30.663716 | mon1 | "changed": false, 2026-08-18 11:50:30.664019 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:30.664246 | mon1 | } 2026-08-18 11:50:30.664457 | mon1 | ok: [mon2] => { 2026-08-18 11:50:30.664662 | mon1 | "changed": false, 2026-08-18 11:50:30.664866 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:30.665059 | mon1 | } 2026-08-18 11:50:30.665265 | mon1 | ok: [mon3] => { 2026-08-18 11:50:30.665551 | mon1 | "changed": false, 2026-08-18 11:50:30.665768 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:30.665961 | mon1 | } 2026-08-18 11:50:30.666223 | mon1 | 2026-08-18 11:50:30.666454 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:50:30.666674 | mon1 | Tuesday 18 August 2026 11:50:30 +0000 (0:00:00.075) 0:00:27.837 ******** 2026-08-18 11:50:31.073290 | mon1 | ok: [mon1] 2026-08-18 11:50:31.073472 | mon1 | ok: [mon2] 2026-08-18 11:50:31.073682 | mon1 | ok: [mon3] 2026-08-18 11:50:31.073873 | mon1 | 2026-08-18 11:50:31.074109 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:50:31.074494 | mon1 | Tuesday 18 August 2026 11:50:31 +0000 (0:00:00.410) 0:00:28.247 ******** 2026-08-18 11:50:31.144228 | mon1 | ok: [mon1] 2026-08-18 11:50:31.144316 | mon1 | ok: [mon2] 2026-08-18 11:50:31.144409 | mon1 | ok: [mon3] 2026-08-18 11:50:31.144522 | mon1 | 2026-08-18 11:50:31.144633 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:50:31.144723 | mon1 | Tuesday 18 August 2026 11:50:31 +0000 (0:00:00.070) 0:00:28.318 ******** 2026-08-18 11:50:31.245897 | mon1 | ok: [mon1] 2026-08-18 11:50:31.246077 | mon1 | ok: [mon2] 2026-08-18 11:50:31.246326 | mon1 | ok: [mon3] 2026-08-18 11:50:31.246526 | mon1 | 2026-08-18 11:50:31.246770 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:50:31.247029 | mon1 | Tuesday 18 August 2026 11:50:31 +0000 (0:00:00.101) 0:00:28.419 ******** 2026-08-18 11:50:31.334077 | mon1 | ok: [mon1] => { 2026-08-18 11:50:31.334276 | mon1 | "changed": false, 2026-08-18 11:50:31.334488 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:31.334686 | mon1 | } 2026-08-18 11:50:31.334888 | mon1 | ok: [mon2] => { 2026-08-18 11:50:31.335161 | mon1 | "changed": false, 2026-08-18 11:50:31.335349 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:31.335549 | mon1 | } 2026-08-18 11:50:31.335735 | mon1 | ok: [mon3] => { 2026-08-18 11:50:31.335928 | mon1 | "changed": false, 2026-08-18 11:50:31.336126 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:31.336314 | mon1 | } 2026-08-18 11:50:31.336496 | mon1 | 2026-08-18 11:50:31.336705 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:50:31.336907 | mon1 | Tuesday 18 August 2026 11:50:31 +0000 (0:00:00.088) 0:00:28.508 ******** 2026-08-18 11:50:33.079962 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:33.080067 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:33.080601 | mon1 | ok: [mon1] 2026-08-18 11:50:33.080685 | mon1 | 2026-08-18 11:50:33.080694 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:50:33.080701 | mon1 | Tuesday 18 August 2026 11:50:33 +0000 (0:00:01.746) 0:00:30.254 ******** 2026-08-18 11:50:33.186607 | mon1 | skipping: [mon1] 2026-08-18 11:50:33.186692 | mon1 | skipping: [mon2] 2026-08-18 11:50:33.186762 | mon1 | skipping: [mon3] 2026-08-18 11:50:33.187113 | mon1 | 2026-08-18 11:50:33.187166 | mon1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 11:50:33.187178 | mon1 | Tuesday 18 August 2026 11:50:33 +0000 (0:00:00.106) 0:00:30.360 ******** 2026-08-18 11:50:35.149776 | mon1 | ok: [mon1] 2026-08-18 11:50:35.149864 | mon1 | 2026-08-18 11:50:35.150183 | mon1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 11:50:35.150258 | mon1 | Tuesday 18 August 2026 11:50:35 +0000 (0:00:01.962) 0:00:32.323 ******** 2026-08-18 11:50:36.873577 | mon1 | ok: [mon1] 2026-08-18 11:50:36.873685 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:36.873697 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:36.874025 | mon1 | 2026-08-18 11:50:36.874091 | mon1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 11:50:36.874097 | mon1 | Tuesday 18 August 2026 11:50:36 +0000 (0:00:01.724) 0:00:34.047 ******** 2026-08-18 11:50:37.508585 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:50:37.508681 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:50:37.508696 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:50:37.509038 | mon1 | 2026-08-18 11:50:37.509105 | mon1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 11:50:37.509110 | mon1 | Tuesday 18 August 2026 11:50:37 +0000 (0:00:00.634) 0:00:34.682 ******** 2026-08-18 11:50:37.599111 | mon1 | ok: [mon1] 2026-08-18 11:50:37.599175 | mon1 | ok: [mon2] 2026-08-18 11:50:37.599275 | mon1 | ok: [mon3] 2026-08-18 11:50:37.599379 | mon1 | 2026-08-18 11:50:37.599484 | mon1 | TASK [Register this manager host] ********************************************** 2026-08-18 11:50:37.599583 | mon1 | Tuesday 18 August 2026 11:50:37 +0000 (0:00:00.090) 0:00:34.773 ******** 2026-08-18 11:50:37.738664 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3 2026-08-18 11:50:37.738826 | mon1 | 2026-08-18 11:50:37.739084 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:50:37.739330 | mon1 | Tuesday 18 August 2026 11:50:37 +0000 (0:00:00.139) 0:00:34.912 ******** 2026-08-18 11:50:39.214056 | mon1 | ok: [mon1] 2026-08-18 11:50:39.214161 | mon1 | 2026-08-18 11:50:39.214173 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:50:39.214184 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:01.473) 0:00:36.386 ******** 2026-08-18 11:50:39.287166 | mon1 | ok: [mon1] 2026-08-18 11:50:39.287320 | mon1 | ok: [mon2] 2026-08-18 11:50:39.287516 | mon1 | ok: [mon3] 2026-08-18 11:50:39.287730 | mon1 | 2026-08-18 11:50:39.287938 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:50:39.288141 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.075) 0:00:36.461 ******** 2026-08-18 11:50:39.356095 | mon1 | ok: [mon1] => { 2026-08-18 11:50:39.356284 | mon1 | "changed": false, 2026-08-18 11:50:39.356483 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.356674 | mon1 | } 2026-08-18 11:50:39.356870 | mon1 | ok: [mon2] => { 2026-08-18 11:50:39.357063 | mon1 | "changed": false, 2026-08-18 11:50:39.357262 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.357446 | mon1 | } 2026-08-18 11:50:39.357638 | mon1 | ok: [mon3] => { 2026-08-18 11:50:39.357828 | mon1 | "changed": false, 2026-08-18 11:50:39.358021 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.358205 | mon1 | } 2026-08-18 11:50:39.358386 | mon1 | 2026-08-18 11:50:39.358599 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:50:39.358798 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.069) 0:00:36.530 ******** 2026-08-18 11:50:39.646340 | mon1 | ok: [mon2] 2026-08-18 11:50:39.646525 | mon1 | ok: [mon1] 2026-08-18 11:50:39.646726 | mon1 | ok: [mon3] 2026-08-18 11:50:39.646915 | mon1 | 2026-08-18 11:50:39.647296 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:50:39.647500 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.289) 0:00:36.819 ******** 2026-08-18 11:50:39.736675 | mon1 | ok: [mon1] 2026-08-18 11:50:39.736843 | mon1 | ok: [mon2] 2026-08-18 11:50:39.737035 | mon1 | ok: [mon3] 2026-08-18 11:50:39.737214 | mon1 | 2026-08-18 11:50:39.737428 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:50:39.737629 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.090) 0:00:36.910 ******** 2026-08-18 11:50:39.846535 | mon1 | ok: [mon1] 2026-08-18 11:50:39.846722 | mon1 | ok: [mon2] 2026-08-18 11:50:39.846923 | mon1 | ok: [mon3] 2026-08-18 11:50:39.847143 | mon1 | 2026-08-18 11:50:39.847363 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:50:39.847569 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.110) 0:00:37.020 ******** 2026-08-18 11:50:39.916590 | mon1 | ok: [mon1] => { 2026-08-18 11:50:39.916783 | mon1 | "changed": false, 2026-08-18 11:50:39.916989 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.917184 | mon1 | } 2026-08-18 11:50:39.917385 | mon1 | ok: [mon2] => { 2026-08-18 11:50:39.917578 | mon1 | "changed": false, 2026-08-18 11:50:39.917778 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.917967 | mon1 | } 2026-08-18 11:50:39.918164 | mon1 | ok: [mon3] => { 2026-08-18 11:50:39.918360 | mon1 | "changed": false, 2026-08-18 11:50:39.918558 | mon1 | "msg": "All assertions passed" 2026-08-18 11:50:39.918756 | mon1 | } 2026-08-18 11:50:39.918937 | mon1 | 2026-08-18 11:50:39.919179 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:50:39.919385 | mon1 | Tuesday 18 August 2026 11:50:39 +0000 (0:00:00.070) 0:00:37.090 ******** 2026-08-18 11:50:41.562142 | mon1 | ok: [mon1] 2026-08-18 11:50:41.562225 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:41.562237 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:41.562247 | mon1 | 2026-08-18 11:50:41.562257 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:50:41.562266 | mon1 | Tuesday 18 August 2026 11:50:41 +0000 (0:00:01.643) 0:00:38.734 ******** 2026-08-18 11:50:41.665698 | mon1 | skipping: [mon1] 2026-08-18 11:50:41.665768 | mon1 | skipping: [mon2] 2026-08-18 11:50:41.666351 | mon1 | skipping: [mon3] 2026-08-18 11:50:41.666400 | mon1 | 2026-08-18 11:50:41.666408 | mon1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 11:50:41.666415 | mon1 | Tuesday 18 August 2026 11:50:41 +0000 (0:00:00.104) 0:00:38.839 ******** 2026-08-18 11:50:43.282344 | mon1 | ok: [mon1] 2026-08-18 11:50:43.283033 | mon1 | 2026-08-18 11:50:43.283096 | mon1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 11:50:43.283107 | mon1 | Tuesday 18 August 2026 11:50:43 +0000 (0:00:01.616) 0:00:40.455 ******** 2026-08-18 11:50:44.909427 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:44.909495 | mon1 | ok: [mon1] 2026-08-18 11:50:44.909584 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:50:44.909887 | mon1 | 2026-08-18 11:50:44.909932 | mon1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 11:50:44.909943 | mon1 | Tuesday 18 August 2026 11:50:44 +0000 (0:00:01.628) 0:00:42.083 ******** 2026-08-18 11:50:52.920326 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-18 11:50:52.920376 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-18 11:50:52.920382 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-18 11:50:52.920386 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-18 11:50:52.920390 | mon1 | 2026-08-18 11:50:52.920395 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 11:50:52.920399 | mon1 | 2026-08-18 11:50:52.920403 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:50:52.920407 | mon1 | Tuesday 18 August 2026 11:50:52 +0000 (0:00:08.010) 0:00:50.094 ******** 2026-08-18 11:50:54.064207 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-18 11:50:54.065069 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:50:54.065182 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:50:54.065195 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:50:54.065206 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:50:54.118396 | mon1 | ok: [mon2] 2026-08-18 11:50:54.118480 | mon1 | ok: [mon3] 2026-08-18 11:50:54.119001 | mon1 | ok: [mon1] 2026-08-18 11:50:54.119068 | mon1 | ok: [osd1] 2026-08-18 11:50:54.119074 | mon1 | 2026-08-18 11:50:54.119086 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:50:54.119092 | mon1 | Tuesday 18 August 2026 11:50:54 +0000 (0:00:01.198) 0:00:51.292 ******** 2026-08-18 11:50:54.366913 | mon1 | ok: [mon1] 2026-08-18 11:50:54.367074 | mon1 | ok: [mon2] 2026-08-18 11:50:54.367106 | mon1 | ok: [mon3] 2026-08-18 11:50:54.367465 | mon1 | ok: [osd1] 2026-08-18 11:50:54.367521 | mon1 | 2026-08-18 11:50:54.367527 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:54.367533 | mon1 | Tuesday 18 August 2026 11:50:54 +0000 (0:00:00.249) 0:00:51.541 ******** 2026-08-18 11:50:54.402472 | mon1 | skipping: [mon1] 2026-08-18 11:50:54.475408 | mon1 | skipping: [mon2] 2026-08-18 11:50:54.475909 | mon1 | skipping: [mon3] 2026-08-18 11:50:54.475960 | mon1 | skipping: [osd1] 2026-08-18 11:50:54.475965 | mon1 | 2026-08-18 11:50:54.475971 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:50:54.475975 | mon1 | Tuesday 18 August 2026 11:50:54 +0000 (0:00:00.108) 0:00:51.649 ******** 2026-08-18 11:50:54.751793 | mon1 | ok: [mon2] 2026-08-18 11:50:54.751906 | mon1 | ok: [mon3] 2026-08-18 11:50:54.751932 | mon1 | ok: [mon1] 2026-08-18 11:50:54.752004 | mon1 | ok: [osd1] 2026-08-18 11:50:54.752369 | mon1 | 2026-08-18 11:50:54.752444 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:54.752451 | mon1 | Tuesday 18 August 2026 11:50:54 +0000 (0:00:00.276) 0:00:51.925 ******** 2026-08-18 11:50:54.880468 | mon1 | ok: [mon1] => { 2026-08-18 11:50:54.880580 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:54.882193 | mon1 | } 2026-08-18 11:50:54.882257 | mon1 | ok: [mon2] => { 2026-08-18 11:50:54.882265 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:54.882272 | mon1 | } 2026-08-18 11:50:54.882278 | mon1 | ok: [mon3] => { 2026-08-18 11:50:54.882284 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:54.882289 | mon1 | } 2026-08-18 11:50:54.882294 | mon1 | ok: [osd1] => { 2026-08-18 11:50:54.882300 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:50:54.882305 | mon1 | } 2026-08-18 11:50:54.882311 | mon1 | 2026-08-18 11:50:54.882317 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:54.882324 | mon1 | Tuesday 18 August 2026 11:50:54 +0000 (0:00:00.128) 0:00:52.054 ******** 2026-08-18 11:50:55.242659 | mon1 | ok: [mon1] 2026-08-18 11:50:55.242762 | mon1 | ok: [mon2] 2026-08-18 11:50:55.243084 | mon1 | ok: [mon3] 2026-08-18 11:50:55.243158 | mon1 | ok: [osd1] 2026-08-18 11:50:55.243178 | mon1 | 2026-08-18 11:50:55.243420 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:55.243762 | mon1 | Tuesday 18 August 2026 11:50:55 +0000 (0:00:00.362) 0:00:52.416 ******** 2026-08-18 11:50:55.291593 | mon1 | skipping: [mon1] 2026-08-18 11:50:55.369765 | mon1 | skipping: [mon2] 2026-08-18 11:50:55.369845 | mon1 | skipping: [mon3] 2026-08-18 11:50:55.369860 | mon1 | skipping: [osd1] 2026-08-18 11:50:55.370126 | mon1 | 2026-08-18 11:50:55.370142 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:55.370148 | mon1 | Tuesday 18 August 2026 11:50:55 +0000 (0:00:00.127) 0:00:52.543 ******** 2026-08-18 11:50:55.405765 | mon1 | skipping: [mon1] 2026-08-18 11:50:55.500245 | mon1 | skipping: [mon2] 2026-08-18 11:50:55.500349 | mon1 | skipping: [mon3] 2026-08-18 11:50:55.500359 | mon1 | skipping: [osd1] 2026-08-18 11:50:55.500414 | mon1 | 2026-08-18 11:50:55.500608 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:50:55.500625 | mon1 | Tuesday 18 August 2026 11:50:55 +0000 (0:00:00.130) 0:00:52.674 ******** 2026-08-18 11:50:55.761394 | mon1 | ok: [mon2] 2026-08-18 11:50:55.761504 | mon1 | ok: [mon1] 2026-08-18 11:50:55.761563 | mon1 | ok: [mon3] 2026-08-18 11:50:55.761637 | mon1 | ok: [osd1] 2026-08-18 11:50:55.761722 | mon1 | 2026-08-18 11:50:55.761824 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:50:55.761914 | mon1 | Tuesday 18 August 2026 11:50:55 +0000 (0:00:00.261) 0:00:52.935 ******** 2026-08-18 11:50:57.048553 | mon1 | ok: [mon2] 2026-08-18 11:50:57.048683 | mon1 | ok: [mon3] 2026-08-18 11:50:57.048695 | mon1 | ok: [osd1] 2026-08-18 11:50:57.048706 | mon1 | ok: [mon1] 2026-08-18 11:50:57.048804 | mon1 | 2026-08-18 11:50:57.048900 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:50:57.049000 | mon1 | Tuesday 18 August 2026 11:50:57 +0000 (0:00:01.287) 0:00:54.222 ******** 2026-08-18 11:50:57.177322 | mon1 | ok: [mon1] => { 2026-08-18 11:50:57.177493 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:57.177703 | mon1 | } 2026-08-18 11:50:57.177894 | mon1 | ok: [mon2] => { 2026-08-18 11:50:57.178104 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:57.178291 | mon1 | } 2026-08-18 11:50:57.178484 | mon1 | ok: [mon3] => { 2026-08-18 11:50:57.178695 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:57.178882 | mon1 | } 2026-08-18 11:50:57.179195 | mon1 | ok: [osd1] => { 2026-08-18 11:50:57.179412 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:50:57.179606 | mon1 | } 2026-08-18 11:50:57.179787 | mon1 | 2026-08-18 11:50:57.180021 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:50:57.180314 | mon1 | Tuesday 18 August 2026 11:50:57 +0000 (0:00:00.128) 0:00:54.351 ******** 2026-08-18 11:50:57.575265 | mon1 | ok: [mon1] 2026-08-18 11:50:57.575376 | mon1 | ok: [mon2] 2026-08-18 11:50:57.575621 | mon1 | ok: [osd1] 2026-08-18 11:50:57.575815 | mon1 | ok: [mon3] 2026-08-18 11:50:57.575991 | mon1 | 2026-08-18 11:50:57.576187 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:50:57.576610 | mon1 | Tuesday 18 August 2026 11:50:57 +0000 (0:00:00.397) 0:00:54.748 ******** 2026-08-18 11:50:59.601675 | mon1 | ok: [osd1] 2026-08-18 11:50:59.601848 | mon1 | ok: [mon3] 2026-08-18 11:50:59.602059 | mon1 | ok: [mon2] 2026-08-18 11:50:59.602262 | mon1 | ok: [mon1] 2026-08-18 11:50:59.602453 | mon1 | 2026-08-18 11:50:59.602673 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:50:59.602915 | mon1 | Tuesday 18 August 2026 11:50:59 +0000 (0:00:02.026) 0:00:56.775 ******** 2026-08-18 11:50:59.642382 | mon1 | skipping: [mon1] 2026-08-18 11:50:59.673358 | mon1 | skipping: [mon2] 2026-08-18 11:50:59.673546 | mon1 | skipping: [mon3] 2026-08-18 11:50:59.673745 | mon1 | skipping: [osd1] 2026-08-18 11:50:59.673965 | mon1 | 2026-08-18 11:50:59.674182 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:50:59.674389 | mon1 | Tuesday 18 August 2026 11:50:59 +0000 (0:00:00.072) 0:00:56.847 ******** 2026-08-18 11:50:59.706670 | mon1 | skipping: [mon1] 2026-08-18 11:50:59.756110 | mon1 | skipping: [mon2] 2026-08-18 11:50:59.756309 | mon1 | skipping: [mon3] 2026-08-18 11:50:59.756525 | mon1 | skipping: [osd1] 2026-08-18 11:50:59.756726 | mon1 | 2026-08-18 11:50:59.756987 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:50:59.757205 | mon1 | Tuesday 18 August 2026 11:50:59 +0000 (0:00:00.082) 0:00:56.929 ******** 2026-08-18 11:50:59.800908 | mon1 | skipping: [mon1] 2026-08-18 11:50:59.827930 | mon1 | skipping: [mon2] 2026-08-18 11:50:59.828122 | mon1 | skipping: [mon3] 2026-08-18 11:50:59.828339 | mon1 | skipping: [osd1] 2026-08-18 11:50:59.828503 | mon1 | 2026-08-18 11:50:59.828717 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:50:59.828953 | mon1 | Tuesday 18 August 2026 11:50:59 +0000 (0:00:00.071) 0:00:57.001 ******** 2026-08-18 11:51:01.121765 | mon1 | ok: [mon3] 2026-08-18 11:51:01.121834 | mon1 | ok: [mon2] 2026-08-18 11:51:01.121848 | mon1 | ok: [osd1] 2026-08-18 11:51:01.121860 | mon1 | ok: [mon1] 2026-08-18 11:51:01.121870 | mon1 | 2026-08-18 11:51:01.121882 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:51:01.121893 | mon1 | Tuesday 18 August 2026 11:51:01 +0000 (0:00:01.292) 0:00:58.294 ******** 2026-08-18 11:51:01.610455 | mon1 | ok: [mon2] 2026-08-18 11:51:01.610587 | mon1 | ok: [osd1] 2026-08-18 11:51:01.610598 | mon1 | ok: [mon1] 2026-08-18 11:51:01.610663 | mon1 | ok: [mon3] 2026-08-18 11:51:01.611047 | mon1 | 2026-08-18 11:51:01.611116 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:51:01.611124 | mon1 | Tuesday 18 August 2026 11:51:01 +0000 (0:00:00.490) 0:00:58.784 ******** 2026-08-18 11:51:02.590311 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:02.590393 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:02.590400 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:02.590407 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:02.590413 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:02.590422 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:02.590428 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:02.590453 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:02.590460 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:02.590466 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:02.590472 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:02.590478 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:02.590484 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:02.590490 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:02.590496 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:02.590502 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:02.590508 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:02.590515 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:02.590521 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:02.590527 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:02.590533 | mon1 | 2026-08-18 11:51:02.590540 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:51:02.590546 | mon1 | Tuesday 18 August 2026 11:51:02 +0000 (0:00:00.976) 0:00:59.760 ******** 2026-08-18 11:51:03.205163 | mon1 | ok: [mon1] 2026-08-18 11:51:03.205265 | mon1 | ok: [mon2] 2026-08-18 11:51:03.205276 | mon1 | ok: [mon3] 2026-08-18 11:51:03.205315 | mon1 | ok: [osd1] 2026-08-18 11:51:03.206739 | mon1 | 2026-08-18 11:51:03.206824 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:03.206831 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.592) 0:01:00.353 ******** 2026-08-18 11:51:03.206836 | mon1 | 2026-08-18 11:51:03.206840 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:03.206844 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.007) 0:01:00.361 ******** 2026-08-18 11:51:03.206848 | mon1 | 2026-08-18 11:51:03.206852 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:03.206856 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.007) 0:01:00.368 ******** 2026-08-18 11:51:03.206860 | mon1 | 2026-08-18 11:51:03.206864 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:03.206869 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.005) 0:01:00.373 ******** 2026-08-18 11:51:03.206873 | mon1 | 2026-08-18 11:51:03.206877 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:51:03.206881 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.005) 0:01:00.379 ******** 2026-08-18 11:51:03.627921 | mon1 | ok: [mon1] 2026-08-18 11:51:03.628054 | mon1 | ok: [mon2] 2026-08-18 11:51:03.628067 | mon1 | ok: [mon3] 2026-08-18 11:51:03.628082 | mon1 | ok: [osd1] 2026-08-18 11:51:03.628436 | mon1 | 2026-08-18 11:51:03.628516 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:03.628523 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.422) 0:01:00.801 ******** 2026-08-18 11:51:03.910661 | mon1 | ok: [mon1] 2026-08-18 11:51:03.910751 | mon1 | ok: [mon2] 2026-08-18 11:51:03.910760 | mon1 | ok: [mon3] 2026-08-18 11:51:03.910767 | mon1 | ok: [osd1] 2026-08-18 11:51:03.910773 | mon1 | 2026-08-18 11:51:03.910781 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:03.910789 | mon1 | Tuesday 18 August 2026 11:51:03 +0000 (0:00:00.281) 0:01:01.083 ******** 2026-08-18 11:51:04.031439 | mon1 | ok: [mon1] => { 2026-08-18 11:51:04.031513 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:04.031539 | mon1 | } 2026-08-18 11:51:04.031543 | mon1 | ok: [mon2] => { 2026-08-18 11:51:04.031547 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:04.031551 | mon1 | } 2026-08-18 11:51:04.031555 | mon1 | ok: [mon3] => { 2026-08-18 11:51:04.031560 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:04.031563 | mon1 | } 2026-08-18 11:51:04.031567 | mon1 | ok: [osd1] => { 2026-08-18 11:51:04.031571 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:04.031575 | mon1 | } 2026-08-18 11:51:04.031579 | mon1 | 2026-08-18 11:51:04.031584 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:04.031593 | mon1 | Tuesday 18 August 2026 11:51:04 +0000 (0:00:00.120) 0:01:01.204 ******** 2026-08-18 11:51:04.422735 | mon1 | ok: [mon1] 2026-08-18 11:51:04.422849 | mon1 | ok: [mon2] 2026-08-18 11:51:04.422860 | mon1 | ok: [mon3] 2026-08-18 11:51:04.422977 | mon1 | ok: [osd1] 2026-08-18 11:51:04.423280 | mon1 | 2026-08-18 11:51:04.423335 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:04.423342 | mon1 | Tuesday 18 August 2026 11:51:04 +0000 (0:00:00.393) 0:01:01.597 ******** 2026-08-18 11:51:07.615595 | mon1 | ok: [mon2] 2026-08-18 11:51:07.615662 | mon1 | ok: [osd1] 2026-08-18 11:51:07.616093 | mon1 | ok: [mon3] 2026-08-18 11:51:07.616373 | mon1 | ok: [mon1] 2026-08-18 11:51:07.616380 | mon1 | 2026-08-18 11:51:07.616385 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:51:07.616389 | mon1 | Tuesday 18 August 2026 11:51:07 +0000 (0:00:03.192) 0:01:04.789 ******** 2026-08-18 11:51:08.837486 | mon1 | ok: [mon2] 2026-08-18 11:51:08.837565 | mon1 | ok: [mon3] 2026-08-18 11:51:08.838342 | mon1 | ok: [osd1] 2026-08-18 11:51:08.838422 | mon1 | ok: [mon1] 2026-08-18 11:51:08.838432 | mon1 | 2026-08-18 11:51:08.838442 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:51:08.838452 | mon1 | Tuesday 18 August 2026 11:51:08 +0000 (0:00:01.221) 0:01:06.011 ******** 2026-08-18 11:51:09.084201 | mon1 | ok: [mon1] 2026-08-18 11:51:09.084314 | mon1 | ok: [mon2] 2026-08-18 11:51:09.085011 | mon1 | ok: [mon3] 2026-08-18 11:51:09.085073 | mon1 | ok: [osd1] 2026-08-18 11:51:09.085082 | mon1 | 2026-08-18 11:51:09.085091 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:51:09.085098 | mon1 | Tuesday 18 August 2026 11:51:09 +0000 (0:00:00.247) 0:01:06.258 ******** 2026-08-18 11:51:09.572611 | mon1 | ok: [mon2] 2026-08-18 11:51:09.572667 | mon1 | ok: [mon3] 2026-08-18 11:51:09.572743 | mon1 | ok: [mon1] 2026-08-18 11:51:09.573132 | mon1 | ok: [osd1] 2026-08-18 11:51:09.573179 | mon1 | 2026-08-18 11:51:09.573185 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:51:09.573190 | mon1 | Tuesday 18 August 2026 11:51:09 +0000 (0:00:00.488) 0:01:06.746 ******** 2026-08-18 11:51:10.174515 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:10.174582 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:10.174991 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:10.175006 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:10.175011 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:10.175017 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:10.175844 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:10.175855 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:10.175860 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:10.175865 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:10.175869 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:10.175872 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:10.175877 | mon1 | 2026-08-18 11:51:10.175881 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:51:10.175897 | mon1 | Tuesday 18 August 2026 11:51:10 +0000 (0:00:00.601) 0:01:07.348 ******** 2026-08-18 11:51:10.646970 | mon1 | ok: [mon2] 2026-08-18 11:51:10.647104 | mon1 | ok: [mon3] 2026-08-18 11:51:10.647798 | mon1 | ok: [osd1] 2026-08-18 11:51:10.647862 | mon1 | ok: [mon1] 2026-08-18 11:51:10.647870 | mon1 | 2026-08-18 11:51:10.647877 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:51:10.647884 | mon1 | Tuesday 18 August 2026 11:51:10 +0000 (0:00:00.472) 0:01:07.821 ******** 2026-08-18 11:51:11.154587 | mon1 | ok: [mon2] 2026-08-18 11:51:11.154630 | mon1 | ok: [mon3] 2026-08-18 11:51:11.154635 | mon1 | ok: [mon1] 2026-08-18 11:51:11.154639 | mon1 | ok: [osd1] 2026-08-18 11:51:11.154643 | mon1 | 2026-08-18 11:51:11.154648 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:11.154653 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.482) 0:01:08.303 ******** 2026-08-18 11:51:11.154657 | mon1 | 2026-08-18 11:51:11.154661 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:11.154665 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.007) 0:01:08.310 ******** 2026-08-18 11:51:11.154669 | mon1 | 2026-08-18 11:51:11.154673 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:11.154677 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.005) 0:01:08.316 ******** 2026-08-18 11:51:11.154680 | mon1 | 2026-08-18 11:51:11.154684 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:11.154688 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.005) 0:01:08.322 ******** 2026-08-18 11:51:11.154692 | mon1 | 2026-08-18 11:51:11.154696 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:51:11.154700 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.005) 0:01:08.327 ******** 2026-08-18 11:51:11.577701 | mon1 | ok: [mon2] 2026-08-18 11:51:11.577768 | mon1 | ok: [mon1] 2026-08-18 11:51:11.578245 | mon1 | ok: [mon3] 2026-08-18 11:51:11.578292 | mon1 | ok: [osd1] 2026-08-18 11:51:11.578298 | mon1 | 2026-08-18 11:51:11.578303 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:11.578308 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.424) 0:01:08.751 ******** 2026-08-18 11:51:11.620162 | mon1 | ok: [mon1] => { 2026-08-18 11:51:11.620267 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:11.620391 | mon1 | } 2026-08-18 11:51:11.655164 | mon1 | ok: [mon2] => { 2026-08-18 11:51:11.655224 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:11.655314 | mon1 | } 2026-08-18 11:51:11.656042 | mon1 | ok: [mon3] => { 2026-08-18 11:51:11.656152 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:11.656166 | mon1 | } 2026-08-18 11:51:11.656176 | mon1 | ok: [osd1] => { 2026-08-18 11:51:11.656185 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:11.656194 | mon1 | } 2026-08-18 11:51:11.656204 | mon1 | 2026-08-18 11:51:11.656224 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:11.656234 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.078) 0:01:08.829 ******** 2026-08-18 11:51:11.969496 | mon1 | ok: [mon2] 2026-08-18 11:51:11.969563 | mon1 | ok: [mon1] 2026-08-18 11:51:11.970250 | mon1 | ok: [mon3] 2026-08-18 11:51:11.970301 | mon1 | ok: [osd1] 2026-08-18 11:51:11.970309 | mon1 | 2026-08-18 11:51:11.970315 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:11.970322 | mon1 | Tuesday 18 August 2026 11:51:11 +0000 (0:00:00.313) 0:01:09.143 ******** 2026-08-18 11:51:12.005618 | mon1 | skipping: [mon1] 2026-08-18 11:51:12.018410 | mon1 | skipping: [mon2] 2026-08-18 11:51:12.070313 | mon1 | skipping: [mon3] 2026-08-18 11:51:12.070730 | mon1 | skipping: [osd1] 2026-08-18 11:51:12.070857 | mon1 | 2026-08-18 11:51:12.071270 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:51:12.071348 | mon1 | Tuesday 18 August 2026 11:51:12 +0000 (0:00:00.099) 0:01:09.243 ******** 2026-08-18 11:51:12.124868 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:12.171124 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:12.171209 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:12.171222 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:12.171556 | mon1 | 2026-08-18 11:51:12.171612 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:51:12.171619 | mon1 | Tuesday 18 August 2026 11:51:12 +0000 (0:00:00.102) 0:01:09.345 ******** 2026-08-18 11:51:13.394765 | mon1 | ok: [mon3] 2026-08-18 11:51:13.394886 | mon1 | ok: [osd1] 2026-08-18 11:51:13.395046 | mon1 | ok: [mon1] 2026-08-18 11:51:13.395178 | mon1 | ok: [mon2] 2026-08-18 11:51:13.395308 | mon1 | 2026-08-18 11:51:13.395481 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:51:13.395622 | mon1 | Tuesday 18 August 2026 11:51:13 +0000 (0:00:01.223) 0:01:10.568 ******** 2026-08-18 11:51:14.099817 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:51:14.100013 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:51:14.100227 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:51:14.100543 | mon1 | ok: [osd1] => (item=chronyd) 2026-08-18 11:51:14.100825 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:51:14.101044 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:51:14.101373 | mon1 | ok: [osd1] => (item=sshd) 2026-08-18 11:51:14.101702 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:51:14.101959 | mon1 | 2026-08-18 11:51:14.102181 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:51:14.102403 | mon1 | Tuesday 18 August 2026 11:51:14 +0000 (0:00:00.704) 0:01:11.273 ******** 2026-08-18 11:51:14.347159 | mon1 | ok: [mon2] 2026-08-18 11:51:14.347355 | mon1 | ok: [mon1] 2026-08-18 11:51:14.347604 | mon1 | ok: [mon3] 2026-08-18 11:51:14.347789 | mon1 | ok: [osd1] 2026-08-18 11:51:14.347981 | mon1 | 2026-08-18 11:51:14.348202 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:51:14.348409 | mon1 | Tuesday 18 August 2026 11:51:14 +0000 (0:00:00.247) 0:01:11.520 ******** 2026-08-18 11:51:14.633669 | mon1 | ok: [mon2] 2026-08-18 11:51:14.633833 | mon1 | ok: [mon1] 2026-08-18 11:51:14.634056 | mon1 | ok: [mon3] 2026-08-18 11:51:14.634272 | mon1 | ok: [osd1] 2026-08-18 11:51:14.634496 | mon1 | 2026-08-18 11:51:14.634699 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:51:14.635083 | mon1 | Tuesday 18 August 2026 11:51:14 +0000 (0:00:00.286) 0:01:11.807 ******** 2026-08-18 11:51:15.145752 | mon1 | ok: [mon2] 2026-08-18 11:51:15.145973 | mon1 | ok: [mon1] 2026-08-18 11:51:15.146234 | mon1 | ok: [mon3] 2026-08-18 11:51:15.146477 | mon1 | ok: [osd1] 2026-08-18 11:51:15.146705 | mon1 | 2026-08-18 11:51:15.147007 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:51:15.147275 | mon1 | Tuesday 18 August 2026 11:51:15 +0000 (0:00:00.511) 0:01:12.319 ******** 2026-08-18 11:51:15.183167 | mon1 | skipping: [mon1] 2026-08-18 11:51:15.204712 | mon1 | skipping: [mon2] 2026-08-18 11:51:15.204987 | mon1 | skipping: [mon3] 2026-08-18 11:51:15.205239 | mon1 | skipping: [osd1] 2026-08-18 11:51:15.205557 | mon1 | 2026-08-18 11:51:15.205856 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:51:15.206106 | mon1 | Tuesday 18 August 2026 11:51:15 +0000 (0:00:00.059) 0:01:12.379 ******** 2026-08-18 11:51:15.584261 | mon1 | ok: [mon2] 2026-08-18 11:51:15.584475 | mon1 | ok: [mon1] 2026-08-18 11:51:15.584774 | mon1 | ok: [mon3] 2026-08-18 11:51:15.584976 | mon1 | ok: [osd1] 2026-08-18 11:51:15.585179 | mon1 | 2026-08-18 11:51:15.585438 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:51:15.585674 | mon1 | Tuesday 18 August 2026 11:51:15 +0000 (0:00:00.378) 0:01:12.758 ******** 2026-08-18 11:51:16.062796 | mon1 | ok: [mon2] 2026-08-18 11:51:16.062976 | mon1 | ok: [mon3] 2026-08-18 11:51:16.063209 | mon1 | ok: [mon1] 2026-08-18 11:51:16.063421 | mon1 | ok: [osd1] 2026-08-18 11:51:16.063612 | mon1 | 2026-08-18 11:51:16.063835 | mon1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 11:51:16.064047 | mon1 | Tuesday 18 August 2026 11:51:16 +0000 (0:00:00.478) 0:01:13.236 ******** 2026-08-18 11:51:16.655611 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:51:16.655747 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:51:16.655955 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:51:16.656157 | mon1 | 2026-08-18 11:51:16.656389 | mon1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 11:51:16.656611 | mon1 | Tuesday 18 August 2026 11:51:16 +0000 (0:00:00.592) 0:01:13.828 ******** 2026-08-18 11:51:16.741647 | mon1 | ok: [mon1] 2026-08-18 11:51:16.741756 | mon1 | ok: [mon2] 2026-08-18 11:51:16.741950 | mon1 | ok: [mon3] 2026-08-18 11:51:16.742136 | mon1 | ok: [osd1] 2026-08-18 11:51:16.742343 | mon1 | 2026-08-18 11:51:16.742615 | mon1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 11:51:16.742879 | mon1 | Tuesday 18 August 2026 11:51:16 +0000 (0:00:00.087) 0:01:13.915 ******** 2026-08-18 11:51:16.787998 | mon1 | ok: [mon1] 2026-08-18 11:51:16.828794 | mon1 | ok: [mon2] 2026-08-18 11:51:16.828939 | mon1 | ok: [mon3] 2026-08-18 11:51:16.829137 | mon1 | ok: [osd1] 2026-08-18 11:51:16.829325 | mon1 | 2026-08-18 11:51:16.829533 | mon1 | TASK [Register this OSD host] ************************************************** 2026-08-18 11:51:16.829739 | mon1 | Tuesday 18 August 2026 11:51:16 +0000 (0:00:00.086) 0:01:14.002 ******** 2026-08-18 11:51:16.959456 | mon1 | included: vexxhost.ceph.cephadm_host for mon1, mon2, mon3, osd1 2026-08-18 11:51:16.959604 | mon1 | 2026-08-18 11:51:16.959822 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 11:51:16.960047 | mon1 | Tuesday 18 August 2026 11:51:16 +0000 (0:00:00.130) 0:01:14.133 ******** 2026-08-18 11:51:18.500895 | mon1 | ok: [mon1] 2026-08-18 11:51:18.500989 | mon1 | 2026-08-18 11:51:18.501002 | mon1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 11:51:18.501014 | mon1 | Tuesday 18 August 2026 11:51:18 +0000 (0:00:01.540) 0:01:15.673 ******** 2026-08-18 11:51:18.542824 | mon1 | ok: [mon1] 2026-08-18 11:51:18.585889 | mon1 | ok: [mon2] 2026-08-18 11:51:18.585950 | mon1 | ok: [mon3] 2026-08-18 11:51:18.586339 | mon1 | ok: [osd1] 2026-08-18 11:51:18.586395 | mon1 | 2026-08-18 11:51:18.586401 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 11:51:18.586407 | mon1 | Tuesday 18 August 2026 11:51:18 +0000 (0:00:00.086) 0:01:15.759 ******** 2026-08-18 11:51:18.631276 | mon1 | ok: [mon1] => { 2026-08-18 11:51:18.631363 | mon1 | "changed": false, 2026-08-18 11:51:18.631616 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:18.631684 | mon1 | } 2026-08-18 11:51:18.677596 | mon1 | ok: [mon2] => { 2026-08-18 11:51:18.679171 | mon1 | "changed": false, 2026-08-18 11:51:18.679292 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:18.679306 | mon1 | } 2026-08-18 11:51:18.679315 | mon1 | ok: [mon3] => { 2026-08-18 11:51:18.679324 | mon1 | "changed": false, 2026-08-18 11:51:18.679333 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:18.679375 | mon1 | } 2026-08-18 11:51:18.679384 | mon1 | ok: [osd1] => { 2026-08-18 11:51:18.679393 | mon1 | "changed": false, 2026-08-18 11:51:18.679402 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:18.679411 | mon1 | } 2026-08-18 11:51:18.679432 | mon1 | 2026-08-18 11:51:18.679441 | mon1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 11:51:18.679454 | mon1 | Tuesday 18 August 2026 11:51:18 +0000 (0:00:00.091) 0:01:15.851 ******** 2026-08-18 11:51:19.004490 | mon1 | ok: [mon2] 2026-08-18 11:51:19.004608 | mon1 | ok: [mon1] 2026-08-18 11:51:19.004620 | mon1 | ok: [mon3] 2026-08-18 11:51:19.005157 | mon1 | ok: [osd1] 2026-08-18 11:51:19.005241 | mon1 | 2026-08-18 11:51:19.005249 | mon1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 11:51:19.005276 | mon1 | Tuesday 18 August 2026 11:51:19 +0000 (0:00:00.327) 0:01:16.178 ******** 2026-08-18 11:51:19.053867 | mon1 | ok: [mon1] 2026-08-18 11:51:19.092854 | mon1 | ok: [mon2] 2026-08-18 11:51:19.092930 | mon1 | ok: [mon3] 2026-08-18 11:51:19.093387 | mon1 | ok: [osd1] 2026-08-18 11:51:19.093467 | mon1 | 2026-08-18 11:51:19.093475 | mon1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 11:51:19.093483 | mon1 | Tuesday 18 August 2026 11:51:19 +0000 (0:00:00.088) 0:01:16.267 ******** 2026-08-18 11:51:19.221089 | mon1 | ok: [mon1] 2026-08-18 11:51:19.221183 | mon1 | ok: [mon2] 2026-08-18 11:51:19.221877 | mon1 | ok: [mon3] 2026-08-18 11:51:19.221949 | mon1 | ok: [osd1] 2026-08-18 11:51:19.221956 | mon1 | 2026-08-18 11:51:19.221964 | mon1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 11:51:19.221971 | mon1 | Tuesday 18 August 2026 11:51:19 +0000 (0:00:00.127) 0:01:16.394 ******** 2026-08-18 11:51:19.281973 | mon1 | ok: [mon1] => { 2026-08-18 11:51:19.282402 | mon1 | "changed": false, 2026-08-18 11:51:19.282466 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:19.282475 | mon1 | } 2026-08-18 11:51:19.330143 | mon1 | ok: [mon2] => { 2026-08-18 11:51:19.331032 | mon1 | "changed": false, 2026-08-18 11:51:19.331086 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:19.331095 | mon1 | } 2026-08-18 11:51:19.331101 | mon1 | ok: [mon3] => { 2026-08-18 11:51:19.331107 | mon1 | "changed": false, 2026-08-18 11:51:19.332242 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:19.332261 | mon1 | } 2026-08-18 11:51:19.332267 | mon1 | ok: [osd1] => { 2026-08-18 11:51:19.332273 | mon1 | "changed": false, 2026-08-18 11:51:19.332279 | mon1 | "msg": "All assertions passed" 2026-08-18 11:51:19.332284 | mon1 | } 2026-08-18 11:51:19.332290 | mon1 | 2026-08-18 11:51:19.332296 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 11:51:19.332303 | mon1 | Tuesday 18 August 2026 11:51:19 +0000 (0:00:00.109) 0:01:16.503 ******** 2026-08-18 11:51:20.996944 | mon1 | ok: [mon1] 2026-08-18 11:51:20.997037 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:20.997047 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:20.997055 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:20.997063 | mon1 | 2026-08-18 11:51:20.997071 | mon1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 11:51:20.997079 | mon1 | Tuesday 18 August 2026 11:51:20 +0000 (0:00:01.665) 0:01:18.169 ******** 2026-08-18 11:51:21.039994 | mon1 | skipping: [mon1] 2026-08-18 11:51:21.111044 | mon1 | skipping: [mon2] 2026-08-18 11:51:21.111121 | mon1 | skipping: [mon3] 2026-08-18 11:51:21.111362 | mon1 | skipping: [osd1] 2026-08-18 11:51:21.111575 | mon1 | 2026-08-18 11:51:21.111816 | mon1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 11:51:21.112051 | mon1 | Tuesday 18 August 2026 11:51:21 +0000 (0:00:00.114) 0:01:18.284 ******** 2026-08-18 11:51:21.143684 | mon1 | skipping: [mon1] 2026-08-18 11:51:21.143976 | mon1 | 2026-08-18 11:51:21.144315 | mon1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 11:51:21.144606 | mon1 | Tuesday 18 August 2026 11:51:21 +0000 (0:00:00.033) 0:01:18.317 ******** 2026-08-18 11:51:22.513167 | mon1 | ok: [mon2] 2026-08-18 11:51:22.513289 | mon1 | ok: [mon3] 2026-08-18 11:51:22.513300 | mon1 | ok: [osd1] 2026-08-18 11:51:22.513309 | mon1 | ok: [mon1] 2026-08-18 11:51:22.513318 | mon1 | 2026-08-18 11:51:22.513329 | mon1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 11:51:22.513340 | mon1 | Tuesday 18 August 2026 11:51:22 +0000 (0:00:01.368) 0:01:19.685 ******** 2026-08-18 11:51:22.550322 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd0/data) 2026-08-18 11:51:22.620462 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd0/data) 2026-08-18 11:51:22.620576 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd1/data) 2026-08-18 11:51:22.620590 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd1/data) 2026-08-18 11:51:22.620808 | mon1 | skipping: [mon1] => (item=/dev/ceph-mon1-osd2/data) 2026-08-18 11:51:22.621226 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd0/data) 2026-08-18 11:51:22.621262 | mon1 | skipping: [mon1] 2026-08-18 11:51:22.621274 | mon1 | skipping: [mon2] => (item=/dev/ceph-mon2-osd2/data) 2026-08-18 11:51:22.621286 | mon1 | skipping: [mon2] 2026-08-18 11:51:22.621317 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd1/data) 2026-08-18 11:51:22.621329 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-18 11:51:22.621343 | mon1 | skipping: [mon3] => (item=/dev/ceph-mon3-osd2/data) 2026-08-18 11:51:22.621385 | mon1 | skipping: [mon3] 2026-08-18 11:51:22.621777 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-18 11:51:22.621851 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-18 11:51:22.621863 | mon1 | skipping: [osd1] 2026-08-18 11:51:22.621882 | mon1 | 2026-08-18 11:51:22.621892 | mon1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 11:51:22.621905 | mon1 | Tuesday 18 August 2026 11:51:22 +0000 (0:00:00.109) 0:01:19.794 ******** 2026-08-18 11:51:24.374692 | mon1 | ok: [mon2 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:24.374801 | mon1 | ok: [mon1] 2026-08-18 11:51:24.375093 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:24.375183 | mon1 | ok: [mon3 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-18 11:51:24.375605 | mon1 | 2026-08-18 11:51:24.375650 | mon1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 11:51:24.375657 | mon1 | Tuesday 18 August 2026 11:51:24 +0000 (0:00:01.753) 0:01:21.548 ******** 2026-08-18 11:51:24.447261 | mon1 | skipping: [mon1] 2026-08-18 11:51:24.447763 | mon1 | 2026-08-18 11:51:24.447809 | mon1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 11:51:24.447815 | mon1 | 2026-08-18 11:51:24.447819 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:51:24.447824 | mon1 | Tuesday 18 August 2026 11:51:24 +0000 (0:00:00.072) 0:01:21.621 ******** 2026-08-18 11:51:25.378668 | mon1 | ok: [mon1] 2026-08-18 11:51:25.378741 | mon1 | ok: [mon3] 2026-08-18 11:51:25.379001 | mon1 | ok: [mon2] 2026-08-18 11:51:25.379042 | mon1 | 2026-08-18 11:51:25.379207 | mon1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 11:51:25.379218 | mon1 | Tuesday 18 August 2026 11:51:25 +0000 (0:00:00.930) 0:01:22.552 ******** 2026-08-18 11:51:25.948299 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:51:25.948382 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:51:25.948407 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:51:25.948417 | mon1 | 2026-08-18 11:51:25.948427 | mon1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 11:51:25.948437 | mon1 | Tuesday 18 August 2026 11:51:25 +0000 (0:00:00.568) 0:01:23.121 ******** 2026-08-18 11:51:26.013626 | mon1 | ok: [mon1] 2026-08-18 11:51:26.013694 | mon1 | ok: [mon2] 2026-08-18 11:51:26.013706 | mon1 | ok: [mon3] 2026-08-18 11:51:26.013718 | mon1 | 2026-08-18 11:51:26.013731 | mon1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 11:51:26.013744 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.064) 0:01:23.186 ******** 2026-08-18 11:51:26.072724 | mon1 | ok: [mon1] 2026-08-18 11:51:26.072782 | mon1 | ok: [mon2] 2026-08-18 11:51:26.072789 | mon1 | ok: [mon3] 2026-08-18 11:51:26.072796 | mon1 | 2026-08-18 11:51:26.072803 | mon1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 11:51:26.072811 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.059) 0:01:23.245 ******** 2026-08-18 11:51:26.118920 | mon1 | skipping: [mon1] 2026-08-18 11:51:26.119141 | mon1 | skipping: [mon2] 2026-08-18 11:51:26.119371 | mon1 | skipping: [mon3] 2026-08-18 11:51:26.119560 | mon1 | 2026-08-18 11:51:26.119773 | mon1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 11:51:26.119982 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.046) 0:01:23.292 ******** 2026-08-18 11:51:26.145617 | mon1 | skipping: [mon1] 2026-08-18 11:51:26.164943 | mon1 | skipping: [mon2] 2026-08-18 11:51:26.165116 | mon1 | skipping: [mon3] 2026-08-18 11:51:26.165301 | mon1 | 2026-08-18 11:51:26.165558 | mon1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 11:51:26.165766 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.046) 0:01:23.339 ******** 2026-08-18 11:51:26.216761 | mon1 | skipping: [mon1] 2026-08-18 11:51:26.216929 | mon1 | skipping: [mon2] 2026-08-18 11:51:26.217126 | mon1 | skipping: [mon3] 2026-08-18 11:51:26.217317 | mon1 | 2026-08-18 11:51:26.217617 | mon1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 11:51:26.217838 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.051) 0:01:23.390 ******** 2026-08-18 11:51:26.267505 | mon1 | skipping: [mon1] 2026-08-18 11:51:26.267652 | mon1 | skipping: [mon2] 2026-08-18 11:51:26.267851 | mon1 | skipping: [mon3] 2026-08-18 11:51:26.268037 | mon1 | 2026-08-18 11:51:26.268253 | mon1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 11:51:26.268475 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.050) 0:01:23.441 ******** 2026-08-18 11:51:26.317682 | mon1 | skipping: [mon1] 2026-08-18 11:51:26.317837 | mon1 | skipping: [mon2] 2026-08-18 11:51:26.318035 | mon1 | skipping: [mon3] 2026-08-18 11:51:26.318216 | mon1 | 2026-08-18 11:51:26.318436 | mon1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 11:51:26.318650 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.050) 0:01:23.491 ******** 2026-08-18 11:51:26.391816 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for mon1, mon2, mon3 2026-08-18 11:51:26.391983 | mon1 | 2026-08-18 11:51:26.392208 | mon1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 11:51:26.392420 | mon1 | Tuesday 18 August 2026 11:51:26 +0000 (0:00:00.074) 0:01:23.566 ******** 2026-08-18 11:51:28.029029 | mon1 | ok: [mon1] 2026-08-18 11:51:28.029137 | mon1 | 2026-08-18 11:51:28.029151 | mon1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 11:51:28.029162 | mon1 | Tuesday 18 August 2026 11:51:28 +0000 (0:00:01.635) 0:01:25.201 ******** 2026-08-18 11:51:29.730337 | mon1 | ok: [mon1] 2026-08-18 11:51:29.730417 | mon1 | 2026-08-18 11:51:29.730734 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 11:51:29.730788 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:01.702) 0:01:26.904 ******** 2026-08-18 11:51:29.770533 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.770607 | mon1 | 2026-08-18 11:51:29.770841 | mon1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 11:51:29.770992 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.040) 0:01:26.944 ******** 2026-08-18 11:51:29.812723 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.812839 | mon1 | 2026-08-18 11:51:29.813189 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:51:29.813272 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.041) 0:01:26.986 ******** 2026-08-18 11:51:29.854757 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.854858 | mon1 | 2026-08-18 11:51:29.855227 | mon1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 11:51:29.855278 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.042) 0:01:27.028 ******** 2026-08-18 11:51:29.901174 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.901491 | mon1 | 2026-08-18 11:51:29.901532 | mon1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 11:51:29.901539 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.046) 0:01:27.074 ******** 2026-08-18 11:51:29.946134 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.946225 | mon1 | 2026-08-18 11:51:29.946237 | mon1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 11:51:29.946249 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.043) 0:01:27.117 ******** 2026-08-18 11:51:29.998607 | mon1 | skipping: [mon1] => (item=ceph mgr module disable dashboard) 2026-08-18 11:51:29.999086 | mon1 | skipping: [mon1] => (item=ceph mgr module enable dashboard) 2026-08-18 11:51:29.999182 | mon1 | skipping: [mon1] => (item=ceph orch reconfig mgr) 2026-08-18 11:51:29.999237 | mon1 | skipping: [mon1] 2026-08-18 11:51:29.999247 | mon1 | 2026-08-18 11:51:29.999587 | mon1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 11:51:29.999676 | mon1 | Tuesday 18 August 2026 11:51:29 +0000 (0:00:00.054) 0:01:27.172 ******** 2026-08-18 11:51:30.029350 | mon1 | skipping: [mon1] 2026-08-18 11:51:30.098499 | mon1 | skipping: [mon2] 2026-08-18 11:51:30.098574 | mon1 | skipping: [mon3] 2026-08-18 11:51:30.098623 | mon1 | 2026-08-18 11:51:30.099235 | mon1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 11:51:30.099299 | mon1 | 2026-08-18 11:51:30.099306 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:51:30.099311 | mon1 | Tuesday 18 August 2026 11:51:30 +0000 (0:00:00.100) 0:01:27.273 ******** 2026-08-18 11:51:31.075859 | mon1 | ok: [mon1] 2026-08-18 11:51:31.075946 | mon1 | ok: [mon3] 2026-08-18 11:51:31.075958 | mon1 | ok: [mon2] 2026-08-18 11:51:31.076295 | mon1 | 2026-08-18 11:51:31.076371 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:31.076378 | mon1 | Tuesday 18 August 2026 11:51:31 +0000 (0:00:00.976) 0:01:28.249 ******** 2026-08-18 11:51:31.326636 | mon1 | ok: [mon1] 2026-08-18 11:51:31.326752 | mon1 | ok: [mon3] 2026-08-18 11:51:31.326764 | mon1 | ok: [mon2] 2026-08-18 11:51:31.326832 | mon1 | 2026-08-18 11:51:31.327069 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:31.327147 | mon1 | Tuesday 18 August 2026 11:51:31 +0000 (0:00:00.251) 0:01:28.500 ******** 2026-08-18 11:51:31.361980 | mon1 | skipping: [mon1] 2026-08-18 11:51:31.411596 | mon1 | skipping: [mon2] 2026-08-18 11:51:31.411665 | mon1 | skipping: [mon3] 2026-08-18 11:51:31.411671 | mon1 | 2026-08-18 11:51:31.411677 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:51:31.411683 | mon1 | Tuesday 18 August 2026 11:51:31 +0000 (0:00:00.084) 0:01:28.584 ******** 2026-08-18 11:51:31.657562 | mon1 | ok: [mon2] 2026-08-18 11:51:31.657672 | mon1 | ok: [mon1] 2026-08-18 11:51:31.657684 | mon1 | ok: [mon3] 2026-08-18 11:51:31.657753 | mon1 | 2026-08-18 11:51:31.658013 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:31.658070 | mon1 | Tuesday 18 August 2026 11:51:31 +0000 (0:00:00.246) 0:01:28.831 ******** 2026-08-18 11:51:31.777564 | mon1 | ok: [mon1] => { 2026-08-18 11:51:31.777674 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:31.779043 | mon1 | } 2026-08-18 11:51:31.779124 | mon1 | ok: [mon2] => { 2026-08-18 11:51:31.779136 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:31.779146 | mon1 | } 2026-08-18 11:51:31.779155 | mon1 | ok: [mon3] => { 2026-08-18 11:51:31.779164 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:31.779173 | mon1 | } 2026-08-18 11:51:31.779182 | mon1 | 2026-08-18 11:51:31.779199 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:31.779209 | mon1 | Tuesday 18 August 2026 11:51:31 +0000 (0:00:00.119) 0:01:28.951 ******** 2026-08-18 11:51:32.136649 | mon1 | ok: [mon1] 2026-08-18 11:51:32.136721 | mon1 | ok: [mon3] 2026-08-18 11:51:32.137099 | mon1 | ok: [mon2] 2026-08-18 11:51:32.137145 | mon1 | 2026-08-18 11:51:32.137151 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:32.137156 | mon1 | Tuesday 18 August 2026 11:51:32 +0000 (0:00:00.359) 0:01:29.311 ******** 2026-08-18 11:51:32.239690 | mon1 | skipping: [mon1] 2026-08-18 11:51:32.239761 | mon1 | skipping: [mon2] 2026-08-18 11:51:32.240692 | mon1 | skipping: [mon3] 2026-08-18 11:51:32.240731 | mon1 | 2026-08-18 11:51:32.240736 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:32.240741 | mon1 | Tuesday 18 August 2026 11:51:32 +0000 (0:00:00.102) 0:01:29.413 ******** 2026-08-18 11:51:32.328625 | mon1 | skipping: [mon1] 2026-08-18 11:51:32.328664 | mon1 | skipping: [mon2] 2026-08-18 11:51:32.329070 | mon1 | skipping: [mon3] 2026-08-18 11:51:32.329118 | mon1 | 2026-08-18 11:51:32.329124 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:32.329168 | mon1 | Tuesday 18 August 2026 11:51:32 +0000 (0:00:00.088) 0:01:29.502 ******** 2026-08-18 11:51:32.573135 | mon1 | ok: [mon1] 2026-08-18 11:51:32.573204 | mon1 | ok: [mon2] 2026-08-18 11:51:32.573645 | mon1 | ok: [mon3] 2026-08-18 11:51:32.573725 | mon1 | 2026-08-18 11:51:32.573732 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:32.573737 | mon1 | Tuesday 18 August 2026 11:51:32 +0000 (0:00:00.244) 0:01:29.747 ******** 2026-08-18 11:51:33.733442 | mon1 | ok: [mon3] 2026-08-18 11:51:33.733513 | mon1 | ok: [mon2] 2026-08-18 11:51:33.733547 | mon1 | ok: [mon1] 2026-08-18 11:51:33.733874 | mon1 | 2026-08-18 11:51:33.733917 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:33.733922 | mon1 | Tuesday 18 August 2026 11:51:33 +0000 (0:00:01.160) 0:01:30.907 ******** 2026-08-18 11:51:33.852657 | mon1 | ok: [mon1] => { 2026-08-18 11:51:33.852721 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:33.853623 | mon1 | } 2026-08-18 11:51:33.853639 | mon1 | ok: [mon2] => { 2026-08-18 11:51:33.853644 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:33.853648 | mon1 | } 2026-08-18 11:51:33.853652 | mon1 | ok: [mon3] => { 2026-08-18 11:51:33.853656 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:33.853660 | mon1 | } 2026-08-18 11:51:33.853664 | mon1 | 2026-08-18 11:51:33.853668 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:33.853672 | mon1 | Tuesday 18 August 2026 11:51:33 +0000 (0:00:00.119) 0:01:31.026 ******** 2026-08-18 11:51:34.240821 | mon1 | ok: [mon1] 2026-08-18 11:51:34.240924 | mon1 | ok: [mon3] 2026-08-18 11:51:34.241436 | mon1 | ok: [mon2] 2026-08-18 11:51:34.241454 | mon1 | 2026-08-18 11:51:34.241462 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:34.241468 | mon1 | Tuesday 18 August 2026 11:51:34 +0000 (0:00:00.387) 0:01:31.414 ******** 2026-08-18 11:51:36.307852 | mon1 | ok: [mon3] 2026-08-18 11:51:36.307929 | mon1 | ok: [mon2] 2026-08-18 11:51:36.308315 | mon1 | ok: [mon1] 2026-08-18 11:51:36.308393 | mon1 | 2026-08-18 11:51:36.308400 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:51:36.308406 | mon1 | Tuesday 18 August 2026 11:51:36 +0000 (0:00:02.067) 0:01:33.481 ******** 2026-08-18 11:51:36.341449 | mon1 | skipping: [mon1] 2026-08-18 11:51:36.369005 | mon1 | skipping: [mon2] 2026-08-18 11:51:36.369136 | mon1 | skipping: [mon3] 2026-08-18 11:51:36.369203 | mon1 | 2026-08-18 11:51:36.369539 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:51:36.369597 | mon1 | Tuesday 18 August 2026 11:51:36 +0000 (0:00:00.061) 0:01:33.542 ******** 2026-08-18 11:51:36.406633 | mon1 | skipping: [mon1] 2026-08-18 11:51:36.436946 | mon1 | skipping: [mon2] 2026-08-18 11:51:36.437063 | mon1 | skipping: [mon3] 2026-08-18 11:51:36.437191 | mon1 | 2026-08-18 11:51:36.437532 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:51:36.437605 | mon1 | Tuesday 18 August 2026 11:51:36 +0000 (0:00:00.068) 0:01:33.611 ******** 2026-08-18 11:51:36.476566 | mon1 | skipping: [mon1] 2026-08-18 11:51:36.508197 | mon1 | skipping: [mon2] 2026-08-18 11:51:36.508233 | mon1 | skipping: [mon3] 2026-08-18 11:51:36.508240 | mon1 | 2026-08-18 11:51:36.508247 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:51:36.508254 | mon1 | Tuesday 18 August 2026 11:51:36 +0000 (0:00:00.070) 0:01:33.681 ******** 2026-08-18 11:51:37.898096 | mon1 | ok: [mon2] 2026-08-18 11:51:37.898218 | mon1 | ok: [mon3] 2026-08-18 11:51:37.898930 | mon1 | ok: [mon1] 2026-08-18 11:51:37.899402 | mon1 | 2026-08-18 11:51:37.899413 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:51:37.899422 | mon1 | Tuesday 18 August 2026 11:51:37 +0000 (0:00:01.390) 0:01:35.071 ******** 2026-08-18 11:51:38.339749 | mon1 | ok: [mon3] 2026-08-18 11:51:38.339850 | mon1 | ok: [mon2] 2026-08-18 11:51:38.339862 | mon1 | ok: [mon1] 2026-08-18 11:51:38.340207 | mon1 | 2026-08-18 11:51:38.340258 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:51:38.340265 | mon1 | Tuesday 18 August 2026 11:51:38 +0000 (0:00:00.442) 0:01:35.514 ******** 2026-08-18 11:51:39.293739 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:39.293816 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:39.295033 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:51:39.295128 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:39.295141 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:39.295150 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:51:39.295160 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:39.295168 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:39.295177 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:51:39.295186 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:39.295196 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:39.295213 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:51:39.295970 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:39.296017 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:39.296022 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:51:39.296027 | mon1 | 2026-08-18 11:51:39.296037 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:51:39.296042 | mon1 | Tuesday 18 August 2026 11:51:39 +0000 (0:00:00.953) 0:01:36.467 ******** 2026-08-18 11:51:39.876802 | mon1 | ok: [mon2] 2026-08-18 11:51:39.876873 | mon1 | ok: [mon3] 2026-08-18 11:51:39.878030 | mon1 | ok: [mon1] 2026-08-18 11:51:39.878074 | mon1 | 2026-08-18 11:51:39.878080 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:39.878085 | mon1 | Tuesday 18 August 2026 11:51:39 +0000 (0:00:00.563) 0:01:37.030 ******** 2026-08-18 11:51:39.878089 | mon1 | 2026-08-18 11:51:39.878093 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:39.878097 | mon1 | Tuesday 18 August 2026 11:51:39 +0000 (0:00:00.006) 0:01:37.037 ******** 2026-08-18 11:51:39.878101 | mon1 | 2026-08-18 11:51:39.878105 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:51:39.878109 | mon1 | Tuesday 18 August 2026 11:51:39 +0000 (0:00:00.005) 0:01:37.042 ******** 2026-08-18 11:51:39.878113 | mon1 | 2026-08-18 11:51:39.878117 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:51:39.878121 | mon1 | Tuesday 18 August 2026 11:51:39 +0000 (0:00:00.008) 0:01:37.051 ******** 2026-08-18 11:51:40.282529 | mon1 | ok: [mon2] 2026-08-18 11:51:40.282600 | mon1 | ok: [mon3] 2026-08-18 11:51:40.283013 | mon1 | ok: [mon1] 2026-08-18 11:51:40.283052 | mon1 | 2026-08-18 11:51:40.283065 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:40.283080 | mon1 | Tuesday 18 August 2026 11:51:40 +0000 (0:00:00.405) 0:01:37.456 ******** 2026-08-18 11:51:40.520974 | mon1 | ok: [mon1] 2026-08-18 11:51:40.522061 | mon1 | ok: [mon2] 2026-08-18 11:51:40.522085 | mon1 | ok: [mon3] 2026-08-18 11:51:40.522098 | mon1 | 2026-08-18 11:51:40.522112 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:40.522123 | mon1 | Tuesday 18 August 2026 11:51:40 +0000 (0:00:00.238) 0:01:37.695 ******** 2026-08-18 11:51:40.635035 | mon1 | ok: [mon1] => { 2026-08-18 11:51:40.635098 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:40.635110 | mon1 | } 2026-08-18 11:51:40.635119 | mon1 | ok: [mon2] => { 2026-08-18 11:51:40.635135 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:40.635994 | mon1 | } 2026-08-18 11:51:40.636050 | mon1 | ok: [mon3] => { 2026-08-18 11:51:40.636058 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:51:40.636067 | mon1 | } 2026-08-18 11:51:40.636073 | mon1 | 2026-08-18 11:51:40.636080 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:40.636087 | mon1 | Tuesday 18 August 2026 11:51:40 +0000 (0:00:00.112) 0:01:37.808 ******** 2026-08-18 11:51:41.030310 | mon1 | ok: [mon2] 2026-08-18 11:51:41.031071 | mon1 | ok: [mon1] 2026-08-18 11:51:41.031171 | mon1 | ok: [mon3] 2026-08-18 11:51:41.031182 | mon1 | 2026-08-18 11:51:41.031193 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:41.031204 | mon1 | Tuesday 18 August 2026 11:51:41 +0000 (0:00:00.395) 0:01:38.204 ******** 2026-08-18 11:51:44.200697 | mon1 | ok: [mon2] 2026-08-18 11:51:44.200854 | mon1 | ok: [mon3] 2026-08-18 11:51:44.200869 | mon1 | ok: [mon1] 2026-08-18 11:51:44.201173 | mon1 | 2026-08-18 11:51:44.201232 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:51:44.201238 | mon1 | Tuesday 18 August 2026 11:51:44 +0000 (0:00:03.170) 0:01:41.374 ******** 2026-08-18 11:51:45.637543 | mon1 | ok: [mon2] 2026-08-18 11:51:45.637664 | mon1 | ok: [mon3] 2026-08-18 11:51:45.638283 | mon1 | ok: [mon1] 2026-08-18 11:51:45.638365 | mon1 | 2026-08-18 11:51:45.638373 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:51:45.638381 | mon1 | Tuesday 18 August 2026 11:51:45 +0000 (0:00:01.436) 0:01:42.811 ******** 2026-08-18 11:51:45.865375 | mon1 | ok: [mon2] 2026-08-18 11:51:45.865493 | mon1 | ok: [mon1] 2026-08-18 11:51:45.865504 | mon1 | ok: [mon3] 2026-08-18 11:51:45.865567 | mon1 | 2026-08-18 11:51:45.865824 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:51:45.865905 | mon1 | Tuesday 18 August 2026 11:51:45 +0000 (0:00:00.227) 0:01:43.039 ******** 2026-08-18 11:51:46.354105 | mon1 | ok: [mon2] 2026-08-18 11:51:46.354205 | mon1 | ok: [mon1] 2026-08-18 11:51:46.354466 | mon1 | ok: [mon3] 2026-08-18 11:51:46.354535 | mon1 | 2026-08-18 11:51:46.354554 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:51:46.354730 | mon1 | Tuesday 18 August 2026 11:51:46 +0000 (0:00:00.488) 0:01:43.528 ******** 2026-08-18 11:51:46.923119 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:46.923232 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:46.923246 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:51:46.924472 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:46.924534 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:46.924542 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:51:46.924553 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:46.924561 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:46.924569 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:51:46.924578 | mon1 | 2026-08-18 11:51:46.924587 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:51:46.924595 | mon1 | Tuesday 18 August 2026 11:51:46 +0000 (0:00:00.569) 0:01:44.097 ******** 2026-08-18 11:51:47.375860 | mon1 | ok: [mon2] 2026-08-18 11:51:47.375948 | mon1 | ok: [mon1] 2026-08-18 11:51:47.375961 | mon1 | ok: [mon3] 2026-08-18 11:51:47.375967 | mon1 | 2026-08-18 11:51:47.375975 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:51:47.375982 | mon1 | Tuesday 18 August 2026 11:51:47 +0000 (0:00:00.451) 0:01:44.548 ******** 2026-08-18 11:51:47.859629 | mon1 | ok: [mon1] 2026-08-18 11:51:47.859800 | mon1 | ok: [mon2] 2026-08-18 11:51:47.859812 | mon1 | ok: [mon3] 2026-08-18 11:51:47.859822 | mon1 | 2026-08-18 11:51:47.860890 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:47.860974 | mon1 | Tuesday 18 August 2026 11:51:47 +0000 (0:00:00.463) 0:01:45.012 ******** 2026-08-18 11:51:47.860980 | mon1 | 2026-08-18 11:51:47.860985 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:47.860990 | mon1 | Tuesday 18 August 2026 11:51:47 +0000 (0:00:00.007) 0:01:45.020 ******** 2026-08-18 11:51:47.860994 | mon1 | 2026-08-18 11:51:47.860998 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:51:47.861002 | mon1 | Tuesday 18 August 2026 11:51:47 +0000 (0:00:00.005) 0:01:45.026 ******** 2026-08-18 11:51:47.861006 | mon1 | 2026-08-18 11:51:47.861010 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:51:47.861014 | mon1 | Tuesday 18 August 2026 11:51:47 +0000 (0:00:00.007) 0:01:45.033 ******** 2026-08-18 11:51:48.261490 | mon1 | ok: [mon2] 2026-08-18 11:51:48.262033 | mon1 | ok: [mon1] 2026-08-18 11:51:48.262050 | mon1 | ok: [mon3] 2026-08-18 11:51:48.262060 | mon1 | 2026-08-18 11:51:48.262071 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:48.262081 | mon1 | Tuesday 18 August 2026 11:51:48 +0000 (0:00:00.402) 0:01:45.435 ******** 2026-08-18 11:51:48.318189 | mon1 | ok: [mon1] => { 2026-08-18 11:51:48.318352 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:48.319021 | mon1 | } 2026-08-18 11:51:48.319080 | mon1 | ok: [mon2] => { 2026-08-18 11:51:48.319089 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:48.319096 | mon1 | } 2026-08-18 11:51:48.319102 | mon1 | ok: [mon3] => { 2026-08-18 11:51:48.319618 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:51:48.319630 | mon1 | } 2026-08-18 11:51:48.319635 | mon1 | 2026-08-18 11:51:48.319640 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:48.319645 | mon1 | Tuesday 18 August 2026 11:51:48 +0000 (0:00:00.056) 0:01:45.492 ******** 2026-08-18 11:51:48.617934 | mon1 | ok: [mon2] 2026-08-18 11:51:48.617996 | mon1 | ok: [mon1] 2026-08-18 11:51:48.618004 | mon1 | ok: [mon3] 2026-08-18 11:51:48.618010 | mon1 | 2026-08-18 11:51:48.618016 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:48.618022 | mon1 | Tuesday 18 August 2026 11:51:48 +0000 (0:00:00.298) 0:01:45.791 ******** 2026-08-18 11:51:48.686386 | mon1 | skipping: [mon1] 2026-08-18 11:51:48.686434 | mon1 | skipping: [mon2] 2026-08-18 11:51:48.686438 | mon1 | skipping: [mon3] 2026-08-18 11:51:48.686443 | mon1 | 2026-08-18 11:51:48.686447 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:51:48.686452 | mon1 | Tuesday 18 August 2026 11:51:48 +0000 (0:00:00.069) 0:01:45.860 ******** 2026-08-18 11:51:48.754808 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:48.754855 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:48.754862 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:51:48.754868 | mon1 | 2026-08-18 11:51:48.754874 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:51:48.754881 | mon1 | Tuesday 18 August 2026 11:51:48 +0000 (0:00:00.068) 0:01:45.928 ******** 2026-08-18 11:51:49.833221 | mon1 | ok: [mon2] 2026-08-18 11:51:49.833272 | mon1 | ok: [mon3] 2026-08-18 11:51:49.833278 | mon1 | ok: [mon1] 2026-08-18 11:51:49.833284 | mon1 | 2026-08-18 11:51:49.833291 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:51:49.833297 | mon1 | Tuesday 18 August 2026 11:51:49 +0000 (0:00:01.077) 0:01:47.006 ******** 2026-08-18 11:51:50.527079 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:51:50.527206 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:51:50.527218 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:51:50.527227 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:51:50.527236 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:51:50.527244 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:51:50.527254 | mon1 | 2026-08-18 11:51:50.527274 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:51:50.527316 | mon1 | Tuesday 18 August 2026 11:51:50 +0000 (0:00:00.692) 0:01:47.699 ******** 2026-08-18 11:51:50.746393 | mon1 | ok: [mon2] 2026-08-18 11:51:50.746603 | mon1 | ok: [mon3] 2026-08-18 11:51:50.746910 | mon1 | ok: [mon1] 2026-08-18 11:51:50.747177 | mon1 | 2026-08-18 11:51:50.747440 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:51:50.747719 | mon1 | Tuesday 18 August 2026 11:51:50 +0000 (0:00:00.221) 0:01:47.920 ******** 2026-08-18 11:51:51.021747 | mon1 | ok: [mon1] 2026-08-18 11:51:51.021807 | mon1 | ok: [mon2] 2026-08-18 11:51:51.021817 | mon1 | ok: [mon3] 2026-08-18 11:51:51.021827 | mon1 | 2026-08-18 11:51:51.021836 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:51:51.021846 | mon1 | Tuesday 18 August 2026 11:51:51 +0000 (0:00:00.273) 0:01:48.194 ******** 2026-08-18 11:51:51.454568 | mon1 | ok: [mon1] 2026-08-18 11:51:51.454686 | mon1 | ok: [mon2] 2026-08-18 11:51:51.454700 | mon1 | ok: [mon3] 2026-08-18 11:51:51.455142 | mon1 | 2026-08-18 11:51:51.455244 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:51:51.455268 | mon1 | Tuesday 18 August 2026 11:51:51 +0000 (0:00:00.434) 0:01:48.628 ******** 2026-08-18 11:51:51.517280 | mon1 | skipping: [mon1] 2026-08-18 11:51:51.517329 | mon1 | skipping: [mon2] 2026-08-18 11:51:51.517734 | mon1 | skipping: [mon3] 2026-08-18 11:51:51.517788 | mon1 | 2026-08-18 11:51:51.517794 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:51:51.517800 | mon1 | Tuesday 18 August 2026 11:51:51 +0000 (0:00:00.062) 0:01:48.691 ******** 2026-08-18 11:51:51.895053 | mon1 | ok: [mon2] 2026-08-18 11:51:51.895758 | mon1 | ok: [mon1] 2026-08-18 11:51:51.895811 | mon1 | ok: [mon3] 2026-08-18 11:51:51.895819 | mon1 | 2026-08-18 11:51:51.895825 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:51:51.895832 | mon1 | Tuesday 18 August 2026 11:51:51 +0000 (0:00:00.377) 0:01:49.069 ******** 2026-08-18 11:51:52.370231 | mon1 | ok: [mon1] 2026-08-18 11:51:52.370309 | mon1 | ok: [mon3] 2026-08-18 11:51:52.370679 | mon1 | ok: [mon2] 2026-08-18 11:51:52.370726 | mon1 | 2026-08-18 11:51:52.370732 | mon1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 11:51:52.370737 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.475) 0:01:49.544 ******** 2026-08-18 11:51:52.441784 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-18 11:51:52.441886 | mon1 | skipping: [mon1] => (item=mon2) 2026-08-18 11:51:52.442376 | mon1 | skipping: [mon1] => (item=mon3) 2026-08-18 11:51:52.442497 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.442510 | mon1 | 2026-08-18 11:51:52.442532 | mon1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 11:51:52.442647 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.071) 0:01:49.615 ******** 2026-08-18 11:51:52.477766 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.513859 | mon1 | skipping: [mon2] 2026-08-18 11:51:52.513979 | mon1 | skipping: [mon3] 2026-08-18 11:51:52.514129 | mon1 | 2026-08-18 11:51:52.514280 | mon1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 11:51:52.514437 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.072) 0:01:49.687 ******** 2026-08-18 11:51:52.546049 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.574633 | mon1 | skipping: [mon2] 2026-08-18 11:51:52.574796 | mon1 | skipping: [mon3] 2026-08-18 11:51:52.575011 | mon1 | 2026-08-18 11:51:52.575237 | mon1 | TASK [Register this RGW host] ************************************************** 2026-08-18 11:51:52.575438 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.061) 0:01:49.748 ******** 2026-08-18 11:51:52.646128 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.646335 | mon1 | skipping: [mon2] 2026-08-18 11:51:52.646549 | mon1 | skipping: [mon3] 2026-08-18 11:51:52.646743 | mon1 | 2026-08-18 11:51:52.647016 | mon1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 11:51:52.647272 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.070) 0:01:49.819 ******** 2026-08-18 11:51:52.684671 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.684845 | mon1 | 2026-08-18 11:51:52.685053 | mon1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 11:51:52.685314 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.038) 0:01:49.858 ******** 2026-08-18 11:51:52.713535 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.713675 | mon1 | 2026-08-18 11:51:52.713886 | mon1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 11:51:52.714129 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.029) 0:01:49.887 ******** 2026-08-18 11:51:52.801308 | mon1 | skipping: [mon1] 2026-08-18 11:51:52.801523 | mon1 | 2026-08-18 11:51:52.801830 | mon1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 11:51:52.802024 | mon1 | 2026-08-18 11:51:52.802242 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:51:52.802580 | mon1 | Tuesday 18 August 2026 11:51:52 +0000 (0:00:00.087) 0:01:49.975 ******** 2026-08-18 11:51:53.779547 | mon1 | ok: [mon2] 2026-08-18 11:51:53.779712 | mon1 | ok: [mon3] 2026-08-18 11:51:53.779921 | mon1 | ok: [mon1] 2026-08-18 11:51:53.780103 | mon1 | 2026-08-18 11:51:53.780373 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:53.780576 | mon1 | Tuesday 18 August 2026 11:51:53 +0000 (0:00:00.977) 0:01:50.953 ******** 2026-08-18 11:51:54.007286 | mon1 | ok: [mon1] 2026-08-18 11:51:54.007485 | mon1 | ok: [mon2] 2026-08-18 11:51:54.007772 | mon1 | ok: [mon3] 2026-08-18 11:51:54.008002 | mon1 | 2026-08-18 11:51:54.008327 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:54.008612 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.227) 0:01:51.181 ******** 2026-08-18 11:51:54.071951 | mon1 | skipping: [mon1] 2026-08-18 11:51:54.072144 | mon1 | skipping: [mon2] 2026-08-18 11:51:54.072416 | mon1 | skipping: [mon3] 2026-08-18 11:51:54.072626 | mon1 | 2026-08-18 11:51:54.072871 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 11:51:54.073093 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.065) 0:01:51.246 ******** 2026-08-18 11:51:54.326344 | mon1 | ok: [mon1] 2026-08-18 11:51:54.326528 | mon1 | ok: [mon2] 2026-08-18 11:51:54.326733 | mon1 | ok: [mon3] 2026-08-18 11:51:54.326927 | mon1 | 2026-08-18 11:51:54.327188 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:54.327423 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.254) 0:01:51.500 ******** 2026-08-18 11:51:54.423730 | mon1 | ok: [mon1] => { 2026-08-18 11:51:54.424039 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:54.424272 | mon1 | } 2026-08-18 11:51:54.424486 | mon1 | ok: [mon2] => { 2026-08-18 11:51:54.424754 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:54.424954 | mon1 | } 2026-08-18 11:51:54.425157 | mon1 | ok: [mon3] => { 2026-08-18 11:51:54.425373 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 11:51:54.425569 | mon1 | } 2026-08-18 11:51:54.425795 | mon1 | 2026-08-18 11:51:54.426021 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:54.426252 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.097) 0:01:51.597 ******** 2026-08-18 11:51:54.765717 | mon1 | ok: [mon2] 2026-08-18 11:51:54.765932 | mon1 | ok: [mon1] 2026-08-18 11:51:54.766153 | mon1 | ok: [mon3] 2026-08-18 11:51:54.766362 | mon1 | 2026-08-18 11:51:54.766589 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:54.766832 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.341) 0:01:51.939 ******** 2026-08-18 11:51:54.794301 | mon1 | skipping: [mon1] 2026-08-18 11:51:54.855980 | mon1 | skipping: [mon2] 2026-08-18 11:51:54.856153 | mon1 | skipping: [mon3] 2026-08-18 11:51:54.856331 | mon1 | 2026-08-18 11:51:54.856560 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:54.856947 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.090) 0:01:52.029 ******** 2026-08-18 11:51:54.880183 | mon1 | skipping: [mon1] 2026-08-18 11:51:54.936644 | mon1 | skipping: [mon2] 2026-08-18 11:51:54.936685 | mon1 | skipping: [mon3] 2026-08-18 11:51:54.936765 | mon1 | 2026-08-18 11:51:54.936862 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:51:54.936957 | mon1 | Tuesday 18 August 2026 11:51:54 +0000 (0:00:00.081) 0:01:52.111 ******** 2026-08-18 11:51:55.173203 | mon1 | ok: [mon2] 2026-08-18 11:51:55.173410 | mon1 | ok: [mon3] 2026-08-18 11:51:55.173612 | mon1 | ok: [mon1] 2026-08-18 11:51:55.173800 | mon1 | 2026-08-18 11:51:55.174030 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 11:51:55.174253 | mon1 | Tuesday 18 August 2026 11:51:55 +0000 (0:00:00.235) 0:01:52.347 ******** 2026-08-18 11:51:56.545928 | mon1 | ok: [mon2] 2026-08-18 11:51:56.546114 | mon1 | ok: [mon3] 2026-08-18 11:51:56.546315 | mon1 | ok: [mon1] 2026-08-18 11:51:56.546527 | mon1 | 2026-08-18 11:51:56.546742 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:51:56.547051 | mon1 | Tuesday 18 August 2026 11:51:56 +0000 (0:00:01.372) 0:01:53.719 ******** 2026-08-18 11:51:56.652644 | mon1 | ok: [mon1] => { 2026-08-18 11:51:56.652848 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:56.653046 | mon1 | } 2026-08-18 11:51:56.653246 | mon1 | ok: [mon2] => { 2026-08-18 11:51:56.653460 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:56.653649 | mon1 | } 2026-08-18 11:51:56.653844 | mon1 | ok: [mon3] => { 2026-08-18 11:51:56.654044 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 11:51:56.654231 | mon1 | } 2026-08-18 11:51:56.654411 | mon1 | 2026-08-18 11:51:56.654619 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:51:56.654873 | mon1 | Tuesday 18 August 2026 11:51:56 +0000 (0:00:00.107) 0:01:53.826 ******** 2026-08-18 11:51:57.053413 | mon1 | ok: [mon2] 2026-08-18 11:51:57.053548 | mon1 | ok: [mon1] 2026-08-18 11:51:57.053753 | mon1 | ok: [mon3] 2026-08-18 11:51:57.053945 | mon1 | 2026-08-18 11:51:57.054165 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:51:57.054377 | mon1 | Tuesday 18 August 2026 11:51:57 +0000 (0:00:00.397) 0:01:54.224 ******** 2026-08-18 11:51:59.101783 | mon1 | ok: [mon3] 2026-08-18 11:51:59.101873 | mon1 | ok: [mon2] 2026-08-18 11:51:59.101906 | mon1 | ok: [mon1] 2026-08-18 11:51:59.102009 | mon1 | 2026-08-18 11:51:59.102108 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 11:51:59.102238 | mon1 | Tuesday 18 August 2026 11:51:59 +0000 (0:00:02.039) 0:01:56.264 ******** 2026-08-18 11:51:59.139208 | mon1 | skipping: [mon1] 2026-08-18 11:51:59.139487 | mon1 | skipping: [mon2] 2026-08-18 11:51:59.139732 | mon1 | skipping: [mon3] 2026-08-18 11:51:59.139973 | mon1 | 2026-08-18 11:51:59.140279 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 11:51:59.140513 | mon1 | Tuesday 18 August 2026 11:51:59 +0000 (0:00:00.048) 0:01:56.313 ******** 2026-08-18 11:51:59.167595 | mon1 | skipping: [mon1] 2026-08-18 11:51:59.194649 | mon1 | skipping: [mon2] 2026-08-18 11:51:59.194846 | mon1 | skipping: [mon3] 2026-08-18 11:51:59.195062 | mon1 | 2026-08-18 11:51:59.195275 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 11:51:59.195481 | mon1 | Tuesday 18 August 2026 11:51:59 +0000 (0:00:00.055) 0:01:56.368 ******** 2026-08-18 11:51:59.253433 | mon1 | skipping: [mon1] 2026-08-18 11:51:59.253631 | mon1 | skipping: [mon2] 2026-08-18 11:51:59.253832 | mon1 | skipping: [mon3] 2026-08-18 11:51:59.254037 | mon1 | 2026-08-18 11:51:59.254272 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 11:51:59.254486 | mon1 | Tuesday 18 August 2026 11:51:59 +0000 (0:00:00.058) 0:01:56.427 ******** 2026-08-18 11:52:00.326364 | mon1 | ok: [mon3] 2026-08-18 11:52:00.326576 | mon1 | ok: [mon2] 2026-08-18 11:52:00.326797 | mon1 | ok: [mon1] 2026-08-18 11:52:00.326994 | mon1 | 2026-08-18 11:52:00.327308 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 11:52:00.327567 | mon1 | Tuesday 18 August 2026 11:52:00 +0000 (0:00:01.072) 0:01:57.500 ******** 2026-08-18 11:52:00.777421 | mon1 | ok: [mon1] 2026-08-18 11:52:00.777621 | mon1 | ok: [mon2] 2026-08-18 11:52:00.777838 | mon1 | ok: [mon3] 2026-08-18 11:52:00.778058 | mon1 | 2026-08-18 11:52:00.778398 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 11:52:00.778628 | mon1 | Tuesday 18 August 2026 11:52:00 +0000 (0:00:00.451) 0:01:57.951 ******** 2026-08-18 11:52:01.744275 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-18 11:52:01.744342 | mon1 | ok: [mon2] => (item={'path': '/etc/containerd'}) 2026-08-18 11:52:01.744350 | mon1 | ok: [mon3] => (item={'path': '/etc/containerd'}) 2026-08-18 11:52:01.744356 | mon1 | ok: [mon3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:52:01.744371 | mon1 | ok: [mon2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:52:01.747092 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 11:52:01.747113 | mon1 | ok: [mon3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:52:01.747120 | mon1 | ok: [mon2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:52:01.747126 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 11:52:01.747133 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:52:01.747140 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:52:01.747146 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 11:52:01.747153 | mon1 | ok: [mon3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:52:01.747159 | mon1 | ok: [mon2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:52:01.747165 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 11:52:01.747172 | mon1 | 2026-08-18 11:52:01.747182 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 11:52:01.747420 | mon1 | Tuesday 18 August 2026 11:52:01 +0000 (0:00:00.965) 0:01:58.917 ******** 2026-08-18 11:52:02.312700 | mon1 | ok: [mon1] 2026-08-18 11:52:02.312821 | mon1 | ok: [mon2] 2026-08-18 11:52:02.312833 | mon1 | ok: [mon3] 2026-08-18 11:52:02.313951 | mon1 | 2026-08-18 11:52:02.313970 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:52:02.313978 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.551) 0:01:59.469 ******** 2026-08-18 11:52:02.313983 | mon1 | 2026-08-18 11:52:02.313988 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:52:02.313994 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.005) 0:01:59.474 ******** 2026-08-18 11:52:02.313999 | mon1 | 2026-08-18 11:52:02.314004 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 11:52:02.314009 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.005) 0:01:59.480 ******** 2026-08-18 11:52:02.314014 | mon1 | 2026-08-18 11:52:02.314018 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 11:52:02.314023 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.006) 0:01:59.486 ******** 2026-08-18 11:52:02.716739 | mon1 | ok: [mon1] 2026-08-18 11:52:02.716869 | mon1 | ok: [mon2] 2026-08-18 11:52:02.716880 | mon1 | ok: [mon3] 2026-08-18 11:52:02.716895 | mon1 | 2026-08-18 11:52:02.717171 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 11:52:02.717247 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.403) 0:01:59.890 ******** 2026-08-18 11:52:02.955820 | mon1 | ok: [mon1] 2026-08-18 11:52:02.955876 | mon1 | ok: [mon2] 2026-08-18 11:52:02.955882 | mon1 | ok: [mon3] 2026-08-18 11:52:02.955888 | mon1 | 2026-08-18 11:52:02.955894 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:52:02.955900 | mon1 | Tuesday 18 August 2026 11:52:02 +0000 (0:00:00.238) 0:02:00.129 ******** 2026-08-18 11:52:03.072572 | mon1 | ok: [mon1] => { 2026-08-18 11:52:03.072646 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:52:03.073611 | mon1 | } 2026-08-18 11:52:03.073692 | mon1 | ok: [mon2] => { 2026-08-18 11:52:03.073698 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:52:03.073704 | mon1 | } 2026-08-18 11:52:03.073708 | mon1 | ok: [mon3] => { 2026-08-18 11:52:03.073712 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 11:52:03.073717 | mon1 | } 2026-08-18 11:52:03.073721 | mon1 | 2026-08-18 11:52:03.073725 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:52:03.073730 | mon1 | Tuesday 18 August 2026 11:52:03 +0000 (0:00:00.117) 0:02:00.246 ******** 2026-08-18 11:52:03.478330 | mon1 | ok: [mon1] 2026-08-18 11:52:03.478411 | mon1 | ok: [mon3] 2026-08-18 11:52:03.478418 | mon1 | ok: [mon2] 2026-08-18 11:52:03.478425 | mon1 | 2026-08-18 11:52:03.478432 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:52:03.478438 | mon1 | Tuesday 18 August 2026 11:52:03 +0000 (0:00:00.404) 0:02:00.651 ******** 2026-08-18 11:52:06.674139 | mon1 | ok: [mon3] 2026-08-18 11:52:06.674246 | mon1 | ok: [mon2] 2026-08-18 11:52:06.674254 | mon1 | ok: [mon1] 2026-08-18 11:52:06.674661 | mon1 | 2026-08-18 11:52:06.674733 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 11:52:06.674740 | mon1 | Tuesday 18 August 2026 11:52:06 +0000 (0:00:03.196) 0:02:03.848 ******** 2026-08-18 11:52:07.846517 | mon1 | ok: [mon2] 2026-08-18 11:52:07.846640 | mon1 | ok: [mon3] 2026-08-18 11:52:07.846709 | mon1 | ok: [mon1] 2026-08-18 11:52:07.847141 | mon1 | 2026-08-18 11:52:07.847257 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 11:52:07.847270 | mon1 | Tuesday 18 August 2026 11:52:07 +0000 (0:00:01.172) 0:02:05.020 ******** 2026-08-18 11:52:08.074503 | mon1 | ok: [mon1] 2026-08-18 11:52:08.074611 | mon1 | ok: [mon2] 2026-08-18 11:52:08.074623 | mon1 | ok: [mon3] 2026-08-18 11:52:08.074959 | mon1 | 2026-08-18 11:52:08.075295 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 11:52:08.075303 | mon1 | Tuesday 18 August 2026 11:52:08 +0000 (0:00:00.227) 0:02:05.248 ******** 2026-08-18 11:52:08.546937 | mon1 | ok: [mon1] 2026-08-18 11:52:08.547027 | mon1 | ok: [mon3] 2026-08-18 11:52:08.547542 | mon1 | ok: [mon2] 2026-08-18 11:52:08.547617 | mon1 | 2026-08-18 11:52:08.547624 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 11:52:08.547630 | mon1 | Tuesday 18 August 2026 11:52:08 +0000 (0:00:00.472) 0:02:05.721 ******** 2026-08-18 11:52:09.140485 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-18 11:52:09.140547 | mon1 | ok: [mon2] => (item={'path': '/etc/docker'}) 2026-08-18 11:52:09.141529 | mon1 | ok: [mon3] => (item={'path': '/etc/docker'}) 2026-08-18 11:52:09.141592 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:52:09.141599 | mon1 | ok: [mon3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:52:09.141603 | mon1 | ok: [mon2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 11:52:09.141608 | mon1 | ok: [mon3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:52:09.141613 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:52:09.141617 | mon1 | ok: [mon2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 11:52:09.141621 | mon1 | 2026-08-18 11:52:09.141627 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 11:52:09.141649 | mon1 | Tuesday 18 August 2026 11:52:09 +0000 (0:00:00.593) 0:02:06.314 ******** 2026-08-18 11:52:09.584711 | mon1 | ok: [mon2] 2026-08-18 11:52:09.584781 | mon1 | ok: [mon1] 2026-08-18 11:52:09.584786 | mon1 | ok: [mon3] 2026-08-18 11:52:09.584790 | mon1 | 2026-08-18 11:52:09.584795 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 11:52:09.584800 | mon1 | Tuesday 18 August 2026 11:52:09 +0000 (0:00:00.443) 0:02:06.758 ******** 2026-08-18 11:52:10.065676 | mon1 | ok: [mon2] 2026-08-18 11:52:10.065744 | mon1 | ok: [mon3] 2026-08-18 11:52:10.065749 | mon1 | ok: [mon1] 2026-08-18 11:52:10.065754 | mon1 | 2026-08-18 11:52:10.065759 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:52:10.065764 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.463) 0:02:07.221 ******** 2026-08-18 11:52:10.065768 | mon1 | 2026-08-18 11:52:10.065778 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:52:10.065782 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.005) 0:02:07.227 ******** 2026-08-18 11:52:10.065786 | mon1 | 2026-08-18 11:52:10.065790 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 11:52:10.065794 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.005) 0:02:07.232 ******** 2026-08-18 11:52:10.065798 | mon1 | 2026-08-18 11:52:10.065802 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 11:52:10.065884 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.005) 0:02:07.238 ******** 2026-08-18 11:52:10.467175 | mon1 | ok: [mon1] 2026-08-18 11:52:10.467289 | mon1 | ok: [mon2] 2026-08-18 11:52:10.467300 | mon1 | ok: [mon3] 2026-08-18 11:52:10.467320 | mon1 | 2026-08-18 11:52:10.467501 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 11:52:10.467720 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.401) 0:02:07.640 ******** 2026-08-18 11:52:10.534743 | mon1 | ok: [mon1] => { 2026-08-18 11:52:10.534964 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:52:10.535179 | mon1 | } 2026-08-18 11:52:10.535384 | mon1 | ok: [mon2] => { 2026-08-18 11:52:10.535593 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:52:10.535785 | mon1 | } 2026-08-18 11:52:10.535974 | mon1 | ok: [mon3] => { 2026-08-18 11:52:10.536185 | mon1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 11:52:10.536364 | mon1 | } 2026-08-18 11:52:10.536542 | mon1 | 2026-08-18 11:52:10.536746 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 11:52:10.536948 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.068) 0:02:07.708 ******** 2026-08-18 11:52:10.839813 | mon1 | ok: [mon2] 2026-08-18 11:52:10.839979 | mon1 | ok: [mon3] 2026-08-18 11:52:10.839992 | mon1 | ok: [mon1] 2026-08-18 11:52:10.840060 | mon1 | 2026-08-18 11:52:10.840176 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 11:52:10.840294 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.305) 0:02:08.013 ******** 2026-08-18 11:52:10.922178 | mon1 | skipping: [mon1] 2026-08-18 11:52:10.922370 | mon1 | skipping: [mon2] 2026-08-18 11:52:10.922600 | mon1 | skipping: [mon3] 2026-08-18 11:52:10.922803 | mon1 | 2026-08-18 11:52:10.923071 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 11:52:10.923287 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.082) 0:02:08.096 ******** 2026-08-18 11:52:11.000140 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:52:11.000364 | mon1 | ok: [mon2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:52:11.000595 | mon1 | ok: [mon3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 11:52:11.000800 | mon1 | 2026-08-18 11:52:11.001030 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 11:52:11.001251 | mon1 | Tuesday 18 August 2026 11:52:10 +0000 (0:00:00.078) 0:02:08.174 ******** 2026-08-18 11:52:12.385308 | mon1 | ok: [mon3] 2026-08-18 11:52:12.385403 | mon1 | ok: [mon2] 2026-08-18 11:52:12.385414 | mon1 | ok: [mon1] 2026-08-18 11:52:12.385689 | mon1 | 2026-08-18 11:52:12.385706 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 11:52:12.385713 | mon1 | Tuesday 18 August 2026 11:52:12 +0000 (0:00:01.384) 0:02:09.559 ******** 2026-08-18 11:52:13.067688 | mon1 | ok: [mon1] => (item=chronyd) 2026-08-18 11:52:13.067808 | mon1 | ok: [mon2] => (item=chronyd) 2026-08-18 11:52:13.067819 | mon1 | ok: [mon3] => (item=chronyd) 2026-08-18 11:52:13.068434 | mon1 | ok: [mon2] => (item=sshd) 2026-08-18 11:52:13.068501 | mon1 | ok: [mon1] => (item=sshd) 2026-08-18 11:52:13.068505 | mon1 | ok: [mon3] => (item=sshd) 2026-08-18 11:52:13.068510 | mon1 | 2026-08-18 11:52:13.068515 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 11:52:13.068520 | mon1 | Tuesday 18 August 2026 11:52:13 +0000 (0:00:00.682) 0:02:10.241 ******** 2026-08-18 11:52:13.309895 | mon1 | ok: [mon1] 2026-08-18 11:52:13.309982 | mon1 | ok: [mon2] 2026-08-18 11:52:13.310360 | mon1 | ok: [mon3] 2026-08-18 11:52:13.310417 | mon1 | 2026-08-18 11:52:13.310423 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 11:52:13.310429 | mon1 | Tuesday 18 August 2026 11:52:13 +0000 (0:00:00.242) 0:02:10.484 ******** 2026-08-18 11:52:13.581628 | mon1 | ok: [mon2] 2026-08-18 11:52:13.581696 | mon1 | ok: [mon1] 2026-08-18 11:52:13.582145 | mon1 | ok: [mon3] 2026-08-18 11:52:13.582216 | mon1 | 2026-08-18 11:52:13.582223 | mon1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 11:52:13.582228 | mon1 | Tuesday 18 August 2026 11:52:13 +0000 (0:00:00.271) 0:02:10.755 ******** 2026-08-18 11:52:14.080952 | mon1 | ok: [mon2] 2026-08-18 11:52:14.081070 | mon1 | ok: [mon3] 2026-08-18 11:52:14.081077 | mon1 | ok: [mon1] 2026-08-18 11:52:14.081391 | mon1 | 2026-08-18 11:52:14.081451 | mon1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 11:52:14.081457 | mon1 | Tuesday 18 August 2026 11:52:14 +0000 (0:00:00.499) 0:02:11.255 ******** 2026-08-18 11:52:14.150873 | mon1 | skipping: [mon1] 2026-08-18 11:52:14.150986 | mon1 | skipping: [mon2] 2026-08-18 11:52:14.151495 | mon1 | skipping: [mon3] 2026-08-18 11:52:14.151573 | mon1 | 2026-08-18 11:52:14.151580 | mon1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 11:52:14.151587 | mon1 | Tuesday 18 August 2026 11:52:14 +0000 (0:00:00.069) 0:02:11.324 ******** 2026-08-18 11:52:14.549952 | mon1 | ok: [mon2] 2026-08-18 11:52:14.550045 | mon1 | ok: [mon3] 2026-08-18 11:52:14.550765 | mon1 | ok: [mon1] 2026-08-18 11:52:14.550828 | mon1 | 2026-08-18 11:52:14.550839 | mon1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 11:52:14.550848 | mon1 | Tuesday 18 August 2026 11:52:14 +0000 (0:00:00.399) 0:02:11.723 ******** 2026-08-18 11:52:15.044678 | mon1 | ok: [mon2] 2026-08-18 11:52:15.044755 | mon1 | ok: [mon1] 2026-08-18 11:52:15.044821 | mon1 | ok: [mon3] 2026-08-18 11:52:15.045225 | mon1 | 2026-08-18 11:52:15.045311 | mon1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 11:52:15.045319 | mon1 | Tuesday 18 August 2026 11:52:15 +0000 (0:00:00.494) 0:02:12.218 ******** 2026-08-18 11:52:15.658721 | mon1 | ok: [mon1] => (item=mon1) 2026-08-18 11:52:15.658797 | mon1 | ok: [mon1 -> mon2({{ nodepool.private_ipv4 }})] => (item=mon2) 2026-08-18 11:52:15.659089 | mon1 | ok: [mon1 -> mon3({{ nodepool.private_ipv4 }})] => (item=mon3) 2026-08-18 11:52:15.659184 | mon1 | 2026-08-18 11:52:15.659205 | mon1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 11:52:15.659215 | mon1 | Tuesday 18 August 2026 11:52:15 +0000 (0:00:00.614) 0:02:12.832 ******** 2026-08-18 11:52:15.742103 | mon1 | ok: [mon1] 2026-08-18 11:52:15.742211 | mon1 | ok: [mon2] 2026-08-18 11:52:15.742218 | mon1 | ok: [mon3] 2026-08-18 11:52:15.742561 | mon1 | 2026-08-18 11:52:15.742633 | mon1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 11:52:15.742639 | mon1 | Tuesday 18 August 2026 11:52:15 +0000 (0:00:00.083) 0:02:12.916 ******** 2026-08-18 11:52:15.821403 | mon1 | ok: [mon1] 2026-08-18 11:52:15.821496 | mon1 | ok: [mon2] 2026-08-18 11:52:15.821505 | mon1 | ok: [mon3] 2026-08-18 11:52:15.821870 | mon1 | 2026-08-18 11:52:15.821965 | mon1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 11:52:15.821972 | mon1 | Tuesday 18 August 2026 11:52:15 +0000 (0:00:00.079) 0:02:12.995 ******** 2026-08-18 11:52:15.855301 | mon1 | skipping: [mon1] 2026-08-18 11:52:15.855409 | mon1 | 2026-08-18 11:52:15.855425 | mon1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 11:52:15.855551 | mon1 | Tuesday 18 August 2026 11:52:15 +0000 (0:00:00.033) 0:02:13.029 ******** 2026-08-18 11:52:17.460696 | mon1 | ok: [mon1] => (item=ceph-exporter) 2026-08-18 11:52:17.460786 | mon1 | 2026-08-18 11:52:17.460798 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:52:17.463095 | mon1 | mon1 : ok=199 changed=0 unreachable=0 failed=0 skipped=59 rescued=0 ignored=0 2026-08-18 11:52:17.463210 | mon1 | mon2 : ok=185 changed=0 unreachable=0 failed=0 skipped=46 rescued=0 ignored=0 2026-08-18 11:52:17.463226 | mon1 | mon3 : ok=185 changed=0 unreachable=0 failed=0 skipped=46 rescued=0 ignored=0 2026-08-18 11:52:17.463236 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=10 rescued=0 ignored=0 2026-08-18 11:52:17.463246 | mon1 | 2026-08-18 11:52:17.463255 | mon1 | 2026-08-18 11:52:17.463279 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:52:17.463290 | mon1 | Tuesday 18 August 2026 11:52:17 +0000 (0:00:01.605) 0:02:14.635 ******** 2026-08-18 11:52:17.463299 | mon1 | =============================================================================== 2026-08-18 11:52:17.463309 | mon1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 8.01s 2026-08-18 11:52:17.463318 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.19s 2026-08-18 11:52:17.463385 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.20s 2026-08-18 11:52:17.463404 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.19s 2026-08-18 11:52:17.463415 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s 2026-08-18 11:52:17.463424 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.26s 2026-08-18 11:52:17.463433 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.07s 2026-08-18 11:52:17.463441 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.04s 2026-08-18 11:52:17.463450 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.03s 2026-08-18 11:52:17.463458 | mon1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 1.96s 2026-08-18 11:52:17.463469 | mon1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 1.75s 2026-08-18 11:52:17.463491 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.75s 2026-08-18 11:52:17.463500 | mon1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 1.72s 2026-08-18 11:52:17.463509 | mon1 | vexxhost.ceph.configure : Get the current dashboard certificate --------- 1.70s 2026-08-18 11:52:17.463518 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.67s 2026-08-18 11:52:17.463527 | mon1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 1.64s 2026-08-18 11:52:17.463539 | mon1 | vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled --- 1.64s 2026-08-18 11:52:17.463878 | mon1 | vexxhost.ceph.mgr : Wait for this manager's daemon to be present -------- 1.63s 2026-08-18 11:52:17.463952 | mon1 | vexxhost.ceph.cephadm_host : Get the cephadm public key ----------------- 1.63s 2026-08-18 11:52:17.463959 | mon1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 1.62s 2026-08-18 11:52:17.662499 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-18 11:52:17.671073 | mon1 | INFO [default > side_effect] Executing 2026-08-18 11:52:17.672007 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 11:52:17.677257 | mon1 | INFO [default > verify] Executing 2026-08-18 11:52:18.327792 | mon1 | 2026-08-18 11:52:18.328207 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-18 11:52:18.328510 | mon1 | 2026-08-18 11:52:18.328804 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 11:52:18.329094 | mon1 | Tuesday 18 August 2026 11:52:18 +0000 (0:00:00.007) 0:00:00.007 ******** 2026-08-18 11:52:19.476716 | mon1 | [WARNING]: Platform linux on host mon2 is using the discovered Python 2026-08-18 11:52:19.476781 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:52:19.476790 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:52:19.476796 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:52:19.476803 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:52:19.541384 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-18 11:52:19.541462 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:52:19.541472 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:52:19.541480 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:52:19.541487 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:52:19.560247 | mon1 | [WARNING]: Platform linux on host mon3 is using the discovered Python 2026-08-18 11:52:19.560281 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 11:52:19.560292 | mon1 | interpreter could change the meaning of that path. See 2026-08-18 11:52:19.560301 | mon1 | https://docs.ansible.com/ansible- 2026-08-18 11:52:19.560311 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 11:52:19.567296 | mon1 | ok: [mon2] 2026-08-18 11:52:19.567411 | mon1 | ok: [mon1] 2026-08-18 11:52:19.567423 | mon1 | ok: [mon3] 2026-08-18 11:52:19.567433 | mon1 | 2026-08-18 11:52:19.567455 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-18 11:52:19.567550 | mon1 | Tuesday 18 August 2026 11:52:19 +0000 (0:00:01.238) 0:00:01.246 ******** 2026-08-18 11:52:25.438543 | mon1 | ok: [mon2] 2026-08-18 11:52:25.438693 | mon1 | ok: [mon3] 2026-08-18 11:52:25.438736 | mon1 | ok: [mon1] 2026-08-18 11:52:25.438904 | mon1 | 2026-08-18 11:52:25.439154 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-18 11:52:25.439328 | mon1 | Tuesday 18 August 2026 11:52:25 +0000 (0:00:05.870) 0:00:07.117 ******** 2026-08-18 11:52:25.497591 | mon1 | ok: [mon1] 2026-08-18 11:52:25.497686 | mon1 | ok: [mon2] 2026-08-18 11:52:25.497792 | mon1 | ok: [mon3] 2026-08-18 11:52:25.497917 | mon1 | 2026-08-18 11:52:25.498070 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-18 11:52:25.498214 | mon1 | Tuesday 18 August 2026 11:52:25 +0000 (0:00:00.059) 0:00:07.177 ******** 2026-08-18 11:52:25.557890 | mon1 | ok: [mon1] => { 2026-08-18 11:52:25.558059 | mon1 | "changed": false, 2026-08-18 11:52:25.558283 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:25.558519 | mon1 | } 2026-08-18 11:52:25.558738 | mon1 | ok: [mon2] => { 2026-08-18 11:52:25.559007 | mon1 | "changed": false, 2026-08-18 11:52:25.559250 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:25.559537 | mon1 | } 2026-08-18 11:52:25.559775 | mon1 | ok: [mon3] => { 2026-08-18 11:52:25.559993 | mon1 | "changed": false, 2026-08-18 11:52:25.560229 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:25.560513 | mon1 | } 2026-08-18 11:52:25.560733 | mon1 | 2026-08-18 11:52:25.560964 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-18 11:52:25.561174 | mon1 | Tuesday 18 August 2026 11:52:25 +0000 (0:00:00.060) 0:00:07.237 ******** 2026-08-18 11:52:27.234414 | mon1 | ok: [mon2] 2026-08-18 11:52:27.234562 | mon1 | ok: [mon3] 2026-08-18 11:52:27.234792 | mon1 | ok: [mon1] 2026-08-18 11:52:27.235012 | mon1 | 2026-08-18 11:52:27.235235 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-18 11:52:27.235445 | mon1 | Tuesday 18 August 2026 11:52:27 +0000 (0:00:01.676) 0:00:08.913 ******** 2026-08-18 11:52:27.303483 | mon1 | ok: [mon1] => { 2026-08-18 11:52:27.303654 | mon1 | "_ceph_health": { 2026-08-18 11:52:27.303938 | mon1 | "changed": false, 2026-08-18 11:52:27.304070 | mon1 | "cmd": [ 2026-08-18 11:52:27.304317 | mon1 | "cephadm", 2026-08-18 11:52:27.304489 | mon1 | "shell", 2026-08-18 11:52:27.304742 | mon1 | "--", 2026-08-18 11:52:27.304937 | mon1 | "ceph", 2026-08-18 11:52:27.305140 | mon1 | "health" 2026-08-18 11:52:27.305349 | mon1 | ], 2026-08-18 11:52:27.305541 | mon1 | "delta": "0:00:01.448573", 2026-08-18 11:52:27.305743 | mon1 | "end": "2026-08-18 11:52:27.195051", 2026-08-18 11:52:27.305940 | mon1 | "failed": false, 2026-08-18 11:52:27.306119 | mon1 | "msg": "", 2026-08-18 11:52:27.306291 | mon1 | "rc": 0, 2026-08-18 11:52:27.306474 | mon1 | "start": "2026-08-18 11:52:25.746478", 2026-08-18 11:52:27.306694 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-18 11:52:27.306886 | mon1 | "stderr_lines": [ 2026-08-18 11:52:27.307126 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:52:27.307417 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-18 11:52:27.307591 | mon1 | ], 2026-08-18 11:52:27.307786 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:52:27.307970 | mon1 | "stdout_lines": [ 2026-08-18 11:52:27.308146 | mon1 | "HEALTH_OK" 2026-08-18 11:52:27.308339 | mon1 | ] 2026-08-18 11:52:27.308518 | mon1 | } 2026-08-18 11:52:27.308767 | mon1 | } 2026-08-18 11:52:27.308956 | mon1 | ok: [mon2] => { 2026-08-18 11:52:27.309149 | mon1 | "_ceph_health": { 2026-08-18 11:52:27.309352 | mon1 | "changed": false, 2026-08-18 11:52:27.309494 | mon1 | "cmd": [ 2026-08-18 11:52:27.309638 | mon1 | "cephadm", 2026-08-18 11:52:27.309765 | mon1 | "shell", 2026-08-18 11:52:27.309899 | mon1 | "--", 2026-08-18 11:52:27.310030 | mon1 | "ceph", 2026-08-18 11:52:27.310155 | mon1 | "health" 2026-08-18 11:52:27.310288 | mon1 | ], 2026-08-18 11:52:27.310418 | mon1 | "delta": "0:00:01.324060", 2026-08-18 11:52:27.310561 | mon1 | "end": "2026-08-18 11:52:27.063103", 2026-08-18 11:52:27.310693 | mon1 | "failed": false, 2026-08-18 11:52:27.310824 | mon1 | "msg": "", 2026-08-18 11:52:27.310976 | mon1 | "rc": 0, 2026-08-18 11:52:27.311118 | mon1 | "start": "2026-08-18 11:52:25.739043", 2026-08-18 11:52:27.311281 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon2/config", 2026-08-18 11:52:27.311411 | mon1 | "stderr_lines": [ 2026-08-18 11:52:27.311551 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:52:27.311699 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon2/config" 2026-08-18 11:52:27.311834 | mon1 | ], 2026-08-18 11:52:27.311970 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:52:27.312108 | mon1 | "stdout_lines": [ 2026-08-18 11:52:27.312238 | mon1 | "HEALTH_OK" 2026-08-18 11:52:27.312360 | mon1 | ] 2026-08-18 11:52:27.312488 | mon1 | } 2026-08-18 11:52:27.312695 | mon1 | } 2026-08-18 11:52:27.312791 | mon1 | ok: [mon3] => { 2026-08-18 11:52:27.312921 | mon1 | "_ceph_health": { 2026-08-18 11:52:27.313055 | mon1 | "changed": false, 2026-08-18 11:52:27.313184 | mon1 | "cmd": [ 2026-08-18 11:52:27.313314 | mon1 | "cephadm", 2026-08-18 11:52:27.313444 | mon1 | "shell", 2026-08-18 11:52:27.313575 | mon1 | "--", 2026-08-18 11:52:27.313711 | mon1 | "ceph", 2026-08-18 11:52:27.313848 | mon1 | "health" 2026-08-18 11:52:27.313980 | mon1 | ], 2026-08-18 11:52:27.314115 | mon1 | "delta": "0:00:01.350389", 2026-08-18 11:52:27.314263 | mon1 | "end": "2026-08-18 11:52:27.103432", 2026-08-18 11:52:27.314402 | mon1 | "failed": false, 2026-08-18 11:52:27.314541 | mon1 | "msg": "", 2026-08-18 11:52:27.314680 | mon1 | "rc": 0, 2026-08-18 11:52:27.314822 | mon1 | "start": "2026-08-18 11:52:25.753043", 2026-08-18 11:52:27.315000 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon3/config", 2026-08-18 11:52:27.315134 | mon1 | "stderr_lines": [ 2026-08-18 11:52:27.315269 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-18 11:52:27.315404 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon3/config" 2026-08-18 11:52:27.315524 | mon1 | ], 2026-08-18 11:52:27.315648 | mon1 | "stdout": "HEALTH_OK", 2026-08-18 11:52:27.315771 | mon1 | "stdout_lines": [ 2026-08-18 11:52:27.315905 | mon1 | "HEALTH_OK" 2026-08-18 11:52:27.316038 | mon1 | ] 2026-08-18 11:52:27.316156 | mon1 | } 2026-08-18 11:52:27.316285 | mon1 | } 2026-08-18 11:52:27.316402 | mon1 | 2026-08-18 11:52:27.316534 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-18 11:52:27.316687 | mon1 | Tuesday 18 August 2026 11:52:27 +0000 (0:00:00.069) 0:00:08.983 ******** 2026-08-18 11:52:27.354505 | mon1 | ok: [mon1] => { 2026-08-18 11:52:27.354601 | mon1 | "changed": false, 2026-08-18 11:52:27.354663 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:27.354789 | mon1 | } 2026-08-18 11:52:27.354914 | mon1 | ok: [mon2] => { 2026-08-18 11:52:27.355076 | mon1 | "changed": false, 2026-08-18 11:52:27.355196 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:27.355356 | mon1 | } 2026-08-18 11:52:27.355533 | mon1 | ok: [mon3] => { 2026-08-18 11:52:27.355707 | mon1 | "changed": false, 2026-08-18 11:52:27.355884 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:27.356053 | mon1 | } 2026-08-18 11:52:27.356216 | mon1 | 2026-08-18 11:52:27.356400 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-18 11:52:27.356578 | mon1 | Tuesday 18 August 2026 11:52:27 +0000 (0:00:00.050) 0:00:09.034 ******** 2026-08-18 11:52:35.997146 | mon1 | changed: [mon3] 2026-08-18 11:52:35.997232 | mon1 | changed: [mon2] 2026-08-18 11:52:35.997242 | mon1 | changed: [mon1] 2026-08-18 11:52:35.997252 | mon1 | 2026-08-18 11:52:35.997262 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-18 11:52:35.997272 | mon1 | Tuesday 18 August 2026 11:52:35 +0000 (0:00:08.641) 0:00:17.675 ******** 2026-08-18 11:52:39.208618 | mon1 | changed: [mon2] 2026-08-18 11:52:39.208714 | mon1 | changed: [mon3] 2026-08-18 11:52:39.209272 | mon1 | changed: [mon1] 2026-08-18 11:52:39.209332 | mon1 | 2026-08-18 11:52:39.209340 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-18 11:52:39.209347 | mon1 | Tuesday 18 August 2026 11:52:39 +0000 (0:00:03.213) 0:00:20.888 ******** 2026-08-18 11:52:40.940641 | mon1 | ok: [mon2] 2026-08-18 11:52:40.940728 | mon1 | ok: [mon3] 2026-08-18 11:52:40.941249 | mon1 | ok: [mon1] 2026-08-18 11:52:40.941270 | mon1 | 2026-08-18 11:52:40.941278 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-18 11:52:40.941285 | mon1 | Tuesday 18 August 2026 11:52:40 +0000 (0:00:01.732) 0:00:22.620 ******** 2026-08-18 11:52:41.007130 | mon1 | ok: [mon1] => { 2026-08-18 11:52:41.007196 | mon1 | "changed": false, 2026-08-18 11:52:41.008430 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:41.008510 | mon1 | } 2026-08-18 11:52:41.008517 | mon1 | ok: [mon2] => { 2026-08-18 11:52:41.008529 | mon1 | "changed": false, 2026-08-18 11:52:41.008536 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:41.008541 | mon1 | } 2026-08-18 11:52:41.008546 | mon1 | ok: [mon3] => { 2026-08-18 11:52:41.008552 | mon1 | "changed": false, 2026-08-18 11:52:41.008556 | mon1 | "msg": "All assertions passed" 2026-08-18 11:52:41.008562 | mon1 | } 2026-08-18 11:52:41.008567 | mon1 | 2026-08-18 11:52:41.008573 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-18 11:52:41.008579 | mon1 | Tuesday 18 August 2026 11:52:41 +0000 (0:00:00.066) 0:00:22.687 ******** 2026-08-18 11:52:41.195588 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 11:52:41.196544 | mon1 | fatal: [mon2]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 11:52:41.219012 | mon1 | fatal: [mon3]: FAILED! => {"changed": false, "msg": "value of state must be one of: present, update, absent, fetch_initial_keys, generate_secret, got: info"} 2026-08-18 11:52:41.222444 | mon1 | 2026-08-18 11:52:41.222480 | mon1 | PLAY RECAP ********************************************************************* 2026-08-18 11:52:41.222493 | mon1 | mon1 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 11:52:41.222503 | mon1 | mon2 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 11:52:41.222512 | mon1 | mon3 : ok=11 changed=2 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0 2026-08-18 11:52:41.222520 | mon1 | 2026-08-18 11:52:41.222529 | mon1 | 2026-08-18 11:52:41.222542 | mon1 | TASKS RECAP ******************************************************************** 2026-08-18 11:52:41.223200 | mon1 | Tuesday 18 August 2026 11:52:41 +0000 (0:00:00.214) 0:00:22.901 ******** 2026-08-18 11:52:41.223267 | mon1 | =============================================================================== 2026-08-18 11:52:41.223285 | mon1 | Create a test Ceph pool ------------------------------------------------- 8.64s 2026-08-18 11:52:41.225146 | mon1 | List locally deployed Ceph daemons -------------------------------------- 5.87s 2026-08-18 11:52:41.225164 | mon1 | Create a test Ceph key -------------------------------------------------- 3.21s 2026-08-18 11:52:41.225170 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.73s 2026-08-18 11:52:41.225174 | mon1 | Get cluster health status ----------------------------------------------- 1.68s 2026-08-18 11:52:41.225178 | mon1 | Gathering Facts --------------------------------------------------------- 1.24s 2026-08-18 11:52:41.225181 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.21s 2026-08-18 11:52:41.225185 | mon1 | Print cluster health status --------------------------------------------- 0.07s 2026-08-18 11:52:41.225189 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.07s 2026-08-18 11:52:41.225193 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.06s 2026-08-18 11:52:41.225197 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.06s 2026-08-18 11:52:41.225201 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.05s 2026-08-18 11:52:41.293872 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 11:52:41.294150 | mon1 | ERROR [default > verify] Executed: Failed 2026-08-18 11:52:41.294327 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml 2026-08-18 11:52:51.784411 | mon1 | ERROR 2026-08-18 11:52:51.784593 | mon1 | { 2026-08-18 11:52:51.784624 | mon1 | "delta": "0:11:58.101859", 2026-08-18 11:52:51.784649 | mon1 | "end": "2026-08-18 11:52:41.400673", 2026-08-18 11:52:51.784669 | mon1 | "msg": "non-zero return code", 2026-08-18 11:52:51.784688 | mon1 | "rc": 2, 2026-08-18 11:52:51.784707 | mon1 | "start": "2026-08-18 11:40:43.298814" 2026-08-18 11:52:51.784726 | mon1 | } failure 2026-08-18 11:52:51.819043 | 2026-08-18 11:52:51.819204 | PLAY RECAP 2026-08-18 11:52:51.819298 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-18 11:52:51.819354 | 2026-08-18 11:52:51.955521 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 11:52:51.960865 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 11:52:52.534691 | 2026-08-18 11:52:52.534970 | PLAY [all] 2026-08-18 11:52:52.546660 | 2026-08-18 11:52:52.546734 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 11:52:52.599474 | mon1 | ok 2026-08-18 11:52:52.604360 | mon2 | ok 2026-08-18 11:52:52.608154 | mon3 | ok 2026-08-18 11:52:52.622102 | osd1 | ok 2026-08-18 11:52:52.626314 | 2026-08-18 11:52:52.626376 | TASK [fetch-output : Set log path for single node] 2026-08-18 11:52:52.660100 | mon1 | skipping: Conditional result was False 2026-08-18 11:52:52.671228 | mon2 | skipping: Conditional result was False 2026-08-18 11:52:52.671460 | mon3 | skipping: Conditional result was False 2026-08-18 11:52:52.682057 | osd1 | skipping: Conditional result was False 2026-08-18 11:52:52.690877 | 2026-08-18 11:52:52.690942 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 11:52:53.043940 | osd1 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/logs/osd1" 2026-08-18 11:52:53.045123 | mon3 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/logs/mon3" 2026-08-18 11:52:53.054608 | mon2 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/logs/mon2" 2026-08-18 11:52:53.081276 | mon1 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/logs/mon1" 2026-08-18 11:52:53.247511 | mon2 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/artifacts" 2026-08-18 11:52:53.270011 | osd1 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/artifacts" 2026-08-18 11:52:53.273257 | mon1 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/artifacts" 2026-08-18 11:52:53.275116 | mon3 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/artifacts" 2026-08-18 11:52:53.462294 | mon2 -> localhost | changed: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/docs" 2026-08-18 11:52:53.470824 | osd1 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/docs" 2026-08-18 11:52:53.474650 | mon3 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/docs" 2026-08-18 11:52:53.474732 | mon3 -> localhost | changed: All items complete 2026-08-18 11:52:53.474773 | 2026-08-18 11:52:53.509579 | mon1 -> localhost | ok: "/var/lib/zuul/builds/c6f64d7b5f1d482885fef9dd894a9818/work/docs" 2026-08-18 11:52:53.509756 | mon1 -> localhost | changed: All items complete 2026-08-18 11:52:53.509819 | 2026-08-18 11:52:53.518374 | 2026-08-18 11:52:53.518490 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 11:52:54.150972 | mon1 | changed: .d..t...... ./ 2026-08-18 11:52:54.156919 | osd1 | changed: .d..t...... ./ 2026-08-18 11:52:54.161324 | mon3 | changed: .d..t...... ./ 2026-08-18 11:52:54.165680 | mon2 | changed: .d..t...... ./ 2026-08-18 11:52:54.588472 | mon1 | changed: .d..t...... ./ 2026-08-18 11:52:54.595605 | osd1 | ok 2026-08-18 11:52:54.611998 | mon2 | ok 2026-08-18 11:52:54.617644 | mon3 | ok 2026-08-18 11:52:55.048387 | mon1 | ok 2026-08-18 11:52:55.054832 | osd1 | changed: .d..t...... ./ 2026-08-18 11:52:55.059565 | mon3 | ok 2026-08-18 11:52:55.067808 | mon2 | ok 2026-08-18 11:52:55.067871 | mon2 | changed: All items complete 2026-08-18 11:52:55.067897 | 2026-08-18 11:52:55.141459 | 2026-08-18 11:52:55.141616 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 11:52:55.522766 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007345 2026-08-18 11:52:55.523267 | mon1 -> localhost | changed: All items complete 2026-08-18 11:52:55.523479 | 2026-08-18 11:52:55.740327 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006563 2026-08-18 11:52:55.770162 | 2026-08-18 11:52:55.770328 | PLAY [all] 2026-08-18 11:52:55.778350 | 2026-08-18 11:52:55.778424 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 11:52:56.148020 | mon1 | changed 2026-08-18 11:52:56.311991 | mon2 | changed 2026-08-18 11:52:56.319872 | osd1 | changed 2026-08-18 11:52:56.337775 | mon3 | changed 2026-08-18 11:52:56.357993 | 2026-08-18 11:52:56.358121 | PLAY RECAP 2026-08-18 11:52:56.358171 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 11:52:56.358222 | mon2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 11:52:56.358248 | mon3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 11:52:56.358271 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 11:52:56.358290 | 2026-08-18 11:52:56.559057 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 11:52:56.565427 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 11:52:57.152074 | 2026-08-18 11:52:57.152748 | PLAY [localhost] 2026-08-18 11:52:57.166638 | 2026-08-18 11:52:57.166755 | TASK [Generate Zuul manifest] 2026-08-18 11:52:57.189555 | localhost | ok 2026-08-18 11:52:57.212655 | 2026-08-18 11:52:57.212905 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 11:52:57.603902 | localhost | changed 2026-08-18 11:52:57.616785 | 2026-08-18 11:52:57.616876 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 11:52:57.650855 | localhost | ok 2026-08-18 11:52:57.660598 | 2026-08-18 11:52:57.660663 | TASK [Upload logs] 2026-08-18 11:52:57.682633 | localhost | ok 2026-08-18 11:52:57.752754 | 2026-08-18 11:52:57.752968 | TASK [Set zuul-log-path fact] 2026-08-18 11:52:57.775586 | localhost | ok 2026-08-18 11:52:57.789597 | 2026-08-18 11:52:57.789671 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 11:52:57.821365 | localhost | ok 2026-08-18 11:52:57.830175 | 2026-08-18 11:52:57.830249 | TASK [upload-logs : Create log directories] 2026-08-18 11:52:58.228535 | localhost | changed 2026-08-18 11:52:58.270477 | 2026-08-18 11:52:58.270639 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 11:52:58.617856 | localhost -> localhost | ok: Runtime: 0:00:00.005275 2026-08-18 11:52:58.624997 | 2026-08-18 11:52:58.625069 | TASK [upload-logs : Upload logs to log server] 2026-08-18 11:52:59.062585 | localhost | Output suppressed because no_log was given 2026-08-18 11:52:59.067463 | 2026-08-18 11:52:59.067549 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 11:52:59.109964 | localhost | skipping: Conditional result was False 2026-08-18 11:52:59.117963 | localhost | skipping: Conditional result was False 2026-08-18 11:52:59.132004 | 2026-08-18 11:52:59.132169 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 11:52:59.168913 | localhost | skipping: Conditional result was False 2026-08-18 11:52:59.169373 | 2026-08-18 11:52:59.173930 | localhost | skipping: Conditional result was False 2026-08-18 11:52:59.184812 | 2026-08-18 11:52:59.184990 | LOOP [upload-logs : Upload console log and json output]