2026-08-18 12:55:25.849062 | Job console starting 2026-08-18 12:55:25.874784 | Updating git repos 2026-08-18 12:55:25.908287 | Cloning repos into workspace 2026-08-18 12:55:26.009758 | Restoring repo states 2026-08-18 12:55:26.029141 | Merging changes 2026-08-18 12:55:26.448625 | Checking out repos 2026-08-18 12:55:26.618453 | Preparing playbooks 2026-08-18 12:55:28.291049 | Running Ansible setup 2026-08-18 12:55:33.291088 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 12:55:33.946870 | 2026-08-18 12:55:33.947005 | PLAY [localhost] 2026-08-18 12:55:33.954682 | 2026-08-18 12:55:33.954755 | TASK [Gathering Facts] 2026-08-18 12:55:34.885750 | localhost | ok 2026-08-18 12:55:34.895475 | 2026-08-18 12:55:34.895575 | TASK [Setup log path fact] 2026-08-18 12:55:34.914429 | localhost | ok 2026-08-18 12:55:34.927347 | 2026-08-18 12:55:34.927416 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 12:55:34.959160 | localhost | ok 2026-08-18 12:55:34.968648 | 2026-08-18 12:55:34.968758 | TASK [emit-job-header : Print job information] 2026-08-18 12:55:35.011435 | # Job Information 2026-08-18 12:55:35.011708 | Ansible Version: 2.16.18 2026-08-18 12:55:35.011780 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-08-18 12:55:35.011831 | Pipeline: check 2026-08-18 12:55:35.011875 | Executor: 2d72f0692154 2026-08-18 12:55:35.011920 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 12:55:35.011972 | Event ID: a98b4580-9b03-11f1-8895-8d0246b08d0b 2026-08-18 12:55:35.015778 | 2026-08-18 12:55:35.015846 | LOOP [emit-job-header : Print node information] 2026-08-18 12:55:35.150338 | localhost | ok: 2026-08-18 12:55:35.150573 | localhost | # Node Information 2026-08-18 12:55:35.150613 | localhost | Inventory Hostname: node1 2026-08-18 12:55:35.150644 | localhost | Hostname: np0000189985 2026-08-18 12:55:35.150672 | localhost | Username: zuul 2026-08-18 12:55:35.150708 | localhost | Distro: Ubuntu 22.04 2026-08-18 12:55:35.150737 | localhost | Provider: yul1 2026-08-18 12:55:35.150764 | localhost | Region: ca-ymq-1 2026-08-18 12:55:35.150790 | localhost | Label: ubuntu-jammy 2026-08-18 12:55:35.150816 | localhost | Product Name: OpenStack Nova 2026-08-18 12:55:35.150842 | localhost | Interface IP: 199.204.45.144 2026-08-18 12:55:35.191983 | localhost | ok: 2026-08-18 12:55:35.192085 | localhost | # Node Information 2026-08-18 12:55:35.192141 | localhost | Inventory Hostname: node2 2026-08-18 12:55:35.192188 | localhost | Hostname: np0000189986 2026-08-18 12:55:35.192231 | localhost | Username: zuul 2026-08-18 12:55:35.192273 | localhost | Distro: Ubuntu 22.04 2026-08-18 12:55:35.192314 | localhost | Provider: yul1 2026-08-18 12:55:35.192355 | localhost | Region: ca-ymq-1 2026-08-18 12:55:35.192394 | localhost | Label: ubuntu-jammy 2026-08-18 12:55:35.192433 | localhost | Product Name: OpenStack Nova 2026-08-18 12:55:35.192474 | localhost | Interface IP: 199.204.45.223 2026-08-18 12:55:35.234180 | localhost | ok: 2026-08-18 12:55:35.234254 | localhost | # Node Information 2026-08-18 12:55:35.234297 | localhost | Inventory Hostname: node3 2026-08-18 12:55:35.234332 | localhost | Hostname: np0000189987 2026-08-18 12:55:35.234367 | localhost | Username: zuul 2026-08-18 12:55:35.234400 | localhost | Distro: Ubuntu 22.04 2026-08-18 12:55:35.234432 | localhost | Provider: yul1 2026-08-18 12:55:35.234464 | localhost | Region: ca-ymq-1 2026-08-18 12:55:35.234496 | localhost | Label: ubuntu-jammy 2026-08-18 12:55:35.234532 | localhost | Product Name: OpenStack Nova 2026-08-18 12:55:35.234565 | localhost | Interface IP: 199.204.45.162 2026-08-18 12:55:35.249418 | 2026-08-18 12:55:35.249602 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 12:55:35.639355 | localhost -> localhost | changed 2026-08-18 12:55:35.649016 | 2026-08-18 12:55:35.649162 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 12:55:37.111182 | localhost -> localhost | changed 2026-08-18 12:55:37.122544 | 2026-08-18 12:55:37.122621 | PLAY [all] 2026-08-18 12:55:37.133930 | 2026-08-18 12:55:37.133996 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 12:55:37.391017 | node1 -> localhost | ok 2026-08-18 12:55:37.401729 | 2026-08-18 12:55:37.401798 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 12:55:37.432308 | node1 | ok 2026-08-18 12:55:37.439501 | node2 | ok 2026-08-18 12:55:37.456913 | node3 | ok 2026-08-18 12:55:37.521738 | node1 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 12:55:37.521865 | node2 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 12:55:37.521888 | node3 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 12:55:37.527857 | 2026-08-18 12:55:37.527919 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 12:55:38.514835 | node1 -> localhost | Generating public/private rsa key pair. 2026-08-18 12:55:38.515061 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/7d8c11bc745d44bf96d6d2e231924c91_id_rsa 2026-08-18 12:55:38.515107 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/7d8c11bc745d44bf96d6d2e231924c91_id_rsa.pub 2026-08-18 12:55:38.515162 | node1 -> localhost | The key fingerprint is: 2026-08-18 12:55:38.515198 | node1 -> localhost | SHA256:xzJbhqeUfD5MV/b8JajYn4NXEPls9TXl0sA1jHIAUe0 zuul-build-sshkey 2026-08-18 12:55:38.515231 | node1 -> localhost | The key's randomart image is: 2026-08-18 12:55:38.515263 | node1 -> localhost | +---[RSA 3072]----+ 2026-08-18 12:55:38.515294 | node1 -> localhost | | o+ooo+o+| 2026-08-18 12:55:38.515325 | node1 -> localhost | | .o+.*+| 2026-08-18 12:55:38.515357 | node1 -> localhost | | +++.*| 2026-08-18 12:55:38.515387 | node1 -> localhost | | . + .E++.| 2026-08-18 12:55:38.515416 | node1 -> localhost | | S O oo. +| 2026-08-18 12:55:38.515445 | node1 -> localhost | | . ^ o ..o| 2026-08-18 12:55:38.515474 | node1 -> localhost | | + *. . .| 2026-08-18 12:55:38.515503 | node1 -> localhost | | .oo. | 2026-08-18 12:55:38.515531 | node1 -> localhost | | .o. | 2026-08-18 12:55:38.515561 | node1 -> localhost | +----[SHA256]-----+ 2026-08-18 12:55:38.515640 | node1 -> localhost | ok: Runtime: 0:00:00.536919 2026-08-18 12:55:38.523921 | 2026-08-18 12:55:38.524043 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 12:55:38.563235 | node1 | ok 2026-08-18 12:55:38.569869 | node2 | ok 2026-08-18 12:55:38.576415 | node3 | ok 2026-08-18 12:55:38.595501 | node1 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 12:55:38.595626 | node2 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 12:55:38.595651 | node3 | included: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 12:55:38.609258 | 2026-08-18 12:55:38.609378 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 12:55:38.640906 | node1 | skipping: Conditional result was False 2026-08-18 12:55:38.641989 | node2 | skipping: Conditional result was False 2026-08-18 12:55:38.662550 | node3 | skipping: Conditional result was False 2026-08-18 12:55:38.674458 | 2026-08-18 12:55:38.674531 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 12:55:39.156282 | node2 | changed 2026-08-18 12:55:39.161382 | node1 | changed 2026-08-18 12:55:39.165311 | node3 | changed 2026-08-18 12:55:39.170866 | 2026-08-18 12:55:39.171368 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 12:55:39.359202 | node1 | ok 2026-08-18 12:55:39.365732 | node2 | ok 2026-08-18 12:55:39.385487 | node3 | ok 2026-08-18 12:55:39.392936 | 2026-08-18 12:55:39.393033 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 12:55:39.850538 | node2 | changed 2026-08-18 12:55:39.855942 | node1 | changed 2026-08-18 12:55:39.874551 | node3 | changed 2026-08-18 12:55:39.882034 | 2026-08-18 12:55:39.882107 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 12:55:40.359241 | node2 | changed 2026-08-18 12:55:40.363962 | node1 | changed 2026-08-18 12:55:40.401406 | node3 | changed 2026-08-18 12:55:40.409166 | 2026-08-18 12:55:40.409255 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 12:55:40.437454 | node1 | skipping: Conditional result was False 2026-08-18 12:55:40.448916 | node2 | skipping: Conditional result was False 2026-08-18 12:55:40.459596 | node3 | skipping: Conditional result was False 2026-08-18 12:55:40.469408 | 2026-08-18 12:55:40.469505 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 12:55:40.869074 | node1 -> localhost | changed 2026-08-18 12:55:40.889448 | 2026-08-18 12:55:40.889530 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 12:55:41.199149 | node1 -> localhost | Identity added: /var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/7d8c11bc745d44bf96d6d2e231924c91_id_rsa (zuul-build-sshkey) 2026-08-18 12:55:41.199330 | node1 -> localhost | ok: Runtime: 0:00:00.015907 2026-08-18 12:55:41.204144 | 2026-08-18 12:55:41.204207 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 12:55:41.544094 | node3 | ok 2026-08-18 12:55:41.550020 | node2 | ok 2026-08-18 12:55:41.555299 | node1 | ok 2026-08-18 12:55:41.559599 | 2026-08-18 12:55:41.559663 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 12:55:41.589306 | node1 | skipping: Conditional result was False 2026-08-18 12:55:41.610662 | node2 | skipping: Conditional result was False 2026-08-18 12:55:41.610928 | node3 | skipping: Conditional result was False 2026-08-18 12:55:41.628886 | 2026-08-18 12:55:41.628981 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 12:55:41.990096 | node1 | ok 2026-08-18 12:55:41.995373 | node2 | ok 2026-08-18 12:55:41.999086 | node3 | ok 2026-08-18 12:55:42.004068 | 2026-08-18 12:55:42.004127 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 12:55:42.687718 | node1 | Output suppressed because no_log was given 2026-08-18 12:55:42.692470 | node2 | Output suppressed because no_log was given 2026-08-18 12:55:42.720122 | node3 | Output suppressed because no_log was given 2026-08-18 12:55:42.742024 | 2026-08-18 12:55:42.742116 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 12:55:42.926666 | node1 | ok: "logs" 2026-08-18 12:55:42.927034 | node1 | ok: All items complete 2026-08-18 12:55:42.927160 | 2026-08-18 12:55:42.938111 | node2 | ok: "logs" 2026-08-18 12:55:42.966518 | node3 | ok: "logs" 2026-08-18 12:55:43.077753 | node1 | ok: "artifacts" 2026-08-18 12:55:43.110875 | node2 | ok: "artifacts" 2026-08-18 12:55:43.129209 | node3 | ok: "artifacts" 2026-08-18 12:55:43.241829 | node1 | ok: "docs" 2026-08-18 12:55:43.267321 | node2 | ok: "docs" 2026-08-18 12:55:43.291390 | node3 | ok: "docs" 2026-08-18 12:55:43.291491 | node3 | ok: All items complete 2026-08-18 12:55:43.291524 | 2026-08-18 12:55:43.306925 | 2026-08-18 12:55:43.307119 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 12:55:43.488594 | node1 | changed: "logs" 2026-08-18 12:55:43.499319 | node2 | changed: "logs" 2026-08-18 12:55:43.519727 | node3 | changed: "logs" 2026-08-18 12:55:43.652624 | node1 | changed: "artifacts" 2026-08-18 12:55:43.660139 | node2 | changed: "artifacts" 2026-08-18 12:55:43.691023 | node3 | changed: "artifacts" 2026-08-18 12:55:43.809357 | node2 | changed: "docs" 2026-08-18 12:55:43.816235 | node1 | changed: "docs" 2026-08-18 12:55:43.848263 | node3 | changed: "docs" 2026-08-18 12:55:43.848435 | node3 | changed: All items complete 2026-08-18 12:55:43.848516 | 2026-08-18 12:55:43.874731 | 2026-08-18 12:55:43.874861 | PLAY RECAP 2026-08-18 12:55:43.874915 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:43.874946 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 12:55:43.874971 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 12:55:43.874995 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 12:55:43.875014 | 2026-08-18 12:55:44.107261 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 12:55:44.119852 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 12:55:44.799355 | 2026-08-18 12:55:44.799506 | PLAY [all] 2026-08-18 12:55:44.811604 | 2026-08-18 12:55:44.811687 | TASK [setup-uv : Extract archive] 2026-08-18 12:55:47.009897 | node3 | changed 2026-08-18 12:55:47.095164 | node2 | changed 2026-08-18 12:55:47.126499 | node1 | changed 2026-08-18 12:55:47.135524 | 2026-08-18 12:55:47.135710 | TASK [setup-uv : Print version] 2026-08-18 12:55:47.519332 | node3 | uv 0.8.13 2026-08-18 12:55:47.524986 | node2 | uv 0.8.13 2026-08-18 12:55:47.517109 | node1 | uv 0.8.13 2026-08-18 12:55:47.709830 | node1 | ok: Runtime: 0:00:00.011326 2026-08-18 12:55:47.717743 | node3 | ok: Runtime: 0:00:00.012520 2026-08-18 12:55:47.725978 | node2 | ok: Runtime: 0:00:00.010416 2026-08-18 12:55:47.745474 | 2026-08-18 12:55:47.745546 | TASK [Install Ansible collection siblings] 2026-08-18 12:55:48.063461 | node1 | ok: 2026-08-18 12:55:48.063690 | node1 | Skipping community.crypto: no checked-out sibling 2026-08-18 12:55:48.063735 | node1 | Skipping community.docker: no checked-out sibling 2026-08-18 12:55:48.063767 | node1 | Skipping community.general: no checked-out sibling 2026-08-18 12:55:48.063796 | node1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 12:55:48.063827 | node1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 12:55:48.066391 | 2026-08-18 12:55:48.066456 | PLAY RECAP 2026-08-18 12:55:48.066521 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:48.066586 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:48.066625 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 12:55:48.066651 | 2026-08-18 12:55:48.232275 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 12:55:48.246891 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 12:55:48.880825 | 2026-08-18 12:55:48.880986 | PLAY [all] 2026-08-18 12:55:48.893936 | 2026-08-18 12:55:48.894054 | LOOP [Check inventory directories] 2026-08-18 12:55:49.229005 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 12:55:49.382567 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 12:55:49.539099 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 12:55:49.560279 | 2026-08-18 12:55:49.560550 | LOOP [Copy inventory file for Zuul] 2026-08-18 12:55:50.322952 | node1 | changed: 2026-08-18 12:55:50.323149 | node1 | { 2026-08-18 12:55:50.323177 | node1 | "ansible_loop_var": "item", 2026-08-18 12:55:50.323201 | node1 | "changed": false, 2026-08-18 12:55:50.323221 | node1 | "failed": false, 2026-08-18 12:55:50.323245 | node1 | "invocation": { 2026-08-18 12:55:50.323264 | node1 | "module_args": { 2026-08-18 12:55:50.323298 | node1 | "checksum_algorithm": "sha1", 2026-08-18 12:55:50.323318 | node1 | "follow": true, 2026-08-18 12:55:50.323336 | node1 | "get_attributes": true, 2026-08-18 12:55:50.323355 | node1 | "get_checksum": true, 2026-08-18 12:55:50.323373 | node1 | "get_mime": true, 2026-08-18 12:55:50.323391 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 12:55:50.323410 | node1 | } 2026-08-18 12:55:50.323427 | node1 | }, 2026-08-18 12:55:50.323445 | node1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 12:55:50.323463 | node1 | "stat": { 2026-08-18 12:55:50.323481 | node1 | "atime": 1787057742.5723977, 2026-08-18 12:55:50.323499 | node1 | "attr_flags": "e", 2026-08-18 12:55:50.323517 | node1 | "attributes": [ 2026-08-18 12:55:50.323536 | node1 | "extents" 2026-08-18 12:55:50.323553 | node1 | ], 2026-08-18 12:55:50.323570 | node1 | "block_size": 4096, 2026-08-18 12:55:50.323587 | node1 | "blocks": 8, 2026-08-18 12:55:50.323605 | node1 | "charset": "unknown", 2026-08-18 12:55:50.323623 | node1 | "ctime": 1787057742.5844018, 2026-08-18 12:55:50.323642 | node1 | "dev": 64513, 2026-08-18 12:55:50.323660 | node1 | "device_type": 0, 2026-08-18 12:55:50.323677 | node1 | "executable": true, 2026-08-18 12:55:50.323694 | node1 | "exists": true, 2026-08-18 12:55:50.323711 | node1 | "gid": 1000, 2026-08-18 12:55:50.323729 | node1 | "gr_name": "zuul", 2026-08-18 12:55:50.323746 | node1 | "inode": 1042461, 2026-08-18 12:55:50.323763 | node1 | "isblk": false, 2026-08-18 12:55:50.323781 | node1 | "ischr": false, 2026-08-18 12:55:50.323798 | node1 | "isdir": true, 2026-08-18 12:55:50.323815 | node1 | "isfifo": false, 2026-08-18 12:55:50.323832 | node1 | "isgid": false, 2026-08-18 12:55:50.323848 | node1 | "islnk": false, 2026-08-18 12:55:50.323866 | node1 | "isreg": false, 2026-08-18 12:55:50.323883 | node1 | "issock": false, 2026-08-18 12:55:50.323900 | node1 | "isuid": false, 2026-08-18 12:55:50.323917 | node1 | "mimetype": "unknown", 2026-08-18 12:55:50.323935 | node1 | "mode": "0755", 2026-08-18 12:55:50.323952 | node1 | "mtime": 1787057726.3916416, 2026-08-18 12:55:50.323969 | node1 | "nlink": 10, 2026-08-18 12:55:50.323986 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 12:55:50.324003 | node1 | "pw_name": "zuul", 2026-08-18 12:55:50.324021 | node1 | "readable": true, 2026-08-18 12:55:50.324038 | node1 | "rgrp": true, 2026-08-18 12:55:50.324055 | node1 | "roth": true, 2026-08-18 12:55:50.324073 | node1 | "rusr": true, 2026-08-18 12:55:50.324090 | node1 | "size": 4096, 2026-08-18 12:55:50.324107 | node1 | "uid": 1000, 2026-08-18 12:55:50.324123 | node1 | "version": "2647721695", 2026-08-18 12:55:50.324141 | node1 | "wgrp": false, 2026-08-18 12:55:50.324159 | node1 | "woth": false, 2026-08-18 12:55:50.324177 | node1 | "writeable": true, 2026-08-18 12:55:50.324194 | node1 | "wusr": true, 2026-08-18 12:55:50.324210 | node1 | "xgrp": true, 2026-08-18 12:55:50.324227 | node1 | "xoth": true, 2026-08-18 12:55:50.324244 | node1 | "xusr": true 2026-08-18 12:55:50.324261 | node1 | } 2026-08-18 12:55:50.324278 | node1 | } 2026-08-18 12:55:50.324313 | node1 | ok: All items complete 2026-08-18 12:55:50.324334 | 2026-08-18 12:55:50.325845 | node1 | skipping: Conditional result was False 2026-08-18 12:55:50.326431 | node1 | skipping: Conditional result was False 2026-08-18 12:55:50.337357 | 2026-08-18 12:55:50.337519 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 12:55:50.669162 | node1 | changed: 3 replacements made 2026-08-18 12:55:50.671077 | node1 | skipping: Conditional result was False 2026-08-18 12:55:50.671952 | node1 | skipping: Conditional result was False 2026-08-18 12:55:50.689006 | 2026-08-18 12:55:50.689140 | TASK [Run Molecule scenario] 2026-08-18 12:55:51.303259 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-08-18 12:55:52.046225 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-08-18 12:55:52.227915 | node1 | Using CPython 3.13.7 2026-08-18 12:55:52.228029 | node1 | Creating virtual environment at: .venv 2026-08-18 12:55:52.271405 | node1 | Downloading pygments (1.2MiB) 2026-08-18 12:55:52.271574 | node1 | Downloading netaddr (2.2MiB) 2026-08-18 12:55:52.272263 | node1 | Downloading ansible-core (2.1MiB) 2026-08-18 12:55:52.274048 | node1 | Downloading cryptography (4.3MiB) 2026-08-18 12:55:52.460673 | node1 | Downloading netaddr 2026-08-18 12:55:52.468644 | node1 | Downloading cryptography 2026-08-18 12:55:52.508608 | node1 | Downloading pygments 2026-08-18 12:55:52.607241 | node1 | Downloading ansible-core 2026-08-18 12:55:52.641805 | node1 | Installed 42 packages in 33ms 2026-08-18 12:55:53.786604 | node1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 12:55:53.786717 | node1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 12:55:54.399819 | node1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 12:55:54.399940 | node1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 12:56:24.352001 | node1 | INFO [default > dependency] Executing 2026-08-18 12:56:24.352153 | node1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 12:56:24.352213 | node1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 12:56:24.352337 | node1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 12:56:24.357287 | node1 | INFO [default > cleanup] Executing 2026-08-18 12:56:24.357557 | node1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 12:56:24.362488 | node1 | INFO [default > destroy] Executing 2026-08-18 12:56:24.362515 | node1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 12:56:24.362578 | node1 | INFO [default > destroy] Executed: Successful 2026-08-18 12:56:24.367488 | node1 | INFO [default > syntax] Executing 2026-08-18 12:56:25.526848 | node1 | 2026-08-18 12:56:25.527082 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 12:56:25.662444 | node1 | INFO [default > syntax] Executed: Successful 2026-08-18 12:56:25.672669 | node1 | INFO [default > create] Executing 2026-08-18 12:56:25.674541 | node1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 12:56:25.680658 | node1 | INFO [default > prepare] Executing 2026-08-18 12:56:26.428450 | node1 | 2026-08-18 12:56:26.428654 | node1 | PLAY [Prepare] ***************************************************************** 2026-08-18 12:56:26.428849 | node1 | 2026-08-18 12:56:26.429059 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:56:26.429262 | node1 | Tuesday 18 August 2026 12:56:26 +0000 (0:00:00.031) 0:00:00.031 ******** 2026-08-18 12:56:27.617097 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 12:56:27.617307 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:56:27.617511 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:56:27.617711 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:56:27.617888 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:56:27.619637 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 12:56:27.619763 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:56:27.619885 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:56:27.620010 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:56:27.620138 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:56:27.622509 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 12:56:27.622628 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:56:27.622748 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:56:27.622866 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:56:27.622987 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:56:27.628305 | node1 | ok: [node3] 2026-08-18 12:56:27.628490 | node1 | ok: [node2] 2026-08-18 12:56:27.628678 | node1 | ok: [node1] 2026-08-18 12:56:27.628857 | node1 | 2026-08-18 12:56:27.629094 | node1 | TASK [Configure short hostname] ************************************************ 2026-08-18 12:56:27.629295 | node1 | Tuesday 18 August 2026 12:56:27 +0000 (0:00:01.200) 0:00:01.231 ******** 2026-08-18 12:56:28.389572 | node1 | changed: [node1] 2026-08-18 12:56:28.389659 | node1 | changed: [node2] 2026-08-18 12:56:28.389670 | node1 | changed: [node3] 2026-08-18 12:56:28.389746 | node1 | 2026-08-18 12:56:28.389853 | node1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 12:56:28.389953 | node1 | Tuesday 18 August 2026 12:56:28 +0000 (0:00:00.760) 0:00:01.992 ******** 2026-08-18 12:56:28.646104 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 12:56:28.646204 | node1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 12:56:28.646220 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 12:56:28.663153 | node1 | changed: [node3] 2026-08-18 12:56:28.663199 | node1 | changed: [node1] 2026-08-18 12:56:28.663292 | node1 | changed: [node2] 2026-08-18 12:56:28.663378 | node1 | 2026-08-18 12:56:28.663472 | node1 | TASK [Update apt cache] ******************************************************** 2026-08-18 12:56:28.663564 | node1 | Tuesday 18 August 2026 12:56:28 +0000 (0:00:00.273) 0:00:02.266 ******** 2026-08-18 12:56:35.962575 | node1 | changed: [node3] 2026-08-18 12:56:35.962733 | node1 | changed: [node1] 2026-08-18 12:56:35.962954 | node1 | changed: [node2] 2026-08-18 12:56:35.963166 | node1 | 2026-08-18 12:56:35.963388 | node1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 12:56:35.963556 | node1 | 2026-08-18 12:56:35.963757 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:56:35.963950 | node1 | Tuesday 18 August 2026 12:56:35 +0000 (0:00:07.299) 0:00:09.565 ******** 2026-08-18 12:56:36.696980 | node1 | ok: [node1] 2026-08-18 12:56:36.697134 | node1 | ok: [node2] 2026-08-18 12:56:36.697325 | node1 | ok: [node3] 2026-08-18 12:56:36.697504 | node1 | 2026-08-18 12:56:36.697703 | node1 | TASK [Install depedencies] ***************************************************** 2026-08-18 12:56:36.697903 | node1 | Tuesday 18 August 2026 12:56:36 +0000 (0:00:00.734) 0:00:10.300 ******** 2026-08-18 12:57:06.534744 | node1 | changed: [node1] 2026-08-18 12:57:06.534905 | node1 | changed: [node3] 2026-08-18 12:57:06.535108 | node1 | changed: [node2] 2026-08-18 12:57:06.535305 | node1 | 2026-08-18 12:57:06.535516 | node1 | TASK [Start up service] ******************************************************** 2026-08-18 12:57:06.535735 | node1 | Tuesday 18 August 2026 12:57:06 +0000 (0:00:29.836) 0:00:40.137 ******** 2026-08-18 12:57:07.133755 | node1 | ok: [node3] 2026-08-18 12:57:07.133890 | node1 | ok: [node2] 2026-08-18 12:57:07.133901 | node1 | ok: [node1] 2026-08-18 12:57:07.133981 | node1 | 2026-08-18 12:57:07.134075 | node1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 12:57:07.134168 | node1 | Tuesday 18 August 2026 12:57:07 +0000 (0:00:00.599) 0:00:40.736 ******** 2026-08-18 12:57:07.453859 | node1 | ok: [node2] 2026-08-18 12:57:07.454031 | node1 | ok: [node3] 2026-08-18 12:57:07.454266 | node1 | ok: [node1] 2026-08-18 12:57:07.454574 | node1 | 2026-08-18 12:57:07.454788 | node1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 12:57:07.455004 | node1 | Tuesday 18 August 2026 12:57:07 +0000 (0:00:00.320) 0:00:41.056 ******** 2026-08-18 12:57:08.154951 | node1 | changed: [node2] 2026-08-18 12:57:08.155066 | node1 | changed: [node1] 2026-08-18 12:57:08.155210 | node1 | changed: [node3] 2026-08-18 12:57:08.155327 | node1 | 2026-08-18 12:57:08.155470 | node1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 12:57:08.155608 | node1 | Tuesday 18 August 2026 12:57:08 +0000 (0:00:00.701) 0:00:41.758 ******** 2026-08-18 12:57:08.358857 | node1 | ok: [node1] 2026-08-18 12:57:08.359006 | node1 | ok: [node3] 2026-08-18 12:57:08.359165 | node1 | ok: [node2] 2026-08-18 12:57:08.359314 | node1 | 2026-08-18 12:57:08.359474 | node1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 12:57:08.359619 | node1 | Tuesday 18 August 2026 12:57:08 +0000 (0:00:00.203) 0:00:41.962 ******** 2026-08-18 12:57:08.385527 | node1 | skipping: [node1] 2026-08-18 12:57:08.385729 | node1 | skipping: [node2] 2026-08-18 12:57:08.385928 | node1 | skipping: [node3] 2026-08-18 12:57:08.386113 | node1 | 2026-08-18 12:57:08.386367 | node1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 12:57:08.386572 | node1 | Tuesday 18 August 2026 12:57:08 +0000 (0:00:00.027) 0:00:41.989 ******** 2026-08-18 12:57:08.954542 | node1 | changed: [node1] => (item=osd0) 2026-08-18 12:57:08.954721 | node1 | changed: [node3] => (item=osd0) 2026-08-18 12:57:08.954953 | node1 | changed: [node2] => (item=osd0) 2026-08-18 12:57:08.955158 | node1 | changed: [node1] => (item=osd1) 2026-08-18 12:57:08.955352 | node1 | changed: [node3] => (item=osd1) 2026-08-18 12:57:08.955532 | node1 | changed: [node2] => (item=osd1) 2026-08-18 12:57:08.955732 | node1 | changed: [node1] => (item=osd2) 2026-08-18 12:57:08.955913 | node1 | changed: [node3] => (item=osd2) 2026-08-18 12:57:08.956102 | node1 | changed: [node2] => (item=osd2) 2026-08-18 12:57:08.956283 | node1 | 2026-08-18 12:57:08.956480 | node1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 12:57:08.956675 | node1 | Tuesday 18 August 2026 12:57:08 +0000 (0:00:00.568) 0:00:42.557 ******** 2026-08-18 12:57:09.615371 | node1 | changed: [node1] => (item=osd0) 2026-08-18 12:57:09.615533 | node1 | changed: [node3] => (item=osd0) 2026-08-18 12:57:09.615739 | node1 | changed: [node2] => (item=osd0) 2026-08-18 12:57:09.615934 | node1 | changed: [node1] => (item=osd1) 2026-08-18 12:57:09.616130 | node1 | changed: [node2] => (item=osd1) 2026-08-18 12:57:09.616325 | node1 | changed: [node3] => (item=osd1) 2026-08-18 12:57:09.616522 | node1 | changed: [node1] => (item=osd2) 2026-08-18 12:57:09.616717 | node1 | changed: [node2] => (item=osd2) 2026-08-18 12:57:09.616910 | node1 | changed: [node3] => (item=osd2) 2026-08-18 12:57:09.617092 | node1 | 2026-08-18 12:57:09.617293 | node1 | TASK [Start loop devices] ****************************************************** 2026-08-18 12:57:09.617493 | node1 | Tuesday 18 August 2026 12:57:09 +0000 (0:00:00.660) 0:00:43.217 ******** 2026-08-18 12:57:10.319992 | node1 | changed: [node1] => (item=osd0) 2026-08-18 12:57:10.320081 | node1 | changed: [node2] => (item=osd0) 2026-08-18 12:57:10.320199 | node1 | changed: [node3] => (item=osd0) 2026-08-18 12:57:10.320314 | node1 | changed: [node1] => (item=osd1) 2026-08-18 12:57:10.320432 | node1 | changed: [node3] => (item=osd1) 2026-08-18 12:57:10.320551 | node1 | changed: [node2] => (item=osd1) 2026-08-18 12:57:10.320673 | node1 | changed: [node3] => (item=osd2) 2026-08-18 12:57:10.320812 | node1 | changed: [node1] => (item=osd2) 2026-08-18 12:57:10.320957 | node1 | changed: [node2] => (item=osd2) 2026-08-18 12:57:10.321067 | node1 | 2026-08-18 12:57:10.321191 | node1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 12:57:10.321313 | node1 | Tuesday 18 August 2026 12:57:10 +0000 (0:00:00.704) 0:00:43.922 ******** 2026-08-18 12:57:13.595609 | node1 | changed: [node2] => (item=osd0) 2026-08-18 12:57:13.595782 | node1 | changed: [node1] => (item=osd0) 2026-08-18 12:57:13.595975 | node1 | changed: [node3] => (item=osd0) 2026-08-18 12:57:13.596168 | node1 | changed: [node2] => (item=osd1) 2026-08-18 12:57:13.596356 | node1 | changed: [node1] => (item=osd1) 2026-08-18 12:57:13.596543 | node1 | changed: [node3] => (item=osd1) 2026-08-18 12:57:13.596723 | node1 | changed: [node2] => (item=osd2) 2026-08-18 12:57:13.596918 | node1 | changed: [node3] => (item=osd2) 2026-08-18 12:57:13.597098 | node1 | changed: [node1] => (item=osd2) 2026-08-18 12:57:13.597274 | node1 | 2026-08-18 12:57:13.597499 | node1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 12:57:13.597705 | node1 | Tuesday 18 August 2026 12:57:13 +0000 (0:00:03.276) 0:00:47.198 ******** 2026-08-18 12:57:15.638392 | node1 | changed: [node1] => (item=ceph-node1-osd0) 2026-08-18 12:57:15.638709 | node1 | changed: [node2] => (item=ceph-node2-osd0) 2026-08-18 12:57:15.638728 | node1 | changed: [node3] => (item=ceph-node3-osd0) 2026-08-18 12:57:15.638738 | node1 | changed: [node1] => (item=ceph-node1-osd1) 2026-08-18 12:57:15.638747 | node1 | changed: [node2] => (item=ceph-node2-osd1) 2026-08-18 12:57:15.638755 | node1 | changed: [node3] => (item=ceph-node3-osd1) 2026-08-18 12:57:15.638764 | node1 | changed: [node1] => (item=ceph-node1-osd2) 2026-08-18 12:57:15.638781 | node1 | changed: [node2] => (item=ceph-node2-osd2) 2026-08-18 12:57:15.638790 | node1 | changed: [node3] => (item=ceph-node3-osd2) 2026-08-18 12:57:15.638801 | node1 | 2026-08-18 12:57:15.641842 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 12:57:15.641866 | node1 | node1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 12:57:15.641874 | node1 | node2 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 12:57:15.641880 | node1 | node3 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 12:57:15.641886 | node1 | 2026-08-18 12:57:15.641891 | node1 | 2026-08-18 12:57:15.641897 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 12:57:15.641903 | node1 | Tuesday 18 August 2026 12:57:15 +0000 (0:00:02.042) 0:00:49.241 ******** 2026-08-18 12:57:15.641908 | node1 | =============================================================================== 2026-08-18 12:57:15.641914 | node1 | Install depedencies ---------------------------------------------------- 29.84s 2026-08-18 12:57:15.641919 | node1 | Update apt cache -------------------------------------------------------- 7.30s 2026-08-18 12:57:15.641925 | node1 | Create a volume group for each loop device ------------------------------ 3.28s 2026-08-18 12:57:15.641930 | node1 | Create a logical volume for each loop device ---------------------------- 2.04s 2026-08-18 12:57:15.641936 | node1 | Gathering Facts --------------------------------------------------------- 1.20s 2026-08-18 12:57:15.641941 | node1 | Configure short hostname ------------------------------------------------ 0.76s 2026-08-18 12:57:15.641947 | node1 | Gathering Facts --------------------------------------------------------- 0.73s 2026-08-18 12:57:15.641953 | node1 | Start loop devices ------------------------------------------------------ 0.70s 2026-08-18 12:57:15.641964 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.70s 2026-08-18 12:57:15.641970 | node1 | Set permissions on loopback devices ------------------------------------- 0.66s 2026-08-18 12:57:15.641976 | node1 | Start up service -------------------------------------------------------- 0.60s 2026-08-18 12:57:15.641981 | node1 | Create devices for Ceph ------------------------------------------------- 0.57s 2026-08-18 12:57:15.641987 | node1 | Generate lvm.conf ------------------------------------------------------- 0.32s 2026-08-18 12:57:15.641993 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-08-18 12:57:15.641998 | node1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-08-18 12:57:15.642004 | node1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-08-18 12:57:15.715672 | node1 | INFO [default > prepare] Executed: Successful 2026-08-18 12:57:15.724943 | node1 | INFO [default > converge] Executing 2026-08-18 12:57:16.751844 | node1 | 2026-08-18 12:57:16.752217 | node1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 12:57:16.752467 | node1 | 2026-08-18 12:57:16.752725 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 12:57:16.752988 | node1 | Tuesday 18 August 2026 12:57:16 +0000 (0:00:00.078) 0:00:00.078 ******** 2026-08-18 12:57:17.848572 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 12:57:17.848652 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:57:17.848679 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:57:17.848684 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:57:17.848689 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:57:17.897674 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 12:57:17.897759 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:57:17.897771 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:57:17.897782 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:57:17.897792 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:57:17.903435 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 12:57:17.903457 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-08-18 12:57:17.903465 | node1 | interpreter could change the meaning of that path. See 2026-08-18 12:57:17.903471 | node1 | https://docs.ansible.com/ansible- 2026-08-18 12:57:17.903477 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 12:57:17.958345 | node1 | ok: [node1] 2026-08-18 12:57:17.958399 | node1 | ok: [node2] 2026-08-18 12:57:17.958414 | node1 | ok: [node3] 2026-08-18 12:57:17.958426 | node1 | 2026-08-18 12:57:17.958534 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:57:17.958622 | node1 | Tuesday 18 August 2026 12:57:17 +0000 (0:00:01.206) 0:00:01.284 ******** 2026-08-18 12:57:18.280947 | node1 | ok: [node1] 2026-08-18 12:57:18.281126 | node1 | ok: [node2] 2026-08-18 12:57:18.281319 | node1 | ok: [node3] 2026-08-18 12:57:18.281496 | node1 | 2026-08-18 12:57:18.281702 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:57:18.281897 | node1 | Tuesday 18 August 2026 12:57:18 +0000 (0:00:00.322) 0:00:01.607 ******** 2026-08-18 12:57:18.363562 | node1 | skipping: [node1] 2026-08-18 12:57:18.363787 | node1 | skipping: [node2] 2026-08-18 12:57:18.364033 | node1 | skipping: [node3] 2026-08-18 12:57:18.364247 | node1 | 2026-08-18 12:57:18.364495 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 12:57:18.364748 | node1 | Tuesday 18 August 2026 12:57:18 +0000 (0:00:00.082) 0:00:01.689 ******** 2026-08-18 12:57:18.713097 | node1 | changed: [node2] 2026-08-18 12:57:18.713266 | node1 | changed: [node3] 2026-08-18 12:57:18.713458 | node1 | changed: [node1] 2026-08-18 12:57:18.713638 | node1 | 2026-08-18 12:57:18.713840 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:57:18.714036 | node1 | Tuesday 18 August 2026 12:57:18 +0000 (0:00:00.349) 0:00:02.039 ******** 2026-08-18 12:57:18.816713 | node1 | ok: [node1] => { 2026-08-18 12:57:18.816800 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 12:57:18.816888 | node1 | } 2026-08-18 12:57:18.817034 | node1 | ok: [node3] => { 2026-08-18 12:57:18.817164 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 12:57:18.817270 | node1 | } 2026-08-18 12:57:18.817370 | node1 | ok: [node2] => { 2026-08-18 12:57:18.817498 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 12:57:18.817598 | node1 | } 2026-08-18 12:57:18.817702 | node1 | 2026-08-18 12:57:18.817818 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:57:18.817938 | node1 | Tuesday 18 August 2026 12:57:18 +0000 (0:00:00.103) 0:00:02.142 ******** 2026-08-18 12:57:19.586084 | node1 | changed: [node2] 2026-08-18 12:57:19.586162 | node1 | changed: [node3] 2026-08-18 12:57:19.586173 | node1 | changed: [node1] 2026-08-18 12:57:19.586183 | node1 | 2026-08-18 12:57:19.586192 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:57:19.586202 | node1 | Tuesday 18 August 2026 12:57:19 +0000 (0:00:00.768) 0:00:02.911 ******** 2026-08-18 12:57:19.689170 | node1 | skipping: [node1] 2026-08-18 12:57:19.689706 | node1 | skipping: [node2] 2026-08-18 12:57:19.689772 | node1 | skipping: [node3] 2026-08-18 12:57:19.689778 | node1 | 2026-08-18 12:57:19.689796 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:57:19.689802 | node1 | Tuesday 18 August 2026 12:57:19 +0000 (0:00:00.104) 0:00:03.015 ******** 2026-08-18 12:57:19.721527 | node1 | skipping: [node1] 2026-08-18 12:57:19.788105 | node1 | skipping: [node2] 2026-08-18 12:57:19.788182 | node1 | skipping: [node3] 2026-08-18 12:57:19.788272 | node1 | 2026-08-18 12:57:19.788371 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:57:19.788503 | node1 | Tuesday 18 August 2026 12:57:19 +0000 (0:00:00.099) 0:00:03.114 ******** 2026-08-18 12:57:20.043484 | node1 | ok: [node1] 2026-08-18 12:57:20.043555 | node1 | ok: [node2] 2026-08-18 12:57:20.043956 | node1 | ok: [node3] 2026-08-18 12:57:20.044019 | node1 | 2026-08-18 12:57:20.044026 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 12:57:20.044038 | node1 | Tuesday 18 August 2026 12:57:20 +0000 (0:00:00.254) 0:00:03.369 ******** 2026-08-18 12:57:21.352843 | node1 | ok: [node1] 2026-08-18 12:57:21.352935 | node1 | ok: [node3] 2026-08-18 12:57:21.352971 | node1 | ok: [node2] 2026-08-18 12:57:21.353267 | node1 | 2026-08-18 12:57:21.353331 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:57:21.353338 | node1 | Tuesday 18 August 2026 12:57:21 +0000 (0:00:01.309) 0:00:04.679 ******** 2026-08-18 12:57:21.461755 | node1 | ok: [node1] => { 2026-08-18 12:57:21.461846 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 12:57:21.461913 | node1 | } 2026-08-18 12:57:21.462414 | node1 | ok: [node2] => { 2026-08-18 12:57:21.462511 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 12:57:21.462519 | node1 | } 2026-08-18 12:57:21.462525 | node1 | ok: [node3] => { 2026-08-18 12:57:21.462531 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 12:57:21.462547 | node1 | } 2026-08-18 12:57:21.462553 | node1 | 2026-08-18 12:57:21.462744 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:57:21.462814 | node1 | Tuesday 18 August 2026 12:57:21 +0000 (0:00:00.109) 0:00:04.788 ******** 2026-08-18 12:57:22.295755 | node1 | changed: [node2] 2026-08-18 12:57:22.296013 | node1 | changed: [node1] 2026-08-18 12:57:22.296027 | node1 | changed: [node3] 2026-08-18 12:57:22.296414 | node1 | 2026-08-18 12:57:22.296467 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:57:22.296475 | node1 | Tuesday 18 August 2026 12:57:22 +0000 (0:00:00.833) 0:00:05.621 ******** 2026-08-18 12:57:25.200006 | node1 | changed: [node1] 2026-08-18 12:57:25.200111 | node1 | changed: [node3] 2026-08-18 12:57:25.200122 | node1 | changed: [node2] 2026-08-18 12:57:25.200424 | node1 | 2026-08-18 12:57:25.200484 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 12:57:25.200490 | node1 | Tuesday 18 August 2026 12:57:25 +0000 (0:00:02.904) 0:00:08.526 ******** 2026-08-18 12:57:25.232854 | node1 | skipping: [node1] 2026-08-18 12:57:25.259624 | node1 | skipping: [node2] 2026-08-18 12:57:25.260154 | node1 | skipping: [node3] 2026-08-18 12:57:25.260263 | node1 | 2026-08-18 12:57:25.260270 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 12:57:25.260277 | node1 | Tuesday 18 August 2026 12:57:25 +0000 (0:00:00.059) 0:00:08.585 ******** 2026-08-18 12:57:25.289934 | node1 | skipping: [node1] 2026-08-18 12:57:25.320442 | node1 | skipping: [node2] 2026-08-18 12:57:25.320964 | node1 | skipping: [node3] 2026-08-18 12:57:25.321029 | node1 | 2026-08-18 12:57:25.321037 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 12:57:25.321043 | node1 | Tuesday 18 August 2026 12:57:25 +0000 (0:00:00.060) 0:00:08.646 ******** 2026-08-18 12:57:25.353590 | node1 | skipping: [node1] 2026-08-18 12:57:25.382686 | node1 | skipping: [node2] 2026-08-18 12:57:25.382804 | node1 | skipping: [node3] 2026-08-18 12:57:25.382925 | node1 | 2026-08-18 12:57:25.383242 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 12:57:25.383316 | node1 | Tuesday 18 August 2026 12:57:25 +0000 (0:00:00.062) 0:00:08.709 ******** 2026-08-18 12:57:31.993334 | node1 | changed: [node2] 2026-08-18 12:57:31.993639 | node1 | changed: [node1] 2026-08-18 12:57:31.993813 | node1 | changed: [node3] 2026-08-18 12:57:31.993974 | node1 | 2026-08-18 12:57:31.994156 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 12:57:31.994370 | node1 | Tuesday 18 August 2026 12:57:31 +0000 (0:00:06.605) 0:00:15.314 ******** 2026-08-18 12:57:32.522124 | node1 | changed: [node2] 2026-08-18 12:57:32.522198 | node1 | changed: [node1] 2026-08-18 12:57:32.522205 | node1 | changed: [node3] 2026-08-18 12:57:32.522212 | node1 | 2026-08-18 12:57:32.522218 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 12:57:32.522225 | node1 | Tuesday 18 August 2026 12:57:32 +0000 (0:00:00.532) 0:00:15.847 ******** 2026-08-18 12:57:33.410482 | node1 | changed: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 12:57:33.410560 | node1 | changed: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 12:57:33.410571 | node1 | changed: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 12:57:33.410581 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 12:57:33.410593 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 12:57:33.410602 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 12:57:33.410611 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 12:57:33.410620 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 12:57:33.410629 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 12:57:33.410638 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 12:57:33.410648 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 12:57:33.410658 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 12:57:33.410667 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 12:57:33.410677 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 12:57:33.410696 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 12:57:33.410705 | node1 | 2026-08-18 12:57:33.410726 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 12:57:33.410738 | node1 | Tuesday 18 August 2026 12:57:33 +0000 (0:00:00.885) 0:00:16.733 ******** 2026-08-18 12:57:34.056572 | node1 | changed: [node1] 2026-08-18 12:57:34.056699 | node1 | changed: [node2] 2026-08-18 12:57:34.056893 | node1 | changed: [node3] 2026-08-18 12:57:34.057076 | node1 | 2026-08-18 12:57:34.057285 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 12:57:34.057509 | node1 | Tuesday 18 August 2026 12:57:34 +0000 (0:00:00.625) 0:00:17.359 ******** 2026-08-18 12:57:34.057733 | node1 | 2026-08-18 12:57:34.057992 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 12:57:34.058199 | node1 | Tuesday 18 August 2026 12:57:34 +0000 (0:00:00.010) 0:00:17.369 ******** 2026-08-18 12:57:34.058415 | node1 | 2026-08-18 12:57:34.058610 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 12:57:34.058804 | node1 | Tuesday 18 August 2026 12:57:34 +0000 (0:00:00.006) 0:00:17.376 ******** 2026-08-18 12:57:34.058973 | node1 | 2026-08-18 12:57:34.059178 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 12:57:34.059401 | node1 | Tuesday 18 August 2026 12:57:34 +0000 (0:00:00.006) 0:00:17.382 ******** 2026-08-18 12:57:34.968298 | node1 | ok: [node1] 2026-08-18 12:57:34.968644 | node1 | ok: [node3] 2026-08-18 12:57:34.968903 | node1 | ok: [node2] 2026-08-18 12:57:34.969174 | node1 | 2026-08-18 12:57:34.969468 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 12:57:34.969734 | node1 | Tuesday 18 August 2026 12:57:34 +0000 (0:00:00.912) 0:00:18.294 ******** 2026-08-18 12:57:35.430063 | node1 | changed: [node1] 2026-08-18 12:57:35.430140 | node1 | changed: [node2] 2026-08-18 12:57:35.430147 | node1 | changed: [node3] 2026-08-18 12:57:35.430153 | node1 | 2026-08-18 12:57:35.430160 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 12:57:35.430166 | node1 | Tuesday 18 August 2026 12:57:35 +0000 (0:00:00.461) 0:00:18.755 ******** 2026-08-18 12:57:36.002861 | node1 | changed: [node1] 2026-08-18 12:57:36.002917 | node1 | changed: [node3] 2026-08-18 12:57:36.002923 | node1 | changed: [node2] 2026-08-18 12:57:36.002927 | node1 | 2026-08-18 12:57:36.002932 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 12:57:36.002937 | node1 | Tuesday 18 August 2026 12:57:36 +0000 (0:00:00.573) 0:00:19.329 ******** 2026-08-18 12:57:36.259055 | node1 | ok: [node1] 2026-08-18 12:57:36.259113 | node1 | ok: [node2] 2026-08-18 12:57:36.259118 | node1 | ok: [node3] 2026-08-18 12:57:36.259123 | node1 | 2026-08-18 12:57:36.259128 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:57:36.259132 | node1 | Tuesday 18 August 2026 12:57:36 +0000 (0:00:00.256) 0:00:19.585 ******** 2026-08-18 12:57:36.349541 | node1 | ok: [node1] => { 2026-08-18 12:57:36.349603 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 12:57:36.349609 | node1 | } 2026-08-18 12:57:36.349613 | node1 | ok: [node2] => { 2026-08-18 12:57:36.349617 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 12:57:36.349621 | node1 | } 2026-08-18 12:57:36.349625 | node1 | ok: [node3] => { 2026-08-18 12:57:36.349629 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 12:57:36.349633 | node1 | } 2026-08-18 12:57:36.349638 | node1 | 2026-08-18 12:57:36.349642 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:57:36.349647 | node1 | Tuesday 18 August 2026 12:57:36 +0000 (0:00:00.089) 0:00:19.675 ******** 2026-08-18 12:57:37.226126 | node1 | changed: [node2] 2026-08-18 12:57:37.226220 | node1 | changed: [node3] 2026-08-18 12:57:37.226754 | node1 | changed: [node1] 2026-08-18 12:57:37.226918 | node1 | 2026-08-18 12:57:37.226927 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:57:37.226934 | node1 | Tuesday 18 August 2026 12:57:37 +0000 (0:00:00.877) 0:00:20.552 ******** 2026-08-18 12:57:41.679558 | node1 | changed: [node1] 2026-08-18 12:57:41.679635 | node1 | changed: [node2] 2026-08-18 12:57:41.679680 | node1 | changed: [node3] 2026-08-18 12:57:41.679763 | node1 | 2026-08-18 12:57:41.679863 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 12:57:41.679954 | node1 | Tuesday 18 August 2026 12:57:41 +0000 (0:00:04.449) 0:00:25.001 ******** 2026-08-18 12:57:42.789240 | node1 | ok: [node2] 2026-08-18 12:57:42.789403 | node1 | ok: [node3] 2026-08-18 12:57:42.789608 | node1 | ok: [node1] 2026-08-18 12:57:42.789799 | node1 | 2026-08-18 12:57:42.790076 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 12:57:42.790446 | node1 | Tuesday 18 August 2026 12:57:42 +0000 (0:00:01.113) 0:00:26.115 ******** 2026-08-18 12:57:43.130053 | node1 | changed: [node1] 2026-08-18 12:57:43.130221 | node1 | changed: [node2] 2026-08-18 12:57:43.130486 | node1 | changed: [node3] 2026-08-18 12:57:43.130622 | node1 | 2026-08-18 12:57:43.130874 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 12:57:43.131017 | node1 | Tuesday 18 August 2026 12:57:43 +0000 (0:00:00.340) 0:00:26.456 ******** 2026-08-18 12:57:43.588712 | node1 | changed: [node1] 2026-08-18 12:57:43.588926 | node1 | changed: [node2] 2026-08-18 12:57:43.589148 | node1 | changed: [node3] 2026-08-18 12:57:43.589360 | node1 | 2026-08-18 12:57:43.589595 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 12:57:43.589824 | node1 | Tuesday 18 August 2026 12:57:43 +0000 (0:00:00.458) 0:00:26.915 ******** 2026-08-18 12:57:44.172661 | node1 | changed: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 12:57:44.172731 | node1 | changed: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 12:57:44.173647 | node1 | changed: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 12:57:44.173694 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 12:57:44.173701 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 12:57:44.173705 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 12:57:44.173710 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 12:57:44.173714 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 12:57:44.173718 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 12:57:44.173722 | node1 | 2026-08-18 12:57:44.173726 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 12:57:44.173731 | node1 | Tuesday 18 August 2026 12:57:44 +0000 (0:00:00.584) 0:00:27.499 ******** 2026-08-18 12:57:44.665008 | node1 | changed: [node1] 2026-08-18 12:57:44.665077 | node1 | changed: [node2] 2026-08-18 12:57:44.665614 | node1 | changed: [node3] 2026-08-18 12:57:44.665661 | node1 | 2026-08-18 12:57:44.665669 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 12:57:44.665676 | node1 | Tuesday 18 August 2026 12:57:44 +0000 (0:00:00.492) 0:00:27.991 ******** 2026-08-18 12:57:45.146024 | node1 | changed: [node1] 2026-08-18 12:57:45.146095 | node1 | changed: [node2] 2026-08-18 12:57:45.146160 | node1 | changed: [node3] 2026-08-18 12:57:45.146342 | node1 | 2026-08-18 12:57:45.146382 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 12:57:45.147266 | node1 | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.460) 0:00:28.452 ******** 2026-08-18 12:57:45.147310 | node1 | 2026-08-18 12:57:45.147316 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 12:57:45.147326 | node1 | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.006) 0:00:28.459 ******** 2026-08-18 12:57:45.147331 | node1 | 2026-08-18 12:57:45.147335 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 12:57:45.147339 | node1 | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.007) 0:00:28.466 ******** 2026-08-18 12:57:45.147343 | node1 | 2026-08-18 12:57:45.147347 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 12:57:45.147351 | node1 | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.006) 0:00:28.472 ******** 2026-08-18 12:57:45.898108 | node1 | ok: [node2] 2026-08-18 12:57:45.898149 | node1 | ok: [node1] 2026-08-18 12:57:45.898154 | node1 | ok: [node3] 2026-08-18 12:57:45.898159 | node1 | 2026-08-18 12:57:45.898164 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 12:57:45.898169 | node1 | Tuesday 18 August 2026 12:57:45 +0000 (0:00:00.751) 0:00:29.224 ******** 2026-08-18 12:57:47.149877 | node1 | changed: [node1] 2026-08-18 12:57:47.149966 | node1 | changed: [node3] 2026-08-18 12:57:47.150378 | node1 | changed: [node2] 2026-08-18 12:57:47.150446 | node1 | 2026-08-18 12:57:47.150458 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 12:57:47.150475 | node1 | Tuesday 18 August 2026 12:57:47 +0000 (0:00:01.251) 0:00:30.476 ******** 2026-08-18 12:57:47.736318 | node1 | changed: [node1] 2026-08-18 12:57:47.736401 | node1 | changed: [node2] 2026-08-18 12:57:47.736418 | node1 | changed: [node3] 2026-08-18 12:57:47.736687 | node1 | 2026-08-18 12:57:47.736732 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 12:57:47.736738 | node1 | Tuesday 18 August 2026 12:57:47 +0000 (0:00:00.586) 0:00:31.063 ******** 2026-08-18 12:57:47.765574 | node1 | ok: [node1] => { 2026-08-18 12:57:47.765659 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 12:57:47.765750 | node1 | } 2026-08-18 12:57:47.795047 | node1 | ok: [node2] => { 2026-08-18 12:57:47.795088 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 12:57:47.795192 | node1 | } 2026-08-18 12:57:47.795267 | node1 | ok: [node3] => { 2026-08-18 12:57:47.795723 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 12:57:47.795774 | node1 | } 2026-08-18 12:57:47.795780 | node1 | 2026-08-18 12:57:47.795785 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 12:57:47.795789 | node1 | Tuesday 18 August 2026 12:57:47 +0000 (0:00:00.058) 0:00:31.122 ******** 2026-08-18 12:57:49.233805 | node1 | changed: [node1] 2026-08-18 12:57:49.233875 | node1 | changed: [node2] 2026-08-18 12:57:49.233889 | node1 | changed: [node3] 2026-08-18 12:57:49.234217 | node1 | 2026-08-18 12:57:49.234261 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 12:57:49.234268 | node1 | Tuesday 18 August 2026 12:57:49 +0000 (0:00:01.438) 0:00:32.560 ******** 2026-08-18 12:57:49.263593 | node1 | skipping: [node1] 2026-08-18 12:57:49.316721 | node1 | skipping: [node2] 2026-08-18 12:57:49.316772 | node1 | skipping: [node3] 2026-08-18 12:57:49.316869 | node1 | 2026-08-18 12:57:49.316966 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 12:57:49.317099 | node1 | Tuesday 18 August 2026 12:57:49 +0000 (0:00:00.083) 0:00:32.643 ******** 2026-08-18 12:57:49.349256 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 12:57:49.395954 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 12:57:49.396479 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 12:57:49.396504 | node1 | 2026-08-18 12:57:49.396511 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 12:57:49.396518 | node1 | Tuesday 18 August 2026 12:57:49 +0000 (0:00:00.078) 0:00:32.722 ******** 2026-08-18 12:57:54.752793 | node1 | changed: [node1] 2026-08-18 12:57:54.752961 | node1 | changed: [node2] 2026-08-18 12:57:54.752974 | node1 | changed: [node3] 2026-08-18 12:57:54.752990 | node1 | 2026-08-18 12:57:54.753000 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 12:57:54.753012 | node1 | Tuesday 18 August 2026 12:57:54 +0000 (0:00:05.356) 0:00:38.079 ******** 2026-08-18 12:57:55.410158 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 12:57:55.410233 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 12:57:55.410323 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 12:57:55.410867 | node1 | ok: [node2] => (item=sshd) 2026-08-18 12:57:55.410912 | node1 | ok: [node1] => (item=sshd) 2026-08-18 12:57:55.410917 | node1 | ok: [node3] => (item=sshd) 2026-08-18 12:57:55.410921 | node1 | 2026-08-18 12:57:55.410926 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 12:57:55.410931 | node1 | Tuesday 18 August 2026 12:57:55 +0000 (0:00:00.657) 0:00:38.736 ******** 2026-08-18 12:57:55.626352 | node1 | ok: [node1] 2026-08-18 12:57:55.626415 | node1 | ok: [node2] 2026-08-18 12:57:55.626544 | node1 | ok: [node3] 2026-08-18 12:57:55.626660 | node1 | 2026-08-18 12:57:55.626794 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 12:57:55.627027 | node1 | Tuesday 18 August 2026 12:57:55 +0000 (0:00:00.216) 0:00:38.952 ******** 2026-08-18 12:57:56.048990 | node1 | changed: [node2] 2026-08-18 12:57:56.049183 | node1 | changed: [node1] 2026-08-18 12:57:56.049382 | node1 | changed: [node3] 2026-08-18 12:57:56.049571 | node1 | 2026-08-18 12:57:56.049841 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 12:57:56.050049 | node1 | Tuesday 18 August 2026 12:57:56 +0000 (0:00:00.422) 0:00:39.375 ******** 2026-08-18 12:57:56.536043 | node1 | changed: [node1] 2026-08-18 12:57:56.536145 | node1 | changed: [node2] 2026-08-18 12:57:56.536277 | node1 | changed: [node3] 2026-08-18 12:57:56.536392 | node1 | 2026-08-18 12:57:56.536557 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 12:57:56.536757 | node1 | Tuesday 18 August 2026 12:57:56 +0000 (0:00:00.486) 0:00:39.862 ******** 2026-08-18 12:57:56.562486 | node1 | skipping: [node1] 2026-08-18 12:57:56.590161 | node1 | skipping: [node2] 2026-08-18 12:57:56.590396 | node1 | skipping: [node3] 2026-08-18 12:57:56.590582 | node1 | 2026-08-18 12:57:56.590789 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 12:57:56.591001 | node1 | Tuesday 18 August 2026 12:57:56 +0000 (0:00:00.054) 0:00:39.916 ******** 2026-08-18 12:58:35.650560 | node1 | changed: [node2] 2026-08-18 12:58:35.650679 | node1 | changed: [node1] 2026-08-18 12:58:35.650919 | node1 | changed: [node3] 2026-08-18 12:58:35.651049 | node1 | 2026-08-18 12:58:35.651406 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 12:58:35.651601 | node1 | Tuesday 18 August 2026 12:58:35 +0000 (0:00:39.059) 0:01:18.976 ******** 2026-08-18 12:58:36.160471 | node1 | changed: [node1] 2026-08-18 12:58:36.160638 | node1 | changed: [node3] 2026-08-18 12:58:36.160851 | node1 | changed: [node2] 2026-08-18 12:58:36.161047 | node1 | 2026-08-18 12:58:36.161276 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 12:58:36.161491 | node1 | Tuesday 18 August 2026 12:58:36 +0000 (0:00:00.510) 0:01:19.486 ******** 2026-08-18 12:58:36.275284 | node1 | ok: [node2] 2026-08-18 12:58:36.275469 | node1 | ok: [node1] 2026-08-18 12:58:36.275666 | node1 | ok: [node3] 2026-08-18 12:58:36.275906 | node1 | 2026-08-18 12:58:36.276090 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 12:58:36.276279 | node1 | Tuesday 18 August 2026 12:58:36 +0000 (0:00:00.114) 0:01:19.601 ******** 2026-08-18 12:58:36.337612 | node1 | ok: [node1] => { 2026-08-18 12:58:36.337777 | node1 | "changed": false, 2026-08-18 12:58:36.337984 | node1 | "msg": "All assertions passed" 2026-08-18 12:58:36.338182 | node1 | } 2026-08-18 12:58:36.338562 | node1 | ok: [node2] => { 2026-08-18 12:58:36.338785 | node1 | "changed": false, 2026-08-18 12:58:36.338986 | node1 | "msg": "All assertions passed" 2026-08-18 12:58:36.339179 | node1 | } 2026-08-18 12:58:36.339376 | node1 | ok: [node3] => { 2026-08-18 12:58:36.339580 | node1 | "changed": false, 2026-08-18 12:58:36.339758 | node1 | "msg": "All assertions passed" 2026-08-18 12:58:36.339957 | node1 | } 2026-08-18 12:58:36.340127 | node1 | 2026-08-18 12:58:36.340329 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 12:58:36.340530 | node1 | Tuesday 18 August 2026 12:58:36 +0000 (0:00:00.062) 0:01:19.664 ******** 2026-08-18 12:58:36.365005 | node1 | ok: [node1] 2026-08-18 12:58:36.400522 | node1 | ok: [node2] 2026-08-18 12:58:36.400686 | node1 | ok: [node3] 2026-08-18 12:58:36.400869 | node1 | 2026-08-18 12:58:36.401082 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 12:58:36.401283 | node1 | Tuesday 18 August 2026 12:58:36 +0000 (0:00:00.062) 0:01:19.726 ******** 2026-08-18 12:58:36.971504 | node1 | ok: [node1] => (item=node1) 2026-08-18 12:58:36.971568 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 12:58:36.971580 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 12:58:36.971590 | node1 | 2026-08-18 12:58:36.971600 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 12:58:36.971610 | node1 | Tuesday 18 August 2026 12:58:36 +0000 (0:00:00.569) 0:01:20.296 ******** 2026-08-18 12:58:37.039947 | node1 | ok: [node1] 2026-08-18 12:58:37.040021 | node1 | ok: [node2] 2026-08-18 12:58:37.040513 | node1 | ok: [node3] 2026-08-18 12:58:37.040562 | node1 | 2026-08-18 12:58:37.040570 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 12:58:37.040577 | node1 | Tuesday 18 August 2026 12:58:37 +0000 (0:00:00.069) 0:01:20.366 ******** 2026-08-18 12:58:37.158324 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3 2026-08-18 12:58:37.158408 | node1 | 2026-08-18 12:58:37.158513 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 12:58:37.158640 | node1 | Tuesday 18 August 2026 12:58:37 +0000 (0:00:00.118) 0:01:20.485 ******** 2026-08-18 12:58:37.361770 | node1 | skipping: [node2] 2026-08-18 12:58:37.361863 | node1 | skipping: [node3] 2026-08-18 12:58:37.361895 | node1 | changed: [node1] 2026-08-18 12:58:37.362203 | node1 | 2026-08-18 12:58:37.362247 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 12:58:37.362253 | node1 | Tuesday 18 August 2026 12:58:37 +0000 (0:00:00.203) 0:01:20.688 ******** 2026-08-18 12:58:37.397126 | node1 | skipping: [node1] 2026-08-18 12:58:37.433329 | node1 | skipping: [node2] 2026-08-18 12:58:37.433408 | node1 | skipping: [node3] 2026-08-18 12:58:37.433702 | node1 | 2026-08-18 12:58:37.433748 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 12:58:37.433754 | node1 | Tuesday 18 August 2026 12:58:37 +0000 (0:00:00.071) 0:01:20.759 ******** 2026-08-18 12:58:37.469634 | node1 | skipping: [node1] 2026-08-18 12:58:37.502249 | node1 | skipping: [node2] 2026-08-18 12:58:37.502339 | node1 | skipping: [node3] 2026-08-18 12:58:37.502472 | node1 | 2026-08-18 12:58:37.502753 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 12:58:37.502785 | node1 | Tuesday 18 August 2026 12:58:37 +0000 (0:00:00.069) 0:01:20.829 ******** 2026-08-18 12:58:39.014468 | node1 | skipping: [node2] 2026-08-18 12:58:39.014574 | node1 | skipping: [node3] 2026-08-18 12:58:39.015515 | node1 | changed: [node1] 2026-08-18 12:58:39.015561 | node1 | 2026-08-18 12:58:39.015569 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 12:58:39.015576 | node1 | Tuesday 18 August 2026 12:58:39 +0000 (0:00:01.511) 0:01:22.340 ******** 2026-08-18 12:58:39.289716 | node1 | skipping: [node2] 2026-08-18 12:58:39.289778 | node1 | skipping: [node3] 2026-08-18 12:58:39.289855 | node1 | changed: [node1] 2026-08-18 12:58:39.290129 | node1 | 2026-08-18 12:58:39.290146 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 12:58:39.290152 | node1 | Tuesday 18 August 2026 12:58:39 +0000 (0:00:00.275) 0:01:22.616 ******** 2026-08-18 12:58:39.323495 | node1 | skipping: [node1] 2026-08-18 12:58:39.349196 | node1 | skipping: [node2] 2026-08-18 12:58:39.349307 | node1 | skipping: [node3] 2026-08-18 12:58:39.349416 | node1 | 2026-08-18 12:58:39.349684 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 12:58:39.349705 | node1 | Tuesday 18 August 2026 12:58:39 +0000 (0:00:00.059) 0:01:22.675 ******** 2026-08-18 12:59:16.787329 | node1 | skipping: [node2] 2026-08-18 12:59:16.787417 | node1 | skipping: [node3] 2026-08-18 12:59:16.787478 | node1 | changed: [node1] 2026-08-18 12:59:16.787752 | node1 | 2026-08-18 12:59:16.787792 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 12:59:16.787798 | node1 | Tuesday 18 August 2026 12:59:16 +0000 (0:00:37.437) 0:02:00.113 ******** 2026-08-18 12:59:16.992998 | node1 | skipping: [node2] 2026-08-18 12:59:16.993069 | node1 | skipping: [node3] 2026-08-18 12:59:16.993158 | node1 | changed: [node1] 2026-08-18 12:59:16.993472 | node1 | 2026-08-18 12:59:16.993511 | node1 | TASK [Register this monitor host] ********************************************** 2026-08-18 12:59:16.993517 | node1 | Tuesday 18 August 2026 12:59:16 +0000 (0:00:00.205) 0:02:00.319 ******** 2026-08-18 12:59:17.129310 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 12:59:17.129376 | node1 | 2026-08-18 12:59:17.129573 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 12:59:17.129616 | node1 | Tuesday 18 August 2026 12:59:17 +0000 (0:00:00.136) 0:02:00.456 ******** 2026-08-18 12:59:18.624387 | node1 | ok: [node1] 2026-08-18 12:59:18.624445 | node1 | 2026-08-18 12:59:18.624454 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 12:59:18.624461 | node1 | Tuesday 18 August 2026 12:59:18 +0000 (0:00:01.494) 0:02:01.950 ******** 2026-08-18 12:59:18.696165 | node1 | ok: [node1] 2026-08-18 12:59:18.696215 | node1 | ok: [node2] 2026-08-18 12:59:18.696224 | node1 | ok: [node3] 2026-08-18 12:59:18.696231 | node1 | 2026-08-18 12:59:18.696238 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 12:59:18.696245 | node1 | Tuesday 18 August 2026 12:59:18 +0000 (0:00:00.071) 0:02:02.021 ******** 2026-08-18 12:59:18.766381 | node1 | ok: [node1] => { 2026-08-18 12:59:18.766444 | node1 | "changed": false, 2026-08-18 12:59:18.766453 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:18.766460 | node1 | } 2026-08-18 12:59:18.766466 | node1 | ok: [node2] => { 2026-08-18 12:59:18.766472 | node1 | "changed": false, 2026-08-18 12:59:18.766478 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:18.766484 | node1 | } 2026-08-18 12:59:18.766490 | node1 | ok: [node3] => { 2026-08-18 12:59:18.766496 | node1 | "changed": false, 2026-08-18 12:59:18.766501 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:18.766507 | node1 | } 2026-08-18 12:59:18.766514 | node1 | 2026-08-18 12:59:18.766520 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 12:59:18.766527 | node1 | Tuesday 18 August 2026 12:59:18 +0000 (0:00:00.069) 0:02:02.091 ******** 2026-08-18 12:59:19.118216 | node1 | changed: [node3] 2026-08-18 12:59:19.118254 | node1 | ok: [node1] 2026-08-18 12:59:19.118259 | node1 | changed: [node2] 2026-08-18 12:59:19.118264 | node1 | 2026-08-18 12:59:19.118269 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 12:59:19.118293 | node1 | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.353) 0:02:02.444 ******** 2026-08-18 12:59:19.188375 | node1 | ok: [node1] 2026-08-18 12:59:19.188434 | node1 | ok: [node2] 2026-08-18 12:59:19.188441 | node1 | ok: [node3] 2026-08-18 12:59:19.188447 | node1 | 2026-08-18 12:59:19.188454 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 12:59:19.188460 | node1 | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.069) 0:02:02.514 ******** 2026-08-18 12:59:19.296403 | node1 | ok: [node1] 2026-08-18 12:59:19.296453 | node1 | ok: [node2] 2026-08-18 12:59:19.296459 | node1 | ok: [node3] 2026-08-18 12:59:19.296465 | node1 | 2026-08-18 12:59:19.296478 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 12:59:19.296484 | node1 | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.108) 0:02:02.622 ******** 2026-08-18 12:59:19.362604 | node1 | ok: [node1] => { 2026-08-18 12:59:19.362642 | node1 | "changed": false, 2026-08-18 12:59:19.362648 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:19.362653 | node1 | } 2026-08-18 12:59:19.362657 | node1 | ok: [node2] => { 2026-08-18 12:59:19.362661 | node1 | "changed": false, 2026-08-18 12:59:19.362665 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:19.362670 | node1 | } 2026-08-18 12:59:19.362674 | node1 | ok: [node3] => { 2026-08-18 12:59:19.362678 | node1 | "changed": false, 2026-08-18 12:59:19.362682 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:19.362686 | node1 | } 2026-08-18 12:59:19.362690 | node1 | 2026-08-18 12:59:19.362694 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 12:59:19.362699 | node1 | Tuesday 18 August 2026 12:59:19 +0000 (0:00:00.065) 0:02:02.688 ******** 2026-08-18 12:59:38.764646 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:38.764697 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:38.764705 | node1 | changed: [node1] 2026-08-18 12:59:38.764711 | node1 | 2026-08-18 12:59:38.764718 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 12:59:38.764724 | node1 | Tuesday 18 August 2026 12:59:38 +0000 (0:00:19.402) 0:02:22.090 ******** 2026-08-18 12:59:38.850367 | node1 | skipping: [node1] 2026-08-18 12:59:38.850431 | node1 | skipping: [node2] 2026-08-18 12:59:38.850519 | node1 | skipping: [node3] 2026-08-18 12:59:38.850789 | node1 | 2026-08-18 12:59:38.850804 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 12:59:38.850809 | node1 | Tuesday 18 August 2026 12:59:38 +0000 (0:00:00.086) 0:02:22.177 ******** 2026-08-18 12:59:47.766986 | node1 | changed: [node1] 2026-08-18 12:59:47.767060 | node1 | 2026-08-18 12:59:47.767134 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 12:59:47.767264 | node1 | Tuesday 18 August 2026 12:59:47 +0000 (0:00:08.916) 0:02:31.093 ******** 2026-08-18 12:59:49.413467 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:49.413551 | node1 | ok: [node1] 2026-08-18 12:59:49.413560 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:49.413867 | node1 | 2026-08-18 12:59:49.413905 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 12:59:49.413911 | node1 | Tuesday 18 August 2026 12:59:49 +0000 (0:00:01.646) 0:02:32.740 ******** 2026-08-18 12:59:50.018100 | node1 | ok: [node1] => (item=node1) 2026-08-18 12:59:50.018153 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 12:59:50.018260 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 12:59:50.018529 | node1 | 2026-08-18 12:59:50.018573 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 12:59:50.018595 | node1 | Tuesday 18 August 2026 12:59:50 +0000 (0:00:00.604) 0:02:33.344 ******** 2026-08-18 12:59:50.076572 | node1 | ok: [node1] 2026-08-18 12:59:50.076636 | node1 | ok: [node2] 2026-08-18 12:59:50.076988 | node1 | ok: [node3] 2026-08-18 12:59:50.077004 | node1 | 2026-08-18 12:59:50.077009 | node1 | TASK [Register this manager host] ********************************************** 2026-08-18 12:59:50.077014 | node1 | Tuesday 18 August 2026 12:59:50 +0000 (0:00:00.058) 0:02:33.403 ******** 2026-08-18 12:59:50.192599 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 12:59:50.192664 | node1 | 2026-08-18 12:59:50.192749 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 12:59:50.192851 | node1 | Tuesday 18 August 2026 12:59:50 +0000 (0:00:00.116) 0:02:33.519 ******** 2026-08-18 12:59:51.587887 | node1 | ok: [node1] 2026-08-18 12:59:51.588381 | node1 | 2026-08-18 12:59:51.588449 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 12:59:51.588458 | node1 | Tuesday 18 August 2026 12:59:51 +0000 (0:00:01.394) 0:02:34.914 ******** 2026-08-18 12:59:51.661634 | node1 | ok: [node1] 2026-08-18 12:59:51.661704 | node1 | ok: [node2] 2026-08-18 12:59:51.661785 | node1 | ok: [node3] 2026-08-18 12:59:51.662093 | node1 | 2026-08-18 12:59:51.662136 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 12:59:51.662141 | node1 | Tuesday 18 August 2026 12:59:51 +0000 (0:00:00.074) 0:02:34.988 ******** 2026-08-18 12:59:51.735517 | node1 | ok: [node1] => { 2026-08-18 12:59:51.735629 | node1 | "changed": false, 2026-08-18 12:59:51.736892 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:51.736939 | node1 | } 2026-08-18 12:59:51.736945 | node1 | ok: [node2] => { 2026-08-18 12:59:51.736950 | node1 | "changed": false, 2026-08-18 12:59:51.736954 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:51.736958 | node1 | } 2026-08-18 12:59:51.736963 | node1 | ok: [node3] => { 2026-08-18 12:59:51.736967 | node1 | "changed": false, 2026-08-18 12:59:51.736971 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:51.736975 | node1 | } 2026-08-18 12:59:51.736979 | node1 | 2026-08-18 12:59:51.736983 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 12:59:51.736988 | node1 | Tuesday 18 August 2026 12:59:51 +0000 (0:00:00.073) 0:02:35.061 ******** 2026-08-18 12:59:52.015306 | node1 | ok: [node1] 2026-08-18 12:59:52.015378 | node1 | ok: [node2] 2026-08-18 12:59:52.015471 | node1 | ok: [node3] 2026-08-18 12:59:52.015800 | node1 | 2026-08-18 12:59:52.015842 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 12:59:52.015849 | node1 | Tuesday 18 August 2026 12:59:52 +0000 (0:00:00.280) 0:02:35.342 ******** 2026-08-18 12:59:52.093830 | node1 | ok: [node1] 2026-08-18 12:59:52.094535 | node1 | ok: [node2] 2026-08-18 12:59:52.094613 | node1 | ok: [node3] 2026-08-18 12:59:52.094625 | node1 | 2026-08-18 12:59:52.094636 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 12:59:52.094654 | node1 | Tuesday 18 August 2026 12:59:52 +0000 (0:00:00.077) 0:02:35.420 ******** 2026-08-18 12:59:52.201659 | node1 | ok: [node1] 2026-08-18 12:59:52.201775 | node1 | ok: [node2] 2026-08-18 12:59:52.202482 | node1 | ok: [node3] 2026-08-18 12:59:52.202545 | node1 | 2026-08-18 12:59:52.202553 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 12:59:52.202561 | node1 | Tuesday 18 August 2026 12:59:52 +0000 (0:00:00.108) 0:02:35.528 ******** 2026-08-18 12:59:52.277659 | node1 | ok: [node1] => { 2026-08-18 12:59:52.277740 | node1 | "changed": false, 2026-08-18 12:59:52.277764 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:52.277782 | node1 | } 2026-08-18 12:59:52.278399 | node1 | ok: [node2] => { 2026-08-18 12:59:52.278467 | node1 | "changed": false, 2026-08-18 12:59:52.278479 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:52.278492 | node1 | } 2026-08-18 12:59:52.278505 | node1 | ok: [node3] => { 2026-08-18 12:59:52.278517 | node1 | "changed": false, 2026-08-18 12:59:52.278544 | node1 | "msg": "All assertions passed" 2026-08-18 12:59:52.278555 | node1 | } 2026-08-18 12:59:52.278567 | node1 | 2026-08-18 12:59:52.278836 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 12:59:52.278883 | node1 | Tuesday 18 August 2026 12:59:52 +0000 (0:00:00.076) 0:02:35.604 ******** 2026-08-18 12:59:59.900122 | node1 | ok: [node1] 2026-08-18 12:59:59.900173 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:59.900181 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 12:59:59.900187 | node1 | 2026-08-18 12:59:59.900194 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 12:59:59.900200 | node1 | Tuesday 18 August 2026 12:59:59 +0000 (0:00:07.621) 0:02:43.226 ******** 2026-08-18 12:59:59.987590 | node1 | skipping: [node1] 2026-08-18 12:59:59.987663 | node1 | skipping: [node2] 2026-08-18 12:59:59.988042 | node1 | skipping: [node3] 2026-08-18 12:59:59.988096 | node1 | 2026-08-18 12:59:59.988102 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 12:59:59.988107 | node1 | Tuesday 18 August 2026 12:59:59 +0000 (0:00:00.088) 0:02:43.314 ******** 2026-08-18 13:00:02.741818 | node1 | changed: [node1] 2026-08-18 13:00:02.741902 | node1 | 2026-08-18 13:00:02.741914 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 13:00:02.741925 | node1 | Tuesday 18 August 2026 13:00:02 +0000 (0:00:02.752) 0:02:46.066 ******** 2026-08-18 13:00:04.613116 | node1 | ok: [node1] 2026-08-18 13:00:04.613194 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:00:04.613277 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:00:04.613561 | node1 | 2026-08-18 13:00:04.613578 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 13:00:04.613584 | node1 | Tuesday 18 August 2026 13:00:04 +0000 (0:00:01.872) 0:02:47.939 ******** 2026-08-18 13:00:14.082668 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'}) 2026-08-18 13:00:14.082718 | node1 | changed: [node1] => (item={'name': 'dashboard'}) 2026-08-18 13:00:14.082724 | node1 | ok: [node1] => (item={'name': 'iostat'}) 2026-08-18 13:00:14.082728 | node1 | changed: [node1] => (item={'name': 'prometheus'}) 2026-08-18 13:00:14.082733 | node1 | changed: [node1] => (item={'name': 'rgw'}) 2026-08-18 13:00:14.082737 | node1 | 2026-08-18 13:00:14.082741 | node1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 13:00:14.082746 | node1 | 2026-08-18 13:00:14.082750 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:00:14.082754 | node1 | Tuesday 18 August 2026 13:00:14 +0000 (0:00:09.469) 0:02:57.408 ******** 2026-08-18 13:00:15.048287 | node1 | ok: [node1] 2026-08-18 13:00:15.048336 | node1 | ok: [node2] 2026-08-18 13:00:15.048341 | node1 | ok: [node3] 2026-08-18 13:00:15.048346 | node1 | 2026-08-18 13:00:15.048350 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:00:15.048355 | node1 | Tuesday 18 August 2026 13:00:15 +0000 (0:00:00.965) 0:02:58.374 ******** 2026-08-18 13:00:15.287428 | node1 | ok: [node1] 2026-08-18 13:00:15.287502 | node1 | ok: [node2] 2026-08-18 13:00:15.287511 | node1 | ok: [node3] 2026-08-18 13:00:15.287813 | node1 | 2026-08-18 13:00:15.287858 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:00:15.287864 | node1 | Tuesday 18 August 2026 13:00:15 +0000 (0:00:00.239) 0:02:58.614 ******** 2026-08-18 13:00:15.358809 | node1 | skipping: [node1] 2026-08-18 13:00:15.358866 | node1 | skipping: [node2] 2026-08-18 13:00:15.359297 | node1 | skipping: [node3] 2026-08-18 13:00:15.359367 | node1 | 2026-08-18 13:00:15.359373 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 13:00:15.359379 | node1 | Tuesday 18 August 2026 13:00:15 +0000 (0:00:00.071) 0:02:58.685 ******** 2026-08-18 13:00:15.598668 | node1 | ok: [node1] 2026-08-18 13:00:15.598736 | node1 | ok: [node2] 2026-08-18 13:00:15.599179 | node1 | ok: [node3] 2026-08-18 13:00:15.599224 | node1 | 2026-08-18 13:00:15.599231 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:00:15.599236 | node1 | Tuesday 18 August 2026 13:00:15 +0000 (0:00:00.239) 0:02:58.925 ******** 2026-08-18 13:00:15.676695 | node1 | ok: [node1] => { 2026-08-18 13:00:15.676837 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:00:15.677012 | node1 | } 2026-08-18 13:00:15.677148 | node1 | ok: [node2] => { 2026-08-18 13:00:15.677287 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:00:15.677421 | node1 | } 2026-08-18 13:00:15.677582 | node1 | ok: [node3] => { 2026-08-18 13:00:15.677757 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:00:15.677885 | node1 | } 2026-08-18 13:00:15.678004 | node1 | 2026-08-18 13:00:15.678137 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:00:15.678269 | node1 | Tuesday 18 August 2026 13:00:15 +0000 (0:00:00.077) 0:02:59.003 ******** 2026-08-18 13:00:16.020790 | node1 | ok: [node1] 2026-08-18 13:00:16.020872 | node1 | ok: [node2] 2026-08-18 13:00:16.020988 | node1 | ok: [node3] 2026-08-18 13:00:16.021082 | node1 | 2026-08-18 13:00:16.021196 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:00:16.021290 | node1 | Tuesday 18 August 2026 13:00:16 +0000 (0:00:00.344) 0:02:59.347 ******** 2026-08-18 13:00:16.122312 | node1 | skipping: [node1] 2026-08-18 13:00:16.122352 | node1 | skipping: [node2] 2026-08-18 13:00:16.122357 | node1 | skipping: [node3] 2026-08-18 13:00:16.122362 | node1 | 2026-08-18 13:00:16.122367 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:00:16.122371 | node1 | Tuesday 18 August 2026 13:00:16 +0000 (0:00:00.099) 0:02:59.446 ******** 2026-08-18 13:00:16.215571 | node1 | skipping: [node1] 2026-08-18 13:00:16.215666 | node1 | skipping: [node2] 2026-08-18 13:00:16.215758 | node1 | skipping: [node3] 2026-08-18 13:00:16.215845 | node1 | 2026-08-18 13:00:16.215941 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:00:16.216043 | node1 | Tuesday 18 August 2026 13:00:16 +0000 (0:00:00.095) 0:02:59.542 ******** 2026-08-18 13:00:16.460410 | node1 | ok: [node1] 2026-08-18 13:00:16.460492 | node1 | ok: [node2] 2026-08-18 13:00:16.460503 | node1 | ok: [node3] 2026-08-18 13:00:16.460582 | node1 | 2026-08-18 13:00:16.460732 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:00:16.460770 | node1 | Tuesday 18 August 2026 13:00:16 +0000 (0:00:00.244) 0:02:59.786 ******** 2026-08-18 13:00:17.819936 | node1 | ok: [node1] 2026-08-18 13:00:17.819983 | node1 | ok: [node3] 2026-08-18 13:00:17.819988 | node1 | ok: [node2] 2026-08-18 13:00:17.819993 | node1 | 2026-08-18 13:00:17.819998 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:00:17.820002 | node1 | Tuesday 18 August 2026 13:00:17 +0000 (0:00:01.359) 0:03:01.146 ******** 2026-08-18 13:00:17.900764 | node1 | ok: [node1] => { 2026-08-18 13:00:17.900845 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:00:17.900996 | node1 | } 2026-08-18 13:00:17.901092 | node1 | ok: [node2] => { 2026-08-18 13:00:17.901195 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:00:17.901286 | node1 | } 2026-08-18 13:00:17.901379 | node1 | ok: [node3] => { 2026-08-18 13:00:17.901486 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:00:17.901593 | node1 | } 2026-08-18 13:00:17.901679 | node1 | 2026-08-18 13:00:17.901776 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:00:17.901870 | node1 | Tuesday 18 August 2026 13:00:17 +0000 (0:00:00.081) 0:03:01.227 ******** 2026-08-18 13:00:18.323111 | node1 | ok: [node2] 2026-08-18 13:00:18.323274 | node1 | ok: [node1] 2026-08-18 13:00:18.323531 | node1 | ok: [node3] 2026-08-18 13:00:18.323726 | node1 | 2026-08-18 13:00:18.323954 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:00:18.324132 | node1 | Tuesday 18 August 2026 13:00:18 +0000 (0:00:00.421) 0:03:01.649 ******** 2026-08-18 13:00:20.296228 | node1 | ok: [node1] 2026-08-18 13:00:20.296333 | node1 | ok: [node2] 2026-08-18 13:00:20.296348 | node1 | ok: [node3] 2026-08-18 13:00:20.296427 | node1 | 2026-08-18 13:00:20.296496 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 13:00:20.296589 | node1 | Tuesday 18 August 2026 13:00:20 +0000 (0:00:01.973) 0:03:03.622 ******** 2026-08-18 13:00:20.324825 | node1 | skipping: [node1] 2026-08-18 13:00:20.350774 | node1 | skipping: [node2] 2026-08-18 13:00:20.350904 | node1 | skipping: [node3] 2026-08-18 13:00:20.351020 | node1 | 2026-08-18 13:00:20.351161 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 13:00:20.351299 | node1 | Tuesday 18 August 2026 13:00:20 +0000 (0:00:00.054) 0:03:03.677 ******** 2026-08-18 13:00:20.372962 | node1 | skipping: [node1] 2026-08-18 13:00:20.401390 | node1 | skipping: [node2] 2026-08-18 13:00:20.401600 | node1 | skipping: [node3] 2026-08-18 13:00:20.401804 | node1 | 2026-08-18 13:00:20.402048 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 13:00:20.402343 | node1 | Tuesday 18 August 2026 13:00:20 +0000 (0:00:00.050) 0:03:03.727 ******** 2026-08-18 13:00:20.454115 | node1 | skipping: [node1] 2026-08-18 13:00:20.454317 | node1 | skipping: [node2] 2026-08-18 13:00:20.454533 | node1 | skipping: [node3] 2026-08-18 13:00:20.454729 | node1 | 2026-08-18 13:00:20.454949 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 13:00:20.455163 | node1 | Tuesday 18 August 2026 13:00:20 +0000 (0:00:00.052) 0:03:03.780 ******** 2026-08-18 13:00:21.634037 | node1 | ok: [node1] 2026-08-18 13:00:21.634124 | node1 | ok: [node3] 2026-08-18 13:00:21.634362 | node1 | ok: [node2] 2026-08-18 13:00:21.634430 | node1 | 2026-08-18 13:00:21.634715 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 13:00:21.634740 | node1 | Tuesday 18 August 2026 13:00:21 +0000 (0:00:01.180) 0:03:04.960 ******** 2026-08-18 13:00:22.090457 | node1 | ok: [node1] 2026-08-18 13:00:22.090536 | node1 | ok: [node2] 2026-08-18 13:00:22.090543 | node1 | ok: [node3] 2026-08-18 13:00:22.090550 | node1 | 2026-08-18 13:00:22.090557 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 13:00:22.090565 | node1 | Tuesday 18 August 2026 13:00:22 +0000 (0:00:00.455) 0:03:05.415 ******** 2026-08-18 13:00:23.062118 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 13:00:23.062200 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 13:00:23.062211 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 13:00:23.062221 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:00:23.062231 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:00:23.062240 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:00:23.062249 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:00:23.062257 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:00:23.062266 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:00:23.062343 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:00:23.062357 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:00:23.062365 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:00:23.062373 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:00:23.062396 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:00:23.062404 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:00:23.062413 | node1 | 2026-08-18 13:00:23.062422 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 13:00:23.062431 | node1 | Tuesday 18 August 2026 13:00:23 +0000 (0:00:00.968) 0:03:06.384 ******** 2026-08-18 13:00:23.634162 | node1 | ok: [node1] 2026-08-18 13:00:23.634231 | node1 | ok: [node2] 2026-08-18 13:00:23.634546 | node1 | ok: [node3] 2026-08-18 13:00:23.634621 | node1 | 2026-08-18 13:00:23.634641 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:00:23.634653 | node1 | Tuesday 18 August 2026 13:00:23 +0000 (0:00:00.560) 0:03:06.945 ******** 2026-08-18 13:00:23.635499 | node1 | 2026-08-18 13:00:23.635546 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:00:23.635552 | node1 | Tuesday 18 August 2026 13:00:23 +0000 (0:00:00.005) 0:03:06.950 ******** 2026-08-18 13:00:23.635557 | node1 | 2026-08-18 13:00:23.635561 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:00:23.635565 | node1 | Tuesday 18 August 2026 13:00:23 +0000 (0:00:00.004) 0:03:06.955 ******** 2026-08-18 13:00:23.635569 | node1 | 2026-08-18 13:00:23.635573 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 13:00:23.635577 | node1 | Tuesday 18 August 2026 13:00:23 +0000 (0:00:00.005) 0:03:06.960 ******** 2026-08-18 13:00:24.989974 | node1 | ok: [node2] 2026-08-18 13:00:24.990048 | node1 | ok: [node3] 2026-08-18 13:00:24.990122 | node1 | ok: [node1] 2026-08-18 13:00:24.990219 | node1 | 2026-08-18 13:00:24.990316 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:00:24.990419 | node1 | Tuesday 18 August 2026 13:00:24 +0000 (0:00:01.355) 0:03:08.316 ******** 2026-08-18 13:00:25.211459 | node1 | ok: [node1] 2026-08-18 13:00:25.211521 | node1 | ok: [node2] 2026-08-18 13:00:25.211618 | node1 | ok: [node3] 2026-08-18 13:00:25.211681 | node1 | 2026-08-18 13:00:25.211777 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:00:25.211862 | node1 | Tuesday 18 August 2026 13:00:25 +0000 (0:00:00.221) 0:03:08.538 ******** 2026-08-18 13:00:25.288163 | node1 | ok: [node1] => { 2026-08-18 13:00:25.288270 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:00:25.288393 | node1 | } 2026-08-18 13:00:25.288516 | node1 | ok: [node2] => { 2026-08-18 13:00:25.288648 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:00:25.288766 | node1 | } 2026-08-18 13:00:25.288880 | node1 | ok: [node3] => { 2026-08-18 13:00:25.289010 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:00:25.289126 | node1 | } 2026-08-18 13:00:25.289238 | node1 | 2026-08-18 13:00:25.289390 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:00:25.289517 | node1 | Tuesday 18 August 2026 13:00:25 +0000 (0:00:00.076) 0:03:08.614 ******** 2026-08-18 13:00:25.706076 | node1 | ok: [node2] 2026-08-18 13:00:25.706146 | node1 | ok: [node3] 2026-08-18 13:00:25.706365 | node1 | ok: [node1] 2026-08-18 13:00:25.706476 | node1 | 2026-08-18 13:00:25.706607 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:00:25.706737 | node1 | Tuesday 18 August 2026 13:00:25 +0000 (0:00:00.417) 0:03:09.032 ******** 2026-08-18 13:00:28.845280 | node1 | ok: [node1] 2026-08-18 13:00:28.845472 | node1 | ok: [node2] 2026-08-18 13:00:28.845693 | node1 | ok: [node3] 2026-08-18 13:00:28.845894 | node1 | 2026-08-18 13:00:28.846153 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 13:00:28.846408 | node1 | Tuesday 18 August 2026 13:00:28 +0000 (0:00:03.139) 0:03:12.171 ******** 2026-08-18 13:00:30.005592 | node1 | ok: [node2] 2026-08-18 13:00:30.005669 | node1 | ok: [node3] 2026-08-18 13:00:30.005750 | node1 | ok: [node1] 2026-08-18 13:00:30.006055 | node1 | 2026-08-18 13:00:30.006095 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 13:00:30.006100 | node1 | Tuesday 18 August 2026 13:00:30 +0000 (0:00:01.161) 0:03:13.332 ******** 2026-08-18 13:00:30.226134 | node1 | ok: [node1] 2026-08-18 13:00:30.226188 | node1 | ok: [node2] 2026-08-18 13:00:30.226199 | node1 | ok: [node3] 2026-08-18 13:00:30.226687 | node1 | 2026-08-18 13:00:30.226739 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 13:00:30.226747 | node1 | Tuesday 18 August 2026 13:00:30 +0000 (0:00:00.220) 0:03:13.552 ******** 2026-08-18 13:00:30.671613 | node1 | ok: [node1] 2026-08-18 13:00:30.671666 | node1 | ok: [node3] 2026-08-18 13:00:30.671880 | node1 | ok: [node2] 2026-08-18 13:00:30.672146 | node1 | 2026-08-18 13:00:30.672373 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 13:00:30.672382 | node1 | Tuesday 18 August 2026 13:00:30 +0000 (0:00:00.445) 0:03:13.997 ******** 2026-08-18 13:00:31.243770 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 13:00:31.243858 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 13:00:31.245058 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 13:00:31.245110 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:00:31.245118 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:00:31.245124 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:00:31.245130 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:00:31.245136 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:00:31.245142 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:00:31.245148 | node1 | 2026-08-18 13:00:31.245154 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 13:00:31.245160 | node1 | Tuesday 18 August 2026 13:00:31 +0000 (0:00:00.572) 0:03:14.570 ******** 2026-08-18 13:00:31.669530 | node1 | ok: [node1] 2026-08-18 13:00:31.669636 | node1 | ok: [node3] 2026-08-18 13:00:31.670158 | node1 | ok: [node2] 2026-08-18 13:00:31.670174 | node1 | 2026-08-18 13:00:31.670180 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 13:00:31.670185 | node1 | Tuesday 18 August 2026 13:00:31 +0000 (0:00:00.426) 0:03:14.996 ******** 2026-08-18 13:00:32.181363 | node1 | ok: [node2] 2026-08-18 13:00:32.181443 | node1 | ok: [node1] 2026-08-18 13:00:32.182363 | node1 | ok: [node3] 2026-08-18 13:00:32.182430 | node1 | 2026-08-18 13:00:32.182442 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:00:32.182452 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.458) 0:03:15.454 ******** 2026-08-18 13:00:32.182461 | node1 | 2026-08-18 13:00:32.182470 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:00:32.182479 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.007) 0:03:15.462 ******** 2026-08-18 13:00:32.182489 | node1 | 2026-08-18 13:00:32.182501 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:00:32.182514 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.005) 0:03:15.467 ******** 2026-08-18 13:00:32.182535 | node1 | 2026-08-18 13:00:32.182545 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 13:00:32.182557 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.040) 0:03:15.508 ******** 2026-08-18 13:00:32.573689 | node1 | ok: [node1] 2026-08-18 13:00:32.573731 | node1 | ok: [node2] 2026-08-18 13:00:32.573736 | node1 | ok: [node3] 2026-08-18 13:00:32.573741 | node1 | 2026-08-18 13:00:32.573746 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:00:32.573751 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.391) 0:03:15.899 ******** 2026-08-18 13:00:32.634180 | node1 | ok: [node1] => { 2026-08-18 13:00:32.634315 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:00:32.634353 | node1 | } 2026-08-18 13:00:32.634364 | node1 | ok: [node2] => { 2026-08-18 13:00:32.634373 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:00:32.634382 | node1 | } 2026-08-18 13:00:32.634391 | node1 | ok: [node3] => { 2026-08-18 13:00:32.634400 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:00:32.634420 | node1 | } 2026-08-18 13:00:32.634429 | node1 | 2026-08-18 13:00:32.634442 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:00:32.634591 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.060) 0:03:15.959 ******** 2026-08-18 13:00:32.936122 | node1 | ok: [node1] 2026-08-18 13:00:32.936242 | node1 | ok: [node2] 2026-08-18 13:00:32.936254 | node1 | ok: [node3] 2026-08-18 13:00:32.936378 | node1 | 2026-08-18 13:00:32.936540 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:00:32.936680 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.302) 0:03:16.262 ******** 2026-08-18 13:00:32.999738 | node1 | skipping: [node1] 2026-08-18 13:00:32.999871 | node1 | skipping: [node2] 2026-08-18 13:00:32.999997 | node1 | skipping: [node3] 2026-08-18 13:00:33.000116 | node1 | 2026-08-18 13:00:33.000264 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 13:00:33.000392 | node1 | Tuesday 18 August 2026 13:00:32 +0000 (0:00:00.064) 0:03:16.326 ******** 2026-08-18 13:00:33.066892 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:00:33.067034 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:00:33.067166 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:00:33.067284 | node1 | 2026-08-18 13:00:33.067417 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 13:00:33.067555 | node1 | Tuesday 18 August 2026 13:00:33 +0000 (0:00:00.066) 0:03:16.393 ******** 2026-08-18 13:00:34.289752 | node1 | ok: [node1] 2026-08-18 13:00:34.289893 | node1 | ok: [node3] 2026-08-18 13:00:34.290053 | node1 | ok: [node2] 2026-08-18 13:00:34.290259 | node1 | 2026-08-18 13:00:34.290529 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 13:00:34.290727 | node1 | Tuesday 18 August 2026 13:00:34 +0000 (0:00:01.222) 0:03:17.615 ******** 2026-08-18 13:00:34.978504 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 13:00:34.978696 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 13:00:34.979000 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 13:00:34.979217 | node1 | ok: [node1] => (item=sshd) 2026-08-18 13:00:34.979438 | node1 | ok: [node2] => (item=sshd) 2026-08-18 13:00:34.979629 | node1 | ok: [node3] => (item=sshd) 2026-08-18 13:00:34.979807 | node1 | 2026-08-18 13:00:34.980033 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 13:00:34.980231 | node1 | Tuesday 18 August 2026 13:00:34 +0000 (0:00:00.688) 0:03:18.304 ******** 2026-08-18 13:00:35.211165 | node1 | ok: [node1] 2026-08-18 13:00:35.211337 | node1 | ok: [node2] 2026-08-18 13:00:35.211543 | node1 | ok: [node3] 2026-08-18 13:00:35.211765 | node1 | 2026-08-18 13:00:35.211982 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 13:00:35.212198 | node1 | Tuesday 18 August 2026 13:00:35 +0000 (0:00:00.233) 0:03:18.537 ******** 2026-08-18 13:00:35.470359 | node1 | ok: [node1] 2026-08-18 13:00:35.471311 | node1 | ok: [node2] 2026-08-18 13:00:35.471536 | node1 | ok: [node3] 2026-08-18 13:00:35.471550 | node1 | 2026-08-18 13:00:35.471607 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 13:00:35.471620 | node1 | Tuesday 18 August 2026 13:00:35 +0000 (0:00:00.259) 0:03:18.796 ******** 2026-08-18 13:00:35.898598 | node1 | ok: [node1] 2026-08-18 13:00:35.898671 | node1 | ok: [node2] 2026-08-18 13:00:35.898735 | node1 | ok: [node3] 2026-08-18 13:00:35.899034 | node1 | 2026-08-18 13:00:35.899081 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 13:00:35.899087 | node1 | Tuesday 18 August 2026 13:00:35 +0000 (0:00:00.428) 0:03:19.225 ******** 2026-08-18 13:00:35.926545 | node1 | skipping: [node1] 2026-08-18 13:00:35.959076 | node1 | skipping: [node2] 2026-08-18 13:00:35.959098 | node1 | skipping: [node3] 2026-08-18 13:00:35.959104 | node1 | 2026-08-18 13:00:35.959109 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 13:00:35.959113 | node1 | Tuesday 18 August 2026 13:00:35 +0000 (0:00:00.060) 0:03:19.285 ******** 2026-08-18 13:00:36.346882 | node1 | ok: [node1] 2026-08-18 13:00:36.346993 | node1 | ok: [node2] 2026-08-18 13:00:36.347528 | node1 | ok: [node3] 2026-08-18 13:00:36.347582 | node1 | 2026-08-18 13:00:36.347590 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 13:00:36.347597 | node1 | Tuesday 18 August 2026 13:00:36 +0000 (0:00:00.388) 0:03:19.673 ******** 2026-08-18 13:00:36.834258 | node1 | ok: [node2] 2026-08-18 13:00:36.834355 | node1 | ok: [node1] 2026-08-18 13:00:36.834369 | node1 | ok: [node3] 2026-08-18 13:00:36.834668 | node1 | 2026-08-18 13:00:36.834722 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 13:00:36.834729 | node1 | Tuesday 18 August 2026 13:00:36 +0000 (0:00:00.487) 0:03:20.160 ******** 2026-08-18 13:00:37.425506 | node1 | ok: [node1] => (item=node1) 2026-08-18 13:00:37.425578 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 13:00:37.426114 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 13:00:37.426161 | node1 | 2026-08-18 13:00:37.426168 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 13:00:37.426175 | node1 | Tuesday 18 August 2026 13:00:37 +0000 (0:00:00.591) 0:03:20.752 ******** 2026-08-18 13:00:37.493395 | node1 | ok: [node1] 2026-08-18 13:00:37.494040 | node1 | ok: [node2] 2026-08-18 13:00:37.494091 | node1 | ok: [node3] 2026-08-18 13:00:37.494099 | node1 | 2026-08-18 13:00:37.494106 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 13:00:37.494113 | node1 | Tuesday 18 August 2026 13:00:37 +0000 (0:00:00.067) 0:03:20.819 ******** 2026-08-18 13:00:37.556897 | node1 | ok: [node1] 2026-08-18 13:00:37.556968 | node1 | ok: [node2] 2026-08-18 13:00:37.557453 | node1 | ok: [node3] 2026-08-18 13:00:37.557494 | node1 | 2026-08-18 13:00:37.557502 | node1 | TASK [Register this OSD host] ************************************************** 2026-08-18 13:00:37.557509 | node1 | Tuesday 18 August 2026 13:00:37 +0000 (0:00:00.063) 0:03:20.883 ******** 2026-08-18 13:00:37.656814 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 13:00:37.656941 | node1 | 2026-08-18 13:00:37.656947 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 13:00:37.657017 | node1 | Tuesday 18 August 2026 13:00:37 +0000 (0:00:00.100) 0:03:20.983 ******** 2026-08-18 13:00:39.118080 | node1 | ok: [node1] 2026-08-18 13:00:39.118198 | node1 | 2026-08-18 13:00:39.118211 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 13:00:39.118405 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:01.460) 0:03:22.444 ******** 2026-08-18 13:00:39.190239 | node1 | ok: [node1] 2026-08-18 13:00:39.190329 | node1 | ok: [node2] 2026-08-18 13:00:39.190740 | node1 | ok: [node3] 2026-08-18 13:00:39.190815 | node1 | 2026-08-18 13:00:39.190822 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 13:00:39.190828 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.072) 0:03:22.516 ******** 2026-08-18 13:00:39.255707 | node1 | ok: [node1] => { 2026-08-18 13:00:39.257441 | node1 | "changed": false, 2026-08-18 13:00:39.257498 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.257507 | node1 | } 2026-08-18 13:00:39.257528 | node1 | ok: [node2] => { 2026-08-18 13:00:39.257534 | node1 | "changed": false, 2026-08-18 13:00:39.257540 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.257546 | node1 | } 2026-08-18 13:00:39.257551 | node1 | ok: [node3] => { 2026-08-18 13:00:39.257557 | node1 | "changed": false, 2026-08-18 13:00:39.257570 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.257576 | node1 | } 2026-08-18 13:00:39.257583 | node1 | 2026-08-18 13:00:39.257589 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 13:00:39.257609 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.065) 0:03:22.582 ******** 2026-08-18 13:00:39.573956 | node1 | ok: [node2] 2026-08-18 13:00:39.573998 | node1 | ok: [node1] 2026-08-18 13:00:39.574003 | node1 | ok: [node3] 2026-08-18 13:00:39.574008 | node1 | 2026-08-18 13:00:39.574013 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 13:00:39.574019 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.318) 0:03:22.900 ******** 2026-08-18 13:00:39.636095 | node1 | ok: [node1] 2026-08-18 13:00:39.636140 | node1 | ok: [node2] 2026-08-18 13:00:39.636147 | node1 | ok: [node3] 2026-08-18 13:00:39.636153 | node1 | 2026-08-18 13:00:39.636159 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 13:00:39.636166 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.061) 0:03:22.961 ******** 2026-08-18 13:00:39.729703 | node1 | ok: [node1] 2026-08-18 13:00:39.729750 | node1 | ok: [node2] 2026-08-18 13:00:39.729755 | node1 | ok: [node3] 2026-08-18 13:00:39.729760 | node1 | 2026-08-18 13:00:39.729765 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 13:00:39.729770 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.093) 0:03:23.055 ******** 2026-08-18 13:00:39.792846 | node1 | ok: [node1] => { 2026-08-18 13:00:39.792893 | node1 | "changed": false, 2026-08-18 13:00:39.792900 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.792907 | node1 | } 2026-08-18 13:00:39.792913 | node1 | ok: [node2] => { 2026-08-18 13:00:39.792918 | node1 | "changed": false, 2026-08-18 13:00:39.792924 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.792930 | node1 | } 2026-08-18 13:00:39.792935 | node1 | ok: [node3] => { 2026-08-18 13:00:39.792941 | node1 | "changed": false, 2026-08-18 13:00:39.792946 | node1 | "msg": "All assertions passed" 2026-08-18 13:00:39.792951 | node1 | } 2026-08-18 13:00:39.792957 | node1 | 2026-08-18 13:00:39.792963 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 13:00:39.792969 | node1 | Tuesday 18 August 2026 13:00:39 +0000 (0:00:00.061) 0:03:23.117 ******** 2026-08-18 13:00:41.370288 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:00:41.370372 | node1 | ok: [node1] 2026-08-18 13:00:41.370740 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:00:41.370782 | node1 | 2026-08-18 13:00:41.370788 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 13:00:41.370793 | node1 | Tuesday 18 August 2026 13:00:41 +0000 (0:00:01.578) 0:03:24.696 ******** 2026-08-18 13:00:41.462250 | node1 | skipping: [node1] 2026-08-18 13:00:41.462459 | node1 | skipping: [node2] 2026-08-18 13:00:41.462536 | node1 | skipping: [node3] 2026-08-18 13:00:41.462547 | node1 | 2026-08-18 13:00:41.462766 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 13:00:41.462813 | node1 | Tuesday 18 August 2026 13:00:41 +0000 (0:00:00.092) 0:03:24.788 ******** 2026-08-18 13:00:41.495997 | node1 | skipping: [node1] 2026-08-18 13:00:41.496456 | node1 | 2026-08-18 13:00:41.496510 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 13:00:41.496518 | node1 | Tuesday 18 August 2026 13:00:41 +0000 (0:00:00.033) 0:03:24.822 ******** 2026-08-18 13:00:42.766382 | node1 | ok: [node2] 2026-08-18 13:00:42.766450 | node1 | ok: [node1] 2026-08-18 13:00:42.766460 | node1 | ok: [node3] 2026-08-18 13:00:42.766475 | node1 | 2026-08-18 13:00:42.766723 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 13:00:42.766768 | node1 | Tuesday 18 August 2026 13:00:42 +0000 (0:00:01.270) 0:03:26.092 ******** 2026-08-18 13:06:28.810622 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data) 2026-08-18 13:06:28.812039 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data) 2026-08-18 13:06:28.812086 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data) 2026-08-18 13:06:28.812094 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data) 2026-08-18 13:06:28.812113 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data) 2026-08-18 13:06:28.812119 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data) 2026-08-18 13:06:28.812125 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data) 2026-08-18 13:06:28.812131 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data) 2026-08-18 13:06:28.812136 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data) 2026-08-18 13:06:28.812142 | node1 | 2026-08-18 13:06:28.812149 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 13:06:28.812155 | node1 | Tuesday 18 August 2026 13:06:28 +0000 (0:05:46.044) 0:09:12.137 ******** 2026-08-18 13:06:43.310372 | node1 | ok: [node1] 2026-08-18 13:06:43.310448 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 13:06:43.310459 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:06:43.310469 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left). 2026-08-18 13:06:43.310478 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:06:43.310494 | node1 | 2026-08-18 13:06:43.310504 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 13:06:43.310610 | node1 | Tuesday 18 August 2026 13:06:43 +0000 (0:00:14.499) 0:09:26.636 ******** 2026-08-18 13:06:43.380864 | node1 | skipping: [node1] 2026-08-18 13:06:43.380952 | node1 | 2026-08-18 13:06:43.381355 | node1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 13:06:43.381403 | node1 | 2026-08-18 13:06:43.381409 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:06:43.381414 | node1 | Tuesday 18 August 2026 13:06:43 +0000 (0:00:00.070) 0:09:26.707 ******** 2026-08-18 13:06:44.442067 | node1 | ok: [node1] 2026-08-18 13:06:44.442148 | node1 | ok: [node3] 2026-08-18 13:06:44.442211 | node1 | ok: [node2] 2026-08-18 13:06:44.442365 | node1 | 2026-08-18 13:06:44.442414 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 13:06:44.442590 | node1 | Tuesday 18 August 2026 13:06:44 +0000 (0:00:01.060) 0:09:27.768 ******** 2026-08-18 13:06:45.004638 | node1 | ok: [node1] => (item=node1) 2026-08-18 13:06:45.004764 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 13:06:45.005363 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 13:06:45.005447 | node1 | 2026-08-18 13:06:45.005457 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 13:06:45.005464 | node1 | Tuesday 18 August 2026 13:06:45 +0000 (0:00:00.562) 0:09:28.330 ******** 2026-08-18 13:06:45.067892 | node1 | ok: [node1] 2026-08-18 13:06:45.067993 | node1 | ok: [node2] 2026-08-18 13:06:45.068583 | node1 | ok: [node3] 2026-08-18 13:06:45.068661 | node1 | 2026-08-18 13:06:45.068670 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 13:06:45.068687 | node1 | Tuesday 18 August 2026 13:06:45 +0000 (0:00:00.063) 0:09:28.394 ******** 2026-08-18 13:06:45.129510 | node1 | ok: [node1] 2026-08-18 13:06:45.129689 | node1 | ok: [node2] 2026-08-18 13:06:45.130460 | node1 | ok: [node3] 2026-08-18 13:06:45.130563 | node1 | 2026-08-18 13:06:45.130572 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 13:06:45.130588 | node1 | Tuesday 18 August 2026 13:06:45 +0000 (0:00:00.061) 0:09:28.455 ******** 2026-08-18 13:06:45.202229 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3 2026-08-18 13:06:45.202443 | node1 | 2026-08-18 13:06:45.202517 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 13:06:45.202525 | node1 | Tuesday 18 August 2026 13:06:45 +0000 (0:00:00.073) 0:09:28.528 ******** 2026-08-18 13:07:01.563222 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 13:07:01.563309 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 13:07:01.563984 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 13:07:01.564028 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 13:07:01.564038 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 13:07:01.564084 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 13:07:01.564090 | node1 | 2026-08-18 13:07:01.564095 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 13:07:01.564101 | node1 | Tuesday 18 August 2026 13:07:01 +0000 (0:00:16.361) 0:09:44.889 ******** 2026-08-18 13:07:01.625974 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3 2026-08-18 13:07:01.626050 | node1 | 2026-08-18 13:07:01.626117 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 13:07:01.626245 | node1 | Tuesday 18 August 2026 13:07:01 +0000 (0:00:00.062) 0:09:44.952 ******** 2026-08-18 13:07:05.038095 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 13:07:05.038167 | node1 | 2026-08-18 13:07:05.038378 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 13:07:05.038442 | node1 | Tuesday 18 August 2026 13:07:05 +0000 (0:00:03.411) 0:09:48.364 ******** 2026-08-18 13:07:05.111417 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3 2026-08-18 13:07:05.111497 | node1 | 2026-08-18 13:07:05.111732 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 13:07:05.111780 | node1 | Tuesday 18 August 2026 13:07:05 +0000 (0:00:00.073) 0:09:48.437 ******** 2026-08-18 13:07:14.275694 | node1 | changed: [node1] => (item=rep_hdd) 2026-08-18 13:07:14.275770 | node1 | changed: [node1] => (item=rep_lab) 2026-08-18 13:07:14.276128 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 13:07:14.276167 | node1 | 2026-08-18 13:07:14.276172 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 13:07:14.276178 | node1 | Tuesday 18 August 2026 13:07:14 +0000 (0:00:09.164) 0:09:57.602 ******** 2026-08-18 13:07:14.343517 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3 2026-08-18 13:07:14.343605 | node1 | 2026-08-18 13:07:14.343796 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 13:07:14.343836 | node1 | Tuesday 18 August 2026 13:07:14 +0000 (0:00:00.068) 0:09:57.670 ******** 2026-08-18 13:07:45.110403 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data) 2026-08-18 13:07:45.110512 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index) 2026-08-18 13:07:45.111378 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 13:07:45.111426 | node1 | changed: [node1] => (item=molecule-1.rgw.control) 2026-08-18 13:07:45.111434 | node1 | changed: [node1] => (item=molecule-1.rgw.log) 2026-08-18 13:07:45.111441 | node1 | changed: [node1] => (item=molecule-1.rgw.meta) 2026-08-18 13:07:45.111447 | node1 | 2026-08-18 13:07:45.111453 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 13:07:45.111459 | node1 | Tuesday 18 August 2026 13:07:45 +0000 (0:00:30.766) 0:10:28.436 ******** 2026-08-18 13:07:45.138857 | node1 | skipping: [node1] 2026-08-18 13:07:45.163923 | node1 | skipping: [node2] 2026-08-18 13:07:45.163992 | node1 | skipping: [node3] 2026-08-18 13:07:45.164406 | node1 | 2026-08-18 13:07:45.164431 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 13:07:45.164438 | node1 | Tuesday 18 August 2026 13:07:45 +0000 (0:00:00.053) 0:10:28.490 ******** 2026-08-18 13:07:45.225575 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3 2026-08-18 13:07:45.225903 | node1 | 2026-08-18 13:07:45.226052 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 13:07:45.226205 | node1 | Tuesday 18 August 2026 13:07:45 +0000 (0:00:00.061) 0:10:28.552 ******** 2026-08-18 13:07:46.744591 | node1 | ok: [node1] 2026-08-18 13:07:46.744656 | node1 | 2026-08-18 13:07:46.744668 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 13:07:46.744678 | node1 | Tuesday 18 August 2026 13:07:46 +0000 (0:00:01.517) 0:10:30.069 ******** 2026-08-18 13:07:48.329203 | node1 | ok: [node1] 2026-08-18 13:07:48.329818 | node1 | 2026-08-18 13:07:48.329886 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 13:07:48.329898 | node1 | Tuesday 18 August 2026 13:07:48 +0000 (0:00:01.585) 0:10:31.655 ******** 2026-08-18 13:07:48.361732 | node1 | skipping: [node1] 2026-08-18 13:07:48.361842 | node1 | 2026-08-18 13:07:48.361989 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 13:07:48.362157 | node1 | Tuesday 18 August 2026 13:07:48 +0000 (0:00:00.032) 0:10:31.688 ******** 2026-08-18 13:07:48.396521 | node1 | skipping: [node1] 2026-08-18 13:07:48.396640 | node1 | 2026-08-18 13:07:48.396919 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 13:07:48.396945 | node1 | Tuesday 18 August 2026 13:07:48 +0000 (0:00:00.034) 0:10:31.722 ******** 2026-08-18 13:07:48.431696 | node1 | skipping: [node1] 2026-08-18 13:07:48.431717 | node1 | 2026-08-18 13:07:48.431724 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 13:07:48.431730 | node1 | Tuesday 18 August 2026 13:07:48 +0000 (0:00:00.035) 0:10:31.758 ******** 2026-08-18 13:07:50.193160 | node1 | changed: [node1] 2026-08-18 13:07:50.193248 | node1 | 2026-08-18 13:07:50.193317 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 13:07:50.193448 | node1 | Tuesday 18 August 2026 13:07:50 +0000 (0:00:01.761) 0:10:33.519 ******** 2026-08-18 13:07:50.239443 | node1 | ok: [node1] 2026-08-18 13:07:50.239851 | node1 | 2026-08-18 13:07:50.239901 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 13:07:50.239909 | node1 | Tuesday 18 August 2026 13:07:50 +0000 (0:00:00.045) 0:10:33.565 ******** 2026-08-18 13:07:56.844941 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard) 2026-08-18 13:07:56.845039 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard) 2026-08-18 13:07:56.845180 | node1 | changed: [node1] => (item=ceph orch reconfig mgr) 2026-08-18 13:07:56.845304 | node1 | 2026-08-18 13:07:56.845458 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 13:07:56.845593 | node1 | Tuesday 18 August 2026 13:07:56 +0000 (0:00:06.605) 0:10:40.171 ******** 2026-08-18 13:07:56.916611 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3 2026-08-18 13:07:56.916673 | node1 | 2026-08-18 13:07:56.916752 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 13:07:56.916843 | node1 | Tuesday 18 August 2026 13:07:56 +0000 (0:00:00.072) 0:10:40.243 ******** 2026-08-18 13:08:05.534727 | node1 | changed: [node1] => (item=None) 2026-08-18 13:08:05.534800 | node1 | changed: [node1] => (item=None) 2026-08-18 13:08:05.534918 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}] 2026-08-18 13:08:05.535402 | node1 | 2026-08-18 13:08:05.535450 | node1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 13:08:05.535456 | node1 | 2026-08-18 13:08:05.535461 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:08:05.535466 | node1 | Tuesday 18 August 2026 13:08:05 +0000 (0:00:08.618) 0:10:48.861 ******** 2026-08-18 13:08:06.672893 | node1 | ok: [node1] 2026-08-18 13:08:06.673020 | node1 | ok: [node2] 2026-08-18 13:08:06.673076 | node1 | ok: [node3] 2026-08-18 13:08:06.673369 | node1 | 2026-08-18 13:08:06.673412 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:06.673418 | node1 | Tuesday 18 August 2026 13:08:06 +0000 (0:00:01.137) 0:10:49.999 ******** 2026-08-18 13:08:06.907766 | node1 | ok: [node1] 2026-08-18 13:08:06.907838 | node1 | ok: [node2] 2026-08-18 13:08:06.907879 | node1 | ok: [node3] 2026-08-18 13:08:06.908175 | node1 | 2026-08-18 13:08:06.908216 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:06.908222 | node1 | Tuesday 18 August 2026 13:08:06 +0000 (0:00:00.234) 0:10:50.234 ******** 2026-08-18 13:08:06.935841 | node1 | skipping: [node1] 2026-08-18 13:08:06.977193 | node1 | skipping: [node2] 2026-08-18 13:08:06.977236 | node1 | skipping: [node3] 2026-08-18 13:08:06.977241 | node1 | 2026-08-18 13:08:06.977246 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 13:08:06.977251 | node1 | Tuesday 18 August 2026 13:08:06 +0000 (0:00:00.069) 0:10:50.303 ******** 2026-08-18 13:08:07.213556 | node1 | ok: [node1] 2026-08-18 13:08:07.213631 | node1 | ok: [node2] 2026-08-18 13:08:07.214013 | node1 | ok: [node3] 2026-08-18 13:08:07.214061 | node1 | 2026-08-18 13:08:07.214067 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:07.214072 | node1 | Tuesday 18 August 2026 13:08:07 +0000 (0:00:00.236) 0:10:50.540 ******** 2026-08-18 13:08:07.292584 | node1 | ok: [node1] => { 2026-08-18 13:08:07.293962 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:08:07.294005 | node1 | } 2026-08-18 13:08:07.294010 | node1 | ok: [node2] => { 2026-08-18 13:08:07.294015 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:08:07.294019 | node1 | } 2026-08-18 13:08:07.294023 | node1 | ok: [node3] => { 2026-08-18 13:08:07.294027 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:08:07.294031 | node1 | } 2026-08-18 13:08:07.294035 | node1 | 2026-08-18 13:08:07.294046 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:07.294051 | node1 | Tuesday 18 August 2026 13:08:07 +0000 (0:00:00.079) 0:10:50.619 ******** 2026-08-18 13:08:07.646137 | node1 | ok: [node2] 2026-08-18 13:08:07.646193 | node1 | ok: [node1] 2026-08-18 13:08:07.646200 | node1 | ok: [node3] 2026-08-18 13:08:07.646206 | node1 | 2026-08-18 13:08:07.646212 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:07.646219 | node1 | Tuesday 18 August 2026 13:08:07 +0000 (0:00:00.352) 0:10:50.972 ******** 2026-08-18 13:08:07.731042 | node1 | skipping: [node1] 2026-08-18 13:08:07.731126 | node1 | skipping: [node2] 2026-08-18 13:08:07.731510 | node1 | skipping: [node3] 2026-08-18 13:08:07.731554 | node1 | 2026-08-18 13:08:07.731559 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:07.731565 | node1 | Tuesday 18 August 2026 13:08:07 +0000 (0:00:00.085) 0:10:51.057 ******** 2026-08-18 13:08:07.760163 | node1 | skipping: [node1] 2026-08-18 13:08:07.818446 | node1 | skipping: [node2] 2026-08-18 13:08:07.818534 | node1 | skipping: [node3] 2026-08-18 13:08:07.818622 | node1 | 2026-08-18 13:08:07.818719 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:07.818854 | node1 | Tuesday 18 August 2026 13:08:07 +0000 (0:00:00.087) 0:10:51.145 ******** 2026-08-18 13:08:08.055605 | node1 | ok: [node1] 2026-08-18 13:08:08.055645 | node1 | ok: [node2] 2026-08-18 13:08:08.055650 | node1 | ok: [node3] 2026-08-18 13:08:08.055654 | node1 | 2026-08-18 13:08:08.055659 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:08.055664 | node1 | Tuesday 18 August 2026 13:08:08 +0000 (0:00:00.236) 0:10:51.381 ******** 2026-08-18 13:08:09.429416 | node1 | ok: [node2] 2026-08-18 13:08:09.429491 | node1 | ok: [node1] 2026-08-18 13:08:09.429514 | node1 | ok: [node3] 2026-08-18 13:08:09.429810 | node1 | 2026-08-18 13:08:09.430090 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:09.430098 | node1 | Tuesday 18 August 2026 13:08:09 +0000 (0:00:01.374) 0:10:52.756 ******** 2026-08-18 13:08:09.518152 | node1 | ok: [node1] => { 2026-08-18 13:08:09.518213 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:08:09.519466 | node1 | } 2026-08-18 13:08:09.519515 | node1 | ok: [node2] => { 2026-08-18 13:08:09.519523 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:08:09.519529 | node1 | } 2026-08-18 13:08:09.519535 | node1 | ok: [node3] => { 2026-08-18 13:08:09.519541 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:08:09.519546 | node1 | } 2026-08-18 13:08:09.519552 | node1 | 2026-08-18 13:08:09.519558 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:09.519564 | node1 | Tuesday 18 August 2026 13:08:09 +0000 (0:00:00.088) 0:10:52.844 ******** 2026-08-18 13:08:09.889867 | node1 | ok: [node1] 2026-08-18 13:08:09.889908 | node1 | ok: [node2] 2026-08-18 13:08:09.889913 | node1 | ok: [node3] 2026-08-18 13:08:09.889917 | node1 | 2026-08-18 13:08:09.889922 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:09.889927 | node1 | Tuesday 18 August 2026 13:08:09 +0000 (0:00:00.371) 0:10:53.216 ******** 2026-08-18 13:08:11.911399 | node1 | ok: [node1] 2026-08-18 13:08:11.911468 | node1 | ok: [node3] 2026-08-18 13:08:11.911519 | node1 | ok: [node2] 2026-08-18 13:08:11.911775 | node1 | 2026-08-18 13:08:11.911791 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 13:08:11.911797 | node1 | Tuesday 18 August 2026 13:08:11 +0000 (0:00:02.021) 0:10:55.238 ******** 2026-08-18 13:08:11.940621 | node1 | skipping: [node1] 2026-08-18 13:08:11.967193 | node1 | skipping: [node2] 2026-08-18 13:08:11.967293 | node1 | skipping: [node3] 2026-08-18 13:08:11.967681 | node1 | 2026-08-18 13:08:11.967702 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 13:08:11.967709 | node1 | Tuesday 18 August 2026 13:08:11 +0000 (0:00:00.055) 0:10:55.293 ******** 2026-08-18 13:08:11.992827 | node1 | skipping: [node1] 2026-08-18 13:08:12.020360 | node1 | skipping: [node2] 2026-08-18 13:08:12.020446 | node1 | skipping: [node3] 2026-08-18 13:08:12.020617 | node1 | 2026-08-18 13:08:12.020830 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 13:08:12.020850 | node1 | Tuesday 18 August 2026 13:08:12 +0000 (0:00:00.053) 0:10:55.347 ******** 2026-08-18 13:08:12.052034 | node1 | skipping: [node1] 2026-08-18 13:08:12.080410 | node1 | skipping: [node2] 2026-08-18 13:08:12.080499 | node1 | skipping: [node3] 2026-08-18 13:08:12.080579 | node1 | 2026-08-18 13:08:12.080674 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 13:08:12.080758 | node1 | Tuesday 18 August 2026 13:08:12 +0000 (0:00:00.059) 0:10:55.407 ******** 2026-08-18 13:08:13.174890 | node1 | ok: [node2] 2026-08-18 13:08:13.174964 | node1 | ok: [node1] 2026-08-18 13:08:13.175025 | node1 | ok: [node3] 2026-08-18 13:08:13.175325 | node1 | 2026-08-18 13:08:13.175368 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 13:08:13.175374 | node1 | Tuesday 18 August 2026 13:08:13 +0000 (0:00:01.094) 0:10:56.501 ******** 2026-08-18 13:08:13.664091 | node1 | ok: [node1] 2026-08-18 13:08:13.664161 | node1 | ok: [node2] 2026-08-18 13:08:13.664520 | node1 | ok: [node3] 2026-08-18 13:08:13.664567 | node1 | 2026-08-18 13:08:13.664573 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 13:08:13.664578 | node1 | Tuesday 18 August 2026 13:08:13 +0000 (0:00:00.489) 0:10:56.990 ******** 2026-08-18 13:08:14.640384 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 13:08:14.640446 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 13:08:14.640815 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 13:08:14.640853 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:08:14.640859 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:08:14.640867 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:08:14.642024 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:08:14.642045 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:08:14.642062 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:08:14.642068 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:08:14.642074 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:08:14.642091 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:08:14.642096 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:08:14.642101 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:08:14.642105 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:08:14.642110 | node1 | 2026-08-18 13:08:14.642114 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 13:08:14.642119 | node1 | Tuesday 18 August 2026 13:08:14 +0000 (0:00:00.976) 0:10:57.966 ******** 2026-08-18 13:08:15.195113 | node1 | ok: [node1] 2026-08-18 13:08:15.195186 | node1 | ok: [node2] 2026-08-18 13:08:15.195251 | node1 | ok: [node3] 2026-08-18 13:08:15.196279 | node1 | 2026-08-18 13:08:15.196316 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:08:15.196322 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.538) 0:10:58.505 ******** 2026-08-18 13:08:15.196327 | node1 | 2026-08-18 13:08:15.196331 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:08:15.196335 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.005) 0:10:58.511 ******** 2026-08-18 13:08:15.196367 | node1 | 2026-08-18 13:08:15.196372 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:08:15.196376 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.004) 0:10:58.516 ******** 2026-08-18 13:08:15.196380 | node1 | 2026-08-18 13:08:15.196384 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 13:08:15.196388 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.005) 0:10:58.521 ******** 2026-08-18 13:08:15.582331 | node1 | ok: [node1] 2026-08-18 13:08:15.582389 | node1 | ok: [node2] 2026-08-18 13:08:15.582485 | node1 | ok: [node3] 2026-08-18 13:08:15.582779 | node1 | 2026-08-18 13:08:15.582824 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:15.582830 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.387) 0:10:58.908 ******** 2026-08-18 13:08:15.818521 | node1 | ok: [node1] 2026-08-18 13:08:15.818585 | node1 | ok: [node2] 2026-08-18 13:08:15.818649 | node1 | ok: [node3] 2026-08-18 13:08:15.818942 | node1 | 2026-08-18 13:08:15.818979 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:15.818985 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.236) 0:10:59.145 ******** 2026-08-18 13:08:15.890112 | node1 | ok: [node1] => { 2026-08-18 13:08:15.890218 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:08:15.890387 | node1 | } 2026-08-18 13:08:15.890463 | node1 | ok: [node2] => { 2026-08-18 13:08:15.891011 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:08:15.891055 | node1 | } 2026-08-18 13:08:15.891061 | node1 | ok: [node3] => { 2026-08-18 13:08:15.891066 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:08:15.891070 | node1 | } 2026-08-18 13:08:15.891074 | node1 | 2026-08-18 13:08:15.891275 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:15.891286 | node1 | Tuesday 18 August 2026 13:08:15 +0000 (0:00:00.071) 0:10:59.216 ******** 2026-08-18 13:08:16.274357 | node1 | ok: [node2] 2026-08-18 13:08:16.274421 | node1 | ok: [node1] 2026-08-18 13:08:16.274433 | node1 | ok: [node3] 2026-08-18 13:08:16.274443 | node1 | 2026-08-18 13:08:16.274453 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:16.274479 | node1 | Tuesday 18 August 2026 13:08:16 +0000 (0:00:00.382) 0:10:59.599 ******** 2026-08-18 13:08:20.303070 | node1 | ok: [node2] 2026-08-18 13:08:20.303249 | node1 | ok: [node3] 2026-08-18 13:08:20.303442 | node1 | ok: [node1] 2026-08-18 13:08:20.303625 | node1 | 2026-08-18 13:08:20.303833 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 13:08:20.304038 | node1 | Tuesday 18 August 2026 13:08:20 +0000 (0:00:04.029) 0:11:03.629 ******** 2026-08-18 13:08:21.557328 | node1 | ok: [node2] 2026-08-18 13:08:21.557535 | node1 | ok: [node1] 2026-08-18 13:08:21.557758 | node1 | ok: [node3] 2026-08-18 13:08:21.557965 | node1 | 2026-08-18 13:08:21.558199 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 13:08:21.558450 | node1 | Tuesday 18 August 2026 13:08:21 +0000 (0:00:01.253) 0:11:04.883 ******** 2026-08-18 13:08:21.794500 | node1 | ok: [node2] 2026-08-18 13:08:21.794690 | node1 | ok: [node1] 2026-08-18 13:08:21.794896 | node1 | ok: [node3] 2026-08-18 13:08:21.795124 | node1 | 2026-08-18 13:08:21.795340 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 13:08:21.795544 | node1 | Tuesday 18 August 2026 13:08:21 +0000 (0:00:00.237) 0:11:05.120 ******** 2026-08-18 13:08:22.256739 | node1 | ok: [node1] 2026-08-18 13:08:22.256799 | node1 | ok: [node2] 2026-08-18 13:08:22.256970 | node1 | ok: [node3] 2026-08-18 13:08:22.257032 | node1 | 2026-08-18 13:08:22.257173 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 13:08:22.257301 | node1 | Tuesday 18 August 2026 13:08:22 +0000 (0:00:00.462) 0:11:05.582 ******** 2026-08-18 13:08:22.893277 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 13:08:22.893426 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 13:08:22.893633 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 13:08:22.893841 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:08:22.894045 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:08:22.894295 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:08:22.894523 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:08:22.894724 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:08:22.894927 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:08:22.895114 | node1 | 2026-08-18 13:08:22.895322 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 13:08:22.895561 | node1 | Tuesday 18 August 2026 13:08:22 +0000 (0:00:00.636) 0:11:06.219 ******** 2026-08-18 13:08:23.341921 | node1 | ok: [node1] 2026-08-18 13:08:23.342101 | node1 | ok: [node2] 2026-08-18 13:08:23.342300 | node1 | ok: [node3] 2026-08-18 13:08:23.342496 | node1 | 2026-08-18 13:08:23.342701 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 13:08:23.342895 | node1 | Tuesday 18 August 2026 13:08:23 +0000 (0:00:00.448) 0:11:06.668 ******** 2026-08-18 13:08:23.822942 | node1 | ok: [node2] 2026-08-18 13:08:23.823123 | node1 | ok: [node1] 2026-08-18 13:08:23.823318 | node1 | ok: [node3] 2026-08-18 13:08:23.823546 | node1 | 2026-08-18 13:08:23.823767 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:08:23.823978 | node1 | Tuesday 18 August 2026 13:08:23 +0000 (0:00:00.461) 0:11:07.130 ******** 2026-08-18 13:08:23.824153 | node1 | 2026-08-18 13:08:23.824362 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:08:23.824554 | node1 | Tuesday 18 August 2026 13:08:23 +0000 (0:00:00.005) 0:11:07.136 ******** 2026-08-18 13:08:23.824732 | node1 | 2026-08-18 13:08:23.824934 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:08:23.825134 | node1 | Tuesday 18 August 2026 13:08:23 +0000 (0:00:00.005) 0:11:07.142 ******** 2026-08-18 13:08:23.825314 | node1 | 2026-08-18 13:08:23.825515 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 13:08:23.825713 | node1 | Tuesday 18 August 2026 13:08:23 +0000 (0:00:00.006) 0:11:07.148 ******** 2026-08-18 13:08:24.248195 | node1 | ok: [node1] 2026-08-18 13:08:24.248304 | node1 | ok: [node2] 2026-08-18 13:08:24.248316 | node1 | ok: [node3] 2026-08-18 13:08:24.248326 | node1 | 2026-08-18 13:08:24.248337 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:24.248347 | node1 | Tuesday 18 August 2026 13:08:24 +0000 (0:00:00.424) 0:11:07.573 ******** 2026-08-18 13:08:24.300642 | node1 | ok: [node1] => { 2026-08-18 13:08:24.300696 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:08:24.300702 | node1 | } 2026-08-18 13:08:24.300707 | node1 | ok: [node2] => { 2026-08-18 13:08:24.300712 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:08:24.300716 | node1 | } 2026-08-18 13:08:24.300720 | node1 | ok: [node3] => { 2026-08-18 13:08:24.300724 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:08:24.300728 | node1 | } 2026-08-18 13:08:24.300732 | node1 | 2026-08-18 13:08:24.300737 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:24.300748 | node1 | Tuesday 18 August 2026 13:08:24 +0000 (0:00:00.051) 0:11:07.624 ******** 2026-08-18 13:08:24.601393 | node1 | ok: [node1] 2026-08-18 13:08:24.601433 | node1 | ok: [node2] 2026-08-18 13:08:24.601439 | node1 | ok: [node3] 2026-08-18 13:08:24.601443 | node1 | 2026-08-18 13:08:24.601448 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:24.601453 | node1 | Tuesday 18 August 2026 13:08:24 +0000 (0:00:00.302) 0:11:07.927 ******** 2026-08-18 13:08:24.624901 | node1 | skipping: [node1] 2026-08-18 13:08:24.672665 | node1 | skipping: [node2] 2026-08-18 13:08:24.672692 | node1 | skipping: [node3] 2026-08-18 13:08:24.672697 | node1 | 2026-08-18 13:08:24.672702 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 13:08:24.672708 | node1 | Tuesday 18 August 2026 13:08:24 +0000 (0:00:00.071) 0:11:07.999 ******** 2026-08-18 13:08:24.737423 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:08:24.737470 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:08:24.737477 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:08:24.737483 | node1 | 2026-08-18 13:08:24.737490 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 13:08:24.737497 | node1 | Tuesday 18 August 2026 13:08:24 +0000 (0:00:00.064) 0:11:08.063 ******** 2026-08-18 13:08:25.794642 | node1 | ok: [node1] 2026-08-18 13:08:25.794711 | node1 | ok: [node2] 2026-08-18 13:08:25.794798 | node1 | ok: [node3] 2026-08-18 13:08:25.795071 | node1 | 2026-08-18 13:08:25.795087 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 13:08:25.795094 | node1 | Tuesday 18 August 2026 13:08:25 +0000 (0:00:01.057) 0:11:09.121 ******** 2026-08-18 13:08:26.492561 | node1 | ok: [node1] => (item=chronyd) 2026-08-18 13:08:26.492666 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 13:08:26.493430 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 13:08:26.493680 | node1 | ok: [node1] => (item=sshd) 2026-08-18 13:08:26.493688 | node1 | ok: [node2] => (item=sshd) 2026-08-18 13:08:26.493695 | node1 | ok: [node3] => (item=sshd) 2026-08-18 13:08:26.493700 | node1 | 2026-08-18 13:08:26.493705 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 13:08:26.493715 | node1 | Tuesday 18 August 2026 13:08:26 +0000 (0:00:00.697) 0:11:09.818 ******** 2026-08-18 13:08:26.723865 | node1 | ok: [node1] 2026-08-18 13:08:26.723952 | node1 | ok: [node2] 2026-08-18 13:08:26.724139 | node1 | ok: [node3] 2026-08-18 13:08:26.724210 | node1 | 2026-08-18 13:08:26.724490 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 13:08:26.724535 | node1 | Tuesday 18 August 2026 13:08:26 +0000 (0:00:00.231) 0:11:10.050 ******** 2026-08-18 13:08:26.997401 | node1 | ok: [node1] 2026-08-18 13:08:26.998038 | node1 | ok: [node2] 2026-08-18 13:08:26.998094 | node1 | ok: [node3] 2026-08-18 13:08:26.998102 | node1 | 2026-08-18 13:08:26.998108 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 13:08:26.998115 | node1 | Tuesday 18 August 2026 13:08:26 +0000 (0:00:00.273) 0:11:10.323 ******** 2026-08-18 13:08:27.453312 | node1 | ok: [node1] 2026-08-18 13:08:27.453359 | node1 | ok: [node2] 2026-08-18 13:08:27.453366 | node1 | ok: [node3] 2026-08-18 13:08:27.453372 | node1 | 2026-08-18 13:08:27.453379 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 13:08:27.453385 | node1 | Tuesday 18 August 2026 13:08:27 +0000 (0:00:00.455) 0:11:10.779 ******** 2026-08-18 13:08:27.500622 | node1 | skipping: [node1] 2026-08-18 13:08:27.500688 | node1 | skipping: [node2] 2026-08-18 13:08:27.500762 | node1 | skipping: [node3] 2026-08-18 13:08:27.501035 | node1 | 2026-08-18 13:08:27.501052 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 13:08:27.501057 | node1 | Tuesday 18 August 2026 13:08:27 +0000 (0:00:00.048) 0:11:10.827 ******** 2026-08-18 13:08:27.874136 | node1 | ok: [node1] 2026-08-18 13:08:27.874267 | node1 | ok: [node2] 2026-08-18 13:08:27.874900 | node1 | ok: [node3] 2026-08-18 13:08:27.874949 | node1 | 2026-08-18 13:08:27.874957 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 13:08:27.874965 | node1 | Tuesday 18 August 2026 13:08:27 +0000 (0:00:00.373) 0:11:11.200 ******** 2026-08-18 13:08:28.339728 | node1 | ok: [node1] 2026-08-18 13:08:28.339813 | node1 | ok: [node3] 2026-08-18 13:08:28.339929 | node1 | ok: [node2] 2026-08-18 13:08:28.340229 | node1 | 2026-08-18 13:08:28.340245 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 13:08:28.340251 | node1 | Tuesday 18 August 2026 13:08:28 +0000 (0:00:00.465) 0:11:11.666 ******** 2026-08-18 13:08:28.926040 | node1 | ok: [node1] => (item=node1) 2026-08-18 13:08:28.926122 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 13:08:28.926186 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 13:08:28.926403 | node1 | 2026-08-18 13:08:28.926502 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 13:08:28.926523 | node1 | Tuesday 18 August 2026 13:08:28 +0000 (0:00:00.586) 0:11:12.252 ******** 2026-08-18 13:08:29.006710 | node1 | ok: [node1] 2026-08-18 13:08:29.006884 | node1 | ok: [node2] 2026-08-18 13:08:29.007063 | node1 | ok: [node3] 2026-08-18 13:08:29.007230 | node1 | 2026-08-18 13:08:29.007433 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 13:08:29.007618 | node1 | Tuesday 18 August 2026 13:08:29 +0000 (0:00:00.080) 0:11:12.333 ******** 2026-08-18 13:08:29.073288 | node1 | ok: [node1] 2026-08-18 13:08:29.073440 | node1 | ok: [node2] 2026-08-18 13:08:29.073625 | node1 | ok: [node3] 2026-08-18 13:08:29.073799 | node1 | 2026-08-18 13:08:29.073996 | node1 | TASK [Register this RGW host] ************************************************** 2026-08-18 13:08:29.074194 | node1 | Tuesday 18 August 2026 13:08:29 +0000 (0:00:00.066) 0:11:12.399 ******** 2026-08-18 13:08:29.173208 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 13:08:29.173358 | node1 | 2026-08-18 13:08:29.173564 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 13:08:29.173762 | node1 | Tuesday 18 August 2026 13:08:29 +0000 (0:00:00.100) 0:11:12.499 ******** 2026-08-18 13:08:30.610087 | node1 | ok: [node1] 2026-08-18 13:08:30.610310 | node1 | 2026-08-18 13:08:30.610540 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 13:08:30.610736 | node1 | Tuesday 18 August 2026 13:08:30 +0000 (0:00:01.436) 0:11:13.936 ******** 2026-08-18 13:08:30.667806 | node1 | ok: [node1] 2026-08-18 13:08:30.667993 | node1 | ok: [node2] 2026-08-18 13:08:30.668175 | node1 | ok: [node3] 2026-08-18 13:08:30.668365 | node1 | 2026-08-18 13:08:30.668577 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 13:08:30.668787 | node1 | Tuesday 18 August 2026 13:08:30 +0000 (0:00:00.058) 0:11:13.994 ******** 2026-08-18 13:08:30.724143 | node1 | ok: [node1] => { 2026-08-18 13:08:30.724382 | node1 | "changed": false, 2026-08-18 13:08:30.724586 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:30.724830 | node1 | } 2026-08-18 13:08:30.726399 | node1 | ok: [node2] => { 2026-08-18 13:08:30.726462 | node1 | "changed": false, 2026-08-18 13:08:30.726474 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:30.726486 | node1 | } 2026-08-18 13:08:30.726496 | node1 | ok: [node3] => { 2026-08-18 13:08:30.726506 | node1 | "changed": false, 2026-08-18 13:08:30.726516 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:30.726533 | node1 | } 2026-08-18 13:08:30.726595 | node1 | 2026-08-18 13:08:30.726752 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 13:08:30.726850 | node1 | Tuesday 18 August 2026 13:08:30 +0000 (0:00:00.056) 0:11:14.050 ******** 2026-08-18 13:08:30.997007 | node1 | ok: [node1] 2026-08-18 13:08:30.997109 | node1 | ok: [node2] 2026-08-18 13:08:30.997228 | node1 | ok: [node3] 2026-08-18 13:08:30.997339 | node1 | 2026-08-18 13:08:30.997475 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 13:08:30.997599 | node1 | Tuesday 18 August 2026 13:08:30 +0000 (0:00:00.272) 0:11:14.323 ******** 2026-08-18 13:08:31.061936 | node1 | ok: [node1] 2026-08-18 13:08:31.062118 | node1 | ok: [node2] 2026-08-18 13:08:31.062344 | node1 | ok: [node3] 2026-08-18 13:08:31.062525 | node1 | 2026-08-18 13:08:31.062740 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 13:08:31.062936 | node1 | Tuesday 18 August 2026 13:08:31 +0000 (0:00:00.064) 0:11:14.388 ******** 2026-08-18 13:08:31.158823 | node1 | ok: [node1] 2026-08-18 13:08:31.159006 | node1 | ok: [node2] 2026-08-18 13:08:31.159196 | node1 | ok: [node3] 2026-08-18 13:08:31.159373 | node1 | 2026-08-18 13:08:31.159586 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 13:08:31.159786 | node1 | Tuesday 18 August 2026 13:08:31 +0000 (0:00:00.096) 0:11:14.484 ******** 2026-08-18 13:08:31.221390 | node1 | ok: [node1] => { 2026-08-18 13:08:31.221580 | node1 | "changed": false, 2026-08-18 13:08:31.221771 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:31.222050 | node1 | } 2026-08-18 13:08:31.222245 | node1 | ok: [node2] => { 2026-08-18 13:08:31.222464 | node1 | "changed": false, 2026-08-18 13:08:31.222652 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:31.222831 | node1 | } 2026-08-18 13:08:31.223017 | node1 | ok: [node3] => { 2026-08-18 13:08:31.223225 | node1 | "changed": false, 2026-08-18 13:08:31.223413 | node1 | "msg": "All assertions passed" 2026-08-18 13:08:31.223591 | node1 | } 2026-08-18 13:08:31.223765 | node1 | 2026-08-18 13:08:31.223968 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 13:08:31.224163 | node1 | Tuesday 18 August 2026 13:08:31 +0000 (0:00:00.062) 0:11:14.547 ******** 2026-08-18 13:08:32.760904 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:08:32.761129 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:08:32.761432 | node1 | ok: [node1] 2026-08-18 13:08:32.761577 | node1 | 2026-08-18 13:08:32.761738 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 13:08:32.761982 | node1 | Tuesday 18 August 2026 13:08:32 +0000 (0:00:01.539) 0:11:16.086 ******** 2026-08-18 13:08:32.838598 | node1 | skipping: [node1] 2026-08-18 13:08:32.838769 | node1 | skipping: [node2] 2026-08-18 13:08:32.838965 | node1 | skipping: [node3] 2026-08-18 13:08:32.839152 | node1 | 2026-08-18 13:08:32.839361 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 13:08:32.839558 | node1 | Tuesday 18 August 2026 13:08:32 +0000 (0:00:00.078) 0:11:16.165 ******** 2026-08-18 13:08:32.890814 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1 2026-08-18 13:08:32.891031 | node1 | 2026-08-18 13:08:32.891245 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 13:08:32.891441 | node1 | Tuesday 18 August 2026 13:08:32 +0000 (0:00:00.052) 0:11:16.217 ******** 2026-08-18 13:08:37.201515 | node1 | changed: [node1] => (item=molecule) 2026-08-18 13:08:37.201697 | node1 | 2026-08-18 13:08:37.201930 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 13:08:37.202179 | node1 | Tuesday 18 August 2026 13:08:37 +0000 (0:00:04.310) 0:11:20.527 ******** 2026-08-18 13:08:39.201496 | node1 | changed: [node1] => (item=molecule) 2026-08-18 13:08:39.201668 | node1 | 2026-08-18 13:08:39.201885 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 13:08:39.202105 | node1 | Tuesday 18 August 2026 13:08:39 +0000 (0:00:02.000) 0:11:22.528 ******** 2026-08-18 13:08:41.275556 | node1 | changed: [node1] => (item=None) 2026-08-18 13:08:41.275607 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}] 2026-08-18 13:08:41.275616 | node1 | 2026-08-18 13:08:41.275622 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 13:08:41.275628 | node1 | Tuesday 18 August 2026 13:08:41 +0000 (0:00:02.073) 0:11:24.601 ******** 2026-08-18 13:08:42.678777 | node1 | changed: [node1] 2026-08-18 13:08:42.678857 | node1 | 2026-08-18 13:08:42.679162 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 13:08:42.679207 | node1 | Tuesday 18 August 2026 13:08:42 +0000 (0:00:01.403) 0:11:26.005 ******** 2026-08-18 13:08:42.731292 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1 2026-08-18 13:08:42.731344 | node1 | 2026-08-18 13:08:42.731458 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 13:08:42.731577 | node1 | Tuesday 18 August 2026 13:08:42 +0000 (0:00:00.052) 0:11:26.058 ******** 2026-08-18 13:08:44.166996 | node1 | ok: [node1] 2026-08-18 13:08:44.167075 | node1 | 2026-08-18 13:08:44.167399 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 13:08:44.167445 | node1 | Tuesday 18 August 2026 13:08:44 +0000 (0:00:01.435) 0:11:27.493 ******** 2026-08-18 13:08:44.208789 | node1 | ok: [node1] 2026-08-18 13:08:44.208906 | node1 | 2026-08-18 13:08:44.209185 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 13:08:44.209212 | node1 | Tuesday 18 August 2026 13:08:44 +0000 (0:00:00.042) 0:11:27.535 ******** 2026-08-18 13:08:46.993708 | node1 | changed: [node1] => (item=molecule) 2026-08-18 13:08:46.993754 | node1 | 2026-08-18 13:08:46.993760 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 13:08:46.993765 | node1 | Tuesday 18 August 2026 13:08:46 +0000 (0:00:02.784) 0:11:30.320 ******** 2026-08-18 13:08:48.409799 | node1 | failed: [node1] (item=rgw.molecule) => {"ansible_loop_var": "item", "changed": true, "cmd": ["cephadm", "shell", "--fsid", "1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", "--config", "/var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.node1/config", "--", "ceph", "orch", "redeploy", "rgw.molecule"], "delta": "0:00:01.223705", "end": "2026-08-18 13:08:48.382714", "item": {"count_per_host": 1, "id": "molecule", "networks": ["0.0.0.0/0"], "spec": {"generate_cert": true, "rgw_frontend_port": 8080, "rgw_realm": "molecule", "rgw_zone": "molecule-1", "rgw_zonegroup": "molecule", "ssl": true}}, "msg": "non-zero return code", "rc": 22, "start": "2026-08-18 13:08:47.159009", "stderr": "Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\"", "stderr_lines": ["Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\""], "stdout": "", "stdout_lines": []} 2026-08-18 13:08:48.425529 | node1 | 2026-08-18 13:08:48.426022 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 13:08:48.426079 | node1 | Tuesday 18 August 2026 13:08:48 +0000 (0:00:01.431) 0:11:31.751 ******** 2026-08-18 13:08:48.475537 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node2 2026-08-18 13:08:48.475588 | node1 | 2026-08-18 13:08:48.475805 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] ************************************** 2026-08-18 13:08:48.475838 | node1 | Tuesday 18 August 2026 13:08:48 +0000 (0:00:00.050) 0:11:31.802 ******** 2026-08-18 13:08:49.515191 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 13:08:49.515648 | node1 | 2026-08-18 13:08:49.515696 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************ 2026-08-18 13:08:49.515705 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:01.039) 0:11:32.841 ******** 2026-08-18 13:08:49.554958 | node1 | skipping: [node2] 2026-08-18 13:08:49.554997 | node1 | 2026-08-18 13:08:49.555270 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] ***************************** 2026-08-18 13:08:49.555303 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.039) 0:11:32.881 ******** 2026-08-18 13:08:49.601352 | node1 | skipping: [node2] 2026-08-18 13:08:49.601796 | node1 | 2026-08-18 13:08:49.601848 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] *************** 2026-08-18 13:08:49.601856 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.046) 0:11:32.927 ******** 2026-08-18 13:08:49.643436 | node1 | skipping: [node2] 2026-08-18 13:08:49.643604 | node1 | 2026-08-18 13:08:49.643864 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] ********************************* 2026-08-18 13:08:49.643926 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.042) 0:11:32.969 ******** 2026-08-18 13:08:49.680344 | node1 | skipping: [node2] 2026-08-18 13:08:49.680571 | node1 | 2026-08-18 13:08:49.680589 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************ 2026-08-18 13:08:49.680745 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.037) 0:11:33.006 ******** 2026-08-18 13:08:49.736750 | node1 | skipping: [node2] => (item=default.rgw.control) 2026-08-18 13:08:49.736837 | node1 | skipping: [node2] => (item=default.rgw.log) 2026-08-18 13:08:49.737291 | node1 | skipping: [node2] => (item=default.rgw.meta) 2026-08-18 13:08:49.737311 | node1 | skipping: [node2] 2026-08-18 13:08:49.737317 | node1 | 2026-08-18 13:08:49.737321 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ******** 2026-08-18 13:08:49.737326 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.056) 0:11:33.063 ******** 2026-08-18 13:08:49.778838 | node1 | skipping: [node2] 2026-08-18 13:08:49.778921 | node1 | 2026-08-18 13:08:49.779021 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] ********** 2026-08-18 13:08:49.779114 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.042) 0:11:33.105 ******** 2026-08-18 13:08:49.851679 | node1 | skipping: [node2] 2026-08-18 13:08:49.851773 | node1 | 2026-08-18 13:08:49.851869 | node1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 13:08:49.851978 | node1 | 2026-08-18 13:08:49.852132 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 13:08:49.852259 | node1 | Tuesday 18 August 2026 13:08:49 +0000 (0:00:00.072) 0:11:33.178 ******** 2026-08-18 13:08:50.872038 | node1 | ok: [node2] 2026-08-18 13:08:50.872113 | node1 | ok: [node3] 2026-08-18 13:08:50.872478 | node1 | 2026-08-18 13:08:50.872521 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:50.872528 | node1 | Tuesday 18 August 2026 13:08:50 +0000 (0:00:01.020) 0:11:34.198 ******** 2026-08-18 13:08:51.096954 | node1 | ok: [node2] 2026-08-18 13:08:51.097030 | node1 | ok: [node3] 2026-08-18 13:08:51.097044 | node1 | 2026-08-18 13:08:51.097270 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:51.097313 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.224) 0:11:34.423 ******** 2026-08-18 13:08:51.151954 | node1 | skipping: [node2] 2026-08-18 13:08:51.152000 | node1 | skipping: [node3] 2026-08-18 13:08:51.152341 | node1 | 2026-08-18 13:08:51.152386 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 13:08:51.152392 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.054) 0:11:34.478 ******** 2026-08-18 13:08:51.376966 | node1 | ok: [node2] 2026-08-18 13:08:51.377024 | node1 | ok: [node3] 2026-08-18 13:08:51.377113 | node1 | 2026-08-18 13:08:51.377214 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:51.377308 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.225) 0:11:34.703 ******** 2026-08-18 13:08:51.445336 | node1 | ok: [node2] => { 2026-08-18 13:08:51.445448 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:08:51.445457 | node1 | } 2026-08-18 13:08:51.445473 | node1 | ok: [node3] => { 2026-08-18 13:08:51.445479 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 13:08:51.445485 | node1 | } 2026-08-18 13:08:51.445558 | node1 | 2026-08-18 13:08:51.445650 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:51.445752 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.067) 0:11:34.771 ******** 2026-08-18 13:08:51.782829 | node1 | ok: [node2] 2026-08-18 13:08:51.782897 | node1 | ok: [node3] 2026-08-18 13:08:51.782909 | node1 | 2026-08-18 13:08:51.782925 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:51.782946 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.337) 0:11:35.109 ******** 2026-08-18 13:08:51.833909 | node1 | skipping: [node2] 2026-08-18 13:08:51.833981 | node1 | skipping: [node3] 2026-08-18 13:08:51.834316 | node1 | 2026-08-18 13:08:51.834362 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:51.834368 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.051) 0:11:35.160 ******** 2026-08-18 13:08:51.906244 | node1 | skipping: [node2] 2026-08-18 13:08:51.906362 | node1 | skipping: [node3] 2026-08-18 13:08:51.906435 | node1 | 2026-08-18 13:08:51.906528 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:51.906673 | node1 | Tuesday 18 August 2026 13:08:51 +0000 (0:00:00.071) 0:11:35.232 ******** 2026-08-18 13:08:52.163847 | node1 | ok: [node2] 2026-08-18 13:08:52.163959 | node1 | ok: [node3] 2026-08-18 13:08:52.164071 | node1 | 2026-08-18 13:08:52.164213 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 13:08:52.164345 | node1 | Tuesday 18 August 2026 13:08:52 +0000 (0:00:00.257) 0:11:35.489 ******** 2026-08-18 13:08:53.589765 | node1 | ok: [node2] 2026-08-18 13:08:53.589881 | node1 | ok: [node3] 2026-08-18 13:08:53.590115 | node1 | 2026-08-18 13:08:53.590451 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:08:53.590725 | node1 | Tuesday 18 August 2026 13:08:53 +0000 (0:00:01.425) 0:11:36.915 ******** 2026-08-18 13:08:53.667057 | node1 | ok: [node2] => { 2026-08-18 13:08:53.667299 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:08:53.667498 | node1 | } 2026-08-18 13:08:53.667699 | node1 | ok: [node3] => { 2026-08-18 13:08:53.667866 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 13:08:53.668041 | node1 | } 2026-08-18 13:08:53.668209 | node1 | 2026-08-18 13:08:53.668419 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:08:53.668607 | node1 | Tuesday 18 August 2026 13:08:53 +0000 (0:00:00.077) 0:11:36.992 ******** 2026-08-18 13:08:54.018170 | node1 | ok: [node2] 2026-08-18 13:08:54.018379 | node1 | ok: [node3] 2026-08-18 13:08:54.018557 | node1 | 2026-08-18 13:08:54.018763 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:08:54.018963 | node1 | Tuesday 18 August 2026 13:08:54 +0000 (0:00:00.351) 0:11:37.344 ******** 2026-08-18 13:08:56.046156 | node1 | ok: [node2] 2026-08-18 13:08:56.046221 | node1 | ok: [node3] 2026-08-18 13:08:56.046232 | node1 | 2026-08-18 13:08:56.046242 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 13:08:56.046252 | node1 | Tuesday 18 August 2026 13:08:56 +0000 (0:00:02.027) 0:11:39.371 ******** 2026-08-18 13:08:56.081912 | node1 | skipping: [node2] 2026-08-18 13:08:56.081995 | node1 | skipping: [node3] 2026-08-18 13:08:56.082057 | node1 | 2026-08-18 13:08:56.082349 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 13:08:56.082412 | node1 | Tuesday 18 August 2026 13:08:56 +0000 (0:00:00.036) 0:11:39.408 ******** 2026-08-18 13:08:56.126948 | node1 | skipping: [node2] 2026-08-18 13:08:56.127517 | node1 | skipping: [node3] 2026-08-18 13:08:56.127561 | node1 | 2026-08-18 13:08:56.127569 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 13:08:56.127576 | node1 | Tuesday 18 August 2026 13:08:56 +0000 (0:00:00.045) 0:11:39.453 ******** 2026-08-18 13:08:56.222326 | node1 | skipping: [node2] 2026-08-18 13:08:56.222616 | node1 | skipping: [node3] 2026-08-18 13:08:56.222634 | node1 | 2026-08-18 13:08:56.222914 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 13:08:56.222964 | node1 | Tuesday 18 August 2026 13:08:56 +0000 (0:00:00.095) 0:11:39.548 ******** 2026-08-18 13:08:57.535186 | node1 | ok: [node2] 2026-08-18 13:08:57.535265 | node1 | ok: [node3] 2026-08-18 13:08:57.535684 | node1 | 2026-08-18 13:08:57.535734 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 13:08:57.535742 | node1 | Tuesday 18 August 2026 13:08:57 +0000 (0:00:01.313) 0:11:40.861 ******** 2026-08-18 13:08:57.981542 | node1 | ok: [node3] 2026-08-18 13:08:57.981608 | node1 | ok: [node2] 2026-08-18 13:08:57.981667 | node1 | 2026-08-18 13:08:57.981883 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 13:08:57.981928 | node1 | Tuesday 18 August 2026 13:08:57 +0000 (0:00:00.445) 0:11:41.307 ******** 2026-08-18 13:08:58.885052 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 13:08:58.885123 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 13:08:58.885206 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:08:58.886167 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 13:08:58.886214 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:08:58.886220 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 13:08:58.886224 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:08:58.886229 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 13:08:58.886234 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:08:58.886239 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 13:08:58.886243 | node1 | 2026-08-18 13:08:58.886248 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 13:08:58.886252 | node1 | Tuesday 18 August 2026 13:08:58 +0000 (0:00:00.903) 0:11:42.211 ******** 2026-08-18 13:08:59.421390 | node1 | ok: [node2] 2026-08-18 13:08:59.421462 | node1 | ok: [node3] 2026-08-18 13:08:59.421521 | node1 | 2026-08-18 13:08:59.422256 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:08:59.422333 | node1 | Tuesday 18 August 2026 13:08:59 +0000 (0:00:00.525) 0:11:42.737 ******** 2026-08-18 13:08:59.422341 | node1 | 2026-08-18 13:08:59.422346 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 13:08:59.422350 | node1 | Tuesday 18 August 2026 13:08:59 +0000 (0:00:00.005) 0:11:42.742 ******** 2026-08-18 13:08:59.422354 | node1 | 2026-08-18 13:08:59.422360 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 13:08:59.422379 | node1 | Tuesday 18 August 2026 13:08:59 +0000 (0:00:00.005) 0:11:42.747 ******** 2026-08-18 13:08:59.809942 | node1 | ok: [node2] 2026-08-18 13:08:59.810063 | node1 | ok: [node3] 2026-08-18 13:08:59.810076 | node1 | 2026-08-18 13:08:59.810091 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 13:08:59.810242 | node1 | Tuesday 18 August 2026 13:08:59 +0000 (0:00:00.388) 0:11:43.136 ******** 2026-08-18 13:09:00.044288 | node1 | ok: [node2] 2026-08-18 13:09:00.044352 | node1 | ok: [node3] 2026-08-18 13:09:00.044414 | node1 | 2026-08-18 13:09:00.044681 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:09:00.044765 | node1 | Tuesday 18 August 2026 13:09:00 +0000 (0:00:00.233) 0:11:43.370 ******** 2026-08-18 13:09:00.113672 | node1 | ok: [node2] => { 2026-08-18 13:09:00.113784 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:09:00.113801 | node1 | } 2026-08-18 13:09:00.113863 | node1 | ok: [node3] => { 2026-08-18 13:09:00.114331 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 13:09:00.114387 | node1 | } 2026-08-18 13:09:00.114394 | node1 | 2026-08-18 13:09:00.114399 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:09:00.114459 | node1 | Tuesday 18 August 2026 13:09:00 +0000 (0:00:00.069) 0:11:43.439 ******** 2026-08-18 13:09:00.456296 | node1 | ok: [node2] 2026-08-18 13:09:00.456333 | node1 | ok: [node3] 2026-08-18 13:09:00.456339 | node1 | 2026-08-18 13:09:00.456344 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:09:00.456348 | node1 | Tuesday 18 August 2026 13:09:00 +0000 (0:00:00.343) 0:11:43.782 ******** 2026-08-18 13:09:03.580144 | node1 | ok: [node2] 2026-08-18 13:09:03.580225 | node1 | ok: [node3] 2026-08-18 13:09:03.580237 | node1 | 2026-08-18 13:09:03.580432 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 13:09:03.580475 | node1 | Tuesday 18 August 2026 13:09:03 +0000 (0:00:03.124) 0:11:46.906 ******** 2026-08-18 13:09:04.940136 | node1 | ok: [node2] 2026-08-18 13:09:04.940182 | node1 | ok: [node3] 2026-08-18 13:09:04.940190 | node1 | 2026-08-18 13:09:04.940196 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 13:09:04.940203 | node1 | Tuesday 18 August 2026 13:09:04 +0000 (0:00:01.358) 0:11:48.265 ******** 2026-08-18 13:09:05.137403 | node1 | ok: [node2] 2026-08-18 13:09:05.137474 | node1 | ok: [node3] 2026-08-18 13:09:05.137944 | node1 | 2026-08-18 13:09:05.137994 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 13:09:05.138002 | node1 | Tuesday 18 August 2026 13:09:05 +0000 (0:00:00.198) 0:11:48.464 ******** 2026-08-18 13:09:05.595019 | node1 | ok: [node2] 2026-08-18 13:09:05.595086 | node1 | ok: [node3] 2026-08-18 13:09:05.595155 | node1 | 2026-08-18 13:09:05.595355 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 13:09:05.595370 | node1 | Tuesday 18 August 2026 13:09:05 +0000 (0:00:00.457) 0:11:48.921 ******** 2026-08-18 13:09:06.158758 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 13:09:06.158820 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 13:09:06.159436 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:09:06.159452 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 13:09:06.159457 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:09:06.159461 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 13:09:06.159466 | node1 | 2026-08-18 13:09:06.159470 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 13:09:06.159475 | node1 | Tuesday 18 August 2026 13:09:06 +0000 (0:00:00.564) 0:11:49.485 ******** 2026-08-18 13:09:06.603787 | node1 | ok: [node2] 2026-08-18 13:09:06.603843 | node1 | ok: [node3] 2026-08-18 13:09:06.604186 | node1 | 2026-08-18 13:09:06.604232 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 13:09:06.604238 | node1 | Tuesday 18 August 2026 13:09:06 +0000 (0:00:00.444) 0:11:49.930 ******** 2026-08-18 13:09:07.086463 | node1 | ok: [node2] 2026-08-18 13:09:07.086538 | node1 | ok: [node3] 2026-08-18 13:09:07.086603 | node1 | 2026-08-18 13:09:07.087330 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:09:07.087373 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.471) 0:11:50.402 ******** 2026-08-18 13:09:07.087379 | node1 | 2026-08-18 13:09:07.087383 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 13:09:07.087388 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.006) 0:11:50.408 ******** 2026-08-18 13:09:07.087392 | node1 | 2026-08-18 13:09:07.087396 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 13:09:07.087410 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.005) 0:11:50.413 ******** 2026-08-18 13:09:07.450161 | node1 | ok: [node2] 2026-08-18 13:09:07.450223 | node1 | ok: [node3] 2026-08-18 13:09:07.450472 | node1 | 2026-08-18 13:09:07.450555 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 13:09:07.450567 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.363) 0:11:50.776 ******** 2026-08-18 13:09:07.494431 | node1 | ok: [node2] => { 2026-08-18 13:09:07.494631 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:09:07.494841 | node1 | } 2026-08-18 13:09:07.495097 | node1 | ok: [node3] => { 2026-08-18 13:09:07.495265 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 13:09:07.495431 | node1 | } 2026-08-18 13:09:07.495606 | node1 | 2026-08-18 13:09:07.495819 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 13:09:07.496006 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.044) 0:11:50.821 ******** 2026-08-18 13:09:07.788269 | node1 | ok: [node2] 2026-08-18 13:09:07.788460 | node1 | ok: [node3] 2026-08-18 13:09:07.788639 | node1 | 2026-08-18 13:09:07.788870 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 13:09:07.789120 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.293) 0:11:51.114 ******** 2026-08-18 13:09:07.834517 | node1 | skipping: [node2] 2026-08-18 13:09:07.834700 | node1 | skipping: [node3] 2026-08-18 13:09:07.834877 | node1 | 2026-08-18 13:09:07.835082 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 13:09:07.835279 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.046) 0:11:51.161 ******** 2026-08-18 13:09:07.887034 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:09:07.887253 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-08-18 13:09:07.887387 | node1 | 2026-08-18 13:09:07.887665 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 13:09:07.887871 | node1 | Tuesday 18 August 2026 13:09:07 +0000 (0:00:00.052) 0:11:51.213 ******** 2026-08-18 13:09:09.222939 | node1 | ok: [node2] 2026-08-18 13:09:09.223045 | node1 | ok: [node3] 2026-08-18 13:09:09.223151 | node1 | 2026-08-18 13:09:09.223283 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 13:09:09.223409 | node1 | Tuesday 18 August 2026 13:09:09 +0000 (0:00:01.335) 0:11:52.549 ******** 2026-08-18 13:09:09.874446 | node1 | ok: [node2] => (item=chronyd) 2026-08-18 13:09:09.874654 | node1 | ok: [node3] => (item=chronyd) 2026-08-18 13:09:09.874929 | node1 | ok: [node2] => (item=sshd) 2026-08-18 13:09:09.875134 | node1 | ok: [node3] => (item=sshd) 2026-08-18 13:09:09.875314 | node1 | 2026-08-18 13:09:09.875520 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 13:09:09.875719 | node1 | Tuesday 18 August 2026 13:09:09 +0000 (0:00:00.651) 0:11:53.200 ******** 2026-08-18 13:09:10.084917 | node1 | ok: [node2] 2026-08-18 13:09:10.084976 | node1 | ok: [node3] 2026-08-18 13:09:10.085054 | node1 | 2026-08-18 13:09:10.085149 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 13:09:10.085239 | node1 | Tuesday 18 August 2026 13:09:10 +0000 (0:00:00.210) 0:11:53.411 ******** 2026-08-18 13:09:10.340489 | node1 | ok: [node2] 2026-08-18 13:09:10.340576 | node1 | ok: [node3] 2026-08-18 13:09:10.340588 | node1 | 2026-08-18 13:09:10.340599 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 13:09:10.340610 | node1 | Tuesday 18 August 2026 13:09:10 +0000 (0:00:00.254) 0:11:53.665 ******** 2026-08-18 13:09:10.761002 | node1 | ok: [node2] 2026-08-18 13:09:10.761078 | node1 | ok: [node3] 2026-08-18 13:09:10.761093 | node1 | 2026-08-18 13:09:10.761328 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 13:09:10.761371 | node1 | Tuesday 18 August 2026 13:09:10 +0000 (0:00:00.421) 0:11:54.087 ******** 2026-08-18 13:09:10.806083 | node1 | skipping: [node2] 2026-08-18 13:09:10.806146 | node1 | skipping: [node3] 2026-08-18 13:09:10.806374 | node1 | 2026-08-18 13:09:10.806435 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 13:09:10.806449 | node1 | Tuesday 18 August 2026 13:09:10 +0000 (0:00:00.044) 0:11:54.132 ******** 2026-08-18 13:09:11.153738 | node1 | ok: [node2] 2026-08-18 13:09:11.153812 | node1 | ok: [node3] 2026-08-18 13:09:11.154180 | node1 | 2026-08-18 13:09:11.154228 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 13:09:11.154234 | node1 | Tuesday 18 August 2026 13:09:11 +0000 (0:00:00.347) 0:11:54.480 ******** 2026-08-18 13:09:11.614692 | node1 | ok: [node2] 2026-08-18 13:09:11.614777 | node1 | ok: [node3] 2026-08-18 13:09:11.614793 | node1 | 2026-08-18 13:09:11.615009 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 13:09:11.615052 | node1 | Tuesday 18 August 2026 13:09:11 +0000 (0:00:00.460) 0:11:54.941 ******** 2026-08-18 13:09:12.207593 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=node1) 2026-08-18 13:09:12.207674 | node1 | ok: [node2] => (item=node2) 2026-08-18 13:09:12.207687 | node1 | ok: [node2 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 13:09:12.207986 | node1 | 2026-08-18 13:09:12.208033 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 13:09:12.208039 | node1 | Tuesday 18 August 2026 13:09:12 +0000 (0:00:00.592) 0:11:55.533 ******** 2026-08-18 13:09:12.276965 | node1 | ok: [node2] 2026-08-18 13:09:12.277053 | node1 | ok: [node3] 2026-08-18 13:09:12.277385 | node1 | 2026-08-18 13:09:12.277461 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 13:09:12.277468 | node1 | Tuesday 18 August 2026 13:09:12 +0000 (0:00:00.069) 0:11:55.603 ******** 2026-08-18 13:09:12.336969 | node1 | ok: [node2] 2026-08-18 13:09:12.337041 | node1 | ok: [node3] 2026-08-18 13:09:12.337348 | node1 | 2026-08-18 13:09:12.337380 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 13:09:12.337386 | node1 | Tuesday 18 August 2026 13:09:12 +0000 (0:00:00.060) 0:11:55.663 ******** 2026-08-18 13:09:12.370082 | node1 | skipping: [node2] 2026-08-18 13:09:12.370178 | node1 | 2026-08-18 13:09:12.370397 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 13:09:12.370475 | node1 | Tuesday 18 August 2026 13:09:12 +0000 (0:00:00.033) 0:11:55.696 ******** 2026-08-18 13:09:15.119092 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=ceph-exporter) 2026-08-18 13:09:15.119173 | node1 | 2026-08-18 13:09:15.119251 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 13:09:15.119350 | node1 | node1 : ok=204 changed=47 unreachable=0 failed=1 skipped=37 rescued=0 ignored=0 2026-08-18 13:09:15.119453 | node1 | node2 : ok=210 changed=29 unreachable=0 failed=0 skipped=53 rescued=0 ignored=0 2026-08-18 13:09:15.119556 | node1 | node3 : ok=206 changed=28 unreachable=0 failed=0 skipped=45 rescued=0 ignored=0 2026-08-18 13:09:15.119635 | node1 | 2026-08-18 13:09:15.119720 | node1 | 2026-08-18 13:09:15.119816 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 13:09:15.119911 | node1 | Tuesday 18 August 2026 13:09:15 +0000 (0:00:02.749) 0:11:58.445 ******** 2026-08-18 13:09:15.119998 | node1 | =============================================================================== 2026-08-18 13:09:15.120089 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 346.04s 2026-08-18 13:09:15.120182 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 39.06s 2026-08-18 13:09:15.120273 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 37.44s 2026-08-18 13:09:15.120364 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 30.77s 2026-08-18 13:09:15.120456 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 19.40s 2026-08-18 13:09:15.120549 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 16.36s 2026-08-18 13:09:15.120647 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 14.50s 2026-08-18 13:09:15.120742 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 9.47s 2026-08-18 13:09:15.120834 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 9.16s 2026-08-18 13:09:15.120926 | node1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 8.92s 2026-08-18 13:09:15.121022 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 8.62s 2026-08-18 13:09:15.121114 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 7.62s 2026-08-18 13:09:15.121250 | node1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.61s 2026-08-18 13:09:15.121345 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 6.61s 2026-08-18 13:09:15.121442 | node1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.36s 2026-08-18 13:09:15.121537 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.45s 2026-08-18 13:09:15.121629 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.31s 2026-08-18 13:09:15.121721 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.03s 2026-08-18 13:09:15.121812 | node1 | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.41s 2026-08-18 13:09:15.121904 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s 2026-08-18 13:09:15.242348 | node1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 13:09:15.242407 | node1 | ERROR [default > converge] Executed: Failed 2026-08-18 13:09:15.242413 | node1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 13:09:15.408814 | node1 | ERROR 2026-08-18 13:09:15.409081 | node1 | { 2026-08-18 13:09:15.409136 | node1 | "delta": "0:13:24.240037", 2026-08-18 13:09:15.409166 | node1 | "end": "2026-08-18 13:09:15.291647", 2026-08-18 13:09:15.409193 | node1 | "msg": "non-zero return code", 2026-08-18 13:09:15.409239 | node1 | "rc": 2, 2026-08-18 13:09:15.409268 | node1 | "start": "2026-08-18 12:55:51.051610" 2026-08-18 13:09:15.409293 | node1 | } failure 2026-08-18 13:09:15.430160 | 2026-08-18 13:09:15.430214 | PLAY RECAP 2026-08-18 13:09:15.430256 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-08-18 13:09:15.430278 | 2026-08-18 13:09:15.569176 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 13:09:15.580546 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 13:09:16.194592 | 2026-08-18 13:09:16.194711 | PLAY [all] 2026-08-18 13:09:16.206311 | 2026-08-18 13:09:16.206388 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 13:09:16.252879 | node1 | ok 2026-08-18 13:09:16.258636 | node2 | ok 2026-08-18 13:09:16.275995 | node3 | ok 2026-08-18 13:09:16.281582 | 2026-08-18 13:09:16.281671 | TASK [fetch-output : Set log path for single node] 2026-08-18 13:09:16.311198 | node1 | skipping: Conditional result was False 2026-08-18 13:09:16.311962 | node2 | skipping: Conditional result was False 2026-08-18 13:09:16.322403 | node3 | skipping: Conditional result was False 2026-08-18 13:09:16.330109 | 2026-08-18 13:09:16.330200 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 13:09:16.676490 | node2 -> localhost | changed: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/logs/node2" 2026-08-18 13:09:16.700434 | node3 -> localhost | changed: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/logs/node3" 2026-08-18 13:09:16.722954 | node1 -> localhost | changed: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/logs/node1" 2026-08-18 13:09:16.875058 | node2 -> localhost | changed: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/artifacts" 2026-08-18 13:09:16.966587 | node1 -> localhost | ok: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/artifacts" 2026-08-18 13:09:16.982596 | node3 -> localhost | ok: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/artifacts" 2026-08-18 13:09:17.070038 | node2 -> localhost | changed: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/docs" 2026-08-18 13:09:17.182396 | node1 -> localhost | ok: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/docs" 2026-08-18 13:09:17.182611 | node1 -> localhost | changed: All items complete 2026-08-18 13:09:17.182670 | 2026-08-18 13:09:17.191273 | node3 -> localhost | ok: "/var/lib/zuul/builds/7d8c11bc745d44bf96d6d2e231924c91/work/docs" 2026-08-18 13:09:17.234850 | 2026-08-18 13:09:17.234982 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 13:09:17.802533 | node1 | changed: .d..t...... ./ 2026-08-18 13:09:17.802860 | node1 | changed: All items complete 2026-08-18 13:09:17.802922 | 2026-08-18 13:09:17.813127 | node2 | changed: .d..t...... ./ 2026-08-18 13:09:17.818284 | node3 | changed: .d..t...... ./ 2026-08-18 13:09:18.222998 | node1 | changed: .d..t...... ./ 2026-08-18 13:09:18.262106 | node2 | ok 2026-08-18 13:09:18.269773 | node3 | ok 2026-08-18 13:09:18.674821 | node1 | changed: .d..t...... ./ 2026-08-18 13:09:18.703974 | node2 | ok 2026-08-18 13:09:18.713265 | node3 | ok 2026-08-18 13:09:18.713336 | node3 | changed: All items complete 2026-08-18 13:09:18.713370 | 2026-08-18 13:09:18.747127 | 2026-08-18 13:09:18.747340 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 13:09:19.136464 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007613 2026-08-18 13:09:19.353402 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.007070 2026-08-18 13:09:19.381792 | 2026-08-18 13:09:19.381902 | PLAY [all] 2026-08-18 13:09:19.388252 | 2026-08-18 13:09:19.388314 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 13:09:19.809689 | node1 | changed 2026-08-18 13:09:19.989425 | node3 | changed 2026-08-18 13:09:20.016616 | node2 | changed 2026-08-18 13:09:20.037366 | 2026-08-18 13:09:20.037466 | PLAY RECAP 2026-08-18 13:09:20.037529 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 13:09:20.037571 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 13:09:20.037607 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 13:09:20.037634 | 2026-08-18 13:09:20.168034 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 13:09:20.183447 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 13:09:20.781263 | 2026-08-18 13:09:20.781381 | PLAY [localhost] 2026-08-18 13:09:20.791194 | 2026-08-18 13:09:20.791271 | TASK [Generate Zuul manifest] 2026-08-18 13:09:20.812248 | localhost | ok 2026-08-18 13:09:20.826838 | 2026-08-18 13:09:20.826912 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 13:09:21.158159 | localhost | changed 2026-08-18 13:09:21.171757 | 2026-08-18 13:09:21.171841 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 13:09:21.385641 | localhost | ok 2026-08-18 13:09:21.393600 | 2026-08-18 13:09:21.393664 | TASK [Upload logs] 2026-08-18 13:09:21.413768 | localhost | ok 2026-08-18 13:09:21.518920 | 2026-08-18 13:09:21.519048 | TASK [Set zuul-log-path fact] 2026-08-18 13:09:21.536857 | localhost | ok 2026-08-18 13:09:21.549800 | 2026-08-18 13:09:21.549861 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 13:09:21.577679 | localhost | ok 2026-08-18 13:09:21.585967 | 2026-08-18 13:09:21.586027 | TASK [upload-logs : Create log directories] 2026-08-18 13:09:21.920135 | localhost | changed 2026-08-18 13:09:21.924609 | 2026-08-18 13:09:21.924677 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 13:09:22.267691 | localhost -> localhost | ok: Runtime: 0:00:00.005694 2026-08-18 13:09:22.274136 | 2026-08-18 13:09:22.274220 | TASK [upload-logs : Upload logs to log server] 2026-08-18 13:09:22.716840 | localhost | Output suppressed because no_log was given 2026-08-18 13:09:22.723280 | 2026-08-18 13:09:22.723365 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 13:09:22.764608 | localhost | skipping: Conditional result was False 2026-08-18 13:09:22.771878 | localhost | skipping: Conditional result was False 2026-08-18 13:09:22.786157 | 2026-08-18 13:09:22.786283 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 13:09:22.826821 | localhost | skipping: Conditional result was False 2026-08-18 13:09:22.827036 | 2026-08-18 13:09:22.831277 | localhost | skipping: Conditional result was False 2026-08-18 13:09:22.846465 | 2026-08-18 13:09:22.846587 | LOOP [upload-logs : Upload console log and json output]