2026-08-18 13:25:11.507585 | Job console starting
2026-08-18 13:25:11.528222 | Updating git repos
2026-08-18 13:25:11.552235 | Cloning repos into workspace
2026-08-18 13:25:11.620105 | Restoring repo states
2026-08-18 13:25:11.628808 | Merging changes
2026-08-18 13:25:12.024662 | Checking out repos
2026-08-18 13:25:12.066646 | Preparing playbooks
2026-08-18 13:25:12.983775 | Running Ansible setup
2026-08-18 13:25:18.225501 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 13:25:18.871083 | 
2026-08-18 13:25:18.871202 | PLAY [localhost]
2026-08-18 13:25:18.878361 | 
2026-08-18 13:25:18.878427 | TASK [Gathering Facts]
2026-08-18 13:25:19.739199 | localhost | ok
2026-08-18 13:25:19.749600 | 
2026-08-18 13:25:19.749705 | TASK [Setup log path fact]
2026-08-18 13:25:19.771915 | localhost | ok
2026-08-18 13:25:19.782439 | 
2026-08-18 13:25:19.782506 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 13:25:19.812154 | localhost | ok
2026-08-18 13:25:19.819894 | 
2026-08-18 13:25:19.819990 | TASK [emit-job-header : Print job information]
2026-08-18 13:25:19.861087 | # Job Information
2026-08-18 13:25:19.861300 | Ansible Version: 2.16.18
2026-08-18 13:25:19.861372 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-08-18 13:25:19.861422 | Pipeline: check
2026-08-18 13:25:19.861467 | Executor: 2d72f0692154
2026-08-18 13:25:19.861511 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123
2026-08-18 13:25:19.861562 | Event ID: b9670990-9b07-11f1-9c6d-2490f072e427
2026-08-18 13:25:19.865393 | 
2026-08-18 13:25:19.865481 | LOOP [emit-job-header : Print node information]
2026-08-18 13:25:20.021243 | localhost | ok:
2026-08-18 13:25:20.021532 | localhost | # Node Information
2026-08-18 13:25:20.021583 | localhost | Inventory Hostname: node1
2026-08-18 13:25:20.021621 | localhost | Hostname: np0000189990
2026-08-18 13:25:20.021656 | localhost | Username: zuul
2026-08-18 13:25:20.021702 | localhost | Distro: Ubuntu 22.04
2026-08-18 13:25:20.021738 | localhost | Provider: yul1
2026-08-18 13:25:20.021772 | localhost | Region: ca-ymq-1
2026-08-18 13:25:20.021806 | localhost | Label: ubuntu-jammy
2026-08-18 13:25:20.021840 | localhost | Product Name: OpenStack Nova
2026-08-18 13:25:20.021873 | localhost | Interface IP: 199.204.45.129
2026-08-18 13:25:20.068355 | localhost | ok:
2026-08-18 13:25:20.068529 | localhost | # Node Information
2026-08-18 13:25:20.068589 | localhost | Inventory Hostname: node2
2026-08-18 13:25:20.068646 | localhost | Hostname: np0000189991
2026-08-18 13:25:20.068757 | localhost | Username: zuul
2026-08-18 13:25:20.068815 | localhost | Distro: Ubuntu 22.04
2026-08-18 13:25:20.068890 | localhost | Provider: yul1
2026-08-18 13:25:20.068942 | localhost | Region: ca-ymq-1
2026-08-18 13:25:20.069033 | localhost | Label: ubuntu-jammy
2026-08-18 13:25:20.069079 | localhost | Product Name: OpenStack Nova
2026-08-18 13:25:20.069122 | localhost | Interface IP: 199.204.45.248
2026-08-18 13:25:20.115745 | localhost | ok:
2026-08-18 13:25:20.115893 | localhost | # Node Information
2026-08-18 13:25:20.116017 | localhost | Inventory Hostname: node3
2026-08-18 13:25:20.116103 | localhost | Hostname: np0000189992
2026-08-18 13:25:20.116183 | localhost | Username: zuul
2026-08-18 13:25:20.116265 | localhost | Distro: Ubuntu 22.04
2026-08-18 13:25:20.116342 | localhost | Provider: yul1
2026-08-18 13:25:20.116413 | localhost | Region: ca-ymq-1
2026-08-18 13:25:20.116482 | localhost | Label: ubuntu-jammy
2026-08-18 13:25:20.116551 | localhost | Product Name: OpenStack Nova
2026-08-18 13:25:20.116619 | localhost | Interface IP: 199.204.45.140
2026-08-18 13:25:20.124583 | 
2026-08-18 13:25:20.124659 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-18 13:25:20.545126 | localhost -> localhost | changed
2026-08-18 13:25:20.554563 | 
2026-08-18 13:25:20.554663 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-18 13:25:21.479428 | localhost -> localhost | changed
2026-08-18 13:25:21.489283 | 
2026-08-18 13:25:21.489369 | PLAY [all]
2026-08-18 13:25:21.500098 | 
2026-08-18 13:25:21.500184 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-18 13:25:21.716205 | node1 -> localhost | ok
2026-08-18 13:25:21.727044 | 
2026-08-18 13:25:21.727109 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-18 13:25:21.756121 | node1 | ok
2026-08-18 13:25:21.760375 | node2 | ok
2026-08-18 13:25:21.780441 | node3 | ok
2026-08-18 13:25:21.840088 | node1 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 13:25:21.840202 | node2 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 13:25:21.840227 | node3 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 13:25:21.846230 | 
2026-08-18 13:25:21.846293 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-18 13:25:22.536280 | node1 -> localhost | Generating public/private rsa key pair.
2026-08-18 13:25:22.536715 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/4ee3ca621cde427fb8603b1cdaca1fd9_id_rsa
2026-08-18 13:25:22.536749 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/4ee3ca621cde427fb8603b1cdaca1fd9_id_rsa.pub
2026-08-18 13:25:22.536773 | node1 -> localhost | The key fingerprint is:
2026-08-18 13:25:22.536795 | node1 -> localhost | SHA256:bAmycQcfIm2Au1kcaT12qz/XeoyAikaNG3q55SJ9v4U zuul-build-sshkey
2026-08-18 13:25:22.536816 | node1 -> localhost | The key's randomart image is:
2026-08-18 13:25:22.536837 | node1 -> localhost | +---[RSA 3072]----+
2026-08-18 13:25:22.536856 | node1 -> localhost | |   .o=o .        |
2026-08-18 13:25:22.536877 | node1 -> localhost | |  . +.*+..       |
2026-08-18 13:25:22.536897 | node1 -> localhost | |   +o+ooo.       |
2026-08-18 13:25:22.536927 | node1 -> localhost | |  . o= +..       |
2026-08-18 13:25:22.536947 | node1 -> localhost | |   *.  oS        |
2026-08-18 13:25:22.536994 | node1 -> localhost | |  * . oo.        |
2026-08-18 13:25:22.537015 | node1 -> localhost | | + =..E... +     |
2026-08-18 13:25:22.537035 | node1 -> localhost | |o Ooo  .o o +    |
2026-08-18 13:25:22.537054 | node1 -> localhost | | +.+..o. o.o     |
2026-08-18 13:25:22.537074 | node1 -> localhost | +----[SHA256]-----+
2026-08-18 13:25:22.537119 | node1 -> localhost | ok: Runtime: 0:00:00.306018
2026-08-18 13:25:22.543654 | 
2026-08-18 13:25:22.543727 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-18 13:25:22.576404 | node1 | ok
2026-08-18 13:25:22.580805 | node2 | ok
2026-08-18 13:25:22.586013 | node3 | ok
2026-08-18 13:25:22.608828 | node1 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 13:25:22.608896 | node2 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 13:25:22.608919 | node3 | included: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 13:25:22.621963 | 
2026-08-18 13:25:22.622055 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-18 13:25:22.667113 | node1 | skipping: Conditional result was False
2026-08-18 13:25:22.668027 | node2 | skipping: Conditional result was False
2026-08-18 13:25:22.668413 | node3 | skipping: Conditional result was False
2026-08-18 13:25:22.679497 | 
2026-08-18 13:25:22.679633 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-18 13:25:23.138469 | node1 | changed
2026-08-18 13:25:23.144055 | node2 | changed
2026-08-18 13:25:23.148319 | node3 | changed
2026-08-18 13:25:23.153904 | 
2026-08-18 13:25:23.153966 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-18 13:25:23.350556 | node1 | ok
2026-08-18 13:25:23.359257 | node2 | ok
2026-08-18 13:25:23.365535 | node3 | ok
2026-08-18 13:25:23.373945 | 
2026-08-18 13:25:23.374035 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-18 13:25:23.823374 | node1 | changed
2026-08-18 13:25:23.840026 | node2 | changed
2026-08-18 13:25:23.868205 | node3 | changed
2026-08-18 13:25:23.884117 | 
2026-08-18 13:25:23.884294 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-18 13:25:24.336004 | node1 | changed
2026-08-18 13:25:24.365193 | node2 | changed
2026-08-18 13:25:24.370936 | node3 | changed
2026-08-18 13:25:24.378006 | 
2026-08-18 13:25:24.378070 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-18 13:25:24.406057 | node1 | skipping: Conditional result was False
2026-08-18 13:25:24.410898 | node2 | skipping: Conditional result was False
2026-08-18 13:25:24.421618 | node3 | skipping: Conditional result was False
2026-08-18 13:25:24.429214 | 
2026-08-18 13:25:24.429305 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-18 13:25:24.821151 | node1 -> localhost | changed
2026-08-18 13:25:24.863595 | 
2026-08-18 13:25:24.863741 | TASK [add-build-sshkey : Add back temp key]
2026-08-18 13:25:25.146295 | node1 -> localhost | Identity added: /var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/4ee3ca621cde427fb8603b1cdaca1fd9_id_rsa (zuul-build-sshkey)
2026-08-18 13:25:25.146483 | node1 -> localhost | ok: Runtime: 0:00:00.014857
2026-08-18 13:25:25.151535 | 
2026-08-18 13:25:25.151598 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-18 13:25:25.457012 | node1 | ok
2026-08-18 13:25:25.461112 | node3 | ok
2026-08-18 13:25:25.465314 | node2 | ok
2026-08-18 13:25:25.469725 | 
2026-08-18 13:25:25.469796 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-18 13:25:25.497238 | node1 | skipping: Conditional result was False
2026-08-18 13:25:25.508395 | node2 | skipping: Conditional result was False
2026-08-18 13:25:25.539002 | node3 | skipping: Conditional result was False
2026-08-18 13:25:25.561741 | 
2026-08-18 13:25:25.561808 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-18 13:25:25.958433 | node1 | ok
2026-08-18 13:25:25.962722 | node3 | ok
2026-08-18 13:25:25.966441 | node2 | ok
2026-08-18 13:25:25.972182 | 
2026-08-18 13:25:25.972247 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-18 13:25:26.622598 | node1 | Output suppressed because no_log was given
2026-08-18 13:25:26.659633 | node2 | Output suppressed because no_log was given
2026-08-18 13:25:26.664662 | node3 | Output suppressed because no_log was given
2026-08-18 13:25:26.682394 | 
2026-08-18 13:25:26.682464 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-18 13:25:26.861360 | node1 | ok: "logs"
2026-08-18 13:25:26.861637 | node1 | ok: All items complete
2026-08-18 13:25:26.861678 | 
2026-08-18 13:25:26.877463 | node2 | ok: "logs"
2026-08-18 13:25:26.883491 | node3 | ok: "logs"
2026-08-18 13:25:27.014061 | node1 | ok: "artifacts"
2026-08-18 13:25:27.030636 | node3 | ok: "artifacts"
2026-08-18 13:25:27.052688 | node2 | ok: "artifacts"
2026-08-18 13:25:27.170474 | node1 | ok: "docs"
2026-08-18 13:25:27.187470 | node3 | ok: "docs"
2026-08-18 13:25:27.214664 | node2 | ok: "docs"
2026-08-18 13:25:27.214833 | node2 | ok: All items complete
2026-08-18 13:25:27.214892 | 
2026-08-18 13:25:27.234929 | 
2026-08-18 13:25:27.234995 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-18 13:25:27.430701 | node2 | changed: "logs"
2026-08-18 13:25:27.443429 | node1 | changed: "logs"
2026-08-18 13:25:27.449846 | node3 | changed: "logs"
2026-08-18 13:25:27.580431 | node3 | changed: "artifacts"
2026-08-18 13:25:27.586616 | node2 | changed: "artifacts"
2026-08-18 13:25:27.614180 | node1 | changed: "artifacts"
2026-08-18 13:25:27.731877 | node2 | changed: "docs"
2026-08-18 13:25:27.737780 | node3 | changed: "docs"
2026-08-18 13:25:27.769619 | node1 | changed: "docs"
2026-08-18 13:25:27.769692 | node1 | changed: All items complete
2026-08-18 13:25:27.769727 | 
2026-08-18 13:25:27.792325 | 
2026-08-18 13:25:27.792373 | PLAY RECAP
2026-08-18 13:25:27.792416 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:25:27.792445 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 13:25:27.792470 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 13:25:27.792493 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 13:25:27.792511 | 
2026-08-18 13:25:27.922791 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 13:25:27.932097 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 13:25:28.554303 | 
2026-08-18 13:25:28.554426 | PLAY [all]
2026-08-18 13:25:28.566537 | 
2026-08-18 13:25:28.566622 | TASK [setup-uv : Extract archive]
2026-08-18 13:25:30.779381 | node3 | changed
2026-08-18 13:25:30.872200 | node2 | changed
2026-08-18 13:25:30.892657 | node1 | changed
2026-08-18 13:25:30.901257 | 
2026-08-18 13:25:30.901452 | TASK [setup-uv : Print version]
2026-08-18 13:25:31.297488 | node3 | uv 0.8.13
2026-08-18 13:25:31.292582 | node2 | uv 0.8.13
2026-08-18 13:25:31.289253 | node1 | uv 0.8.13
2026-08-18 13:25:31.479522 | node2 | ok: Runtime: 0:00:00.014111
2026-08-18 13:25:31.490297 | node1 | ok: Runtime: 0:00:00.013102
2026-08-18 13:25:31.498593 | node3 | ok: Runtime: 0:00:00.012719
2026-08-18 13:25:31.514750 | 
2026-08-18 13:25:31.514818 | TASK [Install Ansible collection siblings]
2026-08-18 13:25:31.842155 | node1 | ok:
2026-08-18 13:25:31.842330 | node1 | Skipping community.crypto: no checked-out sibling
2026-08-18 13:25:31.842373 | node1 | Skipping community.docker: no checked-out sibling
2026-08-18 13:25:31.842405 | node1 | Skipping community.general: no checked-out sibling
2026-08-18 13:25:31.842433 | node1 | Skipping ansible.utils: no checked-out sibling
2026-08-18 13:25:31.842461 | node1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-18 13:25:31.844812 | 
2026-08-18 13:25:31.844873 | PLAY RECAP
2026-08-18 13:25:31.844945 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:25:31.845000 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:25:31.845036 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:25:31.845063 | 
2026-08-18 13:25:31.968995 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 13:25:31.987308 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 13:25:32.636115 | 
2026-08-18 13:25:32.636250 | PLAY [all]
2026-08-18 13:25:32.648527 | 
2026-08-18 13:25:32.648604 | LOOP [Check inventory directories]
2026-08-18 13:25:32.986564 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 13:25:33.126190 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-18 13:25:33.274223 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-18 13:25:33.292268 | 
2026-08-18 13:25:33.292367 | LOOP [Copy inventory file for Zuul]
2026-08-18 13:25:34.039599 | node1 | changed:
2026-08-18 13:25:34.039910 | node1 | {
2026-08-18 13:25:34.039986 | node1 |   "ansible_loop_var": "item",
2026-08-18 13:25:34.040045 | node1 |   "changed": false,
2026-08-18 13:25:34.040095 | node1 |   "failed": false,
2026-08-18 13:25:34.040155 | node1 |   "invocation": {
2026-08-18 13:25:34.040196 | node1 |     "module_args": {
2026-08-18 13:25:34.040243 | node1 |       "checksum_algorithm": "sha1",
2026-08-18 13:25:34.040285 | node1 |       "follow": true,
2026-08-18 13:25:34.040331 | node1 |       "get_attributes": true,
2026-08-18 13:25:34.040381 | node1 |       "get_checksum": true,
2026-08-18 13:25:34.040429 | node1 |       "get_mime": true,
2026-08-18 13:25:34.040498 | node1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 13:25:34.040574 | node1 |     }
2026-08-18 13:25:34.040648 | node1 |   },
2026-08-18 13:25:34.040715 | node1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 13:25:34.040768 | node1 |   "stat": {
2026-08-18 13:25:34.040818 | node1 |     "atime": 1787059526.5218537,
2026-08-18 13:25:34.040881 | node1 |     "attr_flags": "e",
2026-08-18 13:25:34.040942 | node1 |     "attributes": [
2026-08-18 13:25:34.041016 | node1 |       "extents"
2026-08-18 13:25:34.041060 | node1 |     ],
2026-08-18 13:25:34.041105 | node1 |     "block_size": 4096,
2026-08-18 13:25:34.041153 | node1 |     "blocks": 8,
2026-08-18 13:25:34.041202 | node1 |     "charset": "unknown",
2026-08-18 13:25:34.041269 | node1 |     "ctime": 1787059526.5298557,
2026-08-18 13:25:34.041313 | node1 |     "dev": 64513,
2026-08-18 13:25:34.041354 | node1 |     "device_type": 0,
2026-08-18 13:25:34.041423 | node1 |     "executable": true,
2026-08-18 13:25:34.041496 | node1 |     "exists": true,
2026-08-18 13:25:34.041565 | node1 |     "gid": 1000,
2026-08-18 13:25:34.041618 | node1 |     "gr_name": "zuul",
2026-08-18 13:25:34.041668 | node1 |     "inode": 1042461,
2026-08-18 13:25:34.041715 | node1 |     "isblk": false,
2026-08-18 13:25:34.041763 | node1 |     "ischr": false,
2026-08-18 13:25:34.041807 | node1 |     "isdir": true,
2026-08-18 13:25:34.041836 | node1 |     "isfifo": false,
2026-08-18 13:25:34.041866 | node1 |     "isgid": false,
2026-08-18 13:25:34.041903 | node1 |     "islnk": false,
2026-08-18 13:25:34.041947 | node1 |     "isreg": false,
2026-08-18 13:25:34.041994 | node1 |     "issock": false,
2026-08-18 13:25:34.042042 | node1 |     "isuid": false,
2026-08-18 13:25:34.042106 | node1 |     "mimetype": "unknown",
2026-08-18 13:25:34.042182 | node1 |     "mode": "0755",
2026-08-18 13:25:34.042257 | node1 |     "mtime": 1787059511.974534,
2026-08-18 13:25:34.042322 | node1 |     "nlink": 10,
2026-08-18 13:25:34.042373 | node1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 13:25:34.042423 | node1 |     "pw_name": "zuul",
2026-08-18 13:25:34.042471 | node1 |     "readable": true,
2026-08-18 13:25:34.042519 | node1 |     "rgrp": true,
2026-08-18 13:25:34.042562 | node1 |     "roth": true,
2026-08-18 13:25:34.042596 | node1 |     "rusr": true,
2026-08-18 13:25:34.042627 | node1 |     "size": 4096,
2026-08-18 13:25:34.042654 | node1 |     "uid": 1000,
2026-08-18 13:25:34.042679 | node1 |     "version": "412174733",
2026-08-18 13:25:34.042703 | node1 |     "wgrp": false,
2026-08-18 13:25:34.042730 | node1 |     "woth": false,
2026-08-18 13:25:34.042754 | node1 |     "writeable": true,
2026-08-18 13:25:34.042778 | node1 |     "wusr": true,
2026-08-18 13:25:34.042801 | node1 |     "xgrp": true,
2026-08-18 13:25:34.042825 | node1 |     "xoth": true,
2026-08-18 13:25:34.042848 | node1 |     "xusr": true
2026-08-18 13:25:34.042871 | node1 |   }
2026-08-18 13:25:34.042896 | node1 | }
2026-08-18 13:25:34.042949 | node1 | ok: All items complete
2026-08-18 13:25:34.042980 | 
2026-08-18 13:25:34.044648 | node1 | skipping: Conditional result was False
2026-08-18 13:25:34.045836 | node1 | skipping: Conditional result was False
2026-08-18 13:25:34.059006 | 
2026-08-18 13:25:34.059168 | LOOP [Switch "ansible_host" to private IP]
2026-08-18 13:25:34.417905 | node1 | changed: 3 replacements made
2026-08-18 13:25:34.419584 | node1 | skipping: Conditional result was False
2026-08-18 13:25:34.420398 | node1 | skipping: Conditional result was False
2026-08-18 13:25:34.434325 | 
2026-08-18 13:25:34.434472 | TASK [Run Molecule scenario]
2026-08-18 13:25:34.992645 | node1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-08-18 13:25:35.859275 | node1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-08-18 13:25:36.032803 | node1 | Using CPython 3.13.7
2026-08-18 13:25:36.032862 | node1 | Creating virtual environment at: .venv
2026-08-18 13:25:36.072045 | node1 | Downloading pygments (1.2MiB)
2026-08-18 13:25:36.076072 | node1 | Downloading ansible-core (2.1MiB)
2026-08-18 13:25:36.076398 | node1 | Downloading cryptography (4.3MiB)
2026-08-18 13:25:36.076733 | node1 | Downloading netaddr (2.2MiB)
2026-08-18 13:25:36.279007 | node1 |  Downloading cryptography
2026-08-18 13:25:36.279677 | node1 |  Downloading netaddr
2026-08-18 13:25:36.321016 | node1 |  Downloading pygments
2026-08-18 13:25:36.436279 | node1 |  Downloading ansible-core
2026-08-18 13:25:36.464957 | node1 | Installed 42 packages in 28ms
2026-08-18 13:25:37.616870 | node1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-18 13:25:37.616984 | node1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-18 13:25:38.224030 | node1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-18 13:25:38.224139 | node1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-18 13:26:23.270598 | node1 | INFO     [default > dependency] Executing
2026-08-18 13:26:23.270754 | node1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-18 13:26:23.270896 | node1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-18 13:26:23.271013 | node1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-18 13:26:23.280609 | node1 | INFO     [default > cleanup] Executing
2026-08-18 13:26:23.281344 | node1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 13:26:23.289047 | node1 | INFO     [default > destroy] Executing
2026-08-18 13:26:23.289085 | node1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-18 13:26:23.289152 | node1 | INFO     [default > destroy] Executed: Successful
2026-08-18 13:26:23.294098 | node1 | INFO     [default > syntax] Executing
2026-08-18 13:26:24.394725 | node1 |
2026-08-18 13:26:24.394890 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 13:26:24.456479 | node1 | INFO     [default > syntax] Executed: Successful
2026-08-18 13:26:24.467856 | node1 | INFO     [default > create] Executing
2026-08-18 13:26:24.469194 | node1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 13:26:24.474258 | node1 | INFO     [default > prepare] Executing
2026-08-18 13:26:25.200300 | node1 |
2026-08-18 13:26:25.200403 | node1 | PLAY [Prepare] *****************************************************************
2026-08-18 13:26:25.200415 | node1 |
2026-08-18 13:26:25.200545 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:26:25.200682 | node1 | Tuesday 18 August 2026  13:26:25 +0000 (0:00:00.030)       0:00:00.030 ********
2026-08-18 13:26:26.367689 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 13:26:26.367984 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:26:26.368207 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:26:26.368397 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:26:26.368577 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:26:26.368830 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 13:26:26.369006 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:26:26.369225 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:26:26.369403 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:26:26.369580 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:26:26.370627 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 13:26:26.370801 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:26:26.370968 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:26:26.371147 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:26:26.371320 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:26:26.375601 | node1 | ok: [node1]
2026-08-18 13:26:26.375739 | node1 | ok: [node2]
2026-08-18 13:26:26.375861 | node1 | ok: [node3]
2026-08-18 13:26:26.375978 | node1 |
2026-08-18 13:26:26.376115 | node1 | TASK [Configure short hostname] ************************************************
2026-08-18 13:26:26.376254 | node1 | Tuesday 18 August 2026  13:26:26 +0000 (0:00:01.176)       0:00:01.206 ********
2026-08-18 13:26:27.165144 | node1 | changed: [node1]
2026-08-18 13:26:27.165368 | node1 | changed: [node2]
2026-08-18 13:26:27.165568 | node1 | changed: [node3]
2026-08-18 13:26:27.165715 | node1 |
2026-08-18 13:26:27.165968 | node1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-18 13:26:27.166134 | node1 | Tuesday 18 August 2026  13:26:27 +0000 (0:00:00.788)       0:00:01.995 ********
2026-08-18 13:26:27.423421 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-18 13:26:27.423681 | node1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-18 13:26:27.423957 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-18 13:26:27.456513 | node1 | changed: [node1]
2026-08-18 13:26:27.456712 | node1 | changed: [node2]
2026-08-18 13:26:27.456926 | node1 | changed: [node3]
2026-08-18 13:26:27.457147 | node1 |
2026-08-18 13:26:27.457375 | node1 | TASK [Update apt cache] ********************************************************
2026-08-18 13:26:27.457589 | node1 | Tuesday 18 August 2026  13:26:27 +0000 (0:00:00.291)       0:00:02.286 ********
2026-08-18 13:27:09.116257 | node1 | changed: [node1]
2026-08-18 13:27:09.116426 | node1 | changed: [node2]
2026-08-18 13:27:09.116711 | node1 | changed: [node3]
2026-08-18 13:27:09.117068 | node1 |
2026-08-18 13:27:09.117375 | node1 | PLAY [Create devices for Ceph] *************************************************
2026-08-18 13:27:09.117601 | node1 |
2026-08-18 13:27:09.117798 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:27:09.117946 | node1 | Tuesday 18 August 2026  13:27:09 +0000 (0:00:41.652)       0:00:43.939 ********
2026-08-18 13:27:09.811564 | node1 | ok: [node1]
2026-08-18 13:27:09.811718 | node1 | ok: [node3]
2026-08-18 13:27:09.811960 | node1 | ok: [node2]
2026-08-18 13:27:09.812161 | node1 |
2026-08-18 13:27:09.812407 | node1 | TASK [Install depedencies] *****************************************************
2026-08-18 13:27:09.812649 | node1 | Tuesday 18 August 2026  13:27:09 +0000 (0:00:00.702)       0:00:44.642 ********
2026-08-18 13:27:31.729501 | node1 | changed: [node2]
2026-08-18 13:27:31.729728 | node1 | changed: [node1]
2026-08-18 13:27:31.729942 | node1 | changed: [node3]
2026-08-18 13:27:31.730146 | node1 |
2026-08-18 13:27:31.730362 | node1 | TASK [Start up service] ********************************************************
2026-08-18 13:27:31.730587 | node1 | Tuesday 18 August 2026  13:27:31 +0000 (0:00:21.916)       0:01:06.558 ********
2026-08-18 13:27:32.301827 | node1 | ok: [node2]
2026-08-18 13:27:32.301901 | node1 | ok: [node1]
2026-08-18 13:27:32.302049 | node1 | ok: [node3]
2026-08-18 13:27:32.302168 | node1 |
2026-08-18 13:27:32.302300 | node1 | TASK [Generate lvm.conf] *******************************************************
2026-08-18 13:27:32.302433 | node1 | Tuesday 18 August 2026  13:27:32 +0000 (0:00:00.573)       0:01:07.132 ********
2026-08-18 13:27:32.616428 | node1 | ok: [node1]
2026-08-18 13:27:32.616615 | node1 | ok: [node2]
2026-08-18 13:27:32.616815 | node1 | ok: [node3]
2026-08-18 13:27:32.617004 | node1 |
2026-08-18 13:27:32.617252 | node1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-18 13:27:32.617449 | node1 | Tuesday 18 August 2026  13:27:32 +0000 (0:00:00.314)       0:01:07.447 ********
2026-08-18 13:27:33.290678 | node1 | changed: [node1]
2026-08-18 13:27:33.290796 | node1 | changed: [node3]
2026-08-18 13:27:33.291004 | node1 | changed: [node2]
2026-08-18 13:27:33.291189 | node1 |
2026-08-18 13:27:33.291396 | node1 | TASK [Get list of all loopback devices] ****************************************
2026-08-18 13:27:33.291606 | node1 | Tuesday 18 August 2026  13:27:33 +0000 (0:00:00.674)       0:01:08.121 ********
2026-08-18 13:27:33.506324 | node1 | ok: [node1]
2026-08-18 13:27:33.506519 | node1 | ok: [node2]
2026-08-18 13:27:33.506731 | node1 | ok: [node3]
2026-08-18 13:27:33.506935 | node1 |
2026-08-18 13:27:33.507157 | node1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-18 13:27:33.507376 | node1 | Tuesday 18 August 2026  13:27:33 +0000 (0:00:00.215)       0:01:08.336 ********
2026-08-18 13:27:33.543162 | node1 | skipping: [node1]
2026-08-18 13:27:33.543350 | node1 | skipping: [node2]
2026-08-18 13:27:33.543553 | node1 | skipping: [node3]
2026-08-18 13:27:33.543730 | node1 |
2026-08-18 13:27:33.543962 | node1 | TASK [Create devices for Ceph] *************************************************
2026-08-18 13:27:33.544169 | node1 | Tuesday 18 August 2026  13:27:33 +0000 (0:00:00.036)       0:01:08.373 ********
2026-08-18 13:27:34.126731 | node1 | changed: [node1] => (item=osd0)
2026-08-18 13:27:34.126951 | node1 | changed: [node2] => (item=osd0)
2026-08-18 13:27:34.127171 | node1 | changed: [node3] => (item=osd0)
2026-08-18 13:27:34.127389 | node1 | changed: [node1] => (item=osd1)
2026-08-18 13:27:34.127599 | node1 | changed: [node2] => (item=osd1)
2026-08-18 13:27:34.127810 | node1 | changed: [node3] => (item=osd1)
2026-08-18 13:27:34.128015 | node1 | changed: [node1] => (item=osd2)
2026-08-18 13:27:34.128225 | node1 | changed: [node2] => (item=osd2)
2026-08-18 13:27:34.128429 | node1 | changed: [node3] => (item=osd2)
2026-08-18 13:27:34.128625 | node1 |
2026-08-18 13:27:34.128846 | node1 | TASK [Set permissions on loopback devices] *************************************
2026-08-18 13:27:34.129048 | node1 | Tuesday 18 August 2026  13:27:34 +0000 (0:00:00.583)       0:01:08.957 ********
2026-08-18 13:27:34.757845 | node1 | changed: [node1] => (item=osd0)
2026-08-18 13:27:34.758065 | node1 | changed: [node3] => (item=osd0)
2026-08-18 13:27:34.758266 | node1 | changed: [node2] => (item=osd0)
2026-08-18 13:27:34.758471 | node1 | changed: [node1] => (item=osd1)
2026-08-18 13:27:34.758669 | node1 | changed: [node3] => (item=osd1)
2026-08-18 13:27:34.758917 | node1 | changed: [node2] => (item=osd1)
2026-08-18 13:27:34.759116 | node1 | changed: [node1] => (item=osd2)
2026-08-18 13:27:34.759320 | node1 | changed: [node2] => (item=osd2)
2026-08-18 13:27:34.759522 | node1 | changed: [node3] => (item=osd2)
2026-08-18 13:27:34.759699 | node1 |
2026-08-18 13:27:34.759928 | node1 | TASK [Start loop devices] ******************************************************
2026-08-18 13:27:34.760133 | node1 | Tuesday 18 August 2026  13:27:34 +0000 (0:00:00.631)       0:01:09.588 ********
2026-08-18 13:27:35.456542 | node1 | changed: [node1] => (item=osd0)
2026-08-18 13:27:35.456779 | node1 | changed: [node2] => (item=osd0)
2026-08-18 13:27:35.457000 | node1 | changed: [node3] => (item=osd0)
2026-08-18 13:27:35.457275 | node1 | changed: [node1] => (item=osd1)
2026-08-18 13:27:35.457494 | node1 | changed: [node3] => (item=osd1)
2026-08-18 13:27:35.457714 | node1 | changed: [node2] => (item=osd1)
2026-08-18 13:27:35.457894 | node1 | changed: [node1] => (item=osd2)
2026-08-18 13:27:35.458088 | node1 | changed: [node3] => (item=osd2)
2026-08-18 13:27:35.458290 | node1 | changed: [node2] => (item=osd2)
2026-08-18 13:27:35.458465 | node1 |
2026-08-18 13:27:35.458680 | node1 | TASK [Create a volume group for each loop device] ******************************
2026-08-18 13:27:35.458875 | node1 | Tuesday 18 August 2026  13:27:35 +0000 (0:00:00.698)       0:01:10.287 ********
2026-08-18 13:27:38.765087 | node1 | changed: [node3] => (item=osd0)
2026-08-18 13:27:38.765284 | node1 | changed: [node1] => (item=osd0)
2026-08-18 13:27:38.765444 | node1 | changed: [node2] => (item=osd0)
2026-08-18 13:27:38.765651 | node1 | changed: [node1] => (item=osd1)
2026-08-18 13:27:38.765823 | node1 | changed: [node3] => (item=osd1)
2026-08-18 13:27:38.766027 | node1 | changed: [node2] => (item=osd1)
2026-08-18 13:27:38.766154 | node1 | changed: [node1] => (item=osd2)
2026-08-18 13:27:38.766269 | node1 | changed: [node3] => (item=osd2)
2026-08-18 13:27:38.766380 | node1 | changed: [node2] => (item=osd2)
2026-08-18 13:27:38.766486 | node1 |
2026-08-18 13:27:38.766606 | node1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-18 13:27:38.766727 | node1 | Tuesday 18 August 2026  13:27:38 +0000 (0:00:03.308)       0:01:13.595 ********
2026-08-18 13:27:40.711079 | node1 | changed: [node2] => (item=ceph-node2-osd0)
2026-08-18 13:27:40.711248 | node1 | changed: [node1] => (item=ceph-node1-osd0)
2026-08-18 13:27:40.711445 | node1 | changed: [node3] => (item=ceph-node3-osd0)
2026-08-18 13:27:40.711640 | node1 | changed: [node1] => (item=ceph-node1-osd1)
2026-08-18 13:27:40.711835 | node1 | changed: [node3] => (item=ceph-node3-osd1)
2026-08-18 13:27:40.712033 | node1 | changed: [node2] => (item=ceph-node2-osd1)
2026-08-18 13:27:40.712292 | node1 | changed: [node2] => (item=ceph-node2-osd2)
2026-08-18 13:27:40.712513 | node1 | changed: [node3] => (item=ceph-node3-osd2)
2026-08-18 13:27:40.712708 | node1 | changed: [node1] => (item=ceph-node1-osd2)
2026-08-18 13:27:40.712889 | node1 |
2026-08-18 13:27:40.713084 | node1 | PLAY RECAP *********************************************************************
2026-08-18 13:27:40.713373 | node1 | node1                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 13:27:40.713582 | node1 | node2                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 13:27:40.713809 | node1 | node3                      : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 13:27:40.713985 | node1 |
2026-08-18 13:27:40.714168 | node1 |
2026-08-18 13:27:40.714367 | node1 | TASKS RECAP ********************************************************************
2026-08-18 13:27:40.714573 | node1 | Tuesday 18 August 2026  13:27:40 +0000 (0:00:01.946)       0:01:15.541 ********
2026-08-18 13:27:40.714755 | node1 | ===============================================================================
2026-08-18 13:27:40.714951 | node1 | Update apt cache ------------------------------------------------------- 41.65s
2026-08-18 13:27:40.715147 | node1 | Install depedencies ---------------------------------------------------- 21.92s
2026-08-18 13:27:40.715347 | node1 | Create a volume group for each loop device ------------------------------ 3.31s
2026-08-18 13:27:40.715546 | node1 | Create a logical volume for each loop device ---------------------------- 1.95s
2026-08-18 13:27:40.715743 | node1 | Gathering Facts --------------------------------------------------------- 1.18s
2026-08-18 13:27:40.715940 | node1 | Configure short hostname ------------------------------------------------ 0.79s
2026-08-18 13:27:40.716177 | node1 | Gathering Facts --------------------------------------------------------- 0.70s
2026-08-18 13:27:40.716411 | node1 | Start loop devices ------------------------------------------------------ 0.70s
2026-08-18 13:27:40.716618 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.67s
2026-08-18 13:27:40.716814 | node1 | Set permissions on loopback devices ------------------------------------- 0.63s
2026-08-18 13:27:40.717012 | node1 | Create devices for Ceph ------------------------------------------------- 0.58s
2026-08-18 13:27:40.717231 | node1 | Start up service -------------------------------------------------------- 0.57s
2026-08-18 13:27:40.717436 | node1 | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-08-18 13:27:40.717637 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-18 13:27:40.717829 | node1 | Get list of all loopback devices ---------------------------------------- 0.22s
2026-08-18 13:27:40.718032 | node1 | Fail if there is any existing loopback devices -------------------------- 0.04s
2026-08-18 13:27:40.856303 | node1 | INFO     [default > prepare] Executed: Successful
2026-08-18 13:27:40.866352 | node1 | INFO     [default > converge] Executing
2026-08-18 13:27:41.953987 | node1 |
2026-08-18 13:27:41.954155 | node1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-18 13:27:41.954379 | node1 |
2026-08-18 13:27:41.954583 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:27:41.954752 | node1 | Tuesday 18 August 2026  13:27:41 +0000 (0:00:00.084)       0:00:00.084 ********
2026-08-18 13:27:43.058619 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 13:27:43.058800 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:27:43.059006 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:27:43.059228 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:27:43.059425 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:27:43.073800 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 13:27:43.074263 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:27:43.074277 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:27:43.074370 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:27:43.074589 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:27:43.088565 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 13:27:43.088786 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:27:43.088989 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:27:43.089193 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:27:43.089407 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:27:43.144624 | node1 | ok: [node1]
2026-08-18 13:27:43.144810 | node1 | ok: [node2]
2026-08-18 13:27:43.145004 | node1 | ok: [node3]
2026-08-18 13:27:43.145221 | node1 |
2026-08-18 13:27:43.145430 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:27:43.145646 | node1 | Tuesday 18 August 2026  13:27:43 +0000 (0:00:01.190)       0:00:01.275 ********
2026-08-18 13:27:43.467724 | node1 | ok: [node1]
2026-08-18 13:27:43.467944 | node1 | ok: [node2]
2026-08-18 13:27:43.468194 | node1 | ok: [node3]
2026-08-18 13:27:43.468385 | node1 |
2026-08-18 13:27:43.468638 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:27:43.468837 | node1 | Tuesday 18 August 2026  13:27:43 +0000 (0:00:00.322)       0:00:01.598 ********
2026-08-18 13:27:43.558153 | node1 | skipping: [node1]
2026-08-18 13:27:43.558351 | node1 | skipping: [node2]
2026-08-18 13:27:43.558716 | node1 | skipping: [node3]
2026-08-18 13:27:43.559009 | node1 |
2026-08-18 13:27:43.559298 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:27:43.559632 | node1 | Tuesday 18 August 2026  13:27:43 +0000 (0:00:00.090)       0:00:01.688 ********
2026-08-18 13:27:43.901583 | node1 | changed: [node1]
2026-08-18 13:27:43.901712 | node1 | changed: [node2]
2026-08-18 13:27:43.901914 | node1 | changed: [node3]
2026-08-18 13:27:43.902098 | node1 |
2026-08-18 13:27:43.902303 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:27:43.902504 | node1 | Tuesday 18 August 2026  13:27:43 +0000 (0:00:00.343)       0:00:02.032 ********
2026-08-18 13:27:44.003587 | node1 | ok: [node2] => {
2026-08-18 13:27:44.003821 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:27:44.004034 | node1 | }
2026-08-18 13:27:44.004372 | node1 | ok: [node1] => {
2026-08-18 13:27:44.004648 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:27:44.004892 | node1 | }
2026-08-18 13:27:44.005188 | node1 | ok: [node3] => {
2026-08-18 13:27:44.005418 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:27:44.005603 | node1 | }
2026-08-18 13:27:44.005797 | node1 |
2026-08-18 13:27:44.005990 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:27:44.006233 | node1 | Tuesday 18 August 2026  13:27:44 +0000 (0:00:00.102)       0:00:02.134 ********
2026-08-18 13:27:44.769039 | node1 | changed: [node1]
2026-08-18 13:27:44.769247 | node1 | changed: [node2]
2026-08-18 13:27:44.769460 | node1 | changed: [node3]
2026-08-18 13:27:44.769656 | node1 |
2026-08-18 13:27:44.769876 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:27:44.770091 | node1 | Tuesday 18 August 2026  13:27:44 +0000 (0:00:00.765)       0:00:02.899 ********
2026-08-18 13:27:44.793039 | node1 | skipping: [node1]
2026-08-18 13:27:44.851649 | node1 | skipping: [node2]
2026-08-18 13:27:44.851784 | node1 | skipping: [node3]
2026-08-18 13:27:44.851950 | node1 |
2026-08-18 13:27:44.852168 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:27:44.852357 | node1 | Tuesday 18 August 2026  13:27:44 +0000 (0:00:00.082)       0:00:02.982 ********
2026-08-18 13:27:44.938399 | node1 | skipping: [node1]
2026-08-18 13:27:44.938482 | node1 | skipping: [node2]
2026-08-18 13:27:44.938676 | node1 | skipping: [node3]
2026-08-18 13:27:44.938855 | node1 |
2026-08-18 13:27:44.939058 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:27:44.939260 | node1 | Tuesday 18 August 2026  13:27:44 +0000 (0:00:00.086)       0:00:03.069 ********
2026-08-18 13:27:45.193209 | node1 | ok: [node1]
2026-08-18 13:27:45.193287 | node1 | ok: [node2]
2026-08-18 13:27:45.193387 | node1 | ok: [node3]
2026-08-18 13:27:45.193493 | node1 |
2026-08-18 13:27:45.193670 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:27:45.193753 | node1 | Tuesday 18 August 2026  13:27:45 +0000 (0:00:00.254)       0:00:03.324 ********
2026-08-18 13:27:46.561077 | node1 | ok: [node3]
2026-08-18 13:27:46.561338 | node1 | ok: [node2]
2026-08-18 13:27:46.561351 | node1 | ok: [node1]
2026-08-18 13:27:46.561361 | node1 |
2026-08-18 13:27:46.561398 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:27:46.561501 | node1 | Tuesday 18 August 2026  13:27:46 +0000 (0:00:01.368)       0:00:04.692 ********
2026-08-18 13:27:46.670342 | node1 | ok: [node1] => {
2026-08-18 13:27:46.670483 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:27:46.670669 | node1 | }
2026-08-18 13:27:46.670863 | node1 | ok: [node2] => {
2026-08-18 13:27:46.671074 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:27:46.671261 | node1 | }
2026-08-18 13:27:46.671445 | node1 | ok: [node3] => {
2026-08-18 13:27:46.671662 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:27:46.671836 | node1 | }
2026-08-18 13:27:46.672009 | node1 |
2026-08-18 13:27:46.672208 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:27:46.672403 | node1 | Tuesday 18 August 2026  13:27:46 +0000 (0:00:00.109)       0:00:04.801 ********
2026-08-18 13:27:47.495267 | node1 | changed: [node3]
2026-08-18 13:27:47.495362 | node1 | changed: [node2]
2026-08-18 13:27:47.495482 | node1 | changed: [node1]
2026-08-18 13:27:47.495600 | node1 |
2026-08-18 13:27:47.495739 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:27:47.495873 | node1 | Tuesday 18 August 2026  13:27:47 +0000 (0:00:00.824)       0:00:05.626 ********
2026-08-18 13:27:50.387636 | node1 | changed: [node1]
2026-08-18 13:27:50.387700 | node1 | changed: [node2]
2026-08-18 13:27:50.387711 | node1 | changed: [node3]
2026-08-18 13:27:50.387721 | node1 |
2026-08-18 13:27:50.387731 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:27:50.387740 | node1 | Tuesday 18 August 2026  13:27:50 +0000 (0:00:02.891)       0:00:08.517 ********
2026-08-18 13:27:50.420526 | node1 | skipping: [node1]
2026-08-18 13:27:50.450762 | node1 | skipping: [node2]
2026-08-18 13:27:50.451277 | node1 | skipping: [node3]
2026-08-18 13:27:50.451323 | node1 |
2026-08-18 13:27:50.451331 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:27:50.451338 | node1 | Tuesday 18 August 2026  13:27:50 +0000 (0:00:00.064)       0:00:08.581 ********
2026-08-18 13:27:50.481074 | node1 | skipping: [node1]
2026-08-18 13:27:50.510967 | node1 | skipping: [node2]
2026-08-18 13:27:50.511090 | node1 | skipping: [node3]
2026-08-18 13:27:50.511207 | node1 |
2026-08-18 13:27:50.511539 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:27:50.511580 | node1 | Tuesday 18 August 2026  13:27:50 +0000 (0:00:00.060)       0:00:08.642 ********
2026-08-18 13:27:50.544148 | node1 | skipping: [node1]
2026-08-18 13:27:50.574242 | node1 | skipping: [node2]
2026-08-18 13:27:50.577192 | node1 | skipping: [node3]
2026-08-18 13:27:50.577228 | node1 |
2026-08-18 13:27:50.577235 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:27:50.577254 | node1 | Tuesday 18 August 2026  13:27:50 +0000 (0:00:00.063)       0:00:08.705 ********
2026-08-18 13:28:26.640839 | node1 | changed: [node2]
2026-08-18 13:28:26.640910 | node1 | changed: [node3]
2026-08-18 13:28:26.641302 | node1 | changed: [node1]
2026-08-18 13:28:26.641421 | node1 |
2026-08-18 13:28:26.641434 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:28:26.641456 | node1 | Tuesday 18 August 2026  13:28:26 +0000 (0:00:36.065)       0:00:44.771 ********
2026-08-18 13:28:27.195970 | node1 | changed: [node1]
2026-08-18 13:28:27.196079 | node1 | changed: [node3]
2026-08-18 13:28:27.196598 | node1 | changed: [node2]
2026-08-18 13:28:27.196806 | node1 |
2026-08-18 13:28:27.196813 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:28:27.196819 | node1 | Tuesday 18 August 2026  13:28:27 +0000 (0:00:00.555)       0:00:45.326 ********
2026-08-18 13:28:28.113925 | node1 | changed: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:28:28.114000 | node1 | changed: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:28:28.114014 | node1 | changed: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:28:28.115387 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:28:28.115434 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:28:28.115440 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:28:28.115444 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:28:28.115448 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:28:28.115452 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:28:28.115457 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:28:28.115461 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:28:28.115465 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:28:28.115470 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:28:28.115474 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:28:28.115484 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:28:28.115488 | node1 |
2026-08-18 13:28:28.115493 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:28:28.115497 | node1 | Tuesday 18 August 2026  13:28:28 +0000 (0:00:00.918)       0:00:46.245 ********
2026-08-18 13:28:28.741292 | node1 | changed: [node1]
2026-08-18 13:28:28.741417 | node1 | changed: [node3]
2026-08-18 13:28:28.741430 | node1 | changed: [node2]
2026-08-18 13:28:28.741492 | node1 |
2026-08-18 13:28:28.742487 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:28:28.742526 | node1 | Tuesday 18 August 2026  13:28:28 +0000 (0:00:00.606)       0:00:46.851 ********
2026-08-18 13:28:28.742532 | node1 |
2026-08-18 13:28:28.742537 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:28:28.742541 | node1 | Tuesday 18 August 2026  13:28:28 +0000 (0:00:00.007)       0:00:46.859 ********
2026-08-18 13:28:28.742545 | node1 |
2026-08-18 13:28:28.742549 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:28:28.742553 | node1 | Tuesday 18 August 2026  13:28:28 +0000 (0:00:00.006)       0:00:46.865 ********
2026-08-18 13:28:28.742557 | node1 |
2026-08-18 13:28:28.742561 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 13:28:28.742565 | node1 | Tuesday 18 August 2026  13:28:28 +0000 (0:00:00.006)       0:00:46.872 ********
2026-08-18 13:28:29.629293 | node1 | ok: [node3]
2026-08-18 13:28:29.629366 | node1 | ok: [node1]
2026-08-18 13:28:29.629381 | node1 | ok: [node2]
2026-08-18 13:28:29.629727 | node1 |
2026-08-18 13:28:29.629768 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-18 13:28:29.629774 | node1 | Tuesday 18 August 2026  13:28:29 +0000 (0:00:00.887)       0:00:47.760 ********
2026-08-18 13:28:30.097460 | node1 | changed: [node1]
2026-08-18 13:28:30.097544 | node1 | changed: [node2]
2026-08-18 13:28:30.098040 | node1 | changed: [node3]
2026-08-18 13:28:30.098059 | node1 |
2026-08-18 13:28:30.098066 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:28:30.098073 | node1 | Tuesday 18 August 2026  13:28:30 +0000 (0:00:00.468)       0:00:48.228 ********
2026-08-18 13:28:30.677197 | node1 | changed: [node1]
2026-08-18 13:28:30.677241 | node1 | changed: [node2]
2026-08-18 13:28:30.677246 | node1 | changed: [node3]
2026-08-18 13:28:30.677251 | node1 |
2026-08-18 13:28:30.677255 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:28:30.677677 | node1 | Tuesday 18 August 2026  13:28:30 +0000 (0:00:00.579)       0:00:48.807 ********
2026-08-18 13:28:30.932267 | node1 | ok: [node1]
2026-08-18 13:28:30.932324 | node1 | ok: [node2]
2026-08-18 13:28:30.932692 | node1 | ok: [node3]
2026-08-18 13:28:30.932906 | node1 |
2026-08-18 13:28:30.932912 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:28:30.932918 | node1 | Tuesday 18 August 2026  13:28:30 +0000 (0:00:00.255)       0:00:49.063 ********
2026-08-18 13:28:31.033182 | node1 | ok: [node1] => {
2026-08-18 13:28:31.034531 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:28:31.034577 | node1 | }
2026-08-18 13:28:31.034585 | node1 | ok: [node2] => {
2026-08-18 13:28:31.034591 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:28:31.034597 | node1 | }
2026-08-18 13:28:31.034602 | node1 | ok: [node3] => {
2026-08-18 13:28:31.034608 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:28:31.034613 | node1 | }
2026-08-18 13:28:31.034619 | node1 |
2026-08-18 13:28:31.034625 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:28:31.034632 | node1 | Tuesday 18 August 2026  13:28:31 +0000 (0:00:00.101)       0:00:49.164 ********
2026-08-18 13:28:31.971003 | node1 | changed: [node3]
2026-08-18 13:28:31.971115 | node1 | changed: [node1]
2026-08-18 13:28:31.971127 | node1 | changed: [node2]
2026-08-18 13:28:31.971195 | node1 |
2026-08-18 13:28:31.971436 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:28:31.971501 | node1 | Tuesday 18 August 2026  13:28:31 +0000 (0:00:00.937)       0:00:50.101 ********
2026-08-18 13:28:36.389241 | node1 | changed: [node1]
2026-08-18 13:28:36.389301 | node1 | changed: [node3]
2026-08-18 13:28:36.389665 | node1 | changed: [node2]
2026-08-18 13:28:36.389706 | node1 |
2026-08-18 13:28:36.389712 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:28:36.389717 | node1 | Tuesday 18 August 2026  13:28:36 +0000 (0:00:04.418)       0:00:54.520 ********
2026-08-18 13:28:37.571670 | node1 | ok: [node3]
2026-08-18 13:28:37.571756 | node1 | ok: [node1]
2026-08-18 13:28:37.571768 | node1 | ok: [node2]
2026-08-18 13:28:37.572047 | node1 |
2026-08-18 13:28:37.572092 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:28:37.572098 | node1 | Tuesday 18 August 2026  13:28:37 +0000 (0:00:01.182)       0:00:55.702 ********
2026-08-18 13:28:37.899442 | node1 | changed: [node1]
2026-08-18 13:28:37.899493 | node1 | changed: [node3]
2026-08-18 13:28:37.899928 | node1 | changed: [node2]
2026-08-18 13:28:37.900015 | node1 |
2026-08-18 13:28:37.900022 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:28:37.900028 | node1 | Tuesday 18 August 2026  13:28:37 +0000 (0:00:00.327)       0:00:56.029 ********
2026-08-18 13:28:38.401592 | node1 | changed: [node1]
2026-08-18 13:28:38.401689 | node1 | changed: [node2]
2026-08-18 13:28:38.401700 | node1 | changed: [node3]
2026-08-18 13:28:38.402004 | node1 |
2026-08-18 13:28:38.402055 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:28:38.402062 | node1 | Tuesday 18 August 2026  13:28:38 +0000 (0:00:00.502)       0:00:56.532 ********
2026-08-18 13:28:38.986398 | node1 | changed: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:28:38.986459 | node1 | changed: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:28:38.987441 | node1 | changed: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:28:38.987522 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:28:38.987531 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:28:38.987536 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:28:38.987541 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:28:38.987545 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:28:38.987550 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:28:38.987555 | node1 |
2026-08-18 13:28:38.987560 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:28:38.987566 | node1 | Tuesday 18 August 2026  13:28:38 +0000 (0:00:00.584)       0:00:57.117 ********
2026-08-18 13:28:39.451052 | node1 | changed: [node1]
2026-08-18 13:28:39.451132 | node1 | changed: [node3]
2026-08-18 13:28:39.451137 | node1 | changed: [node2]
2026-08-18 13:28:39.451141 | node1 |
2026-08-18 13:28:39.451147 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:28:39.451152 | node1 | Tuesday 18 August 2026  13:28:39 +0000 (0:00:00.464)       0:00:57.581 ********
2026-08-18 13:28:39.952248 | node1 | changed: [node2]
2026-08-18 13:28:39.952356 | node1 | changed: [node3]
2026-08-18 13:28:39.952368 | node1 | changed: [node1]
2026-08-18 13:28:39.952432 | node1 |
2026-08-18 13:28:39.953250 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:28:39.953325 | node1 | Tuesday 18 August 2026  13:28:39 +0000 (0:00:00.481)       0:00:58.062 ********
2026-08-18 13:28:39.953338 | node1 |
2026-08-18 13:28:39.953348 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:28:39.953367 | node1 | Tuesday 18 August 2026  13:28:39 +0000 (0:00:00.006)       0:00:58.069 ********
2026-08-18 13:28:39.953376 | node1 |
2026-08-18 13:28:39.953385 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:28:39.953394 | node1 | Tuesday 18 August 2026  13:28:39 +0000 (0:00:00.007)       0:00:58.076 ********
2026-08-18 13:28:39.953410 | node1 |
2026-08-18 13:28:39.953420 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 13:28:39.953429 | node1 | Tuesday 18 August 2026  13:28:39 +0000 (0:00:00.006)       0:00:58.083 ********
2026-08-18 13:28:40.643085 | node1 | ok: [node2]
2026-08-18 13:28:40.643148 | node1 | ok: [node1]
2026-08-18 13:28:40.643272 | node1 | ok: [node3]
2026-08-18 13:28:40.643310 | node1 |
2026-08-18 13:28:40.643511 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-18 13:28:40.643526 | node1 | Tuesday 18 August 2026  13:28:40 +0000 (0:00:00.690)       0:00:58.774 ********
2026-08-18 13:28:42.154910 | node1 | changed: [node3]
2026-08-18 13:28:42.154987 | node1 | changed: [node2]
2026-08-18 13:28:42.155351 | node1 | changed: [node1]
2026-08-18 13:28:42.155396 | node1 |
2026-08-18 13:28:42.155403 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:28:42.155407 | node1 | Tuesday 18 August 2026  13:28:42 +0000 (0:00:01.511)       0:01:00.286 ********
2026-08-18 13:28:42.749494 | node1 | changed: [node1]
2026-08-18 13:28:42.749569 | node1 | changed: [node2]
2026-08-18 13:28:42.749916 | node1 | changed: [node3]
2026-08-18 13:28:42.749961 | node1 |
2026-08-18 13:28:42.749967 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:28:42.749972 | node1 | Tuesday 18 August 2026  13:28:42 +0000 (0:00:00.594)       0:01:00.880 ********
2026-08-18 13:28:42.812640 | node1 | ok: [node1] => {
2026-08-18 13:28:42.813310 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:28:42.813410 | node1 | }
2026-08-18 13:28:42.813423 | node1 | ok: [node2] => {
2026-08-18 13:28:42.813433 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:28:42.813467 | node1 | }
2026-08-18 13:28:42.813476 | node1 | ok: [node3] => {
2026-08-18 13:28:42.813494 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:28:42.813503 | node1 | }
2026-08-18 13:28:42.813513 | node1 |
2026-08-18 13:28:42.813740 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:28:42.813816 | node1 | Tuesday 18 August 2026  13:28:42 +0000 (0:00:00.062)       0:01:00.943 ********
2026-08-18 13:28:44.195128 | node1 | changed: [node2]
2026-08-18 13:28:44.195418 | node1 | changed: [node1]
2026-08-18 13:28:44.195446 | node1 | changed: [node3]
2026-08-18 13:28:44.195456 | node1 |
2026-08-18 13:28:44.195466 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:28:44.195528 | node1 | Tuesday 18 August 2026  13:28:44 +0000 (0:00:01.382)       0:01:02.325 ********
2026-08-18 13:28:44.227797 | node1 | skipping: [node1]
2026-08-18 13:28:44.275561 | node1 | skipping: [node2]
2026-08-18 13:28:44.275585 | node1 | skipping: [node3]
2026-08-18 13:28:44.275591 | node1 |
2026-08-18 13:28:44.275595 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:28:44.275600 | node1 | Tuesday 18 August 2026  13:28:44 +0000 (0:00:00.080)       0:01:02.406 ********
2026-08-18 13:28:44.306824 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:28:44.356086 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:28:44.356549 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:28:44.356597 | node1 |
2026-08-18 13:28:44.356603 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:28:44.356608 | node1 | Tuesday 18 August 2026  13:28:44 +0000 (0:00:00.080)       0:01:02.486 ********
2026-08-18 13:28:49.513056 | node1 | changed: [node3]
2026-08-18 13:28:49.513155 | node1 | changed: [node1]
2026-08-18 13:28:49.513238 | node1 | changed: [node2]
2026-08-18 13:28:49.513346 | node1 |
2026-08-18 13:28:49.513451 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:28:49.513551 | node1 | Tuesday 18 August 2026  13:28:49 +0000 (0:00:05.156)       0:01:07.643 ********
2026-08-18 13:28:50.199278 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:28:50.199454 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:28:50.199675 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:28:50.199879 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:28:50.200070 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:28:50.200264 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:28:50.200440 | node1 |
2026-08-18 13:28:50.200708 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:28:50.200893 | node1 | Tuesday 18 August 2026  13:28:50 +0000 (0:00:00.686)       0:01:08.330 ********
2026-08-18 13:28:50.418592 | node1 | ok: [node1]
2026-08-18 13:28:50.418792 | node1 | ok: [node2]
2026-08-18 13:28:50.419003 | node1 | ok: [node3]
2026-08-18 13:28:50.419196 | node1 |
2026-08-18 13:28:50.419416 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:28:50.419629 | node1 | Tuesday 18 August 2026  13:28:50 +0000 (0:00:00.219)       0:01:08.549 ********
2026-08-18 13:28:50.876091 | node1 | changed: [node3]
2026-08-18 13:28:50.876250 | node1 | changed: [node1]
2026-08-18 13:28:50.876514 | node1 | changed: [node2]
2026-08-18 13:28:50.876688 | node1 |
2026-08-18 13:28:50.876925 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:28:50.877160 | node1 | Tuesday 18 August 2026  13:28:50 +0000 (0:00:00.457)       0:01:09.006 ********
2026-08-18 13:28:51.360866 | node1 | changed: [node1]
2026-08-18 13:28:51.361117 | node1 | changed: [node2]
2026-08-18 13:28:51.361365 | node1 | changed: [node3]
2026-08-18 13:28:51.361584 | node1 |
2026-08-18 13:28:51.361808 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:28:51.362031 | node1 | Tuesday 18 August 2026  13:28:51 +0000 (0:00:00.484)       0:01:09.491 ********
2026-08-18 13:28:51.412846 | node1 | skipping: [node1]
2026-08-18 13:28:51.413192 | node1 | skipping: [node2]
2026-08-18 13:28:51.413401 | node1 | skipping: [node3]
2026-08-18 13:28:51.413594 | node1 |
2026-08-18 13:28:51.413814 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:28:51.414034 | node1 | Tuesday 18 August 2026  13:28:51 +0000 (0:00:00.052)       0:01:09.543 ********
2026-08-18 13:29:32.366606 | node1 | changed: [node2]
2026-08-18 13:29:32.366680 | node1 | changed: [node1]
2026-08-18 13:29:32.366692 | node1 | changed: [node3]
2026-08-18 13:29:32.366702 | node1 |
2026-08-18 13:29:32.366713 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:29:32.366723 | node1 | Tuesday 18 August 2026  13:29:32 +0000 (0:00:40.952)       0:01:50.496 ********
2026-08-18 13:29:32.877804 | node1 | changed: [node3]
2026-08-18 13:29:32.877876 | node1 | changed: [node1]
2026-08-18 13:29:32.877936 | node1 | changed: [node2]
2026-08-18 13:29:32.878232 | node1 |
2026-08-18 13:29:32.878268 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] ***
2026-08-18 13:29:32.878274 | node1 | Tuesday 18 August 2026  13:29:32 +0000 (0:00:00.512)       0:01:51.008 ********
2026-08-18 13:29:33.329259 | node1 | ok: [node3]
2026-08-18 13:29:33.329323 | node1 | ok: [node2]
2026-08-18 13:29:33.329337 | node1 | ok: [node1]
2026-08-18 13:29:33.329642 | node1 |
2026-08-18 13:29:33.329683 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] ***
2026-08-18 13:29:33.329688 | node1 | Tuesday 18 August 2026  13:29:33 +0000 (0:00:00.451)       0:01:51.460 ********
2026-08-18 13:29:33.397633 | node1 | ok: [node1] => {
2026-08-18 13:29:33.398843 | node1 |     "changed": false,
2026-08-18 13:29:33.398892 | node1 |     "msg": "All assertions passed"
2026-08-18 13:29:33.398898 | node1 | }
2026-08-18 13:29:33.398903 | node1 | ok: [node2] => {
2026-08-18 13:29:33.398907 | node1 |     "changed": false,
2026-08-18 13:29:33.398911 | node1 |     "msg": "All assertions passed"
2026-08-18 13:29:33.398915 | node1 | }
2026-08-18 13:29:33.398919 | node1 | ok: [node3] => {
2026-08-18 13:29:33.398923 | node1 |     "changed": false,
2026-08-18 13:29:33.398927 | node1 |     "msg": "All assertions passed"
2026-08-18 13:29:33.398931 | node1 | }
2026-08-18 13:29:33.398935 | node1 |
2026-08-18 13:29:33.398940 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] *******************
2026-08-18 13:29:33.398945 | node1 | Tuesday 18 August 2026  13:29:33 +0000 (0:00:00.068)       0:01:51.528 ********
2026-08-18 13:29:33.430820 | node1 | ok: [node1]
2026-08-18 13:29:33.464964 | node1 | ok: [node2]
2026-08-18 13:29:33.465037 | node1 | ok: [node3]
2026-08-18 13:29:33.465251 | node1 |
2026-08-18 13:29:33.465324 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] ***
2026-08-18 13:29:33.465336 | node1 | Tuesday 18 August 2026  13:29:33 +0000 (0:00:00.067)       0:01:51.595 ********
2026-08-18 13:29:33.994960 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:29:33.995029 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:29:33.995123 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:29:33.995430 | node1 |
2026-08-18 13:29:33.995469 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] ***
2026-08-18 13:29:33.995475 | node1 | Tuesday 18 August 2026  13:29:33 +0000 (0:00:00.530)       0:01:52.126 ********
2026-08-18 13:29:34.062291 | node1 | ok: [node1]
2026-08-18 13:29:34.062335 | node1 | ok: [node2]
2026-08-18 13:29:34.062704 | node1 | ok: [node3]
2026-08-18 13:29:34.062739 | node1 |
2026-08-18 13:29:34.062744 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 13:29:34.062749 | node1 | Tuesday 18 August 2026  13:29:34 +0000 (0:00:00.067)       0:01:52.193 ********
2026-08-18 13:29:34.183024 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3
2026-08-18 13:29:34.183099 | node1 |
2026-08-18 13:29:34.183332 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] *****************************
2026-08-18 13:29:34.183373 | node1 | Tuesday 18 August 2026  13:29:34 +0000 (0:00:00.120)       0:01:52.314 ********
2026-08-18 13:29:34.386613 | node1 | skipping: [node2]
2026-08-18 13:29:34.386702 | node1 | skipping: [node3]
2026-08-18 13:29:34.386740 | node1 | changed: [node1]
2026-08-18 13:29:34.386755 | node1 |
2026-08-18 13:29:34.387023 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] ***********
2026-08-18 13:29:34.387094 | node1 | Tuesday 18 August 2026  13:29:34 +0000 (0:00:00.203)       0:01:52.517 ********
2026-08-18 13:29:34.422266 | node1 | skipping: [node1]
2026-08-18 13:29:34.453179 | node1 | skipping: [node2]
2026-08-18 13:29:34.453266 | node1 | skipping: [node3]
2026-08-18 13:29:34.453596 | node1 |
2026-08-18 13:29:34.453642 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************
2026-08-18 13:29:34.453649 | node1 | Tuesday 18 August 2026  13:29:34 +0000 (0:00:00.067)       0:01:52.584 ********
2026-08-18 13:29:34.488269 | node1 | skipping: [node1]
2026-08-18 13:29:34.514343 | node1 | skipping: [node2]
2026-08-18 13:29:34.514757 | node1 | skipping: [node3]
2026-08-18 13:29:34.514807 | node1 |
2026-08-18 13:29:34.514813 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] ***
2026-08-18 13:29:34.514819 | node1 | Tuesday 18 August 2026  13:29:34 +0000 (0:00:00.060)       0:01:52.645 ********
2026-08-18 13:29:35.992220 | node1 | skipping: [node2]
2026-08-18 13:29:35.992336 | node1 | skipping: [node3]
2026-08-18 13:29:35.992348 | node1 | changed: [node1]
2026-08-18 13:29:35.992414 | node1 |
2026-08-18 13:29:35.992654 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] ***
2026-08-18 13:29:35.992707 | node1 | Tuesday 18 August 2026  13:29:35 +0000 (0:00:01.478)       0:01:54.123 ********
2026-08-18 13:29:36.277325 | node1 | skipping: [node2]
2026-08-18 13:29:36.277439 | node1 | skipping: [node3]
2026-08-18 13:29:36.277936 | node1 | changed: [node1]
2026-08-18 13:29:36.278010 | node1 |
2026-08-18 13:29:36.278018 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] **************
2026-08-18 13:29:36.278026 | node1 | Tuesday 18 August 2026  13:29:36 +0000 (0:00:00.284)       0:01:54.408 ********
2026-08-18 13:29:36.310635 | node1 | skipping: [node1]
2026-08-18 13:29:36.337595 | node1 | skipping: [node2]
2026-08-18 13:29:36.338070 | node1 | skipping: [node3]
2026-08-18 13:29:36.338092 | node1 |
2026-08-18 13:29:36.338101 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 13:29:36.338108 | node1 | Tuesday 18 August 2026  13:29:36 +0000 (0:00:00.061)       0:01:54.469 ********
2026-08-18 13:30:18.887787 | node1 | skipping: [node2]
2026-08-18 13:30:18.887860 | node1 | skipping: [node3]
2026-08-18 13:30:18.888399 | node1 | changed: [node1]
2026-08-18 13:30:18.888445 | node1 |
2026-08-18 13:30:18.888452 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] **********************
2026-08-18 13:30:18.888459 | node1 | Tuesday 18 August 2026  13:30:18 +0000 (0:00:42.549)       0:02:37.018 ********
2026-08-18 13:30:19.099880 | node1 | skipping: [node2]
2026-08-18 13:30:19.099940 | node1 | skipping: [node3]
2026-08-18 13:30:19.100318 | node1 | changed: [node1]
2026-08-18 13:30:19.100363 | node1 |
2026-08-18 13:30:19.100368 | node1 | TASK [Register this monitor host] **********************************************
2026-08-18 13:30:19.100373 | node1 | Tuesday 18 August 2026  13:30:19 +0000 (0:00:00.212)       0:02:37.230 ********
2026-08-18 13:30:19.234961 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:30:19.235278 | node1 |
2026-08-18 13:30:19.235315 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:30:19.235321 | node1 | Tuesday 18 August 2026  13:30:19 +0000 (0:00:00.135)       0:02:37.366 ********
2026-08-18 13:30:20.773598 | node1 | ok: [node1]
2026-08-18 13:30:20.773670 | node1 |
2026-08-18 13:30:20.773961 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:30:20.774024 | node1 | Tuesday 18 August 2026  13:30:20 +0000 (0:00:01.537)       0:02:38.903 ********
2026-08-18 13:30:20.850574 | node1 | ok: [node1]
2026-08-18 13:30:20.850643 | node1 | ok: [node2]
2026-08-18 13:30:20.850650 | node1 | ok: [node3]
2026-08-18 13:30:20.850657 | node1 |
2026-08-18 13:30:20.850664 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:30:20.850671 | node1 | Tuesday 18 August 2026  13:30:20 +0000 (0:00:00.076)       0:02:38.980 ********
2026-08-18 13:30:20.922809 | node1 | ok: [node1] => {
2026-08-18 13:30:20.922873 | node1 |     "changed": false,
2026-08-18 13:30:20.922984 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:20.923073 | node1 | }
2026-08-18 13:30:20.923190 | node1 | ok: [node2] => {
2026-08-18 13:30:20.923291 | node1 |     "changed": false,
2026-08-18 13:30:20.923375 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:20.923464 | node1 | }
2026-08-18 13:30:20.923555 | node1 | ok: [node3] => {
2026-08-18 13:30:20.923645 | node1 |     "changed": false,
2026-08-18 13:30:20.923737 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:20.923826 | node1 | }
2026-08-18 13:30:20.923909 | node1 |
2026-08-18 13:30:20.924014 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:30:20.924107 | node1 | Tuesday 18 August 2026  13:30:20 +0000 (0:00:00.073)       0:02:39.053 ********
2026-08-18 13:30:21.311397 | node1 | changed: [node3]
2026-08-18 13:30:21.311499 | node1 | ok: [node1]
2026-08-18 13:30:21.312078 | node1 | changed: [node2]
2026-08-18 13:30:21.312153 | node1 |
2026-08-18 13:30:21.312163 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:30:21.312171 | node1 | Tuesday 18 August 2026  13:30:21 +0000 (0:00:00.388)       0:02:39.442 ********
2026-08-18 13:30:21.394917 | node1 | ok: [node1]
2026-08-18 13:30:21.394962 | node1 | ok: [node2]
2026-08-18 13:30:21.394969 | node1 | ok: [node3]
2026-08-18 13:30:21.395194 | node1 |
2026-08-18 13:30:21.395249 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:30:21.395342 | node1 | Tuesday 18 August 2026  13:30:21 +0000 (0:00:00.082)       0:02:39.525 ********
2026-08-18 13:30:21.504973 | node1 | ok: [node1]
2026-08-18 13:30:21.505050 | node1 | ok: [node2]
2026-08-18 13:30:21.505093 | node1 | ok: [node3]
2026-08-18 13:30:21.505206 | node1 |
2026-08-18 13:30:21.505320 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:30:21.505407 | node1 | Tuesday 18 August 2026  13:30:21 +0000 (0:00:00.110)       0:02:39.636 ********
2026-08-18 13:30:21.579087 | node1 | ok: [node1] => {
2026-08-18 13:30:21.579195 | node1 |     "changed": false,
2026-08-18 13:30:21.579327 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:21.579459 | node1 | }
2026-08-18 13:30:21.579586 | node1 | ok: [node2] => {
2026-08-18 13:30:21.579715 | node1 |     "changed": false,
2026-08-18 13:30:21.579831 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:21.579951 | node1 | }
2026-08-18 13:30:21.580073 | node1 | ok: [node3] => {
2026-08-18 13:30:21.580199 | node1 |     "changed": false,
2026-08-18 13:30:21.580325 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:21.580447 | node1 | }
2026-08-18 13:30:21.580561 | node1 |
2026-08-18 13:30:21.580697 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:30:21.580825 | node1 | Tuesday 18 August 2026  13:30:21 +0000 (0:00:00.074)       0:02:39.710 ********
2026-08-18 13:30:48.234993 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:30:48.235035 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:30:48.235041 | node1 | changed: [node1]
2026-08-18 13:30:48.235046 | node1 |
2026-08-18 13:30:48.235050 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:30:48.235054 | node1 | Tuesday 18 August 2026  13:30:48 +0000 (0:00:26.655)       0:03:06.365 ********
2026-08-18 13:30:48.322310 | node1 | skipping: [node1]
2026-08-18 13:30:48.322419 | node1 | skipping: [node2]
2026-08-18 13:30:48.322434 | node1 | skipping: [node3]
2026-08-18 13:30:48.322755 | node1 |
2026-08-18 13:30:48.322802 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] **********************
2026-08-18 13:30:48.322808 | node1 | Tuesday 18 August 2026  13:30:48 +0000 (0:00:00.087)       0:03:06.453 ********
2026-08-18 13:30:51.239873 | node1 | changed: [node1]
2026-08-18 13:30:51.239955 | node1 |
2026-08-18 13:30:51.240285 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ********
2026-08-18 13:30:51.240337 | node1 | Tuesday 18 August 2026  13:30:51 +0000 (0:00:02.917)       0:03:09.370 ********
2026-08-18 13:30:52.973858 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:30:52.973923 | node1 | ok: [node1]
2026-08-18 13:30:52.973985 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:30:52.974277 | node1 |
2026-08-18 13:30:52.974323 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] ***********************
2026-08-18 13:30:52.974329 | node1 | Tuesday 18 August 2026  13:30:52 +0000 (0:00:01.734)       0:03:11.104 ********
2026-08-18 13:30:53.559560 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:30:53.559604 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:30:53.559610 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:30:53.559615 | node1 |
2026-08-18 13:30:53.559619 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] *******************************
2026-08-18 13:30:53.559624 | node1 | Tuesday 18 August 2026  13:30:53 +0000 (0:00:00.585)       0:03:11.690 ********
2026-08-18 13:30:53.629189 | node1 | ok: [node1]
2026-08-18 13:30:53.629233 | node1 | ok: [node2]
2026-08-18 13:30:53.629237 | node1 | ok: [node3]
2026-08-18 13:30:53.629242 | node1 |
2026-08-18 13:30:53.629475 | node1 | TASK [Register this manager host] **********************************************
2026-08-18 13:30:53.629486 | node1 | Tuesday 18 August 2026  13:30:53 +0000 (0:00:00.070)       0:03:11.760 ********
2026-08-18 13:30:53.749190 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:30:53.749258 | node1 |
2026-08-18 13:30:53.749441 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:30:53.749740 | node1 | Tuesday 18 August 2026  13:30:53 +0000 (0:00:00.119)       0:03:11.879 ********
2026-08-18 13:30:55.810837 | node1 | ok: [node1]
2026-08-18 13:30:55.810920 | node1 |
2026-08-18 13:30:55.810926 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:30:55.810932 | node1 | Tuesday 18 August 2026  13:30:55 +0000 (0:00:02.061)       0:03:13.940 ********
2026-08-18 13:30:55.891403 | node1 | ok: [node1]
2026-08-18 13:30:55.891508 | node1 | ok: [node2]
2026-08-18 13:30:55.891520 | node1 | ok: [node3]
2026-08-18 13:30:55.891531 | node1 |
2026-08-18 13:30:55.891543 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:30:55.891554 | node1 | Tuesday 18 August 2026  13:30:55 +0000 (0:00:00.080)       0:03:14.020 ********
2026-08-18 13:30:55.957423 | node1 | ok: [node1] => {
2026-08-18 13:30:55.957498 | node1 |     "changed": false,
2026-08-18 13:30:55.957518 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:55.957621 | node1 | }
2026-08-18 13:30:55.958190 | node1 | ok: [node2] => {
2026-08-18 13:30:55.958614 | node1 |     "changed": false,
2026-08-18 13:30:55.958734 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:55.958962 | node1 | }
2026-08-18 13:30:55.959468 | node1 | ok: [node3] => {
2026-08-18 13:30:55.959626 | node1 |     "changed": false,
2026-08-18 13:30:55.959845 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:55.960088 | node1 | }
2026-08-18 13:30:55.960320 | node1 |
2026-08-18 13:30:55.960619 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:30:55.960821 | node1 | Tuesday 18 August 2026  13:30:55 +0000 (0:00:00.067)       0:03:14.088 ********
2026-08-18 13:30:56.230766 | node1 | ok: [node1]
2026-08-18 13:30:56.231069 | node1 | ok: [node2]
2026-08-18 13:30:56.231324 | node1 | ok: [node3]
2026-08-18 13:30:56.231520 | node1 |
2026-08-18 13:30:56.231759 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:30:56.231982 | node1 | Tuesday 18 August 2026  13:30:56 +0000 (0:00:00.272)       0:03:14.361 ********
2026-08-18 13:30:56.298372 | node1 | ok: [node1]
2026-08-18 13:30:56.298538 | node1 | ok: [node2]
2026-08-18 13:30:56.298827 | node1 | ok: [node3]
2026-08-18 13:30:56.299029 | node1 |
2026-08-18 13:30:56.299300 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:30:56.299520 | node1 | Tuesday 18 August 2026  13:30:56 +0000 (0:00:00.067)       0:03:14.429 ********
2026-08-18 13:30:56.397330 | node1 | ok: [node1]
2026-08-18 13:30:56.397450 | node1 | ok: [node2]
2026-08-18 13:30:56.397651 | node1 | ok: [node3]
2026-08-18 13:30:56.397839 | node1 |
2026-08-18 13:30:56.398155 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:30:56.398404 | node1 | Tuesday 18 August 2026  13:30:56 +0000 (0:00:00.098)       0:03:14.528 ********
2026-08-18 13:30:56.466135 | node1 | ok: [node1] => {
2026-08-18 13:30:56.466294 | node1 |     "changed": false,
2026-08-18 13:30:56.466491 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:56.466686 | node1 | }
2026-08-18 13:30:56.466892 | node1 | ok: [node2] => {
2026-08-18 13:30:56.467082 | node1 |     "changed": false,
2026-08-18 13:30:56.467280 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:56.467464 | node1 | }
2026-08-18 13:30:56.467660 | node1 | ok: [node3] => {
2026-08-18 13:30:56.467857 | node1 |     "changed": false,
2026-08-18 13:30:56.468061 | node1 |     "msg": "All assertions passed"
2026-08-18 13:30:56.468234 | node1 | }
2026-08-18 13:30:56.468413 | node1 |
2026-08-18 13:30:56.468622 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:30:56.468828 | node1 | Tuesday 18 August 2026  13:30:56 +0000 (0:00:00.069)       0:03:14.597 ********
2026-08-18 13:31:01.678546 | node1 | ok: [node1]
2026-08-18 13:31:01.678626 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:01.678703 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:01.678808 | node1 |
2026-08-18 13:31:01.678952 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:31:01.679085 | node1 | Tuesday 18 August 2026  13:31:01 +0000 (0:00:05.212)       0:03:19.809 ********
2026-08-18 13:31:01.791070 | node1 | skipping: [node1]
2026-08-18 13:31:01.791286 | node1 | skipping: [node2]
2026-08-18 13:31:01.791567 | node1 | skipping: [node3]
2026-08-18 13:31:01.791770 | node1 |
2026-08-18 13:31:01.792252 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] **********************
2026-08-18 13:31:01.792491 | node1 | Tuesday 18 August 2026  13:31:01 +0000 (0:00:00.111)       0:03:19.921 ********
2026-08-18 13:31:04.592454 | node1 | changed: [node1]
2026-08-18 13:31:04.592578 | node1 |
2026-08-18 13:31:04.592813 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ********
2026-08-18 13:31:04.593023 | node1 | Tuesday 18 August 2026  13:31:04 +0000 (0:00:02.801)       0:03:22.723 ********
2026-08-18 13:31:06.172416 | node1 | ok: [node1]
2026-08-18 13:31:06.172638 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:06.172877 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:06.173084 | node1 |
2026-08-18 13:31:06.173371 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] **************************
2026-08-18 13:31:06.173589 | node1 | Tuesday 18 August 2026  13:31:06 +0000 (0:00:01.580)       0:03:24.303 ********
2026-08-18 13:31:15.903201 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'})
2026-08-18 13:31:15.903366 | node1 | changed: [node1] => (item={'name': 'dashboard'})
2026-08-18 13:31:15.903437 | node1 | ok: [node1] => (item={'name': 'iostat'})
2026-08-18 13:31:15.903450 | node1 | changed: [node1] => (item={'name': 'prometheus'})
2026-08-18 13:31:15.903461 | node1 | changed: [node1] => (item={'name': 'rgw'})
2026-08-18 13:31:15.903583 | node1 |
2026-08-18 13:31:15.903601 | node1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-18 13:31:15.903649 | node1 |
2026-08-18 13:31:15.903664 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:31:15.903737 | node1 | Tuesday 18 August 2026  13:31:15 +0000 (0:00:09.727)       0:03:34.031 ********
2026-08-18 13:31:16.831790 | node1 | ok: [node1]
2026-08-18 13:31:16.831864 | node1 | ok: [node3]
2026-08-18 13:31:16.831869 | node1 | ok: [node2]
2026-08-18 13:31:16.831891 | node1 |
2026-08-18 13:31:16.831898 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:31:16.831904 | node1 | Tuesday 18 August 2026  13:31:16 +0000 (0:00:00.930)       0:03:34.961 ********
2026-08-18 13:31:17.086466 | node1 | ok: [node1]
2026-08-18 13:31:17.086508 | node1 | ok: [node3]
2026-08-18 13:31:17.086513 | node1 | ok: [node2]
2026-08-18 13:31:17.086518 | node1 |
2026-08-18 13:31:17.086523 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:31:17.086527 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.255)       0:03:35.217 ********
2026-08-18 13:31:17.159751 | node1 | skipping: [node1]
2026-08-18 13:31:17.159798 | node1 | skipping: [node2]
2026-08-18 13:31:17.159803 | node1 | skipping: [node3]
2026-08-18 13:31:17.159819 | node1 |
2026-08-18 13:31:17.159824 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:31:17.159829 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.073)       0:03:35.290 ********
2026-08-18 13:31:17.415034 | node1 | ok: [node1]
2026-08-18 13:31:17.415100 | node1 | ok: [node3]
2026-08-18 13:31:17.415190 | node1 | ok: [node2]
2026-08-18 13:31:17.415278 | node1 |
2026-08-18 13:31:17.415384 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:31:17.415484 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.255)       0:03:35.546 ********
2026-08-18 13:31:17.486641 | node1 | ok: [node1] => {
2026-08-18 13:31:17.486744 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:31:17.486835 | node1 | }
2026-08-18 13:31:17.486928 | node1 | ok: [node2] => {
2026-08-18 13:31:17.487046 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:31:17.487107 | node1 | }
2026-08-18 13:31:17.487199 | node1 | ok: [node3] => {
2026-08-18 13:31:17.487296 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:31:17.487383 | node1 | }
2026-08-18 13:31:17.487466 | node1 |
2026-08-18 13:31:17.487560 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:31:17.487655 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.071)       0:03:35.618 ********
2026-08-18 13:31:17.809692 | node1 | ok: [node1]
2026-08-18 13:31:17.809801 | node1 | ok: [node3]
2026-08-18 13:31:17.809935 | node1 | ok: [node2]
2026-08-18 13:31:17.810058 | node1 |
2026-08-18 13:31:17.810202 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:31:17.810334 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.322)       0:03:35.940 ********
2026-08-18 13:31:17.839213 | node1 | skipping: [node1]
2026-08-18 13:31:17.897309 | node1 | skipping: [node2]
2026-08-18 13:31:17.897374 | node1 | skipping: [node3]
2026-08-18 13:31:17.897441 | node1 |
2026-08-18 13:31:17.897660 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:31:17.897702 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.087)       0:03:36.028 ********
2026-08-18 13:31:17.925779 | node1 | skipping: [node1]
2026-08-18 13:31:17.988939 | node1 | skipping: [node2]
2026-08-18 13:31:17.989016 | node1 | skipping: [node3]
2026-08-18 13:31:17.989100 | node1 |
2026-08-18 13:31:17.989235 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:31:17.989346 | node1 | Tuesday 18 August 2026  13:31:17 +0000 (0:00:00.091)       0:03:36.120 ********
2026-08-18 13:31:18.242848 | node1 | ok: [node1]
2026-08-18 13:31:18.242912 | node1 | ok: [node3]
2026-08-18 13:31:18.243015 | node1 | ok: [node2]
2026-08-18 13:31:18.243109 | node1 |
2026-08-18 13:31:18.243213 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:31:18.243309 | node1 | Tuesday 18 August 2026  13:31:18 +0000 (0:00:00.253)       0:03:36.373 ********
2026-08-18 13:31:19.669888 | node1 | ok: [node3]
2026-08-18 13:31:19.670004 | node1 | ok: [node1]
2026-08-18 13:31:19.670017 | node1 | ok: [node2]
2026-08-18 13:31:19.670090 | node1 |
2026-08-18 13:31:19.670307 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:31:19.670364 | node1 | Tuesday 18 August 2026  13:31:19 +0000 (0:00:01.427)       0:03:37.800 ********
2026-08-18 13:31:19.772275 | node1 | ok: [node1] => {
2026-08-18 13:31:19.772346 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:31:19.772449 | node1 | }
2026-08-18 13:31:19.772545 | node1 | ok: [node2] => {
2026-08-18 13:31:19.772651 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:31:19.772751 | node1 | }
2026-08-18 13:31:19.772826 | node1 | ok: [node3] => {
2026-08-18 13:31:19.772936 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:31:19.773012 | node1 | }
2026-08-18 13:31:19.773138 | node1 |
2026-08-18 13:31:19.773230 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:31:19.773320 | node1 | Tuesday 18 August 2026  13:31:19 +0000 (0:00:00.102)       0:03:37.903 ********
2026-08-18 13:31:20.139583 | node1 | ok: [node1]
2026-08-18 13:31:20.139678 | node1 | ok: [node2]
2026-08-18 13:31:20.139762 | node1 | ok: [node3]
2026-08-18 13:31:20.140073 | node1 |
2026-08-18 13:31:20.140114 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:31:20.140120 | node1 | Tuesday 18 August 2026  13:31:20 +0000 (0:00:00.367)       0:03:38.270 ********
2026-08-18 13:31:22.089768 | node1 | ok: [node1]
2026-08-18 13:31:22.089842 | node1 | ok: [node3]
2026-08-18 13:31:22.089907 | node1 | ok: [node2]
2026-08-18 13:31:22.090207 | node1 |
2026-08-18 13:31:22.090430 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:31:22.090436 | node1 | Tuesday 18 August 2026  13:31:22 +0000 (0:00:01.950)       0:03:40.220 ********
2026-08-18 13:31:22.118886 | node1 | skipping: [node1]
2026-08-18 13:31:22.139245 | node1 | skipping: [node2]
2026-08-18 13:31:22.139331 | node1 | skipping: [node3]
2026-08-18 13:31:22.139423 | node1 |
2026-08-18 13:31:22.139532 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:31:22.139655 | node1 | Tuesday 18 August 2026  13:31:22 +0000 (0:00:00.049)       0:03:40.270 ********
2026-08-18 13:31:22.176410 | node1 | skipping: [node1]
2026-08-18 13:31:22.207674 | node1 | skipping: [node2]
2026-08-18 13:31:22.207785 | node1 | skipping: [node3]
2026-08-18 13:31:22.207867 | node1 |
2026-08-18 13:31:22.208144 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:31:22.208229 | node1 | Tuesday 18 August 2026  13:31:22 +0000 (0:00:00.068)       0:03:40.338 ********
2026-08-18 13:31:22.238325 | node1 | skipping: [node1]
2026-08-18 13:31:22.269779 | node1 | skipping: [node2]
2026-08-18 13:31:22.269904 | node1 | skipping: [node3]
2026-08-18 13:31:22.270029 | node1 |
2026-08-18 13:31:22.270354 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:31:22.270411 | node1 | Tuesday 18 August 2026  13:31:22 +0000 (0:00:00.062)       0:03:40.400 ********
2026-08-18 13:31:23.485830 | node1 | ok: [node3]
2026-08-18 13:31:23.485930 | node1 | ok: [node2]
2026-08-18 13:31:23.485994 | node1 | ok: [node1]
2026-08-18 13:31:23.486351 | node1 |
2026-08-18 13:31:23.486440 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:31:23.486447 | node1 | Tuesday 18 August 2026  13:31:23 +0000 (0:00:01.215)       0:03:41.616 ********
2026-08-18 13:31:23.971323 | node1 | ok: [node3]
2026-08-18 13:31:23.971431 | node1 | ok: [node2]
2026-08-18 13:31:23.971566 | node1 | ok: [node1]
2026-08-18 13:31:23.971754 | node1 |
2026-08-18 13:31:23.971929 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:31:23.972095 | node1 | Tuesday 18 August 2026  13:31:23 +0000 (0:00:00.484)       0:03:42.100 ********
2026-08-18 13:31:24.959924 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:31:24.959978 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:31:24.959987 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:31:24.959995 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:31:24.960004 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:31:24.960018 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:31:24.961327 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:31:24.961399 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:31:24.961412 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:31:24.961422 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:31:24.961433 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:31:24.961442 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:31:24.961452 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:31:24.961481 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:31:24.961496 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:31:24.961510 | node1 |
2026-08-18 13:31:24.961534 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:31:24.961549 | node1 | Tuesday 18 August 2026  13:31:24 +0000 (0:00:00.989)       0:03:43.090 ********
2026-08-18 13:31:25.535321 | node1 | ok: [node2]
2026-08-18 13:31:25.535406 | node1 | ok: [node1]
2026-08-18 13:31:25.535411 | node1 | ok: [node3]
2026-08-18 13:31:25.535416 | node1 |
2026-08-18 13:31:25.535422 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:31:25.535427 | node1 | Tuesday 18 August 2026  13:31:25 +0000 (0:00:00.554)       0:03:43.645 ********
2026-08-18 13:31:25.535431 | node1 |
2026-08-18 13:31:25.535435 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:31:25.535439 | node1 | Tuesday 18 August 2026  13:31:25 +0000 (0:00:00.007)       0:03:43.652 ********
2026-08-18 13:31:25.535444 | node1 |
2026-08-18 13:31:25.535448 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:31:25.535453 | node1 | Tuesday 18 August 2026  13:31:25 +0000 (0:00:00.005)       0:03:43.657 ********
2026-08-18 13:31:25.535459 | node1 |
2026-08-18 13:31:25.535463 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:31:25.535468 | node1 | Tuesday 18 August 2026  13:31:25 +0000 (0:00:00.006)       0:03:43.664 ********
2026-08-18 13:31:25.922213 | node1 | ok: [node1]
2026-08-18 13:31:25.922330 | node1 | ok: [node3]
2026-08-18 13:31:25.922343 | node1 | ok: [node2]
2026-08-18 13:31:25.922355 | node1 |
2026-08-18 13:31:25.922481 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:31:25.922576 | node1 | Tuesday 18 August 2026  13:31:25 +0000 (0:00:00.388)       0:03:44.053 ********
2026-08-18 13:31:26.157696 | node1 | ok: [node1]
2026-08-18 13:31:26.157764 | node1 | ok: [node2]
2026-08-18 13:31:26.157850 | node1 | ok: [node3]
2026-08-18 13:31:26.157942 | node1 |
2026-08-18 13:31:26.158038 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:31:26.158123 | node1 | Tuesday 18 August 2026  13:31:26 +0000 (0:00:00.235)       0:03:44.288 ********
2026-08-18 13:31:26.241549 | node1 | ok: [node2] => {
2026-08-18 13:31:26.242551 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:31:26.242611 | node1 | }
2026-08-18 13:31:26.242623 | node1 | ok: [node1] => {
2026-08-18 13:31:26.242633 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:31:26.242642 | node1 | }
2026-08-18 13:31:26.242651 | node1 | ok: [node3] => {
2026-08-18 13:31:26.242667 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:31:26.242855 | node1 | }
2026-08-18 13:31:26.242888 | node1 |
2026-08-18 13:31:26.243131 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:31:26.243158 | node1 | Tuesday 18 August 2026  13:31:26 +0000 (0:00:00.082)       0:03:44.371 ********
2026-08-18 13:31:26.611662 | node1 | ok: [node1]
2026-08-18 13:31:26.611715 | node1 | ok: [node3]
2026-08-18 13:31:26.611720 | node1 | ok: [node2]
2026-08-18 13:31:26.611725 | node1 |
2026-08-18 13:31:26.611729 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:31:26.611734 | node1 | Tuesday 18 August 2026  13:31:26 +0000 (0:00:00.370)       0:03:44.742 ********
2026-08-18 13:31:30.728206 | node1 | ok: [node1]
2026-08-18 13:31:30.728286 | node1 | ok: [node3]
2026-08-18 13:31:30.728293 | node1 | ok: [node2]
2026-08-18 13:31:30.728348 | node1 |
2026-08-18 13:31:30.728573 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:31:30.728612 | node1 | Tuesday 18 August 2026  13:31:30 +0000 (0:00:04.116)       0:03:48.859 ********
2026-08-18 13:31:31.875377 | node1 | ok: [node3]
2026-08-18 13:31:31.875460 | node1 | ok: [node1]
2026-08-18 13:31:31.875970 | node1 | ok: [node2]
2026-08-18 13:31:31.875992 | node1 |
2026-08-18 13:31:31.876000 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:31:31.876006 | node1 | Tuesday 18 August 2026  13:31:31 +0000 (0:00:01.147)       0:03:50.006 ********
2026-08-18 13:31:32.088115 | node1 | ok: [node1]
2026-08-18 13:31:32.088228 | node1 | ok: [node2]
2026-08-18 13:31:32.088779 | node1 | ok: [node3]
2026-08-18 13:31:32.088824 | node1 |
2026-08-18 13:31:32.088832 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:31:32.088838 | node1 | Tuesday 18 August 2026  13:31:32 +0000 (0:00:00.212)       0:03:50.218 ********
2026-08-18 13:31:32.545313 | node1 | ok: [node2]
2026-08-18 13:31:32.545379 | node1 | ok: [node1]
2026-08-18 13:31:32.545391 | node1 | ok: [node3]
2026-08-18 13:31:32.545642 | node1 |
2026-08-18 13:31:32.545658 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:31:32.545663 | node1 | Tuesday 18 August 2026  13:31:32 +0000 (0:00:00.457)       0:03:50.676 ********
2026-08-18 13:31:33.101712 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:31:33.101816 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:31:33.103212 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:31:33.103275 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:31:33.103283 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:31:33.103288 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:31:33.103294 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:31:33.103299 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:31:33.103304 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:31:33.103309 | node1 |
2026-08-18 13:31:33.103315 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:31:33.103321 | node1 | Tuesday 18 August 2026  13:31:33 +0000 (0:00:00.556)       0:03:51.232 ********
2026-08-18 13:31:33.541177 | node1 | ok: [node1]
2026-08-18 13:31:33.541269 | node1 | ok: [node3]
2026-08-18 13:31:33.541312 | node1 | ok: [node2]
2026-08-18 13:31:33.541629 | node1 |
2026-08-18 13:31:33.541671 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:31:33.541676 | node1 | Tuesday 18 August 2026  13:31:33 +0000 (0:00:00.439)       0:03:51.672 ********
2026-08-18 13:31:34.029400 | node1 | ok: [node1]
2026-08-18 13:31:34.029459 | node1 | ok: [node2]
2026-08-18 13:31:34.030569 | node1 | ok: [node3]
2026-08-18 13:31:34.030615 | node1 |
2026-08-18 13:31:34.030620 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:31:34.030625 | node1 | Tuesday 18 August 2026  13:31:33 +0000 (0:00:00.433)       0:03:52.105 ********
2026-08-18 13:31:34.030629 | node1 |
2026-08-18 13:31:34.030633 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:31:34.030637 | node1 | Tuesday 18 August 2026  13:31:33 +0000 (0:00:00.007)       0:03:52.113 ********
2026-08-18 13:31:34.030641 | node1 |
2026-08-18 13:31:34.030645 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:31:34.030649 | node1 | Tuesday 18 August 2026  13:31:33 +0000 (0:00:00.005)       0:03:52.118 ********
2026-08-18 13:31:34.030653 | node1 |
2026-08-18 13:31:34.030657 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:31:34.030661 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.041)       0:03:52.160 ********
2026-08-18 13:31:34.392843 | node1 | ok: [node2]
2026-08-18 13:31:34.392905 | node1 | ok: [node1]
2026-08-18 13:31:34.393001 | node1 | ok: [node3]
2026-08-18 13:31:34.393295 | node1 |
2026-08-18 13:31:34.393363 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:31:34.393381 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.363)       0:03:52.523 ********
2026-08-18 13:31:34.449518 | node1 | ok: [node1] => {
2026-08-18 13:31:34.449609 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:31:34.449696 | node1 | }
2026-08-18 13:31:34.450487 | node1 | ok: [node2] => {
2026-08-18 13:31:34.450525 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:31:34.450531 | node1 | }
2026-08-18 13:31:34.450536 | node1 | ok: [node3] => {
2026-08-18 13:31:34.450540 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:31:34.450544 | node1 | }
2026-08-18 13:31:34.450548 | node1 |
2026-08-18 13:31:34.450552 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:31:34.450557 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.057)       0:03:52.580 ********
2026-08-18 13:31:34.752847 | node1 | ok: [node1]
2026-08-18 13:31:34.752926 | node1 | ok: [node3]
2026-08-18 13:31:34.753274 | node1 | ok: [node2]
2026-08-18 13:31:34.753354 | node1 |
2026-08-18 13:31:34.753665 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:31:34.753713 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.302)       0:03:52.883 ********
2026-08-18 13:31:34.822896 | node1 | skipping: [node1]
2026-08-18 13:31:34.822947 | node1 | skipping: [node2]
2026-08-18 13:31:34.823338 | node1 | skipping: [node3]
2026-08-18 13:31:34.823381 | node1 |
2026-08-18 13:31:34.823387 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:31:34.823392 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.070)       0:03:52.954 ********
2026-08-18 13:31:34.896922 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:31:34.897293 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:31:34.897350 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:31:34.897367 | node1 |
2026-08-18 13:31:34.897510 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:31:34.897527 | node1 | Tuesday 18 August 2026  13:31:34 +0000 (0:00:00.073)       0:03:53.027 ********
2026-08-18 13:31:36.063427 | node1 | ok: [node1]
2026-08-18 13:31:36.063509 | node1 | ok: [node3]
2026-08-18 13:31:36.063543 | node1 | ok: [node2]
2026-08-18 13:31:36.063846 | node1 |
2026-08-18 13:31:36.063892 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:31:36.063898 | node1 | Tuesday 18 August 2026  13:31:36 +0000 (0:00:01.166)       0:03:54.194 ********
2026-08-18 13:31:36.719933 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:31:36.719976 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:31:36.719981 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:31:36.719985 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:31:36.719989 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:31:36.719993 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:31:36.719997 | node1 |
2026-08-18 13:31:36.720001 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:31:36.720006 | node1 | Tuesday 18 August 2026  13:31:36 +0000 (0:00:00.656)       0:03:54.850 ********
2026-08-18 13:31:36.927697 | node1 | ok: [node1]
2026-08-18 13:31:36.927740 | node1 | ok: [node2]
2026-08-18 13:31:36.927745 | node1 | ok: [node3]
2026-08-18 13:31:36.927750 | node1 |
2026-08-18 13:31:36.927754 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:31:36.927759 | node1 | Tuesday 18 August 2026  13:31:36 +0000 (0:00:00.208)       0:03:55.058 ********
2026-08-18 13:31:37.207645 | node1 | ok: [node2]
2026-08-18 13:31:37.207709 | node1 | ok: [node1]
2026-08-18 13:31:37.207766 | node1 | ok: [node3]
2026-08-18 13:31:37.208071 | node1 |
2026-08-18 13:31:37.208108 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:31:37.208114 | node1 | Tuesday 18 August 2026  13:31:37 +0000 (0:00:00.280)       0:03:55.338 ********
2026-08-18 13:31:37.657099 | node1 | ok: [node1]
2026-08-18 13:31:37.657206 | node1 | ok: [node3]
2026-08-18 13:31:37.657654 | node1 | ok: [node2]
2026-08-18 13:31:37.657728 | node1 |
2026-08-18 13:31:37.657734 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:31:37.657740 | node1 | Tuesday 18 August 2026  13:31:37 +0000 (0:00:00.449)       0:03:55.787 ********
2026-08-18 13:31:37.692483 | node1 | skipping: [node1]
2026-08-18 13:31:37.722165 | node1 | skipping: [node2]
2026-08-18 13:31:37.722222 | node1 | skipping: [node3]
2026-08-18 13:31:37.722226 | node1 |
2026-08-18 13:31:37.722232 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:31:37.722237 | node1 | Tuesday 18 August 2026  13:31:37 +0000 (0:00:00.064)       0:03:55.852 ********
2026-08-18 13:31:38.113228 | node1 | ok: [node3]
2026-08-18 13:31:38.113322 | node1 | ok: [node1]
2026-08-18 13:31:38.113335 | node1 | ok: [node2]
2026-08-18 13:31:38.113635 | node1 |
2026-08-18 13:31:38.113656 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:31:38.113663 | node1 | Tuesday 18 August 2026  13:31:38 +0000 (0:00:00.391)       0:03:56.243 ********
2026-08-18 13:31:38.572977 | node1 | ok: [node1]
2026-08-18 13:31:38.573336 | node1 | ok: [node2]
2026-08-18 13:31:38.573352 | node1 | ok: [node3]
2026-08-18 13:31:38.573362 | node1 |
2026-08-18 13:31:38.573383 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] ***********************
2026-08-18 13:31:38.573397 | node1 | Tuesday 18 August 2026  13:31:38 +0000 (0:00:00.460)       0:03:56.704 ********
2026-08-18 13:31:39.145733 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:31:39.145888 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:31:39.145915 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:31:39.145927 | node1 |
2026-08-18 13:31:39.146001 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] *******
2026-08-18 13:31:39.146146 | node1 | Tuesday 18 August 2026  13:31:39 +0000 (0:00:00.572)       0:03:57.276 ********
2026-08-18 13:31:39.234725 | node1 | ok: [node1]
2026-08-18 13:31:39.234774 | node1 | ok: [node2]
2026-08-18 13:31:39.235168 | node1 | ok: [node3]
2026-08-18 13:31:39.235219 | node1 |
2026-08-18 13:31:39.235225 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] ***********************
2026-08-18 13:31:39.235231 | node1 | Tuesday 18 August 2026  13:31:39 +0000 (0:00:00.088)       0:03:57.365 ********
2026-08-18 13:31:39.317807 | node1 | ok: [node1]
2026-08-18 13:31:39.317858 | node1 | ok: [node2]
2026-08-18 13:31:39.317863 | node1 | ok: [node3]
2026-08-18 13:31:39.317868 | node1 |
2026-08-18 13:31:39.317873 | node1 | TASK [Register this OSD host] **************************************************
2026-08-18 13:31:39.317879 | node1 | Tuesday 18 August 2026  13:31:39 +0000 (0:00:00.082)       0:03:57.448 ********
2026-08-18 13:31:39.425615 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:31:39.429629 | node1 |
2026-08-18 13:31:39.429662 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:31:39.429677 | node1 | Tuesday 18 August 2026  13:31:39 +0000 (0:00:00.108)       0:03:57.556 ********
2026-08-18 13:31:40.934540 | node1 | ok: [node1]
2026-08-18 13:31:40.934648 | node1 |
2026-08-18 13:31:40.934656 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:31:40.934794 | node1 | Tuesday 18 August 2026  13:31:40 +0000 (0:00:01.508)       0:03:59.065 ********
2026-08-18 13:31:41.003722 | node1 | ok: [node1]
2026-08-18 13:31:41.003786 | node1 | ok: [node2]
2026-08-18 13:31:41.004178 | node1 | ok: [node3]
2026-08-18 13:31:41.004232 | node1 |
2026-08-18 13:31:41.004238 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:31:41.004244 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.069)       0:03:59.134 ********
2026-08-18 13:31:41.068426 | node1 | ok: [node1] => {
2026-08-18 13:31:41.069255 | node1 |     "changed": false,
2026-08-18 13:31:41.069325 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.069338 | node1 | }
2026-08-18 13:31:41.069348 | node1 | ok: [node2] => {
2026-08-18 13:31:41.069358 | node1 |     "changed": false,
2026-08-18 13:31:41.069366 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.069382 | node1 | }
2026-08-18 13:31:41.070259 | node1 | ok: [node3] => {
2026-08-18 13:31:41.070308 | node1 |     "changed": false,
2026-08-18 13:31:41.070323 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.070332 | node1 | }
2026-08-18 13:31:41.070339 | node1 |
2026-08-18 13:31:41.070346 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:31:41.070367 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.064)       0:03:59.199 ********
2026-08-18 13:31:41.353190 | node1 | ok: [node1]
2026-08-18 13:31:41.353894 | node1 | ok: [node2]
2026-08-18 13:31:41.353937 | node1 | ok: [node3]
2026-08-18 13:31:41.353943 | node1 |
2026-08-18 13:31:41.353949 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:31:41.353954 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.284)       0:03:59.483 ********
2026-08-18 13:31:41.422980 | node1 | ok: [node1]
2026-08-18 13:31:41.423662 | node1 | ok: [node2]
2026-08-18 13:31:41.423715 | node1 | ok: [node3]
2026-08-18 13:31:41.423722 | node1 |
2026-08-18 13:31:41.423729 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:31:41.423736 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.069)       0:03:59.553 ********
2026-08-18 13:31:41.523592 | node1 | ok: [node1]
2026-08-18 13:31:41.523652 | node1 | ok: [node2]
2026-08-18 13:31:41.524003 | node1 | ok: [node3]
2026-08-18 13:31:41.524037 | node1 |
2026-08-18 13:31:41.524042 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:31:41.524048 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.101)       0:03:59.654 ********
2026-08-18 13:31:41.586863 | node1 | ok: [node1] => {
2026-08-18 13:31:41.586962 | node1 |     "changed": false,
2026-08-18 13:31:41.588135 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.588181 | node1 | }
2026-08-18 13:31:41.588186 | node1 | ok: [node2] => {
2026-08-18 13:31:41.588191 | node1 |     "changed": false,
2026-08-18 13:31:41.588196 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.588200 | node1 | }
2026-08-18 13:31:41.588204 | node1 | ok: [node3] => {
2026-08-18 13:31:41.588208 | node1 |     "changed": false,
2026-08-18 13:31:41.588212 | node1 |     "msg": "All assertions passed"
2026-08-18 13:31:41.588216 | node1 | }
2026-08-18 13:31:41.588220 | node1 |
2026-08-18 13:31:41.588225 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:31:41.588230 | node1 | Tuesday 18 August 2026  13:31:41 +0000 (0:00:00.063)       0:03:59.718 ********
2026-08-18 13:31:43.175854 | node1 | ok: [node1]
2026-08-18 13:31:43.175935 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:43.176345 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:31:43.176360 | node1 |
2026-08-18 13:31:43.176366 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:31:43.176371 | node1 | Tuesday 18 August 2026  13:31:43 +0000 (0:00:01.588)       0:04:01.307 ********
2026-08-18 13:31:43.257886 | node1 | skipping: [node1]
2026-08-18 13:31:43.257938 | node1 | skipping: [node2]
2026-08-18 13:31:43.258041 | node1 | skipping: [node3]
2026-08-18 13:31:43.258319 | node1 |
2026-08-18 13:31:43.258335 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] **************
2026-08-18 13:31:43.258340 | node1 | Tuesday 18 August 2026  13:31:43 +0000 (0:00:00.082)       0:04:01.389 ********
2026-08-18 13:31:43.283080 | node1 | skipping: [node1]
2026-08-18 13:31:43.283216 | node1 |
2026-08-18 13:31:43.283363 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] *********
2026-08-18 13:31:43.283520 | node1 | Tuesday 18 August 2026  13:31:43 +0000 (0:00:00.025)       0:04:01.414 ********
2026-08-18 13:31:44.552185 | node1 | ok: [node3]
2026-08-18 13:31:44.552266 | node1 | ok: [node1]
2026-08-18 13:31:44.552333 | node1 | ok: [node2]
2026-08-18 13:31:44.552618 | node1 |
2026-08-18 13:31:44.552661 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ********
2026-08-18 13:31:44.552667 | node1 | Tuesday 18 August 2026  13:31:44 +0000 (0:00:01.269)       0:04:02.683 ********
2026-08-18 13:35:37.191359 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data)
2026-08-18 13:35:37.191470 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data)
2026-08-18 13:35:37.191483 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data)
2026-08-18 13:35:37.191493 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data)
2026-08-18 13:35:37.191521 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data)
2026-08-18 13:35:37.191530 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data)
2026-08-18 13:35:37.191539 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data)
2026-08-18 13:35:37.191548 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data)
2026-08-18 13:35:37.191557 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data)
2026-08-18 13:35:37.191566 | node1 |
2026-08-18 13:35:37.191576 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] ***
2026-08-18 13:35:37.191585 | node1 | Tuesday 18 August 2026  13:35:37 +0000 (0:03:52.637)       0:07:55.320 ********
2026-08-18 13:35:58.306392 | node1 | ok: [node1]
2026-08-18 13:35:58.306472 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 13:35:58.306603 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 13:35:58.306695 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left).
2026-08-18 13:35:58.306791 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:35:58.306894 | node1 | FAILED - RETRYING: [node2 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (118 retries left).
2026-08-18 13:35:58.306976 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:35:58.307063 | node1 |
2026-08-18 13:35:58.307162 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] ***
2026-08-18 13:35:58.307254 | node1 | Tuesday 18 August 2026  13:35:58 +0000 (0:00:21.116)       0:08:16.437 ********
2026-08-18 13:35:58.375351 | node1 | skipping: [node1]
2026-08-18 13:35:58.375394 | node1 |
2026-08-18 13:35:58.375499 | node1 | PLAY [Apply Ceph configuration] ************************************************
2026-08-18 13:35:58.375574 | node1 |
2026-08-18 13:35:58.375671 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:35:58.375763 | node1 | Tuesday 18 August 2026  13:35:58 +0000 (0:00:00.069)       0:08:16.506 ********
2026-08-18 13:35:59.461415 | node1 | ok: [node1]
2026-08-18 13:35:59.461597 | node1 | ok: [node2]
2026-08-18 13:35:59.461661 | node1 | ok: [node3]
2026-08-18 13:35:59.461704 | node1 |
2026-08-18 13:35:59.461946 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] *****************
2026-08-18 13:35:59.461995 | node1 | Tuesday 18 August 2026  13:35:59 +0000 (0:00:01.085)       0:08:17.592 ********
2026-08-18 13:36:00.042011 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:36:00.042140 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:36:00.042700 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:36:00.042752 | node1 |
2026-08-18 13:36:00.042760 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] *************************
2026-08-18 13:36:00.042774 | node1 | Tuesday 18 August 2026  13:36:00 +0000 (0:00:00.580)       0:08:18.172 ********
2026-08-18 13:36:00.105086 | node1 | ok: [node1]
2026-08-18 13:36:00.105182 | node1 | ok: [node2]
2026-08-18 13:36:00.105705 | node1 | ok: [node3]
2026-08-18 13:36:00.105757 | node1 |
2026-08-18 13:36:00.105765 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] *****************
2026-08-18 13:36:00.105772 | node1 | Tuesday 18 August 2026  13:36:00 +0000 (0:00:00.063)       0:08:18.235 ********
2026-08-18 13:36:00.160407 | node1 | ok: [node1]
2026-08-18 13:36:00.161057 | node1 | ok: [node2]
2026-08-18 13:36:00.161135 | node1 | ok: [node3]
2026-08-18 13:36:00.161143 | node1 |
2026-08-18 13:36:00.161149 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:36:00.161156 | node1 | Tuesday 18 August 2026  13:36:00 +0000 (0:00:00.055)       0:08:18.291 ********
2026-08-18 13:36:00.232780 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3
2026-08-18 13:36:00.232848 | node1 |
2026-08-18 13:36:00.233174 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:36:00.233224 | node1 | Tuesday 18 August 2026  13:36:00 +0000 (0:00:00.072)       0:08:18.363 ********
2026-08-18 13:36:17.457510 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour)
2026-08-18 13:36:17.457605 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY)
2026-08-18 13:36:17.457621 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS)
2026-08-18 13:36:17.458211 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI)
2026-08-18 13:36:17.458256 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING)
2026-08-18 13:36:17.458262 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS)
2026-08-18 13:36:17.458267 | node1 |
2026-08-18 13:36:17.458271 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:36:17.458276 | node1 | Tuesday 18 August 2026  13:36:17 +0000 (0:00:17.224)       0:08:35.588 ********
2026-08-18 13:36:17.533187 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3
2026-08-18 13:36:17.533270 | node1 |
2026-08-18 13:36:17.533475 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:36:17.533524 | node1 | Tuesday 18 August 2026  13:36:17 +0000 (0:00:00.076)       0:08:35.664 ********
2026-08-18 13:36:21.467919 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 13:36:21.468000 | node1 |
2026-08-18 13:36:21.468009 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:36:21.468016 | node1 | Tuesday 18 August 2026  13:36:21 +0000 (0:00:03.934)       0:08:39.598 ********
2026-08-18 13:36:21.570261 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3
2026-08-18 13:36:21.570318 | node1 |
2026-08-18 13:36:21.570325 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:36:21.570331 | node1 | Tuesday 18 August 2026  13:36:21 +0000 (0:00:00.098)       0:08:39.696 ********
2026-08-18 13:36:31.359637 | node1 | changed: [node1] => (item=rep_hdd)
2026-08-18 13:36:31.359711 | node1 | changed: [node1] => (item=rep_lab)
2026-08-18 13:36:31.360132 | node1 | changed: [node1] => (item=ec_hdd_s3)
2026-08-18 13:36:31.360181 | node1 |
2026-08-18 13:36:31.360186 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:36:31.360192 | node1 | Tuesday 18 August 2026  13:36:31 +0000 (0:00:09.793)       0:08:49.490 ********
2026-08-18 13:36:31.429603 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3
2026-08-18 13:36:31.429677 | node1 |
2026-08-18 13:36:31.429714 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:36:31.429819 | node1 | Tuesday 18 August 2026  13:36:31 +0000 (0:00:00.070)       0:08:49.560 ********
2026-08-18 13:37:02.101732 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data)
2026-08-18 13:37:02.101815 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index)
2026-08-18 13:37:02.101827 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec)
2026-08-18 13:37:02.101836 | node1 | changed: [node1] => (item=molecule-1.rgw.control)
2026-08-18 13:37:02.101848 | node1 | changed: [node1] => (item=molecule-1.rgw.log)
2026-08-18 13:37:02.102726 | node1 | changed: [node1] => (item=molecule-1.rgw.meta)
2026-08-18 13:37:02.102801 | node1 |
2026-08-18 13:37:02.102812 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] **************************
2026-08-18 13:37:02.102823 | node1 | Tuesday 18 August 2026  13:37:02 +0000 (0:00:30.670)       0:09:20.230 ********
2026-08-18 13:37:02.156467 | node1 | skipping: [node1]
2026-08-18 13:37:02.156553 | node1 | skipping: [node2]
2026-08-18 13:37:02.156937 | node1 | skipping: [node3]
2026-08-18 13:37:02.156984 | node1 |
2026-08-18 13:37:02.156990 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] **********
2026-08-18 13:37:02.157006 | node1 | Tuesday 18 August 2026  13:37:02 +0000 (0:00:00.056)       0:09:20.287 ********
2026-08-18 13:37:02.225886 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3
2026-08-18 13:37:02.225949 | node1 |
2026-08-18 13:37:02.226153 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] ***
2026-08-18 13:37:02.226189 | node1 | Tuesday 18 August 2026  13:37:02 +0000 (0:00:00.069)       0:09:20.357 ********
2026-08-18 13:37:03.777347 | node1 | ok: [node1]
2026-08-18 13:37:03.777419 | node1 |
2026-08-18 13:37:03.777631 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] *********
2026-08-18 13:37:03.777674 | node1 | Tuesday 18 August 2026  13:37:03 +0000 (0:00:01.551)       0:09:21.908 ********
2026-08-18 13:37:05.355116 | node1 | ok: [node1]
2026-08-18 13:37:05.355176 | node1 |
2026-08-18 13:37:05.355184 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] *****************
2026-08-18 13:37:05.355191 | node1 | Tuesday 18 August 2026  13:37:05 +0000 (0:00:01.577)       0:09:23.485 ********
2026-08-18 13:37:05.383807 | node1 | skipping: [node1]
2026-08-18 13:37:05.383869 | node1 |
2026-08-18 13:37:05.384170 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] *************
2026-08-18 13:37:05.384193 | node1 | Tuesday 18 August 2026  13:37:05 +0000 (0:00:00.029)       0:09:23.514 ********
2026-08-18 13:37:05.416862 | node1 | skipping: [node1]
2026-08-18 13:37:05.417044 | node1 |
2026-08-18 13:37:05.417358 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:37:05.418518 | node1 | Tuesday 18 August 2026  13:37:05 +0000 (0:00:00.032)       0:09:23.547 ********
2026-08-18 13:37:05.454823 | node1 | skipping: [node1]
2026-08-18 13:37:05.455000 | node1 |
2026-08-18 13:37:05.455222 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] **************
2026-08-18 13:37:05.455433 | node1 | Tuesday 18 August 2026  13:37:05 +0000 (0:00:00.038)       0:09:23.585 ********
2026-08-18 13:37:07.188196 | node1 | changed: [node1]
2026-08-18 13:37:07.188378 | node1 |
2026-08-18 13:37:07.188664 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:37:07.188893 | node1 | Tuesday 18 August 2026  13:37:07 +0000 (0:00:01.733)       0:09:25.319 ********
2026-08-18 13:37:07.236674 | node1 | ok: [node1]
2026-08-18 13:37:07.236782 | node1 |
2026-08-18 13:37:07.236915 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] ***
2026-08-18 13:37:07.237043 | node1 | Tuesday 18 August 2026  13:37:07 +0000 (0:00:00.048)       0:09:25.368 ********
2026-08-18 13:37:14.212345 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard)
2026-08-18 13:37:14.212420 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard)
2026-08-18 13:37:14.213249 | node1 | changed: [node1] => (item=ceph orch reconfig mgr)
2026-08-18 13:37:14.213311 | node1 |
2026-08-18 13:37:14.213322 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:37:14.213332 | node1 | Tuesday 18 August 2026  13:37:14 +0000 (0:00:06.975)       0:09:32.343 ********
2026-08-18 13:37:14.282166 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3
2026-08-18 13:37:14.282236 | node1 |
2026-08-18 13:37:14.282288 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:37:14.282403 | node1 | Tuesday 18 August 2026  13:37:14 +0000 (0:00:00.069)       0:09:32.413 ********
2026-08-18 13:37:23.187365 | node1 | changed: [node1] => (item=None)
2026-08-18 13:37:23.187427 | node1 | changed: [node1] => (item=None)
2026-08-18 13:37:23.187438 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}]
2026-08-18 13:37:23.187448 | node1 |
2026-08-18 13:37:23.187458 | node1 | PLAY [Deploy Ceph RADOS Gateways] **********************************************
2026-08-18 13:37:23.187467 | node1 |
2026-08-18 13:37:23.187476 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:37:23.187485 | node1 | Tuesday 18 August 2026  13:37:23 +0000 (0:00:08.903)       0:09:41.316 ********
2026-08-18 13:37:24.301188 | node1 | ok: [node1]
2026-08-18 13:37:24.301227 | node1 | ok: [node2]
2026-08-18 13:37:24.301232 | node1 | ok: [node3]
2026-08-18 13:37:24.301237 | node1 |
2026-08-18 13:37:24.301241 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:37:24.301246 | node1 | Tuesday 18 August 2026  13:37:24 +0000 (0:00:01.115)       0:09:42.431 ********
2026-08-18 13:37:24.530303 | node1 | ok: [node1]
2026-08-18 13:37:24.530343 | node1 | ok: [node2]
2026-08-18 13:37:24.530348 | node1 | ok: [node3]
2026-08-18 13:37:24.530352 | node1 |
2026-08-18 13:37:24.530357 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:37:24.530362 | node1 | Tuesday 18 August 2026  13:37:24 +0000 (0:00:00.229)       0:09:42.661 ********
2026-08-18 13:37:24.596132 | node1 | skipping: [node1]
2026-08-18 13:37:24.596645 | node1 | skipping: [node2]
2026-08-18 13:37:24.596657 | node1 | skipping: [node3]
2026-08-18 13:37:24.596661 | node1 |
2026-08-18 13:37:24.596666 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:37:24.596670 | node1 | Tuesday 18 August 2026  13:37:24 +0000 (0:00:00.066)       0:09:42.727 ********
2026-08-18 13:37:24.828359 | node1 | ok: [node1]
2026-08-18 13:37:24.828425 | node1 | ok: [node2]
2026-08-18 13:37:24.828436 | node1 | ok: [node3]
2026-08-18 13:37:24.828452 | node1 |
2026-08-18 13:37:24.828569 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:37:24.828702 | node1 | Tuesday 18 August 2026  13:37:24 +0000 (0:00:00.231)       0:09:42.959 ********
2026-08-18 13:37:24.911105 | node1 | ok: [node1] => {
2026-08-18 13:37:24.911230 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:37:24.911359 | node1 | }
2026-08-18 13:37:24.911486 | node1 | ok: [node2] => {
2026-08-18 13:37:24.911628 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:37:24.911745 | node1 | }
2026-08-18 13:37:24.911871 | node1 | ok: [node3] => {
2026-08-18 13:37:24.912005 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:37:24.912127 | node1 | }
2026-08-18 13:37:24.912277 | node1 |
2026-08-18 13:37:24.912404 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:37:24.912535 | node1 | Tuesday 18 August 2026  13:37:24 +0000 (0:00:00.082)       0:09:43.042 ********
2026-08-18 13:37:25.258641 | node1 | ok: [node1]
2026-08-18 13:37:25.258816 | node1 | ok: [node2]
2026-08-18 13:37:25.258971 | node1 | ok: [node3]
2026-08-18 13:37:25.259101 | node1 |
2026-08-18 13:37:25.259224 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:37:25.259371 | node1 | Tuesday 18 August 2026  13:37:25 +0000 (0:00:00.347)       0:09:43.389 ********
2026-08-18 13:37:25.360146 | node1 | skipping: [node1]
2026-08-18 13:37:25.360351 | node1 | skipping: [node2]
2026-08-18 13:37:25.360554 | node1 | skipping: [node3]
2026-08-18 13:37:25.360747 | node1 |
2026-08-18 13:37:25.360980 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:37:25.361256 | node1 | Tuesday 18 August 2026  13:37:25 +0000 (0:00:00.101)       0:09:43.491 ********
2026-08-18 13:37:25.453273 | node1 | skipping: [node1]
2026-08-18 13:37:25.453458 | node1 | skipping: [node2]
2026-08-18 13:37:25.453815 | node1 | skipping: [node3]
2026-08-18 13:37:25.453842 | node1 |
2026-08-18 13:37:25.454044 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:37:25.454263 | node1 | Tuesday 18 August 2026  13:37:25 +0000 (0:00:00.093)       0:09:43.584 ********
2026-08-18 13:37:25.691532 | node1 | ok: [node1]
2026-08-18 13:37:25.691742 | node1 | ok: [node3]
2026-08-18 13:37:25.691979 | node1 | ok: [node2]
2026-08-18 13:37:25.692173 | node1 |
2026-08-18 13:37:25.692393 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:37:25.692601 | node1 | Tuesday 18 August 2026  13:37:25 +0000 (0:00:00.238)       0:09:43.822 ********
2026-08-18 13:37:26.825413 | node1 | ok: [node3]
2026-08-18 13:37:26.825570 | node1 | ok: [node2]
2026-08-18 13:37:26.825780 | node1 | ok: [node1]
2026-08-18 13:37:26.825960 | node1 |
2026-08-18 13:37:26.826175 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:37:26.826390 | node1 | Tuesday 18 August 2026  13:37:26 +0000 (0:00:01.133)       0:09:44.956 ********
2026-08-18 13:37:26.909209 | node1 | ok: [node1] => {
2026-08-18 13:37:26.909269 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:37:26.909282 | node1 | }
2026-08-18 13:37:26.909292 | node1 | ok: [node2] => {
2026-08-18 13:37:26.909302 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:37:26.909312 | node1 | }
2026-08-18 13:37:26.909321 | node1 | ok: [node3] => {
2026-08-18 13:37:26.909337 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:37:26.909379 | node1 | }
2026-08-18 13:37:26.909498 | node1 |
2026-08-18 13:37:26.909629 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:37:26.909761 | node1 | Tuesday 18 August 2026  13:37:26 +0000 (0:00:00.083)       0:09:45.039 ********
2026-08-18 13:37:27.294115 | node1 | ok: [node1]
2026-08-18 13:37:27.294317 | node1 | ok: [node2]
2026-08-18 13:37:27.294528 | node1 | ok: [node3]
2026-08-18 13:37:27.294727 | node1 |
2026-08-18 13:37:27.294951 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:37:27.295169 | node1 | Tuesday 18 August 2026  13:37:27 +0000 (0:00:00.385)       0:09:45.424 ********
2026-08-18 13:37:29.317814 | node1 | ok: [node3]
2026-08-18 13:37:29.317983 | node1 | ok: [node1]
2026-08-18 13:37:29.318193 | node1 | ok: [node2]
2026-08-18 13:37:29.318413 | node1 |
2026-08-18 13:37:29.318840 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:37:29.318920 | node1 | Tuesday 18 August 2026  13:37:29 +0000 (0:00:02.023)       0:09:47.448 ********
2026-08-18 13:37:29.369278 | node1 | skipping: [node1]
2026-08-18 13:37:29.369448 | node1 | skipping: [node2]
2026-08-18 13:37:29.369644 | node1 | skipping: [node3]
2026-08-18 13:37:29.369833 | node1 |
2026-08-18 13:37:29.370047 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:37:29.370252 | node1 | Tuesday 18 August 2026  13:37:29 +0000 (0:00:00.051)       0:09:47.500 ********
2026-08-18 13:37:29.417805 | node1 | skipping: [node1]
2026-08-18 13:37:29.417957 | node1 | skipping: [node2]
2026-08-18 13:37:29.418245 | node1 | skipping: [node3]
2026-08-18 13:37:29.418347 | node1 |
2026-08-18 13:37:29.418641 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:37:29.418877 | node1 | Tuesday 18 August 2026  13:37:29 +0000 (0:00:00.048)       0:09:47.548 ********
2026-08-18 13:37:29.469738 | node1 | skipping: [node1]
2026-08-18 13:37:29.469944 | node1 | skipping: [node2]
2026-08-18 13:37:29.470145 | node1 | skipping: [node3]
2026-08-18 13:37:29.470331 | node1 |
2026-08-18 13:37:29.470590 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:37:29.470809 | node1 | Tuesday 18 August 2026  13:37:29 +0000 (0:00:00.052)       0:09:47.600 ********
2026-08-18 13:37:30.525510 | node1 | ok: [node1]
2026-08-18 13:37:30.525953 | node1 | ok: [node2]
2026-08-18 13:37:30.526015 | node1 | ok: [node3]
2026-08-18 13:37:30.526354 | node1 |
2026-08-18 13:37:30.526424 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:37:30.526693 | node1 | Tuesday 18 August 2026  13:37:30 +0000 (0:00:01.055)       0:09:48.656 ********
2026-08-18 13:37:30.968437 | node1 | ok: [node1]
2026-08-18 13:37:30.968510 | node1 | ok: [node2]
2026-08-18 13:37:30.968876 | node1 | ok: [node3]
2026-08-18 13:37:30.968915 | node1 |
2026-08-18 13:37:30.968920 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:37:30.968926 | node1 | Tuesday 18 August 2026  13:37:30 +0000 (0:00:00.443)       0:09:49.099 ********
2026-08-18 13:37:31.887163 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:37:31.887228 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:37:31.887327 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:37:31.887420 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:37:31.887515 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:37:31.887608 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:37:31.887702 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:37:31.887795 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:37:31.887888 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:37:31.887986 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:37:31.888084 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:37:31.888181 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:37:31.888277 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:37:31.888375 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:37:31.888472 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:37:31.888562 | node1 |
2026-08-18 13:37:31.888658 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:37:31.888749 | node1 | Tuesday 18 August 2026  13:37:31 +0000 (0:00:00.918)       0:09:50.018 ********
2026-08-18 13:37:32.429449 | node1 | ok: [node1]
2026-08-18 13:37:32.429526 | node1 | ok: [node3]
2026-08-18 13:37:32.429682 | node1 | ok: [node2]
2026-08-18 13:37:32.429806 | node1 |
2026-08-18 13:37:32.429947 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:37:32.430084 | node1 | Tuesday 18 August 2026  13:37:32 +0000 (0:00:00.523)       0:09:50.541 ********
2026-08-18 13:37:32.430207 | node1 |
2026-08-18 13:37:32.430331 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:37:32.430465 | node1 | Tuesday 18 August 2026  13:37:32 +0000 (0:00:00.007)       0:09:50.549 ********
2026-08-18 13:37:32.430582 | node1 |
2026-08-18 13:37:32.430712 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:37:32.430842 | node1 | Tuesday 18 August 2026  13:37:32 +0000 (0:00:00.005)       0:09:50.554 ********
2026-08-18 13:37:32.430958 | node1 |
2026-08-18 13:37:32.431088 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:37:32.431216 | node1 | Tuesday 18 August 2026  13:37:32 +0000 (0:00:00.005)       0:09:50.560 ********
2026-08-18 13:37:32.818857 | node1 | ok: [node1]
2026-08-18 13:37:32.818931 | node1 | ok: [node3]
2026-08-18 13:37:32.818944 | node1 | ok: [node2]
2026-08-18 13:37:32.819052 | node1 |
2026-08-18 13:37:32.819148 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:37:32.819242 | node1 | Tuesday 18 August 2026  13:37:32 +0000 (0:00:00.389)       0:09:50.949 ********
2026-08-18 13:37:33.073026 | node1 | ok: [node2]
2026-08-18 13:37:33.073329 | node1 | ok: [node1]
2026-08-18 13:37:33.073534 | node1 | ok: [node3]
2026-08-18 13:37:33.073719 | node1 |
2026-08-18 13:37:33.073931 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:37:33.074165 | node1 | Tuesday 18 August 2026  13:37:33 +0000 (0:00:00.253)       0:09:51.203 ********
2026-08-18 13:37:33.154963 | node1 | ok: [node1] => {
2026-08-18 13:37:33.155142 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:37:33.155268 | node1 | }
2026-08-18 13:37:33.155367 | node1 | ok: [node2] => {
2026-08-18 13:37:33.155488 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:37:33.155571 | node1 | }
2026-08-18 13:37:33.155687 | node1 | ok: [node3] => {
2026-08-18 13:37:33.155782 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:37:33.155868 | node1 | }
2026-08-18 13:37:33.155951 | node1 |
2026-08-18 13:37:33.156071 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:37:33.156177 | node1 | Tuesday 18 August 2026  13:37:33 +0000 (0:00:00.082)       0:09:51.286 ********
2026-08-18 13:37:33.536969 | node1 | ok: [node1]
2026-08-18 13:37:33.537047 | node1 | ok: [node3]
2026-08-18 13:37:33.537207 | node1 | ok: [node2]
2026-08-18 13:37:33.537332 | node1 |
2026-08-18 13:37:33.537470 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:37:33.537638 | node1 | Tuesday 18 August 2026  13:37:33 +0000 (0:00:00.381)       0:09:51.667 ********
2026-08-18 13:37:36.637177 | node1 | ok: [node1]
2026-08-18 13:37:36.637336 | node1 | ok: [node3]
2026-08-18 13:37:36.637532 | node1 | ok: [node2]
2026-08-18 13:37:36.637717 | node1 |
2026-08-18 13:37:36.637932 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:37:36.638528 | node1 | Tuesday 18 August 2026  13:37:36 +0000 (0:00:03.100)       0:09:54.768 ********
2026-08-18 13:37:37.774405 | node1 | ok: [node2]
2026-08-18 13:37:37.774562 | node1 | ok: [node1]
2026-08-18 13:37:37.774754 | node1 | ok: [node3]
2026-08-18 13:37:37.774939 | node1 |
2026-08-18 13:37:37.775154 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:37:37.775454 | node1 | Tuesday 18 August 2026  13:37:37 +0000 (0:00:01.136)       0:09:55.904 ********
2026-08-18 13:37:37.982627 | node1 | ok: [node1]
2026-08-18 13:37:37.982786 | node1 | ok: [node2]
2026-08-18 13:37:37.982987 | node1 | ok: [node3]
2026-08-18 13:37:37.983210 | node1 |
2026-08-18 13:37:37.983428 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:37:37.983631 | node1 | Tuesday 18 August 2026  13:37:37 +0000 (0:00:00.208)       0:09:56.113 ********
2026-08-18 13:37:38.437758 | node1 | ok: [node1]
2026-08-18 13:37:38.437940 | node1 | ok: [node2]
2026-08-18 13:37:38.438148 | node1 | ok: [node3]
2026-08-18 13:37:38.438337 | node1 |
2026-08-18 13:37:38.438551 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:37:38.438754 | node1 | Tuesday 18 August 2026  13:37:38 +0000 (0:00:00.455)       0:09:56.568 ********
2026-08-18 13:37:38.995777 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:37:38.995841 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:37:38.995852 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:37:38.995862 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:37:38.995873 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:37:38.995882 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:37:38.995891 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:37:38.995900 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:37:38.995909 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:37:38.995925 | node1 |
2026-08-18 13:37:38.995935 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:37:38.995945 | node1 | Tuesday 18 August 2026  13:37:38 +0000 (0:00:00.556)       0:09:57.124 ********
2026-08-18 13:37:39.435889 | node1 | ok: [node1]
2026-08-18 13:37:39.435948 | node1 | ok: [node2]
2026-08-18 13:37:39.436045 | node1 | ok: [node3]
2026-08-18 13:37:39.436360 | node1 |
2026-08-18 13:37:39.436402 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:37:39.436408 | node1 | Tuesday 18 August 2026  13:37:39 +0000 (0:00:00.442)       0:09:57.567 ********
2026-08-18 13:37:39.935182 | node1 | ok: [node1]
2026-08-18 13:37:39.935248 | node1 | ok: [node2]
2026-08-18 13:37:39.935327 | node1 | ok: [node3]
2026-08-18 13:37:39.936400 | node1 |
2026-08-18 13:37:39.936446 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:37:39.936452 | node1 | Tuesday 18 August 2026  13:37:39 +0000 (0:00:00.478)       0:09:58.046 ********
2026-08-18 13:37:39.936456 | node1 |
2026-08-18 13:37:39.936460 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:37:39.936464 | node1 | Tuesday 18 August 2026  13:37:39 +0000 (0:00:00.006)       0:09:58.052 ********
2026-08-18 13:37:39.936468 | node1 |
2026-08-18 13:37:39.936472 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:37:39.936487 | node1 | Tuesday 18 August 2026  13:37:39 +0000 (0:00:00.005)       0:09:58.058 ********
2026-08-18 13:37:39.936491 | node1 |
2026-08-18 13:37:39.936495 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:37:39.936499 | node1 | Tuesday 18 August 2026  13:37:39 +0000 (0:00:00.008)       0:09:58.066 ********
2026-08-18 13:37:40.323444 | node1 | ok: [node1]
2026-08-18 13:37:40.323522 | node1 | ok: [node2]
2026-08-18 13:37:40.323584 | node1 | ok: [node3]
2026-08-18 13:37:40.323881 | node1 |
2026-08-18 13:37:40.323924 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:37:40.323930 | node1 | Tuesday 18 August 2026  13:37:40 +0000 (0:00:00.388)       0:09:58.454 ********
2026-08-18 13:37:40.385224 | node1 | ok: [node1] => {
2026-08-18 13:37:40.385325 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:37:40.386085 | node1 | }
2026-08-18 13:37:40.386124 | node1 | ok: [node2] => {
2026-08-18 13:37:40.386144 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:37:40.386153 | node1 | }
2026-08-18 13:37:40.386162 | node1 | ok: [node3] => {
2026-08-18 13:37:40.386170 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:37:40.386182 | node1 | }
2026-08-18 13:37:40.386611 | node1 |
2026-08-18 13:37:40.386662 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:37:40.386670 | node1 | Tuesday 18 August 2026  13:37:40 +0000 (0:00:00.061)       0:09:58.516 ********
2026-08-18 13:37:40.691333 | node1 | ok: [node1]
2026-08-18 13:37:40.691405 | node1 | ok: [node2]
2026-08-18 13:37:40.691468 | node1 | ok: [node3]
2026-08-18 13:37:40.691766 | node1 |
2026-08-18 13:37:40.691813 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:37:40.691819 | node1 | Tuesday 18 August 2026  13:37:40 +0000 (0:00:00.306)       0:09:58.822 ********
2026-08-18 13:37:40.755192 | node1 | skipping: [node1]
2026-08-18 13:37:40.755247 | node1 | skipping: [node2]
2026-08-18 13:37:40.755628 | node1 | skipping: [node3]
2026-08-18 13:37:40.755673 | node1 |
2026-08-18 13:37:40.755680 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:37:40.755686 | node1 | Tuesday 18 August 2026  13:37:40 +0000 (0:00:00.063)       0:09:58.886 ********
2026-08-18 13:37:40.830031 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:37:40.830103 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:37:40.830587 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:37:40.830636 | node1 |
2026-08-18 13:37:40.830644 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:37:40.830651 | node1 | Tuesday 18 August 2026  13:37:40 +0000 (0:00:00.074)       0:09:58.960 ********
2026-08-18 13:37:42.123596 | node1 | ok: [node1]
2026-08-18 13:37:42.123903 | node1 | ok: [node2]
2026-08-18 13:37:42.123920 | node1 | ok: [node3]
2026-08-18 13:37:42.124443 | node1 |
2026-08-18 13:37:42.124471 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:37:42.124481 | node1 | Tuesday 18 August 2026  13:37:42 +0000 (0:00:01.293)       0:10:00.254 ********
2026-08-18 13:37:42.793583 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:37:42.793650 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:37:42.794270 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:37:42.794313 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:37:42.794318 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:37:42.794322 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:37:42.794327 | node1 |
2026-08-18 13:37:42.794331 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:37:42.794337 | node1 | Tuesday 18 August 2026  13:37:42 +0000 (0:00:00.670)       0:10:00.924 ********
2026-08-18 13:37:43.014893 | node1 | ok: [node1]
2026-08-18 13:37:43.015048 | node1 | ok: [node2]
2026-08-18 13:37:43.015147 | node1 | ok: [node3]
2026-08-18 13:37:43.015236 | node1 |
2026-08-18 13:37:43.015333 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:37:43.015428 | node1 | Tuesday 18 August 2026  13:37:43 +0000 (0:00:00.221)       0:10:01.146 ********
2026-08-18 13:37:43.293406 | node1 | ok: [node1]
2026-08-18 13:37:43.293590 | node1 | ok: [node2]
2026-08-18 13:37:43.293791 | node1 | ok: [node3]
2026-08-18 13:37:43.293980 | node1 |
2026-08-18 13:37:43.294206 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:37:43.294416 | node1 | Tuesday 18 August 2026  13:37:43 +0000 (0:00:00.278)       0:10:01.424 ********
2026-08-18 13:37:43.746049 | node1 | ok: [node1]
2026-08-18 13:37:43.746225 | node1 | ok: [node3]
2026-08-18 13:37:43.746432 | node1 | ok: [node2]
2026-08-18 13:37:43.746626 | node1 |
2026-08-18 13:37:43.746845 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:37:43.747055 | node1 | Tuesday 18 August 2026  13:37:43 +0000 (0:00:00.452)       0:10:01.876 ********
2026-08-18 13:37:43.794686 | node1 | skipping: [node1]
2026-08-18 13:37:43.794928 | node1 | skipping: [node2]
2026-08-18 13:37:43.795168 | node1 | skipping: [node3]
2026-08-18 13:37:43.795364 | node1 |
2026-08-18 13:37:43.795589 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:37:43.795830 | node1 | Tuesday 18 August 2026  13:37:43 +0000 (0:00:00.049)       0:10:01.925 ********
2026-08-18 13:37:44.181401 | node1 | ok: [node1]
2026-08-18 13:37:44.181604 | node1 | ok: [node2]
2026-08-18 13:37:44.181827 | node1 | ok: [node3]
2026-08-18 13:37:44.182010 | node1 |
2026-08-18 13:37:44.182229 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:37:44.182431 | node1 | Tuesday 18 August 2026  13:37:44 +0000 (0:00:00.386)       0:10:02.312 ********
2026-08-18 13:37:44.646839 | node1 | ok: [node1]
2026-08-18 13:37:44.646906 | node1 | ok: [node2]
2026-08-18 13:37:44.646961 | node1 | ok: [node3]
2026-08-18 13:37:44.647038 | node1 |
2026-08-18 13:37:44.647138 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] ***********************
2026-08-18 13:37:44.647240 | node1 | Tuesday 18 August 2026  13:37:44 +0000 (0:00:00.465)       0:10:02.778 ********
2026-08-18 13:37:45.257617 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:37:45.257814 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:37:45.258014 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:37:45.258276 | node1 |
2026-08-18 13:37:45.258485 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] *******************************
2026-08-18 13:37:45.258685 | node1 | Tuesday 18 August 2026  13:37:45 +0000 (0:00:00.610)       0:10:03.388 ********
2026-08-18 13:37:45.330263 | node1 | ok: [node1]
2026-08-18 13:37:45.330430 | node1 | ok: [node2]
2026-08-18 13:37:45.330621 | node1 | ok: [node3]
2026-08-18 13:37:45.330802 | node1 |
2026-08-18 13:37:45.331004 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] ***********************
2026-08-18 13:37:45.331207 | node1 | Tuesday 18 August 2026  13:37:45 +0000 (0:00:00.073)       0:10:03.461 ********
2026-08-18 13:37:45.409789 | node1 | ok: [node1]
2026-08-18 13:37:45.410010 | node1 | ok: [node2]
2026-08-18 13:37:45.410239 | node1 | ok: [node3]
2026-08-18 13:37:45.410448 | node1 |
2026-08-18 13:37:45.410688 | node1 | TASK [Register this RGW host] **************************************************
2026-08-18 13:37:45.410911 | node1 | Tuesday 18 August 2026  13:37:45 +0000 (0:00:00.079)       0:10:03.540 ********
2026-08-18 13:37:45.529364 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:37:45.529537 | node1 |
2026-08-18 13:37:45.529765 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:37:45.530003 | node1 | Tuesday 18 August 2026  13:37:45 +0000 (0:00:00.119)       0:10:03.660 ********
2026-08-18 13:37:47.090425 | node1 | ok: [node1]
2026-08-18 13:37:47.090701 | node1 |
2026-08-18 13:37:47.090997 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:37:47.091279 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:01.561)       0:10:05.221 ********
2026-08-18 13:37:47.153669 | node1 | ok: [node1]
2026-08-18 13:37:47.153861 | node1 | ok: [node2]
2026-08-18 13:37:47.154070 | node1 | ok: [node3]
2026-08-18 13:37:47.154300 | node1 |
2026-08-18 13:37:47.154576 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:37:47.154853 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.062)       0:10:05.284 ********
2026-08-18 13:37:47.213895 | node1 | ok: [node1] => {
2026-08-18 13:37:47.214160 | node1 |     "changed": false,
2026-08-18 13:37:47.214288 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.214523 | node1 | }
2026-08-18 13:37:47.214811 | node1 | ok: [node2] => {
2026-08-18 13:37:47.215054 | node1 |     "changed": false,
2026-08-18 13:37:47.215268 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.215578 | node1 | }
2026-08-18 13:37:47.215811 | node1 | ok: [node3] => {
2026-08-18 13:37:47.216019 | node1 |     "changed": false,
2026-08-18 13:37:47.216229 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.216423 | node1 | }
2026-08-18 13:37:47.216663 | node1 |
2026-08-18 13:37:47.216978 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:37:47.217342 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.060)       0:10:05.344 ********
2026-08-18 13:37:47.501783 | node1 | ok: [node1]
2026-08-18 13:37:47.501856 | node1 | ok: [node2]
2026-08-18 13:37:47.501997 | node1 | ok: [node3]
2026-08-18 13:37:47.502118 | node1 |
2026-08-18 13:37:47.502268 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:37:47.502399 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.287)       0:10:05.632 ********
2026-08-18 13:37:47.572111 | node1 | ok: [node1]
2026-08-18 13:37:47.572329 | node1 | ok: [node2]
2026-08-18 13:37:47.572554 | node1 | ok: [node3]
2026-08-18 13:37:47.572772 | node1 |
2026-08-18 13:37:47.573015 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:37:47.573304 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.070)       0:10:05.703 ********
2026-08-18 13:37:47.670389 | node1 | ok: [node1]
2026-08-18 13:37:47.670625 | node1 | ok: [node2]
2026-08-18 13:37:47.670881 | node1 | ok: [node3]
2026-08-18 13:37:47.671150 | node1 |
2026-08-18 13:37:47.671419 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:37:47.671686 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.097)       0:10:05.800 ********
2026-08-18 13:37:47.736148 | node1 | ok: [node1] => {
2026-08-18 13:37:47.736243 | node1 |     "changed": false,
2026-08-18 13:37:47.736367 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.736485 | node1 | }
2026-08-18 13:37:47.736606 | node1 | ok: [node2] => {
2026-08-18 13:37:47.736728 | node1 |     "changed": false,
2026-08-18 13:37:47.736846 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.736963 | node1 | }
2026-08-18 13:37:47.737081 | node1 | ok: [node3] => {
2026-08-18 13:37:47.737240 | node1 |     "changed": false,
2026-08-18 13:37:47.737362 | node1 |     "msg": "All assertions passed"
2026-08-18 13:37:47.737474 | node1 | }
2026-08-18 13:37:47.737586 | node1 |
2026-08-18 13:37:47.737711 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:37:47.737836 | node1 | Tuesday 18 August 2026  13:37:47 +0000 (0:00:00.066)       0:10:05.867 ********
2026-08-18 13:37:49.275359 | node1 | ok: [node1]
2026-08-18 13:37:49.275437 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:37:49.275535 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:37:49.275628 | node1 |
2026-08-18 13:37:49.275734 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:37:49.275838 | node1 | Tuesday 18 August 2026  13:37:49 +0000 (0:00:01.539)       0:10:07.406 ********
2026-08-18 13:37:49.360061 | node1 | skipping: [node1]
2026-08-18 13:37:49.360141 | node1 | skipping: [node2]
2026-08-18 13:37:49.360240 | node1 | skipping: [node3]
2026-08-18 13:37:49.360332 | node1 |
2026-08-18 13:37:49.360473 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] ****
2026-08-18 13:37:49.360575 | node1 | Tuesday 18 August 2026  13:37:49 +0000 (0:00:00.084)       0:10:07.491 ********
2026-08-18 13:37:49.411958 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1
2026-08-18 13:37:49.412035 | node1 |
2026-08-18 13:37:49.412139 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ********************************
2026-08-18 13:37:49.412234 | node1 | Tuesday 18 August 2026  13:37:49 +0000 (0:00:00.052)       0:10:07.543 ********
2026-08-18 13:37:53.948049 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:37:53.948200 | node1 |
2026-08-18 13:37:53.948432 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] ****************************
2026-08-18 13:37:53.948672 | node1 | Tuesday 18 August 2026  13:37:53 +0000 (0:00:04.534)       0:10:12.077 ********
2026-08-18 13:37:55.908119 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:37:55.908192 | node1 |
2026-08-18 13:37:55.908207 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] *********************************
2026-08-18 13:37:55.908219 | node1 | Tuesday 18 August 2026  13:37:55 +0000 (0:00:01.960)       0:10:14.038 ********
2026-08-18 13:37:57.939719 | node1 | changed: [node1] => (item=None)
2026-08-18 13:37:57.939789 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}]
2026-08-18 13:37:57.939873 | node1 |
2026-08-18 13:37:57.940073 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] *******************************
2026-08-18 13:37:57.940088 | node1 | Tuesday 18 August 2026  13:37:57 +0000 (0:00:02.032)       0:10:16.070 ********
2026-08-18 13:38:00.452060 | node1 | changed: [node1]
2026-08-18 13:38:00.452133 | node1 |
2026-08-18 13:38:00.452328 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:38:00.452379 | node1 | Tuesday 18 August 2026  13:38:00 +0000 (0:00:02.512)       0:10:18.583 ********
2026-08-18 13:38:00.512315 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1
2026-08-18 13:38:00.512374 | node1 |
2026-08-18 13:38:00.512568 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ******************
2026-08-18 13:38:00.512607 | node1 | Tuesday 18 August 2026  13:38:00 +0000 (0:00:00.060)       0:10:18.643 ********
2026-08-18 13:38:02.228366 | node1 | ok: [node1]
2026-08-18 13:38:02.228460 | node1 |
2026-08-18 13:38:02.228838 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] *************
2026-08-18 13:38:02.228929 | node1 | Tuesday 18 August 2026  13:38:02 +0000 (0:00:01.715)       0:10:20.358 ********
2026-08-18 13:38:02.275129 | node1 | ok: [node1]
2026-08-18 13:38:02.275225 | node1 |
2026-08-18 13:38:02.275244 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:38:02.275387 | node1 | Tuesday 18 August 2026  13:38:02 +0000 (0:00:00.047)       0:10:20.405 ********
2026-08-18 13:38:05.303834 | node1 | changed: [node1] => (item=molecule)
2026-08-18 13:38:05.303916 | node1 |
2026-08-18 13:38:05.304017 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] ***
2026-08-18 13:38:05.304122 | node1 | Tuesday 18 August 2026  13:38:05 +0000 (0:00:03.029)       0:10:23.434 ********
2026-08-18 13:38:05.348643 | node1 | skipping: [node1] => (item=rgw.molecule)
2026-08-18 13:38:05.348693 | node1 | skipping: [node1]
2026-08-18 13:38:05.348771 | node1 |
2026-08-18 13:38:05.348859 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] *********
2026-08-18 13:38:05.348954 | node1 | Tuesday 18 August 2026  13:38:05 +0000 (0:00:00.044)       0:10:23.479 ********
2026-08-18 13:38:05.406438 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1
2026-08-18 13:38:05.406479 | node1 |
2026-08-18 13:38:05.406594 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] **************************************
2026-08-18 13:38:05.406689 | node1 | Tuesday 18 August 2026  13:38:05 +0000 (0:00:00.057)       0:10:23.537 ********
2026-08-18 13:38:06.436363 | node1 | ok: [node1]
2026-08-18 13:38:06.436453 | node1 |
2026-08-18 13:38:06.436538 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************
2026-08-18 13:38:06.436650 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:01.029)       0:10:24.567 ********
2026-08-18 13:38:06.476818 | node1 | skipping: [node1]
2026-08-18 13:38:06.476897 | node1 |
2026-08-18 13:38:06.477004 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] *****************************
2026-08-18 13:38:06.477103 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.040)       0:10:24.608 ********
2026-08-18 13:38:06.519107 | node1 | skipping: [node1]
2026-08-18 13:38:06.519947 | node1 |
2026-08-18 13:38:06.519972 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] ***************
2026-08-18 13:38:06.520132 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.041)       0:10:24.649 ********
2026-08-18 13:38:06.562570 | node1 | skipping: [node1]
2026-08-18 13:38:06.562619 | node1 |
2026-08-18 13:38:06.562837 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] *********************************
2026-08-18 13:38:06.562867 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.044)       0:10:24.693 ********
2026-08-18 13:38:06.598620 | node1 | skipping: [node1]
2026-08-18 13:38:06.598694 | node1 |
2026-08-18 13:38:06.598797 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************
2026-08-18 13:38:06.598915 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.035)       0:10:24.729 ********
2026-08-18 13:38:06.654757 | node1 | skipping: [node1] => (item=default.rgw.control)
2026-08-18 13:38:06.654813 | node1 | skipping: [node1] => (item=default.rgw.log)
2026-08-18 13:38:06.654957 | node1 | skipping: [node1] => (item=default.rgw.meta)
2026-08-18 13:38:06.655074 | node1 | skipping: [node1]
2026-08-18 13:38:06.655165 | node1 |
2026-08-18 13:38:06.655269 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ********
2026-08-18 13:38:06.655354 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.056)       0:10:24.786 ********
2026-08-18 13:38:06.691344 | node1 | skipping: [node1]
2026-08-18 13:38:06.691392 | node1 |
2026-08-18 13:38:06.691498 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] **********
2026-08-18 13:38:06.691585 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.036)       0:10:24.822 ********
2026-08-18 13:38:06.774648 | node1 | skipping: [node1]
2026-08-18 13:38:06.774717 | node1 |
2026-08-18 13:38:06.774791 | node1 | PLAY [Deploy Ceph monitoring stack] ********************************************
2026-08-18 13:38:06.774880 | node1 |
2026-08-18 13:38:06.774974 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:38:06.775097 | node1 | Tuesday 18 August 2026  13:38:06 +0000 (0:00:00.083)       0:10:24.906 ********
2026-08-18 13:38:07.730491 | node1 | ok: [node1]
2026-08-18 13:38:07.730582 | node1 | ok: [node2]
2026-08-18 13:38:07.730747 | node1 | ok: [node3]
2026-08-18 13:38:07.730763 | node1 |
2026-08-18 13:38:07.730962 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:07.731005 | node1 | Tuesday 18 August 2026  13:38:07 +0000 (0:00:00.955)       0:10:25.861 ********
2026-08-18 13:38:07.990166 | node1 | ok: [node1]
2026-08-18 13:38:07.990246 | node1 | ok: [node2]
2026-08-18 13:38:07.990322 | node1 | ok: [node3]
2026-08-18 13:38:07.990411 | node1 |
2026-08-18 13:38:07.990515 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:07.990616 | node1 | Tuesday 18 August 2026  13:38:07 +0000 (0:00:00.259)       0:10:26.121 ********
2026-08-18 13:38:08.056274 | node1 | skipping: [node1]
2026-08-18 13:38:08.056330 | node1 | skipping: [node2]
2026-08-18 13:38:08.056417 | node1 | skipping: [node3]
2026-08-18 13:38:08.056506 | node1 |
2026-08-18 13:38:08.056606 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:38:08.056711 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.066)       0:10:26.187 ********
2026-08-18 13:38:08.299534 | node1 | ok: [node1]
2026-08-18 13:38:08.299603 | node1 | ok: [node2]
2026-08-18 13:38:08.299669 | node1 | ok: [node3]
2026-08-18 13:38:08.299753 | node1 |
2026-08-18 13:38:08.299851 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:08.299947 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.243)       0:10:26.430 ********
2026-08-18 13:38:08.371927 | node1 | ok: [node1] => {
2026-08-18 13:38:08.372014 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:08.372133 | node1 | }
2026-08-18 13:38:08.372285 | node1 | ok: [node2] => {
2026-08-18 13:38:08.372397 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:08.372554 | node1 | }
2026-08-18 13:38:08.372664 | node1 | ok: [node3] => {
2026-08-18 13:38:08.372771 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:08.372879 | node1 | }
2026-08-18 13:38:08.372969 | node1 |
2026-08-18 13:38:08.373055 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:08.373169 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.072)       0:10:26.502 ********
2026-08-18 13:38:08.693367 | node1 | ok: [node1]
2026-08-18 13:38:08.693474 | node1 | ok: [node3]
2026-08-18 13:38:08.693605 | node1 | ok: [node2]
2026-08-18 13:38:08.693730 | node1 |
2026-08-18 13:38:08.693898 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:08.694034 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.321)       0:10:26.824 ********
2026-08-18 13:38:08.774858 | node1 | skipping: [node1]
2026-08-18 13:38:08.774905 | node1 | skipping: [node2]
2026-08-18 13:38:08.775082 | node1 | skipping: [node3]
2026-08-18 13:38:08.775186 | node1 |
2026-08-18 13:38:08.775303 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:08.775402 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.081)       0:10:26.905 ********
2026-08-18 13:38:08.859395 | node1 | skipping: [node1]
2026-08-18 13:38:08.859657 | node1 | skipping: [node2]
2026-08-18 13:38:08.859940 | node1 | skipping: [node3]
2026-08-18 13:38:08.860181 | node1 |
2026-08-18 13:38:08.860416 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:08.860668 | node1 | Tuesday 18 August 2026  13:38:08 +0000 (0:00:00.084)       0:10:26.990 ********
2026-08-18 13:38:09.105787 | node1 | ok: [node1]
2026-08-18 13:38:09.106462 | node1 | ok: [node2]
2026-08-18 13:38:09.106526 | node1 | ok: [node3]
2026-08-18 13:38:09.106544 | node1 |
2026-08-18 13:38:09.107404 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:09.107434 | node1 | Tuesday 18 August 2026  13:38:09 +0000 (0:00:00.242)       0:10:27.233 ********
2026-08-18 13:38:10.566276 | node1 | ok: [node1]
2026-08-18 13:38:10.566357 | node1 | ok: [node2]
2026-08-18 13:38:10.566404 | node1 | ok: [node3]
2026-08-18 13:38:10.566511 | node1 |
2026-08-18 13:38:10.566609 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:10.566710 | node1 | Tuesday 18 August 2026  13:38:10 +0000 (0:00:01.464)       0:10:28.697 ********
2026-08-18 13:38:10.664430 | node1 | ok: [node1] => {
2026-08-18 13:38:10.664504 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:10.664600 | node1 | }
2026-08-18 13:38:10.664697 | node1 | ok: [node2] => {
2026-08-18 13:38:10.664804 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:10.664908 | node1 | }
2026-08-18 13:38:10.664995 | node1 | ok: [node3] => {
2026-08-18 13:38:10.665093 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:10.665208 | node1 | }
2026-08-18 13:38:10.665296 | node1 |
2026-08-18 13:38:10.665393 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:10.665488 | node1 | Tuesday 18 August 2026  13:38:10 +0000 (0:00:00.097)       0:10:28.795 ********
2026-08-18 13:38:11.112353 | node1 | ok: [node2]
2026-08-18 13:38:11.112540 | node1 | ok: [node1]
2026-08-18 13:38:11.112696 | node1 | ok: [node3]
2026-08-18 13:38:11.112847 | node1 |
2026-08-18 13:38:11.112995 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:11.113171 | node1 | Tuesday 18 August 2026  13:38:11 +0000 (0:00:00.447)       0:10:29.242 ********
2026-08-18 13:38:13.225589 | node1 | ok: [node3]
2026-08-18 13:38:13.225777 | node1 | ok: [node1]
2026-08-18 13:38:13.225987 | node1 | ok: [node2]
2026-08-18 13:38:13.226180 | node1 |
2026-08-18 13:38:13.226401 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:38:13.226608 | node1 | Tuesday 18 August 2026  13:38:13 +0000 (0:00:02.113)       0:10:31.356 ********
2026-08-18 13:38:13.277085 | node1 | skipping: [node1]
2026-08-18 13:38:13.277346 | node1 | skipping: [node2]
2026-08-18 13:38:13.277603 | node1 | skipping: [node3]
2026-08-18 13:38:13.277835 | node1 |
2026-08-18 13:38:13.278072 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:38:13.278324 | node1 | Tuesday 18 August 2026  13:38:13 +0000 (0:00:00.051)       0:10:31.407 ********
2026-08-18 13:38:13.328850 | node1 | skipping: [node1]
2026-08-18 13:38:13.329020 | node1 | skipping: [node2]
2026-08-18 13:38:13.329329 | node1 | skipping: [node3]
2026-08-18 13:38:13.329518 | node1 |
2026-08-18 13:38:13.329731 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:38:13.329936 | node1 | Tuesday 18 August 2026  13:38:13 +0000 (0:00:00.052)       0:10:31.460 ********
2026-08-18 13:38:13.385083 | node1 | skipping: [node1]
2026-08-18 13:38:13.385137 | node1 | skipping: [node2]
2026-08-18 13:38:13.385143 | node1 | skipping: [node3]
2026-08-18 13:38:13.385147 | node1 |
2026-08-18 13:38:13.385151 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:38:13.385156 | node1 | Tuesday 18 August 2026  13:38:13 +0000 (0:00:00.049)       0:10:31.509 ********
2026-08-18 13:38:14.725211 | node1 | ok: [node1]
2026-08-18 13:38:14.725275 | node1 | ok: [node3]
2026-08-18 13:38:14.725474 | node1 | ok: [node2]
2026-08-18 13:38:14.725547 | node1 |
2026-08-18 13:38:14.726005 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:38:14.726042 | node1 | Tuesday 18 August 2026  13:38:14 +0000 (0:00:01.346)       0:10:32.855 ********
2026-08-18 13:38:15.242392 | node1 | ok: [node1]
2026-08-18 13:38:15.242507 | node1 | ok: [node3]
2026-08-18 13:38:15.243340 | node1 | ok: [node2]
2026-08-18 13:38:15.243413 | node1 |
2026-08-18 13:38:15.243424 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:38:15.243434 | node1 | Tuesday 18 August 2026  13:38:15 +0000 (0:00:00.517)       0:10:33.373 ********
2026-08-18 13:38:16.187570 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:16.187680 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:16.187933 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:16.187995 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:16.188015 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:16.189196 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:16.189237 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:16.189242 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:16.189246 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:16.189250 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:16.189255 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:16.189259 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:16.189263 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:16.189268 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:16.189272 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:16.189276 | node1 |
2026-08-18 13:38:16.189281 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:38:16.189288 | node1 | Tuesday 18 August 2026  13:38:16 +0000 (0:00:00.945)       0:10:34.318 ********
2026-08-18 13:38:16.740797 | node1 | ok: [node1]
2026-08-18 13:38:16.740863 | node1 | ok: [node2]
2026-08-18 13:38:16.740956 | node1 | ok: [node3]
2026-08-18 13:38:16.741151 | node1 |
2026-08-18 13:38:16.741170 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:16.742104 | node1 | Tuesday 18 August 2026  13:38:16 +0000 (0:00:00.537)       0:10:34.855 ********
2026-08-18 13:38:16.742145 | node1 |
2026-08-18 13:38:16.742158 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:16.742162 | node1 | Tuesday 18 August 2026  13:38:16 +0000 (0:00:00.005)       0:10:34.861 ********
2026-08-18 13:38:16.742166 | node1 |
2026-08-18 13:38:16.742170 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:16.742174 | node1 | Tuesday 18 August 2026  13:38:16 +0000 (0:00:00.005)       0:10:34.866 ********
2026-08-18 13:38:16.742178 | node1 |
2026-08-18 13:38:16.742182 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:38:16.742186 | node1 | Tuesday 18 August 2026  13:38:16 +0000 (0:00:00.005)       0:10:34.872 ********
2026-08-18 13:38:17.132999 | node1 | ok: [node1]
2026-08-18 13:38:17.133065 | node1 | ok: [node2]
2026-08-18 13:38:17.133484 | node1 | ok: [node3]
2026-08-18 13:38:17.133501 | node1 |
2026-08-18 13:38:17.133511 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:17.133521 | node1 | Tuesday 18 August 2026  13:38:17 +0000 (0:00:00.392)       0:10:35.264 ********
2026-08-18 13:38:17.374840 | node1 | ok: [node1]
2026-08-18 13:38:17.374909 | node1 | ok: [node2]
2026-08-18 13:38:17.374989 | node1 | ok: [node3]
2026-08-18 13:38:17.375330 | node1 |
2026-08-18 13:38:17.375371 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:17.375377 | node1 | Tuesday 18 August 2026  13:38:17 +0000 (0:00:00.241)       0:10:35.506 ********
2026-08-18 13:38:17.454022 | node1 | ok: [node1] => {
2026-08-18 13:38:17.454148 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:17.455487 | node1 | }
2026-08-18 13:38:17.455532 | node1 | ok: [node2] => {
2026-08-18 13:38:17.455539 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:17.455546 | node1 | }
2026-08-18 13:38:17.455552 | node1 | ok: [node3] => {
2026-08-18 13:38:17.455557 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:17.455563 | node1 | }
2026-08-18 13:38:17.455569 | node1 |
2026-08-18 13:38:17.455574 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:17.455580 | node1 | Tuesday 18 August 2026  13:38:17 +0000 (0:00:00.078)       0:10:35.584 ********
2026-08-18 13:38:17.836148 | node1 | ok: [node1]
2026-08-18 13:38:17.836222 | node1 | ok: [node3]
2026-08-18 13:38:17.836403 | node1 | ok: [node2]
2026-08-18 13:38:17.836523 | node1 |
2026-08-18 13:38:17.836663 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:17.836794 | node1 | Tuesday 18 August 2026  13:38:17 +0000 (0:00:00.382)       0:10:35.967 ********
2026-08-18 13:38:20.983462 | node1 | ok: [node3]
2026-08-18 13:38:20.983534 | node1 | ok: [node1]
2026-08-18 13:38:20.983664 | node1 | ok: [node2]
2026-08-18 13:38:20.983726 | node1 |
2026-08-18 13:38:20.983926 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:38:20.983972 | node1 | Tuesday 18 August 2026  13:38:20 +0000 (0:00:03.147)       0:10:39.114 ********
2026-08-18 13:38:22.469712 | node1 | ok: [node1]
2026-08-18 13:38:22.469786 | node1 | ok: [node2]
2026-08-18 13:38:22.469914 | node1 | ok: [node3]
2026-08-18 13:38:22.470011 | node1 |
2026-08-18 13:38:22.470158 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:38:22.470230 | node1 | Tuesday 18 August 2026  13:38:22 +0000 (0:00:01.485)       0:10:40.600 ********
2026-08-18 13:38:22.716121 | node1 | ok: [node1]
2026-08-18 13:38:22.716352 | node1 | ok: [node2]
2026-08-18 13:38:22.716668 | node1 | ok: [node3]
2026-08-18 13:38:22.716876 | node1 |
2026-08-18 13:38:22.717152 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:38:22.717416 | node1 | Tuesday 18 August 2026  13:38:22 +0000 (0:00:00.246)       0:10:40.846 ********
2026-08-18 13:38:23.174050 | node1 | ok: [node3]
2026-08-18 13:38:23.174152 | node1 | ok: [node1]
2026-08-18 13:38:23.174282 | node1 | ok: [node2]
2026-08-18 13:38:23.174398 | node1 |
2026-08-18 13:38:23.174534 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:38:23.174662 | node1 | Tuesday 18 August 2026  13:38:23 +0000 (0:00:00.458)       0:10:41.305 ********
2026-08-18 13:38:23.763828 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:38:23.763894 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:38:23.764039 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:38:23.764156 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:23.764253 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:23.764357 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:23.764454 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:23.764558 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:23.764654 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:23.764755 | node1 |
2026-08-18 13:38:23.764852 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:38:23.764965 | node1 | Tuesday 18 August 2026  13:38:23 +0000 (0:00:00.590)       0:10:41.895 ********
2026-08-18 13:38:24.244306 | node1 | ok: [node1]
2026-08-18 13:38:24.244501 | node1 | ok: [node3]
2026-08-18 13:38:24.244859 | node1 | ok: [node2]
2026-08-18 13:38:24.245078 | node1 |
2026-08-18 13:38:24.245367 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:38:24.245567 | node1 | Tuesday 18 August 2026  13:38:24 +0000 (0:00:00.480)       0:10:42.375 ********
2026-08-18 13:38:24.718108 | node1 | ok: [node1]
2026-08-18 13:38:24.718320 | node1 | ok: [node2]
2026-08-18 13:38:24.718581 | node1 | ok: [node3]
2026-08-18 13:38:24.718821 | node1 |
2026-08-18 13:38:24.719084 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:24.719312 | node1 | Tuesday 18 August 2026  13:38:24 +0000 (0:00:00.455)       0:10:42.830 ********
2026-08-18 13:38:24.719503 | node1 |
2026-08-18 13:38:24.719716 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:24.719926 | node1 | Tuesday 18 August 2026  13:38:24 +0000 (0:00:00.006)       0:10:42.837 ********
2026-08-18 13:38:24.720111 | node1 |
2026-08-18 13:38:24.720357 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:24.720567 | node1 | Tuesday 18 August 2026  13:38:24 +0000 (0:00:00.005)       0:10:42.842 ********
2026-08-18 13:38:24.720750 | node1 |
2026-08-18 13:38:24.720980 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:38:24.721228 | node1 | Tuesday 18 August 2026  13:38:24 +0000 (0:00:00.005)       0:10:42.848 ********
2026-08-18 13:38:25.130346 | node1 | ok: [node1]
2026-08-18 13:38:25.131433 | node1 | ok: [node3]
2026-08-18 13:38:25.131459 | node1 | ok: [node2]
2026-08-18 13:38:25.131470 | node1 |
2026-08-18 13:38:25.131480 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:25.131490 | node1 | Tuesday 18 August 2026  13:38:25 +0000 (0:00:00.412)       0:10:43.260 ********
2026-08-18 13:38:25.188201 | node1 | ok: [node1] => {
2026-08-18 13:38:25.188277 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:25.188288 | node1 | }
2026-08-18 13:38:25.188298 | node1 | ok: [node2] => {
2026-08-18 13:38:25.188307 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:25.188316 | node1 | }
2026-08-18 13:38:25.188325 | node1 | ok: [node3] => {
2026-08-18 13:38:25.188345 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:25.188355 | node1 | }
2026-08-18 13:38:25.188364 | node1 |
2026-08-18 13:38:25.188373 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:25.188382 | node1 | Tuesday 18 August 2026  13:38:25 +0000 (0:00:00.055)       0:10:43.316 ********
2026-08-18 13:38:25.474606 | node1 | ok: [node1]
2026-08-18 13:38:25.474663 | node1 | ok: [node3]
2026-08-18 13:38:25.474673 | node1 | ok: [node2]
2026-08-18 13:38:25.474682 | node1 |
2026-08-18 13:38:25.474692 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:25.474701 | node1 | Tuesday 18 August 2026  13:38:25 +0000 (0:00:00.287)       0:10:43.604 ********
2026-08-18 13:38:25.532772 | node1 | skipping: [node1]
2026-08-18 13:38:25.532988 | node1 | skipping: [node2]
2026-08-18 13:38:25.533366 | node1 | skipping: [node3]
2026-08-18 13:38:25.533593 | node1 |
2026-08-18 13:38:25.533864 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:38:25.534181 | node1 | Tuesday 18 August 2026  13:38:25 +0000 (0:00:00.059)       0:10:43.663 ********
2026-08-18 13:38:25.600053 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:25.600199 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:25.600352 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:25.600482 | node1 |
2026-08-18 13:38:25.600625 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:38:25.600777 | node1 | Tuesday 18 August 2026  13:38:25 +0000 (0:00:00.067)       0:10:43.730 ********
2026-08-18 13:38:26.952585 | node1 | ok: [node1]
2026-08-18 13:38:26.952715 | node1 | ok: [node2]
2026-08-18 13:38:26.952726 | node1 | ok: [node3]
2026-08-18 13:38:26.952792 | node1 |
2026-08-18 13:38:26.952871 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:38:26.952968 | node1 | Tuesday 18 August 2026  13:38:26 +0000 (0:00:01.352)       0:10:45.083 ********
2026-08-18 13:38:28.660984 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:38:28.661138 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:38:28.661153 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:38:28.661262 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:38:28.661356 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:38:28.661469 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:38:28.661541 | node1 |
2026-08-18 13:38:28.661667 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:38:28.661754 | node1 | Tuesday 18 August 2026  13:38:28 +0000 (0:00:01.708)       0:10:46.791 ********
2026-08-18 13:38:28.885714 | node1 | ok: [node1]
2026-08-18 13:38:28.885880 | node1 | ok: [node2]
2026-08-18 13:38:28.886101 | node1 | ok: [node3]
2026-08-18 13:38:28.886307 | node1 |
2026-08-18 13:38:28.886554 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:38:28.886775 | node1 | Tuesday 18 August 2026  13:38:28 +0000 (0:00:00.224)       0:10:47.016 ********
2026-08-18 13:38:29.152647 | node1 | ok: [node1]
2026-08-18 13:38:29.152742 | node1 | ok: [node3]
2026-08-18 13:38:29.152864 | node1 | ok: [node2]
2026-08-18 13:38:29.152971 | node1 |
2026-08-18 13:38:29.153220 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:38:29.153439 | node1 | Tuesday 18 August 2026  13:38:29 +0000 (0:00:00.267)       0:10:47.283 ********
2026-08-18 13:38:29.616875 | node1 | ok: [node1]
2026-08-18 13:38:29.617044 | node1 | ok: [node2]
2026-08-18 13:38:29.617287 | node1 | ok: [node3]
2026-08-18 13:38:29.617515 | node1 |
2026-08-18 13:38:29.617740 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:38:29.617919 | node1 | Tuesday 18 August 2026  13:38:29 +0000 (0:00:00.464)       0:10:47.747 ********
2026-08-18 13:38:29.673660 | node1 | skipping: [node1]
2026-08-18 13:38:29.673724 | node1 | skipping: [node2]
2026-08-18 13:38:29.674427 | node1 | skipping: [node3]
2026-08-18 13:38:29.674486 | node1 |
2026-08-18 13:38:29.674498 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:38:29.674508 | node1 | Tuesday 18 August 2026  13:38:29 +0000 (0:00:00.056)       0:10:47.804 ********
2026-08-18 13:38:30.053791 | node1 | ok: [node1]
2026-08-18 13:38:30.053871 | node1 | ok: [node2]
2026-08-18 13:38:30.054042 | node1 | ok: [node3]
2026-08-18 13:38:30.054110 | node1 |
2026-08-18 13:38:30.054482 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:38:30.054539 | node1 | Tuesday 18 August 2026  13:38:30 +0000 (0:00:00.380)       0:10:48.184 ********
2026-08-18 13:38:30.554867 | node1 | ok: [node1]
2026-08-18 13:38:30.554946 | node1 | ok: [node3]
2026-08-18 13:38:30.555009 | node1 | ok: [node2]
2026-08-18 13:38:30.555316 | node1 |
2026-08-18 13:38:30.555381 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] ****************
2026-08-18 13:38:30.555387 | node1 | Tuesday 18 August 2026  13:38:30 +0000 (0:00:00.501)       0:10:48.685 ********
2026-08-18 13:38:31.150524 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:38:31.150639 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:38:31.151029 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:38:31.151071 | node1 |
2026-08-18 13:38:31.151077 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************
2026-08-18 13:38:31.151082 | node1 | Tuesday 18 August 2026  13:38:31 +0000 (0:00:00.594)       0:10:49.280 ********
2026-08-18 13:38:31.228235 | node1 | ok: [node1]
2026-08-18 13:38:31.228291 | node1 | ok: [node2]
2026-08-18 13:38:31.228615 | node1 | ok: [node3]
2026-08-18 13:38:31.228724 | node1 |
2026-08-18 13:38:31.228737 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] ****************
2026-08-18 13:38:31.228757 | node1 | Tuesday 18 August 2026  13:38:31 +0000 (0:00:00.078)       0:10:49.359 ********
2026-08-18 13:38:31.295296 | node1 | ok: [node1]
2026-08-18 13:38:31.295406 | node1 | ok: [node2]
2026-08-18 13:38:31.295421 | node1 | ok: [node3]
2026-08-18 13:38:31.295741 | node1 |
2026-08-18 13:38:31.295799 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] **************
2026-08-18 13:38:31.295805 | node1 | Tuesday 18 August 2026  13:38:31 +0000 (0:00:00.067)       0:10:49.426 ********
2026-08-18 13:38:31.331530 | node1 | skipping: [node1]
2026-08-18 13:38:31.331615 | node1 |
2026-08-18 13:38:31.331716 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] ***********
2026-08-18 13:38:31.331816 | node1 | Tuesday 18 August 2026  13:38:31 +0000 (0:00:00.035)       0:10:49.461 ********
2026-08-18 13:38:34.155637 | node1 | changed: [node1] => (item=ceph-exporter)
2026-08-18 13:38:34.155774 | node1 |
2026-08-18 13:38:34.155900 | node1 | PLAY RECAP *********************************************************************
2026-08-18 13:38:34.156047 | node1 | node1                      : ok=246  changed=48   unreachable=0    failed=0    skipped=54   rescued=0    ignored=0
2026-08-18 13:38:34.156194 | node1 | node2                      : ok=206  changed=28   unreachable=0    failed=0    skipped=45   rescued=0    ignored=0
2026-08-18 13:38:34.156340 | node1 | node3                      : ok=206  changed=28   unreachable=0    failed=0    skipped=45   rescued=0    ignored=0
2026-08-18 13:38:34.156465 | node1 |
2026-08-18 13:38:34.156578 | node1 |
2026-08-18 13:38:34.156707 | node1 | TASKS RECAP ********************************************************************
2026-08-18 13:38:34.156842 | node1 | Tuesday 18 August 2026  13:38:34 +0000 (0:00:02.825)       0:10:52.286 ********
2026-08-18 13:38:34.156964 | node1 | ===============================================================================
2026-08-18 13:38:34.157087 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 232.64s
2026-08-18 13:38:34.157227 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 42.55s
2026-08-18 13:38:34.157358 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 40.95s
2026-08-18 13:38:34.157494 | node1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 36.07s
2026-08-18 13:38:34.157623 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 30.67s
2026-08-18 13:38:34.157750 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 26.66s
2026-08-18 13:38:34.157884 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 21.12s
2026-08-18 13:38:34.158009 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 17.22s
2026-08-18 13:38:34.158134 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 9.79s
2026-08-18 13:38:34.158266 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules -------------------------- 9.73s
2026-08-18 13:38:34.158395 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 8.90s
2026-08-18 13:38:34.158528 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 6.98s
2026-08-18 13:38:34.158669 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 5.21s
2026-08-18 13:38:34.158798 | node1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.16s
2026-08-18 13:38:34.158929 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.53s
2026-08-18 13:38:34.159053 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.42s
2026-08-18 13:38:34.159177 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.12s
2026-08-18 13:38:34.159300 | node1 | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.93s
2026-08-18 13:38:34.159426 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s
2026-08-18 13:38:34.159558 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.10s
2026-08-18 13:38:34.268783 | node1 | INFO     [default > converge] Executed: Successful
2026-08-18 13:38:34.274740 | node1 | INFO     [default > idempotence] Executing
2026-08-18 13:38:35.332734 | node1 |
2026-08-18 13:38:35.332862 | node1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-18 13:38:35.332984 | node1 |
2026-08-18 13:38:35.333163 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:38:35.333282 | node1 | Tuesday 18 August 2026  13:38:35 +0000 (0:00:00.075)       0:00:00.075 ********
2026-08-18 13:38:36.493051 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 13:38:36.493200 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:38:36.493342 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:38:36.493509 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:38:36.493623 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:38:36.525040 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python
2026-08-18 13:38:36.525282 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:38:36.525524 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:38:36.525647 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:38:36.525781 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:38:36.581960 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python
2026-08-18 13:38:36.582153 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:38:36.582364 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:38:36.582565 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:38:36.582769 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:38:36.634353 | node1 | ok: [node1]
2026-08-18 13:38:36.634645 | node1 | ok: [node3]
2026-08-18 13:38:36.634816 | node1 | ok: [node2]
2026-08-18 13:38:36.634975 | node1 |
2026-08-18 13:38:36.635148 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:36.635308 | node1 | Tuesday 18 August 2026  13:38:36 +0000 (0:00:01.301)       0:00:01.376 ********
2026-08-18 13:38:36.941502 | node1 | ok: [node1]
2026-08-18 13:38:36.941687 | node1 | ok: [node3]
2026-08-18 13:38:36.941879 | node1 | ok: [node2]
2026-08-18 13:38:36.942066 | node1 |
2026-08-18 13:38:36.942275 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:36.942476 | node1 | Tuesday 18 August 2026  13:38:36 +0000 (0:00:00.307)       0:00:01.684 ********
2026-08-18 13:38:37.004749 | node1 | skipping: [node1]
2026-08-18 13:38:37.004954 | node1 | skipping: [node2]
2026-08-18 13:38:37.005221 | node1 | skipping: [node3]
2026-08-18 13:38:37.005405 | node1 |
2026-08-18 13:38:37.005619 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:38:37.005825 | node1 | Tuesday 18 August 2026  13:38:37 +0000 (0:00:00.063)       0:00:01.747 ********
2026-08-18 13:38:37.322462 | node1 | ok: [node3]
2026-08-18 13:38:37.322554 | node1 | ok: [node1]
2026-08-18 13:38:37.322634 | node1 | ok: [node2]
2026-08-18 13:38:37.322696 | node1 |
2026-08-18 13:38:37.322802 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:37.322920 | node1 | Tuesday 18 August 2026  13:38:37 +0000 (0:00:00.317)       0:00:02.065 ********
2026-08-18 13:38:37.415415 | node1 | ok: [node1] => {
2026-08-18 13:38:37.415644 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:37.415845 | node1 | }
2026-08-18 13:38:37.416054 | node1 | ok: [node2] => {
2026-08-18 13:38:37.416268 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:37.416460 | node1 | }
2026-08-18 13:38:37.416661 | node1 | ok: [node3] => {
2026-08-18 13:38:37.416871 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:38:37.417059 | node1 | }
2026-08-18 13:38:37.417273 | node1 |
2026-08-18 13:38:37.417514 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:37.417719 | node1 | Tuesday 18 August 2026  13:38:37 +0000 (0:00:00.092)       0:00:02.157 ********
2026-08-18 13:38:37.844026 | node1 | ok: [node3]
2026-08-18 13:38:37.844091 | node1 | ok: [node2]
2026-08-18 13:38:37.844337 | node1 | ok: [node1]
2026-08-18 13:38:37.844361 | node1 |
2026-08-18 13:38:37.844378 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:37.844455 | node1 | Tuesday 18 August 2026  13:38:37 +0000 (0:00:00.429)       0:00:02.586 ********
2026-08-18 13:38:37.941949 | node1 | skipping: [node1]
2026-08-18 13:38:37.942021 | node1 | skipping: [node2]
2026-08-18 13:38:37.942130 | node1 | skipping: [node3]
2026-08-18 13:38:37.942198 | node1 |
2026-08-18 13:38:37.942295 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:37.942389 | node1 | Tuesday 18 August 2026  13:38:37 +0000 (0:00:00.097)       0:00:02.684 ********
2026-08-18 13:38:38.039410 | node1 | skipping: [node1]
2026-08-18 13:38:38.039488 | node1 | skipping: [node2]
2026-08-18 13:38:38.039587 | node1 | skipping: [node3]
2026-08-18 13:38:38.039674 | node1 |
2026-08-18 13:38:38.039774 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:38.039856 | node1 | Tuesday 18 August 2026  13:38:38 +0000 (0:00:00.097)       0:00:02.782 ********
2026-08-18 13:38:38.281722 | node1 | ok: [node1]
2026-08-18 13:38:38.281970 | node1 | ok: [node3]
2026-08-18 13:38:38.282190 | node1 | ok: [node2]
2026-08-18 13:38:38.282372 | node1 |
2026-08-18 13:38:38.282592 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:38:38.282806 | node1 | Tuesday 18 August 2026  13:38:38 +0000 (0:00:00.241)       0:00:03.024 ********
2026-08-18 13:38:39.804204 | node1 | ok: [node1]
2026-08-18 13:38:39.804529 | node1 | ok: [node2]
2026-08-18 13:38:39.804589 | node1 | ok: [node3]
2026-08-18 13:38:39.804607 | node1 |
2026-08-18 13:38:39.804725 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:39.804861 | node1 | Tuesday 18 August 2026  13:38:39 +0000 (0:00:01.522)       0:00:04.546 ********
2026-08-18 13:38:39.930891 | node1 | ok: [node1] => {
2026-08-18 13:38:39.930975 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:39.932210 | node1 | }
2026-08-18 13:38:39.932251 | node1 | ok: [node2] => {
2026-08-18 13:38:39.932259 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:39.932265 | node1 | }
2026-08-18 13:38:39.932271 | node1 | ok: [node3] => {
2026-08-18 13:38:39.932276 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:38:39.932282 | node1 | }
2026-08-18 13:38:39.932288 | node1 |
2026-08-18 13:38:39.932294 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:39.932300 | node1 | Tuesday 18 August 2026  13:38:39 +0000 (0:00:00.126)       0:00:04.673 ********
2026-08-18 13:38:40.316604 | node1 | ok: [node1]
2026-08-18 13:38:40.316668 | node1 | ok: [node2]
2026-08-18 13:38:40.316766 | node1 | ok: [node3]
2026-08-18 13:38:40.316856 | node1 |
2026-08-18 13:38:40.316959 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:40.317047 | node1 | Tuesday 18 August 2026  13:38:40 +0000 (0:00:00.385)       0:00:05.059 ********
2026-08-18 13:38:42.538175 | node1 | ok: [node2]
2026-08-18 13:38:42.538251 | node1 | ok: [node1]
2026-08-18 13:38:42.538309 | node1 | ok: [node3]
2026-08-18 13:38:42.538586 | node1 |
2026-08-18 13:38:42.538626 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:38:42.538632 | node1 | Tuesday 18 August 2026  13:38:42 +0000 (0:00:02.221)       0:00:07.281 ********
2026-08-18 13:38:42.572014 | node1 | skipping: [node1]
2026-08-18 13:38:42.601835 | node1 | skipping: [node2]
2026-08-18 13:38:42.601905 | node1 | skipping: [node3]
2026-08-18 13:38:42.601999 | node1 |
2026-08-18 13:38:42.602212 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:38:42.602255 | node1 | Tuesday 18 August 2026  13:38:42 +0000 (0:00:00.063)       0:00:07.344 ********
2026-08-18 13:38:42.634651 | node1 | skipping: [node1]
2026-08-18 13:38:42.665826 | node1 | skipping: [node2]
2026-08-18 13:38:42.665846 | node1 | skipping: [node3]
2026-08-18 13:38:42.665851 | node1 |
2026-08-18 13:38:42.665855 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:38:42.665860 | node1 | Tuesday 18 August 2026  13:38:42 +0000 (0:00:00.063)       0:00:07.408 ********
2026-08-18 13:38:42.723552 | node1 | skipping: [node1]
2026-08-18 13:38:42.723617 | node1 | skipping: [node2]
2026-08-18 13:38:42.723691 | node1 | skipping: [node3]
2026-08-18 13:38:42.723985 | node1 |
2026-08-18 13:38:42.724031 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:38:42.724037 | node1 | Tuesday 18 August 2026  13:38:42 +0000 (0:00:00.057)       0:00:07.466 ********
2026-08-18 13:38:43.997924 | node1 | ok: [node1]
2026-08-18 13:38:43.998018 | node1 | ok: [node2]
2026-08-18 13:38:43.998120 | node1 | ok: [node3]
2026-08-18 13:38:43.998208 | node1 |
2026-08-18 13:38:43.998316 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:38:43.998442 | node1 | Tuesday 18 August 2026  13:38:43 +0000 (0:00:01.274)       0:00:08.740 ********
2026-08-18 13:38:44.450173 | node1 | ok: [node1]
2026-08-18 13:38:44.450429 | node1 | ok: [node2]
2026-08-18 13:38:44.450434 | node1 | ok: [node3]
2026-08-18 13:38:44.450439 | node1 |
2026-08-18 13:38:44.450443 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:38:44.450448 | node1 | Tuesday 18 August 2026  13:38:44 +0000 (0:00:00.451)       0:00:09.192 ********
2026-08-18 13:38:45.361356 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:45.361443 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:45.361465 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:38:45.361481 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:45.363273 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:45.363315 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:38:45.363322 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:45.363328 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:45.363340 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:38:45.363346 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:45.363352 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:45.363358 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:38:45.363364 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:45.363377 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:45.363383 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:38:45.363389 | node1 |
2026-08-18 13:38:45.363395 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:38:45.363411 | node1 | Tuesday 18 August 2026  13:38:45 +0000 (0:00:00.910)       0:00:10.103 ********
2026-08-18 13:38:45.947817 | node1 | ok: [node1]
2026-08-18 13:38:45.947884 | node1 | ok: [node3]
2026-08-18 13:38:45.949017 | node1 | ok: [node2]
2026-08-18 13:38:45.949033 | node1 |
2026-08-18 13:38:45.949038 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:45.949043 | node1 | Tuesday 18 August 2026  13:38:45 +0000 (0:00:00.566)       0:00:10.669 ********
2026-08-18 13:38:45.949047 | node1 |
2026-08-18 13:38:45.949051 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:45.949055 | node1 | Tuesday 18 August 2026  13:38:45 +0000 (0:00:00.006)       0:00:10.676 ********
2026-08-18 13:38:45.949059 | node1 |
2026-08-18 13:38:45.949063 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:38:45.949067 | node1 | Tuesday 18 August 2026  13:38:45 +0000 (0:00:00.006)       0:00:10.683 ********
2026-08-18 13:38:45.949071 | node1 |
2026-08-18 13:38:45.949074 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:38:45.949078 | node1 | Tuesday 18 August 2026  13:38:45 +0000 (0:00:00.007)       0:00:10.690 ********
2026-08-18 13:38:46.544545 | node1 | ok: [node1]
2026-08-18 13:38:46.544588 | node1 | ok: [node2]
2026-08-18 13:38:46.544593 | node1 | ok: [node3]
2026-08-18 13:38:46.544597 | node1 |
2026-08-18 13:38:46.544602 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:38:46.544607 | node1 | Tuesday 18 August 2026  13:38:46 +0000 (0:00:00.596)       0:00:11.287 ********
2026-08-18 13:38:46.777570 | node1 | ok: [node1]
2026-08-18 13:38:46.777636 | node1 | ok: [node2]
2026-08-18 13:38:46.778012 | node1 | ok: [node3]
2026-08-18 13:38:46.778064 | node1 |
2026-08-18 13:38:46.778070 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:46.778075 | node1 | Tuesday 18 August 2026  13:38:46 +0000 (0:00:00.233)       0:00:11.520 ********
2026-08-18 13:38:46.872799 | node1 | ok: [node1] => {
2026-08-18 13:38:46.873235 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:46.873302 | node1 | }
2026-08-18 13:38:46.873322 | node1 | ok: [node2] => {
2026-08-18 13:38:46.873332 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:46.873463 | node1 | }
2026-08-18 13:38:46.873581 | node1 | ok: [node3] => {
2026-08-18 13:38:46.873714 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:38:46.873833 | node1 | }
2026-08-18 13:38:46.873937 | node1 |
2026-08-18 13:38:46.874076 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:46.874193 | node1 | Tuesday 18 August 2026  13:38:46 +0000 (0:00:00.095)       0:00:11.615 ********
2026-08-18 13:38:47.253060 | node1 | ok: [node1]
2026-08-18 13:38:47.253192 | node1 | ok: [node2]
2026-08-18 13:38:47.253316 | node1 | ok: [node3]
2026-08-18 13:38:47.253435 | node1 |
2026-08-18 13:38:47.253570 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:47.253703 | node1 | Tuesday 18 August 2026  13:38:47 +0000 (0:00:00.380)       0:00:11.995 ********
2026-08-18 13:38:50.407659 | node1 | ok: [node3]
2026-08-18 13:38:50.407821 | node1 | ok: [node1]
2026-08-18 13:38:50.408119 | node1 | ok: [node2]
2026-08-18 13:38:50.408262 | node1 |
2026-08-18 13:38:50.408375 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:38:50.408561 | node1 | Tuesday 18 August 2026  13:38:50 +0000 (0:00:03.154)       0:00:15.150 ********
2026-08-18 13:38:51.774489 | node1 | ok: [node1]
2026-08-18 13:38:51.774549 | node1 | ok: [node2]
2026-08-18 13:38:51.774561 | node1 | ok: [node3]
2026-08-18 13:38:51.774572 | node1 |
2026-08-18 13:38:51.774582 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:38:51.774592 | node1 | Tuesday 18 August 2026  13:38:51 +0000 (0:00:01.365)       0:00:16.515 ********
2026-08-18 13:38:52.055185 | node1 | ok: [node3]
2026-08-18 13:38:52.055226 | node1 | ok: [node1]
2026-08-18 13:38:52.055231 | node1 | ok: [node2]
2026-08-18 13:38:52.055247 | node1 |
2026-08-18 13:38:52.055251 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:38:52.055256 | node1 | Tuesday 18 August 2026  13:38:52 +0000 (0:00:00.281)       0:00:16.797 ********
2026-08-18 13:38:52.524112 | node1 | ok: [node1]
2026-08-18 13:38:52.524163 | node1 | ok: [node3]
2026-08-18 13:38:52.524170 | node1 | ok: [node2]
2026-08-18 13:38:52.524175 | node1 |
2026-08-18 13:38:52.524181 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:38:52.524186 | node1 | Tuesday 18 August 2026  13:38:52 +0000 (0:00:00.468)       0:00:17.266 ********
2026-08-18 13:38:53.099801 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:38:53.099873 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:38:53.099955 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:38:53.100055 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:53.100153 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:53.100248 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:38:53.100335 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:53.100429 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:53.100522 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:38:53.100607 | node1 |
2026-08-18 13:38:53.100704 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:38:53.100798 | node1 | Tuesday 18 August 2026  13:38:53 +0000 (0:00:00.575)       0:00:17.842 ********
2026-08-18 13:38:53.542335 | node1 | ok: [node2]
2026-08-18 13:38:53.542378 | node1 | ok: [node1]
2026-08-18 13:38:53.542382 | node1 | ok: [node3]
2026-08-18 13:38:53.542387 | node1 |
2026-08-18 13:38:53.542391 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:38:53.542396 | node1 | Tuesday 18 August 2026  13:38:53 +0000 (0:00:00.441)       0:00:18.284 ********
2026-08-18 13:38:54.007796 | node1 | ok: [node1]
2026-08-18 13:38:54.007872 | node1 | ok: [node3]
2026-08-18 13:38:54.007884 | node1 | ok: [node2]
2026-08-18 13:38:54.007985 | node1 |
2026-08-18 13:38:54.008079 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:54.008178 | node1 | Tuesday 18 August 2026  13:38:53 +0000 (0:00:00.443)       0:00:18.728 ********
2026-08-18 13:38:54.008235 | node1 |
2026-08-18 13:38:54.008346 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:54.008420 | node1 | Tuesday 18 August 2026  13:38:53 +0000 (0:00:00.008)       0:00:18.736 ********
2026-08-18 13:38:54.008502 | node1 |
2026-08-18 13:38:54.008595 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:38:54.008686 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.007)       0:00:18.744 ********
2026-08-18 13:38:54.008768 | node1 |
2026-08-18 13:38:54.008862 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:38:54.008953 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.006)       0:00:18.750 ********
2026-08-18 13:38:54.399075 | node1 | ok: [node1]
2026-08-18 13:38:54.399147 | node1 | ok: [node2]
2026-08-18 13:38:54.399230 | node1 | ok: [node3]
2026-08-18 13:38:54.399315 | node1 |
2026-08-18 13:38:54.399417 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:38:54.399513 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.391)       0:00:19.141 ********
2026-08-18 13:38:54.449732 | node1 | ok: [node1] => {
2026-08-18 13:38:54.449847 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:54.451561 | node1 | }
2026-08-18 13:38:54.451607 | node1 | ok: [node2] => {
2026-08-18 13:38:54.451615 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:54.451621 | node1 | }
2026-08-18 13:38:54.451627 | node1 | ok: [node3] => {
2026-08-18 13:38:54.451632 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:38:54.451638 | node1 | }
2026-08-18 13:38:54.451643 | node1 |
2026-08-18 13:38:54.451660 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:38:54.451666 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.050)       0:00:19.192 ********
2026-08-18 13:38:54.754916 | node1 | ok: [node1]
2026-08-18 13:38:54.754984 | node1 | ok: [node3]
2026-08-18 13:38:54.755074 | node1 | ok: [node2]
2026-08-18 13:38:54.755157 | node1 |
2026-08-18 13:38:54.755254 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:38:54.755350 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.305)       0:00:19.497 ********
2026-08-18 13:38:54.834074 | node1 | skipping: [node1]
2026-08-18 13:38:54.834135 | node1 | skipping: [node2]
2026-08-18 13:38:54.834218 | node1 | skipping: [node3]
2026-08-18 13:38:54.834305 | node1 |
2026-08-18 13:38:54.834410 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:38:54.834562 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.079)       0:00:19.576 ********
2026-08-18 13:38:54.906891 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:54.906958 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:54.907296 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:38:54.907358 | node1 |
2026-08-18 13:38:54.907371 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:38:54.907388 | node1 | Tuesday 18 August 2026  13:38:54 +0000 (0:00:00.072)       0:00:19.649 ********
2026-08-18 13:38:55.986716 | node1 | ok: [node1]
2026-08-18 13:38:55.986769 | node1 | ok: [node2]
2026-08-18 13:38:55.986872 | node1 | ok: [node3]
2026-08-18 13:38:55.986959 | node1 |
2026-08-18 13:38:55.987055 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:38:55.987176 | node1 | Tuesday 18 August 2026  13:38:55 +0000 (0:00:01.079)       0:00:20.729 ********
2026-08-18 13:38:56.691664 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:38:56.691712 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:38:56.691717 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:38:56.691721 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:38:56.691724 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:38:56.691728 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:38:56.691732 | node1 |
2026-08-18 13:38:56.691737 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:38:56.691741 | node1 | Tuesday 18 August 2026  13:38:56 +0000 (0:00:00.704)       0:00:21.433 ********
2026-08-18 13:38:56.918086 | node1 | ok: [node1]
2026-08-18 13:38:56.918792 | node1 | ok: [node3]
2026-08-18 13:38:56.918849 | node1 | ok: [node2]
2026-08-18 13:38:56.919997 | node1 |
2026-08-18 13:38:56.920594 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:38:56.920621 | node1 | Tuesday 18 August 2026  13:38:56 +0000 (0:00:00.226)       0:00:21.660 ********
2026-08-18 13:38:57.282687 | node1 | ok: [node1]
2026-08-18 13:38:57.282767 | node1 | ok: [node3]
2026-08-18 13:38:57.282772 | node1 | ok: [node2]
2026-08-18 13:38:57.282776 | node1 |
2026-08-18 13:38:57.282782 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:38:57.282787 | node1 | Tuesday 18 August 2026  13:38:57 +0000 (0:00:00.364)       0:00:22.024 ********
2026-08-18 13:38:57.757306 | node1 | ok: [node1]
2026-08-18 13:38:57.757405 | node1 | ok: [node2]
2026-08-18 13:38:57.757417 | node1 | ok: [node3]
2026-08-18 13:38:57.757427 | node1 |
2026-08-18 13:38:57.757437 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:38:57.757516 | node1 | Tuesday 18 August 2026  13:38:57 +0000 (0:00:00.474)       0:00:22.498 ********
2026-08-18 13:38:57.813205 | node1 | skipping: [node1]
2026-08-18 13:38:57.813347 | node1 | skipping: [node2]
2026-08-18 13:38:57.813472 | node1 | skipping: [node3]
2026-08-18 13:38:57.813586 | node1 |
2026-08-18 13:38:57.813723 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:38:57.813842 | node1 | Tuesday 18 August 2026  13:38:57 +0000 (0:00:00.057)       0:00:22.555 ********
2026-08-18 13:38:58.407519 | node1 | ok: [node1]
2026-08-18 13:38:58.407615 | node1 | ok: [node3]
2026-08-18 13:38:58.407642 | node1 | ok: [node2]
2026-08-18 13:38:58.407729 | node1 |
2026-08-18 13:38:58.407836 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:38:58.407933 | node1 | Tuesday 18 August 2026  13:38:58 +0000 (0:00:00.594)       0:00:23.150 ********
2026-08-18 13:38:58.870220 | node1 | ok: [node1]
2026-08-18 13:38:58.870342 | node1 | ok: [node2]
2026-08-18 13:38:58.870570 | node1 | ok: [node3]
2026-08-18 13:38:58.870756 | node1 |
2026-08-18 13:38:58.871054 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] ***
2026-08-18 13:38:58.871304 | node1 | Tuesday 18 August 2026  13:38:58 +0000 (0:00:00.462)       0:00:23.612 ********
2026-08-18 13:38:58.967957 | node1 | ok: [node1]
2026-08-18 13:38:58.968077 | node1 | ok: [node2]
2026-08-18 13:38:58.968270 | node1 | ok: [node3]
2026-08-18 13:38:58.968454 | node1 |
2026-08-18 13:38:58.968825 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] ***
2026-08-18 13:38:58.968922 | node1 | Tuesday 18 August 2026  13:38:58 +0000 (0:00:00.097)       0:00:23.710 ********
2026-08-18 13:38:59.033706 | node1 | ok: [node1] => {
2026-08-18 13:38:59.033835 | node1 |     "changed": false,
2026-08-18 13:38:59.033863 | node1 |     "msg": "All assertions passed"
2026-08-18 13:38:59.033876 | node1 | }
2026-08-18 13:38:59.033888 | node1 | ok: [node2] => {
2026-08-18 13:38:59.034034 | node1 |     "changed": false,
2026-08-18 13:38:59.034173 | node1 |     "msg": "All assertions passed"
2026-08-18 13:38:59.034299 | node1 | }
2026-08-18 13:38:59.034448 | node1 | ok: [node3] => {
2026-08-18 13:38:59.034552 | node1 |     "changed": false,
2026-08-18 13:38:59.034713 | node1 |     "msg": "All assertions passed"
2026-08-18 13:38:59.034811 | node1 | }
2026-08-18 13:38:59.034929 | node1 |
2026-08-18 13:38:59.035067 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] *******************
2026-08-18 13:38:59.035203 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.065)       0:00:23.775 ********
2026-08-18 13:38:59.097420 | node1 | ok: [node1]
2026-08-18 13:38:59.097605 | node1 | ok: [node2]
2026-08-18 13:38:59.097818 | node1 | ok: [node3]
2026-08-18 13:38:59.098015 | node1 |
2026-08-18 13:38:59.098244 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] ***
2026-08-18 13:38:59.098467 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.063)       0:00:23.839 ********
2026-08-18 13:38:59.675419 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:38:59.675560 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:38:59.675752 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:38:59.675947 | node1 |
2026-08-18 13:38:59.676196 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] ***
2026-08-18 13:38:59.676419 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.578)       0:00:24.417 ********
2026-08-18 13:38:59.742896 | node1 | ok: [node1]
2026-08-18 13:38:59.743095 | node1 | ok: [node2]
2026-08-18 13:38:59.743293 | node1 | ok: [node3]
2026-08-18 13:38:59.743493 | node1 |
2026-08-18 13:38:59.743723 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 13:38:59.743934 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.067)       0:00:24.485 ********
2026-08-18 13:38:59.806192 | node1 | skipping: [node1]
2026-08-18 13:38:59.806387 | node1 | skipping: [node2]
2026-08-18 13:38:59.806580 | node1 | skipping: [node3]
2026-08-18 13:38:59.806764 | node1 |
2026-08-18 13:38:59.806970 | node1 | TASK [Register this monitor host] **********************************************
2026-08-18 13:38:59.807173 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.063)       0:00:24.548 ********
2026-08-18 13:38:59.917050 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:38:59.917331 | node1 |
2026-08-18 13:38:59.917556 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:38:59.917772 | node1 | Tuesday 18 August 2026  13:38:59 +0000 (0:00:00.110)       0:00:24.659 ********
2026-08-18 13:39:01.441202 | node1 | ok: [node1]
2026-08-18 13:39:01.441266 | node1 |
2026-08-18 13:39:01.441726 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:39:01.441807 | node1 | Tuesday 18 August 2026  13:39:01 +0000 (0:00:01.523)       0:00:26.183 ********
2026-08-18 13:39:01.504239 | node1 | ok: [node1]
2026-08-18 13:39:01.504308 | node1 | ok: [node2]
2026-08-18 13:39:01.504862 | node1 | ok: [node3]
2026-08-18 13:39:01.504903 | node1 |
2026-08-18 13:39:01.504918 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:39:01.504938 | node1 | Tuesday 18 August 2026  13:39:01 +0000 (0:00:00.063)       0:00:26.246 ********
2026-08-18 13:39:01.574027 | node1 | ok: [node1] => {
2026-08-18 13:39:01.575346 | node1 |     "changed": false,
2026-08-18 13:39:01.575361 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:01.575367 | node1 | }
2026-08-18 13:39:01.575371 | node1 | ok: [node2] => {
2026-08-18 13:39:01.575375 | node1 |     "changed": false,
2026-08-18 13:39:01.575379 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:01.575383 | node1 | }
2026-08-18 13:39:01.575387 | node1 | ok: [node3] => {
2026-08-18 13:39:01.575391 | node1 |     "changed": false,
2026-08-18 13:39:01.575394 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:01.575398 | node1 | }
2026-08-18 13:39:01.575402 | node1 |
2026-08-18 13:39:01.575407 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:39:01.575412 | node1 | Tuesday 18 August 2026  13:39:01 +0000 (0:00:00.069)       0:00:26.316 ********
2026-08-18 13:39:01.931265 | node1 | ok: [node2]
2026-08-18 13:39:01.931308 | node1 | ok: [node1]
2026-08-18 13:39:01.931313 | node1 | ok: [node3]
2026-08-18 13:39:01.931318 | node1 |
2026-08-18 13:39:01.931323 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:39:01.931328 | node1 | Tuesday 18 August 2026  13:39:01 +0000 (0:00:00.357)       0:00:26.673 ********
2026-08-18 13:39:02.004765 | node1 | ok: [node1]
2026-08-18 13:39:02.004809 | node1 | ok: [node2]
2026-08-18 13:39:02.004814 | node1 | ok: [node3]
2026-08-18 13:39:02.004818 | node1 |
2026-08-18 13:39:02.004822 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:39:02.004827 | node1 | Tuesday 18 August 2026  13:39:02 +0000 (0:00:00.073)       0:00:26.747 ********
2026-08-18 13:39:02.103126 | node1 | ok: [node1]
2026-08-18 13:39:02.103778 | node1 | ok: [node2]
2026-08-18 13:39:02.103830 | node1 | ok: [node3]
2026-08-18 13:39:02.103837 | node1 |
2026-08-18 13:39:02.103844 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:39:02.103851 | node1 | Tuesday 18 August 2026  13:39:02 +0000 (0:00:00.098)       0:00:26.845 ********
2026-08-18 13:39:02.181702 | node1 | ok: [node1] => {
2026-08-18 13:39:02.182057 | node1 |     "changed": false,
2026-08-18 13:39:02.182159 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:02.182183 | node1 | }
2026-08-18 13:39:02.182193 | node1 | ok: [node2] => {
2026-08-18 13:39:02.183126 | node1 |     "changed": false,
2026-08-18 13:39:02.183192 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:02.183204 | node1 | }
2026-08-18 13:39:02.183214 | node1 | ok: [node3] => {
2026-08-18 13:39:02.183223 | node1 |     "changed": false,
2026-08-18 13:39:02.183232 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:02.183241 | node1 | }
2026-08-18 13:39:02.183258 | node1 |
2026-08-18 13:39:02.183268 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:39:02.183430 | node1 | Tuesday 18 August 2026  13:39:02 +0000 (0:00:00.078)       0:00:26.924 ********
2026-08-18 13:39:03.805014 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:03.805097 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:03.805184 | node1 | ok: [node1]
2026-08-18 13:39:03.805482 | node1 |
2026-08-18 13:39:03.805528 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:39:03.805534 | node1 | Tuesday 18 August 2026  13:39:03 +0000 (0:00:01.623)       0:00:28.547 ********
2026-08-18 13:39:03.899029 | node1 | skipping: [node1]
2026-08-18 13:39:03.899095 | node1 | skipping: [node2]
2026-08-18 13:39:03.899481 | node1 | skipping: [node3]
2026-08-18 13:39:03.899499 | node1 |
2026-08-18 13:39:03.899504 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] **********************
2026-08-18 13:39:03.899526 | node1 | Tuesday 18 August 2026  13:39:03 +0000 (0:00:00.094)       0:00:28.641 ********
2026-08-18 13:39:05.528968 | node1 | ok: [node1]
2026-08-18 13:39:05.529043 | node1 |
2026-08-18 13:39:05.529360 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ********
2026-08-18 13:39:05.529382 | node1 | Tuesday 18 August 2026  13:39:05 +0000 (0:00:01.629)       0:00:30.271 ********
2026-08-18 13:39:07.249879 | node1 | ok: [node1]
2026-08-18 13:39:07.249948 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:07.250072 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:07.250143 | node1 |
2026-08-18 13:39:07.250256 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] ***********************
2026-08-18 13:39:07.250352 | node1 | Tuesday 18 August 2026  13:39:07 +0000 (0:00:01.720)       0:00:31.992 ********
2026-08-18 13:39:07.838069 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:39:07.838295 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:39:07.838508 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:39:07.838692 | node1 |
2026-08-18 13:39:07.838900 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] *******************************
2026-08-18 13:39:07.839104 | node1 | Tuesday 18 August 2026  13:39:07 +0000 (0:00:00.588)       0:00:32.580 ********
2026-08-18 13:39:07.903120 | node1 | ok: [node1]
2026-08-18 13:39:07.903238 | node1 | ok: [node2]
2026-08-18 13:39:07.903360 | node1 | ok: [node3]
2026-08-18 13:39:07.903475 | node1 |
2026-08-18 13:39:07.903619 | node1 | TASK [Register this manager host] **********************************************
2026-08-18 13:39:07.903749 | node1 | Tuesday 18 August 2026  13:39:07 +0000 (0:00:00.065)       0:00:32.646 ********
2026-08-18 13:39:08.014517 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:39:08.014565 | node1 |
2026-08-18 13:39:08.014678 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:39:08.014921 | node1 | Tuesday 18 August 2026  13:39:08 +0000 (0:00:00.110)       0:00:32.756 ********
2026-08-18 13:39:09.432869 | node1 | ok: [node1]
2026-08-18 13:39:09.433067 | node1 |
2026-08-18 13:39:09.433353 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:39:09.433581 | node1 | Tuesday 18 August 2026  13:39:09 +0000 (0:00:01.418)       0:00:34.175 ********
2026-08-18 13:39:09.499696 | node1 | ok: [node1]
2026-08-18 13:39:09.499891 | node1 | ok: [node2]
2026-08-18 13:39:09.500102 | node1 | ok: [node3]
2026-08-18 13:39:09.500284 | node1 |
2026-08-18 13:39:09.500510 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:39:09.500730 | node1 | Tuesday 18 August 2026  13:39:09 +0000 (0:00:00.067)       0:00:34.242 ********
2026-08-18 13:39:09.567041 | node1 | ok: [node1] => {
2026-08-18 13:39:09.567234 | node1 |     "changed": false,
2026-08-18 13:39:09.567441 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:09.567638 | node1 | }
2026-08-18 13:39:09.567841 | node1 | ok: [node2] => {
2026-08-18 13:39:09.568041 | node1 |     "changed": false,
2026-08-18 13:39:09.568241 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:09.568435 | node1 | }
2026-08-18 13:39:09.568632 | node1 | ok: [node3] => {
2026-08-18 13:39:09.568828 | node1 |     "changed": false,
2026-08-18 13:39:09.569033 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:09.569257 | node1 | }
2026-08-18 13:39:09.569441 | node1 |
2026-08-18 13:39:09.569658 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:39:09.569889 | node1 | Tuesday 18 August 2026  13:39:09 +0000 (0:00:00.067)       0:00:34.309 ********
2026-08-18 13:39:09.844764 | node1 | ok: [node1]
2026-08-18 13:39:09.844982 | node1 | ok: [node2]
2026-08-18 13:39:09.845232 | node1 | ok: [node3]
2026-08-18 13:39:09.845437 | node1 |
2026-08-18 13:39:09.845658 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:39:09.845867 | node1 | Tuesday 18 August 2026  13:39:09 +0000 (0:00:00.277)       0:00:34.587 ********
2026-08-18 13:39:09.904803 | node1 | ok: [node1]
2026-08-18 13:39:09.904958 | node1 | ok: [node2]
2026-08-18 13:39:09.905165 | node1 | ok: [node3]
2026-08-18 13:39:09.905405 | node1 |
2026-08-18 13:39:09.905580 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:39:09.905774 | node1 | Tuesday 18 August 2026  13:39:09 +0000 (0:00:00.060)       0:00:34.647 ********
2026-08-18 13:39:10.009001 | node1 | ok: [node1]
2026-08-18 13:39:10.009425 | node1 | ok: [node2]
2026-08-18 13:39:10.009721 | node1 | ok: [node3]
2026-08-18 13:39:10.009944 | node1 |
2026-08-18 13:39:10.010262 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:39:10.010634 | node1 | Tuesday 18 August 2026  13:39:10 +0000 (0:00:00.103)       0:00:34.751 ********
2026-08-18 13:39:10.076734 | node1 | ok: [node1] => {
2026-08-18 13:39:10.076925 | node1 |     "changed": false,
2026-08-18 13:39:10.077167 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:10.077433 | node1 | }
2026-08-18 13:39:10.077642 | node1 | ok: [node2] => {
2026-08-18 13:39:10.077796 | node1 |     "changed": false,
2026-08-18 13:39:10.078033 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:10.078273 | node1 | }
2026-08-18 13:39:10.078536 | node1 | ok: [node3] => {
2026-08-18 13:39:10.078834 | node1 |     "changed": false,
2026-08-18 13:39:10.079069 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:10.079269 | node1 | }
2026-08-18 13:39:10.079457 | node1 |
2026-08-18 13:39:10.079676 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:39:10.079889 | node1 | Tuesday 18 August 2026  13:39:10 +0000 (0:00:00.067)       0:00:34.819 ********
2026-08-18 13:39:11.604902 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:11.605016 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:11.605028 | node1 | ok: [node1]
2026-08-18 13:39:11.605204 | node1 |
2026-08-18 13:39:11.605312 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:39:11.605425 | node1 | Tuesday 18 August 2026  13:39:11 +0000 (0:00:01.528)       0:00:36.347 ********
2026-08-18 13:39:11.710900 | node1 | skipping: [node1]
2026-08-18 13:39:11.711080 | node1 | skipping: [node2]
2026-08-18 13:39:11.711341 | node1 | skipping: [node3]
2026-08-18 13:39:11.711550 | node1 |
2026-08-18 13:39:11.711782 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] **********************
2026-08-18 13:39:11.712016 | node1 | Tuesday 18 August 2026  13:39:11 +0000 (0:00:00.105)       0:00:36.453 ********
2026-08-18 13:39:13.179759 | node1 | ok: [node1]
2026-08-18 13:39:13.180140 | node1 |
2026-08-18 13:39:13.180372 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ********
2026-08-18 13:39:13.180591 | node1 | Tuesday 18 August 2026  13:39:13 +0000 (0:00:01.468)       0:00:37.921 ********
2026-08-18 13:39:14.847387 | node1 | ok: [node1]
2026-08-18 13:39:14.847456 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:14.848257 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:14.848325 | node1 |
2026-08-18 13:39:14.848337 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] **************************
2026-08-18 13:39:14.848347 | node1 | Tuesday 18 August 2026  13:39:14 +0000 (0:00:01.667)       0:00:39.589 ********
2026-08-18 13:39:24.951709 | node1 | ok: [node1] => (item={'name': 'diskprediction_local'})
2026-08-18 13:39:24.951787 | node1 | ok: [node1] => (item={'name': 'dashboard'})
2026-08-18 13:39:24.951887 | node1 | ok: [node1] => (item={'name': 'iostat'})
2026-08-18 13:39:24.952524 | node1 | ok: [node1] => (item={'name': 'prometheus'})
2026-08-18 13:39:24.952569 | node1 | ok: [node1] => (item={'name': 'rgw'})
2026-08-18 13:39:24.952575 | node1 |
2026-08-18 13:39:24.952579 | node1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-18 13:39:24.952584 | node1 |
2026-08-18 13:39:24.952588 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:39:24.952592 | node1 | Tuesday 18 August 2026  13:39:24 +0000 (0:00:10.105)       0:00:49.694 ********
2026-08-18 13:39:25.900549 | node1 | ok: [node1]
2026-08-18 13:39:25.900608 | node1 | ok: [node3]
2026-08-18 13:39:25.900686 | node1 | ok: [node2]
2026-08-18 13:39:25.900989 | node1 |
2026-08-18 13:39:25.901034 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:39:25.901040 | node1 | Tuesday 18 August 2026  13:39:25 +0000 (0:00:00.948)       0:00:50.643 ********
2026-08-18 13:39:26.146245 | node1 | ok: [node2]
2026-08-18 13:39:26.146288 | node1 | ok: [node1]
2026-08-18 13:39:26.146293 | node1 | ok: [node3]
2026-08-18 13:39:26.146297 | node1 |
2026-08-18 13:39:26.146302 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:39:26.146306 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.245)       0:00:50.888 ********
2026-08-18 13:39:26.211236 | node1 | skipping: [node1]
2026-08-18 13:39:26.211278 | node1 | skipping: [node2]
2026-08-18 13:39:26.211282 | node1 | skipping: [node3]
2026-08-18 13:39:26.211286 | node1 |
2026-08-18 13:39:26.211291 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:39:26.211295 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.065)       0:00:50.953 ********
2026-08-18 13:39:26.443856 | node1 | ok: [node1]
2026-08-18 13:39:26.443929 | node1 | ok: [node2]
2026-08-18 13:39:26.443991 | node1 | ok: [node3]
2026-08-18 13:39:26.444289 | node1 |
2026-08-18 13:39:26.444333 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:39:26.444338 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.233)       0:00:51.186 ********
2026-08-18 13:39:26.538051 | node1 | ok: [node1] => {
2026-08-18 13:39:26.538163 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:39:26.539518 | node1 | }
2026-08-18 13:39:26.539569 | node1 | ok: [node2] => {
2026-08-18 13:39:26.539577 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:39:26.539585 | node1 | }
2026-08-18 13:39:26.539592 | node1 | ok: [node3] => {
2026-08-18 13:39:26.539600 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:39:26.539608 | node1 | }
2026-08-18 13:39:26.539617 | node1 |
2026-08-18 13:39:26.539625 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:39:26.539632 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.093)       0:00:51.280 ********
2026-08-18 13:39:26.875565 | node1 | ok: [node3]
2026-08-18 13:39:26.875678 | node1 | ok: [node1]
2026-08-18 13:39:26.876068 | node1 | ok: [node2]
2026-08-18 13:39:26.876111 | node1 |
2026-08-18 13:39:26.876117 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:39:26.876122 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.337)       0:00:51.618 ********
2026-08-18 13:39:26.961422 | node1 | skipping: [node1]
2026-08-18 13:39:26.961494 | node1 | skipping: [node2]
2026-08-18 13:39:26.961895 | node1 | skipping: [node3]
2026-08-18 13:39:26.961936 | node1 |
2026-08-18 13:39:26.961941 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:39:26.961946 | node1 | Tuesday 18 August 2026  13:39:26 +0000 (0:00:00.085)       0:00:51.704 ********
2026-08-18 13:39:27.050629 | node1 | skipping: [node1]
2026-08-18 13:39:27.050701 | node1 | skipping: [node2]
2026-08-18 13:39:27.051085 | node1 | skipping: [node3]
2026-08-18 13:39:27.051130 | node1 |
2026-08-18 13:39:27.051135 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:39:27.051140 | node1 | Tuesday 18 August 2026  13:39:27 +0000 (0:00:00.089)       0:00:51.793 ********
2026-08-18 13:39:27.279512 | node1 | ok: [node1]
2026-08-18 13:39:27.279573 | node1 | ok: [node3]
2026-08-18 13:39:27.279956 | node1 | ok: [node2]
2026-08-18 13:39:27.280003 | node1 |
2026-08-18 13:39:27.280008 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:39:27.280013 | node1 | Tuesday 18 August 2026  13:39:27 +0000 (0:00:00.228)       0:00:52.022 ********
2026-08-18 13:39:28.508751 | node1 | ok: [node1]
2026-08-18 13:39:28.508827 | node1 | ok: [node3]
2026-08-18 13:39:28.509276 | node1 | ok: [node2]
2026-08-18 13:39:28.509355 | node1 |
2026-08-18 13:39:28.509366 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:39:28.509377 | node1 | Tuesday 18 August 2026  13:39:28 +0000 (0:00:01.229)       0:00:53.251 ********
2026-08-18 13:39:28.608294 | node1 | ok: [node1] => {
2026-08-18 13:39:28.609212 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:39:28.609293 | node1 | }
2026-08-18 13:39:28.609307 | node1 | ok: [node2] => {
2026-08-18 13:39:28.609318 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:39:28.609328 | node1 | }
2026-08-18 13:39:28.609338 | node1 | ok: [node3] => {
2026-08-18 13:39:28.609356 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:39:28.609367 | node1 | }
2026-08-18 13:39:28.609688 | node1 |
2026-08-18 13:39:28.609731 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:39:28.609737 | node1 | Tuesday 18 August 2026  13:39:28 +0000 (0:00:00.099)       0:00:53.350 ********
2026-08-18 13:39:28.961364 | node1 | ok: [node1]
2026-08-18 13:39:28.961432 | node1 | ok: [node2]
2026-08-18 13:39:28.961763 | node1 | ok: [node3]
2026-08-18 13:39:28.961778 | node1 |
2026-08-18 13:39:28.961783 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:39:28.961789 | node1 | Tuesday 18 August 2026  13:39:28 +0000 (0:00:00.353)       0:00:53.704 ********
2026-08-18 13:39:30.961772 | node1 | ok: [node2]
2026-08-18 13:39:30.961850 | node1 | ok: [node3]
2026-08-18 13:39:30.961924 | node1 | ok: [node1]
2026-08-18 13:39:30.962220 | node1 |
2026-08-18 13:39:30.962263 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:39:30.962269 | node1 | Tuesday 18 August 2026  13:39:30 +0000 (0:00:02.000)       0:00:55.704 ********
2026-08-18 13:39:30.991477 | node1 | skipping: [node1]
2026-08-18 13:39:31.016568 | node1 | skipping: [node2]
2026-08-18 13:39:31.016756 | node1 | skipping: [node3]
2026-08-18 13:39:31.016881 | node1 |
2026-08-18 13:39:31.017011 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:39:31.017171 | node1 | Tuesday 18 August 2026  13:39:31 +0000 (0:00:00.054)       0:00:55.759 ********
2026-08-18 13:39:31.067715 | node1 | skipping: [node1]
2026-08-18 13:39:31.067820 | node1 | skipping: [node2]
2026-08-18 13:39:31.067940 | node1 | skipping: [node3]
2026-08-18 13:39:31.068052 | node1 |
2026-08-18 13:39:31.068181 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:39:31.068308 | node1 | Tuesday 18 August 2026  13:39:31 +0000 (0:00:00.051)       0:00:55.810 ********
2026-08-18 13:39:31.120510 | node1 | skipping: [node1]
2026-08-18 13:39:31.120608 | node1 | skipping: [node2]
2026-08-18 13:39:31.120727 | node1 | skipping: [node3]
2026-08-18 13:39:31.120841 | node1 |
2026-08-18 13:39:31.120969 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:39:31.121094 | node1 | Tuesday 18 August 2026  13:39:31 +0000 (0:00:00.052)       0:00:55.863 ********
2026-08-18 13:39:32.237368 | node1 | ok: [node3]
2026-08-18 13:39:32.237559 | node1 | ok: [node1]
2026-08-18 13:39:32.237782 | node1 | ok: [node2]
2026-08-18 13:39:32.237967 | node1 |
2026-08-18 13:39:32.238186 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:39:32.238390 | node1 | Tuesday 18 August 2026  13:39:32 +0000 (0:00:01.116)       0:00:56.979 ********
2026-08-18 13:39:32.673405 | node1 | ok: [node1]
2026-08-18 13:39:32.673612 | node1 | ok: [node2]
2026-08-18 13:39:32.673821 | node1 | ok: [node3]
2026-08-18 13:39:32.674025 | node1 |
2026-08-18 13:39:32.674253 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:39:32.674492 | node1 | Tuesday 18 August 2026  13:39:32 +0000 (0:00:00.435)       0:00:57.415 ********
2026-08-18 13:39:33.581863 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:39:33.581916 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:39:33.585159 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:39:33.585465 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:39:33.585478 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:39:33.585487 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:39:33.585496 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:39:33.585505 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:39:33.585531 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:39:33.585558 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:39:33.585568 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:39:33.585577 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:39:33.585585 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:39:33.585595 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:39:33.585604 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:39:33.585613 | node1 |
2026-08-18 13:39:33.585622 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:39:33.585631 | node1 | Tuesday 18 August 2026  13:39:33 +0000 (0:00:00.908)       0:00:58.324 ********
2026-08-18 13:39:34.158010 | node1 | ok: [node1]
2026-08-18 13:39:34.158075 | node1 | ok: [node3]
2026-08-18 13:39:34.159315 | node1 | ok: [node2]
2026-08-18 13:39:34.159360 | node1 |
2026-08-18 13:39:34.159365 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:39:34.159370 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.556)       0:00:58.880 ********
2026-08-18 13:39:34.159375 | node1 |
2026-08-18 13:39:34.159379 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:39:34.159383 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.007)       0:00:58.887 ********
2026-08-18 13:39:34.159386 | node1 |
2026-08-18 13:39:34.159390 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:39:34.159394 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.004)       0:00:58.892 ********
2026-08-18 13:39:34.159398 | node1 |
2026-08-18 13:39:34.159402 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:39:34.159406 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.008)       0:00:58.900 ********
2026-08-18 13:39:34.556926 | node1 | ok: [node1]
2026-08-18 13:39:34.556988 | node1 | ok: [node2]
2026-08-18 13:39:34.557025 | node1 | ok: [node3]
2026-08-18 13:39:34.557194 | node1 |
2026-08-18 13:39:34.557277 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:39:34.557374 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.398)       0:00:59.299 ********
2026-08-18 13:39:34.790838 | node1 | ok: [node1]
2026-08-18 13:39:34.790878 | node1 | ok: [node2]
2026-08-18 13:39:34.790883 | node1 | ok: [node3]
2026-08-18 13:39:34.790888 | node1 |
2026-08-18 13:39:34.790893 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:39:34.790897 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.233)       0:00:59.533 ********
2026-08-18 13:39:34.880416 | node1 | ok: [node1] => {
2026-08-18 13:39:34.881193 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:39:34.881262 | node1 | }
2026-08-18 13:39:34.881274 | node1 | ok: [node2] => {
2026-08-18 13:39:34.881285 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:39:34.881295 | node1 | }
2026-08-18 13:39:34.881311 | node1 | ok: [node3] => {
2026-08-18 13:39:34.881880 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:39:34.881927 | node1 | }
2026-08-18 13:39:34.881934 | node1 |
2026-08-18 13:39:34.881940 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:39:34.881946 | node1 | Tuesday 18 August 2026  13:39:34 +0000 (0:00:00.089)       0:00:59.622 ********
2026-08-18 13:39:35.266358 | node1 | ok: [node1]
2026-08-18 13:39:35.266428 | node1 | ok: [node3]
2026-08-18 13:39:35.266441 | node1 | ok: [node2]
2026-08-18 13:39:35.266746 | node1 |
2026-08-18 13:39:35.266785 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:39:35.266798 | node1 | Tuesday 18 August 2026  13:39:35 +0000 (0:00:00.386)       0:01:00.008 ********
2026-08-18 13:39:38.464793 | node1 | ok: [node1]
2026-08-18 13:39:38.464859 | node1 | ok: [node2]
2026-08-18 13:39:38.465230 | node1 | ok: [node3]
2026-08-18 13:39:38.465297 | node1 |
2026-08-18 13:39:38.465309 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:39:38.465325 | node1 | Tuesday 18 August 2026  13:39:38 +0000 (0:00:03.198)       0:01:03.207 ********
2026-08-18 13:39:39.601414 | node1 | ok: [node1]
2026-08-18 13:39:39.601507 | node1 | ok: [node2]
2026-08-18 13:39:39.602030 | node1 | ok: [node3]
2026-08-18 13:39:39.602079 | node1 |
2026-08-18 13:39:39.602086 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:39:39.602093 | node1 | Tuesday 18 August 2026  13:39:39 +0000 (0:00:01.136)       0:01:04.344 ********
2026-08-18 13:39:39.820956 | node1 | ok: [node1]
2026-08-18 13:39:39.821011 | node1 | ok: [node2]
2026-08-18 13:39:39.821131 | node1 | ok: [node3]
2026-08-18 13:39:39.821450 | node1 |
2026-08-18 13:39:39.821499 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:39:39.821505 | node1 | Tuesday 18 August 2026  13:39:39 +0000 (0:00:00.219)       0:01:04.563 ********
2026-08-18 13:39:40.278038 | node1 | ok: [node1]
2026-08-18 13:39:40.278092 | node1 | ok: [node3]
2026-08-18 13:39:40.278189 | node1 | ok: [node2]
2026-08-18 13:39:40.278478 | node1 |
2026-08-18 13:39:40.278493 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:39:40.278513 | node1 | Tuesday 18 August 2026  13:39:40 +0000 (0:00:00.456)       0:01:05.020 ********
2026-08-18 13:39:40.853718 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:39:40.853782 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:39:40.853888 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:39:40.854759 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:39:40.854803 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:39:40.854808 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:39:40.854813 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:39:40.854817 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:39:40.854821 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:39:40.854826 | node1 |
2026-08-18 13:39:40.854830 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:39:40.854835 | node1 | Tuesday 18 August 2026  13:39:40 +0000 (0:00:00.575)       0:01:05.596 ********
2026-08-18 13:39:41.305176 | node1 | ok: [node2]
2026-08-18 13:39:41.305852 | node1 | ok: [node1]
2026-08-18 13:39:41.305901 | node1 | ok: [node3]
2026-08-18 13:39:41.305909 | node1 |
2026-08-18 13:39:41.305915 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:39:41.305922 | node1 | Tuesday 18 August 2026  13:39:41 +0000 (0:00:00.451)       0:01:06.047 ********
2026-08-18 13:39:41.773963 | node1 | ok: [node2]
2026-08-18 13:39:41.774036 | node1 | ok: [node1]
2026-08-18 13:39:41.775609 | node1 | ok: [node3]
2026-08-18 13:39:41.775658 | node1 |
2026-08-18 13:39:41.775665 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:39:41.775672 | node1 | Tuesday 18 August 2026  13:39:41 +0000 (0:00:00.448)       0:01:06.496 ********
2026-08-18 13:39:41.775678 | node1 |
2026-08-18 13:39:41.775684 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:39:41.775689 | node1 | Tuesday 18 August 2026  13:39:41 +0000 (0:00:00.007)       0:01:06.503 ********
2026-08-18 13:39:41.775695 | node1 |
2026-08-18 13:39:41.775700 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:39:41.775706 | node1 | Tuesday 18 August 2026  13:39:41 +0000 (0:00:00.005)       0:01:06.509 ********
2026-08-18 13:39:41.775711 | node1 |
2026-08-18 13:39:41.775717 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:39:41.775722 | node1 | Tuesday 18 August 2026  13:39:41 +0000 (0:00:00.007)       0:01:06.516 ********
2026-08-18 13:39:42.171017 | node1 | ok: [node2]
2026-08-18 13:39:42.171086 | node1 | ok: [node1]
2026-08-18 13:39:42.171516 | node1 | ok: [node3]
2026-08-18 13:39:42.171597 | node1 |
2026-08-18 13:39:42.171604 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:39:42.171611 | node1 | Tuesday 18 August 2026  13:39:42 +0000 (0:00:00.396)       0:01:06.913 ********
2026-08-18 13:39:42.234033 | node1 | ok: [node1] => {
2026-08-18 13:39:42.234121 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:39:42.234133 | node1 | }
2026-08-18 13:39:42.234937 | node1 | ok: [node2] => {
2026-08-18 13:39:42.234976 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:39:42.234982 | node1 | }
2026-08-18 13:39:42.234987 | node1 | ok: [node3] => {
2026-08-18 13:39:42.234991 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:39:42.234995 | node1 | }
2026-08-18 13:39:42.235000 | node1 |
2026-08-18 13:39:42.235004 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:39:42.235008 | node1 | Tuesday 18 August 2026  13:39:42 +0000 (0:00:00.063)       0:01:06.976 ********
2026-08-18 13:39:42.542865 | node1 | ok: [node1]
2026-08-18 13:39:42.542935 | node1 | ok: [node3]
2026-08-18 13:39:42.543298 | node1 | ok: [node2]
2026-08-18 13:39:42.543343 | node1 |
2026-08-18 13:39:42.543349 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:39:42.543354 | node1 | Tuesday 18 August 2026  13:39:42 +0000 (0:00:00.308)       0:01:07.285 ********
2026-08-18 13:39:42.572287 | node1 | skipping: [node1]
2026-08-18 13:39:42.611643 | node1 | skipping: [node2]
2026-08-18 13:39:42.611710 | node1 | skipping: [node3]
2026-08-18 13:39:42.611724 | node1 |
2026-08-18 13:39:42.611853 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:39:42.611972 | node1 | Tuesday 18 August 2026  13:39:42 +0000 (0:00:00.069)       0:01:07.354 ********
2026-08-18 13:39:42.644855 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:39:42.687073 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:39:42.687141 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:39:42.687231 | node1 |
2026-08-18 13:39:42.687444 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:39:42.687481 | node1 | Tuesday 18 August 2026  13:39:42 +0000 (0:00:00.075)       0:01:07.430 ********
2026-08-18 13:39:43.760693 | node1 | ok: [node2]
2026-08-18 13:39:43.760738 | node1 | ok: [node1]
2026-08-18 13:39:43.760745 | node1 | ok: [node3]
2026-08-18 13:39:43.760751 | node1 |
2026-08-18 13:39:43.760757 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:39:43.760764 | node1 | Tuesday 18 August 2026  13:39:43 +0000 (0:00:01.072)       0:01:08.502 ********
2026-08-18 13:39:44.450722 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:39:44.450787 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:39:44.451134 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:39:44.451197 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:39:44.451216 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:39:44.451720 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:39:44.451744 | node1 |
2026-08-18 13:39:44.451751 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:39:44.451758 | node1 | Tuesday 18 August 2026  13:39:44 +0000 (0:00:00.690)       0:01:09.193 ********
2026-08-18 13:39:44.673192 | node1 | ok: [node1]
2026-08-18 13:39:44.673427 | node1 | ok: [node2]
2026-08-18 13:39:44.673435 | node1 | ok: [node3]
2026-08-18 13:39:44.673442 | node1 |
2026-08-18 13:39:44.673455 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:39:44.673466 | node1 | Tuesday 18 August 2026  13:39:44 +0000 (0:00:00.221)       0:01:09.415 ********
2026-08-18 13:39:44.966274 | node1 | ok: [node1]
2026-08-18 13:39:44.966318 | node1 | ok: [node2]
2026-08-18 13:39:44.966333 | node1 | ok: [node3]
2026-08-18 13:39:44.966338 | node1 |
2026-08-18 13:39:44.966343 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:39:44.966347 | node1 | Tuesday 18 August 2026  13:39:44 +0000 (0:00:00.293)       0:01:09.708 ********
2026-08-18 13:39:45.411431 | node1 | ok: [node1]
2026-08-18 13:39:45.411513 | node1 | ok: [node2]
2026-08-18 13:39:45.411520 | node1 | ok: [node3]
2026-08-18 13:39:45.411527 | node1 |
2026-08-18 13:39:45.411534 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:39:45.411541 | node1 | Tuesday 18 August 2026  13:39:45 +0000 (0:00:00.444)       0:01:10.152 ********
2026-08-18 13:39:45.478806 | node1 | skipping: [node1]
2026-08-18 13:39:45.478883 | node1 | skipping: [node2]
2026-08-18 13:39:45.478889 | node1 | skipping: [node3]
2026-08-18 13:39:45.478896 | node1 |
2026-08-18 13:39:45.478902 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:39:45.478909 | node1 | Tuesday 18 August 2026  13:39:45 +0000 (0:00:00.067)       0:01:10.220 ********
2026-08-18 13:39:45.871426 | node1 | ok: [node2]
2026-08-18 13:39:45.871546 | node1 | ok: [node3]
2026-08-18 13:39:45.871624 | node1 | ok: [node1]
2026-08-18 13:39:45.872046 | node1 |
2026-08-18 13:39:45.872107 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:39:45.872115 | node1 | Tuesday 18 August 2026  13:39:45 +0000 (0:00:00.393)       0:01:10.614 ********
2026-08-18 13:39:46.330223 | node1 | ok: [node2]
2026-08-18 13:39:46.330292 | node1 | ok: [node3]
2026-08-18 13:39:46.330663 | node1 | ok: [node1]
2026-08-18 13:39:46.330708 | node1 |
2026-08-18 13:39:46.330713 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] ***********************
2026-08-18 13:39:46.330719 | node1 | Tuesday 18 August 2026  13:39:46 +0000 (0:00:00.458)       0:01:11.072 ********
2026-08-18 13:39:46.990421 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:39:46.990490 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:39:46.990583 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:39:46.990877 | node1 |
2026-08-18 13:39:46.990921 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] *******
2026-08-18 13:39:46.990926 | node1 | Tuesday 18 August 2026  13:39:46 +0000 (0:00:00.660)       0:01:11.733 ********
2026-08-18 13:39:47.070763 | node1 | ok: [node1]
2026-08-18 13:39:47.070835 | node1 | ok: [node2]
2026-08-18 13:39:47.071223 | node1 | ok: [node3]
2026-08-18 13:39:47.071263 | node1 |
2026-08-18 13:39:47.071268 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] ***********************
2026-08-18 13:39:47.071273 | node1 | Tuesday 18 August 2026  13:39:47 +0000 (0:00:00.080)       0:01:11.813 ********
2026-08-18 13:39:47.139729 | node1 | ok: [node1]
2026-08-18 13:39:47.139785 | node1 | ok: [node2]
2026-08-18 13:39:47.140156 | node1 | ok: [node3]
2026-08-18 13:39:47.140197 | node1 |
2026-08-18 13:39:47.140202 | node1 | TASK [Register this OSD host] **************************************************
2026-08-18 13:39:47.140207 | node1 | Tuesday 18 August 2026  13:39:47 +0000 (0:00:00.069)       0:01:11.882 ********
2026-08-18 13:39:47.284468 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:39:47.284542 | node1 |
2026-08-18 13:39:47.284737 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:39:47.284782 | node1 | Tuesday 18 August 2026  13:39:47 +0000 (0:00:00.144)       0:01:12.027 ********
2026-08-18 13:39:48.717347 | node1 | ok: [node1]
2026-08-18 13:39:48.717454 | node1 |
2026-08-18 13:39:48.717758 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:39:48.717807 | node1 | Tuesday 18 August 2026  13:39:48 +0000 (0:00:01.432)       0:01:13.459 ********
2026-08-18 13:39:48.784460 | node1 | ok: [node1]
2026-08-18 13:39:48.784542 | node1 | ok: [node2]
2026-08-18 13:39:48.784930 | node1 | ok: [node3]
2026-08-18 13:39:48.784968 | node1 |
2026-08-18 13:39:48.784973 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:39:48.784978 | node1 | Tuesday 18 August 2026  13:39:48 +0000 (0:00:00.067)       0:01:13.527 ********
2026-08-18 13:39:48.837792 | node1 | ok: [node1] => {
2026-08-18 13:39:48.837887 | node1 |     "changed": false,
2026-08-18 13:39:48.839140 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:48.839191 | node1 | }
2026-08-18 13:39:48.839198 | node1 | ok: [node2] => {
2026-08-18 13:39:48.839205 | node1 |     "changed": false,
2026-08-18 13:39:48.839211 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:48.839216 | node1 | }
2026-08-18 13:39:48.839222 | node1 | ok: [node3] => {
2026-08-18 13:39:48.839227 | node1 |     "changed": false,
2026-08-18 13:39:48.839232 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:48.839238 | node1 | }
2026-08-18 13:39:48.839243 | node1 |
2026-08-18 13:39:48.839250 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:39:48.839256 | node1 | Tuesday 18 August 2026  13:39:48 +0000 (0:00:00.053)       0:01:13.580 ********
2026-08-18 13:39:49.112431 | node1 | ok: [node1]
2026-08-18 13:39:49.112500 | node1 | ok: [node2]
2026-08-18 13:39:49.112864 | node1 | ok: [node3]
2026-08-18 13:39:49.112881 | node1 |
2026-08-18 13:39:49.112886 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:39:49.112892 | node1 | Tuesday 18 August 2026  13:39:49 +0000 (0:00:00.274)       0:01:13.855 ********
2026-08-18 13:39:49.177675 | node1 | ok: [node1]
2026-08-18 13:39:49.177738 | node1 | ok: [node2]
2026-08-18 13:39:49.178254 | node1 | ok: [node3]
2026-08-18 13:39:49.178307 | node1 |
2026-08-18 13:39:49.178318 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:39:49.178408 | node1 | Tuesday 18 August 2026  13:39:49 +0000 (0:00:00.064)       0:01:13.920 ********
2026-08-18 13:39:49.294621 | node1 | ok: [node1]
2026-08-18 13:39:49.294683 | node1 | ok: [node2]
2026-08-18 13:39:49.294690 | node1 | ok: [node3]
2026-08-18 13:39:49.294696 | node1 |
2026-08-18 13:39:49.294702 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:39:49.294709 | node1 | Tuesday 18 August 2026  13:39:49 +0000 (0:00:00.116)       0:01:14.036 ********
2026-08-18 13:39:49.359162 | node1 | ok: [node1] => {
2026-08-18 13:39:49.359270 | node1 |     "changed": false,
2026-08-18 13:39:49.360846 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:49.360893 | node1 | }
2026-08-18 13:39:49.360900 | node1 | ok: [node2] => {
2026-08-18 13:39:49.360906 | node1 |     "changed": false,
2026-08-18 13:39:49.360913 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:49.360918 | node1 | }
2026-08-18 13:39:49.360923 | node1 | ok: [node3] => {
2026-08-18 13:39:49.360929 | node1 |     "changed": false,
2026-08-18 13:39:49.360934 | node1 |     "msg": "All assertions passed"
2026-08-18 13:39:49.360940 | node1 | }
2026-08-18 13:39:49.360945 | node1 |
2026-08-18 13:39:49.360951 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:39:49.360958 | node1 | Tuesday 18 August 2026  13:39:49 +0000 (0:00:00.065)       0:01:14.101 ********
2026-08-18 13:39:50.949429 | node1 | ok: [node1]
2026-08-18 13:39:50.950061 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:50.950106 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:50.950113 | node1 |
2026-08-18 13:39:50.950119 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:39:50.950132 | node1 | Tuesday 18 August 2026  13:39:50 +0000 (0:00:01.590)       0:01:15.691 ********
2026-08-18 13:39:51.019303 | node1 | skipping: [node1]
2026-08-18 13:39:51.019367 | node1 | skipping: [node2]
2026-08-18 13:39:51.019752 | node1 | skipping: [node3]
2026-08-18 13:39:51.019797 | node1 |
2026-08-18 13:39:51.019803 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] **************
2026-08-18 13:39:51.019808 | node1 | Tuesday 18 August 2026  13:39:51 +0000 (0:00:00.070)       0:01:15.762 ********
2026-08-18 13:39:51.043573 | node1 | skipping: [node1]
2026-08-18 13:39:51.043700 | node1 |
2026-08-18 13:39:51.044013 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] *********
2026-08-18 13:39:51.044059 | node1 | Tuesday 18 August 2026  13:39:51 +0000 (0:00:00.024)       0:01:15.786 ********
2026-08-18 13:39:52.309403 | node1 | ok: [node1]
2026-08-18 13:39:52.309490 | node1 | ok: [node2]
2026-08-18 13:39:52.309504 | node1 | ok: [node3]
2026-08-18 13:39:52.309823 | node1 |
2026-08-18 13:39:52.309866 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ********
2026-08-18 13:39:52.309882 | node1 | Tuesday 18 August 2026  13:39:52 +0000 (0:00:01.265)       0:01:17.052 ********
2026-08-18 13:39:52.344509 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd0/data)
2026-08-18 13:39:52.416477 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd1/data)
2026-08-18 13:39:52.416504 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd0/data)
2026-08-18 13:39:52.416511 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd2/data)
2026-08-18 13:39:52.417937 | node1 | skipping: [node1]
2026-08-18 13:39:52.417957 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd1/data)
2026-08-18 13:39:52.417964 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd0/data)
2026-08-18 13:39:52.417970 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd2/data)
2026-08-18 13:39:52.417978 | node1 | skipping: [node2]
2026-08-18 13:39:52.417985 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd1/data)
2026-08-18 13:39:52.417992 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd2/data)
2026-08-18 13:39:52.417998 | node1 | skipping: [node3]
2026-08-18 13:39:52.418004 | node1 |
2026-08-18 13:39:52.418010 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] ***
2026-08-18 13:39:52.418016 | node1 | Tuesday 18 August 2026  13:39:52 +0000 (0:00:00.106)       0:01:17.158 ********
2026-08-18 13:39:54.023173 | node1 | ok: [node1]
2026-08-18 13:39:54.023235 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:54.023247 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:39:54.023264 | node1 |
2026-08-18 13:39:54.023416 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] ***
2026-08-18 13:39:54.023626 | node1 | Tuesday 18 August 2026  13:39:54 +0000 (0:00:01.606)       0:01:18.764 ********
2026-08-18 13:39:54.089631 | node1 | skipping: [node1]
2026-08-18 13:39:54.089830 | node1 |
2026-08-18 13:39:54.090038 | node1 | PLAY [Apply Ceph configuration] ************************************************
2026-08-18 13:39:54.090215 | node1 |
2026-08-18 13:39:54.090416 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:39:54.090616 | node1 | Tuesday 18 August 2026  13:39:54 +0000 (0:00:00.067)       0:01:18.832 ********
2026-08-18 13:39:55.063873 | node1 | ok: [node2]
2026-08-18 13:39:55.063928 | node1 | ok: [node1]
2026-08-18 13:39:55.064428 | node1 | ok: [node3]
2026-08-18 13:39:55.064445 | node1 |
2026-08-18 13:39:55.064451 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] *****************
2026-08-18 13:39:55.064458 | node1 | Tuesday 18 August 2026  13:39:55 +0000 (0:00:00.973)       0:01:19.806 ********
2026-08-18 13:39:55.606326 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:39:55.606377 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:39:55.606395 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:39:55.606632 | node1 |
2026-08-18 13:39:55.606818 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] *************************
2026-08-18 13:39:55.607041 | node1 | Tuesday 18 August 2026  13:39:55 +0000 (0:00:00.542)       0:01:20.348 ********
2026-08-18 13:39:55.659993 | node1 | ok: [node1]
2026-08-18 13:39:55.660131 | node1 | ok: [node2]
2026-08-18 13:39:55.660344 | node1 | ok: [node3]
2026-08-18 13:39:55.660533 | node1 |
2026-08-18 13:39:55.660735 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] *****************
2026-08-18 13:39:55.660937 | node1 | Tuesday 18 August 2026  13:39:55 +0000 (0:00:00.053)       0:01:20.402 ********
2026-08-18 13:39:55.714836 | node1 | ok: [node1]
2026-08-18 13:39:55.714893 | node1 | ok: [node2]
2026-08-18 13:39:55.715037 | node1 | ok: [node3]
2026-08-18 13:39:55.715155 | node1 |
2026-08-18 13:39:55.715300 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:39:55.715437 | node1 | Tuesday 18 August 2026  13:39:55 +0000 (0:00:00.055)       0:01:20.457 ********
2026-08-18 13:39:55.777999 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3
2026-08-18 13:39:55.778166 | node1 |
2026-08-18 13:39:55.778384 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 13:39:55.778591 | node1 | Tuesday 18 August 2026  13:39:55 +0000 (0:00:00.063)       0:01:20.520 ********
2026-08-18 13:40:04.634408 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/standby_behaviour)
2026-08-18 13:40:04.634620 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY)
2026-08-18 13:40:04.634837 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS)
2026-08-18 13:40:04.635051 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI)
2026-08-18 13:40:04.635263 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING)
2026-08-18 13:40:04.635472 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS)
2026-08-18 13:40:04.635649 | node1 |
2026-08-18 13:40:04.635875 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:40:04.636075 | node1 | Tuesday 18 August 2026  13:40:04 +0000 (0:00:08.856)       0:01:29.376 ********
2026-08-18 13:40:04.698340 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3
2026-08-18 13:40:04.698515 | node1 |
2026-08-18 13:40:04.698770 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 13:40:04.698978 | node1 | Tuesday 18 August 2026  13:40:04 +0000 (0:00:00.063)       0:01:29.440 ********
2026-08-18 13:40:06.363689 | node1 | ok: [node1] => (item=ec_hdd_s3)
2026-08-18 13:40:06.363817 | node1 |
2026-08-18 13:40:06.363834 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:40:06.363845 | node1 | Tuesday 18 August 2026  13:40:06 +0000 (0:00:01.664)       0:01:31.104 ********
2026-08-18 13:40:06.437076 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3
2026-08-18 13:40:06.437199 | node1 |
2026-08-18 13:40:06.437475 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 13:40:06.437567 | node1 | Tuesday 18 August 2026  13:40:06 +0000 (0:00:00.074)       0:01:31.179 ********
2026-08-18 13:40:10.891384 | node1 | ok: [node1] => (item=rep_hdd)
2026-08-18 13:40:10.891459 | node1 | ok: [node1] => (item=rep_lab)
2026-08-18 13:40:10.891842 | node1 | ok: [node1] => (item=ec_hdd_s3)
2026-08-18 13:40:10.891890 | node1 |
2026-08-18 13:40:10.891902 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:40:10.891908 | node1 | Tuesday 18 August 2026  13:40:10 +0000 (0:00:04.454)       0:01:35.634 ********
2026-08-18 13:40:10.962700 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3
2026-08-18 13:40:10.962787 | node1 |
2026-08-18 13:40:10.962850 | node1 | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 13:40:10.962973 | node1 | Tuesday 18 August 2026  13:40:10 +0000 (0:00:00.071)       0:01:35.705 ********
2026-08-18 13:40:42.666399 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.data)
2026-08-18 13:40:42.666480 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.index)
2026-08-18 13:40:42.667364 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.non-ec)
2026-08-18 13:40:42.667414 | node1 | ok: [node1] => (item=molecule-1.rgw.control)
2026-08-18 13:40:42.667422 | node1 | ok: [node1] => (item=molecule-1.rgw.log)
2026-08-18 13:40:42.667428 | node1 | ok: [node1] => (item=molecule-1.rgw.meta)
2026-08-18 13:40:42.667434 | node1 |
2026-08-18 13:40:42.667440 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] **************************
2026-08-18 13:40:42.667446 | node1 | Tuesday 18 August 2026  13:40:42 +0000 (0:00:31.703)       0:02:07.408 ********
2026-08-18 13:40:42.694760 | node1 | skipping: [node1]
2026-08-18 13:40:42.724144 | node1 | skipping: [node2]
2026-08-18 13:40:42.724235 | node1 | skipping: [node3]
2026-08-18 13:40:42.724680 | node1 |
2026-08-18 13:40:42.724732 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] **********
2026-08-18 13:40:42.724740 | node1 | Tuesday 18 August 2026  13:40:42 +0000 (0:00:00.057)       0:02:07.466 ********
2026-08-18 13:40:42.799090 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3
2026-08-18 13:40:42.799188 | node1 |
2026-08-18 13:40:42.799201 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] ***
2026-08-18 13:40:42.799335 | node1 | Tuesday 18 August 2026  13:40:42 +0000 (0:00:00.075)       0:02:07.541 ********
2026-08-18 13:40:44.538225 | node1 | ok: [node1]
2026-08-18 13:40:44.538312 | node1 |
2026-08-18 13:40:44.538629 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] *********
2026-08-18 13:40:44.538675 | node1 | Tuesday 18 August 2026  13:40:44 +0000 (0:00:01.738)       0:02:09.280 ********
2026-08-18 13:40:46.261214 | node1 | ok: [node1]
2026-08-18 13:40:46.261295 | node1 |
2026-08-18 13:40:46.261307 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] *****************
2026-08-18 13:40:46.261425 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:01.723)       0:02:11.003 ********
2026-08-18 13:40:46.297492 | node1 | skipping: [node1]
2026-08-18 13:40:46.297943 | node1 |
2026-08-18 13:40:46.298480 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] *************
2026-08-18 13:40:46.298498 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.036)       0:02:11.039 ********
2026-08-18 13:40:46.333337 | node1 | skipping: [node1]
2026-08-18 13:40:46.333757 | node1 |
2026-08-18 13:40:46.333810 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:40:46.333817 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.035)       0:02:11.075 ********
2026-08-18 13:40:46.370120 | node1 | skipping: [node1]
2026-08-18 13:40:46.370212 | node1 |
2026-08-18 13:40:46.370529 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] **************
2026-08-18 13:40:46.370552 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.037)       0:02:11.112 ********
2026-08-18 13:40:46.406814 | node1 | skipping: [node1]
2026-08-18 13:40:46.407449 | node1 |
2026-08-18 13:40:46.407487 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 13:40:46.407498 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.036)       0:02:11.149 ********
2026-08-18 13:40:46.442103 | node1 | skipping: [node1]
2026-08-18 13:40:46.442216 | node1 |
2026-08-18 13:40:46.442232 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] ***
2026-08-18 13:40:46.442275 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.035)       0:02:11.184 ********
2026-08-18 13:40:46.490212 | node1 | skipping: [node1] => (item=ceph mgr module disable dashboard)
2026-08-18 13:40:46.490451 | node1 | skipping: [node1] => (item=ceph mgr module enable dashboard)
2026-08-18 13:40:46.490630 | node1 | skipping: [node1] => (item=ceph orch reconfig mgr)
2026-08-18 13:40:46.490803 | node1 | skipping: [node1]
2026-08-18 13:40:46.490967 | node1 |
2026-08-18 13:40:46.491144 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:40:46.491315 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.047)       0:02:11.232 ********
2026-08-18 13:40:46.573309 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3
2026-08-18 13:40:46.573380 | node1 |
2026-08-18 13:40:46.573399 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 13:40:46.573495 | node1 | Tuesday 18 August 2026  13:40:46 +0000 (0:00:00.083)       0:02:11.315 ********
2026-08-18 13:40:52.856020 | node1 | ok: [node1] => (item=None)
2026-08-18 13:40:52.856090 | node1 | ok: [node1] => (item=None)
2026-08-18 13:40:52.856155 | node1 | ok: [node1 -> {{ ceph_configure_admin_host }}]
2026-08-18 13:40:52.856617 | node1 |
2026-08-18 13:40:52.856657 | node1 | PLAY [Deploy Ceph RADOS Gateways] **********************************************
2026-08-18 13:40:52.856662 | node1 |
2026-08-18 13:40:52.856667 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:40:52.856676 | node1 | Tuesday 18 August 2026  13:40:52 +0000 (0:00:06.283)       0:02:17.599 ********
2026-08-18 13:40:53.880199 | node1 | ok: [node1]
2026-08-18 13:40:53.880480 | node1 | ok: [node3]
2026-08-18 13:40:53.880530 | node1 | ok: [node2]
2026-08-18 13:40:53.880625 | node1 |
2026-08-18 13:40:53.880742 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:40:53.880852 | node1 | Tuesday 18 August 2026  13:40:53 +0000 (0:00:01.022)       0:02:18.621 ********
2026-08-18 13:40:54.128391 | node1 | ok: [node1]
2026-08-18 13:40:54.128632 | node1 | ok: [node2]
2026-08-18 13:40:54.128903 | node1 | ok: [node3]
2026-08-18 13:40:54.129143 | node1 |
2026-08-18 13:40:54.129400 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:40:54.129642 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.248)       0:02:18.870 ********
2026-08-18 13:40:54.205584 | node1 | skipping: [node1]
2026-08-18 13:40:54.205771 | node1 | skipping: [node2]
2026-08-18 13:40:54.205967 | node1 | skipping: [node3]
2026-08-18 13:40:54.206149 | node1 |
2026-08-18 13:40:54.206409 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:40:54.206671 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.077)       0:02:18.948 ********
2026-08-18 13:40:54.440600 | node1 | ok: [node1]
2026-08-18 13:40:54.440833 | node1 | ok: [node2]
2026-08-18 13:40:54.441025 | node1 | ok: [node3]
2026-08-18 13:40:54.441297 | node1 |
2026-08-18 13:40:54.441527 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:40:54.441741 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.235)       0:02:19.183 ********
2026-08-18 13:40:54.534694 | node1 | ok: [node1] => {
2026-08-18 13:40:54.534761 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:40:54.534905 | node1 | }
2026-08-18 13:40:54.535030 | node1 | ok: [node2] => {
2026-08-18 13:40:54.535175 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:40:54.535299 | node1 | }
2026-08-18 13:40:54.535429 | node1 | ok: [node3] => {
2026-08-18 13:40:54.535556 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:40:54.535677 | node1 | }
2026-08-18 13:40:54.535797 | node1 |
2026-08-18 13:40:54.535924 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:40:54.536134 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.094)       0:02:19.277 ********
2026-08-18 13:40:54.869181 | node1 | ok: [node1]
2026-08-18 13:40:54.869278 | node1 | ok: [node2]
2026-08-18 13:40:54.869422 | node1 | ok: [node3]
2026-08-18 13:40:54.869540 | node1 |
2026-08-18 13:40:54.869678 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:40:54.869806 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.334)       0:02:19.611 ********
2026-08-18 13:40:54.945838 | node1 | skipping: [node1]
2026-08-18 13:40:54.946016 | node1 | skipping: [node2]
2026-08-18 13:40:54.946306 | node1 | skipping: [node3]
2026-08-18 13:40:54.946529 | node1 |
2026-08-18 13:40:54.946774 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:40:54.947011 | node1 | Tuesday 18 August 2026  13:40:54 +0000 (0:00:00.076)       0:02:19.688 ********
2026-08-18 13:40:55.030472 | node1 | skipping: [node1]
2026-08-18 13:40:55.030685 | node1 | skipping: [node2]
2026-08-18 13:40:55.030907 | node1 | skipping: [node3]
2026-08-18 13:40:55.031146 | node1 |
2026-08-18 13:40:55.031380 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:40:55.031596 | node1 | Tuesday 18 August 2026  13:40:55 +0000 (0:00:00.084)       0:02:19.772 ********
2026-08-18 13:40:55.261861 | node1 | ok: [node1]
2026-08-18 13:40:55.262046 | node1 | ok: [node3]
2026-08-18 13:40:55.262244 | node1 | ok: [node2]
2026-08-18 13:40:55.262432 | node1 |
2026-08-18 13:40:55.262639 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:40:55.262842 | node1 | Tuesday 18 August 2026  13:40:55 +0000 (0:00:00.231)       0:02:20.004 ********
2026-08-18 13:40:56.315945 | node1 | ok: [node1]
2026-08-18 13:40:56.316015 | node1 | ok: [node3]
2026-08-18 13:40:56.316026 | node1 | ok: [node2]
2026-08-18 13:40:56.316035 | node1 |
2026-08-18 13:40:56.316045 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:40:56.316054 | node1 | Tuesday 18 August 2026  13:40:56 +0000 (0:00:01.052)       0:02:21.057 ********
2026-08-18 13:40:56.410818 | node1 | ok: [node1] => {
2026-08-18 13:40:56.412168 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:40:56.412218 | node1 | }
2026-08-18 13:40:56.412225 | node1 | ok: [node2] => {
2026-08-18 13:40:56.412232 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:40:56.412237 | node1 | }
2026-08-18 13:40:56.412243 | node1 | ok: [node3] => {
2026-08-18 13:40:56.412248 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:40:56.412254 | node1 | }
2026-08-18 13:40:56.412259 | node1 |
2026-08-18 13:40:56.412265 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:40:56.412271 | node1 | Tuesday 18 August 2026  13:40:56 +0000 (0:00:00.096)       0:02:21.153 ********
2026-08-18 13:40:56.776245 | node1 | ok: [node2]
2026-08-18 13:40:56.776337 | node1 | ok: [node1]
2026-08-18 13:40:56.776919 | node1 | ok: [node3]
2026-08-18 13:40:56.776941 | node1 |
2026-08-18 13:40:56.776948 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:40:56.776954 | node1 | Tuesday 18 August 2026  13:40:56 +0000 (0:00:00.365)       0:02:21.518 ********
2026-08-18 13:40:58.760061 | node1 | ok: [node2]
2026-08-18 13:40:58.760138 | node1 | ok: [node1]
2026-08-18 13:40:58.760143 | node1 | ok: [node3]
2026-08-18 13:40:58.760148 | node1 |
2026-08-18 13:40:58.760154 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:40:58.760159 | node1 | Tuesday 18 August 2026  13:40:58 +0000 (0:00:01.982)       0:02:23.501 ********
2026-08-18 13:40:58.819942 | node1 | skipping: [node1]
2026-08-18 13:40:58.820001 | node1 | skipping: [node2]
2026-08-18 13:40:58.820006 | node1 | skipping: [node3]
2026-08-18 13:40:58.820011 | node1 |
2026-08-18 13:40:58.820016 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:40:58.820021 | node1 | Tuesday 18 August 2026  13:40:58 +0000 (0:00:00.060)       0:02:23.561 ********
2026-08-18 13:40:58.879949 | node1 | skipping: [node1]
2026-08-18 13:40:58.880022 | node1 | skipping: [node2]
2026-08-18 13:40:58.880027 | node1 | skipping: [node3]
2026-08-18 13:40:58.880042 | node1 |
2026-08-18 13:40:58.880047 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:40:58.880053 | node1 | Tuesday 18 August 2026  13:40:58 +0000 (0:00:00.060)       0:02:23.621 ********
2026-08-18 13:40:58.940032 | node1 | skipping: [node1]
2026-08-18 13:40:58.940098 | node1 | skipping: [node2]
2026-08-18 13:40:58.940103 | node1 | skipping: [node3]
2026-08-18 13:40:58.940108 | node1 |
2026-08-18 13:40:58.940114 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:40:58.940119 | node1 | Tuesday 18 August 2026  13:40:58 +0000 (0:00:00.060)       0:02:23.682 ********
2026-08-18 13:41:00.265252 | node1 | ok: [node1]
2026-08-18 13:41:00.265370 | node1 | ok: [node3]
2026-08-18 13:41:00.265406 | node1 | ok: [node2]
2026-08-18 13:41:00.265433 | node1 |
2026-08-18 13:41:00.265668 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:41:00.265725 | node1 | Tuesday 18 August 2026  13:41:00 +0000 (0:00:01.325)       0:02:25.007 ********
2026-08-18 13:41:00.731023 | node1 | ok: [node3]
2026-08-18 13:41:00.731096 | node1 | ok: [node2]
2026-08-18 13:41:00.731712 | node1 | ok: [node1]
2026-08-18 13:41:00.731764 | node1 |
2026-08-18 13:41:00.731771 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:41:00.731778 | node1 | Tuesday 18 August 2026  13:41:00 +0000 (0:00:00.465)       0:02:25.473 ********
2026-08-18 13:41:01.687026 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:01.687095 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:01.688563 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:01.688841 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:01.688848 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:01.688852 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:01.688868 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:01.688873 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:01.688877 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:01.688881 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:01.688886 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:01.688890 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:01.688894 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:01.688899 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:01.688903 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:01.688907 | node1 |
2026-08-18 13:41:01.688911 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:41:01.688915 | node1 | Tuesday 18 August 2026  13:41:01 +0000 (0:00:00.956)       0:02:26.429 ********
2026-08-18 13:41:02.247462 | node1 | ok: [node1]
2026-08-18 13:41:02.247505 | node1 | ok: [node2]
2026-08-18 13:41:02.247510 | node1 | ok: [node3]
2026-08-18 13:41:02.247514 | node1 |
2026-08-18 13:41:02.247519 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:02.247523 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.543)       0:02:26.973 ********
2026-08-18 13:41:02.247527 | node1 |
2026-08-18 13:41:02.247531 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:02.247535 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.005)       0:02:26.978 ********
2026-08-18 13:41:02.247539 | node1 |
2026-08-18 13:41:02.247543 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:02.247547 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.004)       0:02:26.983 ********
2026-08-18 13:41:02.247551 | node1 |
2026-08-18 13:41:02.247555 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:41:02.247559 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.005)       0:02:26.989 ********
2026-08-18 13:41:02.631104 | node1 | ok: [node1]
2026-08-18 13:41:02.631177 | node1 | ok: [node2]
2026-08-18 13:41:02.631550 | node1 | ok: [node3]
2026-08-18 13:41:02.631594 | node1 |
2026-08-18 13:41:02.631600 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:41:02.631605 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.384)       0:02:27.373 ********
2026-08-18 13:41:02.864561 | node1 | ok: [node1]
2026-08-18 13:41:02.864627 | node1 | ok: [node2]
2026-08-18 13:41:02.864979 | node1 | ok: [node3]
2026-08-18 13:41:02.864995 | node1 |
2026-08-18 13:41:02.865000 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:02.865005 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.233)       0:02:27.607 ********
2026-08-18 13:41:02.957406 | node1 | ok: [node1] => {
2026-08-18 13:41:02.958149 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:02.958214 | node1 | }
2026-08-18 13:41:02.958225 | node1 | ok: [node2] => {
2026-08-18 13:41:02.958235 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:02.958244 | node1 | }
2026-08-18 13:41:02.958259 | node1 | ok: [node3] => {
2026-08-18 13:41:02.958834 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:02.958862 | node1 | }
2026-08-18 13:41:02.958873 | node1 |
2026-08-18 13:41:02.958881 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:02.958890 | node1 | Tuesday 18 August 2026  13:41:02 +0000 (0:00:00.092)       0:02:27.700 ********
2026-08-18 13:41:03.356469 | node1 | ok: [node2]
2026-08-18 13:41:03.356517 | node1 | ok: [node3]
2026-08-18 13:41:03.356536 | node1 | ok: [node1]
2026-08-18 13:41:03.356542 | node1 |
2026-08-18 13:41:03.356549 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:03.356555 | node1 | Tuesday 18 August 2026  13:41:03 +0000 (0:00:00.398)       0:02:28.098 ********
2026-08-18 13:41:06.542868 | node1 | ok: [node1]
2026-08-18 13:41:06.542919 | node1 | ok: [node2]
2026-08-18 13:41:06.543340 | node1 | ok: [node3]
2026-08-18 13:41:06.543412 | node1 |
2026-08-18 13:41:06.543429 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:41:06.543444 | node1 | Tuesday 18 August 2026  13:41:06 +0000 (0:00:03.187)       0:02:31.285 ********
2026-08-18 13:41:07.629722 | node1 | ok: [node3]
2026-08-18 13:41:07.629824 | node1 | ok: [node2]
2026-08-18 13:41:07.629957 | node1 | ok: [node1]
2026-08-18 13:41:07.630083 | node1 |
2026-08-18 13:41:07.630225 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:41:07.630365 | node1 | Tuesday 18 August 2026  13:41:07 +0000 (0:00:01.086)       0:02:32.372 ********
2026-08-18 13:41:07.835532 | node1 | ok: [node2]
2026-08-18 13:41:07.835589 | node1 | ok: [node3]
2026-08-18 13:41:07.835596 | node1 | ok: [node1]
2026-08-18 13:41:07.835602 | node1 |
2026-08-18 13:41:07.835609 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:41:07.835615 | node1 | Tuesday 18 August 2026  13:41:07 +0000 (0:00:00.204)       0:02:32.576 ********
2026-08-18 13:41:08.296662 | node1 | ok: [node1]
2026-08-18 13:41:08.296728 | node1 | ok: [node2]
2026-08-18 13:41:08.296820 | node1 | ok: [node3]
2026-08-18 13:41:08.297159 | node1 |
2026-08-18 13:41:08.297204 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:41:08.297215 | node1 | Tuesday 18 August 2026  13:41:08 +0000 (0:00:00.462)       0:02:33.039 ********
2026-08-18 13:41:08.866763 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:41:08.866843 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:41:08.867771 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:41:08.867817 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:08.867823 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:08.867828 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:08.867832 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:08.867837 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:08.867841 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:08.867845 | node1 |
2026-08-18 13:41:08.867850 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:41:08.867854 | node1 | Tuesday 18 August 2026  13:41:08 +0000 (0:00:00.570)       0:02:33.609 ********
2026-08-18 13:41:09.304168 | node1 | ok: [node1]
2026-08-18 13:41:09.304239 | node1 | ok: [node3]
2026-08-18 13:41:09.304737 | node1 | ok: [node2]
2026-08-18 13:41:09.304765 | node1 |
2026-08-18 13:41:09.304772 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:41:09.304779 | node1 | Tuesday 18 August 2026  13:41:09 +0000 (0:00:00.437)       0:02:34.046 ********
2026-08-18 13:41:09.763804 | node1 | ok: [node1]
2026-08-18 13:41:09.763873 | node1 | ok: [node3]
2026-08-18 13:41:09.765003 | node1 | ok: [node2]
2026-08-18 13:41:09.765076 | node1 |
2026-08-18 13:41:09.765082 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:09.765088 | node1 | Tuesday 18 August 2026  13:41:09 +0000 (0:00:00.439)       0:02:34.486 ********
2026-08-18 13:41:09.765093 | node1 |
2026-08-18 13:41:09.765097 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:09.765101 | node1 | Tuesday 18 August 2026  13:41:09 +0000 (0:00:00.006)       0:02:34.493 ********
2026-08-18 13:41:09.765105 | node1 |
2026-08-18 13:41:09.765110 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:09.765114 | node1 | Tuesday 18 August 2026  13:41:09 +0000 (0:00:00.006)       0:02:34.499 ********
2026-08-18 13:41:09.765118 | node1 |
2026-08-18 13:41:09.765318 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:41:09.765330 | node1 | Tuesday 18 August 2026  13:41:09 +0000 (0:00:00.006)       0:02:34.506 ********
2026-08-18 13:41:10.142966 | node1 | ok: [node1]
2026-08-18 13:41:10.143086 | node1 | ok: [node3]
2026-08-18 13:41:10.143097 | node1 | ok: [node2]
2026-08-18 13:41:10.143439 | node1 |
2026-08-18 13:41:10.143496 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:10.143502 | node1 | Tuesday 18 August 2026  13:41:10 +0000 (0:00:00.379)       0:02:34.885 ********
2026-08-18 13:41:10.210216 | node1 | ok: [node1] => {
2026-08-18 13:41:10.210302 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:10.211353 | node1 | }
2026-08-18 13:41:10.211431 | node1 | ok: [node2] => {
2026-08-18 13:41:10.211438 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:10.211444 | node1 | }
2026-08-18 13:41:10.211448 | node1 | ok: [node3] => {
2026-08-18 13:41:10.211452 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:10.211456 | node1 | }
2026-08-18 13:41:10.211461 | node1 |
2026-08-18 13:41:10.211466 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:10.211471 | node1 | Tuesday 18 August 2026  13:41:10 +0000 (0:00:00.066)       0:02:34.952 ********
2026-08-18 13:41:10.512200 | node1 | ok: [node1]
2026-08-18 13:41:10.512245 | node1 | ok: [node2]
2026-08-18 13:41:10.512251 | node1 | ok: [node3]
2026-08-18 13:41:10.512258 | node1 |
2026-08-18 13:41:10.512264 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:10.512270 | node1 | Tuesday 18 August 2026  13:41:10 +0000 (0:00:00.301)       0:02:35.254 ********
2026-08-18 13:41:10.579179 | node1 | skipping: [node1]
2026-08-18 13:41:10.579235 | node1 | skipping: [node2]
2026-08-18 13:41:10.579242 | node1 | skipping: [node3]
2026-08-18 13:41:10.579248 | node1 |
2026-08-18 13:41:10.579254 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:41:10.579259 | node1 | Tuesday 18 August 2026  13:41:10 +0000 (0:00:00.067)       0:02:35.321 ********
2026-08-18 13:41:10.658782 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:10.658832 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:10.658838 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:10.658844 | node1 |
2026-08-18 13:41:10.658850 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:41:10.658857 | node1 | Tuesday 18 August 2026  13:41:10 +0000 (0:00:00.079)       0:02:35.400 ********
2026-08-18 13:41:11.753664 | node1 | ok: [node1]
2026-08-18 13:41:11.753796 | node1 | ok: [node3]
2026-08-18 13:41:11.753810 | node1 | ok: [node2]
2026-08-18 13:41:11.753878 | node1 |
2026-08-18 13:41:11.754048 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:41:11.754245 | node1 | Tuesday 18 August 2026  13:41:11 +0000 (0:00:01.095)       0:02:36.496 ********
2026-08-18 13:41:12.455605 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:41:12.455669 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:41:12.455681 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:41:12.455690 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:41:12.455699 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:41:12.455707 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:41:12.455719 | node1 |
2026-08-18 13:41:12.455729 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:41:12.455739 | node1 | Tuesday 18 August 2026  13:41:12 +0000 (0:00:00.700)       0:02:37.196 ********
2026-08-18 13:41:12.673273 | node1 | ok: [node1]
2026-08-18 13:41:12.673350 | node1 | ok: [node3]
2026-08-18 13:41:12.673361 | node1 | ok: [node2]
2026-08-18 13:41:12.673370 | node1 |
2026-08-18 13:41:12.673380 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:41:12.673397 | node1 | Tuesday 18 August 2026  13:41:12 +0000 (0:00:00.218)       0:02:37.414 ********
2026-08-18 13:41:12.929042 | node1 | ok: [node1]
2026-08-18 13:41:12.929227 | node1 | ok: [node2]
2026-08-18 13:41:12.929447 | node1 | ok: [node3]
2026-08-18 13:41:12.929645 | node1 |
2026-08-18 13:41:12.929855 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:41:12.930063 | node1 | Tuesday 18 August 2026  13:41:12 +0000 (0:00:00.256)       0:02:37.671 ********
2026-08-18 13:41:13.365294 | node1 | ok: [node1]
2026-08-18 13:41:13.365363 | node1 | ok: [node2]
2026-08-18 13:41:13.365479 | node1 | ok: [node3]
2026-08-18 13:41:13.365601 | node1 |
2026-08-18 13:41:13.365739 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:41:13.365899 | node1 | Tuesday 18 August 2026  13:41:13 +0000 (0:00:00.436)       0:02:38.107 ********
2026-08-18 13:41:13.423463 | node1 | skipping: [node1]
2026-08-18 13:41:13.423556 | node1 | skipping: [node2]
2026-08-18 13:41:13.423647 | node1 | skipping: [node3]
2026-08-18 13:41:13.423734 | node1 |
2026-08-18 13:41:13.423839 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:41:13.423935 | node1 | Tuesday 18 August 2026  13:41:13 +0000 (0:00:00.058)       0:02:38.166 ********
2026-08-18 13:41:13.811059 | node1 | ok: [node1]
2026-08-18 13:41:13.811134 | node1 | ok: [node2]
2026-08-18 13:41:13.811208 | node1 | ok: [node3]
2026-08-18 13:41:13.811296 | node1 |
2026-08-18 13:41:13.811416 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:41:13.811503 | node1 | Tuesday 18 August 2026  13:41:13 +0000 (0:00:00.387)       0:02:38.553 ********
2026-08-18 13:41:14.303659 | node1 | ok: [node2]
2026-08-18 13:41:14.303748 | node1 | ok: [node3]
2026-08-18 13:41:14.304033 | node1 | ok: [node1]
2026-08-18 13:41:14.304232 | node1 |
2026-08-18 13:41:14.304437 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] ***********************
2026-08-18 13:41:14.304653 | node1 | Tuesday 18 August 2026  13:41:14 +0000 (0:00:00.492)       0:02:39.045 ********
2026-08-18 13:41:14.905467 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:41:14.905574 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:41:14.905714 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:41:14.905823 | node1 |
2026-08-18 13:41:14.905967 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] *******************************
2026-08-18 13:41:14.906070 | node1 | Tuesday 18 August 2026  13:41:14 +0000 (0:00:00.602)       0:02:39.648 ********
2026-08-18 13:41:14.978882 | node1 | ok: [node1]
2026-08-18 13:41:14.979052 | node1 | ok: [node2]
2026-08-18 13:41:14.979254 | node1 | ok: [node3]
2026-08-18 13:41:14.979444 | node1 |
2026-08-18 13:41:14.979659 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] ***********************
2026-08-18 13:41:14.979865 | node1 | Tuesday 18 August 2026  13:41:14 +0000 (0:00:00.073)       0:02:39.721 ********
2026-08-18 13:41:15.045257 | node1 | ok: [node1]
2026-08-18 13:41:15.045483 | node1 | ok: [node2]
2026-08-18 13:41:15.045693 | node1 | ok: [node3]
2026-08-18 13:41:15.045893 | node1 |
2026-08-18 13:41:15.046120 | node1 | TASK [Register this RGW host] **************************************************
2026-08-18 13:41:15.046318 | node1 | Tuesday 18 August 2026  13:41:15 +0000 (0:00:00.066)       0:02:39.787 ********
2026-08-18 13:41:15.155745 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3
2026-08-18 13:41:15.155935 | node1 |
2026-08-18 13:41:15.156179 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 13:41:15.156417 | node1 | Tuesday 18 August 2026  13:41:15 +0000 (0:00:00.110)       0:02:39.898 ********
2026-08-18 13:41:16.648383 | node1 | ok: [node1]
2026-08-18 13:41:16.648449 | node1 |
2026-08-18 13:41:16.648457 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 13:41:16.648464 | node1 | Tuesday 18 August 2026  13:41:16 +0000 (0:00:01.492)       0:02:41.390 ********
2026-08-18 13:41:16.710931 | node1 | ok: [node1]
2026-08-18 13:41:16.711007 | node1 | ok: [node2]
2026-08-18 13:41:16.711068 | node1 | ok: [node3]
2026-08-18 13:41:16.711362 | node1 |
2026-08-18 13:41:16.711407 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 13:41:16.711425 | node1 | Tuesday 18 August 2026  13:41:16 +0000 (0:00:00.063)       0:02:41.453 ********
2026-08-18 13:41:16.775735 | node1 | ok: [node1] => {
2026-08-18 13:41:16.777028 | node1 |     "changed": false,
2026-08-18 13:41:16.777072 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:16.777078 | node1 | }
2026-08-18 13:41:16.777082 | node1 | ok: [node2] => {
2026-08-18 13:41:16.777087 | node1 |     "changed": false,
2026-08-18 13:41:16.777091 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:16.777094 | node1 | }
2026-08-18 13:41:16.777098 | node1 | ok: [node3] => {
2026-08-18 13:41:16.777102 | node1 |     "changed": false,
2026-08-18 13:41:16.777106 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:16.777110 | node1 | }
2026-08-18 13:41:16.777114 | node1 |
2026-08-18 13:41:16.777123 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 13:41:16.777128 | node1 | Tuesday 18 August 2026  13:41:16 +0000 (0:00:00.064)       0:02:41.518 ********
2026-08-18 13:41:17.092473 | node1 | ok: [node1]
2026-08-18 13:41:17.092543 | node1 | ok: [node3]
2026-08-18 13:41:17.092622 | node1 | ok: [node2]
2026-08-18 13:41:17.092709 | node1 |
2026-08-18 13:41:17.092816 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 13:41:17.092913 | node1 | Tuesday 18 August 2026  13:41:17 +0000 (0:00:00.317)       0:02:41.835 ********
2026-08-18 13:41:17.158382 | node1 | ok: [node1]
2026-08-18 13:41:17.158625 | node1 | ok: [node2]
2026-08-18 13:41:17.158852 | node1 | ok: [node3]
2026-08-18 13:41:17.159054 | node1 |
2026-08-18 13:41:17.159290 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 13:41:17.159514 | node1 | Tuesday 18 August 2026  13:41:17 +0000 (0:00:00.065)       0:02:41.900 ********
2026-08-18 13:41:17.255776 | node1 | ok: [node1]
2026-08-18 13:41:17.255948 | node1 | ok: [node2]
2026-08-18 13:41:17.256139 | node1 | ok: [node3]
2026-08-18 13:41:17.256319 | node1 |
2026-08-18 13:41:17.256535 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 13:41:17.256734 | node1 | Tuesday 18 August 2026  13:41:17 +0000 (0:00:00.097)       0:02:41.998 ********
2026-08-18 13:41:17.316140 | node1 | ok: [node1] => {
2026-08-18 13:41:17.316318 | node1 |     "changed": false,
2026-08-18 13:41:17.316517 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:17.316704 | node1 | }
2026-08-18 13:41:17.316897 | node1 | ok: [node2] => {
2026-08-18 13:41:17.317110 | node1 |     "changed": false,
2026-08-18 13:41:17.317348 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:17.317533 | node1 | }
2026-08-18 13:41:17.317724 | node1 | ok: [node3] => {
2026-08-18 13:41:17.317911 | node1 |     "changed": false,
2026-08-18 13:41:17.318104 | node1 |     "msg": "All assertions passed"
2026-08-18 13:41:17.318286 | node1 | }
2026-08-18 13:41:17.318463 | node1 |
2026-08-18 13:41:17.318666 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 13:41:17.318862 | node1 | Tuesday 18 August 2026  13:41:17 +0000 (0:00:00.060)       0:02:42.058 ********
2026-08-18 13:41:18.813421 | node1 | ok: [node1]
2026-08-18 13:41:18.813503 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:41:18.813517 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})]
2026-08-18 13:41:18.813608 | node1 |
2026-08-18 13:41:18.813704 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 13:41:18.813803 | node1 | Tuesday 18 August 2026  13:41:18 +0000 (0:00:01.497)       0:02:43.555 ********
2026-08-18 13:41:18.899223 | node1 | skipping: [node1]
2026-08-18 13:41:18.899408 | node1 | skipping: [node2]
2026-08-18 13:41:18.899616 | node1 | skipping: [node3]
2026-08-18 13:41:18.899808 | node1 |
2026-08-18 13:41:18.900035 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] ****
2026-08-18 13:41:18.900249 | node1 | Tuesday 18 August 2026  13:41:18 +0000 (0:00:00.085)       0:02:43.641 ********
2026-08-18 13:41:18.947085 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1
2026-08-18 13:41:18.947264 | node1 |
2026-08-18 13:41:18.947493 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ********************************
2026-08-18 13:41:18.947698 | node1 | Tuesday 18 August 2026  13:41:18 +0000 (0:00:00.048)       0:02:43.690 ********
2026-08-18 13:41:20.132130 | node1 | ok: [node1] => (item=molecule)
2026-08-18 13:41:20.132195 | node1 |
2026-08-18 13:41:20.132207 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] ****************************
2026-08-18 13:41:20.132217 | node1 | Tuesday 18 August 2026  13:41:20 +0000 (0:00:01.183)       0:02:44.873 ********
2026-08-18 13:41:22.151859 | node1 | ok: [node1] => (item=molecule)
2026-08-18 13:41:22.151907 | node1 |
2026-08-18 13:41:22.151912 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] *********************************
2026-08-18 13:41:22.151917 | node1 | Tuesday 18 August 2026  13:41:22 +0000 (0:00:02.020)       0:02:46.894 ********
2026-08-18 13:41:25.484534 | node1 | ok: [node1] => (item=None)
2026-08-18 13:41:25.484619 | node1 | ok: [node1 -> {{ ceph_rgw_admin_host }}]
2026-08-18 13:41:25.484703 | node1 |
2026-08-18 13:41:25.484803 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] *******************************
2026-08-18 13:41:25.484896 | node1 | Tuesday 18 August 2026  13:41:25 +0000 (0:00:03.332)       0:02:50.226 ********
2026-08-18 13:41:25.546573 | node1 | skipping: [node1]
2026-08-18 13:41:25.546759 | node1 |
2026-08-18 13:41:25.546972 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:41:25.547187 | node1 | Tuesday 18 August 2026  13:41:25 +0000 (0:00:00.062)       0:02:50.288 ********
2026-08-18 13:41:25.597041 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1
2026-08-18 13:41:25.597211 | node1 |
2026-08-18 13:41:25.597467 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ******************
2026-08-18 13:41:25.597715 | node1 | Tuesday 18 August 2026  13:41:25 +0000 (0:00:00.050)       0:02:50.339 ********
2026-08-18 13:41:27.182902 | node1 | ok: [node1]
2026-08-18 13:41:27.182979 | node1 |
2026-08-18 13:41:27.183059 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] *************
2026-08-18 13:41:27.183160 | node1 | Tuesday 18 August 2026  13:41:27 +0000 (0:00:01.585)       0:02:51.924 ********
2026-08-18 13:41:27.227236 | node1 | ok: [node1]
2026-08-18 13:41:27.227410 | node1 |
2026-08-18 13:41:27.227558 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 13:41:27.227694 | node1 | Tuesday 18 August 2026  13:41:27 +0000 (0:00:00.044)       0:02:51.969 ********
2026-08-18 13:41:28.756002 | node1 | ok: [node1] => (item=molecule)
2026-08-18 13:41:28.756064 | node1 |
2026-08-18 13:41:28.756167 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] ***
2026-08-18 13:41:28.756296 | node1 | Tuesday 18 August 2026  13:41:28 +0000 (0:00:01.529)       0:02:53.498 ********
2026-08-18 13:41:28.812259 | node1 | skipping: [node1] => (item=rgw.molecule)
2026-08-18 13:41:28.812329 | node1 | skipping: [node1]
2026-08-18 13:41:28.812641 | node1 |
2026-08-18 13:41:28.812682 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] *********
2026-08-18 13:41:28.812688 | node1 | Tuesday 18 August 2026  13:41:28 +0000 (0:00:00.055)       0:02:53.554 ********
2026-08-18 13:41:28.872502 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1
2026-08-18 13:41:28.872541 | node1 |
2026-08-18 13:41:28.872784 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] **************************************
2026-08-18 13:41:28.872828 | node1 | Tuesday 18 August 2026  13:41:28 +0000 (0:00:00.060)       0:02:53.615 ********
2026-08-18 13:41:29.944508 | node1 | ok: [node1]
2026-08-18 13:41:29.944563 | node1 |
2026-08-18 13:41:29.944568 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************
2026-08-18 13:41:29.944573 | node1 | Tuesday 18 August 2026  13:41:29 +0000 (0:00:01.072)       0:02:54.687 ********
2026-08-18 13:41:29.985834 | node1 | skipping: [node1]
2026-08-18 13:41:29.985866 | node1 |
2026-08-18 13:41:29.985873 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] *****************************
2026-08-18 13:41:29.985879 | node1 | Tuesday 18 August 2026  13:41:29 +0000 (0:00:00.041)       0:02:54.728 ********
2026-08-18 13:41:30.022672 | node1 | skipping: [node1]
2026-08-18 13:41:30.023022 | node1 |
2026-08-18 13:41:30.023070 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] ***************
2026-08-18 13:41:30.023116 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.037)       0:02:54.765 ********
2026-08-18 13:41:30.058217 | node1 | skipping: [node1]
2026-08-18 13:41:30.058301 | node1 |
2026-08-18 13:41:30.058518 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] *********************************
2026-08-18 13:41:30.058565 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.035)       0:02:54.800 ********
2026-08-18 13:41:30.094442 | node1 | skipping: [node1]
2026-08-18 13:41:30.094523 | node1 |
2026-08-18 13:41:30.094590 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************
2026-08-18 13:41:30.094717 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.036)       0:02:54.837 ********
2026-08-18 13:41:30.170336 | node1 | skipping: [node1] => (item=default.rgw.control)
2026-08-18 13:41:30.170415 | node1 | skipping: [node1] => (item=default.rgw.log)
2026-08-18 13:41:30.170914 | node1 | skipping: [node1] => (item=default.rgw.meta)
2026-08-18 13:41:30.170961 | node1 | skipping: [node1]
2026-08-18 13:41:30.170966 | node1 |
2026-08-18 13:41:30.170971 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ********
2026-08-18 13:41:30.170976 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.075)       0:02:54.913 ********
2026-08-18 13:41:30.207565 | node1 | skipping: [node1]
2026-08-18 13:41:30.207633 | node1 |
2026-08-18 13:41:30.207808 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] **********
2026-08-18 13:41:30.207826 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.037)       0:02:54.950 ********
2026-08-18 13:41:30.291356 | node1 | skipping: [node1]
2026-08-18 13:41:30.291423 | node1 |
2026-08-18 13:41:30.291765 | node1 | PLAY [Deploy Ceph monitoring stack] ********************************************
2026-08-18 13:41:30.291783 | node1 |
2026-08-18 13:41:30.291790 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:41:30.291796 | node1 | Tuesday 18 August 2026  13:41:30 +0000 (0:00:00.083)       0:02:55.034 ********
2026-08-18 13:41:32.241227 | node1 | ok: [node1]
2026-08-18 13:41:32.241373 | node1 | ok: [node3]
2026-08-18 13:41:32.241385 | node1 | ok: [node2]
2026-08-18 13:41:32.241395 | node1 |
2026-08-18 13:41:32.241497 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:41:32.241515 | node1 | Tuesday 18 August 2026  13:41:32 +0000 (0:00:01.949)       0:02:56.983 ********
2026-08-18 13:41:32.510364 | node1 | ok: [node1]
2026-08-18 13:41:32.510469 | node1 | ok: [node2]
2026-08-18 13:41:32.510481 | node1 | ok: [node3]
2026-08-18 13:41:32.510550 | node1 |
2026-08-18 13:41:32.510798 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:41:32.510856 | node1 | Tuesday 18 August 2026  13:41:32 +0000 (0:00:00.269)       0:02:57.253 ********
2026-08-18 13:41:32.597008 | node1 | skipping: [node1]
2026-08-18 13:41:32.597077 | node1 | skipping: [node2]
2026-08-18 13:41:32.597499 | node1 | skipping: [node3]
2026-08-18 13:41:32.597570 | node1 |
2026-08-18 13:41:32.597576 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 13:41:32.597582 | node1 | Tuesday 18 August 2026  13:41:32 +0000 (0:00:00.086)       0:02:57.339 ********
2026-08-18 13:41:32.835955 | node1 | ok: [node1]
2026-08-18 13:41:32.836051 | node1 | ok: [node2]
2026-08-18 13:41:32.836056 | node1 | ok: [node3]
2026-08-18 13:41:32.836377 | node1 |
2026-08-18 13:41:32.836425 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:32.836432 | node1 | Tuesday 18 August 2026  13:41:32 +0000 (0:00:00.239)       0:02:57.578 ********
2026-08-18 13:41:32.944905 | node1 | ok: [node1] => {
2026-08-18 13:41:32.944982 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:41:32.945185 | node1 | }
2026-08-18 13:41:32.945241 | node1 | ok: [node2] => {
2026-08-18 13:41:32.945279 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:41:32.945963 | node1 | }
2026-08-18 13:41:32.946047 | node1 | ok: [node3] => {
2026-08-18 13:41:32.946055 | node1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 13:41:32.946079 | node1 | }
2026-08-18 13:41:32.946084 | node1 |
2026-08-18 13:41:32.946089 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:32.946094 | node1 | Tuesday 18 August 2026  13:41:32 +0000 (0:00:00.108)       0:02:57.686 ********
2026-08-18 13:41:33.283711 | node1 | ok: [node1]
2026-08-18 13:41:33.283785 | node1 | ok: [node3]
2026-08-18 13:41:33.284370 | node1 | ok: [node2]
2026-08-18 13:41:33.284421 | node1 |
2026-08-18 13:41:33.284430 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:33.284438 | node1 | Tuesday 18 August 2026  13:41:33 +0000 (0:00:00.339)       0:02:58.026 ********
2026-08-18 13:41:33.373278 | node1 | skipping: [node1]
2026-08-18 13:41:33.373344 | node1 | skipping: [node2]
2026-08-18 13:41:33.373722 | node1 | skipping: [node3]
2026-08-18 13:41:33.373766 | node1 |
2026-08-18 13:41:33.373771 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:41:33.373776 | node1 | Tuesday 18 August 2026  13:41:33 +0000 (0:00:00.089)       0:02:58.116 ********
2026-08-18 13:41:33.405346 | node1 | skipping: [node1]
2026-08-18 13:41:33.464819 | node1 | skipping: [node2]
2026-08-18 13:41:33.464914 | node1 | skipping: [node3]
2026-08-18 13:41:33.465001 | node1 |
2026-08-18 13:41:33.465276 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:41:33.465321 | node1 | Tuesday 18 August 2026  13:41:33 +0000 (0:00:00.091)       0:02:58.207 ********
2026-08-18 13:41:33.710106 | node1 | ok: [node1]
2026-08-18 13:41:33.710148 | node1 | ok: [node2]
2026-08-18 13:41:33.710153 | node1 | ok: [node3]
2026-08-18 13:41:33.710158 | node1 |
2026-08-18 13:41:33.710162 | node1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 13:41:33.710167 | node1 | Tuesday 18 August 2026  13:41:33 +0000 (0:00:00.244)       0:02:58.452 ********
2026-08-18 13:41:34.932758 | node1 | ok: [node3]
2026-08-18 13:41:34.932831 | node1 | ok: [node1]
2026-08-18 13:41:34.932899 | node1 | ok: [node2]
2026-08-18 13:41:34.933291 | node1 |
2026-08-18 13:41:34.933336 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:34.933350 | node1 | Tuesday 18 August 2026  13:41:34 +0000 (0:00:01.223)       0:02:59.675 ********
2026-08-18 13:41:35.034827 | node1 | ok: [node1] => {
2026-08-18 13:41:35.034899 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:41:35.034911 | node1 | }
2026-08-18 13:41:35.034939 | node1 | ok: [node2] => {
2026-08-18 13:41:35.034948 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:41:35.034957 | node1 | }
2026-08-18 13:41:35.034975 | node1 | ok: [node3] => {
2026-08-18 13:41:35.034985 | node1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 13:41:35.034995 | node1 | }
2026-08-18 13:41:35.035325 | node1 |
2026-08-18 13:41:35.035367 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:35.035373 | node1 | Tuesday 18 August 2026  13:41:35 +0000 (0:00:00.101)       0:02:59.777 ********
2026-08-18 13:41:35.397415 | node1 | ok: [node1]
2026-08-18 13:41:35.397480 | node1 | ok: [node2]
2026-08-18 13:41:35.397891 | node1 | ok: [node3]
2026-08-18 13:41:35.397934 | node1 |
2026-08-18 13:41:35.397940 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:35.397945 | node1 | Tuesday 18 August 2026  13:41:35 +0000 (0:00:00.363)       0:03:00.140 ********
2026-08-18 13:41:38.380410 | node1 | ok: [node1]
2026-08-18 13:41:38.380485 | node1 | ok: [node2]
2026-08-18 13:41:38.380497 | node1 | ok: [node3]
2026-08-18 13:41:38.380790 | node1 |
2026-08-18 13:41:38.381020 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 13:41:38.381027 | node1 | Tuesday 18 August 2026  13:41:38 +0000 (0:00:02.982)       0:03:03.123 ********
2026-08-18 13:41:38.411847 | node1 | skipping: [node1]
2026-08-18 13:41:38.439385 | node1 | skipping: [node2]
2026-08-18 13:41:38.439414 | node1 | skipping: [node3]
2026-08-18 13:41:38.439419 | node1 |
2026-08-18 13:41:38.439424 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 13:41:38.439438 | node1 | Tuesday 18 August 2026  13:41:38 +0000 (0:00:00.058)       0:03:03.181 ********
2026-08-18 13:41:38.490901 | node1 | skipping: [node1]
2026-08-18 13:41:38.490941 | node1 | skipping: [node2]
2026-08-18 13:41:38.490947 | node1 | skipping: [node3]
2026-08-18 13:41:38.490953 | node1 |
2026-08-18 13:41:38.490959 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 13:41:38.490965 | node1 | Tuesday 18 August 2026  13:41:38 +0000 (0:00:00.051)       0:03:03.233 ********
2026-08-18 13:41:38.544245 | node1 | skipping: [node1]
2026-08-18 13:41:38.544294 | node1 | skipping: [node2]
2026-08-18 13:41:38.544314 | node1 | skipping: [node3]
2026-08-18 13:41:38.544327 | node1 |
2026-08-18 13:41:38.544336 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 13:41:38.544345 | node1 | Tuesday 18 August 2026  13:41:38 +0000 (0:00:00.052)       0:03:03.285 ********
2026-08-18 13:41:39.868318 | node1 | ok: [node3]
2026-08-18 13:41:39.868699 | node1 | ok: [node1]
2026-08-18 13:41:39.868712 | node1 | ok: [node2]
2026-08-18 13:41:39.868721 | node1 |
2026-08-18 13:41:39.868731 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 13:41:39.868741 | node1 | Tuesday 18 August 2026  13:41:39 +0000 (0:00:01.325)       0:03:04.611 ********
2026-08-18 13:41:40.313232 | node1 | ok: [node1]
2026-08-18 13:41:40.313290 | node1 | ok: [node2]
2026-08-18 13:41:40.313307 | node1 | ok: [node3]
2026-08-18 13:41:40.313581 | node1 |
2026-08-18 13:41:40.313624 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 13:41:40.313630 | node1 | Tuesday 18 August 2026  13:41:40 +0000 (0:00:00.444)       0:03:05.056 ********
2026-08-18 13:41:41.254748 | node1 | ok: [node1] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:41.254830 | node1 | ok: [node2] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:41.254894 | node1 | ok: [node3] => (item={'path': '/etc/containerd'})
2026-08-18 13:41:41.256335 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:41.256378 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:41.256383 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 13:41:41.256387 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:41.256391 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:41.256395 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 13:41:41.256399 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:41.256404 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:41.256408 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 13:41:41.256412 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:41.256416 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:41.256420 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 13:41:41.256424 | node1 |
2026-08-18 13:41:41.256429 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 13:41:41.256432 | node1 | Tuesday 18 August 2026  13:41:41 +0000 (0:00:00.941)       0:03:05.997 ********
2026-08-18 13:41:41.876516 | node1 | ok: [node2]
2026-08-18 13:41:41.876593 | node1 | ok: [node1]
2026-08-18 13:41:41.876657 | node1 | ok: [node3]
2026-08-18 13:41:41.877251 | node1 |
2026-08-18 13:41:41.877312 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:41.877324 | node1 | Tuesday 18 August 2026  13:41:41 +0000 (0:00:00.605)       0:03:06.603 ********
2026-08-18 13:41:41.877333 | node1 |
2026-08-18 13:41:41.877343 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:41.877357 | node1 | Tuesday 18 August 2026  13:41:41 +0000 (0:00:00.005)       0:03:06.608 ********
2026-08-18 13:41:41.877384 | node1 |
2026-08-18 13:41:41.877409 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 13:41:41.877813 | node1 | Tuesday 18 August 2026  13:41:41 +0000 (0:00:00.005)       0:03:06.613 ********
2026-08-18 13:41:41.877853 | node1 |
2026-08-18 13:41:41.877859 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 13:41:41.877863 | node1 | Tuesday 18 August 2026  13:41:41 +0000 (0:00:00.005)       0:03:06.619 ********
2026-08-18 13:41:42.268313 | node1 | ok: [node1]
2026-08-18 13:41:42.268392 | node1 | ok: [node2]
2026-08-18 13:41:42.268452 | node1 | ok: [node3]
2026-08-18 13:41:42.268805 | node1 |
2026-08-18 13:41:42.268848 | node1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 13:41:42.268854 | node1 | Tuesday 18 August 2026  13:41:42 +0000 (0:00:00.391)       0:03:07.011 ********
2026-08-18 13:41:42.512664 | node1 | ok: [node1]
2026-08-18 13:41:42.512710 | node1 | ok: [node2]
2026-08-18 13:41:42.512714 | node1 | ok: [node3]
2026-08-18 13:41:42.512719 | node1 |
2026-08-18 13:41:42.512724 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:42.512729 | node1 | Tuesday 18 August 2026  13:41:42 +0000 (0:00:00.243)       0:03:07.255 ********
2026-08-18 13:41:42.653199 | node1 | ok: [node1] => {
2026-08-18 13:41:42.653253 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:42.653261 | node1 | }
2026-08-18 13:41:42.653272 | node1 | ok: [node2] => {
2026-08-18 13:41:42.654251 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:42.654293 | node1 | }
2026-08-18 13:41:42.654299 | node1 | ok: [node3] => {
2026-08-18 13:41:42.654303 | node1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 13:41:42.654307 | node1 | }
2026-08-18 13:41:42.654311 | node1 |
2026-08-18 13:41:42.654316 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:42.654320 | node1 | Tuesday 18 August 2026  13:41:42 +0000 (0:00:00.140)       0:03:07.395 ********
2026-08-18 13:41:43.081282 | node1 | ok: [node1]
2026-08-18 13:41:43.081396 | node1 | ok: [node2]
2026-08-18 13:41:43.081975 | node1 | ok: [node3]
2026-08-18 13:41:43.082038 | node1 |
2026-08-18 13:41:43.082046 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:43.082053 | node1 | Tuesday 18 August 2026  13:41:43 +0000 (0:00:00.428)       0:03:07.823 ********
2026-08-18 13:41:46.342214 | node1 | ok: [node3]
2026-08-18 13:41:46.342330 | node1 | ok: [node1]
2026-08-18 13:41:46.342342 | node1 | ok: [node2]
2026-08-18 13:41:46.342645 | node1 |
2026-08-18 13:41:46.342701 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 13:41:46.342707 | node1 | Tuesday 18 August 2026  13:41:46 +0000 (0:00:03.261)       0:03:11.084 ********
2026-08-18 13:41:47.431218 | node1 | ok: [node1]
2026-08-18 13:41:47.431270 | node1 | ok: [node3]
2026-08-18 13:41:47.431358 | node1 | ok: [node2]
2026-08-18 13:41:47.431678 | node1 |
2026-08-18 13:41:47.431724 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 13:41:47.431730 | node1 | Tuesday 18 August 2026  13:41:47 +0000 (0:00:01.089)       0:03:12.173 ********
2026-08-18 13:41:47.704343 | node1 | ok: [node1]
2026-08-18 13:41:47.704424 | node1 | ok: [node2]
2026-08-18 13:41:47.704488 | node1 | ok: [node3]
2026-08-18 13:41:47.704777 | node1 |
2026-08-18 13:41:47.704818 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 13:41:47.704824 | node1 | Tuesday 18 August 2026  13:41:47 +0000 (0:00:00.272)       0:03:12.446 ********
2026-08-18 13:41:48.146858 | node1 | ok: [node1]
2026-08-18 13:41:48.146967 | node1 | ok: [node2]
2026-08-18 13:41:48.147514 | node1 | ok: [node3]
2026-08-18 13:41:48.147557 | node1 |
2026-08-18 13:41:48.147565 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 13:41:48.147572 | node1 | Tuesday 18 August 2026  13:41:48 +0000 (0:00:00.442)       0:03:12.889 ********
2026-08-18 13:41:48.700026 | node1 | ok: [node1] => (item={'path': '/etc/docker'})
2026-08-18 13:41:48.700088 | node1 | ok: [node2] => (item={'path': '/etc/docker'})
2026-08-18 13:41:48.700183 | node1 | ok: [node3] => (item={'path': '/etc/docker'})
2026-08-18 13:41:48.701076 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:48.701136 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:48.701143 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 13:41:48.701147 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:48.701152 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:48.701155 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 13:41:48.701160 | node1 |
2026-08-18 13:41:48.701165 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 13:41:48.701169 | node1 | Tuesday 18 August 2026  13:41:48 +0000 (0:00:00.553)       0:03:13.442 ********
2026-08-18 13:41:49.137336 | node1 | ok: [node1]
2026-08-18 13:41:49.137405 | node1 | ok: [node2]
2026-08-18 13:41:49.137492 | node1 | ok: [node3]
2026-08-18 13:41:49.137584 | node1 |
2026-08-18 13:41:49.137681 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 13:41:49.137778 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.437)       0:03:13.880 ********
2026-08-18 13:41:49.599426 | node1 | ok: [node1]
2026-08-18 13:41:49.599593 | node1 | ok: [node2]
2026-08-18 13:41:49.599790 | node1 | ok: [node3]
2026-08-18 13:41:49.599975 | node1 |
2026-08-18 13:41:49.600186 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:49.600388 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.443)       0:03:14.323 ********
2026-08-18 13:41:49.600555 | node1 |
2026-08-18 13:41:49.600768 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:49.600957 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.007)       0:03:14.330 ********
2026-08-18 13:41:49.601236 | node1 |
2026-08-18 13:41:49.601434 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 13:41:49.601631 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.005)       0:03:14.336 ********
2026-08-18 13:41:49.601806 | node1 |
2026-08-18 13:41:49.602031 | node1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 13:41:49.602233 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.005)       0:03:14.341 ********
2026-08-18 13:41:49.979198 | node1 | ok: [node1]
2026-08-18 13:41:49.979480 | node1 | ok: [node2]
2026-08-18 13:41:49.979572 | node1 | ok: [node3]
2026-08-18 13:41:49.979816 | node1 |
2026-08-18 13:41:49.979977 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 13:41:49.980175 | node1 | Tuesday 18 August 2026  13:41:49 +0000 (0:00:00.379)       0:03:14.721 ********
2026-08-18 13:41:50.038862 | node1 | ok: [node1] => {
2026-08-18 13:41:50.039075 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:50.039279 | node1 | }
2026-08-18 13:41:50.039541 | node1 | ok: [node2] => {
2026-08-18 13:41:50.039720 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:50.039913 | node1 | }
2026-08-18 13:41:50.040122 | node1 | ok: [node3] => {
2026-08-18 13:41:50.040323 | node1 |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 13:41:50.040524 | node1 | }
2026-08-18 13:41:50.040713 | node1 |
2026-08-18 13:41:50.040932 | node1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 13:41:50.041183 | node1 | Tuesday 18 August 2026  13:41:50 +0000 (0:00:00.059)       0:03:14.781 ********
2026-08-18 13:41:50.342732 | node1 | ok: [node1]
2026-08-18 13:41:50.342918 | node1 | ok: [node2]
2026-08-18 13:41:50.343108 | node1 | ok: [node3]
2026-08-18 13:41:50.343287 | node1 |
2026-08-18 13:41:50.343495 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 13:41:50.343696 | node1 | Tuesday 18 August 2026  13:41:50 +0000 (0:00:00.303)       0:03:15.085 ********
2026-08-18 13:41:50.364022 | node1 | skipping: [node1]
2026-08-18 13:41:50.404869 | node1 | skipping: [node2]
2026-08-18 13:41:50.405062 | node1 | skipping: [node3]
2026-08-18 13:41:50.405295 | node1 |
2026-08-18 13:41:50.405543 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 13:41:50.405768 | node1 | Tuesday 18 August 2026  13:41:50 +0000 (0:00:00.062)       0:03:15.147 ********
2026-08-18 13:41:50.474350 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:50.474561 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:50.474787 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-18 13:41:50.474973 | node1 |
2026-08-18 13:41:50.475178 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 13:41:50.475379 | node1 | Tuesday 18 August 2026  13:41:50 +0000 (0:00:00.069)       0:03:15.216 ********
2026-08-18 13:41:51.748103 | node1 | ok: [node2]
2026-08-18 13:41:51.748164 | node1 | ok: [node1]
2026-08-18 13:41:51.748175 | node1 | ok: [node3]
2026-08-18 13:41:51.748184 | node1 |
2026-08-18 13:41:51.748194 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 13:41:51.748203 | node1 | Tuesday 18 August 2026  13:41:51 +0000 (0:00:01.272)       0:03:16.489 ********
2026-08-18 13:41:52.414801 | node1 | ok: [node1] => (item=chronyd)
2026-08-18 13:41:52.414851 | node1 | ok: [node3] => (item=chronyd)
2026-08-18 13:41:52.414858 | node1 | ok: [node2] => (item=chronyd)
2026-08-18 13:41:52.414864 | node1 | ok: [node1] => (item=sshd)
2026-08-18 13:41:52.414869 | node1 | ok: [node2] => (item=sshd)
2026-08-18 13:41:52.414874 | node1 | ok: [node3] => (item=sshd)
2026-08-18 13:41:52.414880 | node1 |
2026-08-18 13:41:52.414886 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 13:41:52.414892 | node1 | Tuesday 18 August 2026  13:41:52 +0000 (0:00:00.666)       0:03:17.156 ********
2026-08-18 13:41:52.632631 | node1 | ok: [node1]
2026-08-18 13:41:52.632704 | node1 | ok: [node3]
2026-08-18 13:41:52.633201 | node1 | ok: [node2]
2026-08-18 13:41:52.633264 | node1 |
2026-08-18 13:41:52.633283 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 13:41:52.633386 | node1 | Tuesday 18 August 2026  13:41:52 +0000 (0:00:00.219)       0:03:17.375 ********
2026-08-18 13:41:52.898640 | node1 | ok: [node1]
2026-08-18 13:41:52.898742 | node1 | ok: [node3]
2026-08-18 13:41:52.898822 | node1 | ok: [node2]
2026-08-18 13:41:52.899136 | node1 |
2026-08-18 13:41:52.899380 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 13:41:52.899387 | node1 | Tuesday 18 August 2026  13:41:52 +0000 (0:00:00.266)       0:03:17.641 ********
2026-08-18 13:41:53.369215 | node1 | ok: [node1]
2026-08-18 13:41:53.369281 | node1 | ok: [node2]
2026-08-18 13:41:53.369292 | node1 | ok: [node3]
2026-08-18 13:41:53.369308 | node1 |
2026-08-18 13:41:53.369318 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 13:41:53.369417 | node1 | Tuesday 18 August 2026  13:41:53 +0000 (0:00:00.470)       0:03:18.111 ********
2026-08-18 13:41:53.429746 | node1 | skipping: [node1]
2026-08-18 13:41:53.429786 | node1 | skipping: [node2]
2026-08-18 13:41:53.430187 | node1 | skipping: [node3]
2026-08-18 13:41:53.430231 | node1 |
2026-08-18 13:41:53.430236 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 13:41:53.430241 | node1 | Tuesday 18 August 2026  13:41:53 +0000 (0:00:00.060)       0:03:18.172 ********
2026-08-18 13:41:53.831496 | node1 | ok: [node1]
2026-08-18 13:41:53.831599 | node1 | ok: [node2]
2026-08-18 13:41:53.832123 | node1 | ok: [node3]
2026-08-18 13:41:53.832171 | node1 |
2026-08-18 13:41:53.832176 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 13:41:53.832182 | node1 | Tuesday 18 August 2026  13:41:53 +0000 (0:00:00.401)       0:03:18.574 ********
2026-08-18 13:41:54.291603 | node1 | ok: [node1]
2026-08-18 13:41:54.291660 | node1 | ok: [node2]
2026-08-18 13:41:54.291766 | node1 | ok: [node3]
2026-08-18 13:41:54.292091 | node1 |
2026-08-18 13:41:54.292132 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] ****************
2026-08-18 13:41:54.292138 | node1 | Tuesday 18 August 2026  13:41:54 +0000 (0:00:00.460)       0:03:19.034 ********
2026-08-18 13:41:54.882351 | node1 | ok: [node1] => (item=node1)
2026-08-18 13:41:54.882428 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2)
2026-08-18 13:41:54.882492 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3)
2026-08-18 13:41:54.882774 | node1 |
2026-08-18 13:41:54.882820 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************
2026-08-18 13:41:54.882826 | node1 | Tuesday 18 August 2026  13:41:54 +0000 (0:00:00.590)       0:03:19.625 ********
2026-08-18 13:41:54.945673 | node1 | ok: [node1]
2026-08-18 13:41:54.945745 | node1 | ok: [node2]
2026-08-18 13:41:54.945825 | node1 | ok: [node3]
2026-08-18 13:41:54.945870 | node1 |
2026-08-18 13:41:54.946091 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] ****************
2026-08-18 13:41:54.946136 | node1 | Tuesday 18 August 2026  13:41:54 +0000 (0:00:00.063)       0:03:19.688 ********
2026-08-18 13:41:55.008996 | node1 | ok: [node1]
2026-08-18 13:41:55.009038 | node1 | ok: [node2]
2026-08-18 13:41:55.009178 | node1 | ok: [node3]
2026-08-18 13:41:55.009485 | node1 |
2026-08-18 13:41:55.009526 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] **************
2026-08-18 13:41:55.009532 | node1 | Tuesday 18 August 2026  13:41:55 +0000 (0:00:00.063)       0:03:19.751 ********
2026-08-18 13:41:55.036849 | node1 | skipping: [node1]
2026-08-18 13:41:55.036932 | node1 |
2026-08-18 13:41:55.037100 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] ***********
2026-08-18 13:41:55.037219 | node1 | Tuesday 18 August 2026  13:41:55 +0000 (0:00:00.027)       0:03:19.779 ********
2026-08-18 13:41:56.551630 | node1 | ok: [node1] => (item=ceph-exporter)
2026-08-18 13:41:56.551818 | node1 |
2026-08-18 13:41:56.552066 | node1 | PLAY RECAP *********************************************************************
2026-08-18 13:41:56.552318 | node1 | node1                      : ok=231  changed=0    unreachable=0    failed=0    skipped=57   rescued=0    ignored=0
2026-08-18 13:41:56.552556 | node1 | node2                      : ok=200  changed=0    unreachable=0    failed=0    skipped=39   rescued=0    ignored=0
2026-08-18 13:41:56.552852 | node1 | node3                      : ok=200  changed=0    unreachable=0    failed=0    skipped=39   rescued=0    ignored=0
2026-08-18 13:41:56.553144 | node1 |
2026-08-18 13:41:56.553429 | node1 |
2026-08-18 13:41:56.553715 | node1 | TASKS RECAP ********************************************************************
2026-08-18 13:41:56.554010 | node1 | Tuesday 18 August 2026  13:41:56 +0000 (0:00:01.514)       0:03:21.294 ********
2026-08-18 13:41:56.554294 | node1 | ===============================================================================
2026-08-18 13:41:56.554595 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 31.70s
2026-08-18 13:41:56.554893 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.11s
2026-08-18 13:41:56.555184 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration -------------- 8.86s
2026-08-18 13:41:56.555472 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 6.28s
2026-08-18 13:41:56.555746 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 4.45s
2026-08-18 13:41:56.556054 | node1 | vexxhost.ceph.rgw : Configure RGW zones --------------------------------- 3.33s
2026-08-18 13:41:56.556334 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.26s
2026-08-18 13:41:56.556644 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.20s
2026-08-18 13:41:56.556992 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.19s
2026-08-18 13:41:56.557305 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.15s
2026-08-18 13:41:56.557434 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.98s
2026-08-18 13:41:56.557597 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.22s
2026-08-18 13:41:56.557769 | node1 | vexxhost.ceph.rgw : Configure RGW zonegroups ---------------------------- 2.02s
2026-08-18 13:41:56.557935 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.00s
2026-08-18 13:41:56.558100 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.98s
2026-08-18 13:41:56.558264 | node1 | Gathering Facts --------------------------------------------------------- 1.95s
2026-08-18 13:41:56.558443 | node1 | vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled --- 1.74s
2026-08-18 13:41:56.558613 | node1 | vexxhost.ceph.configure : Get the current dashboard certificate --------- 1.72s
2026-08-18 13:41:56.558782 | node1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 1.72s
2026-08-18 13:41:56.558950 | node1 | vexxhost.ceph.mgr : Wait for this manager's daemon to be present -------- 1.67s
2026-08-18 13:41:56.655987 | node1 | INFO     [default > idempotence] Executed: Successful
2026-08-18 13:41:56.665675 | node1 | INFO     [default > side_effect] Executing
2026-08-18 13:41:56.666650 | node1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 13:41:56.672913 | node1 | INFO     [default > verify] Executing
2026-08-18 13:41:57.305732 | node1 |
2026-08-18 13:41:57.305866 | node1 | PLAY [Verify the deployed Ceph cluster] ****************************************
2026-08-18 13:41:57.306064 | node1 |
2026-08-18 13:41:57.306270 | node1 | TASK [Gathering Facts] *********************************************************
2026-08-18 13:41:57.306473 | node1 | Tuesday 18 August 2026  13:41:57 +0000 (0:00:00.007)       0:00:00.007 ********
2026-08-18 13:41:58.427321 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python
2026-08-18 13:41:58.427517 | node1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-18 13:41:58.427943 | node1 | interpreter could change the meaning of that path. See
2026-08-18 13:41:58.428178 | node1 | https://docs.ansible.com/ansible-
2026-08-18 13:41:58.428392 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 13:41:58.436164 | node1 | ok: [node1]
2026-08-18 13:41:58.436362 | node1 |
2026-08-18 13:41:58.436568 | node1 | TASK [Get cluster health] ******************************************************
2026-08-18 13:41:58.436776 | node1 | Tuesday 18 August 2026  13:41:58 +0000 (0:00:01.130)       0:00:01.137 ********
2026-08-18 13:42:00.100447 | node1 | ok: [node1]
2026-08-18 13:42:00.100573 | node1 |
2026-08-18 13:42:00.100859 | node1 | TASK [Assert the cluster is HEALTH_OK] *****************************************
2026-08-18 13:42:00.101098 | node1 | Tuesday 18 August 2026  13:42:00 +0000 (0:00:01.663)       0:00:02.801 ********
2026-08-18 13:42:00.136871 | node1 | ok: [node1] => {
2026-08-18 13:42:00.137018 | node1 |     "changed": false,
2026-08-18 13:42:00.137258 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:00.137455 | node1 | }
2026-08-18 13:42:00.137638 | node1 |
2026-08-18 13:42:00.137843 | node1 | TASK [Get monitor quorum] ******************************************************
2026-08-18 13:42:00.138032 | node1 | Tuesday 18 August 2026  13:42:00 +0000 (0:00:00.036)       0:00:02.838 ********
2026-08-18 13:42:01.698496 | node1 | ok: [node1]
2026-08-18 13:42:01.698633 | node1 |
2026-08-18 13:42:01.698858 | node1 | TASK [Assert every monitor is in quorum] ***************************************
2026-08-18 13:42:01.699072 | node1 | Tuesday 18 August 2026  13:42:01 +0000 (0:00:01.561)       0:00:04.399 ********
2026-08-18 13:42:01.739111 | node1 | ok: [node1] => {
2026-08-18 13:42:01.739280 | node1 |     "changed": false,
2026-08-18 13:42:01.739537 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:01.739752 | node1 | }
2026-08-18 13:42:01.739951 | node1 |
2026-08-18 13:42:01.740174 | node1 | TASK [Get manager status] ******************************************************
2026-08-18 13:42:01.740396 | node1 | Tuesday 18 August 2026  13:42:01 +0000 (0:00:00.040)       0:00:04.440 ********
2026-08-18 13:42:03.275894 | node1 | ok: [node1]
2026-08-18 13:42:03.276070 | node1 |
2026-08-18 13:42:03.276325 | node1 | TASK [Assert a manager is active] **********************************************
2026-08-18 13:42:03.276526 | node1 | Tuesday 18 August 2026  13:42:03 +0000 (0:00:01.536)       0:00:05.977 ********
2026-08-18 13:42:03.307133 | node1 | ok: [node1] => {
2026-08-18 13:42:03.307374 | node1 |     "changed": false,
2026-08-18 13:42:03.307624 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:03.307871 | node1 | }
2026-08-18 13:42:03.308103 | node1 |
2026-08-18 13:42:03.308407 | node1 | TASK [Get OSD stat] ************************************************************
2026-08-18 13:42:03.308710 | node1 | Tuesday 18 August 2026  13:42:03 +0000 (0:00:00.031)       0:00:06.008 ********
2026-08-18 13:42:04.696644 | node1 | ok: [node1]
2026-08-18 13:42:04.696724 | node1 |
2026-08-18 13:42:04.696739 | node1 | TASK [Assert all OSDs are up and in] *******************************************
2026-08-18 13:42:04.696754 | node1 | Tuesday 18 August 2026  13:42:04 +0000 (0:00:01.388)       0:00:07.397 ********
2026-08-18 13:42:04.742204 | node1 | ok: [node1] => {
2026-08-18 13:42:04.742242 | node1 |     "changed": false,
2026-08-18 13:42:04.742808 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:04.742885 | node1 | }
2026-08-18 13:42:04.742891 | node1 |
2026-08-18 13:42:04.742897 | node1 | TASK [List orchestrator services] **********************************************
2026-08-18 13:42:04.742902 | node1 | Tuesday 18 August 2026  13:42:04 +0000 (0:00:00.046)       0:00:07.443 ********
2026-08-18 13:42:06.218734 | node1 | ok: [node1]
2026-08-18 13:42:06.218849 | node1 |
2026-08-18 13:42:06.219115 | node1 | TASK [Assert every orchestrator service has all its daemons running] ***********
2026-08-18 13:42:06.219172 | node1 | Tuesday 18 August 2026  13:42:06 +0000 (0:00:01.476)       0:00:08.920 ********
2026-08-18 13:42:06.320942 | node1 | failed: [node1] (item=rgw.molecule) => {
2026-08-18 13:42:06.321034 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.321049 | node1 |     "assertion": "(item.status.running | default(0)) > 0",
2026-08-18 13:42:06.321059 | node1 |     "changed": false,
2026-08-18 13:42:06.321069 | node1 |     "evaluated_to": false,
2026-08-18 13:42:06.321079 | node1 |     "item": {
2026-08-18 13:42:06.325636 | node1 |         "events": [
2026-08-18 13:42:06.325674 | node1 |             "2026-08-18T13:38:09.431967Z service:rgw.molecule [INFO] \"service was created\""
2026-08-18 13:42:06.325687 | node1 |         ],
2026-08-18 13:42:06.325697 | node1 |         "networks": [
2026-08-18 13:42:06.325706 | node1 |             "0.0.0.0/0"
2026-08-18 13:42:06.325714 | node1 |         ],
2026-08-18 13:42:06.325768 | node1 |         "placement": {
2026-08-18 13:42:06.325778 | node1 |             "count_per_host": 1,
2026-08-18 13:42:06.325788 | node1 |             "label": "rgw"
2026-08-18 13:42:06.325796 | node1 |         },
2026-08-18 13:42:06.325805 | node1 |         "service_id": "molecule",
2026-08-18 13:42:06.325814 | node1 |         "service_name": "rgw.molecule",
2026-08-18 13:42:06.325824 | node1 |         "service_type": "rgw",
2026-08-18 13:42:06.325833 | node1 |         "spec": {
2026-08-18 13:42:06.325843 | node1 |             "generate_cert": true,
2026-08-18 13:42:06.325853 | node1 |             "rgw_exit_timeout_secs": 120,
2026-08-18 13:42:06.325863 | node1 |             "rgw_frontend_port": 8080,
2026-08-18 13:42:06.325871 | node1 |             "rgw_realm": "molecule",
2026-08-18 13:42:06.325881 | node1 |             "rgw_zone": "molecule-1",
2026-08-18 13:42:06.325889 | node1 |             "rgw_zonegroup": "molecule",
2026-08-18 13:42:06.325899 | node1 |             "ssl": true
2026-08-18 13:42:06.325908 | node1 |         },
2026-08-18 13:42:06.325923 | node1 |         "status": {
2026-08-18 13:42:06.326104 | node1 |             "created": "2026-08-18T13:38:09.407647Z",
2026-08-18 13:42:06.326293 | node1 |             "ports": [
2026-08-18 13:42:06.326482 | node1 |                 8080
2026-08-18 13:42:06.326671 | node1 |             ],
2026-08-18 13:42:06.326853 | node1 |             "running": 0,
2026-08-18 13:42:06.327027 | node1 |             "size": 3
2026-08-18 13:42:06.327151 | node1 |         }
2026-08-18 13:42:06.327273 | node1 |     },
2026-08-18 13:42:06.327403 | node1 |     "msg": "Service rgw.molecule running 0/3"
2026-08-18 13:42:06.327532 | node1 | }
2026-08-18 13:42:06.327756 | node1 | ok: [node1] => (item=ceph-exporter) => {
2026-08-18 13:42:06.327890 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.328021 | node1 |     "changed": false,
2026-08-18 13:42:06.328149 | node1 |     "item": {
2026-08-18 13:42:06.328279 | node1 |         "events": [
2026-08-18 13:42:06.328428 | node1 |             "2026-08-18T13:38:43.881499Z service:ceph-exporter [INFO] \"service was created\""
2026-08-18 13:42:06.328549 | node1 |         ],
2026-08-18 13:42:06.328677 | node1 |         "placement": {
2026-08-18 13:42:06.328805 | node1 |             "host_pattern": "*"
2026-08-18 13:42:06.328928 | node1 |         },
2026-08-18 13:42:06.329057 | node1 |         "service_name": "ceph-exporter",
2026-08-18 13:42:06.329243 | node1 |         "service_type": "ceph-exporter",
2026-08-18 13:42:06.329372 | node1 |         "spec": {
2026-08-18 13:42:06.329505 | node1 |             "prio_limit": 5,
2026-08-18 13:42:06.329631 | node1 |             "stats_period": 5
2026-08-18 13:42:06.329778 | node1 |         },
2026-08-18 13:42:06.329919 | node1 |         "status": {
2026-08-18 13:42:06.330053 | node1 |             "created": "2026-08-18T13:38:33.947524Z",
2026-08-18 13:42:06.330197 | node1 |             "last_refresh": "2026-08-18T13:38:49.488473Z",
2026-08-18 13:42:06.330328 | node1 |             "ports": [
2026-08-18 13:42:06.330462 | node1 |                 9926
2026-08-18 13:42:06.330593 | node1 |             ],
2026-08-18 13:42:06.330732 | node1 |             "running": 3,
2026-08-18 13:42:06.330870 | node1 |             "size": 3
2026-08-18 13:42:06.331008 | node1 |         }
2026-08-18 13:42:06.331144 | node1 |     },
2026-08-18 13:42:06.331284 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:06.331415 | node1 | }
2026-08-18 13:42:06.331559 | node1 | ok: [node1] => (item=crash) => {
2026-08-18 13:42:06.331696 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.331829 | node1 |     "changed": false,
2026-08-18 13:42:06.331968 | node1 |     "item": {
2026-08-18 13:42:06.332111 | node1 |         "placement": {
2026-08-18 13:42:06.332241 | node1 |             "host_pattern": "*"
2026-08-18 13:42:06.332365 | node1 |         },
2026-08-18 13:42:06.332498 | node1 |         "service_name": "crash",
2026-08-18 13:42:06.332627 | node1 |         "service_type": "crash",
2026-08-18 13:42:06.332753 | node1 |         "status": {
2026-08-18 13:42:06.332883 | node1 |             "created": "2026-08-18T13:30:15.430034Z",
2026-08-18 13:42:06.333029 | node1 |             "last_refresh": "2026-08-18T13:38:49.487510Z",
2026-08-18 13:42:06.333202 | node1 |             "running": 3,
2026-08-18 13:42:06.333333 | node1 |             "size": 3
2026-08-18 13:42:06.333461 | node1 |         }
2026-08-18 13:42:06.333584 | node1 |     },
2026-08-18 13:42:06.333713 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:06.333862 | node1 | }
2026-08-18 13:42:06.333994 | node1 | ok: [node1] => (item=mgr) => {
2026-08-18 13:42:06.334124 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.334943 | node1 |     "changed": false,
2026-08-18 13:42:06.335072 | node1 |     "item": {
2026-08-18 13:42:06.335212 | node1 |         "placement": {
2026-08-18 13:42:06.335350 | node1 |             "label": "mgr"
2026-08-18 13:42:06.335488 | node1 |         },
2026-08-18 13:42:06.335619 | node1 |         "service_name": "mgr",
2026-08-18 13:42:06.335755 | node1 |         "service_type": "mgr",
2026-08-18 13:42:06.335877 | node1 |         "status": {
2026-08-18 13:42:06.336003 | node1 |             "created": "2026-08-18T13:31:04.371479Z",
2026-08-18 13:42:06.336130 | node1 |             "last_refresh": "2026-08-18T13:38:49.487969Z",
2026-08-18 13:42:06.336250 | node1 |             "running": 3,
2026-08-18 13:42:06.336385 | node1 |             "size": 3
2026-08-18 13:42:06.336506 | node1 |         }
2026-08-18 13:42:06.336627 | node1 |     },
2026-08-18 13:42:06.336751 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:06.336871 | node1 | }
2026-08-18 13:42:06.337022 | node1 | ok: [node1] => (item=mon) => {
2026-08-18 13:42:06.337182 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.337311 | node1 |     "changed": false,
2026-08-18 13:42:06.337437 | node1 |     "item": {
2026-08-18 13:42:06.337558 | node1 |         "placement": {
2026-08-18 13:42:06.337679 | node1 |             "label": "mon"
2026-08-18 13:42:06.337873 | node1 |         },
2026-08-18 13:42:06.337996 | node1 |         "service_name": "mon",
2026-08-18 13:42:06.338120 | node1 |         "service_type": "mon",
2026-08-18 13:42:06.338242 | node1 |         "status": {
2026-08-18 13:42:06.338370 | node1 |             "created": "2026-08-18T13:30:51.007230Z",
2026-08-18 13:42:06.338476 | node1 |             "last_refresh": "2026-08-18T13:38:49.488678Z",
2026-08-18 13:42:06.338562 | node1 |             "running": 3,
2026-08-18 13:42:06.338658 | node1 |             "size": 3
2026-08-18 13:42:06.338746 | node1 |         }
2026-08-18 13:42:06.338831 | node1 |     },
2026-08-18 13:42:06.338922 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:06.339006 | node1 | }
2026-08-18 13:42:06.339094 | node1 | ok: [node1] => (item=osd.default) => {
2026-08-18 13:42:06.339180 | node1 |     "ansible_loop_var": "item",
2026-08-18 13:42:06.339267 | node1 |     "changed": false,
2026-08-18 13:42:06.339351 | node1 |     "item": {
2026-08-18 13:42:06.339442 | node1 |         "placement": {
2026-08-18 13:42:06.339531 | node1 |             "host_pattern": "node1"
2026-08-18 13:42:06.339617 | node1 |         },
2026-08-18 13:42:06.339705 | node1 |         "service_id": "default",
2026-08-18 13:42:06.339793 | node1 |         "service_name": "osd.default",
2026-08-18 13:42:06.339879 | node1 |         "service_type": "osd",
2026-08-18 13:42:06.339965 | node1 |         "spec": {
2026-08-18 13:42:06.340051 | node1 |             "data_devices": {
2026-08-18 13:42:06.340136 | node1 |                 "paths": [
2026-08-18 13:42:06.340225 | node1 |                     "/dev/ceph-node1-osd0/data"
2026-08-18 13:42:06.340311 | node1 |                 ]
2026-08-18 13:42:06.340402 | node1 |             },
2026-08-18 13:42:06.340490 | node1 |             "filter_logic": "AND",
2026-08-18 13:42:06.340576 | node1 |             "objectstore": "bluestore"
2026-08-18 13:42:06.340660 | node1 |         },
2026-08-18 13:42:06.340745 | node1 |         "status": {
2026-08-18 13:42:06.340834 | node1 |             "created": "2026-08-18T13:31:45.917579Z",
2026-08-18 13:42:06.340924 | node1 |             "last_refresh": "2026-08-18T13:38:49.487793Z",
2026-08-18 13:42:06.341009 | node1 |             "running": 9,
2026-08-18 13:42:06.341093 | node1 |             "size": 9
2026-08-18 13:42:06.341204 | node1 |         }
2026-08-18 13:42:06.341290 | node1 |     },
2026-08-18 13:42:06.341390 | node1 |     "msg": "All assertions passed"
2026-08-18 13:42:06.341476 | node1 | }
2026-08-18 13:42:06.341570 | node1 |
2026-08-18 13:42:06.341659 | node1 | PLAY RECAP *********************************************************************
2026-08-18 13:42:06.341791 | node1 | node1                      : ok=10   changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-08-18 13:42:06.341871 | node1 |
2026-08-18 13:42:06.341951 | node1 |
2026-08-18 13:42:06.342049 | node1 | TASKS RECAP ********************************************************************
2026-08-18 13:42:06.342140 | node1 | Tuesday 18 August 2026  13:42:06 +0000 (0:00:00.104)       0:00:09.024 ********
2026-08-18 13:42:06.342234 | node1 | ===============================================================================
2026-08-18 13:42:06.342324 | node1 | Get cluster health ------------------------------------------------------ 1.66s
2026-08-18 13:42:06.342413 | node1 | Get monitor quorum ------------------------------------------------------ 1.56s
2026-08-18 13:42:06.342504 | node1 | Get manager status ------------------------------------------------------ 1.54s
2026-08-18 13:42:06.342599 | node1 | List orchestrator services ---------------------------------------------- 1.48s
2026-08-18 13:42:06.342686 | node1 | Get OSD stat ------------------------------------------------------------ 1.39s
2026-08-18 13:42:06.342831 | node1 | Gathering Facts --------------------------------------------------------- 1.13s
2026-08-18 13:42:06.342921 | node1 | Assert every orchestrator service has all its daemons running ----------- 0.10s
2026-08-18 13:42:06.343009 | node1 | Assert all OSDs are up and in ------------------------------------------- 0.05s
2026-08-18 13:42:06.343104 | node1 | Assert every monitor is in quorum --------------------------------------- 0.04s
2026-08-18 13:42:06.343195 | node1 | Assert the cluster is HEALTH_OK ----------------------------------------- 0.04s
2026-08-18 13:42:06.343290 | node1 | Assert a manager is active ---------------------------------------------- 0.03s
2026-08-18 13:42:06.401313 | node1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-18 13:42:06.401430 | node1 | ERROR    [default > verify] Executed: Failed
2026-08-18 13:42:06.401562 | node1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-18 13:42:16.721909 | node1 | ERROR
2026-08-18 13:42:16.722139 | node1 | {
2026-08-18 13:42:16.722182 | node1 |   "delta": "0:16:31.691722",
2026-08-18 13:42:16.722214 | node1 |   "end": "2026-08-18 13:42:06.515613",
2026-08-18 13:42:16.722240 | node1 |   "msg": "non-zero return code",
2026-08-18 13:42:16.722267 | node1 |   "rc": 2,
2026-08-18 13:42:16.722295 | node1 |   "start": "2026-08-18 13:25:34.823891"
2026-08-18 13:42:16.722322 | node1 | }
failure
2026-08-18 13:42:16.769208 | 
2026-08-18 13:42:16.769323 | PLAY RECAP
2026-08-18 13:42:16.769372 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-18 13:42:16.769394 | 
2026-08-18 13:42:16.977217 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 13:42:17.002290 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 13:42:18.678533 | 
2026-08-18 13:42:18.678670 | PLAY [all]
2026-08-18 13:42:18.691050 | 
2026-08-18 13:42:18.691130 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-18 13:42:18.751139 | node1 | ok
2026-08-18 13:42:18.756931 | node2 | ok
2026-08-18 13:42:18.761981 | node3 | ok
2026-08-18 13:42:18.766878 | 
2026-08-18 13:42:18.766969 | TASK [fetch-output : Set log path for single node]
2026-08-18 13:42:18.797613 | node1 | skipping: Conditional result was False
2026-08-18 13:42:18.808748 | node2 | skipping: Conditional result was False
2026-08-18 13:42:18.819393 | node3 | skipping: Conditional result was False
2026-08-18 13:42:18.828315 | 
2026-08-18 13:42:18.828407 | LOOP [fetch-output : Ensure local output dirs]
2026-08-18 13:42:19.215280 | node3 -> localhost | changed: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/logs/node3"
2026-08-18 13:42:19.217929 | node2 -> localhost | changed: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/logs/node2"
2026-08-18 13:42:19.219546 | node1 -> localhost | changed: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/logs/node1"
2026-08-18 13:42:19.422783 | node1 -> localhost | changed: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/artifacts"
2026-08-18 13:42:19.426297 | node2 -> localhost | ok: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/artifacts"
2026-08-18 13:42:19.457719 | node3 -> localhost | ok: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/artifacts"
2026-08-18 13:42:19.622954 | node1 -> localhost | changed: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/docs"
2026-08-18 13:42:19.625232 | node2 -> localhost | ok: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/docs"
2026-08-18 13:42:19.647724 | node3 -> localhost | ok: "/var/lib/zuul/builds/4ee3ca621cde427fb8603b1cdaca1fd9/work/docs"
2026-08-18 13:42:19.647863 | node3 -> localhost | changed: All items complete
2026-08-18 13:42:19.647920 | 
2026-08-18 13:42:19.705564 | 
2026-08-18 13:42:19.759897 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-18 13:42:20.338083 | node1 | changed: .d..t...... ./
2026-08-18 13:42:20.343649 | node2 | changed: .d..t...... ./
2026-08-18 13:42:20.387943 | node3 | changed: .d..t...... ./
2026-08-18 13:42:20.777709 | node1 | changed: .d..t...... ./
2026-08-18 13:42:20.788455 | node2 | ok
2026-08-18 13:42:20.842005 | node3 | ok
2026-08-18 13:42:21.253959 | node1 | changed: .d..t...... ./
2026-08-18 13:42:21.259943 | node2 | ok
2026-08-18 13:42:21.284278 | node3 | ok
2026-08-18 13:42:21.284381 | node3 | changed: All items complete
2026-08-18 13:42:21.284421 | 
2026-08-18 13:42:21.312742 | 
2026-08-18 13:42:21.312909 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-18 13:42:21.674808 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008650
2026-08-18 13:42:21.891452 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.007814
2026-08-18 13:42:21.921989 | 
2026-08-18 13:42:21.922162 | PLAY [all]
2026-08-18 13:42:21.928568 | 
2026-08-18 13:42:21.928635 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-18 13:42:22.383798 | node1 | changed
2026-08-18 13:42:22.526301 | node3 | changed
2026-08-18 13:42:22.544710 | node2 | changed
2026-08-18 13:42:22.559657 | 
2026-08-18 13:42:22.559714 | PLAY RECAP
2026-08-18 13:42:22.559766 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:42:22.559796 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:42:22.559822 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 13:42:22.559841 | 
2026-08-18 13:42:22.755550 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 13:42:22.769027 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-18 13:42:23.393402 | 
2026-08-18 13:42:23.393555 | PLAY [localhost]
2026-08-18 13:42:23.403393 | 
2026-08-18 13:42:23.403467 | TASK [Generate Zuul manifest]
2026-08-18 13:42:23.423683 | localhost | ok
2026-08-18 13:42:23.441854 | 
2026-08-18 13:42:23.441945 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-18 13:42:23.797189 | localhost | changed
2026-08-18 13:42:23.808033 | 
2026-08-18 13:42:23.808110 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-18 13:42:23.835708 | localhost | ok
2026-08-18 13:42:23.842277 | 
2026-08-18 13:42:23.842340 | TASK [Upload logs]
2026-08-18 13:42:23.864851 | localhost | ok
2026-08-18 13:42:23.972320 | 
2026-08-18 13:42:23.972483 | TASK [Set zuul-log-path fact]
2026-08-18 13:42:23.996216 | localhost | ok
2026-08-18 13:42:24.009384 | 
2026-08-18 13:42:24.009457 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 13:42:24.042424 | localhost | ok
2026-08-18 13:42:24.052395 | 
2026-08-18 13:42:24.052486 | TASK [upload-logs : Create log directories]
2026-08-18 13:42:24.400524 | localhost | changed
2026-08-18 13:42:24.406819 | 
2026-08-18 13:42:24.406897 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-18 13:42:24.762192 | localhost -> localhost | ok: Runtime: 0:00:00.004953
2026-08-18 13:42:24.768011 | 
2026-08-18 13:42:24.768075 | TASK [upload-logs : Upload logs to log server]
2026-08-18 13:42:25.234043 | localhost | Output suppressed because no_log was given
2026-08-18 13:42:25.241513 | 
2026-08-18 13:42:25.241581 | LOOP [upload-logs : Compress console log and json output]
2026-08-18 13:42:25.284858 | localhost | skipping: Conditional result was False
2026-08-18 13:42:25.292051 | localhost | skipping: Conditional result was False
2026-08-18 13:42:25.304920 | 
2026-08-18 13:42:25.305041 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-18 13:42:25.348408 | localhost | skipping: Conditional result was False
2026-08-18 13:42:25.348798 | 
2026-08-18 13:42:25.352613 | localhost | skipping: Conditional result was False
2026-08-18 13:42:25.371921 | 
2026-08-18 13:42:25.372156 | LOOP [upload-logs : Upload console log and json output]