2026-08-18 15:18:39.361005 | Job console starting 2026-08-18 15:18:39.388889 | Updating git repos 2026-08-18 15:18:39.413937 | Cloning repos into workspace 2026-08-18 15:18:39.516427 | Restoring repo states 2026-08-18 15:18:39.526100 | Merging changes 2026-08-18 15:18:39.884148 | Checking out repos 2026-08-18 15:18:39.920894 | Preparing playbooks 2026-08-18 15:18:41.287790 | Running Ansible setup 2026-08-18 15:18:46.853916 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 15:18:47.519732 | 2026-08-18 15:18:47.520161 | PLAY [localhost] 2026-08-18 15:18:47.527965 | 2026-08-18 15:18:47.528039 | TASK [Gathering Facts] 2026-08-18 15:18:48.458227 | localhost | ok 2026-08-18 15:18:48.469234 | 2026-08-18 15:18:48.469393 | TASK [Setup log path fact] 2026-08-18 15:18:48.491575 | localhost | ok 2026-08-18 15:18:48.503450 | 2026-08-18 15:18:48.503533 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 15:18:48.534562 | localhost | ok 2026-08-18 15:18:48.542781 | 2026-08-18 15:18:48.542857 | TASK [emit-job-header : Print job information] 2026-08-18 15:18:48.584835 | # Job Information 2026-08-18 15:18:48.585155 | Ansible Version: 2.16.18 2026-08-18 15:18:48.585230 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-08-18 15:18:48.585280 | Pipeline: check 2026-08-18 15:18:48.585325 | Executor: 2d72f0692154 2026-08-18 15:18:48.585369 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123 2026-08-18 15:18:48.585418 | Event ID: ca719330-9b17-11f1-98d0-5d703f0ffff7 2026-08-18 15:18:48.590289 | 2026-08-18 15:18:48.590361 | LOOP [emit-job-header : Print node information] 2026-08-18 15:18:48.728736 | localhost | ok: 2026-08-18 15:18:48.729055 | localhost | # Node Information 2026-08-18 15:18:48.729095 | localhost | Inventory Hostname: node1 2026-08-18 15:18:48.729119 | localhost | Hostname: np0000190030 2026-08-18 15:18:48.729138 | localhost | Username: zuul 2026-08-18 15:18:48.729160 | localhost | Distro: Ubuntu 24.04 2026-08-18 15:18:48.729180 | localhost | Provider: yul1 2026-08-18 15:18:48.729199 | localhost | Region: ca-ymq-1 2026-08-18 15:18:48.729218 | localhost | Label: ubuntu-noble 2026-08-18 15:18:48.729237 | localhost | Product Name: OpenStack Nova 2026-08-18 15:18:48.729255 | localhost | Interface IP: 199.204.45.138 2026-08-18 15:18:48.775440 | localhost | ok: 2026-08-18 15:18:48.776132 | localhost | # Node Information 2026-08-18 15:18:48.776205 | localhost | Inventory Hostname: node2 2026-08-18 15:18:48.776263 | localhost | Hostname: np0000190031 2026-08-18 15:18:48.776311 | localhost | Username: zuul 2026-08-18 15:18:48.776357 | localhost | Distro: Ubuntu 24.04 2026-08-18 15:18:48.776402 | localhost | Provider: yul1 2026-08-18 15:18:48.776454 | localhost | Region: ca-ymq-1 2026-08-18 15:18:48.776501 | localhost | Label: ubuntu-noble 2026-08-18 15:18:48.776545 | localhost | Product Name: OpenStack Nova 2026-08-18 15:18:48.776628 | localhost | Interface IP: 199.204.45.227 2026-08-18 15:18:48.824558 | localhost | ok: 2026-08-18 15:18:48.824678 | localhost | # Node Information 2026-08-18 15:18:48.824732 | localhost | Inventory Hostname: node3 2026-08-18 15:18:48.824776 | localhost | Hostname: np0000190032 2026-08-18 15:18:48.824819 | localhost | Username: zuul 2026-08-18 15:18:48.824864 | localhost | Distro: Ubuntu 24.04 2026-08-18 15:18:48.824905 | localhost | Provider: yul1 2026-08-18 15:18:48.824945 | localhost | Region: ca-ymq-1 2026-08-18 15:18:48.825020 | localhost | Label: ubuntu-noble 2026-08-18 15:18:48.825061 | localhost | Product Name: OpenStack Nova 2026-08-18 15:18:48.825100 | localhost | Interface IP: 199.204.45.210 2026-08-18 15:18:48.841289 | 2026-08-18 15:18:48.841427 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-18 15:18:49.251963 | localhost -> localhost | changed 2026-08-18 15:18:49.257283 | 2026-08-18 15:18:49.257418 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-18 15:18:50.153539 | localhost -> localhost | changed 2026-08-18 15:18:50.164974 | 2026-08-18 15:18:50.165036 | PLAY [all] 2026-08-18 15:18:50.176128 | 2026-08-18 15:18:50.176198 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-18 15:18:50.394145 | node1 -> localhost | ok 2026-08-18 15:18:50.404015 | 2026-08-18 15:18:50.404107 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-18 15:18:50.457610 | node1 | ok 2026-08-18 15:18:50.515522 | node2 | ok 2026-08-18 15:18:50.520445 | node3 | ok 2026-08-18 15:18:50.543340 | node1 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:18:50.543433 | node2 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:18:50.543459 | node3 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-18 15:18:50.551344 | 2026-08-18 15:18:50.551420 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-18 15:18:51.532821 | node1 -> localhost | Generating public/private rsa key pair. 2026-08-18 15:18:51.533033 | node1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/920ad38283d44c288e81ee513d8ff8af_id_rsa 2026-08-18 15:18:51.533078 | node1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/920ad38283d44c288e81ee513d8ff8af_id_rsa.pub 2026-08-18 15:18:51.533110 | node1 -> localhost | The key fingerprint is: 2026-08-18 15:18:51.533140 | node1 -> localhost | SHA256:fsO7cCkBh1SqWk/fyL/Yl8GuZ8jpLRERKH5FeiF4tZ4 zuul-build-sshkey 2026-08-18 15:18:51.533170 | node1 -> localhost | The key's randomart image is: 2026-08-18 15:18:51.533199 | node1 -> localhost | +---[RSA 3072]----+ 2026-08-18 15:18:51.533227 | node1 -> localhost | | .oo+=. | 2026-08-18 15:18:51.533255 | node1 -> localhost | | .oooooo | 2026-08-18 15:18:51.533284 | node1 -> localhost | | .+oo.o. | 2026-08-18 15:18:51.533311 | node1 -> localhost | | ..o.o.. | 2026-08-18 15:18:51.533338 | node1 -> localhost | | o ..S Eo | 2026-08-18 15:18:51.533365 | node1 -> localhost | | o o + =..o | 2026-08-18 15:18:51.533392 | node1 -> localhost | | . . B.B= o | 2026-08-18 15:18:51.533419 | node1 -> localhost | | O=+* | 2026-08-18 15:18:51.533447 | node1 -> localhost | | ..OO. | 2026-08-18 15:18:51.533474 | node1 -> localhost | +----[SHA256]-----+ 2026-08-18 15:18:51.533537 | node1 -> localhost | ok: Runtime: 0:00:00.615894 2026-08-18 15:18:51.540656 | 2026-08-18 15:18:51.540720 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-18 15:18:51.577851 | node1 | ok 2026-08-18 15:18:51.583070 | node2 | ok 2026-08-18 15:18:51.587380 | node3 | ok 2026-08-18 15:18:51.605255 | node1 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:18:51.605307 | node2 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:18:51.605331 | node3 | included: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-18 15:18:51.618102 | 2026-08-18 15:18:51.618190 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-18 15:18:51.646121 | node1 | skipping: Conditional result was False 2026-08-18 15:18:51.657180 | node2 | skipping: Conditional result was False 2026-08-18 15:18:51.667640 | node3 | skipping: Conditional result was False 2026-08-18 15:18:51.679311 | 2026-08-18 15:18:51.679377 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-18 15:18:52.232029 | node1 | changed 2026-08-18 15:18:52.315605 | node3 | changed 2026-08-18 15:18:52.320166 | node2 | changed 2026-08-18 15:18:52.325512 | 2026-08-18 15:18:52.325576 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-18 15:18:52.556805 | node1 | ok 2026-08-18 15:18:52.562253 | node2 | ok 2026-08-18 15:18:52.579599 | node3 | ok 2026-08-18 15:18:52.586865 | 2026-08-18 15:18:52.586986 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-18 15:18:53.159963 | node2 | changed 2026-08-18 15:18:53.165637 | node1 | changed 2026-08-18 15:18:53.171617 | node3 | changed 2026-08-18 15:18:53.178160 | 2026-08-18 15:18:53.178234 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-18 15:18:53.752044 | node2 | changed 2026-08-18 15:18:53.759154 | node1 | changed 2026-08-18 15:18:53.780368 | node3 | changed 2026-08-18 15:18:53.785946 | 2026-08-18 15:18:53.786029 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-18 15:18:53.819163 | node1 | skipping: Conditional result was False 2026-08-18 15:18:53.830870 | node2 | skipping: Conditional result was False 2026-08-18 15:18:53.841586 | node3 | skipping: Conditional result was False 2026-08-18 15:18:53.853062 | 2026-08-18 15:18:53.853129 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-18 15:18:54.222606 | node1 -> localhost | changed 2026-08-18 15:18:54.251967 | 2026-08-18 15:18:54.252072 | TASK [add-build-sshkey : Add back temp key] 2026-08-18 15:18:54.519671 | node1 -> localhost | Identity added: /var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/920ad38283d44c288e81ee513d8ff8af_id_rsa (zuul-build-sshkey) 2026-08-18 15:18:54.519886 | node1 -> localhost | ok: Runtime: 0:00:00.014474 2026-08-18 15:18:54.527192 | 2026-08-18 15:18:54.527327 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-18 15:18:54.876705 | node2 | ok 2026-08-18 15:18:54.884102 | node3 | ok 2026-08-18 15:18:54.890565 | node1 | ok 2026-08-18 15:18:54.896065 | 2026-08-18 15:18:54.896130 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-18 15:18:54.975116 | node1 | skipping: Conditional result was False 2026-08-18 15:18:54.976437 | node2 | skipping: Conditional result was False 2026-08-18 15:18:54.997092 | node3 | skipping: Conditional result was False 2026-08-18 15:18:55.033446 | 2026-08-18 15:18:55.033519 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-18 15:18:55.361184 | node1 | ok 2026-08-18 15:18:55.382569 | node2 | ok 2026-08-18 15:18:55.388434 | node3 | ok 2026-08-18 15:18:55.395303 | 2026-08-18 15:18:55.395370 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-18 15:18:56.162577 | node1 | Output suppressed because no_log was given 2026-08-18 15:18:56.170694 | node2 | Output suppressed because no_log was given 2026-08-18 15:18:56.176666 | node3 | Output suppressed because no_log was given 2026-08-18 15:18:56.195773 | 2026-08-18 15:18:56.195883 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-18 15:18:56.427731 | node1 | ok: "logs" 2026-08-18 15:18:56.427983 | node1 | ok: All items complete 2026-08-18 15:18:56.428012 | 2026-08-18 15:18:56.461800 | node3 | ok: "logs" 2026-08-18 15:18:56.467859 | node2 | ok: "logs" 2026-08-18 15:18:56.624715 | node1 | ok: "artifacts" 2026-08-18 15:18:56.663103 | node3 | ok: "artifacts" 2026-08-18 15:18:56.669883 | node2 | ok: "artifacts" 2026-08-18 15:18:56.816265 | node1 | ok: "docs" 2026-08-18 15:18:56.858573 | node3 | ok: "docs" 2026-08-18 15:18:56.864454 | node2 | ok: "docs" 2026-08-18 15:18:56.881916 | 2026-08-18 15:18:56.882049 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-18 15:18:57.098223 | node1 | changed: "logs" 2026-08-18 15:18:57.098519 | node1 | ok: All items complete 2026-08-18 15:18:57.098559 | 2026-08-18 15:18:57.141656 | node2 | changed: "logs" 2026-08-18 15:18:57.148329 | node3 | changed: "logs" 2026-08-18 15:18:57.293655 | node1 | changed: "artifacts" 2026-08-18 15:18:57.356905 | node2 | changed: "artifacts" 2026-08-18 15:18:57.364950 | node3 | changed: "artifacts" 2026-08-18 15:18:57.477642 | node1 | changed: "docs" 2026-08-18 15:18:57.551614 | node2 | changed: "docs" 2026-08-18 15:18:57.563217 | node3 | changed: "docs" 2026-08-18 15:18:57.588678 | 2026-08-18 15:18:57.588788 | PLAY RECAP 2026-08-18 15:18:57.588837 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:18:57.588869 | node1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:18:57.588894 | node2 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:18:57.588917 | node3 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-18 15:18:57.588935 | 2026-08-18 15:18:57.725493 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-18 15:18:57.739403 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 15:18:58.385659 | 2026-08-18 15:18:58.385829 | PLAY [all] 2026-08-18 15:18:58.400008 | 2026-08-18 15:18:58.400152 | TASK [setup-uv : Extract archive] 2026-08-18 15:19:00.882827 | node2 | changed 2026-08-18 15:19:00.888612 | node1 | changed 2026-08-18 15:19:01.082866 | node3 | changed 2026-08-18 15:19:01.091748 | 2026-08-18 15:19:01.091882 | TASK [setup-uv : Print version] 2026-08-18 15:19:01.507673 | node3 | uv 0.8.13 2026-08-18 15:19:01.505958 | node2 | uv 0.8.13 2026-08-18 15:19:01.498904 | node1 | uv 0.8.13 2026-08-18 15:19:01.730162 | node1 | ok: Runtime: 0:00:00.015320 2026-08-18 15:19:01.741595 | node2 | ok: Runtime: 0:00:00.017195 2026-08-18 15:19:01.750120 | node3 | ok: Runtime: 0:00:00.019562 2026-08-18 15:19:01.768527 | 2026-08-18 15:19:01.768593 | TASK [Install Ansible collection siblings] 2026-08-18 15:19:02.130669 | node1 | ok: 2026-08-18 15:19:02.130938 | node1 | Skipping community.crypto: no checked-out sibling 2026-08-18 15:19:02.131008 | node1 | Skipping community.docker: no checked-out sibling 2026-08-18 15:19:02.131059 | node1 | Skipping community.general: no checked-out sibling 2026-08-18 15:19:02.131105 | node1 | Skipping ansible.utils: no checked-out sibling 2026-08-18 15:19:02.131155 | node1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-18 15:19:02.134510 | 2026-08-18 15:19:02.134609 | PLAY RECAP 2026-08-18 15:19:02.134702 | node1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:19:02.134764 | node2 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:19:02.134820 | node3 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:19:02.134863 | 2026-08-18 15:19:02.261279 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-18 15:19:02.269833 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 15:19:02.861906 | 2026-08-18 15:19:02.862022 | PLAY [all] 2026-08-18 15:19:02.874299 | 2026-08-18 15:19:02.874385 | LOOP [Check inventory directories] 2026-08-18 15:19:03.238008 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 15:19:03.425495 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-18 15:19:03.634117 | node1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-18 15:19:03.652700 | 2026-08-18 15:19:03.652920 | LOOP [Copy inventory file for Zuul] 2026-08-18 15:19:04.579708 | node1 | changed: 2026-08-18 15:19:04.579951 | node1 | { 2026-08-18 15:19:04.579989 | node1 | "ansible_loop_var": "item", 2026-08-18 15:19:04.580019 | node1 | "changed": false, 2026-08-18 15:19:04.580046 | node1 | "failed": false, 2026-08-18 15:19:04.580075 | node1 | "invocation": { 2026-08-18 15:19:04.580100 | node1 | "module_args": { 2026-08-18 15:19:04.580125 | node1 | "checksum_algorithm": "sha1", 2026-08-18 15:19:04.580162 | node1 | "follow": true, 2026-08-18 15:19:04.580187 | node1 | "get_attributes": true, 2026-08-18 15:19:04.580212 | node1 | "get_checksum": true, 2026-08-18 15:19:04.580235 | node1 | "get_mime": true, 2026-08-18 15:19:04.580259 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-18 15:19:04.580283 | node1 | } 2026-08-18 15:19:04.580306 | node1 | }, 2026-08-18 15:19:04.580330 | node1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 15:19:04.580353 | node1 | "stat": { 2026-08-18 15:19:04.580376 | node1 | "atime": 1787066336.0522938, 2026-08-18 15:19:04.580400 | node1 | "attr_flags": "e", 2026-08-18 15:19:04.580422 | node1 | "attributes": [ 2026-08-18 15:19:04.580445 | node1 | "extents" 2026-08-18 15:19:04.580468 | node1 | ], 2026-08-18 15:19:04.580491 | node1 | "block_size": 4096, 2026-08-18 15:19:04.580514 | node1 | "blocks": 8, 2026-08-18 15:19:04.580536 | node1 | "charset": "unknown", 2026-08-18 15:19:04.580561 | node1 | "ctime": 1787066336.0642965, 2026-08-18 15:19:04.580584 | node1 | "dev": 64769, 2026-08-18 15:19:04.580607 | node1 | "device_type": 0, 2026-08-18 15:19:04.580630 | node1 | "executable": true, 2026-08-18 15:19:04.580652 | node1 | "exists": true, 2026-08-18 15:19:04.580675 | node1 | "gid": 1000, 2026-08-18 15:19:04.580697 | node1 | "gr_name": "zuul", 2026-08-18 15:19:04.580720 | node1 | "inode": 1034272, 2026-08-18 15:19:04.580742 | node1 | "isblk": false, 2026-08-18 15:19:04.580765 | node1 | "ischr": false, 2026-08-18 15:19:04.580788 | node1 | "isdir": true, 2026-08-18 15:19:04.580811 | node1 | "isfifo": false, 2026-08-18 15:19:04.580833 | node1 | "isgid": false, 2026-08-18 15:19:04.580856 | node1 | "islnk": false, 2026-08-18 15:19:04.580878 | node1 | "isreg": false, 2026-08-18 15:19:04.580900 | node1 | "issock": false, 2026-08-18 15:19:04.580923 | node1 | "isuid": false, 2026-08-18 15:19:04.580945 | node1 | "mimetype": "unknown", 2026-08-18 15:19:04.580997 | node1 | "mode": "0755", 2026-08-18 15:19:04.581021 | node1 | "mtime": 1787066319.8369367, 2026-08-18 15:19:04.581044 | node1 | "nlink": 10, 2026-08-18 15:19:04.581066 | node1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-18 15:19:04.581089 | node1 | "pw_name": "zuul", 2026-08-18 15:19:04.581116 | node1 | "readable": true, 2026-08-18 15:19:04.581139 | node1 | "rgrp": true, 2026-08-18 15:19:04.581162 | node1 | "roth": true, 2026-08-18 15:19:04.581185 | node1 | "rusr": true, 2026-08-18 15:19:04.581208 | node1 | "size": 4096, 2026-08-18 15:19:04.581230 | node1 | "uid": 1000, 2026-08-18 15:19:04.581253 | node1 | "version": "1665134449", 2026-08-18 15:19:04.581276 | node1 | "wgrp": false, 2026-08-18 15:19:04.581330 | node1 | "woth": false, 2026-08-18 15:19:04.581358 | node1 | "writeable": true, 2026-08-18 15:19:04.581382 | node1 | "wusr": true, 2026-08-18 15:19:04.581405 | node1 | "xgrp": true, 2026-08-18 15:19:04.581428 | node1 | "xoth": true, 2026-08-18 15:19:04.581451 | node1 | "xusr": true 2026-08-18 15:19:04.581474 | node1 | } 2026-08-18 15:19:04.581497 | node1 | } 2026-08-18 15:19:04.581544 | node1 | ok: All items complete 2026-08-18 15:19:04.581572 | 2026-08-18 15:19:04.583015 | node1 | skipping: Conditional result was False 2026-08-18 15:19:04.583595 | node1 | skipping: Conditional result was False 2026-08-18 15:19:04.601819 | 2026-08-18 15:19:04.602096 | LOOP [Switch "ansible_host" to private IP] 2026-08-18 15:19:04.975541 | node1 | changed: 3 replacements made 2026-08-18 15:19:04.976759 | node1 | skipping: Conditional result was False 2026-08-18 15:19:04.977370 | node1 | skipping: Conditional result was False 2026-08-18 15:19:04.993443 | 2026-08-18 15:19:04.993618 | TASK [Run Molecule scenario] 2026-08-18 15:19:05.473636 | node1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-08-18 15:19:05.473817 | node1 | Creating virtual environment at: .venv 2026-08-18 15:19:05.522007 | node1 | Downloading pygments (1.2MiB) 2026-08-18 15:19:05.523212 | node1 | Downloading netaddr (2.2MiB) 2026-08-18 15:19:05.539562 | node1 | Downloading cryptography (4.3MiB) 2026-08-18 15:19:05.540430 | node1 | Downloading ansible-core (2.1MiB) 2026-08-18 15:19:05.765193 | node1 | Downloading netaddr 2026-08-18 15:19:05.777151 | node1 | Downloading cryptography 2026-08-18 15:19:05.828866 | node1 | Downloading pygments 2026-08-18 15:19:05.989438 | node1 | Downloading ansible-core 2026-08-18 15:19:06.035003 | node1 | Installed 43 packages in 44ms 2026-08-18 15:19:06.831458 | node1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-18 15:19:06.831593 | node1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-18 15:19:07.454647 | node1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-18 15:19:07.454742 | node1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-18 15:19:52.243898 | node1 | INFO [default > dependency] Executing 2026-08-18 15:19:52.244208 | node1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-18 15:19:52.244516 | node1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-18 15:19:52.244688 | node1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-18 15:19:52.252035 | node1 | INFO [default > cleanup] Executing 2026-08-18 15:19:52.252333 | node1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:19:52.257902 | node1 | INFO [default > destroy] Executing 2026-08-18 15:19:52.257977 | node1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 15:19:52.258054 | node1 | INFO [default > destroy] Executed: Successful 2026-08-18 15:19:52.263649 | node1 | INFO [default > syntax] Executing 2026-08-18 15:19:53.549890 | node1 | 2026-08-18 15:19:53.550195 | node1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-18 15:19:53.621368 | node1 | INFO [default > syntax] Executed: Successful 2026-08-18 15:19:53.632054 | node1 | INFO [default > create] Executing 2026-08-18 15:19:53.633519 | node1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:19:53.639232 | node1 | INFO [default > prepare] Executing 2026-08-18 15:19:54.443404 | node1 | 2026-08-18 15:19:54.443663 | node1 | PLAY [Prepare] ***************************************************************** 2026-08-18 15:19:54.443895 | node1 | 2026-08-18 15:19:54.444186 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:19:54.444437 | node1 | Tuesday 18 August 2026 15:19:54 +0000 (0:00:00.035) 0:00:00.035 ******** 2026-08-18 15:19:55.698002 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:19:55.698296 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:19:55.698559 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:19:55.698858 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:19:55.699119 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:19:55.728300 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:19:55.728397 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:19:55.728533 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:19:55.728700 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:19:55.728954 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:19:55.730001 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:19:55.730151 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:19:55.730311 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:19:55.730487 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:19:55.730648 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:19:55.738341 | node1 | ok: [node1] 2026-08-18 15:19:55.738462 | node1 | ok: [node3] 2026-08-18 15:19:55.738615 | node1 | ok: [node2] 2026-08-18 15:19:55.738759 | node1 | 2026-08-18 15:19:55.739013 | node1 | TASK [Configure short hostname] ************************************************ 2026-08-18 15:19:55.739212 | node1 | Tuesday 18 August 2026 15:19:55 +0000 (0:00:01.295) 0:00:01.331 ******** 2026-08-18 15:19:56.515658 | node1 | changed: [node3] 2026-08-18 15:19:56.515779 | node1 | changed: [node2] 2026-08-18 15:19:56.515957 | node1 | changed: [node1] 2026-08-18 15:19:56.516102 | node1 | 2026-08-18 15:19:56.516261 | node1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-18 15:19:56.516432 | node1 | Tuesday 18 August 2026 15:19:56 +0000 (0:00:00.776) 0:00:02.107 ******** 2026-08-18 15:19:56.827732 | node1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-18 15:19:56.828100 | node1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-18 15:19:56.828581 | node1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-18 15:19:56.864434 | node1 | changed: [node1] 2026-08-18 15:19:56.864635 | node1 | changed: [node2] 2026-08-18 15:19:56.865007 | node1 | changed: [node3] 2026-08-18 15:19:56.865258 | node1 | 2026-08-18 15:19:56.865519 | node1 | TASK [Update apt cache] ******************************************************** 2026-08-18 15:19:56.865763 | node1 | Tuesday 18 August 2026 15:19:56 +0000 (0:00:00.349) 0:00:02.457 ******** 2026-08-18 15:20:04.766121 | node1 | changed: [node3] 2026-08-18 15:20:04.766390 | node1 | changed: [node2] 2026-08-18 15:20:04.766404 | node1 | changed: [node1] 2026-08-18 15:20:04.766416 | node1 | 2026-08-18 15:20:04.766428 | node1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-18 15:20:04.766439 | node1 | 2026-08-18 15:20:04.766451 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:20:04.766471 | node1 | Tuesday 18 August 2026 15:20:04 +0000 (0:00:07.899) 0:00:10.356 ******** 2026-08-18 15:20:06.572370 | node1 | ok: [node2] 2026-08-18 15:20:06.572431 | node1 | ok: [node3] 2026-08-18 15:20:06.572503 | node1 | ok: [node1] 2026-08-18 15:20:06.572601 | node1 | 2026-08-18 15:20:06.572713 | node1 | TASK [Install depedencies] ***************************************************** 2026-08-18 15:20:06.572850 | node1 | Tuesday 18 August 2026 15:20:06 +0000 (0:00:01.808) 0:00:12.164 ******** 2026-08-18 15:20:27.998811 | node1 | changed: [node1] 2026-08-18 15:20:27.999034 | node1 | changed: [node3] 2026-08-18 15:20:27.999287 | node1 | changed: [node2] 2026-08-18 15:20:27.999529 | node1 | 2026-08-18 15:20:28.000004 | node1 | TASK [Start up service] ******************************************************** 2026-08-18 15:20:28.000272 | node1 | Tuesday 18 August 2026 15:20:27 +0000 (0:00:21.426) 0:00:33.590 ******** 2026-08-18 15:20:28.653241 | node1 | ok: [node1] 2026-08-18 15:20:28.653449 | node1 | ok: [node2] 2026-08-18 15:20:28.653700 | node1 | ok: [node3] 2026-08-18 15:20:28.653977 | node1 | 2026-08-18 15:20:28.654243 | node1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-18 15:20:28.654508 | node1 | Tuesday 18 August 2026 15:20:28 +0000 (0:00:00.654) 0:00:34.245 ******** 2026-08-18 15:20:29.003073 | node1 | ok: [node1] 2026-08-18 15:20:29.003119 | node1 | ok: [node2] 2026-08-18 15:20:29.003127 | node1 | ok: [node3] 2026-08-18 15:20:29.003135 | node1 | 2026-08-18 15:20:29.003147 | node1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-18 15:20:29.003346 | node1 | Tuesday 18 August 2026 15:20:29 +0000 (0:00:00.349) 0:00:34.594 ******** 2026-08-18 15:20:29.741260 | node1 | changed: [node1] 2026-08-18 15:20:29.741492 | node1 | changed: [node3] 2026-08-18 15:20:29.741745 | node1 | changed: [node2] 2026-08-18 15:20:29.742036 | node1 | 2026-08-18 15:20:29.742297 | node1 | TASK [Get list of all loopback devices] **************************************** 2026-08-18 15:20:29.742573 | node1 | Tuesday 18 August 2026 15:20:29 +0000 (0:00:00.738) 0:00:35.333 ******** 2026-08-18 15:20:30.015701 | node1 | ok: [node1] 2026-08-18 15:20:30.015972 | node1 | ok: [node2] 2026-08-18 15:20:30.016242 | node1 | ok: [node3] 2026-08-18 15:20:30.016477 | node1 | 2026-08-18 15:20:30.016738 | node1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-18 15:20:30.017046 | node1 | Tuesday 18 August 2026 15:20:30 +0000 (0:00:00.273) 0:00:35.607 ******** 2026-08-18 15:20:30.061615 | node1 | skipping: [node1] 2026-08-18 15:20:30.061829 | node1 | skipping: [node2] 2026-08-18 15:20:30.062113 | node1 | skipping: [node3] 2026-08-18 15:20:30.062354 | node1 | 2026-08-18 15:20:30.062599 | node1 | TASK [Create devices for Ceph] ************************************************* 2026-08-18 15:20:30.062841 | node1 | Tuesday 18 August 2026 15:20:30 +0000 (0:00:00.047) 0:00:35.654 ******** 2026-08-18 15:20:30.762989 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:20:30.763046 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:20:30.763056 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:20:30.763064 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:20:30.763073 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:20:30.763081 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:20:30.763090 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:20:30.763098 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:20:30.763107 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:20:30.763115 | node1 | 2026-08-18 15:20:30.763391 | node1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-18 15:20:30.763692 | node1 | Tuesday 18 August 2026 15:20:30 +0000 (0:00:00.697) 0:00:36.351 ******** 2026-08-18 15:20:31.542982 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:20:31.543342 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:20:31.543651 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:20:31.543979 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:20:31.544292 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:20:31.544626 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:20:31.544921 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:20:31.545246 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:20:31.545549 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:20:31.545824 | node1 | 2026-08-18 15:20:31.546151 | node1 | TASK [Start loop devices] ****************************************************** 2026-08-18 15:20:31.546458 | node1 | Tuesday 18 August 2026 15:20:31 +0000 (0:00:00.783) 0:00:37.135 ******** 2026-08-18 15:20:32.361091 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:20:32.361163 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:20:32.361173 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:20:32.361182 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:20:32.361190 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:20:32.361204 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:20:32.362125 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:20:32.362166 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:20:32.362172 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:20:32.362178 | node1 | 2026-08-18 15:20:32.362184 | node1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-18 15:20:32.362190 | node1 | Tuesday 18 August 2026 15:20:32 +0000 (0:00:00.815) 0:00:37.951 ******** 2026-08-18 15:20:33.837036 | node1 | changed: [node1] => (item=osd0) 2026-08-18 15:20:33.837094 | node1 | changed: [node2] => (item=osd0) 2026-08-18 15:20:33.837104 | node1 | changed: [node3] => (item=osd0) 2026-08-18 15:20:33.837124 | node1 | changed: [node2] => (item=osd1) 2026-08-18 15:20:33.837133 | node1 | changed: [node1] => (item=osd1) 2026-08-18 15:20:33.837141 | node1 | changed: [node3] => (item=osd1) 2026-08-18 15:20:33.837149 | node1 | changed: [node2] => (item=osd2) 2026-08-18 15:20:33.837163 | node1 | changed: [node3] => (item=osd2) 2026-08-18 15:20:33.837715 | node1 | changed: [node1] => (item=osd2) 2026-08-18 15:20:33.837748 | node1 | 2026-08-18 15:20:33.837755 | node1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-18 15:20:33.837762 | node1 | Tuesday 18 August 2026 15:20:33 +0000 (0:00:01.476) 0:00:39.427 ******** 2026-08-18 15:20:36.208007 | node1 | changed: [node1] => (item=ceph-node1-osd0) 2026-08-18 15:20:36.208058 | node1 | changed: [node2] => (item=ceph-node2-osd0) 2026-08-18 15:20:36.209049 | node1 | changed: [node3] => (item=ceph-node3-osd0) 2026-08-18 15:20:36.209130 | node1 | changed: [node1] => (item=ceph-node1-osd1) 2026-08-18 15:20:36.209136 | node1 | changed: [node2] => (item=ceph-node2-osd1) 2026-08-18 15:20:36.209147 | node1 | changed: [node3] => (item=ceph-node3-osd1) 2026-08-18 15:20:36.210012 | node1 | changed: [node1] => (item=ceph-node1-osd2) 2026-08-18 15:20:36.210078 | node1 | changed: [node3] => (item=ceph-node3-osd2) 2026-08-18 15:20:36.210088 | node1 | changed: [node2] => (item=ceph-node2-osd2) 2026-08-18 15:20:36.210180 | node1 | 2026-08-18 15:20:36.210483 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:20:36.210876 | node1 | node1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:20:36.211233 | node1 | node2 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:20:36.211565 | node1 | node3 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-18 15:20:36.211846 | node1 | 2026-08-18 15:20:36.212153 | node1 | 2026-08-18 15:20:36.212460 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:20:36.212769 | node1 | Tuesday 18 August 2026 15:20:36 +0000 (0:00:02.372) 0:00:41.800 ******** 2026-08-18 15:20:36.213091 | node1 | =============================================================================== 2026-08-18 15:20:36.213400 | node1 | Install depedencies ---------------------------------------------------- 21.43s 2026-08-18 15:20:36.213699 | node1 | Update apt cache -------------------------------------------------------- 7.90s 2026-08-18 15:20:36.214034 | node1 | Create a logical volume for each loop device ---------------------------- 2.37s 2026-08-18 15:20:36.214343 | node1 | Gathering Facts --------------------------------------------------------- 1.81s 2026-08-18 15:20:36.216970 | node1 | Create a volume group for each loop device ------------------------------ 1.48s 2026-08-18 15:20:36.216997 | node1 | Gathering Facts --------------------------------------------------------- 1.30s 2026-08-18 15:20:36.217006 | node1 | Start loop devices ------------------------------------------------------ 0.82s 2026-08-18 15:20:36.217015 | node1 | Set permissions on loopback devices ------------------------------------- 0.78s 2026-08-18 15:20:36.217023 | node1 | Configure short hostname ------------------------------------------------ 0.78s 2026-08-18 15:20:36.217032 | node1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.74s 2026-08-18 15:20:36.217040 | node1 | Create devices for Ceph ------------------------------------------------- 0.70s 2026-08-18 15:20:36.217070 | node1 | Start up service -------------------------------------------------------- 0.65s 2026-08-18 15:20:36.217079 | node1 | Generate lvm.conf ------------------------------------------------------- 0.35s 2026-08-18 15:20:36.217087 | node1 | Ensure hostname inside hosts file --------------------------------------- 0.35s 2026-08-18 15:20:36.217275 | node1 | Get list of all loopback devices ---------------------------------------- 0.27s 2026-08-18 15:20:36.217582 | node1 | Fail if there is any existing loopback devices -------------------------- 0.05s 2026-08-18 15:20:36.294395 | node1 | INFO [default > prepare] Executed: Successful 2026-08-18 15:20:36.305195 | node1 | INFO [default > converge] Executing 2026-08-18 15:20:37.456058 | node1 | 2026-08-18 15:20:37.456454 | node1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 15:20:37.456743 | node1 | 2026-08-18 15:20:37.457084 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:20:37.457438 | node1 | Tuesday 18 August 2026 15:20:37 +0000 (0:00:00.058) 0:00:00.058 ******** 2026-08-18 15:20:38.694424 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:20:38.694783 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:20:38.695118 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:20:38.695424 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:20:38.695777 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:20:38.856537 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:20:38.856768 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:20:38.857073 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:20:38.857324 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:20:38.857567 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:20:39.754806 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:20:39.755095 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:20:39.755346 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:20:39.755590 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:20:39.755840 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:20:39.817802 | node1 | ok: [node1] 2026-08-18 15:20:39.818149 | node1 | ok: [node3] 2026-08-18 15:20:39.818373 | node1 | ok: [node2] 2026-08-18 15:20:39.818519 | node1 | 2026-08-18 15:20:39.818679 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:20:39.818830 | node1 | Tuesday 18 August 2026 15:20:39 +0000 (0:00:02.361) 0:00:02.420 ******** 2026-08-18 15:20:40.191465 | node1 | ok: [node2] 2026-08-18 15:20:40.191616 | node1 | ok: [node1] 2026-08-18 15:20:40.191874 | node1 | ok: [node3] 2026-08-18 15:20:40.192167 | node1 | 2026-08-18 15:20:40.192437 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:20:40.192709 | node1 | Tuesday 18 August 2026 15:20:40 +0000 (0:00:00.372) 0:00:02.792 ******** 2026-08-18 15:20:40.231108 | node1 | skipping: [node1] 2026-08-18 15:20:40.294333 | node1 | skipping: [node2] 2026-08-18 15:20:40.294591 | node1 | skipping: [node3] 2026-08-18 15:20:40.294824 | node1 | 2026-08-18 15:20:40.295109 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:20:40.295332 | node1 | Tuesday 18 August 2026 15:20:40 +0000 (0:00:00.104) 0:00:02.897 ******** 2026-08-18 15:20:40.667455 | node1 | changed: [node1] 2026-08-18 15:20:40.667529 | node1 | changed: [node3] 2026-08-18 15:20:40.667632 | node1 | changed: [node2] 2026-08-18 15:20:40.667753 | node1 | 2026-08-18 15:20:40.667905 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:20:40.668068 | node1 | Tuesday 18 August 2026 15:20:40 +0000 (0:00:00.373) 0:00:03.270 ******** 2026-08-18 15:20:40.772083 | node1 | ok: [node2] => { 2026-08-18 15:20:40.772159 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:20:40.772170 | node1 | } 2026-08-18 15:20:40.772184 | node1 | ok: [node1] => { 2026-08-18 15:20:40.773635 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:20:40.773682 | node1 | } 2026-08-18 15:20:40.773689 | node1 | ok: [node3] => { 2026-08-18 15:20:40.773694 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:20:40.773700 | node1 | } 2026-08-18 15:20:40.773706 | node1 | 2026-08-18 15:20:40.773711 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:20:40.773717 | node1 | Tuesday 18 August 2026 15:20:40 +0000 (0:00:00.104) 0:00:03.374 ******** 2026-08-18 15:20:41.687036 | node1 | changed: [node3] 2026-08-18 15:20:41.687076 | node1 | changed: [node1] 2026-08-18 15:20:41.687085 | node1 | changed: [node2] 2026-08-18 15:20:41.687094 | node1 | 2026-08-18 15:20:41.687104 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:20:41.687113 | node1 | Tuesday 18 August 2026 15:20:41 +0000 (0:00:00.913) 0:00:04.287 ******** 2026-08-18 15:20:41.716724 | node1 | skipping: [node1] 2026-08-18 15:20:41.795170 | node1 | skipping: [node2] 2026-08-18 15:20:41.795221 | node1 | skipping: [node3] 2026-08-18 15:20:41.795227 | node1 | 2026-08-18 15:20:41.795233 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:20:41.795239 | node1 | Tuesday 18 August 2026 15:20:41 +0000 (0:00:00.108) 0:00:04.396 ******** 2026-08-18 15:20:41.913919 | node1 | skipping: [node1] 2026-08-18 15:20:41.913991 | node1 | skipping: [node2] 2026-08-18 15:20:41.914001 | node1 | skipping: [node3] 2026-08-18 15:20:41.914011 | node1 | 2026-08-18 15:20:41.914020 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:20:41.914029 | node1 | Tuesday 18 August 2026 15:20:41 +0000 (0:00:00.118) 0:00:04.514 ******** 2026-08-18 15:20:42.239092 | node1 | ok: [node1] 2026-08-18 15:20:42.239141 | node1 | ok: [node2] 2026-08-18 15:20:42.239151 | node1 | ok: [node3] 2026-08-18 15:20:42.239160 | node1 | 2026-08-18 15:20:42.239170 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:20:42.239179 | node1 | Tuesday 18 August 2026 15:20:42 +0000 (0:00:00.324) 0:00:04.839 ******** 2026-08-18 15:20:43.416120 | node1 | ok: [node1] 2026-08-18 15:20:43.416204 | node1 | ok: [node2] 2026-08-18 15:20:43.416280 | node1 | ok: [node3] 2026-08-18 15:20:43.416419 | node1 | 2026-08-18 15:20:43.416585 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:20:43.416743 | node1 | Tuesday 18 August 2026 15:20:43 +0000 (0:00:01.179) 0:00:06.018 ******** 2026-08-18 15:20:43.650267 | node1 | ok: [node1] => { 2026-08-18 15:20:43.650501 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:20:43.650721 | node1 | } 2026-08-18 15:20:43.651032 | node1 | ok: [node3] => { 2026-08-18 15:20:43.651295 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:20:43.651535 | node1 | } 2026-08-18 15:20:43.651778 | node1 | ok: [node2] => { 2026-08-18 15:20:43.652073 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:20:43.652300 | node1 | } 2026-08-18 15:20:43.652523 | node1 | 2026-08-18 15:20:43.652772 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:20:43.653083 | node1 | Tuesday 18 August 2026 15:20:43 +0000 (0:00:00.234) 0:00:06.253 ******** 2026-08-18 15:20:44.766392 | node1 | changed: [node3] 2026-08-18 15:20:44.766459 | node1 | changed: [node2] 2026-08-18 15:20:44.766527 | node1 | changed: [node1] 2026-08-18 15:20:44.766625 | node1 | 2026-08-18 15:20:44.766743 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:20:44.766857 | node1 | Tuesday 18 August 2026 15:20:44 +0000 (0:00:01.116) 0:00:07.369 ******** 2026-08-18 15:20:48.923980 | node1 | changed: [node1] 2026-08-18 15:20:48.924041 | node1 | changed: [node3] 2026-08-18 15:20:48.924054 | node1 | changed: [node2] 2026-08-18 15:20:48.924066 | node1 | 2026-08-18 15:20:48.924079 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:20:48.924091 | node1 | Tuesday 18 August 2026 15:20:48 +0000 (0:00:04.155) 0:00:11.524 ******** 2026-08-18 15:20:48.999071 | node1 | skipping: [node1] 2026-08-18 15:20:48.999114 | node1 | skipping: [node2] 2026-08-18 15:20:48.999122 | node1 | skipping: [node3] 2026-08-18 15:20:48.999922 | node1 | 2026-08-18 15:20:48.999986 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:20:49 | node1 | Tuesday 18 August 2026 15:20:48 +0000 (0:00:00.076) 0:00:11.600 ******** 2026-08-18 15:20:49.072975 | node1 | skipping: [node1] 2026-08-18 15:20:49.073030 | node1 | skipping: [node2] 2026-08-18 15:20:49.073042 | node1 | skipping: [node3] 2026-08-18 15:20:49.073054 | node1 | 2026-08-18 15:20:49.073066 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:20:49.073078 | node1 | Tuesday 18 August 2026 15:20:49 +0000 (0:00:00.073) 0:00:11.674 ******** 2026-08-18 15:20:49.140020 | node1 | skipping: [node1] 2026-08-18 15:20:49.140235 | node1 | skipping: [node2] 2026-08-18 15:20:49.140576 | node1 | skipping: [node3] 2026-08-18 15:20:49.140957 | node1 | 2026-08-18 15:20:49.141669 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:20:49.141696 | node1 | Tuesday 18 August 2026 15:20:49 +0000 (0:00:00.067) 0:00:11.741 ******** 2026-08-18 15:21:03.010704 | node1 | changed: [node1] 2026-08-18 15:21:03.010800 | node1 | changed: [node3] 2026-08-18 15:21:03.010811 | node1 | changed: [node2] 2026-08-18 15:21:03.010820 | node1 | 2026-08-18 15:21:03.010830 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:21:03.010840 | node1 | Tuesday 18 August 2026 15:21:03 +0000 (0:00:13.869) 0:00:25.611 ******** 2026-08-18 15:21:03.687784 | node1 | changed: [node1] 2026-08-18 15:21:03.687847 | node1 | changed: [node2] 2026-08-18 15:21:03.687863 | node1 | changed: [node3] 2026-08-18 15:21:03.687877 | node1 | 2026-08-18 15:21:03.687890 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:21:03.687902 | node1 | Tuesday 18 August 2026 15:21:03 +0000 (0:00:00.674) 0:00:26.285 ******** 2026-08-18 15:21:04.948000 | node1 | changed: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:04.948052 | node1 | changed: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:04.948063 | node1 | changed: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:21:04.948072 | node1 | changed: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:04.948081 | node1 | changed: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:04.948089 | node1 | changed: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:21:04.948098 | node1 | changed: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:04.948106 | node1 | changed: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:04.948114 | node1 | changed: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:21:04.948381 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:04.948760 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:04.949121 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:21:04.949462 | node1 | changed: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:04.949789 | node1 | changed: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:04.950157 | node1 | changed: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:21:04.950457 | node1 | 2026-08-18 15:21:04.950776 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:21:04.951124 | node1 | Tuesday 18 August 2026 15:21:04 +0000 (0:00:01.261) 0:00:27.547 ******** 2026-08-18 15:21:05.767701 | node1 | changed: [node1] 2026-08-18 15:21:05.767892 | node1 | changed: [node2] 2026-08-18 15:21:05.768092 | node1 | changed: [node3] 2026-08-18 15:21:05.768225 | node1 | 2026-08-18 15:21:05.768384 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:05.768540 | node1 | Tuesday 18 August 2026 15:21:05 +0000 (0:00:00.798) 0:00:28.345 ******** 2026-08-18 15:21:05.768683 | node1 | 2026-08-18 15:21:05.768853 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:05.769024 | node1 | Tuesday 18 August 2026 15:21:05 +0000 (0:00:00.008) 0:00:28.354 ******** 2026-08-18 15:21:05.769161 | node1 | 2026-08-18 15:21:05.769628 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:21:05.769696 | node1 | Tuesday 18 August 2026 15:21:05 +0000 (0:00:00.007) 0:00:28.362 ******** 2026-08-18 15:21:05.769850 | node1 | 2026-08-18 15:21:05.770351 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 15:21:05.770398 | node1 | Tuesday 18 August 2026 15:21:05 +0000 (0:00:00.008) 0:00:28.370 ******** 2026-08-18 15:21:06.936905 | node1 | ok: [node1] 2026-08-18 15:21:06.936989 | node1 | ok: [node2] 2026-08-18 15:21:06.937000 | node1 | ok: [node3] 2026-08-18 15:21:06.937009 | node1 | 2026-08-18 15:21:06.937041 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-18 15:21:06.937050 | node1 | Tuesday 18 August 2026 15:21:06 +0000 (0:00:01.166) 0:00:29.537 ******** 2026-08-18 15:21:07.565920 | node1 | changed: [node1] 2026-08-18 15:21:07.566026 | node1 | changed: [node2] 2026-08-18 15:21:07.566036 | node1 | changed: [node3] 2026-08-18 15:21:07.566046 | node1 | 2026-08-18 15:21:07.566055 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:21:07.566064 | node1 | Tuesday 18 August 2026 15:21:07 +0000 (0:00:00.629) 0:00:30.166 ******** 2026-08-18 15:21:08.348132 | node1 | changed: [node2] 2026-08-18 15:21:08.348166 | node1 | changed: [node1] 2026-08-18 15:21:08.348171 | node1 | changed: [node3] 2026-08-18 15:21:08.348176 | node1 | 2026-08-18 15:21:08.348181 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:21:08.348186 | node1 | Tuesday 18 August 2026 15:21:08 +0000 (0:00:00.783) 0:00:30.949 ******** 2026-08-18 15:21:08.648699 | node1 | ok: [node1] 2026-08-18 15:21:08.648741 | node1 | ok: [node2] 2026-08-18 15:21:08.648748 | node1 | ok: [node3] 2026-08-18 15:21:08.648754 | node1 | 2026-08-18 15:21:08.648760 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:21:08.648767 | node1 | Tuesday 18 August 2026 15:21:08 +0000 (0:00:00.300) 0:00:31.250 ******** 2026-08-18 15:21:08.800987 | node1 | ok: [node1] => { 2026-08-18 15:21:08.801034 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:21:08.801044 | node1 | } 2026-08-18 15:21:08.801054 | node1 | ok: [node2] => { 2026-08-18 15:21:08.801062 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:21:08.801071 | node1 | } 2026-08-18 15:21:08.801079 | node1 | ok: [node3] => { 2026-08-18 15:21:08.801087 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:21:08.801096 | node1 | } 2026-08-18 15:21:08.801104 | node1 | 2026-08-18 15:21:08.801407 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:21:08.801729 | node1 | Tuesday 18 August 2026 15:21:08 +0000 (0:00:00.150) 0:00:31.400 ******** 2026-08-18 15:21:09.864681 | node1 | changed: [node1] 2026-08-18 15:21:09.865099 | node1 | changed: [node2] 2026-08-18 15:21:09.865429 | node1 | changed: [node3] 2026-08-18 15:21:09.865727 | node1 | 2026-08-18 15:21:09.866090 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:21:09.866423 | node1 | Tuesday 18 August 2026 15:21:09 +0000 (0:00:01.066) 0:00:32.466 ******** 2026-08-18 15:21:14.609789 | node1 | changed: [node1] 2026-08-18 15:21:14.610219 | node1 | changed: [node2] 2026-08-18 15:21:14.610547 | node1 | changed: [node3] 2026-08-18 15:21:14.610846 | node1 | 2026-08-18 15:21:14.611231 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:21:14.611618 | node1 | Tuesday 18 August 2026 15:21:14 +0000 (0:00:04.744) 0:00:37.211 ******** 2026-08-18 15:21:15.559468 | node1 | ok: [node1] 2026-08-18 15:21:15.559714 | node1 | ok: [node2] 2026-08-18 15:21:15.559953 | node1 | ok: [node3] 2026-08-18 15:21:15.560157 | node1 | 2026-08-18 15:21:15.560373 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:21:15.560584 | node1 | Tuesday 18 August 2026 15:21:15 +0000 (0:00:00.950) 0:00:38.161 ******** 2026-08-18 15:21:15.994270 | node1 | changed: [node1] 2026-08-18 15:21:15.994330 | node1 | changed: [node3] 2026-08-18 15:21:15.994786 | node1 | changed: [node2] 2026-08-18 15:21:15.994800 | node1 | 2026-08-18 15:21:15.994806 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:21:15.994812 | node1 | Tuesday 18 August 2026 15:21:15 +0000 (0:00:00.435) 0:00:38.597 ******** 2026-08-18 15:21:16.630131 | node1 | changed: [node1] 2026-08-18 15:21:16.630214 | node1 | changed: [node2] 2026-08-18 15:21:16.630227 | node1 | changed: [node3] 2026-08-18 15:21:16.630239 | node1 | 2026-08-18 15:21:16.630252 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:21:16.630272 | node1 | Tuesday 18 August 2026 15:21:16 +0000 (0:00:00.634) 0:00:39.231 ******** 2026-08-18 15:21:17.405424 | node1 | changed: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:21:17.405541 | node1 | changed: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:21:17.405709 | node1 | changed: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:21:17.405864 | node1 | changed: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:21:17.407074 | node1 | changed: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:21:17.407129 | node1 | changed: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:21:17.407140 | node1 | changed: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:21:17.407148 | node1 | changed: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:21:17.407157 | node1 | changed: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:21:17.407166 | node1 | 2026-08-18 15:21:17.407175 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:21:17.407190 | node1 | Tuesday 18 August 2026 15:21:17 +0000 (0:00:00.776) 0:00:40.007 ******** 2026-08-18 15:21:18.062429 | node1 | changed: [node1] 2026-08-18 15:21:18.062492 | node1 | changed: [node2] 2026-08-18 15:21:18.062595 | node1 | changed: [node3] 2026-08-18 15:21:18.062698 | node1 | 2026-08-18 15:21:18.062816 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:21:18.062935 | node1 | Tuesday 18 August 2026 15:21:18 +0000 (0:00:00.657) 0:00:40.665 ******** 2026-08-18 15:21:18.720034 | node1 | changed: [node1] 2026-08-18 15:21:18.720084 | node1 | changed: [node2] 2026-08-18 15:21:18.720094 | node1 | changed: [node3] 2026-08-18 15:21:18.720103 | node1 | 2026-08-18 15:21:18.720112 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:21:18.720458 | node1 | Tuesday 18 August 2026 15:21:18 +0000 (0:00:00.628) 0:00:41.293 ******** 2026-08-18 15:21:18.720776 | node1 | 2026-08-18 15:21:18.721145 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:21:18.721469 | node1 | Tuesday 18 August 2026 15:21:18 +0000 (0:00:00.008) 0:00:41.301 ******** 2026-08-18 15:21:18.721756 | node1 | 2026-08-18 15:21:18.722146 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:21:18.722510 | node1 | Tuesday 18 August 2026 15:21:18 +0000 (0:00:00.008) 0:00:41.309 ******** 2026-08-18 15:21:18.722821 | node1 | 2026-08-18 15:21:18.723218 | node1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-18 15:21:18.723578 | node1 | Tuesday 18 August 2026 15:21:18 +0000 (0:00:00.011) 0:00:41.320 ******** 2026-08-18 15:21:19.725503 | node1 | ok: [node1] 2026-08-18 15:21:19.726067 | node1 | ok: [node2] 2026-08-18 15:21:19.726421 | node1 | ok: [node3] 2026-08-18 15:21:19.726740 | node1 | 2026-08-18 15:21:19.727200 | node1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-18 15:21:19.727597 | node1 | Tuesday 18 August 2026 15:21:19 +0000 (0:00:01.007) 0:00:42.328 ******** 2026-08-18 15:21:24.557691 | node1 | changed: [node1] 2026-08-18 15:21:24.557979 | node1 | changed: [node2] 2026-08-18 15:21:24.558192 | node1 | changed: [node3] 2026-08-18 15:21:24.559148 | node1 | 2026-08-18 15:21:24.559219 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:21:24.559239 | node1 | Tuesday 18 August 2026 15:21:24 +0000 (0:00:04.832) 0:00:47.160 ******** 2026-08-18 15:21:25.337460 | node1 | changed: [node2] 2026-08-18 15:21:25.337551 | node1 | changed: [node1] 2026-08-18 15:21:25.337565 | node1 | changed: [node3] 2026-08-18 15:21:25.337672 | node1 | 2026-08-18 15:21:25.337788 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:21:25.337958 | node1 | Tuesday 18 August 2026 15:21:25 +0000 (0:00:00.779) 0:00:47.939 ******** 2026-08-18 15:21:25.431692 | node1 | ok: [node1] => { 2026-08-18 15:21:25.431778 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:21:25.431921 | node1 | } 2026-08-18 15:21:25.433041 | node1 | ok: [node2] => { 2026-08-18 15:21:25.433099 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:21:25.433107 | node1 | } 2026-08-18 15:21:25.433114 | node1 | ok: [node3] => { 2026-08-18 15:21:25.433119 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:21:25.433143 | node1 | } 2026-08-18 15:21:25.433147 | node1 | 2026-08-18 15:21:25.433151 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:21:25.433156 | node1 | Tuesday 18 August 2026 15:21:25 +0000 (0:00:00.093) 0:00:48.033 ******** 2026-08-18 15:21:27.416291 | node1 | changed: [node3] 2026-08-18 15:21:27.416349 | node1 | changed: [node1] 2026-08-18 15:21:27.416359 | node1 | changed: [node2] 2026-08-18 15:21:27.416368 | node1 | 2026-08-18 15:21:27.416378 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:21:27.416386 | node1 | Tuesday 18 August 2026 15:21:27 +0000 (0:00:01.983) 0:00:50.017 ******** 2026-08-18 15:21:27.452459 | node1 | skipping: [node1] 2026-08-18 15:21:27.518015 | node1 | skipping: [node2] 2026-08-18 15:21:27.518079 | node1 | skipping: [node3] 2026-08-18 15:21:27.518091 | node1 | 2026-08-18 15:21:27.518101 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:21:27.518111 | node1 | Tuesday 18 August 2026 15:21:27 +0000 (0:00:00.102) 0:00:50.119 ******** 2026-08-18 15:21:27.606986 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:21:27.607032 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:21:27.607041 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:21:27.607051 | node1 | 2026-08-18 15:21:27.607060 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:21:27.607069 | node1 | Tuesday 18 August 2026 15:21:27 +0000 (0:00:00.088) 0:00:50.207 ******** 2026-08-18 15:21:28.655982 | node1 | ok: [node3] 2026-08-18 15:21:28.656039 | node1 | ok: [node1] 2026-08-18 15:21:28.656049 | node1 | ok: [node2] 2026-08-18 15:21:28.656058 | node1 | 2026-08-18 15:21:28.656068 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:21:28.656077 | node1 | Tuesday 18 August 2026 15:21:28 +0000 (0:00:01.048) 0:00:51.256 ******** 2026-08-18 15:21:29.522012 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:21:29.522085 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:21:29.522097 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:21:29.522108 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:21:29.522119 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:21:29.522128 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:21:29.522221 | node1 | 2026-08-18 15:21:29.522625 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:21:29.523087 | node1 | Tuesday 18 August 2026 15:21:29 +0000 (0:00:00.865) 0:00:52.121 ******** 2026-08-18 15:21:29.806816 | node1 | ok: [node2] 2026-08-18 15:21:29.807147 | node1 | ok: [node1] 2026-08-18 15:21:29.807398 | node1 | ok: [node3] 2026-08-18 15:21:29.807626 | node1 | 2026-08-18 15:21:29.807895 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:21:29.808228 | node1 | Tuesday 18 August 2026 15:21:29 +0000 (0:00:00.287) 0:00:52.409 ******** 2026-08-18 15:21:30.639365 | node1 | changed: [node1] 2026-08-18 15:21:30.639760 | node1 | changed: [node3] 2026-08-18 15:21:30.640132 | node1 | changed: [node2] 2026-08-18 15:21:30.640440 | node1 | 2026-08-18 15:21:30.640785 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:21:30.641173 | node1 | Tuesday 18 August 2026 15:21:30 +0000 (0:00:00.832) 0:00:53.242 ******** 2026-08-18 15:21:31.310213 | node1 | changed: [node2] 2026-08-18 15:21:31.310630 | node1 | changed: [node1] 2026-08-18 15:21:31.311026 | node1 | changed: [node3] 2026-08-18 15:21:31.311337 | node1 | 2026-08-18 15:21:31.311671 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:21:31.312026 | node1 | Tuesday 18 August 2026 15:21:31 +0000 (0:00:00.670) 0:00:53.912 ******** 2026-08-18 15:21:31.386822 | node1 | skipping: [node1] 2026-08-18 15:21:31.387254 | node1 | skipping: [node2] 2026-08-18 15:21:31.387578 | node1 | skipping: [node3] 2026-08-18 15:21:31.388038 | node1 | 2026-08-18 15:21:31.388511 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:21:31.389078 | node1 | Tuesday 18 August 2026 15:21:31 +0000 (0:00:00.076) 0:00:53.989 ******** 2026-08-18 15:22:24.704796 | node1 | changed: [node3] 2026-08-18 15:22:24.705262 | node1 | changed: [node2] 2026-08-18 15:22:24.705590 | node1 | changed: [node1] 2026-08-18 15:22:24.705892 | node1 | 2026-08-18 15:22:24.706326 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:22:24.706657 | node1 | Tuesday 18 August 2026 15:22:24 +0000 (0:00:53.317) 0:01:47.307 ******** 2026-08-18 15:22:25.319443 | node1 | changed: [node1] 2026-08-18 15:22:25.320192 | node1 | changed: [node2] 2026-08-18 15:22:25.320255 | node1 | changed: [node3] 2026-08-18 15:22:25.320898 | node1 | 2026-08-18 15:22:25.320937 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 15:22:25.320951 | node1 | Tuesday 18 August 2026 15:22:25 +0000 (0:00:00.614) 0:01:47.921 ******** 2026-08-18 15:22:25.645058 | node1 | ok: [node1] 2026-08-18 15:22:25.645116 | node1 | ok: [node3] 2026-08-18 15:22:25.645956 | node1 | ok: [node2] 2026-08-18 15:22:25.646030 | node1 | 2026-08-18 15:22:25.646044 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 15:22:25.646056 | node1 | Tuesday 18 August 2026 15:22:25 +0000 (0:00:00.324) 0:01:48.246 ******** 2026-08-18 15:22:25.730013 | node1 | ok: [node1] => { 2026-08-18 15:22:25.730063 | node1 | "changed": false, 2026-08-18 15:22:25.730076 | node1 | "msg": "All assertions passed" 2026-08-18 15:22:25.730088 | node1 | } 2026-08-18 15:22:25.730099 | node1 | ok: [node2] => { 2026-08-18 15:22:25.730111 | node1 | "changed": false, 2026-08-18 15:22:25.730122 | node1 | "msg": "All assertions passed" 2026-08-18 15:22:25.730133 | node1 | } 2026-08-18 15:22:25.730144 | node1 | ok: [node3] => { 2026-08-18 15:22:25.730155 | node1 | "changed": false, 2026-08-18 15:22:25.730457 | node1 | "msg": "All assertions passed" 2026-08-18 15:22:25.730759 | node1 | } 2026-08-18 15:22:25.731107 | node1 | 2026-08-18 15:22:25.731434 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 15:22:25.731744 | node1 | Tuesday 18 August 2026 15:22:25 +0000 (0:00:00.083) 0:01:48.330 ******** 2026-08-18 15:22:25.809507 | node1 | ok: [node1] 2026-08-18 15:22:25.809703 | node1 | ok: [node2] 2026-08-18 15:22:25.809863 | node1 | ok: [node3] 2026-08-18 15:22:25.810040 | node1 | 2026-08-18 15:22:25.810213 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 15:22:25.810380 | node1 | Tuesday 18 August 2026 15:22:25 +0000 (0:00:00.082) 0:01:48.412 ******** 2026-08-18 15:22:26.489436 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:22:26.489813 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:22:26.490172 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:22:26.490471 | node1 | 2026-08-18 15:22:26.490801 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 15:22:26.491152 | node1 | Tuesday 18 August 2026 15:22:26 +0000 (0:00:00.679) 0:01:49.092 ******** 2026-08-18 15:22:26.572252 | node1 | ok: [node1] 2026-08-18 15:22:26.572624 | node1 | ok: [node2] 2026-08-18 15:22:26.573006 | node1 | ok: [node3] 2026-08-18 15:22:26.573353 | node1 | 2026-08-18 15:22:26.573789 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:22:26.574203 | node1 | Tuesday 18 August 2026 15:22:26 +0000 (0:00:00.082) 0:01:49.175 ******** 2026-08-18 15:22:26.711572 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for node1, node2, node3 2026-08-18 15:22:26.711995 | node1 | 2026-08-18 15:22:26.712345 | node1 | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] ***************************** 2026-08-18 15:22:26.712672 | node1 | Tuesday 18 August 2026 15:22:26 +0000 (0:00:00.139) 0:01:49.314 ******** 2026-08-18 15:22:26.964916 | node1 | skipping: [node2] 2026-08-18 15:22:26.965463 | node1 | skipping: [node3] 2026-08-18 15:22:26.965796 | node1 | changed: [node1] 2026-08-18 15:22:26.966155 | node1 | 2026-08-18 15:22:26.966508 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] *********** 2026-08-18 15:22:26.966911 | node1 | Tuesday 18 August 2026 15:22:26 +0000 (0:00:00.253) 0:01:49.567 ******** 2026-08-18 15:22:27.040829 | node1 | skipping: [node1] 2026-08-18 15:22:27.041240 | node1 | skipping: [node2] 2026-08-18 15:22:27.041560 | node1 | skipping: [node3] 2026-08-18 15:22:27.041942 | node1 | 2026-08-18 15:22:27.042673 | node1 | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************ 2026-08-18 15:22:27.042692 | node1 | Tuesday 18 August 2026 15:22:27 +0000 (0:00:00.075) 0:01:49.643 ******** 2026-08-18 15:22:27.119816 | node1 | skipping: [node1] 2026-08-18 15:22:27.160208 | node1 | skipping: [node2] 2026-08-18 15:22:27.160326 | node1 | skipping: [node3] 2026-08-18 15:22:27.160337 | node1 | 2026-08-18 15:22:27.160357 | node1 | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] *** 2026-08-18 15:22:27.160551 | node1 | Tuesday 18 August 2026 15:22:27 +0000 (0:00:00.118) 0:01:49.762 ******** 2026-08-18 15:22:28.371973 | node1 | skipping: [node2] 2026-08-18 15:22:28.372019 | node1 | skipping: [node3] 2026-08-18 15:22:28.372028 | node1 | changed: [node1] 2026-08-18 15:22:28.372037 | node1 | 2026-08-18 15:22:28.372047 | node1 | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] *** 2026-08-18 15:22:28.372056 | node1 | Tuesday 18 August 2026 15:22:28 +0000 (0:00:01.211) 0:01:50.973 ******** 2026-08-18 15:22:28.701032 | node1 | skipping: [node2] 2026-08-18 15:22:28.701086 | node1 | skipping: [node3] 2026-08-18 15:22:28.701096 | node1 | changed: [node1] 2026-08-18 15:22:28.701105 | node1 | 2026-08-18 15:22:28.701115 | node1 | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] ************** 2026-08-18 15:22:28.701124 | node1 | Tuesday 18 August 2026 15:22:28 +0000 (0:00:00.328) 0:01:51.301 ******** 2026-08-18 15:22:28.774365 | node1 | skipping: [node1] 2026-08-18 15:22:28.774447 | node1 | skipping: [node2] 2026-08-18 15:22:28.774458 | node1 | skipping: [node3] 2026-08-18 15:22:28.774470 | node1 | 2026-08-18 15:22:28.774482 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:22:28.774494 | node1 | Tuesday 18 August 2026 15:22:28 +0000 (0:00:00.073) 0:01:51.375 ******** 2026-08-18 15:23:22.552113 | node1 | skipping: [node2] 2026-08-18 15:23:22.552702 | node1 | skipping: [node3] 2026-08-18 15:23:22.552718 | node1 | changed: [node1] 2026-08-18 15:23:22.552736 | node1 | 2026-08-18 15:23:22.552749 | node1 | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] ********************** 2026-08-18 15:23:22.552879 | node1 | Tuesday 18 August 2026 15:23:22 +0000 (0:00:53.778) 0:02:45.153 ******** 2026-08-18 15:23:22.809053 | node1 | skipping: [node2] 2026-08-18 15:23:22.809108 | node1 | skipping: [node3] 2026-08-18 15:23:22.809121 | node1 | changed: [node1] 2026-08-18 15:23:22.809140 | node1 | 2026-08-18 15:23:22.809590 | node1 | TASK [Register this monitor host] ********************************************** 2026-08-18 15:23:22.809650 | node1 | Tuesday 18 August 2026 15:23:22 +0000 (0:00:00.257) 0:02:45.411 ******** 2026-08-18 15:23:22.962343 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:23:22.962401 | node1 | 2026-08-18 15:23:22.962415 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:23:22.962427 | node1 | Tuesday 18 August 2026 15:23:22 +0000 (0:00:00.153) 0:02:45.564 ******** 2026-08-18 15:23:24.811552 | node1 | ok: [node1] 2026-08-18 15:23:24.811618 | node1 | 2026-08-18 15:23:24.811632 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:23:24.811645 | node1 | Tuesday 18 August 2026 15:23:24 +0000 (0:00:01.849) 0:02:47.413 ******** 2026-08-18 15:23:24.909435 | node1 | ok: [node1] 2026-08-18 15:23:24.909479 | node1 | ok: [node2] 2026-08-18 15:23:24.909488 | node1 | ok: [node3] 2026-08-18 15:23:24.909496 | node1 | 2026-08-18 15:23:24.909503 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:23:24.909511 | node1 | Tuesday 18 August 2026 15:23:24 +0000 (0:00:00.098) 0:02:47.511 ******** 2026-08-18 15:23:24.998139 | node1 | ok: [node1] => { 2026-08-18 15:23:24.998182 | node1 | "changed": false, 2026-08-18 15:23:24.998190 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:24.998198 | node1 | } 2026-08-18 15:23:24.998206 | node1 | ok: [node2] => { 2026-08-18 15:23:24.998240 | node1 | "changed": false, 2026-08-18 15:23:24.998245 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:24.998251 | node1 | } 2026-08-18 15:23:24.998257 | node1 | ok: [node3] => { 2026-08-18 15:23:24.998263 | node1 | "changed": false, 2026-08-18 15:23:24.998269 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:24.998275 | node1 | } 2026-08-18 15:23:24.998282 | node1 | 2026-08-18 15:23:24.998290 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:23:24.998297 | node1 | Tuesday 18 August 2026 15:23:24 +0000 (0:00:00.087) 0:02:47.598 ******** 2026-08-18 15:23:25.451632 | node1 | changed: [node3] 2026-08-18 15:23:25.451714 | node1 | changed: [node2] 2026-08-18 15:23:25.451824 | node1 | ok: [node1] 2026-08-18 15:23:25.452040 | node1 | 2026-08-18 15:23:25.452266 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:23:25.452470 | node1 | Tuesday 18 August 2026 15:23:25 +0000 (0:00:00.454) 0:02:48.053 ******** 2026-08-18 15:23:25.539805 | node1 | ok: [node1] 2026-08-18 15:23:25.541097 | node1 | ok: [node2] 2026-08-18 15:23:25.541156 | node1 | ok: [node3] 2026-08-18 15:23:25.541167 | node1 | 2026-08-18 15:23:25.541295 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:23:25.541665 | node1 | Tuesday 18 August 2026 15:23:25 +0000 (0:00:00.089) 0:02:48.142 ******** 2026-08-18 15:23:25.658331 | node1 | ok: [node1] 2026-08-18 15:23:25.658556 | node1 | ok: [node2] 2026-08-18 15:23:25.658836 | node1 | ok: [node3] 2026-08-18 15:23:25.659153 | node1 | 2026-08-18 15:23:25.659443 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:23:25.659719 | node1 | Tuesday 18 August 2026 15:23:25 +0000 (0:00:00.118) 0:02:48.260 ******** 2026-08-18 15:23:25.742396 | node1 | ok: [node1] => { 2026-08-18 15:23:25.742601 | node1 | "changed": false, 2026-08-18 15:23:25.742844 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:25.743166 | node1 | } 2026-08-18 15:23:25.743417 | node1 | ok: [node2] => { 2026-08-18 15:23:25.743658 | node1 | "changed": false, 2026-08-18 15:23:25.743898 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:25.744228 | node1 | } 2026-08-18 15:23:25.744486 | node1 | ok: [node3] => { 2026-08-18 15:23:25.744749 | node1 | "changed": false, 2026-08-18 15:23:25.745049 | node1 | "msg": "All assertions passed" 2026-08-18 15:23:25.745292 | node1 | } 2026-08-18 15:23:25.745524 | node1 | 2026-08-18 15:23:25.745814 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:23:25.746144 | node1 | Tuesday 18 August 2026 15:23:25 +0000 (0:00:00.084) 0:02:48.345 ******** 2026-08-18 15:23:47.032423 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:23:47.032512 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:23:47.032603 | node1 | changed: [node1] 2026-08-18 15:23:47.032967 | node1 | 2026-08-18 15:23:47.033005 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:23:47.033012 | node1 | Tuesday 18 August 2026 15:23:47 +0000 (0:00:21.289) 0:03:09.634 ******** 2026-08-18 15:23:47.166315 | node1 | skipping: [node1] 2026-08-18 15:23:47.166420 | node1 | skipping: [node2] 2026-08-18 15:23:47.166459 | node1 | skipping: [node3] 2026-08-18 15:23:47.166471 | node1 | 2026-08-18 15:23:47.166484 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 15:23:47.166497 | node1 | Tuesday 18 August 2026 15:23:47 +0000 (0:00:00.132) 0:03:09.767 ******** 2026-08-18 15:23:50.607149 | node1 | changed: [node1] 2026-08-18 15:23:50.607196 | node1 | 2026-08-18 15:23:50.607202 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 15:23:50.607208 | node1 | Tuesday 18 August 2026 15:23:50 +0000 (0:00:03.441) 0:03:13.208 ******** 2026-08-18 15:23:58.248541 | node1 | ok: [node1] 2026-08-18 15:23:58.248615 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:23:58.248628 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:23:58.248641 | node1 | 2026-08-18 15:23:58.248654 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 15:23:58.248689 | node1 | Tuesday 18 August 2026 15:23:58 +0000 (0:00:07.640) 0:03:20.849 ******** 2026-08-18 15:23:59.010009 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:23:59.010073 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:23:59.010974 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:23:59.011010 | node1 | 2026-08-18 15:23:59.011021 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 15:23:59.011031 | node1 | Tuesday 18 August 2026 15:23:59 +0000 (0:00:00.761) 0:03:21.610 ******** 2026-08-18 15:23:59.110381 | node1 | ok: [node1] 2026-08-18 15:23:59.110461 | node1 | ok: [node2] 2026-08-18 15:23:59.110471 | node1 | ok: [node3] 2026-08-18 15:23:59.110481 | node1 | 2026-08-18 15:23:59.110835 | node1 | TASK [Register this manager host] ********************************************** 2026-08-18 15:23:59.110873 | node1 | Tuesday 18 August 2026 15:23:59 +0000 (0:00:00.100) 0:03:21.711 ******** 2026-08-18 15:23:59.252543 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:23:59.252606 | node1 | 2026-08-18 15:23:59.252617 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:23:59.252626 | node1 | Tuesday 18 August 2026 15:23:59 +0000 (0:00:00.142) 0:03:21.853 ******** 2026-08-18 15:24:02.477389 | node1 | ok: [node1] 2026-08-18 15:24:02.477456 | node1 | 2026-08-18 15:24:02.477470 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:24:02.477483 | node1 | Tuesday 18 August 2026 15:24:02 +0000 (0:00:03.224) 0:03:25.078 ******** 2026-08-18 15:24:02.570060 | node1 | ok: [node1] 2026-08-18 15:24:02.570131 | node1 | ok: [node2] 2026-08-18 15:24:02.570145 | node1 | ok: [node3] 2026-08-18 15:24:02.570158 | node1 | 2026-08-18 15:24:02.570172 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:24:02.570247 | node1 | Tuesday 18 August 2026 15:24:02 +0000 (0:00:00.091) 0:03:25.170 ******** 2026-08-18 15:24:02.665409 | node1 | ok: [node1] => { 2026-08-18 15:24:02.665509 | node1 | "changed": false, 2026-08-18 15:24:02.665582 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:02.665708 | node1 | } 2026-08-18 15:24:02.665802 | node1 | ok: [node2] => { 2026-08-18 15:24:02.665900 | node1 | "changed": false, 2026-08-18 15:24:02.666032 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:02.666136 | node1 | } 2026-08-18 15:24:02.666243 | node1 | ok: [node3] => { 2026-08-18 15:24:02.666356 | node1 | "changed": false, 2026-08-18 15:24:02.666464 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:02.666567 | node1 | } 2026-08-18 15:24:02.666667 | node1 | 2026-08-18 15:24:02.666802 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:24:02.666960 | node1 | Tuesday 18 August 2026 15:24:02 +0000 (0:00:00.097) 0:03:25.267 ******** 2026-08-18 15:24:03.030137 | node1 | ok: [node1] 2026-08-18 15:24:03.030197 | node1 | ok: [node2] 2026-08-18 15:24:03.030213 | node1 | ok: [node3] 2026-08-18 15:24:03.030228 | node1 | 2026-08-18 15:24:03.030243 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:24:03.030257 | node1 | Tuesday 18 August 2026 15:24:03 +0000 (0:00:00.363) 0:03:25.630 ******** 2026-08-18 15:24:03.133136 | node1 | ok: [node1] 2026-08-18 15:24:03.133203 | node1 | ok: [node2] 2026-08-18 15:24:03.133217 | node1 | ok: [node3] 2026-08-18 15:24:03.133229 | node1 | 2026-08-18 15:24:03.133242 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:24:03.133254 | node1 | Tuesday 18 August 2026 15:24:03 +0000 (0:00:00.102) 0:03:25.733 ******** 2026-08-18 15:24:03.261962 | node1 | ok: [node1] 2026-08-18 15:24:03.262014 | node1 | ok: [node2] 2026-08-18 15:24:03.262027 | node1 | ok: [node3] 2026-08-18 15:24:03.262039 | node1 | 2026-08-18 15:24:03.262052 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:24:03.262063 | node1 | Tuesday 18 August 2026 15:24:03 +0000 (0:00:00.129) 0:03:25.862 ******** 2026-08-18 15:24:03.351988 | node1 | ok: [node1] => { 2026-08-18 15:24:03.352039 | node1 | "changed": false, 2026-08-18 15:24:03.352052 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:03.352084 | node1 | } 2026-08-18 15:24:03.352093 | node1 | ok: [node2] => { 2026-08-18 15:24:03.352102 | node1 | "changed": false, 2026-08-18 15:24:03.352110 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:03.352118 | node1 | } 2026-08-18 15:24:03.352127 | node1 | ok: [node3] => { 2026-08-18 15:24:03.352135 | node1 | "changed": false, 2026-08-18 15:24:03.352351 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:03.352640 | node1 | } 2026-08-18 15:24:03.352917 | node1 | 2026-08-18 15:24:03.353264 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:24:03.353572 | node1 | Tuesday 18 August 2026 15:24:03 +0000 (0:00:00.089) 0:03:25.952 ******** 2026-08-18 15:24:05.276591 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:05.276911 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:05.277160 | node1 | ok: [node1] 2026-08-18 15:24:05.277359 | node1 | 2026-08-18 15:24:05.277578 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:24:05.277790 | node1 | Tuesday 18 August 2026 15:24:05 +0000 (0:00:01.916) 0:03:27.868 ******** 2026-08-18 15:24:05.387010 | node1 | skipping: [node1] 2026-08-18 15:24:05.387423 | node1 | skipping: [node2] 2026-08-18 15:24:05.387747 | node1 | skipping: [node3] 2026-08-18 15:24:05.388127 | node1 | 2026-08-18 15:24:05.388487 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 15:24:05.388830 | node1 | Tuesday 18 August 2026 15:24:05 +0000 (0:00:00.119) 0:03:27.988 ******** 2026-08-18 15:24:13.656808 | node1 | changed: [node1] 2026-08-18 15:24:13.657108 | node1 | 2026-08-18 15:24:13.657453 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 15:24:13.657782 | node1 | Tuesday 18 August 2026 15:24:13 +0000 (0:00:08.270) 0:03:36.259 ******** 2026-08-18 15:24:15.506967 | node1 | ok: [node1] 2026-08-18 15:24:15.507394 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:15.507738 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:15.508078 | node1 | 2026-08-18 15:24:15.508423 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 15:24:15.508754 | node1 | Tuesday 18 August 2026 15:24:15 +0000 (0:00:01.850) 0:03:38.109 ******** 2026-08-18 15:24:25.918853 | node1 | changed: [node1] => (item={'name': 'diskprediction_local'}) 2026-08-18 15:24:25.919300 | node1 | changed: [node1] => (item={'name': 'dashboard'}) 2026-08-18 15:24:25.919626 | node1 | ok: [node1] => (item={'name': 'iostat'}) 2026-08-18 15:24:25.919976 | node1 | changed: [node1] => (item={'name': 'prometheus'}) 2026-08-18 15:24:25.920342 | node1 | changed: [node1] => (item={'name': 'rgw'}) 2026-08-18 15:24:25.920656 | node1 | 2026-08-18 15:24:25.921017 | node1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 15:24:25.921312 | node1 | 2026-08-18 15:24:25.921621 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:24:25.921966 | node1 | Tuesday 18 August 2026 15:24:25 +0000 (0:00:10.411) 0:03:48.521 ******** 2026-08-18 15:24:27.990434 | node1 | ok: [node1] 2026-08-18 15:24:27.990514 | node1 | ok: [node3] 2026-08-18 15:24:27.990619 | node1 | ok: [node2] 2026-08-18 15:24:27.990719 | node1 | 2026-08-18 15:24:27.990834 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:27.990971 | node1 | Tuesday 18 August 2026 15:24:27 +0000 (0:00:02.070) 0:03:50.591 ******** 2026-08-18 15:24:28.302132 | node1 | ok: [node1] 2026-08-18 15:24:28.302211 | node1 | ok: [node2] 2026-08-18 15:24:28.302330 | node1 | ok: [node3] 2026-08-18 15:24:28.302432 | node1 | 2026-08-18 15:24:28.302549 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:28.302657 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:00.313) 0:03:50.904 ******** 2026-08-18 15:24:28.408588 | node1 | skipping: [node1] 2026-08-18 15:24:28.408644 | node1 | skipping: [node2] 2026-08-18 15:24:28.408655 | node1 | skipping: [node3] 2026-08-18 15:24:28.408670 | node1 | 2026-08-18 15:24:28.408678 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:24:28.408717 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:00.102) 0:03:51.006 ******** 2026-08-18 15:24:28.749500 | node1 | ok: [node1] 2026-08-18 15:24:28.749578 | node1 | ok: [node2] 2026-08-18 15:24:28.749666 | node1 | ok: [node3] 2026-08-18 15:24:28.749758 | node1 | 2026-08-18 15:24:28.749876 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:28.750005 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:00.343) 0:03:51.350 ******** 2026-08-18 15:24:28.846537 | node1 | ok: [node1] => { 2026-08-18 15:24:28.846600 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:28.846757 | node1 | } 2026-08-18 15:24:28.846876 | node1 | ok: [node2] => { 2026-08-18 15:24:28.847032 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:28.847135 | node1 | } 2026-08-18 15:24:28.847282 | node1 | ok: [node3] => { 2026-08-18 15:24:28.847381 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:24:28.847500 | node1 | } 2026-08-18 15:24:28.847608 | node1 | 2026-08-18 15:24:28.847750 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:28.847900 | node1 | Tuesday 18 August 2026 15:24:28 +0000 (0:00:00.096) 0:03:51.446 ******** 2026-08-18 15:24:29.269452 | node1 | ok: [node1] 2026-08-18 15:24:29.269514 | node1 | ok: [node2] 2026-08-18 15:24:29.269641 | node1 | ok: [node3] 2026-08-18 15:24:29.269743 | node1 | 2026-08-18 15:24:29.269856 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:29.270017 | node1 | Tuesday 18 August 2026 15:24:29 +0000 (0:00:00.422) 0:03:51.869 ******** 2026-08-18 15:24:29.381842 | node1 | skipping: [node1] 2026-08-18 15:24:29.381911 | node1 | skipping: [node2] 2026-08-18 15:24:29.382416 | node1 | skipping: [node3] 2026-08-18 15:24:29.382457 | node1 | 2026-08-18 15:24:29.382462 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:29.382466 | node1 | Tuesday 18 August 2026 15:24:29 +0000 (0:00:00.115) 0:03:51.984 ******** 2026-08-18 15:24:29.419504 | node1 | skipping: [node1] 2026-08-18 15:24:29.494099 | node1 | skipping: [node2] 2026-08-18 15:24:29.494161 | node1 | skipping: [node3] 2026-08-18 15:24:29.494214 | node1 | 2026-08-18 15:24:29.494775 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:29.494833 | node1 | Tuesday 18 August 2026 15:24:29 +0000 (0:00:00.111) 0:03:52.096 ******** 2026-08-18 15:24:29.798080 | node1 | ok: [node1] 2026-08-18 15:24:29.798167 | node1 | ok: [node2] 2026-08-18 15:24:29.799111 | node1 | ok: [node3] 2026-08-18 15:24:29.799171 | node1 | 2026-08-18 15:24:29.799182 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:24:29.799192 | node1 | Tuesday 18 August 2026 15:24:29 +0000 (0:00:00.303) 0:03:52.399 ******** 2026-08-18 15:24:30.883679 | node1 | ok: [node1] 2026-08-18 15:24:30.883791 | node1 | ok: [node2] 2026-08-18 15:24:30.883798 | node1 | ok: [node3] 2026-08-18 15:24:30.883804 | node1 | 2026-08-18 15:24:30.883810 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:30.883816 | node1 | Tuesday 18 August 2026 15:24:30 +0000 (0:00:01.083) 0:03:53.483 ******** 2026-08-18 15:24:30.990091 | node1 | ok: [node1] => { 2026-08-18 15:24:30.992026 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:30.992086 | node1 | } 2026-08-18 15:24:30.992098 | node1 | ok: [node2] => { 2026-08-18 15:24:30.992108 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:30.992117 | node1 | } 2026-08-18 15:24:30.992126 | node1 | ok: [node3] => { 2026-08-18 15:24:30.992416 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:24:30.992732 | node1 | } 2026-08-18 15:24:30.993070 | node1 | 2026-08-18 15:24:30.993418 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:30.993835 | node1 | Tuesday 18 August 2026 15:24:30 +0000 (0:00:00.108) 0:03:53.591 ******** 2026-08-18 15:24:31.453539 | node1 | ok: [node2] 2026-08-18 15:24:31.453947 | node1 | ok: [node1] 2026-08-18 15:24:31.454331 | node1 | ok: [node3] 2026-08-18 15:24:31.454653 | node1 | 2026-08-18 15:24:31.455112 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:31.455438 | node1 | Tuesday 18 August 2026 15:24:31 +0000 (0:00:00.464) 0:03:54.056 ******** 2026-08-18 15:24:33.600477 | node1 | ok: [node1] 2026-08-18 15:24:33.600863 | node1 | ok: [node2] 2026-08-18 15:24:33.601222 | node1 | ok: [node3] 2026-08-18 15:24:33.601524 | node1 | 2026-08-18 15:24:33.601855 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:24:33.602211 | node1 | Tuesday 18 August 2026 15:24:33 +0000 (0:00:02.146) 0:03:56.202 ******** 2026-08-18 15:24:33.671717 | node1 | skipping: [node1] 2026-08-18 15:24:33.672109 | node1 | skipping: [node2] 2026-08-18 15:24:33.672426 | node1 | skipping: [node3] 2026-08-18 15:24:33.672719 | node1 | 2026-08-18 15:24:33.673080 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:24:33.673408 | node1 | Tuesday 18 August 2026 15:24:33 +0000 (0:00:00.071) 0:03:56.274 ******** 2026-08-18 15:24:33.740826 | node1 | skipping: [node1] 2026-08-18 15:24:33.741088 | node1 | skipping: [node2] 2026-08-18 15:24:33.741286 | node1 | skipping: [node3] 2026-08-18 15:24:33.741468 | node1 | 2026-08-18 15:24:33.741670 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:24:33.741884 | node1 | Tuesday 18 August 2026 15:24:33 +0000 (0:00:00.068) 0:03:56.343 ******** 2026-08-18 15:24:33.814155 | node1 | skipping: [node1] 2026-08-18 15:24:33.815181 | node1 | skipping: [node2] 2026-08-18 15:24:33.815260 | node1 | skipping: [node3] 2026-08-18 15:24:33.815273 | node1 | 2026-08-18 15:24:33.815292 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:24:33.815499 | node1 | Tuesday 18 August 2026 15:24:33 +0000 (0:00:00.073) 0:03:56.416 ******** 2026-08-18 15:24:34.897064 | node1 | ok: [node3] 2026-08-18 15:24:34.897839 | node1 | ok: [node1] 2026-08-18 15:24:34.897894 | node1 | ok: [node2] 2026-08-18 15:24:34.897907 | node1 | 2026-08-18 15:24:34.898336 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:24:34.898395 | node1 | Tuesday 18 August 2026 15:24:34 +0000 (0:00:01.082) 0:03:57.499 ******** 2026-08-18 15:24:35.506420 | node1 | ok: [node1] 2026-08-18 15:24:35.506480 | node1 | ok: [node2] 2026-08-18 15:24:35.506574 | node1 | ok: [node3] 2026-08-18 15:24:35.506676 | node1 | 2026-08-18 15:24:35.506793 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:24:35.506907 | node1 | Tuesday 18 August 2026 15:24:35 +0000 (0:00:00.607) 0:03:58.107 ******** 2026-08-18 15:24:36.699154 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:36.699237 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:36.699389 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:24:36.703033 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:36.703076 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:36.703094 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:24:36.703109 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:36.703124 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:36.703138 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:24:36.703153 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:36.703169 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:36.703190 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:24:36.703619 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:36.703661 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:36.703826 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:24:36.704006 | node1 | 2026-08-18 15:24:36.704136 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:24:36.704351 | node1 | Tuesday 18 August 2026 15:24:36 +0000 (0:00:01.194) 0:03:59.302 ******** 2026-08-18 15:24:37.431404 | node1 | ok: [node1] 2026-08-18 15:24:37.431644 | node1 | ok: [node2] 2026-08-18 15:24:37.431892 | node1 | ok: [node3] 2026-08-18 15:24:37.432164 | node1 | 2026-08-18 15:24:37.432425 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:37.432678 | node1 | Tuesday 18 August 2026 15:24:37 +0000 (0:00:00.713) 0:04:00.015 ******** 2026-08-18 15:24:37.432906 | node1 | 2026-08-18 15:24:37.433202 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:37.433445 | node1 | Tuesday 18 August 2026 15:24:37 +0000 (0:00:00.006) 0:04:00.021 ******** 2026-08-18 15:24:37.433669 | node1 | 2026-08-18 15:24:37.433920 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:24:37.434209 | node1 | Tuesday 18 August 2026 15:24:37 +0000 (0:00:00.006) 0:04:00.028 ******** 2026-08-18 15:24:37.434498 | node1 | 2026-08-18 15:24:37.434743 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:24:37.435023 | node1 | Tuesday 18 August 2026 15:24:37 +0000 (0:00:00.006) 0:04:00.034 ******** 2026-08-18 15:24:37.937183 | node1 | ok: [node1] 2026-08-18 15:24:37.937425 | node1 | ok: [node2] 2026-08-18 15:24:37.937669 | node1 | ok: [node3] 2026-08-18 15:24:37.937960 | node1 | 2026-08-18 15:24:37.938244 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:24:37.938494 | node1 | Tuesday 18 August 2026 15:24:37 +0000 (0:00:00.505) 0:04:00.539 ******** 2026-08-18 15:24:38.238621 | node1 | ok: [node1] 2026-08-18 15:24:38.238809 | node1 | ok: [node2] 2026-08-18 15:24:38.239081 | node1 | ok: [node3] 2026-08-18 15:24:38.239294 | node1 | 2026-08-18 15:24:38.239547 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:38.239804 | node1 | Tuesday 18 August 2026 15:24:38 +0000 (0:00:00.301) 0:04:00.841 ******** 2026-08-18 15:24:38.331354 | node1 | ok: [node1] => { 2026-08-18 15:24:38.331678 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:38.331969 | node1 | } 2026-08-18 15:24:38.332300 | node1 | ok: [node2] => { 2026-08-18 15:24:38.332555 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:38.332810 | node1 | } 2026-08-18 15:24:38.333103 | node1 | ok: [node3] => { 2026-08-18 15:24:38.333359 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:24:38.333599 | node1 | } 2026-08-18 15:24:38.333844 | node1 | 2026-08-18 15:24:38.334158 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:38.334402 | node1 | Tuesday 18 August 2026 15:24:38 +0000 (0:00:00.092) 0:04:00.933 ******** 2026-08-18 15:24:38.809086 | node1 | ok: [node2] 2026-08-18 15:24:38.809138 | node1 | ok: [node1] 2026-08-18 15:24:38.809176 | node1 | ok: [node3] 2026-08-18 15:24:38.809405 | node1 | 2026-08-18 15:24:38.809705 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:38.809968 | node1 | Tuesday 18 August 2026 15:24:38 +0000 (0:00:00.477) 0:04:01.411 ******** 2026-08-18 15:24:42.107373 | node1 | ok: [node1] 2026-08-18 15:24:42.107576 | node1 | ok: [node2] 2026-08-18 15:24:42.107877 | node1 | ok: [node3] 2026-08-18 15:24:42.108164 | node1 | 2026-08-18 15:24:42.108419 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:24:42.108661 | node1 | Tuesday 18 August 2026 15:24:42 +0000 (0:00:03.298) 0:04:04.710 ******** 2026-08-18 15:24:43.249018 | node1 | ok: [node1] 2026-08-18 15:24:43.249215 | node1 | ok: [node3] 2026-08-18 15:24:43.249463 | node1 | ok: [node2] 2026-08-18 15:24:43.249693 | node1 | 2026-08-18 15:24:43.250120 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:24:43.250386 | node1 | Tuesday 18 August 2026 15:24:43 +0000 (0:00:01.141) 0:04:05.851 ******** 2026-08-18 15:24:43.554391 | node1 | ok: [node1] 2026-08-18 15:24:43.554598 | node1 | ok: [node2] 2026-08-18 15:24:43.554843 | node1 | ok: [node3] 2026-08-18 15:24:43.555161 | node1 | 2026-08-18 15:24:43.555423 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:24:43.555672 | node1 | Tuesday 18 August 2026 15:24:43 +0000 (0:00:00.305) 0:04:06.156 ******** 2026-08-18 15:24:44.170194 | node1 | ok: [node3] 2026-08-18 15:24:44.170386 | node1 | ok: [node1] 2026-08-18 15:24:44.170673 | node1 | ok: [node2] 2026-08-18 15:24:44.170869 | node1 | 2026-08-18 15:24:44.171211 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:24:44.171541 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.616) 0:04:06.772 ******** 2026-08-18 15:24:44.868969 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:44.869003 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:44.869008 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:24:44.869012 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:44.869016 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:44.869020 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:24:44.869024 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:44.869037 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:44.869078 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:24:44.869177 | node1 | 2026-08-18 15:24:44.869291 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:24:44.869400 | node1 | Tuesday 18 August 2026 15:24:44 +0000 (0:00:00.698) 0:04:07.471 ******** 2026-08-18 15:24:45.432899 | node1 | ok: [node1] 2026-08-18 15:24:45.433190 | node1 | ok: [node2] 2026-08-18 15:24:45.433437 | node1 | ok: [node3] 2026-08-18 15:24:45.433662 | node1 | 2026-08-18 15:24:45.433919 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:24:45.434200 | node1 | Tuesday 18 August 2026 15:24:45 +0000 (0:00:00.564) 0:04:08.035 ******** 2026-08-18 15:24:46.057173 | node1 | ok: [node2] 2026-08-18 15:24:46.057432 | node1 | ok: [node1] 2026-08-18 15:24:46.057691 | node1 | ok: [node3] 2026-08-18 15:24:46.057958 | node1 | 2026-08-18 15:24:46.058326 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:24:46.058602 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.604) 0:04:08.640 ******** 2026-08-18 15:24:46.058840 | node1 | 2026-08-18 15:24:46.059145 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:24:46.059410 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.006) 0:04:08.646 ******** 2026-08-18 15:24:46.059663 | node1 | 2026-08-18 15:24:46.059915 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:24:46.060205 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.006) 0:04:08.653 ******** 2026-08-18 15:24:46.060561 | node1 | 2026-08-18 15:24:46.060788 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:24:46.061072 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.006) 0:04:08.659 ******** 2026-08-18 15:24:46.538664 | node1 | ok: [node2] 2026-08-18 15:24:46.538747 | node1 | ok: [node1] 2026-08-18 15:24:46.538760 | node1 | ok: [node3] 2026-08-18 15:24:46.538855 | node1 | 2026-08-18 15:24:46.539153 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:24:46.539399 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.480) 0:04:09.140 ******** 2026-08-18 15:24:46.606621 | node1 | ok: [node1] => { 2026-08-18 15:24:46.606859 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:24:46.607174 | node1 | } 2026-08-18 15:24:46.607415 | node1 | ok: [node2] => { 2026-08-18 15:24:46.607660 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:24:46.607893 | node1 | } 2026-08-18 15:24:46.608177 | node1 | ok: [node3] => { 2026-08-18 15:24:46.608424 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:24:46.608755 | node1 | } 2026-08-18 15:24:46.609108 | node1 | 2026-08-18 15:24:46.609364 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:24:46.609614 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.068) 0:04:09.209 ******** 2026-08-18 15:24:46.967842 | node1 | ok: [node1] 2026-08-18 15:24:46.968006 | node1 | ok: [node2] 2026-08-18 15:24:46.968160 | node1 | ok: [node3] 2026-08-18 15:24:46.968303 | node1 | 2026-08-18 15:24:46.968467 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:24:46.968617 | node1 | Tuesday 18 August 2026 15:24:46 +0000 (0:00:00.360) 0:04:09.570 ******** 2026-08-18 15:24:46.996735 | node1 | skipping: [node1] 2026-08-18 15:24:47.047367 | node1 | skipping: [node2] 2026-08-18 15:24:47.047586 | node1 | skipping: [node3] 2026-08-18 15:24:47.047809 | node1 | 2026-08-18 15:24:47.048122 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:24:47.048379 | node1 | Tuesday 18 August 2026 15:24:47 +0000 (0:00:00.079) 0:04:09.650 ******** 2026-08-18 15:24:47.131499 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:24:47.131591 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:24:47.131705 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:24:47.131809 | node1 | 2026-08-18 15:24:47.131954 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:24:47.132059 | node1 | Tuesday 18 August 2026 15:24:47 +0000 (0:00:00.083) 0:04:09.733 ******** 2026-08-18 15:24:48.159386 | node1 | ok: [node1] 2026-08-18 15:24:48.159454 | node1 | ok: [node2] 2026-08-18 15:24:48.160109 | node1 | ok: [node3] 2026-08-18 15:24:48.160161 | node1 | 2026-08-18 15:24:48.160434 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:24:48.160528 | node1 | Tuesday 18 August 2026 15:24:48 +0000 (0:00:01.028) 0:04:10.761 ******** 2026-08-18 15:24:49.054082 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:24:49.054169 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:24:49.055034 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:24:49.055100 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:24:49.055114 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:24:49.055182 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:24:49.055322 | node1 | 2026-08-18 15:24:49.055584 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:24:49.055821 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.893) 0:04:11.655 ******** 2026-08-18 15:24:49.346088 | node1 | ok: [node2] 2026-08-18 15:24:49.346330 | node1 | ok: [node1] 2026-08-18 15:24:49.346581 | node1 | ok: [node3] 2026-08-18 15:24:49.346840 | node1 | 2026-08-18 15:24:49.347140 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:24:49.347396 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.292) 0:04:11.948 ******** 2026-08-18 15:24:49.668696 | node1 | ok: [node1] 2026-08-18 15:24:49.668919 | node1 | ok: [node2] 2026-08-18 15:24:49.669193 | node1 | ok: [node3] 2026-08-18 15:24:49.669519 | node1 | 2026-08-18 15:24:49.669764 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:24:49.669985 | node1 | Tuesday 18 August 2026 15:24:49 +0000 (0:00:00.322) 0:04:12.271 ******** 2026-08-18 15:24:50.250367 | node1 | ok: [node2] 2026-08-18 15:24:50.250589 | node1 | ok: [node1] 2026-08-18 15:24:50.250829 | node1 | ok: [node3] 2026-08-18 15:24:50.251090 | node1 | 2026-08-18 15:24:50.251388 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:24:50.251651 | node1 | Tuesday 18 August 2026 15:24:50 +0000 (0:00:00.581) 0:04:12.852 ******** 2026-08-18 15:24:50.320494 | node1 | skipping: [node1] 2026-08-18 15:24:50.320553 | node1 | skipping: [node2] 2026-08-18 15:24:50.320579 | node1 | skipping: [node3] 2026-08-18 15:24:50.320713 | node1 | 2026-08-18 15:24:50.321087 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:24:50.321435 | node1 | Tuesday 18 August 2026 15:24:50 +0000 (0:00:00.068) 0:04:12.921 ******** 2026-08-18 15:24:50.780032 | node1 | ok: [node2] 2026-08-18 15:24:50.780259 | node1 | ok: [node1] 2026-08-18 15:24:50.780501 | node1 | ok: [node3] 2026-08-18 15:24:50.780727 | node1 | 2026-08-18 15:24:50.781053 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:24:50.781337 | node1 | Tuesday 18 August 2026 15:24:50 +0000 (0:00:00.460) 0:04:13.382 ******** 2026-08-18 15:24:51.393653 | node1 | ok: [node1] 2026-08-18 15:24:51.393823 | node1 | ok: [node2] 2026-08-18 15:24:51.394001 | node1 | ok: [node3] 2026-08-18 15:24:51.394158 | node1 | 2026-08-18 15:24:51.394336 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 15:24:51.394495 | node1 | Tuesday 18 August 2026 15:24:51 +0000 (0:00:00.613) 0:04:13.996 ******** 2026-08-18 15:24:52.195333 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:24:52.195420 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:24:52.195615 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:24:52.195771 | node1 | 2026-08-18 15:24:52.195974 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 15:24:52.196151 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.793) 0:04:14.789 ******** 2026-08-18 15:24:52.266558 | node1 | ok: [node1] 2026-08-18 15:24:52.266786 | node1 | ok: [node2] 2026-08-18 15:24:52.267036 | node1 | ok: [node3] 2026-08-18 15:24:52.267279 | node1 | 2026-08-18 15:24:52.267514 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 15:24:52.267759 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.079) 0:04:14.869 ******** 2026-08-18 15:24:52.345006 | node1 | ok: [node1] 2026-08-18 15:24:52.345127 | node1 | ok: [node2] 2026-08-18 15:24:52.345346 | node1 | ok: [node3] 2026-08-18 15:24:52.345509 | node1 | 2026-08-18 15:24:52.345684 | node1 | TASK [Register this OSD host] ************************************************** 2026-08-18 15:24:52.345861 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.078) 0:04:14.947 ******** 2026-08-18 15:24:52.464163 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:24:52.464290 | node1 | 2026-08-18 15:24:52.464468 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:24:52.464648 | node1 | Tuesday 18 August 2026 15:24:52 +0000 (0:00:00.119) 0:04:15.066 ******** 2026-08-18 15:24:54.996087 | node1 | ok: [node1] 2026-08-18 15:24:54.996150 | node1 | 2026-08-18 15:24:54.996171 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:24:54.996480 | node1 | Tuesday 18 August 2026 15:24:54 +0000 (0:00:02.531) 0:04:17.598 ******** 2026-08-18 15:24:55.070644 | node1 | ok: [node1] 2026-08-18 15:24:55.070852 | node1 | ok: [node2] 2026-08-18 15:24:55.071349 | node1 | ok: [node3] 2026-08-18 15:24:55.071901 | node1 | 2026-08-18 15:24:55.071973 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:24:55.072675 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.074) 0:04:17.672 ******** 2026-08-18 15:24:55.149356 | node1 | ok: [node1] => { 2026-08-18 15:24:55.149430 | node1 | "changed": false, 2026-08-18 15:24:55.149541 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.149651 | node1 | } 2026-08-18 15:24:55.149763 | node1 | ok: [node2] => { 2026-08-18 15:24:55.149872 | node1 | "changed": false, 2026-08-18 15:24:55.150046 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.150867 | node1 | } 2026-08-18 15:24:55.150904 | node1 | ok: [node3] => { 2026-08-18 15:24:55.150910 | node1 | "changed": false, 2026-08-18 15:24:55.150916 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.150921 | node1 | } 2026-08-18 15:24:55.150940 | node1 | 2026-08-18 15:24:55.150954 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:24:55.150960 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.078) 0:04:17.751 ******** 2026-08-18 15:24:55.547905 | node1 | ok: [node1] 2026-08-18 15:24:55.547985 | node1 | ok: [node2] 2026-08-18 15:24:55.547995 | node1 | ok: [node3] 2026-08-18 15:24:55.548005 | node1 | 2026-08-18 15:24:55.548015 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:24:55.548024 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.397) 0:04:18.148 ******** 2026-08-18 15:24:55.620371 | node1 | ok: [node1] 2026-08-18 15:24:55.620464 | node1 | ok: [node2] 2026-08-18 15:24:55.620573 | node1 | ok: [node3] 2026-08-18 15:24:55.620675 | node1 | 2026-08-18 15:24:55.620800 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:24:55.620925 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.072) 0:04:18.221 ******** 2026-08-18 15:24:55.731236 | node1 | ok: [node1] 2026-08-18 15:24:55.731300 | node1 | ok: [node2] 2026-08-18 15:24:55.731309 | node1 | ok: [node3] 2026-08-18 15:24:55.731319 | node1 | 2026-08-18 15:24:55.731329 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:24:55.731338 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.110) 0:04:18.331 ******** 2026-08-18 15:24:55.811997 | node1 | ok: [node1] => { 2026-08-18 15:24:55.812057 | node1 | "changed": false, 2026-08-18 15:24:55.812067 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.812076 | node1 | } 2026-08-18 15:24:55.812085 | node1 | ok: [node2] => { 2026-08-18 15:24:55.812093 | node1 | "changed": false, 2026-08-18 15:24:55.812101 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.812109 | node1 | } 2026-08-18 15:24:55.812117 | node1 | ok: [node3] => { 2026-08-18 15:24:55.812385 | node1 | "changed": false, 2026-08-18 15:24:55.812827 | node1 | "msg": "All assertions passed" 2026-08-18 15:24:55.813174 | node1 | } 2026-08-18 15:24:55.813474 | node1 | 2026-08-18 15:24:55.813822 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:24:55.814172 | node1 | Tuesday 18 August 2026 15:24:55 +0000 (0:00:00.079) 0:04:18.411 ******** 2026-08-18 15:24:57.846860 | node1 | ok: [node1] 2026-08-18 15:24:57.847304 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:57.847630 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:24:57.847987 | node1 | 2026-08-18 15:24:57.848322 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:24:57.848646 | node1 | Tuesday 18 August 2026 15:24:57 +0000 (0:00:02.037) 0:04:20.449 ******** 2026-08-18 15:24:57.942368 | node1 | skipping: [node1] 2026-08-18 15:24:57.942453 | node1 | skipping: [node2] 2026-08-18 15:24:57.942525 | node1 | skipping: [node3] 2026-08-18 15:24:57.942629 | node1 | 2026-08-18 15:24:57.942747 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 15:24:57.942862 | node1 | Tuesday 18 August 2026 15:24:57 +0000 (0:00:00.095) 0:04:20.544 ******** 2026-08-18 15:24:57.977076 | node1 | skipping: [node1] 2026-08-18 15:24:57.977142 | node1 | 2026-08-18 15:24:57.977538 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 15:24:57.977587 | node1 | Tuesday 18 August 2026 15:24:57 +0000 (0:00:00.033) 0:04:20.578 ******** 2026-08-18 15:24:59.668367 | node1 | ok: [node2] 2026-08-18 15:24:59.668442 | node1 | ok: [node1] 2026-08-18 15:24:59.668885 | node1 | ok: [node3] 2026-08-18 15:24:59.668921 | node1 | 2026-08-18 15:24:59.668944 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 15:24:59.668953 | node1 | Tuesday 18 August 2026 15:24:59 +0000 (0:00:01.691) 0:04:22.270 ******** 2026-08-18 15:31:25.953496 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd0/data) 2026-08-18 15:31:25.953595 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd0/data) 2026-08-18 15:31:25.953732 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd0/data) 2026-08-18 15:31:25.953847 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd1/data) 2026-08-18 15:31:25.953992 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd1/data) 2026-08-18 15:31:25.954115 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd1/data) 2026-08-18 15:31:25.954841 | node1 | changed: [node1] => (item=/dev/ceph-node1-osd2/data) 2026-08-18 15:31:25.954869 | node1 | changed: [node2 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node2-osd2/data) 2026-08-18 15:31:25.954875 | node1 | changed: [node3 -> node1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-node3-osd2/data) 2026-08-18 15:31:25.954879 | node1 | 2026-08-18 15:31:25.954883 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 15:31:25.954887 | node1 | Tuesday 18 August 2026 15:31:25 +0000 (0:06:26.285) 0:10:48.555 ******** 2026-08-18 15:31:41.300450 | node1 | ok: [node1] 2026-08-18 15:31:41.300541 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:31:41.300616 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left). 2026-08-18 15:31:41.300738 | node1 | FAILED - RETRYING: [node3 -> node1]: Wait for explicitly requested OSD daemons to be running on this host (119 retries left). 2026-08-18 15:31:41.300854 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:31:41.300978 | node1 | 2026-08-18 15:31:41.301235 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 15:31:41.301271 | node1 | Tuesday 18 August 2026 15:31:41 +0000 (0:00:15.347) 0:11:03.902 ******** 2026-08-18 15:31:41.442039 | node1 | skipping: [node1] 2026-08-18 15:31:41.442107 | node1 | 2026-08-18 15:31:41.442124 | node1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 15:31:41.442138 | node1 | 2026-08-18 15:31:41.442151 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:31:41.442164 | node1 | Tuesday 18 August 2026 15:31:41 +0000 (0:00:00.140) 0:11:04.043 ******** 2026-08-18 15:31:43.435061 | node1 | ok: [node2] 2026-08-18 15:31:43.435125 | node1 | ok: [node3] 2026-08-18 15:31:43.435138 | node1 | ok: [node1] 2026-08-18 15:31:43.435151 | node1 | 2026-08-18 15:31:43.435163 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 15:31:43.435175 | node1 | Tuesday 18 August 2026 15:31:43 +0000 (0:00:01.992) 0:11:06.035 ******** 2026-08-18 15:31:44.191036 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:31:44.191092 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:31:44.191105 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:31:44.191118 | node1 | 2026-08-18 15:31:44.191130 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 15:31:44.191142 | node1 | Tuesday 18 August 2026 15:31:44 +0000 (0:00:00.755) 0:11:06.791 ******** 2026-08-18 15:31:44.279888 | node1 | ok: [node1] 2026-08-18 15:31:44.279982 | node1 | ok: [node2] 2026-08-18 15:31:44.279999 | node1 | ok: [node3] 2026-08-18 15:31:44.280011 | node1 | 2026-08-18 15:31:44.280024 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 15:31:44.280035 | node1 | Tuesday 18 August 2026 15:31:44 +0000 (0:00:00.090) 0:11:06.881 ******** 2026-08-18 15:31:44.344789 | node1 | ok: [node1] 2026-08-18 15:31:44.344825 | node1 | ok: [node2] 2026-08-18 15:31:44.344839 | node1 | ok: [node3] 2026-08-18 15:31:44.344854 | node1 | 2026-08-18 15:31:44.344868 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:31:44.344880 | node1 | Tuesday 18 August 2026 15:31:44 +0000 (0:00:00.065) 0:11:06.946 ******** 2026-08-18 15:31:44.415798 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3 2026-08-18 15:31:44.415831 | node1 | 2026-08-18 15:31:44.415844 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:31:44.415856 | node1 | Tuesday 18 August 2026 15:31:44 +0000 (0:00:00.071) 0:11:07.017 ******** 2026-08-18 15:32:06.619261 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 15:32:06.619320 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 15:32:06.619351 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 15:32:06.619360 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 15:32:06.619369 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 15:32:06.619377 | node1 | changed: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 15:32:06.619386 | node1 | 2026-08-18 15:32:06.619395 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:32:06.619404 | node1 | Tuesday 18 August 2026 15:32:06 +0000 (0:00:22.201) 0:11:29.219 ******** 2026-08-18 15:32:06.698126 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3 2026-08-18 15:32:06.698192 | node1 | 2026-08-18 15:32:06.698208 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:32:06.698240 | node1 | Tuesday 18 August 2026 15:32:06 +0000 (0:00:00.080) 0:11:29.300 ******** 2026-08-18 15:32:10.627847 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 15:32:10.627903 | node1 | 2026-08-18 15:32:10.627917 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:32:10.627937 | node1 | Tuesday 18 August 2026 15:32:10 +0000 (0:00:03.928) 0:11:33.229 ******** 2026-08-18 15:32:10.703282 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3 2026-08-18 15:32:10.703341 | node1 | 2026-08-18 15:32:10.703463 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:32:10.703574 | node1 | Tuesday 18 August 2026 15:32:10 +0000 (0:00:00.074) 0:11:33.303 ******** 2026-08-18 15:32:21.980400 | node1 | changed: [node1] => (item=rep_hdd) 2026-08-18 15:32:21.980627 | node1 | changed: [node1] => (item=rep_lab) 2026-08-18 15:32:21.980883 | node1 | changed: [node1] => (item=ec_hdd_s3) 2026-08-18 15:32:21.981165 | node1 | 2026-08-18 15:32:21.981414 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:32:21.981660 | node1 | Tuesday 18 August 2026 15:32:21 +0000 (0:00:11.279) 0:11:44.582 ******** 2026-08-18 15:32:22.054062 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3 2026-08-18 15:32:22.054245 | node1 | 2026-08-18 15:32:22.054497 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:32:22.054742 | node1 | Tuesday 18 August 2026 15:32:22 +0000 (0:00:00.074) 0:11:44.656 ******** 2026-08-18 15:33:01.137761 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.data) 2026-08-18 15:33:01.138015 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.index) 2026-08-18 15:33:01.138338 | node1 | changed: [node1] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 15:33:01.138654 | node1 | changed: [node1] => (item=molecule-1.rgw.control) 2026-08-18 15:33:01.139114 | node1 | changed: [node1] => (item=molecule-1.rgw.log) 2026-08-18 15:33:01.139612 | node1 | changed: [node1] => (item=molecule-1.rgw.meta) 2026-08-18 15:33:01.139998 | node1 | 2026-08-18 15:33:01.140420 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 15:33:01.140710 | node1 | Tuesday 18 August 2026 15:33:01 +0000 (0:00:39.080) 0:12:23.737 ******** 2026-08-18 15:33:01.191708 | node1 | skipping: [node1] 2026-08-18 15:33:01.191995 | node1 | skipping: [node2] 2026-08-18 15:33:01.192252 | node1 | skipping: [node3] 2026-08-18 15:33:01.192478 | node1 | 2026-08-18 15:33:01.192723 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 15:33:01.192999 | node1 | Tuesday 18 August 2026 15:33:01 +0000 (0:00:00.056) 0:12:23.793 ******** 2026-08-18 15:33:01.280917 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3 2026-08-18 15:33:01.281141 | node1 | 2026-08-18 15:33:01.281413 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 15:33:01.281659 | node1 | Tuesday 18 August 2026 15:33:01 +0000 (0:00:00.089) 0:12:23.883 ******** 2026-08-18 15:33:03.399447 | node1 | ok: [node1] 2026-08-18 15:33:03.399699 | node1 | 2026-08-18 15:33:03.400024 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 15:33:03.400276 | node1 | Tuesday 18 August 2026 15:33:03 +0000 (0:00:02.118) 0:12:26.001 ******** 2026-08-18 15:33:05.363523 | node1 | ok: [node1] 2026-08-18 15:33:05.363694 | node1 | 2026-08-18 15:33:05.364081 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 15:33:05.364389 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:01.963) 0:12:27.965 ******** 2026-08-18 15:33:05.410834 | node1 | skipping: [node1] 2026-08-18 15:33:05.411053 | node1 | 2026-08-18 15:33:05.411319 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 15:33:05.411553 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.047) 0:12:28.012 ******** 2026-08-18 15:33:05.452847 | node1 | skipping: [node1] 2026-08-18 15:33:05.453149 | node1 | 2026-08-18 15:33:05.453406 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:33:05.453654 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.042) 0:12:28.055 ******** 2026-08-18 15:33:05.496917 | node1 | skipping: [node1] 2026-08-18 15:33:05.497193 | node1 | 2026-08-18 15:33:05.497477 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 15:33:05.497701 | node1 | Tuesday 18 August 2026 15:33:05 +0000 (0:00:00.044) 0:12:28.099 ******** 2026-08-18 15:33:07.556038 | node1 | changed: [node1] 2026-08-18 15:33:07.556878 | node1 | 2026-08-18 15:33:07.556902 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:33:07.556915 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:02.059) 0:12:30.158 ******** 2026-08-18 15:33:07.615114 | node1 | ok: [node1] 2026-08-18 15:33:07.615152 | node1 | 2026-08-18 15:33:07.615166 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 15:33:07.615178 | node1 | Tuesday 18 August 2026 15:33:07 +0000 (0:00:00.058) 0:12:30.217 ******** 2026-08-18 15:33:14.740743 | node1 | changed: [node1] => (item=ceph mgr module disable dashboard) 2026-08-18 15:33:14.740815 | node1 | changed: [node1] => (item=ceph mgr module enable dashboard) 2026-08-18 15:33:14.741052 | node1 | changed: [node1] => (item=ceph orch reconfig mgr) 2026-08-18 15:33:14.741286 | node1 | 2026-08-18 15:33:14.741490 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:33:14.741811 | node1 | Tuesday 18 August 2026 15:33:14 +0000 (0:00:07.126) 0:12:37.343 ******** 2026-08-18 15:33:14.823782 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3 2026-08-18 15:33:14.824063 | node1 | 2026-08-18 15:33:14.824324 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:33:14.824577 | node1 | Tuesday 18 August 2026 15:33:14 +0000 (0:00:00.083) 0:12:37.426 ******** 2026-08-18 15:33:25.904097 | node1 | changed: [node1] => (item=None) 2026-08-18 15:33:25.904140 | node1 | changed: [node1] => (item=None) 2026-08-18 15:33:25.904149 | node1 | changed: [node1 -> {{ ceph_configure_admin_host }}] 2026-08-18 15:33:25.904156 | node1 | 2026-08-18 15:33:25.904164 | node1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 15:33:25.904172 | node1 | 2026-08-18 15:33:25.904179 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:33:25.904186 | node1 | Tuesday 18 August 2026 15:33:25 +0000 (0:00:11.078) 0:12:48.504 ******** 2026-08-18 15:33:27.118707 | node1 | ok: [node1] 2026-08-18 15:33:27.118770 | node1 | ok: [node3] 2026-08-18 15:33:27.118779 | node1 | ok: [node2] 2026-08-18 15:33:27.118787 | node1 | 2026-08-18 15:33:27.118796 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:27.118805 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:01.215) 0:12:49.720 ******** 2026-08-18 15:33:27.430092 | node1 | ok: [node1] 2026-08-18 15:33:27.430269 | node1 | ok: [node2] 2026-08-18 15:33:27.430518 | node1 | ok: [node3] 2026-08-18 15:33:27.430751 | node1 | 2026-08-18 15:33:27.431219 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:27.431549 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:00.311) 0:12:50.032 ******** 2026-08-18 15:33:27.522721 | node1 | skipping: [node1] 2026-08-18 15:33:27.522805 | node1 | skipping: [node2] 2026-08-18 15:33:27.523019 | node1 | skipping: [node3] 2026-08-18 15:33:27.523354 | node1 | 2026-08-18 15:33:27.523613 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:33:27.523777 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:00.092) 0:12:50.125 ******** 2026-08-18 15:33:27.819705 | node1 | ok: [node1] 2026-08-18 15:33:27.819892 | node1 | ok: [node3] 2026-08-18 15:33:27.820201 | node1 | ok: [node2] 2026-08-18 15:33:27.820435 | node1 | 2026-08-18 15:33:27.820723 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:27.820991 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:00.297) 0:12:50.422 ******** 2026-08-18 15:33:27.922288 | node1 | ok: [node1] => { 2026-08-18 15:33:27.922534 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:27.922782 | node1 | } 2026-08-18 15:33:27.923060 | node1 | ok: [node2] => { 2026-08-18 15:33:27.923329 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:27.923565 | node1 | } 2026-08-18 15:33:27.923808 | node1 | ok: [node3] => { 2026-08-18 15:33:27.924154 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:33:27.924339 | node1 | } 2026-08-18 15:33:27.924804 | node1 | 2026-08-18 15:33:27.925112 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:27.925365 | node1 | Tuesday 18 August 2026 15:33:27 +0000 (0:00:00.102) 0:12:50.524 ******** 2026-08-18 15:33:28.343902 | node1 | ok: [node1] 2026-08-18 15:33:28.344153 | node1 | ok: [node2] 2026-08-18 15:33:28.344402 | node1 | ok: [node3] 2026-08-18 15:33:28.344633 | node1 | 2026-08-18 15:33:28.344894 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:28.345202 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.421) 0:12:50.946 ******** 2026-08-18 15:33:28.521329 | node1 | skipping: [node1] 2026-08-18 15:33:28.521521 | node1 | skipping: [node2] 2026-08-18 15:33:28.521764 | node1 | skipping: [node3] 2026-08-18 15:33:28.522037 | node1 | 2026-08-18 15:33:28.522285 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:28.522598 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.177) 0:12:51.123 ******** 2026-08-18 15:33:28.631021 | node1 | skipping: [node1] 2026-08-18 15:33:28.631270 | node1 | skipping: [node2] 2026-08-18 15:33:28.631546 | node1 | skipping: [node3] 2026-08-18 15:33:28.631787 | node1 | 2026-08-18 15:33:28.632118 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:28.632364 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.109) 0:12:51.233 ******** 2026-08-18 15:33:28.935585 | node1 | ok: [node1] 2026-08-18 15:33:28.935661 | node1 | ok: [node2] 2026-08-18 15:33:28.935759 | node1 | ok: [node3] 2026-08-18 15:33:28.935973 | node1 | 2026-08-18 15:33:28.936055 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:33:28.936170 | node1 | Tuesday 18 August 2026 15:33:28 +0000 (0:00:00.304) 0:12:51.538 ******** 2026-08-18 15:33:29.887244 | node1 | ok: [node1] 2026-08-18 15:33:29.887462 | node1 | ok: [node2] 2026-08-18 15:33:29.887717 | node1 | ok: [node3] 2026-08-18 15:33:29.888061 | node1 | 2026-08-18 15:33:29.888447 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:29.888813 | node1 | Tuesday 18 August 2026 15:33:29 +0000 (0:00:00.951) 0:12:52.489 ******** 2026-08-18 15:33:29.992652 | node1 | ok: [node1] => { 2026-08-18 15:33:29.992890 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:29.993179 | node1 | } 2026-08-18 15:33:29.993438 | node1 | ok: [node2] => { 2026-08-18 15:33:29.993746 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:29.994022 | node1 | } 2026-08-18 15:33:29.994270 | node1 | ok: [node3] => { 2026-08-18 15:33:29.994557 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:33:29.994777 | node1 | } 2026-08-18 15:33:29.995073 | node1 | 2026-08-18 15:33:29.995323 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:29.995575 | node1 | Tuesday 18 August 2026 15:33:29 +0000 (0:00:00.105) 0:12:52.595 ******** 2026-08-18 15:33:30.439141 | node1 | ok: [node1] 2026-08-18 15:33:30.439363 | node1 | ok: [node2] 2026-08-18 15:33:30.439605 | node1 | ok: [node3] 2026-08-18 15:33:30.439831 | node1 | 2026-08-18 15:33:30.440172 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:30.440417 | node1 | Tuesday 18 August 2026 15:33:30 +0000 (0:00:00.446) 0:12:53.041 ******** 2026-08-18 15:33:32.628766 | node1 | ok: [node1] 2026-08-18 15:33:32.629032 | node1 | ok: [node2] 2026-08-18 15:33:32.629332 | node1 | ok: [node3] 2026-08-18 15:33:32.629579 | node1 | 2026-08-18 15:33:32.629863 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:33:32.630179 | node1 | Tuesday 18 August 2026 15:33:32 +0000 (0:00:02.189) 0:12:55.230 ******** 2026-08-18 15:33:32.693508 | node1 | skipping: [node1] 2026-08-18 15:33:32.693736 | node1 | skipping: [node2] 2026-08-18 15:33:32.694021 | node1 | skipping: [node3] 2026-08-18 15:33:32.694256 | node1 | 2026-08-18 15:33:32.694505 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:33:32.694771 | node1 | Tuesday 18 August 2026 15:33:32 +0000 (0:00:00.065) 0:12:55.296 ******** 2026-08-18 15:33:32.764375 | node1 | skipping: [node1] 2026-08-18 15:33:32.764469 | node1 | skipping: [node2] 2026-08-18 15:33:32.764605 | node1 | skipping: [node3] 2026-08-18 15:33:32.764740 | node1 | 2026-08-18 15:33:32.764964 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:33:32.765086 | node1 | Tuesday 18 August 2026 15:33:32 +0000 (0:00:00.070) 0:12:55.366 ******** 2026-08-18 15:33:32.828294 | node1 | skipping: [node1] 2026-08-18 15:33:32.828510 | node1 | skipping: [node2] 2026-08-18 15:33:32.828765 | node1 | skipping: [node3] 2026-08-18 15:33:32.829039 | node1 | 2026-08-18 15:33:32.829311 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:33:32.829657 | node1 | Tuesday 18 August 2026 15:33:32 +0000 (0:00:00.064) 0:12:55.431 ******** 2026-08-18 15:33:33.782385 | node1 | ok: [node1] 2026-08-18 15:33:33.782460 | node1 | ok: [node3] 2026-08-18 15:33:33.782557 | node1 | ok: [node2] 2026-08-18 15:33:33.782659 | node1 | 2026-08-18 15:33:33.782791 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:33:33.782902 | node1 | Tuesday 18 August 2026 15:33:33 +0000 (0:00:00.953) 0:12:56.384 ******** 2026-08-18 15:33:34.355599 | node1 | ok: [node1] 2026-08-18 15:33:34.355820 | node1 | ok: [node3] 2026-08-18 15:33:34.356126 | node1 | ok: [node2] 2026-08-18 15:33:34.356352 | node1 | 2026-08-18 15:33:34.356663 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:33:34.356918 | node1 | Tuesday 18 August 2026 15:33:34 +0000 (0:00:00.573) 0:12:56.958 ******** 2026-08-18 15:33:35.499039 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:35.499220 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:35.499476 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:33:35.499814 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:35.500031 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:35.500276 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:33:35.500524 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:35.500770 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:35.501057 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:33:35.501313 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:35.501607 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:35.501861 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:33:35.502140 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:35.502434 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:35.502723 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:33:35.502959 | node1 | 2026-08-18 15:33:35.503228 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:33:35.503492 | node1 | Tuesday 18 August 2026 15:33:35 +0000 (0:00:01.143) 0:12:58.101 ******** 2026-08-18 15:33:36.242800 | node1 | ok: [node1] 2026-08-18 15:33:36.243061 | node1 | ok: [node2] 2026-08-18 15:33:36.243293 | node1 | ok: [node3] 2026-08-18 15:33:36.243546 | node1 | 2026-08-18 15:33:36.243832 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:36.244127 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.704) 0:12:58.805 ******** 2026-08-18 15:33:36.244342 | node1 | 2026-08-18 15:33:36.244591 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:36.244838 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.014) 0:12:58.820 ******** 2026-08-18 15:33:36.245111 | node1 | 2026-08-18 15:33:36.245349 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:33:36.245611 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.012) 0:12:58.832 ******** 2026-08-18 15:33:36.245833 | node1 | 2026-08-18 15:33:36.246124 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:33:36.246375 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.012) 0:12:58.845 ******** 2026-08-18 15:33:36.734023 | node1 | ok: [node1] 2026-08-18 15:33:36.735008 | node1 | ok: [node2] 2026-08-18 15:33:36.735959 | node1 | ok: [node3] 2026-08-18 15:33:36.736257 | node1 | 2026-08-18 15:33:36.736567 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:33:36.736829 | node1 | Tuesday 18 August 2026 15:33:36 +0000 (0:00:00.491) 0:12:59.336 ******** 2026-08-18 15:33:37.026971 | node1 | ok: [node1] 2026-08-18 15:33:37.027018 | node1 | ok: [node2] 2026-08-18 15:33:37.027024 | node1 | ok: [node3] 2026-08-18 15:33:37.027030 | node1 | 2026-08-18 15:33:37.027036 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:37.027042 | node1 | Tuesday 18 August 2026 15:33:37 +0000 (0:00:00.291) 0:12:59.627 ******** 2026-08-18 15:33:37.124434 | node1 | ok: [node1] => { 2026-08-18 15:33:37.124705 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:37.125050 | node1 | } 2026-08-18 15:33:37.125310 | node1 | ok: [node2] => { 2026-08-18 15:33:37.125608 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:37.125852 | node1 | } 2026-08-18 15:33:37.126140 | node1 | ok: [node3] => { 2026-08-18 15:33:37.126412 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:33:37.126659 | node1 | } 2026-08-18 15:33:37.126889 | node1 | 2026-08-18 15:33:37.127217 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:37.127477 | node1 | Tuesday 18 August 2026 15:33:37 +0000 (0:00:00.099) 0:12:59.727 ******** 2026-08-18 15:33:37.568161 | node1 | ok: [node1] 2026-08-18 15:33:37.568382 | node1 | ok: [node2] 2026-08-18 15:33:37.568533 | node1 | ok: [node3] 2026-08-18 15:33:37.568678 | node1 | 2026-08-18 15:33:37.568841 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:37.569021 | node1 | Tuesday 18 August 2026 15:33:37 +0000 (0:00:00.443) 0:13:00.171 ******** 2026-08-18 15:33:40.907581 | node1 | ok: [node2] 2026-08-18 15:33:40.907771 | node1 | ok: [node3] 2026-08-18 15:33:40.908082 | node1 | ok: [node1] 2026-08-18 15:33:40.908369 | node1 | 2026-08-18 15:33:40.908609 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:33:40.908864 | node1 | Tuesday 18 August 2026 15:33:40 +0000 (0:00:03.339) 0:13:03.510 ******** 2026-08-18 15:33:41.875697 | node1 | ok: [node1] 2026-08-18 15:33:41.875894 | node1 | ok: [node3] 2026-08-18 15:33:41.876166 | node1 | ok: [node2] 2026-08-18 15:33:41.876392 | node1 | 2026-08-18 15:33:41.876685 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:33:41.876960 | node1 | Tuesday 18 August 2026 15:33:41 +0000 (0:00:00.967) 0:13:04.478 ******** 2026-08-18 15:33:42.164616 | node1 | ok: [node1] 2026-08-18 15:33:42.164851 | node1 | ok: [node2] 2026-08-18 15:33:42.165174 | node1 | ok: [node3] 2026-08-18 15:33:42.165503 | node1 | 2026-08-18 15:33:42.165848 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:33:42.166281 | node1 | Tuesday 18 August 2026 15:33:42 +0000 (0:00:00.288) 0:13:04.766 ******** 2026-08-18 15:33:42.740864 | node1 | ok: [node1] 2026-08-18 15:33:42.741135 | node1 | ok: [node2] 2026-08-18 15:33:42.741378 | node1 | ok: [node3] 2026-08-18 15:33:42.741648 | node1 | 2026-08-18 15:33:42.741904 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:33:42.742194 | node1 | Tuesday 18 August 2026 15:33:42 +0000 (0:00:00.576) 0:13:05.343 ******** 2026-08-18 15:33:43.462112 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:43.462190 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:43.462204 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:33:43.462216 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:43.462228 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:43.462239 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:33:43.462320 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:43.462565 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:43.462810 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:33:43.463083 | node1 | 2026-08-18 15:33:43.463338 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:33:43.463628 | node1 | Tuesday 18 August 2026 15:33:43 +0000 (0:00:00.720) 0:13:06.063 ******** 2026-08-18 15:33:44.043096 | node1 | ok: [node2] 2026-08-18 15:33:44.043142 | node1 | ok: [node1] 2026-08-18 15:33:44.043148 | node1 | ok: [node3] 2026-08-18 15:33:44.043153 | node1 | 2026-08-18 15:33:44.043249 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:33:44.043501 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.580) 0:13:06.644 ******** 2026-08-18 15:33:44.670365 | node1 | ok: [node2] 2026-08-18 15:33:44.670430 | node1 | ok: [node1] 2026-08-18 15:33:44.670511 | node1 | ok: [node3] 2026-08-18 15:33:44.670612 | node1 | 2026-08-18 15:33:44.670725 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:44.670838 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.586) 0:13:07.230 ******** 2026-08-18 15:33:44.670952 | node1 | 2026-08-18 15:33:44.671073 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:44.671177 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.014) 0:13:07.245 ******** 2026-08-18 15:33:44.671281 | node1 | 2026-08-18 15:33:44.671392 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:33:44.671511 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.013) 0:13:07.258 ******** 2026-08-18 15:33:44.671611 | node1 | 2026-08-18 15:33:44.671723 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:33:44.674973 | node1 | Tuesday 18 August 2026 15:33:44 +0000 (0:00:00.013) 0:13:07.271 ******** 2026-08-18 15:33:46.160156 | node1 | ok: [node1] 2026-08-18 15:33:46.160462 | node1 | ok: [node3] 2026-08-18 15:33:46.160868 | node1 | ok: [node2] 2026-08-18 15:33:46.161179 | node1 | 2026-08-18 15:33:46.161438 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:33:46.161689 | node1 | Tuesday 18 August 2026 15:33:46 +0000 (0:00:01.490) 0:13:08.762 ******** 2026-08-18 15:33:46.229055 | node1 | ok: [node1] => { 2026-08-18 15:33:46.229322 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:46.229558 | node1 | } 2026-08-18 15:33:46.229803 | node1 | ok: [node2] => { 2026-08-18 15:33:46.230125 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:46.230357 | node1 | } 2026-08-18 15:33:46.230601 | node1 | ok: [node3] => { 2026-08-18 15:33:46.230879 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:33:46.231160 | node1 | } 2026-08-18 15:33:46.231390 | node1 | 2026-08-18 15:33:46.231642 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:33:46.231964 | node1 | Tuesday 18 August 2026 15:33:46 +0000 (0:00:00.069) 0:13:08.831 ******** 2026-08-18 15:33:46.601676 | node1 | ok: [node1] 2026-08-18 15:33:46.601883 | node1 | ok: [node2] 2026-08-18 15:33:46.602166 | node1 | ok: [node3] 2026-08-18 15:33:46.602391 | node1 | 2026-08-18 15:33:46.602647 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:33:46.602901 | node1 | Tuesday 18 August 2026 15:33:46 +0000 (0:00:00.372) 0:13:09.204 ******** 2026-08-18 15:33:46.673108 | node1 | skipping: [node1] 2026-08-18 15:33:46.728261 | node1 | skipping: [node2] 2026-08-18 15:33:46.728506 | node1 | skipping: [node3] 2026-08-18 15:33:46.728761 | node1 | 2026-08-18 15:33:46.729075 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:33:46.729363 | node1 | Tuesday 18 August 2026 15:33:46 +0000 (0:00:00.126) 0:13:09.331 ******** 2026-08-18 15:33:46.816102 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:33:46.816434 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:33:46.816738 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:33:46.817055 | node1 | 2026-08-18 15:33:46.817354 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:33:46.817641 | node1 | Tuesday 18 August 2026 15:33:46 +0000 (0:00:00.087) 0:13:09.418 ******** 2026-08-18 15:33:47.765717 | node1 | ok: [node3] 2026-08-18 15:33:47.765891 | node1 | ok: [node1] 2026-08-18 15:33:47.766172 | node1 | ok: [node2] 2026-08-18 15:33:47.766392 | node1 | 2026-08-18 15:33:47.766642 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:33:47.766910 | node1 | Tuesday 18 August 2026 15:33:47 +0000 (0:00:00.949) 0:13:10.368 ******** 2026-08-18 15:33:48.617670 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:33:48.617894 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:33:48.618183 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:33:48.618424 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:33:48.618675 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:33:48.618902 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:33:48.619154 | node1 | 2026-08-18 15:33:48.619408 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:33:48.619671 | node1 | Tuesday 18 August 2026 15:33:48 +0000 (0:00:00.851) 0:13:11.220 ******** 2026-08-18 15:33:48.892562 | node1 | ok: [node1] 2026-08-18 15:33:48.892796 | node1 | ok: [node2] 2026-08-18 15:33:48.893089 | node1 | ok: [node3] 2026-08-18 15:33:48.893354 | node1 | 2026-08-18 15:33:48.893634 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:33:48.893908 | node1 | Tuesday 18 August 2026 15:33:48 +0000 (0:00:00.274) 0:13:11.494 ******** 2026-08-18 15:33:49.240385 | node1 | ok: [node1] 2026-08-18 15:33:49.240454 | node1 | ok: [node2] 2026-08-18 15:33:49.240570 | node1 | ok: [node3] 2026-08-18 15:33:49.240671 | node1 | 2026-08-18 15:33:49.240791 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:33:49.240905 | node1 | Tuesday 18 August 2026 15:33:49 +0000 (0:00:00.346) 0:13:11.841 ******** 2026-08-18 15:33:49.817990 | node1 | ok: [node1] 2026-08-18 15:33:49.818056 | node1 | ok: [node2] 2026-08-18 15:33:49.818063 | node1 | ok: [node3] 2026-08-18 15:33:49.818068 | node1 | 2026-08-18 15:33:49.818074 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:33:49.818080 | node1 | Tuesday 18 August 2026 15:33:49 +0000 (0:00:00.577) 0:13:12.419 ******** 2026-08-18 15:33:49.884201 | node1 | skipping: [node1] 2026-08-18 15:33:49.884271 | node1 | skipping: [node2] 2026-08-18 15:33:49.884281 | node1 | skipping: [node3] 2026-08-18 15:33:49.884290 | node1 | 2026-08-18 15:33:49.884300 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:33:49.884308 | node1 | Tuesday 18 August 2026 15:33:49 +0000 (0:00:00.066) 0:13:12.485 ******** 2026-08-18 15:33:50.357087 | node1 | ok: [node2] 2026-08-18 15:33:50.357139 | node1 | ok: [node1] 2026-08-18 15:33:50.357248 | node1 | ok: [node3] 2026-08-18 15:33:50.357471 | node1 | 2026-08-18 15:33:50.357764 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:33:50.358056 | node1 | Tuesday 18 August 2026 15:33:50 +0000 (0:00:00.473) 0:13:12.959 ******** 2026-08-18 15:33:50.951976 | node1 | ok: [node1] 2026-08-18 15:33:50.952011 | node1 | ok: [node3] 2026-08-18 15:33:50.952015 | node1 | ok: [node2] 2026-08-18 15:33:50.952020 | node1 | 2026-08-18 15:33:50.952111 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 15:33:50.952358 | node1 | Tuesday 18 August 2026 15:33:50 +0000 (0:00:00.594) 0:13:13.553 ******** 2026-08-18 15:33:51.729615 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:33:51.729718 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:33:51.729995 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:33:51.730213 | node1 | 2026-08-18 15:33:51.730619 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 15:33:51.730905 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.778) 0:13:14.331 ******** 2026-08-18 15:33:51.813613 | node1 | ok: [node1] 2026-08-18 15:33:51.813838 | node1 | ok: [node2] 2026-08-18 15:33:51.814166 | node1 | ok: [node3] 2026-08-18 15:33:51.814384 | node1 | 2026-08-18 15:33:51.814637 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 15:33:51.814955 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.084) 0:13:14.416 ******** 2026-08-18 15:33:51.894206 | node1 | ok: [node1] 2026-08-18 15:33:51.894379 | node1 | ok: [node2] 2026-08-18 15:33:51.894542 | node1 | ok: [node3] 2026-08-18 15:33:51.894677 | node1 | 2026-08-18 15:33:51.894830 | node1 | TASK [Register this RGW host] ************************************************** 2026-08-18 15:33:51.894985 | node1 | Tuesday 18 August 2026 15:33:51 +0000 (0:00:00.080) 0:13:14.496 ******** 2026-08-18 15:33:52.011975 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:33:52.012154 | node1 | 2026-08-18 15:33:52.012420 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:33:52.012673 | node1 | Tuesday 18 August 2026 15:33:52 +0000 (0:00:00.117) 0:13:14.614 ******** 2026-08-18 15:33:53.731353 | node1 | ok: [node1] 2026-08-18 15:33:53.731543 | node1 | 2026-08-18 15:33:53.731813 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:33:53.732126 | node1 | Tuesday 18 August 2026 15:33:53 +0000 (0:00:01.719) 0:13:16.333 ******** 2026-08-18 15:33:53.807588 | node1 | ok: [node1] 2026-08-18 15:33:53.807790 | node1 | ok: [node2] 2026-08-18 15:33:53.808065 | node1 | ok: [node3] 2026-08-18 15:33:53.808285 | node1 | 2026-08-18 15:33:53.808534 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:33:53.808777 | node1 | Tuesday 18 August 2026 15:33:53 +0000 (0:00:00.076) 0:13:16.410 ******** 2026-08-18 15:33:53.887062 | node1 | ok: [node1] => { 2026-08-18 15:33:53.887276 | node1 | "changed": false, 2026-08-18 15:33:53.887538 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:53.887754 | node1 | } 2026-08-18 15:33:53.888059 | node1 | ok: [node2] => { 2026-08-18 15:33:53.888300 | node1 | "changed": false, 2026-08-18 15:33:53.888526 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:53.888756 | node1 | } 2026-08-18 15:33:53.889020 | node1 | ok: [node3] => { 2026-08-18 15:33:53.889254 | node1 | "changed": false, 2026-08-18 15:33:53.889562 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:53.889799 | node1 | } 2026-08-18 15:33:53.890083 | node1 | 2026-08-18 15:33:53.890338 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:33:53.890582 | node1 | Tuesday 18 August 2026 15:33:53 +0000 (0:00:00.079) 0:13:16.489 ******** 2026-08-18 15:33:54.266812 | node1 | ok: [node1] 2026-08-18 15:33:54.267150 | node1 | ok: [node2] 2026-08-18 15:33:54.267447 | node1 | ok: [node3] 2026-08-18 15:33:54.267716 | node1 | 2026-08-18 15:33:54.268109 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:33:54.268432 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.379) 0:13:16.869 ******** 2026-08-18 15:33:54.343727 | node1 | ok: [node1] 2026-08-18 15:33:54.344100 | node1 | ok: [node2] 2026-08-18 15:33:54.344410 | node1 | ok: [node3] 2026-08-18 15:33:54.344670 | node1 | 2026-08-18 15:33:54.345026 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:33:54.345327 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.077) 0:13:16.946 ******** 2026-08-18 15:33:54.457393 | node1 | ok: [node1] 2026-08-18 15:33:54.457632 | node1 | ok: [node2] 2026-08-18 15:33:54.457873 | node1 | ok: [node3] 2026-08-18 15:33:54.458118 | node1 | 2026-08-18 15:33:54.458380 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:33:54.458638 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.113) 0:13:17.059 ******** 2026-08-18 15:33:54.533914 | node1 | ok: [node1] => { 2026-08-18 15:33:54.534182 | node1 | "changed": false, 2026-08-18 15:33:54.534435 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:54.534672 | node1 | } 2026-08-18 15:33:54.534961 | node1 | ok: [node2] => { 2026-08-18 15:33:54.535229 | node1 | "changed": false, 2026-08-18 15:33:54.535482 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:54.535726 | node1 | } 2026-08-18 15:33:54.536105 | node1 | ok: [node3] => { 2026-08-18 15:33:54.536417 | node1 | "changed": false, 2026-08-18 15:33:54.536608 | node1 | "msg": "All assertions passed" 2026-08-18 15:33:54.536839 | node1 | } 2026-08-18 15:33:54.537137 | node1 | 2026-08-18 15:33:54.537360 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:33:54.537593 | node1 | Tuesday 18 August 2026 15:33:54 +0000 (0:00:00.076) 0:13:17.136 ******** 2026-08-18 15:33:56.281045 | node1 | ok: [node1] 2026-08-18 15:33:56.281315 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:33:56.281615 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:33:56.281908 | node1 | 2026-08-18 15:33:56.282212 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:33:56.282493 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:01.747) 0:13:18.883 ******** 2026-08-18 15:33:56.381548 | node1 | skipping: [node1] 2026-08-18 15:33:56.381761 | node1 | skipping: [node2] 2026-08-18 15:33:56.382055 | node1 | skipping: [node3] 2026-08-18 15:33:56.382370 | node1 | 2026-08-18 15:33:56.382594 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 15:33:56.382841 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.100) 0:13:18.984 ******** 2026-08-18 15:33:56.443320 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1 2026-08-18 15:33:56.443487 | node1 | 2026-08-18 15:33:56.443740 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 15:33:56.444265 | node1 | Tuesday 18 August 2026 15:33:56 +0000 (0:00:00.061) 0:13:19.045 ******** 2026-08-18 15:34:01.072764 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:34:01.073031 | node1 | 2026-08-18 15:34:01.073346 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 15:34:01.073646 | node1 | Tuesday 18 August 2026 15:34:01 +0000 (0:00:04.628) 0:13:23.674 ******** 2026-08-18 15:34:03.556894 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:34:03.557128 | node1 | 2026-08-18 15:34:03.557400 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 15:34:03.557657 | node1 | Tuesday 18 August 2026 15:34:03 +0000 (0:00:02.485) 0:13:26.159 ******** 2026-08-18 15:34:06.121652 | node1 | changed: [node1] => (item=None) 2026-08-18 15:34:06.121892 | node1 | changed: [node1 -> {{ ceph_rgw_admin_host }}] 2026-08-18 15:34:06.122177 | node1 | 2026-08-18 15:34:06.122431 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 15:34:06.122684 | node1 | Tuesday 18 August 2026 15:34:06 +0000 (0:00:02.564) 0:13:28.724 ******** 2026-08-18 15:34:07.848702 | node1 | changed: [node1] 2026-08-18 15:34:07.848907 | node1 | 2026-08-18 15:34:07.849211 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:34:07.849468 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:01.726) 0:13:30.450 ******** 2026-08-18 15:34:07.915185 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1 2026-08-18 15:34:07.915262 | node1 | 2026-08-18 15:34:07.915443 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 15:34:07.915596 | node1 | Tuesday 18 August 2026 15:34:07 +0000 (0:00:00.067) 0:13:30.517 ******** 2026-08-18 15:34:09.607103 | node1 | ok: [node1] 2026-08-18 15:34:09.607221 | node1 | 2026-08-18 15:34:09.607811 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 15:34:09.607844 | node1 | Tuesday 18 August 2026 15:34:09 +0000 (0:00:01.691) 0:13:32.209 ******** 2026-08-18 15:34:09.658492 | node1 | ok: [node1] 2026-08-18 15:34:09.658564 | node1 | 2026-08-18 15:34:09.658726 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:34:09.658916 | node1 | Tuesday 18 August 2026 15:34:09 +0000 (0:00:00.051) 0:13:32.260 ******** 2026-08-18 15:34:12.934202 | node1 | changed: [node1] => (item=molecule) 2026-08-18 15:34:12.934285 | node1 | 2026-08-18 15:34:12.934301 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 15:34:12.934313 | node1 | Tuesday 18 August 2026 15:34:12 +0000 (0:00:03.273) 0:13:35.534 ******** 2026-08-18 15:34:12.989031 | node1 | skipping: [node1] => (item=rgw.molecule) 2026-08-18 15:34:12.989106 | node1 | skipping: [node1] 2026-08-18 15:34:12.989122 | node1 | 2026-08-18 15:34:12.989135 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 15:34:12.989149 | node1 | Tuesday 18 August 2026 15:34:12 +0000 (0:00:00.055) 0:13:35.590 ******** 2026-08-18 15:34:13.053765 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1 2026-08-18 15:34:13.053824 | node1 | 2026-08-18 15:34:13.053838 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] ************************************** 2026-08-18 15:34:13.053851 | node1 | Tuesday 18 August 2026 15:34:13 +0000 (0:00:00.065) 0:13:35.655 ******** 2026-08-18 15:34:14.357574 | node1 | ok: [node1] 2026-08-18 15:34:14.357640 | node1 | 2026-08-18 15:34:14.357654 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************ 2026-08-18 15:34:14.358019 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:01.303) 0:13:36.958 ******** 2026-08-18 15:34:14.408225 | node1 | skipping: [node1] 2026-08-18 15:34:14.408283 | node1 | 2026-08-18 15:34:14.408418 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] ***************************** 2026-08-18 15:34:14.408529 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.052) 0:13:37.011 ******** 2026-08-18 15:34:14.467623 | node1 | skipping: [node1] 2026-08-18 15:34:14.467670 | node1 | 2026-08-18 15:34:14.467684 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] *************** 2026-08-18 15:34:14.467727 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.058) 0:13:37.069 ******** 2026-08-18 15:34:14.528895 | node1 | skipping: [node1] 2026-08-18 15:34:14.528966 | node1 | 2026-08-18 15:34:14.528991 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] ********************************* 2026-08-18 15:34:14.528997 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.059) 0:13:37.129 ******** 2026-08-18 15:34:14.579042 | node1 | skipping: [node1] 2026-08-18 15:34:14.579867 | node1 | 2026-08-18 15:34:14.580250 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************ 2026-08-18 15:34:14.580500 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.051) 0:13:37.180 ******** 2026-08-18 15:34:14.659556 | node1 | skipping: [node1] => (item=default.rgw.control) 2026-08-18 15:34:14.659818 | node1 | skipping: [node1] => (item=default.rgw.log) 2026-08-18 15:34:14.660153 | node1 | skipping: [node1] => (item=default.rgw.meta) 2026-08-18 15:34:14.678303 | node1 | skipping: [node1] 2026-08-18 15:34:14.678463 | node1 | 2026-08-18 15:34:14.678586 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ******** 2026-08-18 15:34:14.678700 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.080) 0:13:37.261 ******** 2026-08-18 15:34:14.714913 | node1 | skipping: [node1] 2026-08-18 15:34:14.715144 | node1 | 2026-08-18 15:34:14.715408 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] ********** 2026-08-18 15:34:14.715700 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.055) 0:13:37.317 ******** 2026-08-18 15:34:14.829423 | node1 | skipping: [node1] 2026-08-18 15:34:14.829533 | node1 | 2026-08-18 15:34:14.829551 | node1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 15:34:14.831023 | node1 | 2026-08-18 15:34:14.831061 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:34:14.831077 | node1 | Tuesday 18 August 2026 15:34:14 +0000 (0:00:00.112) 0:13:37.429 ******** 2026-08-18 15:34:16.924802 | node1 | ok: [node1] 2026-08-18 15:34:16.925102 | node1 | ok: [node3] 2026-08-18 15:34:16.925405 | node1 | ok: [node2] 2026-08-18 15:34:16.925646 | node1 | 2026-08-18 15:34:16.926041 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:16.926322 | node1 | Tuesday 18 August 2026 15:34:16 +0000 (0:00:02.097) 0:13:39.527 ******** 2026-08-18 15:34:17.243558 | node1 | ok: [node1] 2026-08-18 15:34:17.243802 | node1 | ok: [node2] 2026-08-18 15:34:17.244116 | node1 | ok: [node3] 2026-08-18 15:34:17.244348 | node1 | 2026-08-18 15:34:17.244606 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:17.244862 | node1 | Tuesday 18 August 2026 15:34:17 +0000 (0:00:00.318) 0:13:39.846 ******** 2026-08-18 15:34:17.341082 | node1 | skipping: [node1] 2026-08-18 15:34:17.341310 | node1 | skipping: [node2] 2026-08-18 15:34:17.341550 | node1 | skipping: [node3] 2026-08-18 15:34:17.341771 | node1 | 2026-08-18 15:34:17.342060 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:34:17.342366 | node1 | Tuesday 18 August 2026 15:34:17 +0000 (0:00:00.097) 0:13:39.943 ******** 2026-08-18 15:34:17.659080 | node1 | ok: [node1] 2026-08-18 15:34:17.659274 | node1 | ok: [node3] 2026-08-18 15:34:17.659515 | node1 | ok: [node2] 2026-08-18 15:34:17.659742 | node1 | 2026-08-18 15:34:17.660029 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:17.660281 | node1 | Tuesday 18 August 2026 15:34:17 +0000 (0:00:00.317) 0:13:40.261 ******** 2026-08-18 15:34:17.756533 | node1 | ok: [node1] => { 2026-08-18 15:34:17.756717 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:17.756736 | node1 | } 2026-08-18 15:34:17.757461 | node1 | ok: [node2] => { 2026-08-18 15:34:17.757513 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:17.757532 | node1 | } 2026-08-18 15:34:17.757786 | node1 | ok: [node3] => { 2026-08-18 15:34:17.758124 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:17.758349 | node1 | } 2026-08-18 15:34:17.758615 | node1 | 2026-08-18 15:34:17.758881 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:17.759176 | node1 | Tuesday 18 August 2026 15:34:17 +0000 (0:00:00.097) 0:13:40.359 ******** 2026-08-18 15:34:18.175668 | node1 | ok: [node1] 2026-08-18 15:34:18.175893 | node1 | ok: [node2] 2026-08-18 15:34:18.176217 | node1 | ok: [node3] 2026-08-18 15:34:18.176403 | node1 | 2026-08-18 15:34:18.176689 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:18.176989 | node1 | Tuesday 18 August 2026 15:34:18 +0000 (0:00:00.418) 0:13:40.777 ******** 2026-08-18 15:34:18.294819 | node1 | skipping: [node1] 2026-08-18 15:34:18.295022 | node1 | skipping: [node2] 2026-08-18 15:34:18.295234 | node1 | skipping: [node3] 2026-08-18 15:34:18.295373 | node1 | 2026-08-18 15:34:18.295530 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:18.295726 | node1 | Tuesday 18 August 2026 15:34:18 +0000 (0:00:00.119) 0:13:40.897 ******** 2026-08-18 15:34:18.406277 | node1 | skipping: [node1] 2026-08-18 15:34:18.407032 | node1 | skipping: [node2] 2026-08-18 15:34:18.407062 | node1 | skipping: [node3] 2026-08-18 15:34:18.407077 | node1 | 2026-08-18 15:34:18.407371 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:18.407616 | node1 | Tuesday 18 August 2026 15:34:18 +0000 (0:00:00.111) 0:13:41.008 ******** 2026-08-18 15:34:18.712502 | node1 | ok: [node1] 2026-08-18 15:34:18.712709 | node1 | ok: [node2] 2026-08-18 15:34:18.712979 | node1 | ok: [node3] 2026-08-18 15:34:18.713220 | node1 | 2026-08-18 15:34:18.713466 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:18.713711 | node1 | Tuesday 18 August 2026 15:34:18 +0000 (0:00:00.306) 0:13:41.314 ******** 2026-08-18 15:34:19.922026 | node1 | ok: [node3] 2026-08-18 15:34:19.922126 | node1 | ok: [node1] 2026-08-18 15:34:19.922325 | node1 | ok: [node2] 2026-08-18 15:34:19.922879 | node1 | 2026-08-18 15:34:19.922914 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:19.923018 | node1 | Tuesday 18 August 2026 15:34:19 +0000 (0:00:01.209) 0:13:42.524 ******** 2026-08-18 15:34:20.043911 | node1 | ok: [node1] => { 2026-08-18 15:34:20.044554 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:20.044567 | node1 | } 2026-08-18 15:34:20.044573 | node1 | ok: [node2] => { 2026-08-18 15:34:20.044579 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:20.044677 | node1 | } 2026-08-18 15:34:20.044826 | node1 | ok: [node3] => { 2026-08-18 15:34:20.045009 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:20.045163 | node1 | } 2026-08-18 15:34:20.045295 | node1 | 2026-08-18 15:34:20.045452 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:20.045607 | node1 | Tuesday 18 August 2026 15:34:20 +0000 (0:00:00.122) 0:13:42.646 ******** 2026-08-18 15:34:20.508073 | node1 | ok: [node1] 2026-08-18 15:34:20.508535 | node1 | ok: [node2] 2026-08-18 15:34:20.508543 | node1 | ok: [node3] 2026-08-18 15:34:20.508549 | node1 | 2026-08-18 15:34:20.508555 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:20.508563 | node1 | Tuesday 18 August 2026 15:34:20 +0000 (0:00:00.464) 0:13:43.110 ******** 2026-08-18 15:34:22.764846 | node1 | ok: [node1] 2026-08-18 15:34:22.765512 | node1 | ok: [node2] 2026-08-18 15:34:22.765915 | node1 | ok: [node3] 2026-08-18 15:34:22.767066 | node1 | 2026-08-18 15:34:22.767098 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:34:22.767328 | node1 | Tuesday 18 August 2026 15:34:22 +0000 (0:00:02.256) 0:13:45.367 ******** 2026-08-18 15:34:22.808181 | node1 | skipping: [node1] 2026-08-18 15:34:22.838588 | node1 | skipping: [node2] 2026-08-18 15:34:22.839100 | node1 | skipping: [node3] 2026-08-18 15:34:22.839356 | node1 | 2026-08-18 15:34:22.839619 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:34:22.839867 | node1 | Tuesday 18 August 2026 15:34:22 +0000 (0:00:00.074) 0:13:45.441 ******** 2026-08-18 15:34:22.873721 | node1 | skipping: [node1] 2026-08-18 15:34:22.910366 | node1 | skipping: [node2] 2026-08-18 15:34:22.910613 | node1 | skipping: [node3] 2026-08-18 15:34:22.910847 | node1 | 2026-08-18 15:34:22.911335 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:34:22.911608 | node1 | Tuesday 18 August 2026 15:34:22 +0000 (0:00:00.071) 0:13:45.513 ******** 2026-08-18 15:34:22.976542 | node1 | skipping: [node1] 2026-08-18 15:34:22.977086 | node1 | skipping: [node2] 2026-08-18 15:34:22.977345 | node1 | skipping: [node3] 2026-08-18 15:34:22.977592 | node1 | 2026-08-18 15:34:22.977876 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:34:22.978210 | node1 | Tuesday 18 August 2026 15:34:22 +0000 (0:00:00.066) 0:13:45.579 ******** 2026-08-18 15:34:24.035294 | node1 | ok: [node3] 2026-08-18 15:34:24.035366 | node1 | ok: [node1] 2026-08-18 15:34:24.035454 | node1 | ok: [node2] 2026-08-18 15:34:24.035570 | node1 | 2026-08-18 15:34:24.035754 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:34:24.035800 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:01.058) 0:13:46.637 ******** 2026-08-18 15:34:24.704089 | node1 | ok: [node1] 2026-08-18 15:34:24.704315 | node1 | ok: [node2] 2026-08-18 15:34:24.704565 | node1 | ok: [node3] 2026-08-18 15:34:24.704799 | node1 | 2026-08-18 15:34:24.705164 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:34:24.705520 | node1 | Tuesday 18 August 2026 15:34:24 +0000 (0:00:00.668) 0:13:47.306 ******** 2026-08-18 15:34:25.906150 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:25.906366 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:25.906621 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:25.906883 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:25.907178 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:25.907423 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:25.907672 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:25.907962 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:25.908217 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:25.908482 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:25.908745 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:25.909046 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:25.909311 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:25.909571 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:25.909834 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:25.910135 | node1 | 2026-08-18 15:34:25.910391 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:34:25.910642 | node1 | Tuesday 18 August 2026 15:34:25 +0000 (0:00:01.202) 0:13:48.508 ******** 2026-08-18 15:34:26.639338 | node1 | ok: [node1] 2026-08-18 15:34:26.639470 | node1 | ok: [node2] 2026-08-18 15:34:26.639651 | node1 | ok: [node3] 2026-08-18 15:34:26.639858 | node1 | 2026-08-18 15:34:26.640042 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:26.640210 | node1 | Tuesday 18 August 2026 15:34:26 +0000 (0:00:00.712) 0:13:49.221 ******** 2026-08-18 15:34:26.640352 | node1 | 2026-08-18 15:34:26.640598 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:26.640770 | node1 | Tuesday 18 August 2026 15:34:26 +0000 (0:00:00.006) 0:13:49.228 ******** 2026-08-18 15:34:26.640956 | node1 | 2026-08-18 15:34:26.641131 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:26.641305 | node1 | Tuesday 18 August 2026 15:34:26 +0000 (0:00:00.007) 0:13:49.235 ******** 2026-08-18 15:34:26.641463 | node1 | 2026-08-18 15:34:26.641634 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:34:26.641791 | node1 | Tuesday 18 August 2026 15:34:26 +0000 (0:00:00.006) 0:13:49.242 ******** 2026-08-18 15:34:27.164894 | node1 | ok: [node1] 2026-08-18 15:34:27.165206 | node1 | ok: [node2] 2026-08-18 15:34:27.165246 | node1 | ok: [node3] 2026-08-18 15:34:27.165552 | node1 | 2026-08-18 15:34:27.165841 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:27.166158 | node1 | Tuesday 18 August 2026 15:34:27 +0000 (0:00:00.525) 0:13:49.767 ******** 2026-08-18 15:34:27.482794 | node1 | ok: [node1] 2026-08-18 15:34:27.483056 | node1 | ok: [node2] 2026-08-18 15:34:27.483310 | node1 | ok: [node3] 2026-08-18 15:34:27.483687 | node1 | 2026-08-18 15:34:27.483804 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:27.484097 | node1 | Tuesday 18 August 2026 15:34:27 +0000 (0:00:00.317) 0:13:50.085 ******** 2026-08-18 15:34:27.578561 | node1 | ok: [node1] => { 2026-08-18 15:34:27.578833 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:27.579289 | node1 | } 2026-08-18 15:34:27.579637 | node1 | ok: [node2] => { 2026-08-18 15:34:27.579897 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:27.580226 | node1 | } 2026-08-18 15:34:27.580443 | node1 | ok: [node3] => { 2026-08-18 15:34:27.580718 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:27.581007 | node1 | } 2026-08-18 15:34:27.581238 | node1 | 2026-08-18 15:34:27.581522 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:27.581771 | node1 | Tuesday 18 August 2026 15:34:27 +0000 (0:00:00.096) 0:13:50.181 ******** 2026-08-18 15:34:28.052237 | node1 | ok: [node1] 2026-08-18 15:34:28.052522 | node1 | ok: [node3] 2026-08-18 15:34:28.052699 | node1 | ok: [node2] 2026-08-18 15:34:28.053228 | node1 | 2026-08-18 15:34:28.053316 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:28.053572 | node1 | Tuesday 18 August 2026 15:34:28 +0000 (0:00:00.473) 0:13:50.655 ******** 2026-08-18 15:34:31.421861 | node1 | ok: [node1] 2026-08-18 15:34:31.422126 | node1 | ok: [node3] 2026-08-18 15:34:31.422440 | node1 | ok: [node2] 2026-08-18 15:34:31.422705 | node1 | 2026-08-18 15:34:31.423015 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:34:31.423239 | node1 | Tuesday 18 August 2026 15:34:31 +0000 (0:00:03.369) 0:13:54.024 ******** 2026-08-18 15:34:32.425982 | node1 | ok: [node3] 2026-08-18 15:34:32.426042 | node1 | ok: [node2] 2026-08-18 15:34:32.426159 | node1 | ok: [node1] 2026-08-18 15:34:32.426260 | node1 | 2026-08-18 15:34:32.426378 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:34:32.426496 | node1 | Tuesday 18 August 2026 15:34:32 +0000 (0:00:01.004) 0:13:55.028 ******** 2026-08-18 15:34:32.703959 | node1 | ok: [node1] 2026-08-18 15:34:32.704023 | node1 | ok: [node2] 2026-08-18 15:34:32.704124 | node1 | ok: [node3] 2026-08-18 15:34:32.704223 | node1 | 2026-08-18 15:34:32.704340 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:34:32.704454 | node1 | Tuesday 18 August 2026 15:34:32 +0000 (0:00:00.277) 0:13:55.306 ******** 2026-08-18 15:34:33.302732 | node1 | ok: [node2] 2026-08-18 15:34:33.302972 | node1 | ok: [node1] 2026-08-18 15:34:33.303228 | node1 | ok: [node3] 2026-08-18 15:34:33.303461 | node1 | 2026-08-18 15:34:33.303727 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:34:33.304019 | node1 | Tuesday 18 August 2026 15:34:33 +0000 (0:00:00.597) 0:13:55.904 ******** 2026-08-18 15:34:34.086949 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:34.088202 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:34.088492 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:34:34.088665 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:34.088828 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:34.089021 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:34:34.089557 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:34.089684 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:34.089871 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:34:34.090046 | node1 | 2026-08-18 15:34:34.091437 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:34:34.092155 | node1 | Tuesday 18 August 2026 15:34:34 +0000 (0:00:00.784) 0:13:56.689 ******** 2026-08-18 15:34:34.636574 | node1 | ok: [node1] 2026-08-18 15:34:34.636807 | node1 | ok: [node2] 2026-08-18 15:34:34.637086 | node1 | ok: [node3] 2026-08-18 15:34:34.637347 | node1 | 2026-08-18 15:34:34.637617 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:34:34.637882 | node1 | Tuesday 18 August 2026 15:34:34 +0000 (0:00:00.550) 0:13:57.239 ******** 2026-08-18 15:34:35.211158 | node1 | ok: [node2] 2026-08-18 15:34:35.211686 | node1 | ok: [node1] 2026-08-18 15:34:35.212075 | node1 | ok: [node3] 2026-08-18 15:34:35.212306 | node1 | 2026-08-18 15:34:35.212560 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:35.212810 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.554) 0:13:57.793 ******** 2026-08-18 15:34:35.213075 | node1 | 2026-08-18 15:34:35.213318 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:35.213565 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.007) 0:13:57.800 ******** 2026-08-18 15:34:35.213782 | node1 | 2026-08-18 15:34:35.214068 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:34:35.214308 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.006) 0:13:57.807 ******** 2026-08-18 15:34:35.214528 | node1 | 2026-08-18 15:34:35.214775 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:34:35.215071 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.006) 0:13:57.813 ******** 2026-08-18 15:34:35.710338 | node1 | ok: [node1] 2026-08-18 15:34:35.710470 | node1 | ok: [node2] 2026-08-18 15:34:35.710628 | node1 | ok: [node3] 2026-08-18 15:34:35.710784 | node1 | 2026-08-18 15:34:35.711007 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:35.711174 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.499) 0:13:58.313 ******** 2026-08-18 15:34:35.790983 | node1 | ok: [node1] => { 2026-08-18 15:34:35.791264 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:35.791717 | node1 | } 2026-08-18 15:34:35.792017 | node1 | ok: [node2] => { 2026-08-18 15:34:35.792289 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:35.792547 | node1 | } 2026-08-18 15:34:35.792836 | node1 | ok: [node3] => { 2026-08-18 15:34:35.793173 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:34:35.793424 | node1 | } 2026-08-18 15:34:35.793665 | node1 | 2026-08-18 15:34:35.793962 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:35.794249 | node1 | Tuesday 18 August 2026 15:34:35 +0000 (0:00:00.079) 0:13:58.393 ******** 2026-08-18 15:34:36.180557 | node1 | ok: [node1] 2026-08-18 15:34:36.180825 | node1 | ok: [node3] 2026-08-18 15:34:36.181110 | node1 | ok: [node2] 2026-08-18 15:34:36.181379 | node1 | 2026-08-18 15:34:36.181654 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:36.181916 | node1 | Tuesday 18 August 2026 15:34:36 +0000 (0:00:00.390) 0:13:58.783 ******** 2026-08-18 15:34:36.268123 | node1 | skipping: [node1] 2026-08-18 15:34:36.268394 | node1 | skipping: [node2] 2026-08-18 15:34:36.269081 | node1 | skipping: [node3] 2026-08-18 15:34:36.269135 | node1 | 2026-08-18 15:34:36.269215 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:34:36.269585 | node1 | Tuesday 18 August 2026 15:34:36 +0000 (0:00:00.087) 0:13:58.870 ******** 2026-08-18 15:34:36.348268 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:34:36.348482 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:34:36.348782 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:34:36.349090 | node1 | 2026-08-18 15:34:36.349343 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:34:36.349670 | node1 | Tuesday 18 August 2026 15:34:36 +0000 (0:00:00.080) 0:13:58.951 ******** 2026-08-18 15:34:37.338882 | node1 | ok: [node3] 2026-08-18 15:34:37.339043 | node1 | ok: [node2] 2026-08-18 15:34:37.339200 | node1 | ok: [node1] 2026-08-18 15:34:37.339352 | node1 | 2026-08-18 15:34:37.339521 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:34:37.339690 | node1 | Tuesday 18 August 2026 15:34:37 +0000 (0:00:00.990) 0:13:59.941 ******** 2026-08-18 15:34:38.191983 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:34:38.192054 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:34:38.192178 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:34:38.192294 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:34:38.192405 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:34:38.192533 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:34:38.192637 | node1 | 2026-08-18 15:34:38.192751 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:34:38.192872 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.853) 0:14:00.794 ******** 2026-08-18 15:34:38.461159 | node1 | ok: [node1] 2026-08-18 15:34:38.461405 | node1 | ok: [node2] 2026-08-18 15:34:38.461672 | node1 | ok: [node3] 2026-08-18 15:34:38.461898 | node1 | 2026-08-18 15:34:38.462219 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:34:38.462484 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.268) 0:14:01.062 ******** 2026-08-18 15:34:38.795820 | node1 | ok: [node1] 2026-08-18 15:34:38.796106 | node1 | ok: [node2] 2026-08-18 15:34:38.796408 | node1 | ok: [node3] 2026-08-18 15:34:38.796578 | node1 | 2026-08-18 15:34:38.796851 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:34:38.797132 | node1 | Tuesday 18 August 2026 15:34:38 +0000 (0:00:00.335) 0:14:01.398 ******** 2026-08-18 15:34:39.362638 | node1 | ok: [node2] 2026-08-18 15:34:39.362731 | node1 | ok: [node1] 2026-08-18 15:34:39.362846 | node1 | ok: [node3] 2026-08-18 15:34:39.363019 | node1 | 2026-08-18 15:34:39.363134 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:34:39.363230 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.566) 0:14:01.965 ******** 2026-08-18 15:34:39.435893 | node1 | skipping: [node1] 2026-08-18 15:34:39.436964 | node1 | skipping: [node2] 2026-08-18 15:34:39.436988 | node1 | skipping: [node3] 2026-08-18 15:34:39.437001 | node1 | 2026-08-18 15:34:39.437264 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:34:39.437519 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.073) 0:14:02.038 ******** 2026-08-18 15:34:39.898052 | node1 | ok: [node1] 2026-08-18 15:34:39.898147 | node1 | ok: [node3] 2026-08-18 15:34:39.898285 | node1 | ok: [node2] 2026-08-18 15:34:39.898408 | node1 | 2026-08-18 15:34:39.898558 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:34:39.898693 | node1 | Tuesday 18 August 2026 15:34:39 +0000 (0:00:00.462) 0:14:02.500 ******** 2026-08-18 15:34:40.505982 | node1 | ok: [node1] 2026-08-18 15:34:40.506173 | node1 | ok: [node2] 2026-08-18 15:34:40.506316 | node1 | ok: [node3] 2026-08-18 15:34:40.506458 | node1 | 2026-08-18 15:34:40.506636 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 15:34:40.506883 | node1 | Tuesday 18 August 2026 15:34:40 +0000 (0:00:00.608) 0:14:03.109 ******** 2026-08-18 15:34:41.241132 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:34:41.241384 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:34:41.241661 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:34:41.241907 | node1 | 2026-08-18 15:34:41.242216 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 15:34:41.242486 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.734) 0:14:03.843 ******** 2026-08-18 15:34:41.335256 | node1 | ok: [node1] 2026-08-18 15:34:41.335458 | node1 | ok: [node2] 2026-08-18 15:34:41.335687 | node1 | ok: [node3] 2026-08-18 15:34:41.335785 | node1 | 2026-08-18 15:34:41.335951 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 15:34:41.336029 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.094) 0:14:03.937 ******** 2026-08-18 15:34:41.431535 | node1 | ok: [node1] 2026-08-18 15:34:41.432749 | node1 | ok: [node2] 2026-08-18 15:34:41.432781 | node1 | ok: [node3] 2026-08-18 15:34:41.432795 | node1 | 2026-08-18 15:34:41.432808 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 15:34:41.432820 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.096) 0:14:04.034 ******** 2026-08-18 15:34:41.466335 | node1 | skipping: [node1] 2026-08-18 15:34:41.466533 | node1 | 2026-08-18 15:34:41.466788 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 15:34:41.467097 | node1 | Tuesday 18 August 2026 15:34:41 +0000 (0:00:00.035) 0:14:04.069 ******** 2026-08-18 15:34:44.828059 | node1 | changed: [node1] => (item=ceph-exporter) 2026-08-18 15:34:44.828121 | node1 | 2026-08-18 15:34:44.828405 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:34:44.828737 | node1 | node1 : ok=246 changed=47 unreachable=0 failed=0 skipped=54 rescued=0 ignored=0 2026-08-18 15:34:44.829035 | node1 | node2 : ok=206 changed=27 unreachable=0 failed=0 skipped=45 rescued=0 ignored=0 2026-08-18 15:34:44.829302 | node1 | node3 : ok=206 changed=27 unreachable=0 failed=0 skipped=45 rescued=0 ignored=0 2026-08-18 15:34:44.829524 | node1 | 2026-08-18 15:34:44.829743 | node1 | 2026-08-18 15:34:44.830019 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:34:44.830270 | node1 | Tuesday 18 August 2026 15:34:44 +0000 (0:00:03.361) 0:14:07.430 ******** 2026-08-18 15:34:44.830486 | node1 | =============================================================================== 2026-08-18 15:34:44.830749 | node1 | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 386.29s 2026-08-18 15:34:44.831020 | node1 | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 53.78s 2026-08-18 15:34:44.831639 | node1 | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 53.32s 2026-08-18 15:34:44.831917 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 39.08s 2026-08-18 15:34:44.832196 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 22.20s 2026-08-18 15:34:44.832446 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ---------------- 21.29s 2026-08-18 15:34:44.832706 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host -- 15.35s 2026-08-18 15:34:44.832981 | node1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 13.87s 2026-08-18 15:34:44.833223 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------ 11.28s 2026-08-18 15:34:44.833464 | node1 | vexxhost.ceph.configure : Configure dashboard users -------------------- 11.08s 2026-08-18 15:34:44.833704 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.41s 2026-08-18 15:34:44.833973 | node1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 8.27s 2026-08-18 15:34:44.834216 | node1 | vexxhost.ceph.mon : Wait for this monitor's daemon to be present -------- 7.64s 2026-08-18 15:34:44.834464 | node1 | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 7.13s 2026-08-18 15:34:44.834728 | node1 | vexxhost.containers.docker : Restart docker ----------------------------- 4.83s 2026-08-18 15:34:44.835011 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.74s 2026-08-18 15:34:44.835254 | node1 | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.63s 2026-08-18 15:34:44.835492 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.16s 2026-08-18 15:34:44.835733 | node1 | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 3.93s 2026-08-18 15:34:44.836005 | node1 | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 3.44s 2026-08-18 15:34:44.955037 | node1 | INFO [default > converge] Executed: Successful 2026-08-18 15:34:44.965285 | node1 | INFO [default > idempotence] Executing 2026-08-18 15:34:46.157137 | node1 | 2026-08-18 15:34:46.157371 | node1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-18 15:34:46.157594 | node1 | 2026-08-18 15:34:46.157841 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:34:46.158140 | node1 | Tuesday 18 August 2026 15:34:46 +0000 (0:00:00.057) 0:00:00.057 ******** 2026-08-18 15:34:47.398828 | node1 | [WARNING]: Platform linux on host node2 is using the discovered Python 2026-08-18 15:34:47.401948 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:34:47.401964 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:34:47.401970 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:34:47.401975 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:34:47.441521 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:34:47.441888 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:34:47.442257 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:34:47.442542 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:34:47.442818 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:34:47.447940 | node1 | [WARNING]: Platform linux on host node3 is using the discovered Python 2026-08-18 15:34:47.448682 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:34:47.448692 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:34:47.448739 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:34:47.449051 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:34:47.511914 | node1 | ok: [node2] 2026-08-18 15:34:47.512224 | node1 | ok: [node1] 2026-08-18 15:34:47.512472 | node1 | ok: [node3] 2026-08-18 15:34:47.512700 | node1 | 2026-08-18 15:34:47.512902 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:47.513115 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:01.354) 0:00:01.412 ******** 2026-08-18 15:34:47.869407 | node1 | ok: [node1] 2026-08-18 15:34:47.869623 | node1 | ok: [node3] 2026-08-18 15:34:47.869868 | node1 | ok: [node2] 2026-08-18 15:34:47.870168 | node1 | 2026-08-18 15:34:47.870422 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:47.870673 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:00.357) 0:00:01.769 ******** 2026-08-18 15:34:47.974987 | node1 | skipping: [node1] 2026-08-18 15:34:47.975239 | node1 | skipping: [node2] 2026-08-18 15:34:47.975485 | node1 | skipping: [node3] 2026-08-18 15:34:47.975712 | node1 | 2026-08-18 15:34:47.976034 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:34:47.976324 | node1 | Tuesday 18 August 2026 15:34:47 +0000 (0:00:00.105) 0:00:01.875 ******** 2026-08-18 15:34:48.344602 | node1 | ok: [node2] 2026-08-18 15:34:48.344810 | node1 | ok: [node1] 2026-08-18 15:34:48.345093 | node1 | ok: [node3] 2026-08-18 15:34:48.345313 | node1 | 2026-08-18 15:34:48.345562 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:48.345841 | node1 | Tuesday 18 August 2026 15:34:48 +0000 (0:00:00.369) 0:00:02.245 ******** 2026-08-18 15:34:48.454131 | node1 | ok: [node1] => { 2026-08-18 15:34:48.454340 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:48.454528 | node1 | } 2026-08-18 15:34:48.454712 | node1 | ok: [node2] => { 2026-08-18 15:34:48.454885 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:48.455034 | node1 | } 2026-08-18 15:34:48.455163 | node1 | ok: [node3] => { 2026-08-18 15:34:48.455286 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:34:48.455404 | node1 | } 2026-08-18 15:34:48.455518 | node1 | 2026-08-18 15:34:48.455647 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:48.455779 | node1 | Tuesday 18 August 2026 15:34:48 +0000 (0:00:00.109) 0:00:02.354 ******** 2026-08-18 15:34:48.964647 | node1 | ok: [node1] 2026-08-18 15:34:48.964896 | node1 | ok: [node2] 2026-08-18 15:34:48.965214 | node1 | ok: [node3] 2026-08-18 15:34:48.965425 | node1 | 2026-08-18 15:34:48.965677 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:48.965954 | node1 | Tuesday 18 August 2026 15:34:48 +0000 (0:00:00.510) 0:00:02.865 ******** 2026-08-18 15:34:49.077288 | node1 | skipping: [node1] 2026-08-18 15:34:49.077417 | node1 | skipping: [node2] 2026-08-18 15:34:49.077568 | node1 | skipping: [node3] 2026-08-18 15:34:49.077708 | node1 | 2026-08-18 15:34:49.077873 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:49.078066 | node1 | Tuesday 18 August 2026 15:34:49 +0000 (0:00:00.112) 0:00:02.978 ******** 2026-08-18 15:34:49.202262 | node1 | skipping: [node1] 2026-08-18 15:34:49.202441 | node1 | skipping: [node2] 2026-08-18 15:34:49.202681 | node1 | skipping: [node3] 2026-08-18 15:34:49.202900 | node1 | 2026-08-18 15:34:49.203186 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:49.203423 | node1 | Tuesday 18 August 2026 15:34:49 +0000 (0:00:00.125) 0:00:03.103 ******** 2026-08-18 15:34:49.495562 | node1 | ok: [node1] 2026-08-18 15:34:49.495733 | node1 | ok: [node2] 2026-08-18 15:34:49.495904 | node1 | ok: [node3] 2026-08-18 15:34:49.496081 | node1 | 2026-08-18 15:34:49.496252 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:34:49.496416 | node1 | Tuesday 18 August 2026 15:34:49 +0000 (0:00:00.293) 0:00:03.396 ******** 2026-08-18 15:34:50.773499 | node1 | ok: [node2] 2026-08-18 15:34:50.773710 | node1 | ok: [node3] 2026-08-18 15:34:50.773974 | node1 | ok: [node1] 2026-08-18 15:34:50.774190 | node1 | 2026-08-18 15:34:50.774438 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:50.774725 | node1 | Tuesday 18 August 2026 15:34:50 +0000 (0:00:01.277) 0:00:04.673 ******** 2026-08-18 15:34:51.013820 | node1 | ok: [node1] => { 2026-08-18 15:34:51.014125 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:51.014551 | node1 | } 2026-08-18 15:34:51.014833 | node1 | ok: [node2] => { 2026-08-18 15:34:51.015178 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:51.015440 | node1 | } 2026-08-18 15:34:51.015692 | node1 | ok: [node3] => { 2026-08-18 15:34:51.016020 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:34:51.016245 | node1 | } 2026-08-18 15:34:51.016543 | node1 | 2026-08-18 15:34:51.016786 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:51.017086 | node1 | Tuesday 18 August 2026 15:34:51 +0000 (0:00:00.240) 0:00:04.914 ******** 2026-08-18 15:34:51.595097 | node1 | ok: [node1] 2026-08-18 15:34:51.595309 | node1 | ok: [node2] 2026-08-18 15:34:51.595550 | node1 | ok: [node3] 2026-08-18 15:34:51.595785 | node1 | 2026-08-18 15:34:51.596060 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:51.596308 | node1 | Tuesday 18 August 2026 15:34:51 +0000 (0:00:00.581) 0:00:05.495 ******** 2026-08-18 15:34:54.074004 | node1 | ok: [node2] 2026-08-18 15:34:54.074182 | node1 | ok: [node1] 2026-08-18 15:34:54.074416 | node1 | ok: [node3] 2026-08-18 15:34:54.074643 | node1 | 2026-08-18 15:34:54.074888 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:34:54.075177 | node1 | Tuesday 18 August 2026 15:34:54 +0000 (0:00:02.479) 0:00:07.974 ******** 2026-08-18 15:34:54.142992 | node1 | skipping: [node1] 2026-08-18 15:34:54.143238 | node1 | skipping: [node2] 2026-08-18 15:34:54.143511 | node1 | skipping: [node3] 2026-08-18 15:34:54.143732 | node1 | 2026-08-18 15:34:54.144009 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:34:54.144253 | node1 | Tuesday 18 August 2026 15:34:54 +0000 (0:00:00.069) 0:00:08.043 ******** 2026-08-18 15:34:54.211965 | node1 | skipping: [node1] 2026-08-18 15:34:54.212170 | node1 | skipping: [node2] 2026-08-18 15:34:54.212413 | node1 | skipping: [node3] 2026-08-18 15:34:54.212631 | node1 | 2026-08-18 15:34:54.212875 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:34:54.213191 | node1 | Tuesday 18 August 2026 15:34:54 +0000 (0:00:00.068) 0:00:08.112 ******** 2026-08-18 15:34:54.284546 | node1 | skipping: [node1] 2026-08-18 15:34:54.284748 | node1 | skipping: [node2] 2026-08-18 15:34:54.285095 | node1 | skipping: [node3] 2026-08-18 15:34:54.285313 | node1 | 2026-08-18 15:34:54.285599 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:34:54.285889 | node1 | Tuesday 18 August 2026 15:34:54 +0000 (0:00:00.072) 0:00:08.185 ******** 2026-08-18 15:34:55.257687 | node1 | ok: [node2] 2026-08-18 15:34:55.257728 | node1 | ok: [node1] 2026-08-18 15:34:55.257732 | node1 | ok: [node3] 2026-08-18 15:34:55.257737 | node1 | 2026-08-18 15:34:55.257741 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:34:55.257745 | node1 | Tuesday 18 August 2026 15:34:55 +0000 (0:00:00.972) 0:00:09.157 ******** 2026-08-18 15:34:55.848118 | node1 | ok: [node1] 2026-08-18 15:34:55.848182 | node1 | ok: [node2] 2026-08-18 15:34:55.849293 | node1 | ok: [node3] 2026-08-18 15:34:55.849326 | node1 | 2026-08-18 15:34:55.849336 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:34:55.849346 | node1 | Tuesday 18 August 2026 15:34:55 +0000 (0:00:00.590) 0:00:09.748 ******** 2026-08-18 15:34:57.019588 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:57.019658 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:57.019734 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:34:57.019850 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:57.019984 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:57.020119 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:34:57.020228 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:57.020340 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:57.020453 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:34:57.020573 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:57.020692 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:57.020823 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:34:57.020948 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:57.021061 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:57.021179 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:34:57.021279 | node1 | 2026-08-18 15:34:57.021391 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:34:57.021503 | node1 | Tuesday 18 August 2026 15:34:57 +0000 (0:00:01.168) 0:00:10.916 ******** 2026-08-18 15:34:57.783998 | node1 | ok: [node1] 2026-08-18 15:34:57.784059 | node1 | ok: [node3] 2026-08-18 15:34:57.784069 | node1 | ok: [node2] 2026-08-18 15:34:57.784078 | node1 | 2026-08-18 15:34:57.784088 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:57.784117 | node1 | Tuesday 18 August 2026 15:34:57 +0000 (0:00:00.740) 0:00:11.657 ******** 2026-08-18 15:34:57.784126 | node1 | 2026-08-18 15:34:57.784135 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:57.784143 | node1 | Tuesday 18 August 2026 15:34:57 +0000 (0:00:00.008) 0:00:11.665 ******** 2026-08-18 15:34:57.784151 | node1 | 2026-08-18 15:34:57.784407 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:34:57.784785 | node1 | Tuesday 18 August 2026 15:34:57 +0000 (0:00:00.007) 0:00:11.673 ******** 2026-08-18 15:34:57.785104 | node1 | 2026-08-18 15:34:57.785429 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:34:57.785737 | node1 | Tuesday 18 August 2026 15:34:57 +0000 (0:00:00.008) 0:00:11.681 ******** 2026-08-18 15:34:58.501381 | node1 | ok: [node1] 2026-08-18 15:34:58.501814 | node1 | ok: [node2] 2026-08-18 15:34:58.502179 | node1 | ok: [node3] 2026-08-18 15:34:58.502480 | node1 | 2026-08-18 15:34:58.502799 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:34:58.503144 | node1 | Tuesday 18 August 2026 15:34:58 +0000 (0:00:00.720) 0:00:12.401 ******** 2026-08-18 15:34:58.796135 | node1 | ok: [node1] 2026-08-18 15:34:58.796547 | node1 | ok: [node2] 2026-08-18 15:34:58.796858 | node1 | ok: [node3] 2026-08-18 15:34:58.797173 | node1 | 2026-08-18 15:34:58.797499 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:34:58.797853 | node1 | Tuesday 18 August 2026 15:34:58 +0000 (0:00:00.294) 0:00:12.696 ******** 2026-08-18 15:34:58.946377 | node1 | ok: [node1] => { 2026-08-18 15:34:58.946647 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:58.946839 | node1 | } 2026-08-18 15:34:58.947055 | node1 | ok: [node2] => { 2026-08-18 15:34:58.947265 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:58.947456 | node1 | } 2026-08-18 15:34:58.947647 | node1 | ok: [node3] => { 2026-08-18 15:34:58.947850 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:34:58.948054 | node1 | } 2026-08-18 15:34:58.948236 | node1 | 2026-08-18 15:34:58.948450 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:34:58.948646 | node1 | Tuesday 18 August 2026 15:34:58 +0000 (0:00:00.150) 0:00:12.846 ******** 2026-08-18 15:34:59.460470 | node1 | ok: [node1] 2026-08-18 15:34:59.460857 | node1 | ok: [node2] 2026-08-18 15:34:59.461223 | node1 | ok: [node3] 2026-08-18 15:34:59.461577 | node1 | 2026-08-18 15:34:59.461919 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:34:59.462354 | node1 | Tuesday 18 August 2026 15:34:59 +0000 (0:00:00.514) 0:00:13.360 ******** 2026-08-18 15:35:02.896550 | node1 | ok: [node1] 2026-08-18 15:35:02.896827 | node1 | ok: [node3] 2026-08-18 15:35:02.897086 | node1 | ok: [node2] 2026-08-18 15:35:02.897293 | node1 | 2026-08-18 15:35:02.897539 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:35:02.897759 | node1 | Tuesday 18 August 2026 15:35:02 +0000 (0:00:03.436) 0:00:16.797 ******** 2026-08-18 15:35:03.876324 | node1 | ok: [node1] 2026-08-18 15:35:03.876385 | node1 | ok: [node3] 2026-08-18 15:35:03.876529 | node1 | ok: [node2] 2026-08-18 15:35:03.876634 | node1 | 2026-08-18 15:35:03.876753 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:35:03.876869 | node1 | Tuesday 18 August 2026 15:35:03 +0000 (0:00:00.978) 0:00:17.775 ******** 2026-08-18 15:35:04.285016 | node1 | ok: [node1] 2026-08-18 15:35:04.285067 | node1 | ok: [node3] 2026-08-18 15:35:04.285191 | node1 | ok: [node2] 2026-08-18 15:35:04.285314 | node1 | 2026-08-18 15:35:04.285455 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:35:04.285596 | node1 | Tuesday 18 August 2026 15:35:04 +0000 (0:00:00.410) 0:00:18.185 ******** 2026-08-18 15:35:04.880600 | node1 | ok: [node1] 2026-08-18 15:35:04.880684 | node1 | ok: [node2] 2026-08-18 15:35:04.880703 | node1 | ok: [node3] 2026-08-18 15:35:04.880726 | node1 | 2026-08-18 15:35:04.880742 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:35:04.880897 | node1 | Tuesday 18 August 2026 15:35:04 +0000 (0:00:00.594) 0:00:18.780 ******** 2026-08-18 15:35:05.616133 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:35:05.616186 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:35:05.616194 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:35:05.616201 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:35:05.616209 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:35:05.616216 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:35:05.616223 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:35:05.616231 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:35:05.616238 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:35:05.616245 | node1 | 2026-08-18 15:35:05.616253 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:35:05.616261 | node1 | Tuesday 18 August 2026 15:35:05 +0000 (0:00:00.733) 0:00:19.513 ******** 2026-08-18 15:35:06.183354 | node1 | ok: [node1] 2026-08-18 15:35:06.183436 | node1 | ok: [node3] 2026-08-18 15:35:06.183524 | node1 | ok: [node2] 2026-08-18 15:35:06.183643 | node1 | 2026-08-18 15:35:06.183772 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:35:06.183884 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.566) 0:00:20.080 ******** 2026-08-18 15:35:06.785361 | node1 | ok: [node1] 2026-08-18 15:35:06.785453 | node1 | ok: [node2] 2026-08-18 15:35:06.785541 | node1 | ok: [node3] 2026-08-18 15:35:06.786224 | node1 | 2026-08-18 15:35:06.786259 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:35:06.786286 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.579) 0:00:20.659 ******** 2026-08-18 15:35:06.786299 | node1 | 2026-08-18 15:35:06.786563 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:35:06.786609 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.009) 0:00:20.669 ******** 2026-08-18 15:35:06.786629 | node1 | 2026-08-18 15:35:06.786778 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:35:06.787047 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.008) 0:00:20.678 ******** 2026-08-18 15:35:06.787102 | node1 | 2026-08-18 15:35:06.787122 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:35:06.787218 | node1 | Tuesday 18 August 2026 15:35:06 +0000 (0:00:00.008) 0:00:20.686 ******** 2026-08-18 15:35:07.299334 | node1 | ok: [node1] 2026-08-18 15:35:07.299402 | node1 | ok: [node3] 2026-08-18 15:35:07.299513 | node1 | ok: [node2] 2026-08-18 15:35:07.299618 | node1 | 2026-08-18 15:35:07.299743 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:07.299859 | node1 | Tuesday 18 August 2026 15:35:07 +0000 (0:00:00.512) 0:00:21.198 ******** 2026-08-18 15:35:07.367276 | node1 | ok: [node1] => { 2026-08-18 15:35:07.367434 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:35:07.367585 | node1 | } 2026-08-18 15:35:07.367750 | node1 | ok: [node2] => { 2026-08-18 15:35:07.367898 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:35:07.368090 | node1 | } 2026-08-18 15:35:07.368218 | node1 | ok: [node3] => { 2026-08-18 15:35:07.368378 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:35:07.368526 | node1 | } 2026-08-18 15:35:07.368671 | node1 | 2026-08-18 15:35:07.368832 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:07.369013 | node1 | Tuesday 18 August 2026 15:35:07 +0000 (0:00:00.069) 0:00:21.268 ******** 2026-08-18 15:35:07.755009 | node1 | ok: [node1] 2026-08-18 15:35:07.755050 | node1 | ok: [node3] 2026-08-18 15:35:07.756016 | node1 | ok: [node2] 2026-08-18 15:35:07.756072 | node1 | 2026-08-18 15:35:07.756087 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:07.756119 | node1 | Tuesday 18 August 2026 15:35:07 +0000 (0:00:00.386) 0:00:21.654 ******** 2026-08-18 15:35:07.787592 | node1 | skipping: [node1] 2026-08-18 15:35:07.849347 | node1 | skipping: [node2] 2026-08-18 15:35:07.849409 | node1 | skipping: [node3] 2026-08-18 15:35:07.849515 | node1 | 2026-08-18 15:35:07.849633 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:35:07.849750 | node1 | Tuesday 18 August 2026 15:35:07 +0000 (0:00:00.094) 0:00:21.749 ******** 2026-08-18 15:35:07.941118 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:35:07.941165 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:35:07.941527 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:35:07.941835 | node1 | 2026-08-18 15:35:07.942205 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:35:07.942531 | node1 | Tuesday 18 August 2026 15:35:07 +0000 (0:00:00.089) 0:00:21.839 ******** 2026-08-18 15:35:09.043550 | node1 | ok: [node1] 2026-08-18 15:35:09.043954 | node1 | ok: [node2] 2026-08-18 15:35:09.043971 | node1 | ok: [node3] 2026-08-18 15:35:09.043977 | node1 | 2026-08-18 15:35:09.044072 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:35:09.044182 | node1 | Tuesday 18 August 2026 15:35:09 +0000 (0:00:01.104) 0:00:22.943 ******** 2026-08-18 15:35:09.895094 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:35:09.895158 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:35:09.895285 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:35:09.895396 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:35:09.895510 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:35:09.895620 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:35:09.895719 | node1 | 2026-08-18 15:35:09.895835 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:35:09.895969 | node1 | Tuesday 18 August 2026 15:35:09 +0000 (0:00:00.851) 0:00:23.795 ******** 2026-08-18 15:35:10.207307 | node1 | ok: [node1] 2026-08-18 15:35:10.207397 | node1 | ok: [node2] 2026-08-18 15:35:10.207508 | node1 | ok: [node3] 2026-08-18 15:35:10.207614 | node1 | 2026-08-18 15:35:10.207731 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:35:10.207838 | node1 | Tuesday 18 August 2026 15:35:10 +0000 (0:00:00.312) 0:00:24.107 ******** 2026-08-18 15:35:10.670663 | node1 | ok: [node1] 2026-08-18 15:35:10.670724 | node1 | ok: [node3] 2026-08-18 15:35:10.670841 | node1 | ok: [node2] 2026-08-18 15:35:10.670954 | node1 | 2026-08-18 15:35:10.671083 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:35:10.671207 | node1 | Tuesday 18 August 2026 15:35:10 +0000 (0:00:00.463) 0:00:24.570 ******** 2026-08-18 15:35:11.261276 | node1 | ok: [node1] 2026-08-18 15:35:11.261522 | node1 | ok: [node2] 2026-08-18 15:35:11.261830 | node1 | ok: [node3] 2026-08-18 15:35:11.262107 | node1 | 2026-08-18 15:35:11.262378 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:35:11.262636 | node1 | Tuesday 18 August 2026 15:35:11 +0000 (0:00:00.590) 0:00:25.161 ******** 2026-08-18 15:35:11.295168 | node1 | skipping: [node1] 2026-08-18 15:35:11.333615 | node1 | skipping: [node2] 2026-08-18 15:35:11.333828 | node1 | skipping: [node3] 2026-08-18 15:35:11.334097 | node1 | 2026-08-18 15:35:11.334355 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:35:11.334603 | node1 | Tuesday 18 August 2026 15:35:11 +0000 (0:00:00.072) 0:00:25.234 ******** 2026-08-18 15:35:11.959522 | node1 | ok: [node2] 2026-08-18 15:35:11.959695 | node1 | ok: [node1] 2026-08-18 15:35:11.959895 | node1 | ok: [node3] 2026-08-18 15:35:11.960207 | node1 | 2026-08-18 15:35:11.960438 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:35:11.960647 | node1 | Tuesday 18 August 2026 15:35:11 +0000 (0:00:00.622) 0:00:25.857 ******** 2026-08-18 15:35:12.563870 | node1 | ok: [node1] 2026-08-18 15:35:12.564097 | node1 | ok: [node2] 2026-08-18 15:35:12.564337 | node1 | ok: [node3] 2026-08-18 15:35:12.564565 | node1 | 2026-08-18 15:35:12.565028 | node1 | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] *** 2026-08-18 15:35:12.565158 | node1 | Tuesday 18 August 2026 15:35:12 +0000 (0:00:00.607) 0:00:26.464 ******** 2026-08-18 15:35:12.679521 | node1 | ok: [node1] 2026-08-18 15:35:12.679616 | node1 | ok: [node2] 2026-08-18 15:35:12.679847 | node1 | ok: [node3] 2026-08-18 15:35:12.680012 | node1 | 2026-08-18 15:35:12.680193 | node1 | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] *** 2026-08-18 15:35:12.680369 | node1 | Tuesday 18 August 2026 15:35:12 +0000 (0:00:00.115) 0:00:26.580 ******** 2026-08-18 15:35:12.766291 | node1 | ok: [node1] => { 2026-08-18 15:35:12.766339 | node1 | "changed": false, 2026-08-18 15:35:12.766348 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:12.766360 | node1 | } 2026-08-18 15:35:12.766566 | node1 | ok: [node2] => { 2026-08-18 15:35:12.766799 | node1 | "changed": false, 2026-08-18 15:35:12.767070 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:12.767301 | node1 | } 2026-08-18 15:35:12.767535 | node1 | ok: [node3] => { 2026-08-18 15:35:12.767770 | node1 | "changed": false, 2026-08-18 15:35:12.768034 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:12.768262 | node1 | } 2026-08-18 15:35:12.768481 | node1 | 2026-08-18 15:35:12.768742 | node1 | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] ******************* 2026-08-18 15:35:12.769035 | node1 | Tuesday 18 August 2026 15:35:12 +0000 (0:00:00.085) 0:00:26.666 ******** 2026-08-18 15:35:12.856613 | node1 | ok: [node1] 2026-08-18 15:35:12.856831 | node1 | ok: [node2] 2026-08-18 15:35:12.857104 | node1 | ok: [node3] 2026-08-18 15:35:12.857321 | node1 | 2026-08-18 15:35:12.857575 | node1 | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] *** 2026-08-18 15:35:12.857821 | node1 | Tuesday 18 August 2026 15:35:12 +0000 (0:00:00.090) 0:00:26.756 ******** 2026-08-18 15:35:13.692308 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:35:13.692534 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:35:13.692772 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:35:13.693027 | node1 | 2026-08-18 15:35:13.693283 | node1 | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] *** 2026-08-18 15:35:13.693526 | node1 | Tuesday 18 August 2026 15:35:13 +0000 (0:00:00.835) 0:00:27.592 ******** 2026-08-18 15:35:13.776600 | node1 | ok: [node1] 2026-08-18 15:35:13.776815 | node1 | ok: [node2] 2026-08-18 15:35:13.777087 | node1 | ok: [node3] 2026-08-18 15:35:13.777298 | node1 | 2026-08-18 15:35:13.777544 | node1 | TASK [vexxhost.ceph.mon : Bootstrap the cluster] ******************************* 2026-08-18 15:35:13.777783 | node1 | Tuesday 18 August 2026 15:35:13 +0000 (0:00:00.084) 0:00:27.677 ******** 2026-08-18 15:35:13.861566 | node1 | skipping: [node1] 2026-08-18 15:35:13.861683 | node1 | skipping: [node2] 2026-08-18 15:35:13.861891 | node1 | skipping: [node3] 2026-08-18 15:35:13.862106 | node1 | 2026-08-18 15:35:13.862279 | node1 | TASK [Register this monitor host] ********************************************** 2026-08-18 15:35:13.862446 | node1 | Tuesday 18 August 2026 15:35:13 +0000 (0:00:00.084) 0:00:27.761 ******** 2026-08-18 15:35:14.018218 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:35:14.018438 | node1 | 2026-08-18 15:35:14.018725 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:35:14.019024 | node1 | Tuesday 18 August 2026 15:35:14 +0000 (0:00:00.156) 0:00:27.918 ******** 2026-08-18 15:35:15.778139 | node1 | ok: [node1] 2026-08-18 15:35:15.778198 | node1 | 2026-08-18 15:35:15.778212 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:35:15.778224 | node1 | Tuesday 18 August 2026 15:35:15 +0000 (0:00:01.758) 0:00:29.677 ******** 2026-08-18 15:35:15.860139 | node1 | ok: [node1] 2026-08-18 15:35:15.860199 | node1 | ok: [node2] 2026-08-18 15:35:15.860219 | node1 | ok: [node3] 2026-08-18 15:35:15.861043 | node1 | 2026-08-18 15:35:15.861102 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:35:15.861137 | node1 | Tuesday 18 August 2026 15:35:15 +0000 (0:00:00.082) 0:00:29.760 ******** 2026-08-18 15:35:15.940097 | node1 | ok: [node1] => { 2026-08-18 15:35:15.940155 | node1 | "changed": false, 2026-08-18 15:35:15.940165 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:15.940174 | node1 | } 2026-08-18 15:35:15.940183 | node1 | ok: [node2] => { 2026-08-18 15:35:15.940205 | node1 | "changed": false, 2026-08-18 15:35:15.940219 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:15.941005 | node1 | } 2026-08-18 15:35:15.941049 | node1 | ok: [node3] => { 2026-08-18 15:35:15.941058 | node1 | "changed": false, 2026-08-18 15:35:15.941271 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:15.941598 | node1 | } 2026-08-18 15:35:15.941884 | node1 | 2026-08-18 15:35:15.942244 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:35:15.942560 | node1 | Tuesday 18 August 2026 15:35:15 +0000 (0:00:00.078) 0:00:29.838 ******** 2026-08-18 15:35:16.382867 | node1 | ok: [node2] 2026-08-18 15:35:16.382896 | node1 | ok: [node1] 2026-08-18 15:35:16.382900 | node1 | ok: [node3] 2026-08-18 15:35:16.382904 | node1 | 2026-08-18 15:35:16.382909 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:35:16.382913 | node1 | Tuesday 18 August 2026 15:35:16 +0000 (0:00:00.444) 0:00:30.282 ******** 2026-08-18 15:35:16.465792 | node1 | ok: [node1] 2026-08-18 15:35:16.466195 | node1 | ok: [node2] 2026-08-18 15:35:16.466506 | node1 | ok: [node3] 2026-08-18 15:35:16.466788 | node1 | 2026-08-18 15:35:16.467156 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:35:16.467476 | node1 | Tuesday 18 August 2026 15:35:16 +0000 (0:00:00.083) 0:00:30.365 ******** 2026-08-18 15:35:16.578011 | node1 | ok: [node1] 2026-08-18 15:35:16.578218 | node1 | ok: [node2] 2026-08-18 15:35:16.578461 | node1 | ok: [node3] 2026-08-18 15:35:16.578690 | node1 | 2026-08-18 15:35:16.578996 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:35:16.579269 | node1 | Tuesday 18 August 2026 15:35:16 +0000 (0:00:00.111) 0:00:30.477 ******** 2026-08-18 15:35:16.654401 | node1 | ok: [node1] => { 2026-08-18 15:35:16.654637 | node1 | "changed": false, 2026-08-18 15:35:16.654879 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:16.655187 | node1 | } 2026-08-18 15:35:16.655435 | node1 | ok: [node2] => { 2026-08-18 15:35:16.655679 | node1 | "changed": false, 2026-08-18 15:35:16.655933 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:16.656204 | node1 | } 2026-08-18 15:35:16.656448 | node1 | ok: [node3] => { 2026-08-18 15:35:16.656691 | node1 | "changed": false, 2026-08-18 15:35:16.656940 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:16.657205 | node1 | } 2026-08-18 15:35:16.657436 | node1 | 2026-08-18 15:35:16.657696 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:35:16.658004 | node1 | Tuesday 18 August 2026 15:35:16 +0000 (0:00:00.077) 0:00:30.555 ******** 2026-08-18 15:35:18.563346 | node1 | ok: [node1] 2026-08-18 15:35:18.563580 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:18.563843 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:18.564139 | node1 | 2026-08-18 15:35:18.564399 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:35:18.564652 | node1 | Tuesday 18 August 2026 15:35:18 +0000 (0:00:01.908) 0:00:32.463 ******** 2026-08-18 15:35:18.673585 | node1 | skipping: [node1] 2026-08-18 15:35:18.673769 | node1 | skipping: [node2] 2026-08-18 15:35:18.674063 | node1 | skipping: [node3] 2026-08-18 15:35:18.674285 | node1 | 2026-08-18 15:35:18.674532 | node1 | TASK [vexxhost.ceph.mon : Apply the monitor service spec] ********************** 2026-08-18 15:35:18.674776 | node1 | Tuesday 18 August 2026 15:35:18 +0000 (0:00:00.110) 0:00:32.574 ******** 2026-08-18 15:35:20.539806 | node1 | ok: [node1] 2026-08-18 15:35:20.540069 | node1 | 2026-08-18 15:35:20.540330 | node1 | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ******** 2026-08-18 15:35:20.540582 | node1 | Tuesday 18 August 2026 15:35:20 +0000 (0:00:01.865) 0:00:34.439 ******** 2026-08-18 15:35:22.540348 | node1 | ok: [node1] 2026-08-18 15:35:22.540430 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:22.543018 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:22.543107 | node1 | 2026-08-18 15:35:22.543136 | node1 | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] *********************** 2026-08-18 15:35:22.543150 | node1 | Tuesday 18 August 2026 15:35:22 +0000 (0:00:02.001) 0:00:36.441 ******** 2026-08-18 15:35:23.287364 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:35:23.287430 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:35:23.287528 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:35:23.287872 | node1 | 2026-08-18 15:35:23.287907 | node1 | TASK [vexxhost.ceph.mgr : Select the admin host] ******************************* 2026-08-18 15:35:23.287918 | node1 | Tuesday 18 August 2026 15:35:23 +0000 (0:00:00.746) 0:00:37.187 ******** 2026-08-18 15:35:23.374034 | node1 | ok: [node1] 2026-08-18 15:35:23.374092 | node1 | ok: [node2] 2026-08-18 15:35:23.374111 | node1 | ok: [node3] 2026-08-18 15:35:23.374514 | node1 | 2026-08-18 15:35:23.374561 | node1 | TASK [Register this manager host] ********************************************** 2026-08-18 15:35:23.374571 | node1 | Tuesday 18 August 2026 15:35:23 +0000 (0:00:00.086) 0:00:37.274 ******** 2026-08-18 15:35:23.508686 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:35:23.508751 | node1 | 2026-08-18 15:35:23.508766 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:35:23.508779 | node1 | Tuesday 18 August 2026 15:35:23 +0000 (0:00:00.133) 0:00:37.408 ******** 2026-08-18 15:35:25.347069 | node1 | ok: [node1] 2026-08-18 15:35:25.347145 | node1 | 2026-08-18 15:35:25.347167 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:35:25.347392 | node1 | Tuesday 18 August 2026 15:35:25 +0000 (0:00:01.838) 0:00:39.246 ******** 2026-08-18 15:35:25.430898 | node1 | ok: [node1] 2026-08-18 15:35:25.430979 | node1 | ok: [node2] 2026-08-18 15:35:25.430996 | node1 | ok: [node3] 2026-08-18 15:35:25.431009 | node1 | 2026-08-18 15:35:25.431021 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:35:25.431033 | node1 | Tuesday 18 August 2026 15:35:25 +0000 (0:00:00.083) 0:00:39.330 ******** 2026-08-18 15:35:25.511079 | node1 | ok: [node1] => { 2026-08-18 15:35:25.511140 | node1 | "changed": false, 2026-08-18 15:35:25.511155 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:25.511573 | node1 | } 2026-08-18 15:35:25.511640 | node1 | ok: [node2] => { 2026-08-18 15:35:25.512991 | node1 | "changed": false, 2026-08-18 15:35:25.513043 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:25.513056 | node1 | } 2026-08-18 15:35:25.513068 | node1 | ok: [node3] => { 2026-08-18 15:35:25.513080 | node1 | "changed": false, 2026-08-18 15:35:25.513091 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:25.513351 | node1 | } 2026-08-18 15:35:25.513638 | node1 | 2026-08-18 15:35:25.513999 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:35:25.514477 | node1 | Tuesday 18 August 2026 15:35:25 +0000 (0:00:00.080) 0:00:39.410 ******** 2026-08-18 15:35:25.865520 | node1 | ok: [node1] 2026-08-18 15:35:25.865728 | node1 | ok: [node2] 2026-08-18 15:35:25.865889 | node1 | ok: [node3] 2026-08-18 15:35:25.866069 | node1 | 2026-08-18 15:35:25.866256 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:35:25.866428 | node1 | Tuesday 18 August 2026 15:35:25 +0000 (0:00:00.354) 0:00:39.765 ******** 2026-08-18 15:35:25.949363 | node1 | ok: [node1] 2026-08-18 15:35:25.949431 | node1 | ok: [node2] 2026-08-18 15:35:25.950726 | node1 | ok: [node3] 2026-08-18 15:35:25.950783 | node1 | 2026-08-18 15:35:25.950796 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:35:25.950809 | node1 | Tuesday 18 August 2026 15:35:25 +0000 (0:00:00.084) 0:00:39.849 ******** 2026-08-18 15:35:26.071054 | node1 | ok: [node1] 2026-08-18 15:35:26.071108 | node1 | ok: [node2] 2026-08-18 15:35:26.071965 | node1 | ok: [node3] 2026-08-18 15:35:26.072002 | node1 | 2026-08-18 15:35:26.072016 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:35:26.072048 | node1 | Tuesday 18 August 2026 15:35:26 +0000 (0:00:00.121) 0:00:39.971 ******** 2026-08-18 15:35:26.154081 | node1 | ok: [node1] => { 2026-08-18 15:35:26.154138 | node1 | "changed": false, 2026-08-18 15:35:26.154148 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:26.154157 | node1 | } 2026-08-18 15:35:26.154165 | node1 | ok: [node2] => { 2026-08-18 15:35:26.154174 | node1 | "changed": false, 2026-08-18 15:35:26.154188 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:26.154993 | node1 | } 2026-08-18 15:35:26.155049 | node1 | ok: [node3] => { 2026-08-18 15:35:26.155059 | node1 | "changed": false, 2026-08-18 15:35:26.155205 | node1 | "msg": "All assertions passed" 2026-08-18 15:35:26.155500 | node1 | } 2026-08-18 15:35:26.155786 | node1 | 2026-08-18 15:35:26.156138 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:35:26.156457 | node1 | Tuesday 18 August 2026 15:35:26 +0000 (0:00:00.081) 0:00:40.052 ******** 2026-08-18 15:35:28.114492 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:28.114748 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:28.115017 | node1 | ok: [node1] 2026-08-18 15:35:28.115211 | node1 | 2026-08-18 15:35:28.115452 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:35:28.115674 | node1 | Tuesday 18 August 2026 15:35:28 +0000 (0:00:01.962) 0:00:42.014 ******** 2026-08-18 15:35:28.225412 | node1 | skipping: [node1] 2026-08-18 15:35:28.225492 | node1 | skipping: [node2] 2026-08-18 15:35:28.225603 | node1 | skipping: [node3] 2026-08-18 15:35:28.225706 | node1 | 2026-08-18 15:35:28.225823 | node1 | TASK [vexxhost.ceph.mgr : Apply the manager service spec] ********************** 2026-08-18 15:35:28.225957 | node1 | Tuesday 18 August 2026 15:35:28 +0000 (0:00:00.111) 0:00:42.125 ******** 2026-08-18 15:35:30.495534 | node1 | ok: [node1] 2026-08-18 15:35:30.495604 | node1 | 2026-08-18 15:35:30.495619 | node1 | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ******** 2026-08-18 15:35:30.495631 | node1 | Tuesday 18 August 2026 15:35:30 +0000 (0:00:02.269) 0:00:44.395 ******** 2026-08-18 15:35:32.639038 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:32.639114 | node1 | ok: [node1] 2026-08-18 15:35:32.639161 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:35:32.639483 | node1 | 2026-08-18 15:35:32.639974 | node1 | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] ************************** 2026-08-18 15:35:32.640031 | node1 | Tuesday 18 August 2026 15:35:32 +0000 (0:00:02.142) 0:00:46.538 ******** 2026-08-18 15:35:43.716965 | node1 | ok: [node1] => (item={'name': 'diskprediction_local'}) 2026-08-18 15:35:43.717026 | node1 | ok: [node1] => (item={'name': 'dashboard'}) 2026-08-18 15:35:43.717039 | node1 | ok: [node1] => (item={'name': 'iostat'}) 2026-08-18 15:35:43.717051 | node1 | ok: [node1] => (item={'name': 'prometheus'}) 2026-08-18 15:35:43.717062 | node1 | ok: [node1] => (item={'name': 'rgw'}) 2026-08-18 15:35:43.717074 | node1 | 2026-08-18 15:35:43.717087 | node1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-18 15:35:43.717098 | node1 | 2026-08-18 15:35:43.717110 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:35:43.717134 | node1 | Tuesday 18 August 2026 15:35:43 +0000 (0:00:11.077) 0:00:57.615 ******** 2026-08-18 15:35:44.731081 | node1 | ok: [node2] 2026-08-18 15:35:44.731274 | node1 | ok: [node3] 2026-08-18 15:35:44.731581 | node1 | ok: [node1] 2026-08-18 15:35:44.731860 | node1 | 2026-08-18 15:35:44.732206 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:44.732452 | node1 | Tuesday 18 August 2026 15:35:44 +0000 (0:00:01.015) 0:00:58.631 ******** 2026-08-18 15:35:45.012715 | node1 | ok: [node1] 2026-08-18 15:35:45.012992 | node1 | ok: [node2] 2026-08-18 15:35:45.013185 | node1 | ok: [node3] 2026-08-18 15:35:45.013404 | node1 | 2026-08-18 15:35:45.013657 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:45.013902 | node1 | Tuesday 18 August 2026 15:35:45 +0000 (0:00:00.282) 0:00:58.913 ******** 2026-08-18 15:35:45.095758 | node1 | skipping: [node1] 2026-08-18 15:35:45.095870 | node1 | skipping: [node2] 2026-08-18 15:35:45.096282 | node1 | skipping: [node3] 2026-08-18 15:35:45.096464 | node1 | 2026-08-18 15:35:45.096721 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:35:45.096999 | node1 | Tuesday 18 August 2026 15:35:45 +0000 (0:00:00.083) 0:00:58.996 ******** 2026-08-18 15:35:45.395915 | node1 | ok: [node1] 2026-08-18 15:35:45.396130 | node1 | ok: [node2] 2026-08-18 15:35:45.396368 | node1 | ok: [node3] 2026-08-18 15:35:45.396600 | node1 | 2026-08-18 15:35:45.396842 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:45.397136 | node1 | Tuesday 18 August 2026 15:35:45 +0000 (0:00:00.300) 0:00:59.296 ******** 2026-08-18 15:35:45.494183 | node1 | ok: [node1] => { 2026-08-18 15:35:45.494320 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:45.494333 | node1 | } 2026-08-18 15:35:45.494407 | node1 | ok: [node3] => { 2026-08-18 15:35:45.494501 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:45.494662 | node1 | } 2026-08-18 15:35:45.494823 | node1 | ok: [node2] => { 2026-08-18 15:35:45.495022 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:35:45.495190 | node1 | } 2026-08-18 15:35:45.495340 | node1 | 2026-08-18 15:35:45.495546 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:45.495703 | node1 | Tuesday 18 August 2026 15:35:45 +0000 (0:00:00.098) 0:00:59.394 ******** 2026-08-18 15:35:45.919137 | node1 | ok: [node1] 2026-08-18 15:35:45.919207 | node1 | ok: [node3] 2026-08-18 15:35:45.919225 | node1 | ok: [node2] 2026-08-18 15:35:45.919659 | node1 | 2026-08-18 15:35:45.919698 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:45.919705 | node1 | Tuesday 18 August 2026 15:35:45 +0000 (0:00:00.424) 0:00:59.819 ******** 2026-08-18 15:35:46.034196 | node1 | skipping: [node1] 2026-08-18 15:35:46.034263 | node1 | skipping: [node2] 2026-08-18 15:35:46.034273 | node1 | skipping: [node3] 2026-08-18 15:35:46.034282 | node1 | 2026-08-18 15:35:46.034291 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:46.034301 | node1 | Tuesday 18 August 2026 15:35:46 +0000 (0:00:00.113) 0:00:59.932 ******** 2026-08-18 15:35:46.146198 | node1 | skipping: [node1] 2026-08-18 15:35:46.146264 | node1 | skipping: [node2] 2026-08-18 15:35:46.146274 | node1 | skipping: [node3] 2026-08-18 15:35:46.146283 | node1 | 2026-08-18 15:35:46.146293 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:46.146302 | node1 | Tuesday 18 August 2026 15:35:46 +0000 (0:00:00.111) 0:01:00.044 ******** 2026-08-18 15:35:46.446132 | node1 | ok: [node1] 2026-08-18 15:35:46.446197 | node1 | ok: [node2] 2026-08-18 15:35:46.446207 | node1 | ok: [node3] 2026-08-18 15:35:46.446216 | node1 | 2026-08-18 15:35:46.446225 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:35:46.446235 | node1 | Tuesday 18 August 2026 15:35:46 +0000 (0:00:00.300) 0:01:00.344 ******** 2026-08-18 15:35:48.456345 | node1 | ok: [node1] 2026-08-18 15:35:48.456445 | node1 | ok: [node2] 2026-08-18 15:35:48.456454 | node1 | ok: [node3] 2026-08-18 15:35:48.456463 | node1 | 2026-08-18 15:35:48.456473 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:48.456483 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:02.010) 0:01:02.355 ******** 2026-08-18 15:35:48.696001 | node1 | ok: [node1] => { 2026-08-18 15:35:48.696123 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:48.696134 | node1 | } 2026-08-18 15:35:48.696144 | node1 | ok: [node2] => { 2026-08-18 15:35:48.696152 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:48.696161 | node1 | } 2026-08-18 15:35:48.696169 | node1 | ok: [node3] => { 2026-08-18 15:35:48.696177 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:35:48.696265 | node1 | } 2026-08-18 15:35:48.696284 | node1 | 2026-08-18 15:35:48.700042 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:48.700074 | node1 | Tuesday 18 August 2026 15:35:48 +0000 (0:00:00.238) 0:01:02.593 ******** 2026-08-18 15:35:49.293916 | node1 | ok: [node1] 2026-08-18 15:35:49.294007 | node1 | ok: [node2] 2026-08-18 15:35:49.294021 | node1 | ok: [node3] 2026-08-18 15:35:49.294033 | node1 | 2026-08-18 15:35:49.294045 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:49.294057 | node1 | Tuesday 18 August 2026 15:35:49 +0000 (0:00:00.599) 0:01:03.192 ******** 2026-08-18 15:35:51.591962 | node1 | ok: [node1] 2026-08-18 15:35:51.592021 | node1 | ok: [node2] 2026-08-18 15:35:51.592034 | node1 | ok: [node3] 2026-08-18 15:35:51.592046 | node1 | 2026-08-18 15:35:51.592059 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:35:51.592071 | node1 | Tuesday 18 August 2026 15:35:51 +0000 (0:00:02.297) 0:01:05.490 ******** 2026-08-18 15:35:51.658367 | node1 | skipping: [node1] 2026-08-18 15:35:51.658427 | node1 | skipping: [node2] 2026-08-18 15:35:51.658877 | node1 | skipping: [node3] 2026-08-18 15:35:51.658913 | node1 | 2026-08-18 15:35:51.658919 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:35:51.658940 | node1 | Tuesday 18 August 2026 15:35:51 +0000 (0:00:00.065) 0:01:05.555 ******** 2026-08-18 15:35:51.725709 | node1 | skipping: [node1] 2026-08-18 15:35:51.725753 | node1 | skipping: [node2] 2026-08-18 15:35:51.725766 | node1 | skipping: [node3] 2026-08-18 15:35:51.725778 | node1 | 2026-08-18 15:35:51.725791 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:35:51.725803 | node1 | Tuesday 18 August 2026 15:35:51 +0000 (0:00:00.069) 0:01:05.625 ******** 2026-08-18 15:35:51.786847 | node1 | skipping: [node1] 2026-08-18 15:35:51.788393 | node1 | skipping: [node2] 2026-08-18 15:35:51.788434 | node1 | skipping: [node3] 2026-08-18 15:35:51.788452 | node1 | 2026-08-18 15:35:51.788468 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:35:51.788484 | node1 | Tuesday 18 August 2026 15:35:51 +0000 (0:00:00.061) 0:01:05.687 ******** 2026-08-18 15:35:52.742097 | node1 | ok: [node1] 2026-08-18 15:35:52.742157 | node1 | ok: [node2] 2026-08-18 15:35:52.742170 | node1 | ok: [node3] 2026-08-18 15:35:52.742306 | node1 | 2026-08-18 15:35:52.742573 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:35:52.742820 | node1 | Tuesday 18 August 2026 15:35:52 +0000 (0:00:00.954) 0:01:06.642 ******** 2026-08-18 15:35:53.320838 | node1 | ok: [node1] 2026-08-18 15:35:53.321115 | node1 | ok: [node3] 2026-08-18 15:35:53.321342 | node1 | ok: [node2] 2026-08-18 15:35:53.321568 | node1 | 2026-08-18 15:35:53.321822 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:35:53.322118 | node1 | Tuesday 18 August 2026 15:35:53 +0000 (0:00:00.579) 0:01:07.221 ******** 2026-08-18 15:35:54.453030 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:54.453089 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:54.453102 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:35:54.453115 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:54.453128 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:54.454076 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:35:54.454138 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:54.454151 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:54.454162 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:35:54.454259 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:54.456466 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:54.456497 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:35:54.456531 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:54.456540 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:54.456548 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:35:54.456558 | node1 | 2026-08-18 15:35:54.456567 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:35:54.456575 | node1 | Tuesday 18 August 2026 15:35:54 +0000 (0:00:01.131) 0:01:08.352 ******** 2026-08-18 15:35:55.167992 | node1 | ok: [node1] 2026-08-18 15:35:55.168059 | node1 | ok: [node3] 2026-08-18 15:35:55.168088 | node1 | ok: [node2] 2026-08-18 15:35:55.168105 | node1 | 2026-08-18 15:35:55.168120 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.168135 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.694) 0:01:09.046 ******** 2026-08-18 15:35:55.168149 | node1 | 2026-08-18 15:35:55.168163 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.168174 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.006) 0:01:09.053 ******** 2026-08-18 15:35:55.168186 | node1 | 2026-08-18 15:35:55.168421 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:35:55.168758 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.006) 0:01:09.059 ******** 2026-08-18 15:35:55.169183 | node1 | 2026-08-18 15:35:55.169517 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:35:55.169833 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.006) 0:01:09.065 ******** 2026-08-18 15:35:55.697328 | node1 | ok: [node1] 2026-08-18 15:35:55.697401 | node1 | ok: [node2] 2026-08-18 15:35:55.697488 | node1 | ok: [node3] 2026-08-18 15:35:55.697586 | node1 | 2026-08-18 15:35:55.697710 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:35:55.697819 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.532) 0:01:09.598 ******** 2026-08-18 15:35:55.980916 | node1 | ok: [node1] 2026-08-18 15:35:55.981004 | node1 | ok: [node2] 2026-08-18 15:35:55.981018 | node1 | ok: [node3] 2026-08-18 15:35:55.981030 | node1 | 2026-08-18 15:35:55.981043 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:35:55.981055 | node1 | Tuesday 18 August 2026 15:35:55 +0000 (0:00:00.281) 0:01:09.879 ******** 2026-08-18 15:35:56.081987 | node1 | ok: [node1] => { 2026-08-18 15:35:56.082040 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.082053 | node1 | } 2026-08-18 15:35:56.082065 | node1 | ok: [node2] => { 2026-08-18 15:35:56.082077 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.082088 | node1 | } 2026-08-18 15:35:56.082100 | node1 | ok: [node3] => { 2026-08-18 15:35:56.082111 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:35:56.082122 | node1 | } 2026-08-18 15:35:56.082246 | node1 | 2026-08-18 15:35:56.082567 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:35:56.082877 | node1 | Tuesday 18 August 2026 15:35:56 +0000 (0:00:00.099) 0:01:09.979 ******** 2026-08-18 15:35:56.532649 | node1 | ok: [node1] 2026-08-18 15:35:56.533051 | node1 | ok: [node2] 2026-08-18 15:35:56.533384 | node1 | ok: [node3] 2026-08-18 15:35:56.533677 | node1 | 2026-08-18 15:35:56.534062 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:35:56.534404 | node1 | Tuesday 18 August 2026 15:35:56 +0000 (0:00:00.453) 0:01:10.432 ******** 2026-08-18 15:35:59.850446 | node1 | ok: [node1] 2026-08-18 15:35:59.850530 | node1 | ok: [node2] 2026-08-18 15:35:59.850605 | node1 | ok: [node3] 2026-08-18 15:35:59.850705 | node1 | 2026-08-18 15:35:59.850821 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:35:59.850957 | node1 | Tuesday 18 August 2026 15:35:59 +0000 (0:00:03.317) 0:01:13.750 ******** 2026-08-18 15:36:00.863980 | node1 | ok: [node1] 2026-08-18 15:36:00.864036 | node1 | ok: [node2] 2026-08-18 15:36:00.864046 | node1 | ok: [node3] 2026-08-18 15:36:00.864056 | node1 | 2026-08-18 15:36:00.864065 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:36:00.864074 | node1 | Tuesday 18 August 2026 15:36:00 +0000 (0:00:01.011) 0:01:14.762 ******** 2026-08-18 15:36:01.141821 | node1 | ok: [node1] 2026-08-18 15:36:01.141874 | node1 | ok: [node3] 2026-08-18 15:36:01.141884 | node1 | ok: [node2] 2026-08-18 15:36:01.141893 | node1 | 2026-08-18 15:36:01.141903 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:36:01.141912 | node1 | Tuesday 18 August 2026 15:36:01 +0000 (0:00:00.278) 0:01:15.040 ******** 2026-08-18 15:36:01.715096 | node1 | ok: [node1] 2026-08-18 15:36:01.715152 | node1 | ok: [node2] 2026-08-18 15:36:01.715162 | node1 | ok: [node3] 2026-08-18 15:36:01.715172 | node1 | 2026-08-18 15:36:01.715181 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:36:01.715196 | node1 | Tuesday 18 August 2026 15:36:01 +0000 (0:00:00.572) 0:01:15.613 ******** 2026-08-18 15:36:02.430087 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.430145 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.431025 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:36:02.431091 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.431101 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.431117 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:36:02.431991 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.432045 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.432055 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:36:02.432138 | node1 | 2026-08-18 15:36:02.432566 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:36:02.432890 | node1 | Tuesday 18 August 2026 15:36:02 +0000 (0:00:00.716) 0:01:16.329 ******** 2026-08-18 15:36:02.995373 | node1 | ok: [node1] 2026-08-18 15:36:02.995612 | node1 | ok: [node2] 2026-08-18 15:36:02.995837 | node1 | ok: [node3] 2026-08-18 15:36:02.999345 | node1 | 2026-08-18 15:36:02.999362 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:36:02.999366 | node1 | Tuesday 18 August 2026 15:36:02 +0000 (0:00:00.565) 0:01:16.895 ******** 2026-08-18 15:36:03.594875 | node1 | ok: [node1] 2026-08-18 15:36:03.594970 | node1 | ok: [node2] 2026-08-18 15:36:03.595126 | node1 | ok: [node3] 2026-08-18 15:36:03.595189 | node1 | 2026-08-18 15:36:03.595713 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.595739 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.580) 0:01:17.476 ******** 2026-08-18 15:36:03.595744 | node1 | 2026-08-18 15:36:03.595748 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.595847 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.006) 0:01:17.482 ******** 2026-08-18 15:36:03.595993 | node1 | 2026-08-18 15:36:03.596143 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:36:03.596282 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.006) 0:01:17.489 ******** 2026-08-18 15:36:03.596409 | node1 | 2026-08-18 15:36:03.596547 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:36:03.596686 | node1 | Tuesday 18 August 2026 15:36:03 +0000 (0:00:00.006) 0:01:17.495 ******** 2026-08-18 15:36:04.094215 | node1 | ok: [node2] 2026-08-18 15:36:04.094591 | node1 | ok: [node1] 2026-08-18 15:36:04.094893 | node1 | ok: [node3] 2026-08-18 15:36:04.095602 | node1 | 2026-08-18 15:36:04.095642 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:36:04.095798 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.499) 0:01:17.994 ******** 2026-08-18 15:36:04.167606 | node1 | ok: [node1] => { 2026-08-18 15:36:04.167867 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:04.168167 | node1 | } 2026-08-18 15:36:04.168455 | node1 | ok: [node2] => { 2026-08-18 15:36:04.168761 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:04.169040 | node1 | } 2026-08-18 15:36:04.169297 | node1 | ok: [node3] => { 2026-08-18 15:36:04.169561 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:36:04.169801 | node1 | } 2026-08-18 15:36:04.170095 | node1 | 2026-08-18 15:36:04.170358 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:36:04.170618 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.073) 0:01:18.068 ******** 2026-08-18 15:36:04.538573 | node1 | ok: [node1] 2026-08-18 15:36:04.538787 | node1 | ok: [node2] 2026-08-18 15:36:04.539104 | node1 | ok: [node3] 2026-08-18 15:36:04.539329 | node1 | 2026-08-18 15:36:04.539585 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:36:04.539834 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.370) 0:01:18.438 ******** 2026-08-18 15:36:04.628801 | node1 | skipping: [node1] 2026-08-18 15:36:04.629153 | node1 | skipping: [node2] 2026-08-18 15:36:04.629341 | node1 | skipping: [node3] 2026-08-18 15:36:04.629579 | node1 | 2026-08-18 15:36:04.629837 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:36:04.630141 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.090) 0:01:18.529 ******** 2026-08-18 15:36:04.710613 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:36:04.710854 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:36:04.711165 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:36:04.711382 | node1 | 2026-08-18 15:36:04.711629 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:36:04.711871 | node1 | Tuesday 18 August 2026 15:36:04 +0000 (0:00:00.081) 0:01:18.611 ******** 2026-08-18 15:36:05.945973 | node1 | ok: [node1] 2026-08-18 15:36:05.946019 | node1 | ok: [node2] 2026-08-18 15:36:05.946156 | node1 | ok: [node3] 2026-08-18 15:36:05.946380 | node1 | 2026-08-18 15:36:05.946634 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:36:05.946892 | node1 | Tuesday 18 August 2026 15:36:05 +0000 (0:00:01.234) 0:01:19.846 ******** 2026-08-18 15:36:06.792701 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:36:06.792913 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:36:06.793204 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:36:06.793450 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:36:06.793692 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:36:06.794045 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:36:06.794278 | node1 | 2026-08-18 15:36:06.794542 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:36:06.794782 | node1 | Tuesday 18 August 2026 15:36:06 +0000 (0:00:00.847) 0:01:20.693 ******** 2026-08-18 15:36:07.066083 | node1 | ok: [node1] 2026-08-18 15:36:07.066157 | node1 | ok: [node2] 2026-08-18 15:36:07.066178 | node1 | ok: [node3] 2026-08-18 15:36:07.066598 | node1 | 2026-08-18 15:36:07.066635 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:36:07.066642 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.273) 0:01:20.966 ******** 2026-08-18 15:36:07.404439 | node1 | ok: [node1] 2026-08-18 15:36:07.404561 | node1 | ok: [node3] 2026-08-18 15:36:07.404714 | node1 | ok: [node2] 2026-08-18 15:36:07.404857 | node1 | 2026-08-18 15:36:07.405243 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:36:07.405295 | node1 | Tuesday 18 August 2026 15:36:07 +0000 (0:00:00.337) 0:01:21.304 ******** 2026-08-18 15:36:08.047973 | node1 | ok: [node1] 2026-08-18 15:36:08.048033 | node1 | ok: [node2] 2026-08-18 15:36:08.048049 | node1 | ok: [node3] 2026-08-18 15:36:08.048084 | node1 | 2026-08-18 15:36:08.048094 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:36:08.048103 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.641) 0:01:21.946 ******** 2026-08-18 15:36:08.121557 | node1 | skipping: [node1] 2026-08-18 15:36:08.121627 | node1 | skipping: [node2] 2026-08-18 15:36:08.121636 | node1 | skipping: [node3] 2026-08-18 15:36:08.121643 | node1 | 2026-08-18 15:36:08.121651 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:36:08.121658 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.073) 0:01:22.020 ******** 2026-08-18 15:36:08.612999 | node1 | ok: [node1] 2026-08-18 15:36:08.613039 | node1 | ok: [node2] 2026-08-18 15:36:08.613048 | node1 | ok: [node3] 2026-08-18 15:36:08.613357 | node1 | 2026-08-18 15:36:08.613370 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:36:08.613376 | node1 | Tuesday 18 August 2026 15:36:08 +0000 (0:00:00.490) 0:01:22.510 ******** 2026-08-18 15:36:09.214343 | node1 | ok: [node2] 2026-08-18 15:36:09.214425 | node1 | ok: [node1] 2026-08-18 15:36:09.214565 | node1 | ok: [node3] 2026-08-18 15:36:09.214668 | node1 | 2026-08-18 15:36:09.214783 | node1 | TASK [vexxhost.ceph.osd : Locate the cluster admin host] *********************** 2026-08-18 15:36:09.214894 | node1 | Tuesday 18 August 2026 15:36:09 +0000 (0:00:00.603) 0:01:23.114 ******** 2026-08-18 15:36:09.991005 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:36:09.991059 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:36:09.991068 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:36:09.991078 | node1 | 2026-08-18 15:36:09.991087 | node1 | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] ******* 2026-08-18 15:36:09.991096 | node1 | Tuesday 18 August 2026 15:36:09 +0000 (0:00:00.775) 0:01:23.889 ******** 2026-08-18 15:36:10.072178 | node1 | ok: [node1] 2026-08-18 15:36:10.072237 | node1 | ok: [node2] 2026-08-18 15:36:10.072331 | node1 | ok: [node3] 2026-08-18 15:36:10.072345 | node1 | 2026-08-18 15:36:10.072355 | node1 | TASK [vexxhost.ceph.osd : Set the admin mon config path] *********************** 2026-08-18 15:36:10.072364 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.081) 0:01:23.971 ******** 2026-08-18 15:36:10.158093 | node1 | ok: [node1] 2026-08-18 15:36:10.158138 | node1 | ok: [node2] 2026-08-18 15:36:10.158143 | node1 | ok: [node3] 2026-08-18 15:36:10.158148 | node1 | 2026-08-18 15:36:10.158152 | node1 | TASK [Register this OSD host] ************************************************** 2026-08-18 15:36:10.158237 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.086) 0:01:24.057 ******** 2026-08-18 15:36:10.264545 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:36:10.264601 | node1 | 2026-08-18 15:36:10.264645 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:36:10.264678 | node1 | Tuesday 18 August 2026 15:36:10 +0000 (0:00:00.106) 0:01:24.164 ******** 2026-08-18 15:36:12.486519 | node1 | ok: [node1] 2026-08-18 15:36:12.486620 | node1 | 2026-08-18 15:36:12.486740 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:36:12.486898 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:02.220) 0:01:26.384 ******** 2026-08-18 15:36:12.557911 | node1 | ok: [node1] 2026-08-18 15:36:12.558670 | node1 | ok: [node2] 2026-08-18 15:36:12.558710 | node1 | ok: [node3] 2026-08-18 15:36:12.558718 | node1 | 2026-08-18 15:36:12.558727 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:36:12.558734 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:00.073) 0:01:26.458 ******** 2026-08-18 15:36:12.638970 | node1 | ok: [node1] => { 2026-08-18 15:36:12.639004 | node1 | "changed": false, 2026-08-18 15:36:12.639017 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:12.639029 | node1 | } 2026-08-18 15:36:12.639040 | node1 | ok: [node2] => { 2026-08-18 15:36:12.639052 | node1 | "changed": false, 2026-08-18 15:36:12.639063 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:12.639074 | node1 | } 2026-08-18 15:36:12.639085 | node1 | ok: [node3] => { 2026-08-18 15:36:12.639096 | node1 | "changed": false, 2026-08-18 15:36:12.639128 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:12.639137 | node1 | } 2026-08-18 15:36:12.639330 | node1 | 2026-08-18 15:36:12.639656 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:36:12.639998 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:00.078) 0:01:26.536 ******** 2026-08-18 15:36:12.997252 | node1 | ok: [node1] 2026-08-18 15:36:12.997384 | node1 | ok: [node3] 2026-08-18 15:36:12.997533 | node1 | ok: [node2] 2026-08-18 15:36:12.997675 | node1 | 2026-08-18 15:36:12.998053 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:36:12.998092 | node1 | Tuesday 18 August 2026 15:36:12 +0000 (0:00:00.361) 0:01:26.897 ******** 2026-08-18 15:36:13.075366 | node1 | ok: [node1] 2026-08-18 15:36:13.075438 | node1 | ok: [node2] 2026-08-18 15:36:13.075549 | node1 | ok: [node3] 2026-08-18 15:36:13.075649 | node1 | 2026-08-18 15:36:13.075771 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:36:13.075918 | node1 | Tuesday 18 August 2026 15:36:13 +0000 (0:00:00.077) 0:01:26.975 ******** 2026-08-18 15:36:13.204483 | node1 | ok: [node1] 2026-08-18 15:36:13.204554 | node1 | ok: [node2] 2026-08-18 15:36:13.204728 | node1 | ok: [node3] 2026-08-18 15:36:13.204879 | node1 | 2026-08-18 15:36:13.205099 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:36:13.205278 | node1 | Tuesday 18 August 2026 15:36:13 +0000 (0:00:00.128) 0:01:27.104 ******** 2026-08-18 15:36:13.278406 | node1 | ok: [node1] => { 2026-08-18 15:36:13.278539 | node1 | "changed": false, 2026-08-18 15:36:13.278702 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:13.278882 | node1 | } 2026-08-18 15:36:13.279066 | node1 | ok: [node2] => { 2026-08-18 15:36:13.279198 | node1 | "changed": false, 2026-08-18 15:36:13.279370 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:13.279499 | node1 | } 2026-08-18 15:36:13.279671 | node1 | ok: [node3] => { 2026-08-18 15:36:13.279826 | node1 | "changed": false, 2026-08-18 15:36:13.280018 | node1 | "msg": "All assertions passed" 2026-08-18 15:36:13.280163 | node1 | } 2026-08-18 15:36:13.280305 | node1 | 2026-08-18 15:36:13.280477 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:36:13.280647 | node1 | Tuesday 18 August 2026 15:36:13 +0000 (0:00:00.072) 0:01:27.177 ******** 2026-08-18 15:36:16.094975 | node1 | ok: [node1] 2026-08-18 15:36:16.095040 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:16.095053 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:16.095066 | node1 | 2026-08-18 15:36:16.095078 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:36:16.095090 | node1 | Tuesday 18 August 2026 15:36:16 +0000 (0:00:02.816) 0:01:29.993 ******** 2026-08-18 15:36:16.186109 | node1 | skipping: [node1] 2026-08-18 15:36:16.201279 | node1 | skipping: [node2] 2026-08-18 15:36:16.201311 | node1 | skipping: [node3] 2026-08-18 15:36:16.201324 | node1 | 2026-08-18 15:36:16.201336 | node1 | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] ************** 2026-08-18 15:36:16.201348 | node1 | Tuesday 18 August 2026 15:36:16 +0000 (0:00:00.091) 0:01:30.084 ******** 2026-08-18 15:36:16.219741 | node1 | skipping: [node1] 2026-08-18 15:36:16.219797 | node1 | 2026-08-18 15:36:16.220002 | node1 | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] ********* 2026-08-18 15:36:16.220255 | node1 | Tuesday 18 August 2026 15:36:16 +0000 (0:00:00.035) 0:01:30.119 ******** 2026-08-18 15:36:18.171293 | node1 | ok: [node1] 2026-08-18 15:36:18.171571 | node1 | ok: [node2] 2026-08-18 15:36:18.171876 | node1 | ok: [node3] 2026-08-18 15:36:18.172202 | node1 | 2026-08-18 15:36:18.172444 | node1 | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ******** 2026-08-18 15:36:18.172691 | node1 | Tuesday 18 August 2026 15:36:18 +0000 (0:00:01.951) 0:01:32.071 ******** 2026-08-18 15:36:18.288345 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd0/data) 2026-08-18 15:36:18.288408 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd1/data) 2026-08-18 15:36:18.288522 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd0/data) 2026-08-18 15:36:18.288631 | node1 | skipping: [node1] => (item=/dev/ceph-node1-osd2/data) 2026-08-18 15:36:18.288737 | node1 | skipping: [node1] 2026-08-18 15:36:18.288847 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd1/data) 2026-08-18 15:36:18.289957 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd0/data) 2026-08-18 15:36:18.289974 | node1 | skipping: [node2] => (item=/dev/ceph-node2-osd2/data) 2026-08-18 15:36:18.289978 | node1 | skipping: [node2] 2026-08-18 15:36:18.289982 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd1/data) 2026-08-18 15:36:18.289986 | node1 | skipping: [node3] => (item=/dev/ceph-node3-osd2/data) 2026-08-18 15:36:18.289989 | node1 | skipping: [node3] 2026-08-18 15:36:18.289994 | node1 | 2026-08-18 15:36:18.289998 | node1 | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] *** 2026-08-18 15:36:18.290002 | node1 | Tuesday 18 August 2026 15:36:18 +0000 (0:00:00.117) 0:01:32.188 ******** 2026-08-18 15:36:20.442035 | node1 | ok: [node1] 2026-08-18 15:36:20.442096 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:20.442110 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:36:20.442122 | node1 | 2026-08-18 15:36:20.442140 | node1 | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] *** 2026-08-18 15:36:20.442377 | node1 | Tuesday 18 August 2026 15:36:20 +0000 (0:00:02.152) 0:01:34.341 ******** 2026-08-18 15:36:20.516602 | node1 | skipping: [node1] 2026-08-18 15:36:20.516821 | node1 | 2026-08-18 15:36:20.517175 | node1 | PLAY [Apply Ceph configuration] ************************************************ 2026-08-18 15:36:20.517415 | node1 | 2026-08-18 15:36:20.517681 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:36:20.517975 | node1 | Tuesday 18 August 2026 15:36:20 +0000 (0:00:00.075) 0:01:34.417 ******** 2026-08-18 15:36:22.529463 | node1 | ok: [node1] 2026-08-18 15:36:22.529692 | node1 | ok: [node2] 2026-08-18 15:36:22.529935 | node1 | ok: [node3] 2026-08-18 15:36:22.530210 | node1 | 2026-08-18 15:36:22.530485 | node1 | TASK [vexxhost.ceph.configure : Locate the cluster admin host] ***************** 2026-08-18 15:36:22.530737 | node1 | Tuesday 18 August 2026 15:36:22 +0000 (0:00:02.012) 0:01:36.430 ******** 2026-08-18 15:36:23.268134 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:36:23.268246 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:36:23.268336 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:36:23.268680 | node1 | 2026-08-18 15:36:23.269112 | node1 | TASK [vexxhost.ceph.configure : Select the admin host] ************************* 2026-08-18 15:36:23.269355 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.736) 0:01:37.167 ******** 2026-08-18 15:36:23.338508 | node1 | ok: [node1] 2026-08-18 15:36:23.338716 | node1 | ok: [node2] 2026-08-18 15:36:23.339065 | node1 | ok: [node3] 2026-08-18 15:36:23.339309 | node1 | 2026-08-18 15:36:23.339563 | node1 | TASK [vexxhost.ceph.configure : Set the admin mon config path] ***************** 2026-08-18 15:36:23.339994 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.071) 0:01:37.238 ******** 2026-08-18 15:36:23.404976 | node1 | ok: [node1] 2026-08-18 15:36:23.405116 | node1 | ok: [node2] 2026-08-18 15:36:23.405269 | node1 | ok: [node3] 2026-08-18 15:36:23.405421 | node1 | 2026-08-18 15:36:23.405590 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:36:23.405796 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.066) 0:01:37.305 ******** 2026-08-18 15:36:23.493727 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for node1, node2, node3 2026-08-18 15:36:23.494018 | node1 | 2026-08-18 15:36:23.494300 | node1 | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] ************** 2026-08-18 15:36:23.494574 | node1 | Tuesday 18 August 2026 15:36:23 +0000 (0:00:00.088) 0:01:37.393 ******** 2026-08-18 15:36:34.904034 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/standby_behaviour) 2026-08-18 15:36:34.904973 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY) 2026-08-18 15:36:34.904987 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS) 2026-08-18 15:36:34.905011 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI) 2026-08-18 15:36:34.905020 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING) 2026-08-18 15:36:34.906008 | node1 | ok: [node1] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS) 2026-08-18 15:36:34.906065 | node1 | 2026-08-18 15:36:34.906077 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:36:34.906169 | node1 | Tuesday 18 August 2026 15:36:34 +0000 (0:00:11.409) 0:01:48.803 ******** 2026-08-18 15:36:34.992715 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for node1, node2, node3 2026-08-18 15:36:34.993107 | node1 | 2026-08-18 15:36:34.993441 | node1 | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] *************** 2026-08-18 15:36:34.993752 | node1 | Tuesday 18 August 2026 15:36:34 +0000 (0:00:00.088) 0:01:48.892 ******** 2026-08-18 15:36:36.952974 | node1 | ok: [node1] => (item=ec_hdd_s3) 2026-08-18 15:36:36.953375 | node1 | 2026-08-18 15:36:36.953703 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:36:36.954073 | node1 | Tuesday 18 August 2026 15:36:36 +0000 (0:00:01.960) 0:01:50.852 ******** 2026-08-18 15:36:37.045000 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for node1, node2, node3 2026-08-18 15:36:37.045058 | node1 | 2026-08-18 15:36:37.045064 | node1 | TASK [vexxhost.ceph.configure : Configure CRUSH rules] ************************* 2026-08-18 15:36:37.045070 | node1 | Tuesday 18 August 2026 15:36:37 +0000 (0:00:00.091) 0:01:50.943 ******** 2026-08-18 15:36:42.528322 | node1 | ok: [node1] => (item=rep_hdd) 2026-08-18 15:36:42.528577 | node1 | ok: [node1] => (item=rep_lab) 2026-08-18 15:36:42.528843 | node1 | ok: [node1] => (item=ec_hdd_s3) 2026-08-18 15:36:42.529130 | node1 | 2026-08-18 15:36:42.529394 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:36:42.529649 | node1 | Tuesday 18 August 2026 15:36:42 +0000 (0:00:05.485) 0:01:56.428 ******** 2026-08-18 15:36:42.601709 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for node1, node2, node3 2026-08-18 15:36:42.601905 | node1 | 2026-08-18 15:36:42.602235 | node1 | TASK [vexxhost.ceph.configure : Configure pools] ******************************* 2026-08-18 15:36:42.602481 | node1 | Tuesday 18 August 2026 15:36:42 +0000 (0:00:00.073) 0:01:56.502 ******** 2026-08-18 15:37:20.440842 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.data) 2026-08-18 15:37:20.441108 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.index) 2026-08-18 15:37:20.441518 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.non-ec) 2026-08-18 15:37:20.441604 | node1 | ok: [node1] => (item=molecule-1.rgw.control) 2026-08-18 15:37:20.441855 | node1 | ok: [node1] => (item=molecule-1.rgw.log) 2026-08-18 15:37:20.442160 | node1 | ok: [node1] => (item=molecule-1.rgw.meta) 2026-08-18 15:37:20.442388 | node1 | 2026-08-18 15:37:20.442715 | node1 | TASK [vexxhost.ceph.configure : Configure CephX keys] ************************** 2026-08-18 15:37:20.443043 | node1 | Tuesday 18 August 2026 15:37:20 +0000 (0:00:37.838) 0:02:34.341 ******** 2026-08-18 15:37:20.493245 | node1 | skipping: [node1] 2026-08-18 15:37:20.493447 | node1 | skipping: [node2] 2026-08-18 15:37:20.493684 | node1 | skipping: [node3] 2026-08-18 15:37:20.493902 | node1 | 2026-08-18 15:37:20.494204 | node1 | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] ********** 2026-08-18 15:37:20.494444 | node1 | Tuesday 18 August 2026 15:37:20 +0000 (0:00:00.052) 0:02:34.393 ******** 2026-08-18 15:37:20.622096 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for node1, node2, node3 2026-08-18 15:37:20.622275 | node1 | 2026-08-18 15:37:20.622564 | node1 | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] *** 2026-08-18 15:37:20.622825 | node1 | Tuesday 18 August 2026 15:37:20 +0000 (0:00:00.128) 0:02:34.522 ******** 2026-08-18 15:37:22.412488 | node1 | ok: [node1] 2026-08-18 15:37:22.412567 | node1 | 2026-08-18 15:37:22.412672 | node1 | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] ********* 2026-08-18 15:37:22.412783 | node1 | Tuesday 18 August 2026 15:37:22 +0000 (0:00:01.790) 0:02:36.312 ******** 2026-08-18 15:37:24.274346 | node1 | ok: [node1] 2026-08-18 15:37:24.274423 | node1 | 2026-08-18 15:37:24.274527 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate] ***************** 2026-08-18 15:37:24.274640 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:01.858) 0:02:38.171 ******** 2026-08-18 15:37:24.314029 | node1 | skipping: [node1] 2026-08-18 15:37:24.314086 | node1 | 2026-08-18 15:37:24.314212 | node1 | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] ************* 2026-08-18 15:37:24.314326 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.043) 0:02:38.215 ******** 2026-08-18 15:37:24.357308 | node1 | skipping: [node1] 2026-08-18 15:37:24.357382 | node1 | 2026-08-18 15:37:24.357511 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:37:24.357625 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.040) 0:02:38.255 ******** 2026-08-18 15:37:24.392329 | node1 | skipping: [node1] 2026-08-18 15:37:24.392702 | node1 | 2026-08-18 15:37:24.392814 | node1 | TASK [vexxhost.ceph.configure : Create a self-signed certificate] ************** 2026-08-18 15:37:24.392980 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.037) 0:02:38.292 ******** 2026-08-18 15:37:24.437393 | node1 | skipping: [node1] 2026-08-18 15:37:24.437437 | node1 | 2026-08-18 15:37:24.437571 | node1 | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] ***************** 2026-08-18 15:37:24.437683 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.045) 0:02:38.338 ******** 2026-08-18 15:37:24.479696 | node1 | skipping: [node1] 2026-08-18 15:37:24.479949 | node1 | 2026-08-18 15:37:24.480243 | node1 | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] *** 2026-08-18 15:37:24.480497 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.041) 0:02:38.379 ******** 2026-08-18 15:37:24.542325 | node1 | skipping: [node1] => (item=ceph mgr module disable dashboard) 2026-08-18 15:37:24.542584 | node1 | skipping: [node1] => (item=ceph mgr module enable dashboard) 2026-08-18 15:37:24.542855 | node1 | skipping: [node1] => (item=ceph orch reconfig mgr) 2026-08-18 15:37:24.543133 | node1 | skipping: [node1] 2026-08-18 15:37:24.543369 | node1 | 2026-08-18 15:37:24.543590 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:37:24.543835 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.063) 0:02:38.442 ******** 2026-08-18 15:37:24.633999 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for node1, node2, node3 2026-08-18 15:37:24.634275 | node1 | 2026-08-18 15:37:24.634559 | node1 | TASK [vexxhost.ceph.configure : Configure dashboard users] ********************* 2026-08-18 15:37:24.634884 | node1 | Tuesday 18 August 2026 15:37:24 +0000 (0:00:00.091) 0:02:38.534 ******** 2026-08-18 15:37:31.830705 | node1 | ok: [node1] => (item=None) 2026-08-18 15:37:31.830908 | node1 | ok: [node1] => (item=None) 2026-08-18 15:37:31.831210 | node1 | ok: [node1 -> {{ ceph_configure_admin_host }}] 2026-08-18 15:37:31.831424 | node1 | 2026-08-18 15:37:31.831672 | node1 | PLAY [Deploy Ceph RADOS Gateways] ********************************************** 2026-08-18 15:37:31.831924 | node1 | 2026-08-18 15:37:31.832193 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:37:31.833099 | node1 | Tuesday 18 August 2026 15:37:31 +0000 (0:00:07.197) 0:02:45.731 ******** 2026-08-18 15:37:33.820075 | node1 | ok: [node2] 2026-08-18 15:37:33.820183 | node1 | ok: [node3] 2026-08-18 15:37:33.820197 | node1 | ok: [node1] 2026-08-18 15:37:33.820299 | node1 | 2026-08-18 15:37:33.820559 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:37:33.820803 | node1 | Tuesday 18 August 2026 15:37:33 +0000 (0:00:01.988) 0:02:47.719 ******** 2026-08-18 15:37:34.112594 | node1 | ok: [node1] 2026-08-18 15:37:34.112770 | node1 | ok: [node2] 2026-08-18 15:37:34.113046 | node1 | ok: [node3] 2026-08-18 15:37:34.113248 | node1 | 2026-08-18 15:37:34.113511 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:37:34.113739 | node1 | Tuesday 18 August 2026 15:37:34 +0000 (0:00:00.293) 0:02:48.013 ******** 2026-08-18 15:37:34.199746 | node1 | skipping: [node1] 2026-08-18 15:37:34.200012 | node1 | skipping: [node2] 2026-08-18 15:37:34.200278 | node1 | skipping: [node3] 2026-08-18 15:37:34.200499 | node1 | 2026-08-18 15:37:34.200751 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:37:34.201040 | node1 | Tuesday 18 August 2026 15:37:34 +0000 (0:00:00.087) 0:02:48.100 ******** 2026-08-18 15:37:34.519834 | node1 | ok: [node1] 2026-08-18 15:37:34.520074 | node1 | ok: [node2] 2026-08-18 15:37:34.520342 | node1 | ok: [node3] 2026-08-18 15:37:34.520556 | node1 | 2026-08-18 15:37:34.520820 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:37:34.521084 | node1 | Tuesday 18 August 2026 15:37:34 +0000 (0:00:00.319) 0:02:48.420 ******** 2026-08-18 15:37:34.636181 | node1 | ok: [node1] => { 2026-08-18 15:37:34.636500 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:37:34.636716 | node1 | } 2026-08-18 15:37:34.636972 | node1 | ok: [node2] => { 2026-08-18 15:37:34.637226 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:37:34.637454 | node1 | } 2026-08-18 15:37:34.637689 | node1 | ok: [node3] => { 2026-08-18 15:37:34.637967 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:37:34.638198 | node1 | } 2026-08-18 15:37:34.638416 | node1 | 2026-08-18 15:37:34.638662 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:37:34.638903 | node1 | Tuesday 18 August 2026 15:37:34 +0000 (0:00:00.116) 0:02:48.536 ******** 2026-08-18 15:37:35.053206 | node1 | ok: [node1] 2026-08-18 15:37:35.053433 | node1 | ok: [node2] 2026-08-18 15:37:35.053689 | node1 | ok: [node3] 2026-08-18 15:37:35.053921 | node1 | 2026-08-18 15:37:35.054209 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:37:35.054458 | node1 | Tuesday 18 August 2026 15:37:35 +0000 (0:00:00.416) 0:02:48.953 ******** 2026-08-18 15:37:35.160165 | node1 | skipping: [node1] 2026-08-18 15:37:35.160310 | node1 | skipping: [node2] 2026-08-18 15:37:35.160614 | node1 | skipping: [node3] 2026-08-18 15:37:35.160838 | node1 | 2026-08-18 15:37:35.161135 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:37:35.161374 | node1 | Tuesday 18 August 2026 15:37:35 +0000 (0:00:00.107) 0:02:49.060 ******** 2026-08-18 15:37:35.270566 | node1 | skipping: [node1] 2026-08-18 15:37:35.270792 | node1 | skipping: [node2] 2026-08-18 15:37:35.271092 | node1 | skipping: [node3] 2026-08-18 15:37:35.271327 | node1 | 2026-08-18 15:37:35.271600 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:37:35.271871 | node1 | Tuesday 18 August 2026 15:37:35 +0000 (0:00:00.110) 0:02:49.170 ******** 2026-08-18 15:37:35.576025 | node1 | ok: [node1] 2026-08-18 15:37:35.576080 | node1 | ok: [node2] 2026-08-18 15:37:35.576089 | node1 | ok: [node3] 2026-08-18 15:37:35.576099 | node1 | 2026-08-18 15:37:35.576108 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:37:35.576117 | node1 | Tuesday 18 August 2026 15:37:35 +0000 (0:00:00.303) 0:02:49.474 ******** 2026-08-18 15:37:36.550166 | node1 | ok: [node1] 2026-08-18 15:37:36.550232 | node1 | ok: [node3] 2026-08-18 15:37:36.550242 | node1 | ok: [node2] 2026-08-18 15:37:36.550257 | node1 | 2026-08-18 15:37:36.550520 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:37:36.550770 | node1 | Tuesday 18 August 2026 15:37:36 +0000 (0:00:00.975) 0:02:50.450 ******** 2026-08-18 15:37:36.791212 | node1 | ok: [node2] => { 2026-08-18 15:37:36.791463 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:37:36.791722 | node1 | } 2026-08-18 15:37:36.792010 | node1 | ok: [node1] => { 2026-08-18 15:37:36.792288 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:37:36.792541 | node1 | } 2026-08-18 15:37:36.792843 | node1 | ok: [node3] => { 2026-08-18 15:37:36.793154 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:37:36.793406 | node1 | } 2026-08-18 15:37:36.793611 | node1 | 2026-08-18 15:37:36.793858 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:37:36.794144 | node1 | Tuesday 18 August 2026 15:37:36 +0000 (0:00:00.241) 0:02:50.691 ******** 2026-08-18 15:37:37.374971 | node1 | ok: [node1] 2026-08-18 15:37:37.375211 | node1 | ok: [node2] 2026-08-18 15:37:37.375449 | node1 | ok: [node3] 2026-08-18 15:37:37.375670 | node1 | 2026-08-18 15:37:37.375923 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:37:37.376198 | node1 | Tuesday 18 August 2026 15:37:37 +0000 (0:00:00.584) 0:02:51.275 ******** 2026-08-18 15:37:39.666884 | node1 | ok: [node1] 2026-08-18 15:37:39.667140 | node1 | ok: [node3] 2026-08-18 15:37:39.667383 | node1 | ok: [node2] 2026-08-18 15:37:39.667609 | node1 | 2026-08-18 15:37:39.667866 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:37:39.668169 | node1 | Tuesday 18 August 2026 15:37:39 +0000 (0:00:02.291) 0:02:53.567 ******** 2026-08-18 15:37:39.736510 | node1 | skipping: [node1] 2026-08-18 15:37:39.736701 | node1 | skipping: [node2] 2026-08-18 15:37:39.736957 | node1 | skipping: [node3] 2026-08-18 15:37:39.737197 | node1 | 2026-08-18 15:37:39.737472 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:37:39.737716 | node1 | Tuesday 18 August 2026 15:37:39 +0000 (0:00:00.069) 0:02:53.637 ******** 2026-08-18 15:37:39.804803 | node1 | skipping: [node1] 2026-08-18 15:37:39.805053 | node1 | skipping: [node2] 2026-08-18 15:37:39.805284 | node1 | skipping: [node3] 2026-08-18 15:37:39.805562 | node1 | 2026-08-18 15:37:39.805808 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:37:39.806151 | node1 | Tuesday 18 August 2026 15:37:39 +0000 (0:00:00.067) 0:02:53.705 ******** 2026-08-18 15:37:39.872978 | node1 | skipping: [node1] 2026-08-18 15:37:39.873221 | node1 | skipping: [node2] 2026-08-18 15:37:39.873492 | node1 | skipping: [node3] 2026-08-18 15:37:39.873710 | node1 | 2026-08-18 15:37:39.874000 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:37:39.874237 | node1 | Tuesday 18 August 2026 15:37:39 +0000 (0:00:00.068) 0:02:53.773 ******** 2026-08-18 15:37:40.853875 | node1 | ok: [node1] 2026-08-18 15:37:40.854048 | node1 | ok: [node3] 2026-08-18 15:37:40.854235 | node1 | ok: [node2] 2026-08-18 15:37:40.854403 | node1 | 2026-08-18 15:37:40.854600 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:37:40.854784 | node1 | Tuesday 18 August 2026 15:37:40 +0000 (0:00:00.980) 0:02:54.754 ******** 2026-08-18 15:37:41.426037 | node1 | ok: [node1] 2026-08-18 15:37:41.426095 | node1 | ok: [node3] 2026-08-18 15:37:41.426105 | node1 | ok: [node2] 2026-08-18 15:37:41.426115 | node1 | 2026-08-18 15:37:41.426124 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:37:41.426226 | node1 | Tuesday 18 August 2026 15:37:41 +0000 (0:00:00.571) 0:02:55.325 ******** 2026-08-18 15:37:42.568078 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:37:42.568148 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:37:42.568165 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:37:42.568323 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:37:42.568476 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:37:42.568631 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:37:42.568786 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:37:42.568969 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:37:42.569118 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:37:42.569280 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:37:42.569442 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:37:42.569601 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:37:42.569763 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:37:42.570010 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:37:42.570173 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:37:42.570315 | node1 | 2026-08-18 15:37:42.570474 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:37:42.570629 | node1 | Tuesday 18 August 2026 15:37:42 +0000 (0:00:01.143) 0:02:56.468 ******** 2026-08-18 15:37:43.395543 | node1 | ok: [node1] 2026-08-18 15:37:43.395783 | node1 | ok: [node2] 2026-08-18 15:37:43.396103 | node1 | ok: [node3] 2026-08-18 15:37:43.396357 | node1 | 2026-08-18 15:37:43.396643 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:37:43.396950 | node1 | Tuesday 18 August 2026 15:37:43 +0000 (0:00:00.756) 0:02:57.225 ******** 2026-08-18 15:37:43.397223 | node1 | 2026-08-18 15:37:43.397518 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:37:43.397807 | node1 | Tuesday 18 August 2026 15:37:43 +0000 (0:00:00.045) 0:02:57.271 ******** 2026-08-18 15:37:43.398131 | node1 | 2026-08-18 15:37:43.398469 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:37:43.398756 | node1 | Tuesday 18 August 2026 15:37:43 +0000 (0:00:00.012) 0:02:57.283 ******** 2026-08-18 15:37:43.399061 | node1 | 2026-08-18 15:37:43.399340 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:37:43.399619 | node1 | Tuesday 18 August 2026 15:37:43 +0000 (0:00:00.012) 0:02:57.296 ******** 2026-08-18 15:37:43.915913 | node1 | ok: [node1] 2026-08-18 15:37:43.915958 | node1 | ok: [node2] 2026-08-18 15:37:43.915963 | node1 | ok: [node3] 2026-08-18 15:37:43.915967 | node1 | 2026-08-18 15:37:43.915971 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:37:43.915975 | node1 | Tuesday 18 August 2026 15:37:43 +0000 (0:00:00.518) 0:02:57.814 ******** 2026-08-18 15:37:44.199674 | node1 | ok: [node1] 2026-08-18 15:37:44.199903 | node1 | ok: [node2] 2026-08-18 15:37:44.200192 | node1 | ok: [node3] 2026-08-18 15:37:44.200418 | node1 | 2026-08-18 15:37:44.200679 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:37:44.200949 | node1 | Tuesday 18 August 2026 15:37:44 +0000 (0:00:00.285) 0:02:58.100 ******** 2026-08-18 15:37:44.304130 | node1 | ok: [node1] => { 2026-08-18 15:37:44.304374 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:37:44.304613 | node1 | } 2026-08-18 15:37:44.304856 | node1 | ok: [node2] => { 2026-08-18 15:37:44.305164 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:37:44.305390 | node1 | } 2026-08-18 15:37:44.305628 | node1 | ok: [node3] => { 2026-08-18 15:37:44.305883 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:37:44.306150 | node1 | } 2026-08-18 15:37:44.306363 | node1 | 2026-08-18 15:37:44.306665 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:37:44.306912 | node1 | Tuesday 18 August 2026 15:37:44 +0000 (0:00:00.104) 0:02:58.204 ******** 2026-08-18 15:37:44.791787 | node1 | ok: [node1] 2026-08-18 15:37:44.792139 | node1 | ok: [node2] 2026-08-18 15:37:44.792544 | node1 | ok: [node3] 2026-08-18 15:37:44.792903 | node1 | 2026-08-18 15:37:44.793330 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:37:44.793660 | node1 | Tuesday 18 August 2026 15:37:44 +0000 (0:00:00.487) 0:02:58.692 ******** 2026-08-18 15:37:48.154463 | node1 | ok: [node1] 2026-08-18 15:37:48.154658 | node1 | ok: [node2] 2026-08-18 15:37:48.154897 | node1 | ok: [node3] 2026-08-18 15:37:48.155283 | node1 | 2026-08-18 15:37:48.155596 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:37:48.155840 | node1 | Tuesday 18 August 2026 15:37:48 +0000 (0:00:03.362) 0:03:02.055 ******** 2026-08-18 15:37:49.161164 | node1 | ok: [node3] 2026-08-18 15:37:49.161385 | node1 | ok: [node1] 2026-08-18 15:37:49.161623 | node1 | ok: [node2] 2026-08-18 15:37:49.161844 | node1 | 2026-08-18 15:37:49.162136 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:37:49.162377 | node1 | Tuesday 18 August 2026 15:37:49 +0000 (0:00:01.006) 0:03:03.061 ******** 2026-08-18 15:37:49.436644 | node1 | ok: [node1] 2026-08-18 15:37:49.436903 | node1 | ok: [node2] 2026-08-18 15:37:49.437214 | node1 | ok: [node3] 2026-08-18 15:37:49.437457 | node1 | 2026-08-18 15:37:49.437737 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:37:49.438041 | node1 | Tuesday 18 August 2026 15:37:49 +0000 (0:00:00.275) 0:03:03.337 ******** 2026-08-18 15:37:50.025034 | node1 | ok: [node1] 2026-08-18 15:37:50.025094 | node1 | ok: [node2] 2026-08-18 15:37:50.025108 | node1 | ok: [node3] 2026-08-18 15:37:50.025120 | node1 | 2026-08-18 15:37:50.025177 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:37:50.025450 | node1 | Tuesday 18 August 2026 15:37:50 +0000 (0:00:00.587) 0:03:03.924 ******** 2026-08-18 15:37:50.747114 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:37:50.747168 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:37:50.747178 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:37:50.747187 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:37:50.748994 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:37:50.749064 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:37:50.749074 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:37:50.749083 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:37:50.749092 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:37:50.749101 | node1 | 2026-08-18 15:37:50.749110 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:37:50.749307 | node1 | Tuesday 18 August 2026 15:37:50 +0000 (0:00:00.722) 0:03:04.646 ******** 2026-08-18 15:37:51.324844 | node1 | ok: [node1] 2026-08-18 15:37:51.325200 | node1 | ok: [node2] 2026-08-18 15:37:51.325503 | node1 | ok: [node3] 2026-08-18 15:37:51.325809 | node1 | 2026-08-18 15:37:51.326237 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:37:51.326514 | node1 | Tuesday 18 August 2026 15:37:51 +0000 (0:00:00.578) 0:03:05.224 ******** 2026-08-18 15:37:51.944920 | node1 | ok: [node1] 2026-08-18 15:37:51.945177 | node1 | ok: [node2] 2026-08-18 15:37:51.945421 | node1 | ok: [node3] 2026-08-18 15:37:51.945649 | node1 | 2026-08-18 15:37:51.945910 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:37:51.946204 | node1 | Tuesday 18 August 2026 15:37:51 +0000 (0:00:00.578) 0:03:05.803 ******** 2026-08-18 15:37:51.946428 | node1 | 2026-08-18 15:37:51.946683 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:37:51.946955 | node1 | Tuesday 18 August 2026 15:37:51 +0000 (0:00:00.015) 0:03:05.818 ******** 2026-08-18 15:37:51.947193 | node1 | 2026-08-18 15:37:51.947449 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:37:51.947703 | node1 | Tuesday 18 August 2026 15:37:51 +0000 (0:00:00.013) 0:03:05.832 ******** 2026-08-18 15:37:51.947925 | node1 | 2026-08-18 15:37:51.948204 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:37:51.948481 | node1 | Tuesday 18 August 2026 15:37:51 +0000 (0:00:00.013) 0:03:05.845 ******** 2026-08-18 15:37:52.443548 | node1 | ok: [node1] 2026-08-18 15:37:52.443777 | node1 | ok: [node2] 2026-08-18 15:37:52.444084 | node1 | ok: [node3] 2026-08-18 15:37:52.444314 | node1 | 2026-08-18 15:37:52.444654 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:37:52.445993 | node1 | Tuesday 18 August 2026 15:37:52 +0000 (0:00:00.498) 0:03:06.343 ******** 2026-08-18 15:37:52.524042 | node1 | ok: [node1] => { 2026-08-18 15:37:52.524101 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:37:52.524158 | node1 | } 2026-08-18 15:37:52.524403 | node1 | ok: [node2] => { 2026-08-18 15:37:52.524702 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:37:52.524966 | node1 | } 2026-08-18 15:37:52.525213 | node1 | ok: [node3] => { 2026-08-18 15:37:52.525462 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:37:52.525687 | node1 | } 2026-08-18 15:37:52.525907 | node1 | 2026-08-18 15:37:52.526203 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:37:52.526440 | node1 | Tuesday 18 August 2026 15:37:52 +0000 (0:00:00.080) 0:03:06.424 ******** 2026-08-18 15:37:52.910039 | node1 | ok: [node1] 2026-08-18 15:37:52.910232 | node1 | ok: [node3] 2026-08-18 15:37:52.910465 | node1 | ok: [node2] 2026-08-18 15:37:52.910685 | node1 | 2026-08-18 15:37:52.910964 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:37:52.911216 | node1 | Tuesday 18 August 2026 15:37:52 +0000 (0:00:00.385) 0:03:06.810 ******** 2026-08-18 15:37:52.945117 | node1 | skipping: [node1] 2026-08-18 15:37:52.996090 | node1 | skipping: [node2] 2026-08-18 15:37:52.996152 | node1 | skipping: [node3] 2026-08-18 15:37:52.996196 | node1 | 2026-08-18 15:37:52.996788 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:37:52.996833 | node1 | Tuesday 18 August 2026 15:37:52 +0000 (0:00:00.086) 0:03:06.896 ******** 2026-08-18 15:37:53.080116 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:37:53.080172 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:37:53.080182 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:37:53.080192 | node1 | 2026-08-18 15:37:53.080204 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:37:53.080223 | node1 | Tuesday 18 August 2026 15:37:53 +0000 (0:00:00.082) 0:03:06.978 ******** 2026-08-18 15:37:54.043094 | node1 | ok: [node1] 2026-08-18 15:37:54.043152 | node1 | ok: [node3] 2026-08-18 15:37:54.044030 | node1 | ok: [node2] 2026-08-18 15:37:54.044092 | node1 | 2026-08-18 15:37:54.044103 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:37:54.044113 | node1 | Tuesday 18 August 2026 15:37:54 +0000 (0:00:00.964) 0:03:07.943 ******** 2026-08-18 15:37:54.855390 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:37:54.855451 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:37:54.855561 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:37:54.855673 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:37:54.855787 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:37:54.855898 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:37:54.856274 | node1 | 2026-08-18 15:37:54.856311 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:37:54.856317 | node1 | Tuesday 18 August 2026 15:37:54 +0000 (0:00:00.812) 0:03:08.755 ******** 2026-08-18 15:37:55.139089 | node1 | ok: [node1] 2026-08-18 15:37:55.139137 | node1 | ok: [node2] 2026-08-18 15:37:55.140025 | node1 | ok: [node3] 2026-08-18 15:37:55.140074 | node1 | 2026-08-18 15:37:55.140085 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:37:55.140095 | node1 | Tuesday 18 August 2026 15:37:55 +0000 (0:00:00.283) 0:03:09.038 ******** 2026-08-18 15:37:55.465693 | node1 | ok: [node1] 2026-08-18 15:37:55.465970 | node1 | ok: [node2] 2026-08-18 15:37:55.466238 | node1 | ok: [node3] 2026-08-18 15:37:55.466461 | node1 | 2026-08-18 15:37:55.466771 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:37:55.467250 | node1 | Tuesday 18 August 2026 15:37:55 +0000 (0:00:00.324) 0:03:09.362 ******** 2026-08-18 15:37:56.029344 | node1 | ok: [node1] 2026-08-18 15:37:56.029399 | node1 | ok: [node3] 2026-08-18 15:37:56.029504 | node1 | ok: [node2] 2026-08-18 15:37:56.029621 | node1 | 2026-08-18 15:37:56.029741 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:37:56.029864 | node1 | Tuesday 18 August 2026 15:37:56 +0000 (0:00:00.565) 0:03:09.928 ******** 2026-08-18 15:37:56.096986 | node1 | skipping: [node1] 2026-08-18 15:37:56.097131 | node1 | skipping: [node2] 2026-08-18 15:37:56.097849 | node1 | skipping: [node3] 2026-08-18 15:37:56.097877 | node1 | 2026-08-18 15:37:56.097891 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:37:56.097898 | node1 | Tuesday 18 August 2026 15:37:56 +0000 (0:00:00.069) 0:03:09.997 ******** 2026-08-18 15:37:56.565052 | node1 | ok: [node1] 2026-08-18 15:37:56.565104 | node1 | ok: [node3] 2026-08-18 15:37:56.565114 | node1 | ok: [node2] 2026-08-18 15:37:56.565124 | node1 | 2026-08-18 15:37:56.565133 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:37:56.565142 | node1 | Tuesday 18 August 2026 15:37:56 +0000 (0:00:00.465) 0:03:10.463 ******** 2026-08-18 15:37:57.155017 | node1 | ok: [node1] 2026-08-18 15:37:57.155107 | node1 | ok: [node3] 2026-08-18 15:37:57.155372 | node1 | ok: [node2] 2026-08-18 15:37:57.155558 | node1 | 2026-08-18 15:37:57.155915 | node1 | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] *********************** 2026-08-18 15:37:57.156320 | node1 | Tuesday 18 August 2026 15:37:57 +0000 (0:00:00.591) 0:03:11.055 ******** 2026-08-18 15:37:57.915982 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:37:57.916033 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:37:57.916044 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:37:57.916053 | node1 | 2026-08-18 15:37:57.916063 | node1 | TASK [vexxhost.ceph.rgw : Select the admin host] ******************************* 2026-08-18 15:37:57.916072 | node1 | Tuesday 18 August 2026 15:37:57 +0000 (0:00:00.759) 0:03:11.814 ******** 2026-08-18 15:37:57.998132 | node1 | ok: [node1] 2026-08-18 15:37:57.998183 | node1 | ok: [node2] 2026-08-18 15:37:57.998194 | node1 | ok: [node3] 2026-08-18 15:37:57.998204 | node1 | 2026-08-18 15:37:57.998214 | node1 | TASK [vexxhost.ceph.rgw : Set the admin mon config path] *********************** 2026-08-18 15:37:57.998224 | node1 | Tuesday 18 August 2026 15:37:57 +0000 (0:00:00.082) 0:03:11.896 ******** 2026-08-18 15:37:58.079031 | node1 | ok: [node1] 2026-08-18 15:37:58.079082 | node1 | ok: [node2] 2026-08-18 15:37:58.079092 | node1 | ok: [node3] 2026-08-18 15:37:58.079101 | node1 | 2026-08-18 15:37:58.079176 | node1 | TASK [Register this RGW host] ************************************************** 2026-08-18 15:37:58.079421 | node1 | Tuesday 18 August 2026 15:37:58 +0000 (0:00:00.081) 0:03:11.978 ******** 2026-08-18 15:37:58.201065 | node1 | included: vexxhost.ceph.cephadm_host for node1, node2, node3 2026-08-18 15:37:58.201281 | node1 | 2026-08-18 15:37:58.201541 | node1 | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] ***************** 2026-08-18 15:37:58.201791 | node1 | Tuesday 18 August 2026 15:37:58 +0000 (0:00:00.123) 0:03:12.101 ******** 2026-08-18 15:37:59.860741 | node1 | ok: [node1] 2026-08-18 15:37:59.860971 | node1 | 2026-08-18 15:37:59.861293 | node1 | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] *** 2026-08-18 15:37:59.861547 | node1 | Tuesday 18 August 2026 15:37:59 +0000 (0:00:01.659) 0:03:13.761 ******** 2026-08-18 15:37:59.971237 | node1 | ok: [node1] 2026-08-18 15:37:59.971406 | node1 | ok: [node2] 2026-08-18 15:37:59.971733 | node1 | ok: [node3] 2026-08-18 15:37:59.971984 | node1 | 2026-08-18 15:37:59.972270 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ****** 2026-08-18 15:37:59.972523 | node1 | Tuesday 18 August 2026 15:37:59 +0000 (0:00:00.110) 0:03:13.871 ******** 2026-08-18 15:38:00.047591 | node1 | ok: [node1] => { 2026-08-18 15:38:00.047825 | node1 | "changed": false, 2026-08-18 15:38:00.048156 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.048421 | node1 | } 2026-08-18 15:38:00.048691 | node1 | ok: [node2] => { 2026-08-18 15:38:00.049023 | node1 | "changed": false, 2026-08-18 15:38:00.049276 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.049519 | node1 | } 2026-08-18 15:38:00.049776 | node1 | ok: [node3] => { 2026-08-18 15:38:00.050075 | node1 | "changed": false, 2026-08-18 15:38:00.050325 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.050667 | node1 | } 2026-08-18 15:38:00.051143 | node1 | 2026-08-18 15:38:00.051555 | node1 | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] *** 2026-08-18 15:38:00.051921 | node1 | Tuesday 18 August 2026 15:38:00 +0000 (0:00:00.076) 0:03:13.947 ******** 2026-08-18 15:38:00.395396 | node1 | ok: [node1] 2026-08-18 15:38:00.395583 | node1 | ok: [node3] 2026-08-18 15:38:00.395816 | node1 | ok: [node2] 2026-08-18 15:38:00.396081 | node1 | 2026-08-18 15:38:00.396377 | node1 | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] *** 2026-08-18 15:38:00.396627 | node1 | Tuesday 18 August 2026 15:38:00 +0000 (0:00:00.348) 0:03:14.295 ******** 2026-08-18 15:38:00.469827 | node1 | ok: [node1] 2026-08-18 15:38:00.470090 | node1 | ok: [node2] 2026-08-18 15:38:00.470328 | node1 | ok: [node3] 2026-08-18 15:38:00.470552 | node1 | 2026-08-18 15:38:00.470819 | node1 | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] *** 2026-08-18 15:38:00.471111 | node1 | Tuesday 18 August 2026 15:38:00 +0000 (0:00:00.074) 0:03:14.370 ******** 2026-08-18 15:38:00.585232 | node1 | ok: [node1] 2026-08-18 15:38:00.585439 | node1 | ok: [node2] 2026-08-18 15:38:00.585688 | node1 | ok: [node3] 2026-08-18 15:38:00.585971 | node1 | 2026-08-18 15:38:00.586262 | node1 | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] *** 2026-08-18 15:38:00.586515 | node1 | Tuesday 18 August 2026 15:38:00 +0000 (0:00:00.115) 0:03:14.485 ******** 2026-08-18 15:38:00.660221 | node1 | ok: [node1] => { 2026-08-18 15:38:00.660419 | node1 | "changed": false, 2026-08-18 15:38:00.660663 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.660896 | node1 | } 2026-08-18 15:38:00.661186 | node1 | ok: [node2] => { 2026-08-18 15:38:00.661444 | node1 | "changed": false, 2026-08-18 15:38:00.661691 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.661958 | node1 | } 2026-08-18 15:38:00.662241 | node1 | ok: [node3] => { 2026-08-18 15:38:00.662518 | node1 | "changed": false, 2026-08-18 15:38:00.662775 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:00.663093 | node1 | } 2026-08-18 15:38:00.663363 | node1 | 2026-08-18 15:38:00.663633 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] ***************** 2026-08-18 15:38:00.663895 | node1 | Tuesday 18 August 2026 15:38:00 +0000 (0:00:00.074) 0:03:14.560 ******** 2026-08-18 15:38:02.445965 | node1 | ok: [node1] 2026-08-18 15:38:02.446009 | node1 | ok: [node2 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:38:02.446016 | node1 | ok: [node3 -> node1({{ nodepool.private_ipv4 }})] 2026-08-18 15:38:02.446022 | node1 | 2026-08-18 15:38:02.446027 | node1 | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] **** 2026-08-18 15:38:02.446033 | node1 | Tuesday 18 August 2026 15:38:02 +0000 (0:00:01.783) 0:03:16.344 ******** 2026-08-18 15:38:02.545048 | node1 | skipping: [node1] 2026-08-18 15:38:02.545315 | node1 | skipping: [node2] 2026-08-18 15:38:02.545580 | node1 | skipping: [node3] 2026-08-18 15:38:02.545829 | node1 | 2026-08-18 15:38:02.546147 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] **** 2026-08-18 15:38:02.546415 | node1 | Tuesday 18 August 2026 15:38:02 +0000 (0:00:00.101) 0:03:16.445 ******** 2026-08-18 15:38:02.601900 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for node1 2026-08-18 15:38:02.602155 | node1 | 2026-08-18 15:38:02.602416 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW realms] ******************************** 2026-08-18 15:38:02.602669 | node1 | Tuesday 18 August 2026 15:38:02 +0000 (0:00:00.056) 0:03:16.502 ******** 2026-08-18 15:38:03.980857 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:38:03.981123 | node1 | 2026-08-18 15:38:03.981381 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] **************************** 2026-08-18 15:38:03.981628 | node1 | Tuesday 18 August 2026 15:38:03 +0000 (0:00:01.378) 0:03:17.880 ******** 2026-08-18 15:38:06.526085 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:38:06.526196 | node1 | 2026-08-18 15:38:06.526660 | node1 | TASK [vexxhost.ceph.rgw : Configure RGW zones] ********************************* 2026-08-18 15:38:06.526699 | node1 | Tuesday 18 August 2026 15:38:06 +0000 (0:00:02.545) 0:03:20.426 ******** 2026-08-18 15:38:10.002804 | node1 | ok: [node1] => (item=None) 2026-08-18 15:38:10.002872 | node1 | ok: [node1 -> {{ ceph_rgw_admin_host }}] 2026-08-18 15:38:10.002886 | node1 | 2026-08-18 15:38:10.002899 | node1 | TASK [vexxhost.ceph.rgw : Commit the RGW period] ******************************* 2026-08-18 15:38:10.002911 | node1 | Tuesday 18 August 2026 15:38:09 +0000 (0:00:03.475) 0:03:23.901 ******** 2026-08-18 15:38:10.067992 | node1 | skipping: [node1] 2026-08-18 15:38:10.068036 | node1 | 2026-08-18 15:38:10.068054 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:38:10.068306 | node1 | Tuesday 18 August 2026 15:38:10 +0000 (0:00:00.065) 0:03:23.967 ******** 2026-08-18 15:38:10.125130 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for node1 2026-08-18 15:38:10.125165 | node1 | 2026-08-18 15:38:10.125178 | node1 | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ****************** 2026-08-18 15:38:10.125190 | node1 | Tuesday 18 August 2026 15:38:10 +0000 (0:00:00.057) 0:03:24.024 ******** 2026-08-18 15:38:11.867403 | node1 | ok: [node1] 2026-08-18 15:38:11.867489 | node1 | 2026-08-18 15:38:11.867582 | node1 | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] ************* 2026-08-18 15:38:11.867676 | node1 | Tuesday 18 August 2026 15:38:11 +0000 (0:00:01.743) 0:03:25.768 ******** 2026-08-18 15:38:11.921081 | node1 | ok: [node1] 2026-08-18 15:38:11.921141 | node1 | 2026-08-18 15:38:11.921156 | node1 | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] ************************* 2026-08-18 15:38:11.921174 | node1 | Tuesday 18 August 2026 15:38:11 +0000 (0:00:00.053) 0:03:25.821 ******** 2026-08-18 15:38:13.819519 | node1 | ok: [node1] => (item=molecule) 2026-08-18 15:38:13.819582 | node1 | 2026-08-18 15:38:13.819596 | node1 | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] *** 2026-08-18 15:38:13.819609 | node1 | Tuesday 18 August 2026 15:38:13 +0000 (0:00:01.897) 0:03:27.718 ******** 2026-08-18 15:38:13.888802 | node1 | skipping: [node1] => (item=rgw.molecule) 2026-08-18 15:38:13.888861 | node1 | skipping: [node1] 2026-08-18 15:38:13.888875 | node1 | 2026-08-18 15:38:13.888887 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone / zonegroup / pools] ********* 2026-08-18 15:38:13.888899 | node1 | Tuesday 18 August 2026 15:38:13 +0000 (0:00:00.069) 0:03:27.788 ******** 2026-08-18 15:38:13.961341 | node1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/cleanup.yml for node1 2026-08-18 15:38:13.961423 | node1 | 2026-08-18 15:38:13.961437 | node1 | TASK [vexxhost.ceph.rgw : List RGW zones] ************************************** 2026-08-18 15:38:13.961450 | node1 | Tuesday 18 August 2026 15:38:13 +0000 (0:00:00.072) 0:03:27.860 ******** 2026-08-18 15:38:15.233331 | node1 | ok: [node1] 2026-08-18 15:38:15.233396 | node1 | 2026-08-18 15:38:15.233530 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zonegroup] ************************ 2026-08-18 15:38:15.233639 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:01.272) 0:03:29.133 ******** 2026-08-18 15:38:15.281579 | node1 | skipping: [node1] 2026-08-18 15:38:15.281641 | node1 | 2026-08-18 15:38:15.281654 | node1 | TASK [vexxhost.ceph.rgw : Remove the default zone] ***************************** 2026-08-18 15:38:15.281667 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.047) 0:03:29.180 ******** 2026-08-18 15:38:15.329462 | node1 | skipping: [node1] 2026-08-18 15:38:15.329525 | node1 | 2026-08-18 15:38:15.329539 | node1 | TASK [vexxhost.ceph.rgw : Get the current pool deletion setting] *************** 2026-08-18 15:38:15.329551 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.048) 0:03:29.228 ******** 2026-08-18 15:38:15.382031 | node1 | skipping: [node1] 2026-08-18 15:38:15.382072 | node1 | 2026-08-18 15:38:15.382647 | node1 | TASK [vexxhost.ceph.rgw : Allow pool deletion] ********************************* 2026-08-18 15:38:15.382708 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.052) 0:03:29.281 ******** 2026-08-18 15:38:15.434916 | node1 | skipping: [node1] 2026-08-18 15:38:15.434976 | node1 | 2026-08-18 15:38:15.434981 | node1 | TASK [vexxhost.ceph.rgw : Remove the default RGW pools] ************************ 2026-08-18 15:38:15.434986 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.053) 0:03:29.334 ******** 2026-08-18 15:38:15.511430 | node1 | skipping: [node1] => (item=default.rgw.control) 2026-08-18 15:38:15.511531 | node1 | skipping: [node1] => (item=default.rgw.log) 2026-08-18 15:38:15.511743 | node1 | skipping: [node1] => (item=default.rgw.meta) 2026-08-18 15:38:15.511796 | node1 | skipping: [node1] 2026-08-18 15:38:15.511988 | node1 | 2026-08-18 15:38:15.512016 | node1 | TASK [vexxhost.ceph.rgw : Restore the configured pool deletion setting] ******** 2026-08-18 15:38:15.512195 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.076) 0:03:29.411 ******** 2026-08-18 15:38:15.558369 | node1 | skipping: [node1] 2026-08-18 15:38:15.558430 | node1 | 2026-08-18 15:38:15.558525 | node1 | TASK [vexxhost.ceph.rgw : Remove the temporary pool deletion setting] ********** 2026-08-18 15:38:15.558658 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.047) 0:03:29.458 ******** 2026-08-18 15:38:15.658075 | node1 | skipping: [node1] 2026-08-18 15:38:15.658149 | node1 | 2026-08-18 15:38:15.658236 | node1 | PLAY [Deploy Ceph monitoring stack] ******************************************** 2026-08-18 15:38:15.658602 | node1 | 2026-08-18 15:38:15.658628 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:38:15.658633 | node1 | Tuesday 18 August 2026 15:38:15 +0000 (0:00:00.100) 0:03:29.559 ******** 2026-08-18 15:38:17.709098 | node1 | ok: [node3] 2026-08-18 15:38:17.709163 | node1 | ok: [node1] 2026-08-18 15:38:17.709183 | node1 | ok: [node2] 2026-08-18 15:38:17.709880 | node1 | 2026-08-18 15:38:17.709974 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:38:17.710008 | node1 | Tuesday 18 August 2026 15:38:17 +0000 (0:00:02.049) 0:03:31.608 ******** 2026-08-18 15:38:18.010095 | node1 | ok: [node1] 2026-08-18 15:38:18.010168 | node1 | ok: [node2] 2026-08-18 15:38:18.010274 | node1 | ok: [node3] 2026-08-18 15:38:18.010376 | node1 | 2026-08-18 15:38:18.010487 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:38:18.010609 | node1 | Tuesday 18 August 2026 15:38:18 +0000 (0:00:00.301) 0:03:31.909 ******** 2026-08-18 15:38:18.099983 | node1 | skipping: [node1] 2026-08-18 15:38:18.100015 | node1 | skipping: [node2] 2026-08-18 15:38:18.100024 | node1 | skipping: [node3] 2026-08-18 15:38:18.100033 | node1 | 2026-08-18 15:38:18.100043 | node1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-18 15:38:18.100051 | node1 | Tuesday 18 August 2026 15:38:18 +0000 (0:00:00.089) 0:03:31.998 ******** 2026-08-18 15:38:18.407508 | node1 | ok: [node1] 2026-08-18 15:38:18.407564 | node1 | ok: [node2] 2026-08-18 15:38:18.407572 | node1 | ok: [node3] 2026-08-18 15:38:18.407579 | node1 | 2026-08-18 15:38:18.407586 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:38:18.407594 | node1 | Tuesday 18 August 2026 15:38:18 +0000 (0:00:00.308) 0:03:32.307 ******** 2026-08-18 15:38:18.511001 | node1 | ok: [node1] => { 2026-08-18 15:38:18.511059 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:38:18.511069 | node1 | } 2026-08-18 15:38:18.511078 | node1 | ok: [node2] => { 2026-08-18 15:38:18.511086 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:38:18.511095 | node1 | } 2026-08-18 15:38:18.511103 | node1 | ok: [node3] => { 2026-08-18 15:38:18.511111 | node1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-18 15:38:18.511120 | node1 | } 2026-08-18 15:38:18.511184 | node1 | 2026-08-18 15:38:18.511503 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:38:18.511812 | node1 | Tuesday 18 August 2026 15:38:18 +0000 (0:00:00.101) 0:03:32.408 ******** 2026-08-18 15:38:18.931786 | node1 | ok: [node1] 2026-08-18 15:38:18.932196 | node1 | ok: [node2] 2026-08-18 15:38:18.932517 | node1 | ok: [node3] 2026-08-18 15:38:18.932881 | node1 | 2026-08-18 15:38:18.933314 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:38:18.933680 | node1 | Tuesday 18 August 2026 15:38:18 +0000 (0:00:00.423) 0:03:32.832 ******** 2026-08-18 15:38:19.036492 | node1 | skipping: [node1] 2026-08-18 15:38:19.036825 | node1 | skipping: [node2] 2026-08-18 15:38:19.037169 | node1 | skipping: [node3] 2026-08-18 15:38:19.037468 | node1 | 2026-08-18 15:38:19.037782 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:38:19.038192 | node1 | Tuesday 18 August 2026 15:38:19 +0000 (0:00:00.104) 0:03:32.936 ******** 2026-08-18 15:38:19.145743 | node1 | skipping: [node1] 2026-08-18 15:38:19.146173 | node1 | skipping: [node2] 2026-08-18 15:38:19.146493 | node1 | skipping: [node3] 2026-08-18 15:38:19.146782 | node1 | 2026-08-18 15:38:19.147142 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:38:19.147465 | node1 | Tuesday 18 August 2026 15:38:19 +0000 (0:00:00.108) 0:03:33.045 ******** 2026-08-18 15:38:19.440323 | node1 | ok: [node1] 2026-08-18 15:38:19.440684 | node1 | ok: [node2] 2026-08-18 15:38:19.441019 | node1 | ok: [node3] 2026-08-18 15:38:19.441320 | node1 | 2026-08-18 15:38:19.441641 | node1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-18 15:38:19.441982 | node1 | Tuesday 18 August 2026 15:38:19 +0000 (0:00:00.295) 0:03:33.340 ******** 2026-08-18 15:38:20.416503 | node1 | ok: [node1] 2026-08-18 15:38:20.416969 | node1 | ok: [node3] 2026-08-18 15:38:20.417323 | node1 | ok: [node2] 2026-08-18 15:38:20.417633 | node1 | 2026-08-18 15:38:20.418023 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:38:20.418371 | node1 | Tuesday 18 August 2026 15:38:20 +0000 (0:00:00.976) 0:03:34.317 ******** 2026-08-18 15:38:20.698124 | node1 | ok: [node1] => { 2026-08-18 15:38:20.698544 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:38:20.698852 | node1 | } 2026-08-18 15:38:20.699239 | node1 | ok: [node2] => { 2026-08-18 15:38:20.699601 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:38:20.700973 | node1 | } 2026-08-18 15:38:20.700992 | node1 | ok: [node3] => { 2026-08-18 15:38:20.700998 | node1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-18 15:38:20.701003 | node1 | } 2026-08-18 15:38:20.701055 | node1 | 2026-08-18 15:38:20.701256 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:38:20.701455 | node1 | Tuesday 18 August 2026 15:38:20 +0000 (0:00:00.281) 0:03:34.598 ******** 2026-08-18 15:38:21.337442 | node1 | ok: [node3] 2026-08-18 15:38:21.337682 | node1 | ok: [node1] 2026-08-18 15:38:21.337874 | node1 | ok: [node2] 2026-08-18 15:38:21.338099 | node1 | 2026-08-18 15:38:21.338321 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:38:21.338529 | node1 | Tuesday 18 August 2026 15:38:21 +0000 (0:00:00.639) 0:03:35.238 ******** 2026-08-18 15:38:23.624740 | node1 | ok: [node3] 2026-08-18 15:38:23.625186 | node1 | ok: [node1] 2026-08-18 15:38:23.625671 | node1 | ok: [node2] 2026-08-18 15:38:23.626008 | node1 | 2026-08-18 15:38:23.626346 | node1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-18 15:38:23.626663 | node1 | Tuesday 18 August 2026 15:38:23 +0000 (0:00:02.287) 0:03:37.525 ******** 2026-08-18 15:38:23.679160 | node1 | skipping: [node1] 2026-08-18 15:38:23.679519 | node1 | skipping: [node2] 2026-08-18 15:38:23.679822 | node1 | skipping: [node3] 2026-08-18 15:38:23.680138 | node1 | 2026-08-18 15:38:23.680478 | node1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-18 15:38:23.680840 | node1 | Tuesday 18 August 2026 15:38:23 +0000 (0:00:00.054) 0:03:37.579 ******** 2026-08-18 15:38:23.715976 | node1 | skipping: [node1] 2026-08-18 15:38:23.748081 | node1 | skipping: [node2] 2026-08-18 15:38:23.748146 | node1 | skipping: [node3] 2026-08-18 15:38:23.748157 | node1 | 2026-08-18 15:38:23.748166 | node1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-18 15:38:23.748200 | node1 | Tuesday 18 August 2026 15:38:23 +0000 (0:00:00.067) 0:03:37.647 ******** 2026-08-18 15:38:23.810997 | node1 | skipping: [node1] 2026-08-18 15:38:23.811233 | node1 | skipping: [node2] 2026-08-18 15:38:23.811471 | node1 | skipping: [node3] 2026-08-18 15:38:23.811695 | node1 | 2026-08-18 15:38:23.812063 | node1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-18 15:38:23.812458 | node1 | Tuesday 18 August 2026 15:38:23 +0000 (0:00:00.063) 0:03:37.711 ******** 2026-08-18 15:38:24.841182 | node1 | ok: [node1] 2026-08-18 15:38:24.841401 | node1 | ok: [node2] 2026-08-18 15:38:24.841639 | node1 | ok: [node3] 2026-08-18 15:38:24.841900 | node1 | 2026-08-18 15:38:24.842196 | node1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-18 15:38:24.842451 | node1 | Tuesday 18 August 2026 15:38:24 +0000 (0:00:01.030) 0:03:38.741 ******** 2026-08-18 15:38:25.412826 | node1 | ok: [node1] 2026-08-18 15:38:25.413097 | node1 | ok: [node2] 2026-08-18 15:38:25.413332 | node1 | ok: [node3] 2026-08-18 15:38:25.413556 | node1 | 2026-08-18 15:38:25.413833 | node1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-18 15:38:25.414151 | node1 | Tuesday 18 August 2026 15:38:25 +0000 (0:00:00.571) 0:03:39.313 ******** 2026-08-18 15:38:26.570965 | node1 | ok: [node2] => (item={'path': '/etc/containerd'}) 2026-08-18 15:38:26.571242 | node1 | ok: [node1] => (item={'path': '/etc/containerd'}) 2026-08-18 15:38:26.571514 | node1 | ok: [node3] => (item={'path': '/etc/containerd'}) 2026-08-18 15:38:26.571799 | node1 | ok: [node1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:38:26.572130 | node1 | ok: [node2] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:38:26.572406 | node1 | ok: [node3] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-18 15:38:26.572664 | node1 | ok: [node1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:38:26.572968 | node1 | ok: [node3] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:38:26.573225 | node1 | ok: [node2] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-18 15:38:26.573493 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:38:26.573749 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:38:26.574038 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-18 15:38:26.574294 | node1 | ok: [node1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:38:26.574650 | node1 | ok: [node3] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:38:26.574914 | node1 | ok: [node2] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-18 15:38:26.575171 | node1 | 2026-08-18 15:38:26.575421 | node1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-18 15:38:26.575667 | node1 | Tuesday 18 August 2026 15:38:26 +0000 (0:00:01.158) 0:03:40.471 ******** 2026-08-18 15:38:27.286893 | node1 | ok: [node1] 2026-08-18 15:38:27.287147 | node1 | ok: [node2] 2026-08-18 15:38:27.287384 | node1 | ok: [node3] 2026-08-18 15:38:27.287603 | node1 | 2026-08-18 15:38:27.287850 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:38:27.288135 | node1 | Tuesday 18 August 2026 15:38:27 +0000 (0:00:00.697) 0:03:41.168 ******** 2026-08-18 15:38:27.288346 | node1 | 2026-08-18 15:38:27.288587 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:38:27.288830 | node1 | Tuesday 18 August 2026 15:38:27 +0000 (0:00:00.006) 0:03:41.175 ******** 2026-08-18 15:38:27.289082 | node1 | 2026-08-18 15:38:27.289533 | node1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-18 15:38:27.289791 | node1 | Tuesday 18 August 2026 15:38:27 +0000 (0:00:00.006) 0:03:41.181 ******** 2026-08-18 15:38:27.290059 | node1 | 2026-08-18 15:38:27.290298 | node1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-18 15:38:27.290860 | node1 | Tuesday 18 August 2026 15:38:27 +0000 (0:00:00.006) 0:03:41.187 ******** 2026-08-18 15:38:27.780561 | node1 | ok: [node1] 2026-08-18 15:38:27.780611 | node1 | ok: [node2] 2026-08-18 15:38:27.780621 | node1 | ok: [node3] 2026-08-18 15:38:27.780631 | node1 | 2026-08-18 15:38:27.780641 | node1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-18 15:38:27.780650 | node1 | Tuesday 18 August 2026 15:38:27 +0000 (0:00:00.492) 0:03:41.679 ******** 2026-08-18 15:38:28.078973 | node1 | ok: [node1] 2026-08-18 15:38:28.079033 | node1 | ok: [node2] 2026-08-18 15:38:28.079042 | node1 | ok: [node3] 2026-08-18 15:38:28.079052 | node1 | 2026-08-18 15:38:28.079061 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:38:28.079070 | node1 | Tuesday 18 August 2026 15:38:28 +0000 (0:00:00.298) 0:03:41.977 ******** 2026-08-18 15:38:28.184005 | node1 | ok: [node1] => { 2026-08-18 15:38:28.184406 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:38:28.184417 | node1 | } 2026-08-18 15:38:28.184432 | node1 | ok: [node2] => { 2026-08-18 15:38:28.185597 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:38:28.185665 | node1 | } 2026-08-18 15:38:28.185678 | node1 | ok: [node3] => { 2026-08-18 15:38:28.185689 | node1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-18 15:38:28.186123 | node1 | } 2026-08-18 15:38:28.186437 | node1 | 2026-08-18 15:38:28.186717 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:38:28.187014 | node1 | Tuesday 18 August 2026 15:38:28 +0000 (0:00:00.106) 0:03:42.083 ******** 2026-08-18 15:38:28.666417 | node1 | ok: [node1] 2026-08-18 15:38:28.666780 | node1 | ok: [node2] 2026-08-18 15:38:28.667115 | node1 | ok: [node3] 2026-08-18 15:38:28.667411 | node1 | 2026-08-18 15:38:28.667729 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:38:28.668089 | node1 | Tuesday 18 August 2026 15:38:28 +0000 (0:00:00.483) 0:03:42.566 ******** 2026-08-18 15:38:33.006031 | node1 | ok: [node3] 2026-08-18 15:38:33.006289 | node1 | ok: [node1] 2026-08-18 15:38:33.006488 | node1 | ok: [node2] 2026-08-18 15:38:33.006675 | node1 | 2026-08-18 15:38:33.006882 | node1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-18 15:38:33.007138 | node1 | Tuesday 18 August 2026 15:38:33 +0000 (0:00:04.339) 0:03:46.906 ******** 2026-08-18 15:38:33.952469 | node1 | ok: [node2] 2026-08-18 15:38:33.953420 | node1 | ok: [node1] 2026-08-18 15:38:33.953441 | node1 | ok: [node3] 2026-08-18 15:38:33.953449 | node1 | 2026-08-18 15:38:33.953457 | node1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-18 15:38:33.953465 | node1 | Tuesday 18 August 2026 15:38:33 +0000 (0:00:00.946) 0:03:47.853 ******** 2026-08-18 15:38:34.221073 | node1 | ok: [node1] 2026-08-18 15:38:34.221136 | node1 | ok: [node2] 2026-08-18 15:38:34.221149 | node1 | ok: [node3] 2026-08-18 15:38:34.221166 | node1 | 2026-08-18 15:38:34.221440 | node1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-18 15:38:34.221683 | node1 | Tuesday 18 August 2026 15:38:34 +0000 (0:00:00.267) 0:03:48.120 ******** 2026-08-18 15:38:34.786009 | node1 | ok: [node1] 2026-08-18 15:38:34.786231 | node1 | ok: [node2] 2026-08-18 15:38:34.786466 | node1 | ok: [node3] 2026-08-18 15:38:34.786684 | node1 | 2026-08-18 15:38:34.786968 | node1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-18 15:38:34.787215 | node1 | Tuesday 18 August 2026 15:38:34 +0000 (0:00:00.565) 0:03:48.686 ******** 2026-08-18 15:38:35.528108 | node1 | ok: [node2] => (item={'path': '/etc/docker'}) 2026-08-18 15:38:35.528172 | node1 | ok: [node1] => (item={'path': '/etc/docker'}) 2026-08-18 15:38:35.528185 | node1 | ok: [node3] => (item={'path': '/etc/docker'}) 2026-08-18 15:38:35.528197 | node1 | ok: [node2] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:38:35.528214 | node1 | ok: [node3] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:38:35.529965 | node1 | ok: [node1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-18 15:38:35.530034 | node1 | ok: [node2] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:38:35.530066 | node1 | ok: [node3] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:38:35.530075 | node1 | ok: [node1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-18 15:38:35.530084 | node1 | 2026-08-18 15:38:35.530094 | node1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-18 15:38:35.530102 | node1 | Tuesday 18 August 2026 15:38:35 +0000 (0:00:00.740) 0:03:49.427 ******** 2026-08-18 15:38:36.091023 | node1 | ok: [node2] 2026-08-18 15:38:36.091081 | node1 | ok: [node1] 2026-08-18 15:38:36.091091 | node1 | ok: [node3] 2026-08-18 15:38:36.091100 | node1 | 2026-08-18 15:38:36.091110 | node1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-18 15:38:36.091119 | node1 | Tuesday 18 August 2026 15:38:36 +0000 (0:00:00.562) 0:03:49.989 ******** 2026-08-18 15:38:36.696015 | node1 | ok: [node2] 2026-08-18 15:38:36.696093 | node1 | ok: [node1] 2026-08-18 15:38:36.696103 | node1 | ok: [node3] 2026-08-18 15:38:36.696112 | node1 | 2026-08-18 15:38:36.696121 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:38:36.696131 | node1 | Tuesday 18 August 2026 15:38:36 +0000 (0:00:00.584) 0:03:50.573 ******** 2026-08-18 15:38:36.696139 | node1 | 2026-08-18 15:38:36.696148 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:38:36.696292 | node1 | Tuesday 18 August 2026 15:38:36 +0000 (0:00:00.006) 0:03:50.580 ******** 2026-08-18 15:38:36.696582 | node1 | 2026-08-18 15:38:36.696899 | node1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-18 15:38:36.697301 | node1 | Tuesday 18 August 2026 15:38:36 +0000 (0:00:00.006) 0:03:50.587 ******** 2026-08-18 15:38:36.697602 | node1 | 2026-08-18 15:38:36.697914 | node1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-18 15:38:36.698286 | node1 | Tuesday 18 August 2026 15:38:36 +0000 (0:00:00.006) 0:03:50.593 ******** 2026-08-18 15:38:37.200719 | node1 | ok: [node1] 2026-08-18 15:38:37.201127 | node1 | ok: [node2] 2026-08-18 15:38:37.201439 | node1 | ok: [node3] 2026-08-18 15:38:37.201723 | node1 | 2026-08-18 15:38:37.202069 | node1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-18 15:38:37.202388 | node1 | Tuesday 18 August 2026 15:38:37 +0000 (0:00:00.507) 0:03:51.100 ******** 2026-08-18 15:38:37.276859 | node1 | ok: [node1] => { 2026-08-18 15:38:37.277367 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:38:37.277842 | node1 | } 2026-08-18 15:38:37.278256 | node1 | ok: [node2] => { 2026-08-18 15:38:37.278598 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:38:37.279004 | node1 | } 2026-08-18 15:38:37.279341 | node1 | ok: [node3] => { 2026-08-18 15:38:37.279661 | node1 | "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm" 2026-08-18 15:38:37.280017 | node1 | } 2026-08-18 15:38:37.280323 | node1 | 2026-08-18 15:38:37.280679 | node1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-18 15:38:37.281051 | node1 | Tuesday 18 August 2026 15:38:37 +0000 (0:00:00.075) 0:03:51.176 ******** 2026-08-18 15:38:37.657910 | node1 | ok: [node1] 2026-08-18 15:38:37.658480 | node1 | ok: [node3] 2026-08-18 15:38:37.658798 | node1 | ok: [node2] 2026-08-18 15:38:37.659128 | node1 | 2026-08-18 15:38:37.659457 | node1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-18 15:38:37.659768 | node1 | Tuesday 18 August 2026 15:38:37 +0000 (0:00:00.381) 0:03:51.557 ******** 2026-08-18 15:38:37.756699 | node1 | skipping: [node1] 2026-08-18 15:38:37.756832 | node1 | skipping: [node2] 2026-08-18 15:38:37.757792 | node1 | skipping: [node3] 2026-08-18 15:38:37.757851 | node1 | 2026-08-18 15:38:37.757859 | node1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-18 15:38:37.757866 | node1 | Tuesday 18 August 2026 15:38:37 +0000 (0:00:00.098) 0:03:51.656 ******** 2026-08-18 15:38:37.851476 | node1 | ok: [node1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:38:37.851569 | node1 | ok: [node2] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:38:37.851624 | node1 | ok: [node3] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-18 15:38:37.851633 | node1 | 2026-08-18 15:38:37.851643 | node1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-18 15:38:37.851653 | node1 | Tuesday 18 August 2026 15:38:37 +0000 (0:00:00.093) 0:03:51.749 ******** 2026-08-18 15:38:38.782089 | node1 | ok: [node1] 2026-08-18 15:38:38.782203 | node1 | ok: [node3] 2026-08-18 15:38:38.782478 | node1 | ok: [node2] 2026-08-18 15:38:38.782732 | node1 | 2026-08-18 15:38:38.782993 | node1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-18 15:38:38.783209 | node1 | Tuesday 18 August 2026 15:38:38 +0000 (0:00:00.932) 0:03:52.682 ******** 2026-08-18 15:38:39.622851 | node1 | ok: [node1] => (item=systemd-timesyncd) 2026-08-18 15:38:39.622905 | node1 | ok: [node2] => (item=systemd-timesyncd) 2026-08-18 15:38:39.622915 | node1 | ok: [node3] => (item=systemd-timesyncd) 2026-08-18 15:38:39.622949 | node1 | ok: [node2] => (item=ssh) 2026-08-18 15:38:39.622963 | node1 | ok: [node3] => (item=ssh) 2026-08-18 15:38:39.622971 | node1 | ok: [node1] => (item=ssh) 2026-08-18 15:38:39.622980 | node1 | 2026-08-18 15:38:39.622989 | node1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-18 15:38:39.622998 | node1 | Tuesday 18 August 2026 15:38:39 +0000 (0:00:00.838) 0:03:53.520 ******** 2026-08-18 15:38:39.902493 | node1 | ok: [node2] 2026-08-18 15:38:39.902709 | node1 | ok: [node1] 2026-08-18 15:38:39.902959 | node1 | ok: [node3] 2026-08-18 15:38:39.903198 | node1 | 2026-08-18 15:38:39.903453 | node1 | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] ************** 2026-08-18 15:38:39.903697 | node1 | Tuesday 18 August 2026 15:38:39 +0000 (0:00:00.281) 0:03:53.802 ******** 2026-08-18 15:38:40.228525 | node1 | ok: [node1] 2026-08-18 15:38:40.228765 | node1 | ok: [node2] 2026-08-18 15:38:40.229039 | node1 | ok: [node3] 2026-08-18 15:38:40.229289 | node1 | 2026-08-18 15:38:40.229556 | node1 | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] *** 2026-08-18 15:38:40.229801 | node1 | Tuesday 18 August 2026 15:38:40 +0000 (0:00:00.326) 0:03:54.129 ******** 2026-08-18 15:38:40.782629 | node1 | ok: [node1] 2026-08-18 15:38:40.782816 | node1 | ok: [node3] 2026-08-18 15:38:40.783143 | node1 | ok: [node2] 2026-08-18 15:38:40.783404 | node1 | 2026-08-18 15:38:40.783672 | node1 | TASK [vexxhost.ceph.cephadm : Log in to the container registry] **************** 2026-08-18 15:38:40.783922 | node1 | Tuesday 18 August 2026 15:38:40 +0000 (0:00:00.553) 0:03:54.682 ******** 2026-08-18 15:38:40.854192 | node1 | skipping: [node1] 2026-08-18 15:38:40.854388 | node1 | skipping: [node2] 2026-08-18 15:38:40.854621 | node1 | skipping: [node3] 2026-08-18 15:38:40.854839 | node1 | 2026-08-18 15:38:40.855134 | node1 | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] ************************* 2026-08-18 15:38:40.855389 | node1 | Tuesday 18 August 2026 15:38:40 +0000 (0:00:00.072) 0:03:54.754 ******** 2026-08-18 15:38:41.338806 | node1 | ok: [node1] 2026-08-18 15:38:41.339075 | node1 | ok: [node2] 2026-08-18 15:38:41.339318 | node1 | ok: [node3] 2026-08-18 15:38:41.339550 | node1 | 2026-08-18 15:38:41.339827 | node1 | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] *** 2026-08-18 15:38:41.340145 | node1 | Tuesday 18 August 2026 15:38:41 +0000 (0:00:00.484) 0:03:55.239 ******** 2026-08-18 15:38:41.910057 | node1 | ok: [node1] 2026-08-18 15:38:41.910130 | node1 | ok: [node2] 2026-08-18 15:38:41.910388 | node1 | ok: [node3] 2026-08-18 15:38:41.910615 | node1 | 2026-08-18 15:38:41.910908 | node1 | TASK [vexxhost.ceph.monitoring : Locate the cluster admin host] **************** 2026-08-18 15:38:41.911254 | node1 | Tuesday 18 August 2026 15:38:41 +0000 (0:00:00.570) 0:03:55.810 ******** 2026-08-18 15:38:42.641131 | node1 | ok: [node1] => (item=node1) 2026-08-18 15:38:42.641184 | node1 | ok: [node1 -> node2({{ nodepool.private_ipv4 }})] => (item=node2) 2026-08-18 15:38:42.641195 | node1 | ok: [node1 -> node3({{ nodepool.private_ipv4 }})] => (item=node3) 2026-08-18 15:38:42.641205 | node1 | 2026-08-18 15:38:42.641214 | node1 | TASK [vexxhost.ceph.monitoring : Select the admin host] ************************ 2026-08-18 15:38:42.641247 | node1 | Tuesday 18 August 2026 15:38:42 +0000 (0:00:00.729) 0:03:56.540 ******** 2026-08-18 15:38:42.730142 | node1 | ok: [node1] 2026-08-18 15:38:42.730239 | node1 | ok: [node2] 2026-08-18 15:38:42.730246 | node1 | ok: [node3] 2026-08-18 15:38:42.730252 | node1 | 2026-08-18 15:38:42.730258 | node1 | TASK [vexxhost.ceph.monitoring : Set the admin mon config path] **************** 2026-08-18 15:38:42.730272 | node1 | Tuesday 18 August 2026 15:38:42 +0000 (0:00:00.088) 0:03:56.628 ******** 2026-08-18 15:38:42.815123 | node1 | ok: [node1] 2026-08-18 15:38:42.815183 | node1 | ok: [node2] 2026-08-18 15:38:42.815231 | node1 | ok: [node3] 2026-08-18 15:38:42.816102 | node1 | 2026-08-18 15:38:42.816159 | node1 | TASK [vexxhost.ceph.monitoring : Pin monitoring container images] ************** 2026-08-18 15:38:42.816171 | node1 | Tuesday 18 August 2026 15:38:42 +0000 (0:00:00.085) 0:03:56.714 ******** 2026-08-18 15:38:42.853452 | node1 | skipping: [node1] 2026-08-18 15:38:42.853524 | node1 | 2026-08-18 15:38:42.853648 | node1 | TASK [vexxhost.ceph.monitoring : Apply the monitoring service specs] *********** 2026-08-18 15:38:42.853738 | node1 | Tuesday 18 August 2026 15:38:42 +0000 (0:00:00.039) 0:03:56.753 ******** 2026-08-18 15:38:44.706081 | node1 | ok: [node1] => (item=ceph-exporter) 2026-08-18 15:38:44.706159 | node1 | 2026-08-18 15:38:44.706174 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:38:44.706187 | node1 | node1 : ok=231 changed=0 unreachable=0 failed=0 skipped=57 rescued=0 ignored=0 2026-08-18 15:38:44.706198 | node1 | node2 : ok=200 changed=0 unreachable=0 failed=0 skipped=39 rescued=0 ignored=0 2026-08-18 15:38:44.706215 | node1 | node3 : ok=200 changed=0 unreachable=0 failed=0 skipped=39 rescued=0 ignored=0 2026-08-18 15:38:44.706993 | node1 | 2026-08-18 15:38:44.707046 | node1 | 2026-08-18 15:38:44.707060 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:38:44.707223 | node1 | Tuesday 18 August 2026 15:38:44 +0000 (0:00:01.851) 0:03:58.604 ******** 2026-08-18 15:38:44.707527 | node1 | =============================================================================== 2026-08-18 15:38:44.707841 | node1 | vexxhost.ceph.configure : Configure pools ------------------------------ 37.84s 2026-08-18 15:38:44.708188 | node1 | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 11.41s 2026-08-18 15:38:44.708508 | node1 | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 11.08s 2026-08-18 15:38:44.708819 | node1 | vexxhost.ceph.configure : Configure dashboard users --------------------- 7.20s 2026-08-18 15:38:44.709183 | node1 | vexxhost.ceph.configure : Configure CRUSH rules ------------------------- 5.49s 2026-08-18 15:38:44.709503 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.34s 2026-08-18 15:38:44.709835 | node1 | vexxhost.ceph.rgw : Configure RGW zones --------------------------------- 3.48s 2026-08-18 15:38:44.710183 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.44s 2026-08-18 15:38:44.710502 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.36s 2026-08-18 15:38:44.710813 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.32s 2026-08-18 15:38:44.713009 | node1 | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 2.82s 2026-08-18 15:38:44.713040 | node1 | vexxhost.ceph.rgw : Configure RGW zonegroups ---------------------------- 2.55s 2026-08-18 15:38:44.713052 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.48s 2026-08-18 15:38:44.713063 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.30s 2026-08-18 15:38:44.713075 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.29s 2026-08-18 15:38:44.713086 | node1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.29s 2026-08-18 15:38:44.713097 | node1 | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 2.27s 2026-08-18 15:38:44.713109 | node1 | vexxhost.ceph.cephadm_host : Get the cephadm public key ----------------- 2.22s 2026-08-18 15:38:44.713385 | node1 | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 2.15s 2026-08-18 15:38:44.713580 | node1 | vexxhost.ceph.mgr : Wait for this manager's daemon to be present -------- 2.14s 2026-08-18 15:38:44.888180 | node1 | INFO [default > idempotence] Executed: Successful 2026-08-18 15:38:44.899517 | node1 | INFO [default > side_effect] Executing 2026-08-18 15:38:44.899855 | node1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:38:44.905792 | node1 | INFO [default > verify] Executing 2026-08-18 15:38:45.665246 | node1 | 2026-08-18 15:38:45.665628 | node1 | PLAY [Verify the deployed Ceph cluster] **************************************** 2026-08-18 15:38:45.666094 | node1 | 2026-08-18 15:38:45.666425 | node1 | TASK [Gathering Facts] ********************************************************* 2026-08-18 15:38:45.666736 | node1 | Tuesday 18 August 2026 15:38:45 +0000 (0:00:00.009) 0:00:00.009 ******** 2026-08-18 15:38:46.895867 | node1 | [WARNING]: Platform linux on host node1 is using the discovered Python 2026-08-18 15:38:46.896323 | node1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-18 15:38:46.896671 | node1 | interpreter could change the meaning of that path. See 2026-08-18 15:38:46.897024 | node1 | https://docs.ansible.com/ansible- 2026-08-18 15:38:46.897352 | node1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-18 15:38:46.905453 | node1 | ok: [node1] 2026-08-18 15:38:46.905770 | node1 | 2026-08-18 15:38:46.906137 | node1 | TASK [Get cluster health] ****************************************************** 2026-08-18 15:38:46.906476 | node1 | Tuesday 18 August 2026 15:38:46 +0000 (0:00:01.240) 0:00:01.249 ******** 2026-08-18 15:38:48.790585 | node1 | ok: [node1] 2026-08-18 15:38:48.790993 | node1 | 2026-08-18 15:38:48.791346 | node1 | TASK [Assert the cluster is HEALTH_OK] ***************************************** 2026-08-18 15:38:48.791677 | node1 | Tuesday 18 August 2026 15:38:48 +0000 (0:00:01.883) 0:00:03.133 ******** 2026-08-18 15:38:48.835842 | node1 | ok: [node1] => { 2026-08-18 15:38:48.836212 | node1 | "changed": false, 2026-08-18 15:38:48.836537 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:48.836839 | node1 | } 2026-08-18 15:38:48.837164 | node1 | 2026-08-18 15:38:48.837511 | node1 | TASK [Get monitor quorum] ****************************************************** 2026-08-18 15:38:48.837842 | node1 | Tuesday 18 August 2026 15:38:48 +0000 (0:00:00.046) 0:00:03.179 ******** 2026-08-18 15:38:50.940710 | node1 | ok: [node1] 2026-08-18 15:38:50.941216 | node1 | 2026-08-18 15:38:50.941232 | node1 | TASK [Assert every monitor is in quorum] *************************************** 2026-08-18 15:38:50.941239 | node1 | Tuesday 18 August 2026 15:38:50 +0000 (0:00:02.104) 0:00:05.284 ******** 2026-08-18 15:38:50.975084 | node1 | ok: [node1] => { 2026-08-18 15:38:50.975141 | node1 | "changed": false, 2026-08-18 15:38:50.975161 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:50.975339 | node1 | } 2026-08-18 15:38:50.975568 | node1 | 2026-08-18 15:38:50.975866 | node1 | TASK [Get manager status] ****************************************************** 2026-08-18 15:38:50.976166 | node1 | Tuesday 18 August 2026 15:38:50 +0000 (0:00:00.033) 0:00:05.318 ******** 2026-08-18 15:38:52.725774 | node1 | ok: [node1] 2026-08-18 15:38:52.726011 | node1 | 2026-08-18 15:38:52.726631 | node1 | TASK [Assert a manager is active] ********************************************** 2026-08-18 15:38:52.726945 | node1 | Tuesday 18 August 2026 15:38:52 +0000 (0:00:01.751) 0:00:07.069 ******** 2026-08-18 15:38:52.771348 | node1 | ok: [node1] => { 2026-08-18 15:38:52.771599 | node1 | "changed": false, 2026-08-18 15:38:52.771847 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:52.772122 | node1 | } 2026-08-18 15:38:52.772349 | node1 | 2026-08-18 15:38:52.772592 | node1 | TASK [Get OSD stat] ************************************************************ 2026-08-18 15:38:52.772842 | node1 | Tuesday 18 August 2026 15:38:52 +0000 (0:00:00.045) 0:00:07.115 ******** 2026-08-18 15:38:54.427424 | node1 | ok: [node1] 2026-08-18 15:38:54.427508 | node1 | 2026-08-18 15:38:54.427680 | node1 | TASK [Assert all OSDs are up and in] ******************************************* 2026-08-18 15:38:54.427835 | node1 | Tuesday 18 August 2026 15:38:54 +0000 (0:00:01.655) 0:00:08.770 ******** 2026-08-18 15:38:54.471333 | node1 | ok: [node1] => { 2026-08-18 15:38:54.471469 | node1 | "changed": false, 2026-08-18 15:38:54.471620 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:54.471768 | node1 | } 2026-08-18 15:38:54.471909 | node1 | 2026-08-18 15:38:54.472096 | node1 | TASK [List orchestrator services] ********************************************** 2026-08-18 15:38:54.472240 | node1 | Tuesday 18 August 2026 15:38:54 +0000 (0:00:00.045) 0:00:08.815 ******** 2026-08-18 15:38:56.098711 | node1 | ok: [node1] 2026-08-18 15:38:56.098920 | node1 | 2026-08-18 15:38:56.099216 | node1 | TASK [Assert every orchestrator service has all its daemons running] *********** 2026-08-18 15:38:56.099467 | node1 | Tuesday 18 August 2026 15:38:56 +0000 (0:00:01.626) 0:00:10.441 ******** 2026-08-18 15:38:56.195168 | node1 | ok: [node1] => (item=ceph-exporter) => { 2026-08-18 15:38:56.195353 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.195587 | node1 | "changed": false, 2026-08-18 15:38:56.195828 | node1 | "item": { 2026-08-18 15:38:56.196724 | node1 | "events": [ 2026-08-18 15:38:56.196759 | node1 | "2026-08-18T15:34:56.601611Z service:ceph-exporter [INFO] \"service was created\"" 2026-08-18 15:38:56.197028 | node1 | ], 2026-08-18 15:38:56.197267 | node1 | "placement": { 2026-08-18 15:38:56.197489 | node1 | "host_pattern": "*" 2026-08-18 15:38:56.197715 | node1 | }, 2026-08-18 15:38:56.197991 | node1 | "service_name": "ceph-exporter", 2026-08-18 15:38:56.198220 | node1 | "service_type": "ceph-exporter", 2026-08-18 15:38:56.198448 | node1 | "spec": { 2026-08-18 15:38:56.198678 | node1 | "prio_limit": 5, 2026-08-18 15:38:56.198908 | node1 | "stats_period": 5 2026-08-18 15:38:56.199171 | node1 | }, 2026-08-18 15:38:56.199397 | node1 | "status": { 2026-08-18 15:38:56.199634 | node1 | "created": "2026-08-18T15:34:44.557404Z", 2026-08-18 15:38:56.199890 | node1 | "last_refresh": "2026-08-18T15:35:02.567921Z", 2026-08-18 15:38:56.200187 | node1 | "ports": [ 2026-08-18 15:38:56.200403 | node1 | 9926 2026-08-18 15:38:56.200631 | node1 | ], 2026-08-18 15:38:56.200862 | node1 | "running": 3, 2026-08-18 15:38:56.201123 | node1 | "size": 3 2026-08-18 15:38:56.201336 | node1 | } 2026-08-18 15:38:56.201575 | node1 | }, 2026-08-18 15:38:56.201806 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.202070 | node1 | } 2026-08-18 15:38:56.202305 | node1 | ok: [node1] => (item=crash) => { 2026-08-18 15:38:56.202539 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.202774 | node1 | "changed": false, 2026-08-18 15:38:56.203038 | node1 | "item": { 2026-08-18 15:38:56.203265 | node1 | "placement": { 2026-08-18 15:38:56.203498 | node1 | "host_pattern": "*" 2026-08-18 15:38:56.203728 | node1 | }, 2026-08-18 15:38:56.204058 | node1 | "service_name": "crash", 2026-08-18 15:38:56.204275 | node1 | "service_type": "crash", 2026-08-18 15:38:56.204506 | node1 | "status": { 2026-08-18 15:38:56.204728 | node1 | "created": "2026-08-18T15:23:18.665623Z", 2026-08-18 15:38:56.204879 | node1 | "last_refresh": "2026-08-18T15:35:02.567238Z", 2026-08-18 15:38:56.205049 | node1 | "running": 3, 2026-08-18 15:38:56.205189 | node1 | "size": 3 2026-08-18 15:38:56.205330 | node1 | } 2026-08-18 15:38:56.205528 | node1 | }, 2026-08-18 15:38:56.205680 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.205823 | node1 | } 2026-08-18 15:38:56.205996 | node1 | ok: [node1] => (item=mgr) => { 2026-08-18 15:38:56.206144 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.206290 | node1 | "changed": false, 2026-08-18 15:38:56.206435 | node1 | "item": { 2026-08-18 15:38:56.206580 | node1 | "placement": { 2026-08-18 15:38:56.206730 | node1 | "label": "mgr" 2026-08-18 15:38:56.206872 | node1 | }, 2026-08-18 15:38:56.207043 | node1 | "service_name": "mgr", 2026-08-18 15:38:56.207187 | node1 | "service_type": "mgr", 2026-08-18 15:38:56.207331 | node1 | "status": { 2026-08-18 15:38:56.207481 | node1 | "created": "2026-08-18T15:24:08.482452Z", 2026-08-18 15:38:56.207632 | node1 | "last_refresh": "2026-08-18T15:35:02.567756Z", 2026-08-18 15:38:56.207777 | node1 | "running": 3, 2026-08-18 15:38:56.207921 | node1 | "size": 3 2026-08-18 15:38:56.208098 | node1 | } 2026-08-18 15:38:56.208241 | node1 | }, 2026-08-18 15:38:56.208390 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.208533 | node1 | } 2026-08-18 15:38:56.208683 | node1 | ok: [node1] => (item=mon) => { 2026-08-18 15:38:56.208843 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.209004 | node1 | "changed": false, 2026-08-18 15:38:56.209145 | node1 | "item": { 2026-08-18 15:38:56.209291 | node1 | "placement": { 2026-08-18 15:38:56.209435 | node1 | "label": "mon" 2026-08-18 15:38:56.209578 | node1 | }, 2026-08-18 15:38:56.209727 | node1 | "service_name": "mon", 2026-08-18 15:38:56.209874 | node1 | "service_type": "mon", 2026-08-18 15:38:56.210052 | node1 | "status": { 2026-08-18 15:38:56.210199 | node1 | "created": "2026-08-18T15:23:50.337031Z", 2026-08-18 15:38:56.210356 | node1 | "last_refresh": "2026-08-18T15:35:02.567404Z", 2026-08-18 15:38:56.210500 | node1 | "running": 3, 2026-08-18 15:38:56.210644 | node1 | "size": 3 2026-08-18 15:38:56.210790 | node1 | } 2026-08-18 15:38:56.210958 | node1 | }, 2026-08-18 15:38:56.211105 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.211247 | node1 | } 2026-08-18 15:38:56.211399 | node1 | ok: [node1] => (item=osd.default) => { 2026-08-18 15:38:56.211546 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.211693 | node1 | "changed": false, 2026-08-18 15:38:56.211839 | node1 | "item": { 2026-08-18 15:38:56.212037 | node1 | "placement": { 2026-08-18 15:38:56.212200 | node1 | "host_pattern": "node1" 2026-08-18 15:38:56.212341 | node1 | }, 2026-08-18 15:38:56.212494 | node1 | "service_id": "default", 2026-08-18 15:38:56.212639 | node1 | "service_name": "osd.default", 2026-08-18 15:38:56.212787 | node1 | "service_type": "osd", 2026-08-18 15:38:56.212945 | node1 | "spec": { 2026-08-18 15:38:56.213102 | node1 | "data_devices": { 2026-08-18 15:38:56.213244 | node1 | "paths": [ 2026-08-18 15:38:56.213394 | node1 | "/dev/ceph-node1-osd0/data" 2026-08-18 15:38:56.213533 | node1 | ] 2026-08-18 15:38:56.213675 | node1 | }, 2026-08-18 15:38:56.213821 | node1 | "filter_logic": "AND", 2026-08-18 15:38:56.213991 | node1 | "objectstore": "bluestore" 2026-08-18 15:38:56.214135 | node1 | }, 2026-08-18 15:38:56.214277 | node1 | "status": { 2026-08-18 15:38:56.214425 | node1 | "created": "2026-08-18T15:25:01.455243Z", 2026-08-18 15:38:56.214575 | node1 | "last_refresh": "2026-08-18T15:35:02.566825Z", 2026-08-18 15:38:56.214721 | node1 | "running": 9, 2026-08-18 15:38:56.214862 | node1 | "size": 9 2026-08-18 15:38:56.215036 | node1 | } 2026-08-18 15:38:56.215177 | node1 | }, 2026-08-18 15:38:56.215326 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.215468 | node1 | } 2026-08-18 15:38:56.215620 | node1 | ok: [node1] => (item=rgw.molecule) => { 2026-08-18 15:38:56.215768 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:56.215914 | node1 | "changed": false, 2026-08-18 15:38:56.216140 | node1 | "item": { 2026-08-18 15:38:56.216272 | node1 | "events": [ 2026-08-18 15:38:56.216437 | node1 | "2026-08-18T15:34:26.167197Z service:rgw.molecule [INFO] \"service was created\"" 2026-08-18 15:38:56.216579 | node1 | ], 2026-08-18 15:38:56.216725 | node1 | "placement": { 2026-08-18 15:38:56.216836 | node1 | "count_per_host": 1, 2026-08-18 15:38:56.216961 | node1 | "label": "rgw" 2026-08-18 15:38:56.217059 | node1 | }, 2026-08-18 15:38:56.217163 | node1 | "service_id": "molecule", 2026-08-18 15:38:56.217270 | node1 | "service_name": "rgw.molecule", 2026-08-18 15:38:56.217376 | node1 | "service_type": "rgw", 2026-08-18 15:38:56.217477 | node1 | "spec": { 2026-08-18 15:38:56.217582 | node1 | "generate_cert": true, 2026-08-18 15:38:56.217689 | node1 | "rgw_exit_timeout_secs": 120, 2026-08-18 15:38:56.217796 | node1 | "rgw_frontend_port": 8080, 2026-08-18 15:38:56.217900 | node1 | "rgw_realm": "molecule", 2026-08-18 15:38:56.218027 | node1 | "rgw_zone": "molecule-1", 2026-08-18 15:38:56.218131 | node1 | "rgw_zonegroup": "molecule", 2026-08-18 15:38:56.218234 | node1 | "ssl": true 2026-08-18 15:38:56.218335 | node1 | }, 2026-08-18 15:38:56.218439 | node1 | "status": { 2026-08-18 15:38:56.218546 | node1 | "created": "2026-08-18T15:34:26.089430Z", 2026-08-18 15:38:56.218655 | node1 | "last_refresh": "2026-08-18T15:35:02.567567Z", 2026-08-18 15:38:56.218762 | node1 | "ports": [ 2026-08-18 15:38:56.218864 | node1 | 8080 2026-08-18 15:38:56.218985 | node1 | ], 2026-08-18 15:38:56.219086 | node1 | "running": 3, 2026-08-18 15:38:56.219189 | node1 | "size": 3 2026-08-18 15:38:56.219289 | node1 | } 2026-08-18 15:38:56.219392 | node1 | }, 2026-08-18 15:38:56.219499 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:56.219600 | node1 | } 2026-08-18 15:38:56.219697 | node1 | 2026-08-18 15:38:56.219803 | node1 | TASK [List pools] ************************************************************** 2026-08-18 15:38:56.219913 | node1 | Tuesday 18 August 2026 15:38:56 +0000 (0:00:00.097) 0:00:10.539 ******** 2026-08-18 15:38:57.854428 | node1 | ok: [node1] 2026-08-18 15:38:57.854656 | node1 | 2026-08-18 15:38:57.854970 | node1 | TASK [Assert every declared pool exists] *************************************** 2026-08-18 15:38:57.855232 | node1 | Tuesday 18 August 2026 15:38:57 +0000 (0:00:01.659) 0:00:12.198 ******** 2026-08-18 15:38:57.941683 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.data) => { 2026-08-18 15:38:57.942044 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.942343 | node1 | "changed": false, 2026-08-18 15:38:57.942596 | node1 | "item": { 2026-08-18 15:38:57.942865 | node1 | "application": "rgw", 2026-08-18 15:38:57.943199 | node1 | "name": "molecule-1.rgw.buckets.data", 2026-08-18 15:38:57.943439 | node1 | "pg_autoscale_mode": true, 2026-08-18 15:38:57.943682 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.943947 | node1 | "type": "replicated" 2026-08-18 15:38:57.944217 | node1 | }, 2026-08-18 15:38:57.944465 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.944704 | node1 | } 2026-08-18 15:38:57.945145 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.index) => { 2026-08-18 15:38:57.945391 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.945628 | node1 | "changed": false, 2026-08-18 15:38:57.945864 | node1 | "item": { 2026-08-18 15:38:57.946147 | node1 | "application": "rgw", 2026-08-18 15:38:57.946383 | node1 | "name": "molecule-1.rgw.buckets.index", 2026-08-18 15:38:57.946622 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:38:57.946907 | node1 | "pg_num": 8, 2026-08-18 15:38:57.947182 | node1 | "pgp_num": 8, 2026-08-18 15:38:57.947421 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.947660 | node1 | "type": "replicated" 2026-08-18 15:38:57.947852 | node1 | }, 2026-08-18 15:38:57.948034 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.948169 | node1 | } 2026-08-18 15:38:57.948327 | node1 | ok: [node1] => (item=molecule-1.rgw.buckets.non-ec) => { 2026-08-18 15:38:57.948473 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.948623 | node1 | "changed": false, 2026-08-18 15:38:57.948769 | node1 | "item": { 2026-08-18 15:38:57.948918 | node1 | "application": "rgw", 2026-08-18 15:38:57.949088 | node1 | "name": "molecule-1.rgw.buckets.non-ec", 2026-08-18 15:38:57.949237 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:38:57.949383 | node1 | "pg_num": 8, 2026-08-18 15:38:57.949530 | node1 | "pgp_num": 8, 2026-08-18 15:38:57.949678 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.949824 | node1 | "type": "replicated" 2026-08-18 15:38:57.949988 | node1 | }, 2026-08-18 15:38:57.950140 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.950284 | node1 | } 2026-08-18 15:38:57.950439 | node1 | ok: [node1] => (item=molecule-1.rgw.control) => { 2026-08-18 15:38:57.950590 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.950739 | node1 | "changed": false, 2026-08-18 15:38:57.950949 | node1 | "item": { 2026-08-18 15:38:57.951128 | node1 | "application": "rgw", 2026-08-18 15:38:57.951341 | node1 | "name": "molecule-1.rgw.control", 2026-08-18 15:38:57.951490 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:38:57.951637 | node1 | "pg_num": 8, 2026-08-18 15:38:57.951796 | node1 | "pgp_num": 8, 2026-08-18 15:38:57.952003 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.952148 | node1 | "type": "replicated" 2026-08-18 15:38:57.952292 | node1 | }, 2026-08-18 15:38:57.952442 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.952585 | node1 | } 2026-08-18 15:38:57.952737 | node1 | ok: [node1] => (item=molecule-1.rgw.log) => { 2026-08-18 15:38:57.952898 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.953069 | node1 | "changed": false, 2026-08-18 15:38:57.953212 | node1 | "item": { 2026-08-18 15:38:57.953360 | node1 | "application": "rgw", 2026-08-18 15:38:57.953510 | node1 | "name": "molecule-1.rgw.log", 2026-08-18 15:38:57.953660 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:38:57.953806 | node1 | "pg_num": 8, 2026-08-18 15:38:57.953973 | node1 | "pgp_num": 8, 2026-08-18 15:38:57.954122 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.954269 | node1 | "type": "replicated" 2026-08-18 15:38:57.954414 | node1 | }, 2026-08-18 15:38:57.954564 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.954706 | node1 | } 2026-08-18 15:38:57.954878 | node1 | ok: [node1] => (item=molecule-1.rgw.meta) => { 2026-08-18 15:38:57.955055 | node1 | "ansible_loop_var": "item", 2026-08-18 15:38:57.955200 | node1 | "changed": false, 2026-08-18 15:38:57.955345 | node1 | "item": { 2026-08-18 15:38:57.955493 | node1 | "application": "rgw", 2026-08-18 15:38:57.955641 | node1 | "name": "molecule-1.rgw.meta", 2026-08-18 15:38:57.955808 | node1 | "pg_autoscale_mode": "off", 2026-08-18 15:38:57.956004 | node1 | "pg_num": 8, 2026-08-18 15:38:57.956147 | node1 | "pgp_num": 8, 2026-08-18 15:38:57.956295 | node1 | "rule_name": "replicated_rule", 2026-08-18 15:38:57.956441 | node1 | "type": "replicated" 2026-08-18 15:38:57.956583 | node1 | }, 2026-08-18 15:38:57.956733 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:57.956876 | node1 | } 2026-08-18 15:38:57.957036 | node1 | 2026-08-18 15:38:57.957186 | node1 | TASK [Get the RGW zonegroup] *************************************************** 2026-08-18 15:38:57.957337 | node1 | Tuesday 18 August 2026 15:38:57 +0000 (0:00:00.087) 0:00:12.285 ******** 2026-08-18 15:38:59.285572 | node1 | ok: [node1] 2026-08-18 15:38:59.285799 | node1 | 2026-08-18 15:38:59.286162 | node1 | TASK [Assert the zonegroup has a master zone] ********************************** 2026-08-18 15:38:59.286423 | node1 | Tuesday 18 August 2026 15:38:59 +0000 (0:00:01.343) 0:00:13.629 ******** 2026-08-18 15:38:59.368059 | node1 | ok: [node1] => { 2026-08-18 15:38:59.368290 | node1 | "changed": false, 2026-08-18 15:38:59.368557 | node1 | "msg": "All assertions passed" 2026-08-18 15:38:59.368808 | node1 | } 2026-08-18 15:38:59.369090 | node1 | 2026-08-18 15:38:59.369367 | node1 | TASK [Probe the RGW S3 endpoint (anonymous)] *********************************** 2026-08-18 15:38:59.369626 | node1 | Tuesday 18 August 2026 15:38:59 +0000 (0:00:00.082) 0:00:13.711 ******** 2026-08-18 15:38:59.977290 | node1 | ok: [node1] 2026-08-18 15:38:59.977837 | node1 | 2026-08-18 15:38:59.977870 | node1 | TASK [Assert the RGW endpoint returns an S3 listing] *************************** 2026-08-18 15:38:59.978164 | node1 | Tuesday 18 August 2026 15:38:59 +0000 (0:00:00.609) 0:00:14.320 ******** 2026-08-18 15:39:00.028759 | node1 | ok: [node1] => { 2026-08-18 15:39:00.029026 | node1 | "changed": false, 2026-08-18 15:39:00.029291 | node1 | "msg": "All assertions passed" 2026-08-18 15:39:00.029567 | node1 | } 2026-08-18 15:39:00.029802 | node1 | 2026-08-18 15:39:00.030099 | node1 | TASK [Create a test pool] ****************************************************** 2026-08-18 15:39:00.030363 | node1 | Tuesday 18 August 2026 15:39:00 +0000 (0:00:00.051) 0:00:14.372 ******** 2026-08-18 15:39:08.705691 | node1 | changed: [node1] 2026-08-18 15:39:08.705972 | node1 | 2026-08-18 15:39:08.706197 | node1 | TASK [Create a test CephX key] ************************************************* 2026-08-18 15:39:08.706519 | node1 | Tuesday 18 August 2026 15:39:08 +0000 (0:00:08.676) 0:00:23.049 ******** 2026-08-18 15:39:12.646059 | node1 | changed: [node1] 2026-08-18 15:39:12.646335 | node1 | 2026-08-18 15:39:12.646614 | node1 | TASK [Read the test key back] ************************************************** 2026-08-18 15:39:12.646884 | node1 | Tuesday 18 August 2026 15:39:12 +0000 (0:00:03.940) 0:00:26.989 ******** 2026-08-18 15:39:14.567573 | node1 | ok: [node1] 2026-08-18 15:39:14.567648 | node1 | 2026-08-18 15:39:14.567802 | node1 | TASK [Assert the key info is correct] ****************************************** 2026-08-18 15:39:14.567992 | node1 | Tuesday 18 August 2026 15:39:14 +0000 (0:00:01.921) 0:00:28.911 ******** 2026-08-18 15:39:14.615141 | node1 | ok: [node1] => { 2026-08-18 15:39:14.615443 | node1 | "changed": false, 2026-08-18 15:39:14.615724 | node1 | "msg": "All assertions passed" 2026-08-18 15:39:14.616024 | node1 | } 2026-08-18 15:39:14.616298 | node1 | 2026-08-18 15:39:14.616525 | node1 | TASK [Remove the test CephX key] *********************************************** 2026-08-18 15:39:14.616775 | node1 | Tuesday 18 August 2026 15:39:14 +0000 (0:00:00.047) 0:00:28.959 ******** 2026-08-18 15:39:18.021071 | node1 | changed: [node1] 2026-08-18 15:39:18.021130 | node1 | 2026-08-18 15:39:18.021144 | node1 | PLAY RECAP ********************************************************************* 2026-08-18 15:39:18.021157 | node1 | node1 : ok=22 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-18 15:39:18.021169 | node1 | 2026-08-18 15:39:18.021181 | node1 | 2026-08-18 15:39:18.021193 | node1 | TASKS RECAP ******************************************************************** 2026-08-18 15:39:18.021205 | node1 | Tuesday 18 August 2026 15:39:18 +0000 (0:00:03.403) 0:00:32.362 ******** 2026-08-18 15:39:18.021216 | node1 | =============================================================================== 2026-08-18 15:39:18.021228 | node1 | Create a test pool ------------------------------------------------------ 8.68s 2026-08-18 15:39:18.021367 | node1 | Create a test CephX key ------------------------------------------------- 3.94s 2026-08-18 15:39:18.021678 | node1 | Remove the test CephX key ----------------------------------------------- 3.40s 2026-08-18 15:39:18.022010 | node1 | Get monitor quorum ------------------------------------------------------ 2.10s 2026-08-18 15:39:18.022319 | node1 | Read the test key back -------------------------------------------------- 1.92s 2026-08-18 15:39:18.022620 | node1 | Get cluster health ------------------------------------------------------ 1.88s 2026-08-18 15:39:18.023050 | node1 | Get manager status ------------------------------------------------------ 1.75s 2026-08-18 15:39:18.023363 | node1 | List pools -------------------------------------------------------------- 1.66s 2026-08-18 15:39:18.023565 | node1 | Get OSD stat ------------------------------------------------------------ 1.66s 2026-08-18 15:39:18.023766 | node1 | List orchestrator services ---------------------------------------------- 1.63s 2026-08-18 15:39:18.023990 | node1 | Get the RGW zonegroup --------------------------------------------------- 1.34s 2026-08-18 15:39:18.024196 | node1 | Gathering Facts --------------------------------------------------------- 1.24s 2026-08-18 15:39:18.024400 | node1 | Probe the RGW S3 endpoint (anonymous) ----------------------------------- 0.61s 2026-08-18 15:39:18.024601 | node1 | Assert every orchestrator service has all its daemons running ----------- 0.10s 2026-08-18 15:39:18.024803 | node1 | Assert every declared pool exists --------------------------------------- 0.09s 2026-08-18 15:39:18.025038 | node1 | Assert the zonegroup has a master zone ---------------------------------- 0.08s 2026-08-18 15:39:18.025250 | node1 | Assert the RGW endpoint returns an S3 listing --------------------------- 0.05s 2026-08-18 15:39:18.025451 | node1 | Assert the key info is correct ------------------------------------------ 0.05s 2026-08-18 15:39:18.025654 | node1 | Assert the cluster is HEALTH_OK ----------------------------------------- 0.05s 2026-08-18 15:39:18.025966 | node1 | Assert a manager is active ---------------------------------------------- 0.05s 2026-08-18 15:39:18.084222 | node1 | INFO [default > verify] Executed: Successful 2026-08-18 15:39:18.094474 | node1 | INFO [default > cleanup] Executing 2026-08-18 15:39:18.094815 | node1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-18 15:39:18.100560 | node1 | INFO [default > destroy] Executing 2026-08-18 15:39:18.100687 | node1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-18 15:39:18.100780 | node1 | INFO [default > destroy] Executed: Successful 2026-08-18 15:39:18.101074 | node1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-08-18 15:39:28.677025 | node1 | ok: Runtime: 0:20:12.770409 2026-08-18 15:39:28.715139 | 2026-08-18 15:39:28.715242 | PLAY RECAP 2026-08-18 15:39:28.715292 | node1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-18 15:39:28.715313 | 2026-08-18 15:39:28.861909 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-18 15:39:28.879021 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 15:39:29.547746 | 2026-08-18 15:39:29.547872 | PLAY [all] 2026-08-18 15:39:29.560840 | 2026-08-18 15:39:29.560918 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-18 15:39:29.614465 | node1 | ok 2026-08-18 15:39:29.634971 | node2 | ok 2026-08-18 15:39:29.641095 | node3 | ok 2026-08-18 15:39:29.645889 | 2026-08-18 15:39:29.645983 | TASK [fetch-output : Set log path for single node] 2026-08-18 15:39:29.681770 | node1 | skipping: Conditional result was False 2026-08-18 15:39:29.683028 | node2 | skipping: Conditional result was False 2026-08-18 15:39:29.693855 | node3 | skipping: Conditional result was False 2026-08-18 15:39:29.705673 | 2026-08-18 15:39:29.705791 | LOOP [fetch-output : Ensure local output dirs] 2026-08-18 15:39:30.101842 | node2 -> localhost | changed: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/logs/node2" 2026-08-18 15:39:30.109654 | node3 -> localhost | changed: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/logs/node3" 2026-08-18 15:39:30.117717 | node1 -> localhost | changed: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/logs/node1" 2026-08-18 15:39:30.303821 | node2 -> localhost | changed: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/artifacts" 2026-08-18 15:39:30.324016 | node3 -> localhost | ok: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/artifacts" 2026-08-18 15:39:30.341019 | node1 -> localhost | ok: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/artifacts" 2026-08-18 15:39:30.521038 | node2 -> localhost | changed: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/docs" 2026-08-18 15:39:30.532070 | node3 -> localhost | ok: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/docs" 2026-08-18 15:39:30.532159 | node3 -> localhost | changed: All items complete 2026-08-18 15:39:30.532202 | 2026-08-18 15:39:30.563888 | node1 -> localhost | ok: "/var/lib/zuul/builds/920ad38283d44c288e81ee513d8ff8af/work/docs" 2026-08-18 15:39:30.574799 | 2026-08-18 15:39:30.574984 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-18 15:39:31.212851 | node3 | changed: .d..t...... ./ 2026-08-18 15:39:31.213152 | node3 | changed: All items complete 2026-08-18 15:39:31.213191 | 2026-08-18 15:39:31.221868 | node2 | changed: .d..t...... ./ 2026-08-18 15:39:31.239206 | node1 | changed: .d..t...... ./ 2026-08-18 15:39:31.691128 | node2 | changed: .d..t...... ./ 2026-08-18 15:39:31.698183 | node3 | ok 2026-08-18 15:39:31.705103 | node1 | ok 2026-08-18 15:39:32.180350 | node1 | ok 2026-08-18 15:39:32.187299 | node2 | changed: .d..t...... ./ 2026-08-18 15:39:32.194758 | node3 | ok 2026-08-18 15:39:32.229050 | 2026-08-18 15:39:32.229219 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-18 15:39:32.614551 | node1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008276 2026-08-18 15:39:32.614891 | node1 -> localhost | changed: All items complete 2026-08-18 15:39:32.614941 | 2026-08-18 15:39:32.838249 | node1 -> localhost | ok: Item: docs Runtime: 0:00:00.008165 2026-08-18 15:39:32.876234 | 2026-08-18 15:39:32.876382 | PLAY [all] 2026-08-18 15:39:32.884108 | 2026-08-18 15:39:32.884183 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-18 15:39:33.371938 | node1 | changed 2026-08-18 15:39:33.554348 | node2 | changed 2026-08-18 15:39:33.569197 | node3 | changed 2026-08-18 15:39:33.584132 | 2026-08-18 15:39:33.584185 | PLAY RECAP 2026-08-18 15:39:33.584232 | node1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:39:33.584260 | node2 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:39:33.584284 | node3 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-18 15:39:33.584302 | 2026-08-18 15:39:33.706243 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-18 15:39:33.723621 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-18 15:39:34.353247 | 2026-08-18 15:39:34.353784 | PLAY [localhost] 2026-08-18 15:39:34.363865 | 2026-08-18 15:39:34.363942 | TASK [Generate Zuul manifest] 2026-08-18 15:39:34.383843 | localhost | ok 2026-08-18 15:39:34.439545 | 2026-08-18 15:39:34.439657 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-18 15:39:34.808717 | localhost | changed 2026-08-18 15:39:34.822368 | 2026-08-18 15:39:34.822448 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-18 15:39:34.855894 | localhost | ok 2026-08-18 15:39:34.863359 | 2026-08-18 15:39:34.863437 | TASK [Upload logs] 2026-08-18 15:39:34.887187 | localhost | ok 2026-08-18 15:39:34.995596 | 2026-08-18 15:39:34.995758 | TASK [Set zuul-log-path fact] 2026-08-18 15:39:35.017181 | localhost | ok 2026-08-18 15:39:35.030842 | 2026-08-18 15:39:35.030909 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-18 15:39:35.064175 | localhost | ok 2026-08-18 15:39:35.073603 | 2026-08-18 15:39:35.073668 | TASK [upload-logs : Create log directories] 2026-08-18 15:39:35.420647 | localhost | changed 2026-08-18 15:39:35.427515 | 2026-08-18 15:39:35.427617 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-18 15:39:35.806535 | localhost -> localhost | ok: Runtime: 0:00:00.006541 2026-08-18 15:39:35.814740 | 2026-08-18 15:39:35.814809 | TASK [upload-logs : Upload logs to log server] 2026-08-18 15:39:36.304990 | localhost | Output suppressed because no_log was given 2026-08-18 15:39:36.312217 | 2026-08-18 15:39:36.312313 | LOOP [upload-logs : Compress console log and json output] 2026-08-18 15:39:36.358147 | localhost | skipping: Conditional result was False 2026-08-18 15:39:36.365252 | localhost | skipping: Conditional result was False 2026-08-18 15:39:36.377863 | 2026-08-18 15:39:36.378036 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-18 15:39:36.423783 | localhost | skipping: Conditional result was False 2026-08-18 15:39:36.424390 | 2026-08-18 15:39:36.428084 | localhost | skipping: Conditional result was False 2026-08-18 15:39:36.443294 | 2026-08-18 15:39:36.443490 | LOOP [upload-logs : Upload console log and json output]