2026-10-15 05:52:56.863938 | Job console starting 2026-10-15 05:52:56.887697 | Updating git repos 2026-10-15 05:52:56.920706 | Cloning repos into workspace 2026-10-15 05:52:56.969142 | Restoring repo states 2026-10-15 05:52:56.977491 | Merging changes 2026-10-15 05:52:57.267196 | Checking out repos 2026-10-15 05:52:57.312430 | Preparing playbooks 2026-10-15 05:52:58.352964 | Running Ansible setup 2026-10-15 05:53:02.654397 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-10-15 05:53:03.302251 | 2026-10-15 05:53:03.302419 | PLAY [localhost] 2026-10-15 05:53:03.310368 | 2026-10-15 05:53:03.310477 | TASK [Gathering Facts] 2026-10-15 05:53:04.275869 | localhost | ok 2026-10-15 05:53:04.290387 | 2026-10-15 05:53:04.290624 | TASK [Setup log path fact] 2026-10-15 05:53:04.308317 | localhost | ok 2026-10-15 05:53:04.328936 | 2026-10-15 05:53:04.329125 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-10-15 05:53:04.357952 | localhost | ok 2026-10-15 05:53:04.526223 | 2026-10-15 05:53:04.526374 | TASK [emit-job-header : Print job information] 2026-10-15 05:53:04.554922 | # Job Information 2026-10-15 05:53:04.555105 | Ansible Version: 2.16.18 2026-10-15 05:53:04.555137 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-10-15 05:53:04.555157 | Pipeline: check 2026-10-15 05:53:04.555177 | Executor: 2d72f0692154 2026-10-15 05:53:04.555194 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/116 2026-10-15 05:53:04.555213 | Event ID: 080ad4b0-c85c-11f1-8924-833ffce57932 2026-10-15 05:53:04.557787 | 2026-10-15 05:53:04.557850 | LOOP [emit-job-header : Print node information] 2026-10-15 05:53:04.653225 | localhost | ok: 2026-10-15 05:53:04.653895 | localhost | # Node Information 2026-10-15 05:53:04.654022 | localhost | Inventory Hostname: mon1 2026-10-15 05:53:04.654074 | localhost | Hostname: np0000195708 2026-10-15 05:53:04.654119 | localhost | Username: zuul 2026-10-15 05:53:04.654187 | localhost | Distro: Ubuntu 22.04 2026-10-15 05:53:04.654234 | localhost | Provider: yul1 2026-10-15 05:53:04.654276 | localhost | Region: ca-ymq-1 2026-10-15 05:53:04.654314 | localhost | Label: ubuntu-jammy 2026-10-15 05:53:04.654352 | localhost | Product Name: OpenStack Nova 2026-10-15 05:53:04.654389 | localhost | Interface IP: 162.253.55.205 2026-10-15 05:53:04.690586 | localhost | ok: 2026-10-15 05:53:04.690780 | localhost | # Node Information 2026-10-15 05:53:04.690855 | localhost | Inventory Hostname: osd1 2026-10-15 05:53:04.690935 | localhost | Hostname: np0000195709 2026-10-15 05:53:04.690996 | localhost | Username: zuul 2026-10-15 05:53:04.691049 | localhost | Distro: Ubuntu 22.04 2026-10-15 05:53:04.691152 | localhost | Provider: yul1 2026-10-15 05:53:04.691223 | localhost | Region: ca-ymq-1 2026-10-15 05:53:04.691279 | localhost | Label: ubuntu-jammy 2026-10-15 05:53:04.691333 | localhost | Product Name: OpenStack Nova 2026-10-15 05:53:04.691385 | localhost | Interface IP: 162.253.55.113 2026-10-15 05:53:04.700374 | 2026-10-15 05:53:04.700572 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-10-15 05:53:05.059655 | localhost -> localhost | changed 2026-10-15 05:53:05.068404 | 2026-10-15 05:53:05.068969 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-10-15 05:53:05.855128 | localhost -> localhost | changed 2026-10-15 05:53:05.862549 | 2026-10-15 05:53:05.862664 | PLAY [all] 2026-10-15 05:53:05.872993 | 2026-10-15 05:53:05.873135 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-10-15 05:53:06.090239 | mon1 -> localhost | ok 2026-10-15 05:53:06.102022 | 2026-10-15 05:53:06.102202 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-10-15 05:53:06.132319 | mon1 | ok 2026-10-15 05:53:06.141798 | osd1 | ok 2026-10-15 05:53:06.166779 | mon1 | included: /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-10-15 05:53:06.166879 | osd1 | included: /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-10-15 05:53:06.174077 | 2026-10-15 05:53:06.174156 | TASK [add-build-sshkey : Create Temp SSH key] 2026-10-15 05:53:07.202070 | mon1 -> localhost | Generating public/private rsa key pair. 2026-10-15 05:53:07.202359 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/93ceb342aa0748afbc4cfbc0a436643d_id_rsa 2026-10-15 05:53:07.202425 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/93ceb342aa0748afbc4cfbc0a436643d_id_rsa.pub 2026-10-15 05:53:07.202487 | mon1 -> localhost | The key fingerprint is: 2026-10-15 05:53:07.202556 | mon1 -> localhost | SHA256:MEr0kGRUemtMhOSJM4px3+z2oYXFZUCCEjYrEeXCyOk zuul-build-sshkey 2026-10-15 05:53:07.202618 | mon1 -> localhost | The key's randomart image is: 2026-10-15 05:53:07.202681 | mon1 -> localhost | +---[RSA 3072]----+ 2026-10-15 05:53:07.202745 | mon1 -> localhost | |oo==B=+.o | 2026-10-15 05:53:07.202797 | mon1 -> localhost | |++oB+* . . | 2026-10-15 05:53:07.202843 | mon1 -> localhost | |=+B.= * o | 2026-10-15 05:53:07.202888 | mon1 -> localhost | |o* = B = o | 2026-10-15 05:53:07.202962 | mon1 -> localhost | |oE o * S | 2026-10-15 05:53:07.203008 | mon1 -> localhost | | o o | 2026-10-15 05:53:07.203049 | mon1 -> localhost | | + o | 2026-10-15 05:53:07.203091 | mon1 -> localhost | | . + . | 2026-10-15 05:53:07.203134 | mon1 -> localhost | | . . | 2026-10-15 05:53:07.203176 | mon1 -> localhost | +----[SHA256]-----+ 2026-10-15 05:53:07.203289 | mon1 -> localhost | ok: Runtime: 0:00:00.577362 2026-10-15 05:53:07.215816 | 2026-10-15 05:53:07.216042 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-10-15 05:53:07.243818 | mon1 | ok 2026-10-15 05:53:07.263645 | osd1 | ok 2026-10-15 05:53:07.281330 | mon1 | included: /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-10-15 05:53:07.281439 | osd1 | included: /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-10-15 05:53:07.296083 | 2026-10-15 05:53:07.296247 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-10-15 05:53:07.318793 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:07.329659 | osd1 | skipping: Conditional result was False 2026-10-15 05:53:07.337812 | 2026-10-15 05:53:07.337991 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-10-15 05:53:07.771468 | mon1 | changed 2026-10-15 05:53:07.799031 | osd1 | changed 2026-10-15 05:53:07.805892 | 2026-10-15 05:53:07.806029 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-10-15 05:53:08.007246 | osd1 | ok 2026-10-15 05:53:08.018813 | mon1 | ok 2026-10-15 05:53:08.029933 | 2026-10-15 05:53:08.030138 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-10-15 05:53:08.506257 | mon1 | changed 2026-10-15 05:53:08.547032 | osd1 | changed 2026-10-15 05:53:08.557557 | 2026-10-15 05:53:08.557697 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-10-15 05:53:09.095137 | mon1 | changed 2026-10-15 05:53:09.099642 | osd1 | changed 2026-10-15 05:53:09.104316 | 2026-10-15 05:53:09.104390 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-10-15 05:53:09.129586 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:09.140898 | osd1 | skipping: Conditional result was False 2026-10-15 05:53:09.147729 | 2026-10-15 05:53:09.147983 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-10-15 05:53:09.480927 | mon1 -> localhost | changed 2026-10-15 05:53:09.498902 | 2026-10-15 05:53:09.499071 | TASK [add-build-sshkey : Add back temp key] 2026-10-15 05:53:09.799104 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/93ceb342aa0748afbc4cfbc0a436643d_id_rsa (zuul-build-sshkey) 2026-10-15 05:53:09.799478 | mon1 -> localhost | ok: Runtime: 0:00:00.016416 2026-10-15 05:53:09.812482 | 2026-10-15 05:53:09.812676 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-10-15 05:53:10.082721 | osd1 | ok 2026-10-15 05:53:10.089010 | mon1 | ok 2026-10-15 05:53:10.093329 | 2026-10-15 05:53:10.093424 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-10-15 05:53:10.117029 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:10.128375 | osd1 | skipping: Conditional result was False 2026-10-15 05:53:10.142715 | 2026-10-15 05:53:10.142833 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-10-15 05:53:10.417432 | osd1 | ok 2026-10-15 05:53:10.433034 | mon1 | ok 2026-10-15 05:53:10.439666 | 2026-10-15 05:53:10.439814 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-10-15 05:53:11.176651 | osd1 | Output suppressed because no_log was given 2026-10-15 05:53:11.185173 | mon1 | Output suppressed because no_log was given 2026-10-15 05:53:11.206819 | 2026-10-15 05:53:11.206915 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-10-15 05:53:11.424613 | osd1 | ok: "logs" 2026-10-15 05:53:11.425062 | osd1 | ok: All items complete 2026-10-15 05:53:11.425114 | 2026-10-15 05:53:11.433095 | mon1 | ok: "logs" 2026-10-15 05:53:11.597162 | mon1 | ok: "artifacts" 2026-10-15 05:53:11.603654 | osd1 | ok: "artifacts" 2026-10-15 05:53:11.748854 | osd1 | ok: "docs" 2026-10-15 05:53:11.756047 | mon1 | ok: "docs" 2026-10-15 05:53:11.766842 | 2026-10-15 05:53:11.767052 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-10-15 05:53:11.964864 | mon1 | changed: "logs" 2026-10-15 05:53:11.965205 | mon1 | ok: All items complete 2026-10-15 05:53:11.965247 | 2026-10-15 05:53:11.990747 | osd1 | changed: "logs" 2026-10-15 05:53:12.118968 | mon1 | changed: "artifacts" 2026-10-15 05:53:12.146729 | osd1 | changed: "artifacts" 2026-10-15 05:53:12.282265 | mon1 | changed: "docs" 2026-10-15 05:53:12.338416 | osd1 | changed: "docs" 2026-10-15 05:53:12.369190 | 2026-10-15 05:53:12.369425 | PLAY RECAP 2026-10-15 05:53:12.369575 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-10-15 05:53:12.369680 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-10-15 05:53:12.369769 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-10-15 05:53:12.369832 | 2026-10-15 05:53:12.528526 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-10-15 05:53:12.533222 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-10-15 05:53:13.112356 | 2026-10-15 05:53:13.113017 | PLAY [all] 2026-10-15 05:53:13.124852 | 2026-10-15 05:53:13.125020 | TASK [setup-uv : Extract archive] 2026-10-15 05:53:15.314323 | mon1 | changed 2026-10-15 05:53:15.423706 | osd1 | changed 2026-10-15 05:53:15.434170 | 2026-10-15 05:53:15.434479 | TASK [setup-uv : Print version] 2026-10-15 05:53:15.834739 | osd1 | uv 0.8.13 2026-10-15 05:53:15.824478 | mon1 | uv 0.8.13 2026-10-15 05:53:15.999647 | mon1 | ok: Runtime: 0:00:00.011927 2026-10-15 05:53:16.013230 | osd1 | ok: Runtime: 0:00:00.013461 2026-10-15 05:53:16.033158 | 2026-10-15 05:53:16.033286 | TASK [Install Ansible collection siblings] 2026-10-15 05:53:16.419743 | mon1 | ok: 2026-10-15 05:53:16.420020 | mon1 | Skipping community.general: no checked-out sibling 2026-10-15 05:53:16.420076 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-10-15 05:53:16.420118 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-10-15 05:53:16.423166 | 2026-10-15 05:53:16.423256 | PLAY RECAP 2026-10-15 05:53:16.423345 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-10-15 05:53:16.423415 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-10-15 05:53:16.423454 | 2026-10-15 05:53:16.607046 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-10-15 05:53:16.610179 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-10-15 05:53:17.165419 | 2026-10-15 05:53:17.165576 | PLAY [all] 2026-10-15 05:53:17.179878 | 2026-10-15 05:53:17.180081 | LOOP [Check inventory directories] 2026-10-15 05:53:17.530296 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-10-15 05:53:17.707557 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-10-15 05:53:17.874869 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-10-15 05:53:17.895234 | 2026-10-15 05:53:17.895569 | LOOP [Copy inventory file for Zuul] 2026-10-15 05:53:18.736023 | mon1 | changed: 2026-10-15 05:53:18.736259 | mon1 | { 2026-10-15 05:53:18.736300 | mon1 | "ansible_loop_var": "item", 2026-10-15 05:53:18.736333 | mon1 | "changed": false, 2026-10-15 05:53:18.736361 | mon1 | "failed": false, 2026-10-15 05:53:18.736396 | mon1 | "invocation": { 2026-10-15 05:53:18.736423 | mon1 | "module_args": { 2026-10-15 05:53:18.736450 | mon1 | "checksum_algorithm": "sha1", 2026-10-15 05:53:18.736477 | mon1 | "follow": true, 2026-10-15 05:53:18.736527 | mon1 | "get_attributes": true, 2026-10-15 05:53:18.736559 | mon1 | "get_checksum": true, 2026-10-15 05:53:18.736587 | mon1 | "get_mime": true, 2026-10-15 05:53:18.736615 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-10-15 05:53:18.736641 | mon1 | } 2026-10-15 05:53:18.736667 | mon1 | }, 2026-10-15 05:53:18.736694 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-10-15 05:53:18.736725 | mon1 | "stat": { 2026-10-15 05:53:18.736766 | mon1 | "atime": 1792043591.0601933, 2026-10-15 05:53:18.736800 | mon1 | "attr_flags": "e", 2026-10-15 05:53:18.736835 | mon1 | "attributes": [ 2026-10-15 05:53:18.736866 | mon1 | "extents" 2026-10-15 05:53:18.736895 | mon1 | ], 2026-10-15 05:53:18.736942 | mon1 | "block_size": 4096, 2026-10-15 05:53:18.736972 | mon1 | "blocks": 8, 2026-10-15 05:53:18.736999 | mon1 | "charset": "unknown", 2026-10-15 05:53:18.737029 | mon1 | "ctime": 1792043591.0721927, 2026-10-15 05:53:18.737062 | mon1 | "dev": 64513, 2026-10-15 05:53:18.737092 | mon1 | "device_type": 0, 2026-10-15 05:53:18.737121 | mon1 | "executable": true, 2026-10-15 05:53:18.737151 | mon1 | "exists": true, 2026-10-15 05:53:18.737186 | mon1 | "gid": 1000, 2026-10-15 05:53:18.737222 | mon1 | "gr_name": "zuul", 2026-10-15 05:53:18.737254 | mon1 | "inode": 1043485, 2026-10-15 05:53:18.737282 | mon1 | "isblk": false, 2026-10-15 05:53:18.737313 | mon1 | "ischr": false, 2026-10-15 05:53:18.737342 | mon1 | "isdir": true, 2026-10-15 05:53:18.737374 | mon1 | "isfifo": false, 2026-10-15 05:53:18.737410 | mon1 | "isgid": false, 2026-10-15 05:53:18.737445 | mon1 | "islnk": false, 2026-10-15 05:53:18.737480 | mon1 | "isreg": false, 2026-10-15 05:53:18.737512 | mon1 | "issock": false, 2026-10-15 05:53:18.737543 | mon1 | "isuid": false, 2026-10-15 05:53:18.737573 | mon1 | "mimetype": "unknown", 2026-10-15 05:53:18.737605 | mon1 | "mode": "0755", 2026-10-15 05:53:18.737640 | mon1 | "mtime": 1792043576.9996746, 2026-10-15 05:53:18.737676 | mon1 | "nlink": 10, 2026-10-15 05:53:18.737714 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-10-15 05:53:18.737745 | mon1 | "pw_name": "zuul", 2026-10-15 05:53:18.737775 | mon1 | "readable": true, 2026-10-15 05:53:18.737805 | mon1 | "rgrp": true, 2026-10-15 05:53:18.737834 | mon1 | "roth": true, 2026-10-15 05:53:18.737864 | mon1 | "rusr": true, 2026-10-15 05:53:18.737893 | mon1 | "size": 4096, 2026-10-15 05:53:18.738024 | mon1 | "uid": 1000, 2026-10-15 05:53:18.738067 | mon1 | "version": "2253374230", 2026-10-15 05:53:18.738099 | mon1 | "wgrp": false, 2026-10-15 05:53:18.738132 | mon1 | "woth": false, 2026-10-15 05:53:18.738163 | mon1 | "writeable": true, 2026-10-15 05:53:18.738192 | mon1 | "wusr": true, 2026-10-15 05:53:18.738218 | mon1 | "xgrp": true, 2026-10-15 05:53:18.738244 | mon1 | "xoth": true, 2026-10-15 05:53:18.738269 | mon1 | "xusr": true 2026-10-15 05:53:18.738293 | mon1 | } 2026-10-15 05:53:18.738319 | mon1 | } 2026-10-15 05:53:18.738374 | mon1 | ok: All items complete 2026-10-15 05:53:18.738405 | 2026-10-15 05:53:18.740358 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:18.741234 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:18.762461 | 2026-10-15 05:53:18.762668 | LOOP [Switch "ansible_host" to private IP] 2026-10-15 05:53:19.120467 | mon1 | changed: 2 replacements made 2026-10-15 05:53:19.124766 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:19.133697 | mon1 | skipping: Conditional result was False 2026-10-15 05:53:19.146503 | 2026-10-15 05:53:19.146682 | TASK [Run Molecule scenario] 2026-10-15 05:53:19.776297 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-10-15 05:53:20.566264 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-10-15 05:53:20.764655 | mon1 | Using CPython 3.13.7 2026-10-15 05:53:20.764761 | mon1 | Creating virtual environment at: .venv 2026-10-15 05:53:21.024043 | mon1 | Downloading cryptography (4.3MiB) 2026-10-15 05:53:21.024485 | mon1 | Downloading pygments (1.2MiB) 2026-10-15 05:53:21.027866 | mon1 | Downloading netaddr (2.2MiB) 2026-10-15 05:53:21.028097 | mon1 | Downloading ansible-core (2.1MiB) 2026-10-15 05:53:21.178749 | mon1 | Downloading netaddr 2026-10-15 05:53:21.237898 | mon1 | Downloading pygments 2026-10-15 05:53:21.388702 | mon1 | Downloading ansible-core 2026-10-15 05:53:21.432961 | mon1 | Downloading cryptography 2026-10-15 05:53:21.474715 | mon1 | Installed 36 packages in 41ms 2026-10-15 05:53:22.619284 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-10-15 05:53:22.619419 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-10-15 05:53:23.279297 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-10-15 05:53:23.279376 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-10-15 05:53:39.292959 | mon1 | INFO [default > dependency] Executing 2026-10-15 05:53:39.293302 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-10-15 05:53:39.293666 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-10-15 05:53:39.293884 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-10-15 05:53:39.303883 | mon1 | INFO [default > cleanup] Executing 2026-10-15 05:53:39.304417 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-10-15 05:53:39.314274 | mon1 | INFO [default > destroy] Executing 2026-10-15 05:53:39.314378 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-10-15 05:53:39.314514 | mon1 | INFO [default > destroy] Executed: Successful 2026-10-15 05:53:39.324874 | mon1 | INFO [default > syntax] Executing 2026-10-15 05:53:40.270202 | mon1 | 2026-10-15 05:53:40.270555 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-10-15 05:53:40.342815 | mon1 | INFO [default > syntax] Executed: Successful 2026-10-15 05:53:40.351853 | mon1 | INFO [default > create] Executing 2026-10-15 05:53:40.354279 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-10-15 05:53:40.365554 | mon1 | INFO [default > prepare] Executing 2026-10-15 05:53:41.017661 | mon1 | 2026-10-15 05:53:41.017822 | mon1 | PLAY [Prepare] ***************************************************************** 2026-10-15 05:53:41.018013 | mon1 | 2026-10-15 05:53:41.018206 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 05:53:41.018505 | mon1 | Thursday 15 October 2026 05:53:41 +0000 (0:00:00.029) 0:00:00.029 ****** 2026-10-15 05:53:42.173000 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-10-15 05:53:42.173190 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 05:53:42.173405 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 05:53:42.173590 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 05:53:42.173833 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 05:53:42.217447 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-10-15 05:53:42.217602 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 05:53:42.217834 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 05:53:42.217987 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 05:53:42.218172 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 05:53:42.229459 | mon1 | ok: [mon1] 2026-10-15 05:53:42.229622 | mon1 | ok: [osd1] 2026-10-15 05:53:42.229813 | mon1 | 2026-10-15 05:53:42.230008 | mon1 | TASK [Configure short hostname] ************************************************ 2026-10-15 05:53:42.230184 | mon1 | Thursday 15 October 2026 05:53:42 +0000 (0:00:01.211) 0:00:01.241 ****** 2026-10-15 05:53:43.740306 | mon1 | changed: [mon1] 2026-10-15 05:53:43.740403 | mon1 | changed: [osd1] 2026-10-15 05:53:43.740415 | mon1 | 2026-10-15 05:53:43.740478 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-10-15 05:53:43.740568 | mon1 | Thursday 15 October 2026 05:53:43 +0000 (0:00:01.511) 0:00:02.753 ****** 2026-10-15 05:53:44.031816 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-10-15 05:53:44.031949 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-10-15 05:53:44.032135 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-10-15 05:53:44.044729 | mon1 | changed: [osd1] 2026-10-15 05:53:44.044898 | mon1 | changed: [mon1] 2026-10-15 05:53:44.045064 | mon1 | 2026-10-15 05:53:44.045288 | mon1 | TASK [Update apt cache] ******************************************************** 2026-10-15 05:53:44.045544 | mon1 | Thursday 15 October 2026 05:53:44 +0000 (0:00:00.303) 0:00:03.057 ****** 2026-10-15 05:53:51.847047 | mon1 | changed: [osd1] 2026-10-15 05:53:51.847127 | mon1 | changed: [mon1] 2026-10-15 05:53:51.847222 | mon1 | 2026-10-15 05:53:51.847366 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-10-15 05:53:51.847469 | mon1 | 2026-10-15 05:53:51.847581 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 05:53:51.847688 | mon1 | Thursday 15 October 2026 05:53:51 +0000 (0:00:07.802) 0:00:10.859 ****** 2026-10-15 05:53:52.620830 | mon1 | ok: [osd1] 2026-10-15 05:53:52.621014 | mon1 | 2026-10-15 05:53:52.621318 | mon1 | TASK [Install depedencies] ***************************************************** 2026-10-15 05:53:52.621583 | mon1 | Thursday 15 October 2026 05:53:52 +0000 (0:00:00.773) 0:00:11.633 ****** 2026-10-15 05:54:16.875416 | mon1 | changed: [osd1] 2026-10-15 05:54:16.875498 | mon1 | 2026-10-15 05:54:16.875765 | mon1 | TASK [Start up service] ******************************************************** 2026-10-15 05:54:16.876019 | mon1 | Thursday 15 October 2026 05:54:16 +0000 (0:00:24.253) 0:00:35.887 ****** 2026-10-15 05:54:17.457106 | mon1 | ok: [osd1] 2026-10-15 05:54:17.457228 | mon1 | 2026-10-15 05:54:17.457405 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-10-15 05:54:17.457582 | mon1 | Thursday 15 October 2026 05:54:17 +0000 (0:00:00.582) 0:00:36.469 ****** 2026-10-15 05:54:17.799224 | mon1 | ok: [osd1] 2026-10-15 05:54:17.799320 | mon1 | 2026-10-15 05:54:17.799452 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-10-15 05:54:17.799591 | mon1 | Thursday 15 October 2026 05:54:17 +0000 (0:00:00.341) 0:00:36.811 ****** 2026-10-15 05:54:18.517409 | mon1 | changed: [osd1] 2026-10-15 05:54:18.517547 | mon1 | 2026-10-15 05:54:18.517843 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-10-15 05:54:18.518059 | mon1 | Thursday 15 October 2026 05:54:18 +0000 (0:00:00.718) 0:00:37.529 ****** 2026-10-15 05:54:18.723101 | mon1 | ok: [osd1] 2026-10-15 05:54:18.723260 | mon1 | 2026-10-15 05:54:18.723465 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-10-15 05:54:18.723658 | mon1 | Thursday 15 October 2026 05:54:18 +0000 (0:00:00.205) 0:00:37.735 ****** 2026-10-15 05:54:18.739428 | mon1 | skipping: [osd1] 2026-10-15 05:54:18.739572 | mon1 | 2026-10-15 05:54:18.739759 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-10-15 05:54:18.739978 | mon1 | Thursday 15 October 2026 05:54:18 +0000 (0:00:00.016) 0:00:37.752 ****** 2026-10-15 05:54:19.310311 | mon1 | changed: [osd1] => (item=osd0) 2026-10-15 05:54:19.310480 | mon1 | changed: [osd1] => (item=osd1) 2026-10-15 05:54:19.310679 | mon1 | changed: [osd1] => (item=osd2) 2026-10-15 05:54:19.310897 | mon1 | 2026-10-15 05:54:19.311104 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-10-15 05:54:19.311286 | mon1 | Thursday 15 October 2026 05:54:19 +0000 (0:00:00.570) 0:00:38.322 ****** 2026-10-15 05:54:20.012750 | mon1 | changed: [osd1] => (item=osd0) 2026-10-15 05:54:20.012993 | mon1 | changed: [osd1] => (item=osd1) 2026-10-15 05:54:20.013350 | mon1 | changed: [osd1] => (item=osd2) 2026-10-15 05:54:20.013524 | mon1 | 2026-10-15 05:54:20.013847 | mon1 | TASK [Start loop devices] ****************************************************** 2026-10-15 05:54:20.014117 | mon1 | Thursday 15 October 2026 05:54:20 +0000 (0:00:00.702) 0:00:39.024 ****** 2026-10-15 05:54:20.788650 | mon1 | changed: [osd1] => (item=osd0) 2026-10-15 05:54:20.788751 | mon1 | changed: [osd1] => (item=osd1) 2026-10-15 05:54:20.788819 | mon1 | changed: [osd1] => (item=osd2) 2026-10-15 05:54:20.788958 | mon1 | 2026-10-15 05:54:20.789073 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-10-15 05:54:20.789176 | mon1 | Thursday 15 October 2026 05:54:20 +0000 (0:00:00.776) 0:00:39.800 ****** 2026-10-15 05:54:24.168216 | mon1 | changed: [osd1] => (item=osd0) 2026-10-15 05:54:24.168393 | mon1 | changed: [osd1] => (item=osd1) 2026-10-15 05:54:24.168610 | mon1 | changed: [osd1] => (item=osd2) 2026-10-15 05:54:24.168804 | mon1 | 2026-10-15 05:54:24.169132 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-10-15 05:54:24.169404 | mon1 | Thursday 15 October 2026 05:54:24 +0000 (0:00:03.379) 0:00:43.180 ****** 2026-10-15 05:54:26.222700 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-10-15 05:54:26.222851 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-10-15 05:54:26.223066 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-10-15 05:54:26.223253 | mon1 | 2026-10-15 05:54:26.223459 | mon1 | PLAY RECAP ********************************************************************* 2026-10-15 05:54:26.223670 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-10-15 05:54:26.223852 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-10-15 05:54:26.224039 | mon1 | 2026-10-15 05:54:26.224207 | mon1 | 2026-10-15 05:54:26.224429 | mon1 | TASKS RECAP ******************************************************************** 2026-10-15 05:54:26.224606 | mon1 | Thursday 15 October 2026 05:54:26 +0000 (0:00:02.055) 0:00:45.235 ****** 2026-10-15 05:54:26.224775 | mon1 | =============================================================================== 2026-10-15 05:54:26.224951 | mon1 | Install depedencies ---------------------------------------------------- 24.25s 2026-10-15 05:54:26.225169 | mon1 | Update apt cache -------------------------------------------------------- 7.80s 2026-10-15 05:54:26.225369 | mon1 | Create a volume group for each loop device ------------------------------ 3.38s 2026-10-15 05:54:26.225556 | mon1 | Create a logical volume for each loop device ---------------------------- 2.06s 2026-10-15 05:54:26.225749 | mon1 | Configure short hostname ------------------------------------------------ 1.51s 2026-10-15 05:54:26.225952 | mon1 | Gathering Facts --------------------------------------------------------- 1.21s 2026-10-15 05:54:26.226155 | mon1 | Start loop devices ------------------------------------------------------ 0.78s 2026-10-15 05:54:26.226354 | mon1 | Gathering Facts --------------------------------------------------------- 0.77s 2026-10-15 05:54:26.226528 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.72s 2026-10-15 05:54:26.226702 | mon1 | Set permissions on loopback devices ------------------------------------- 0.70s 2026-10-15 05:54:26.226871 | mon1 | Start up service -------------------------------------------------------- 0.58s 2026-10-15 05:54:26.227063 | mon1 | Create devices for Ceph ------------------------------------------------- 0.57s 2026-10-15 05:54:26.227245 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.34s 2026-10-15 05:54:26.227497 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.30s 2026-10-15 05:54:26.227702 | mon1 | Get list of all loopback devices ---------------------------------------- 0.21s 2026-10-15 05:54:26.227869 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-10-15 05:54:26.360871 | mon1 | INFO [default > prepare] Executed: Successful 2026-10-15 05:54:26.371664 | mon1 | INFO [default > converge] Executing 2026-10-15 05:54:27.263125 | mon1 | 2026-10-15 05:54:27.263204 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-10-15 05:54:27.263406 | mon1 | 2026-10-15 05:54:27.263610 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 05:54:27.263910 | mon1 | Thursday 15 October 2026 05:54:27 +0000 (0:00:00.043) 0:00:00.043 ****** 2026-10-15 05:54:28.373687 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-10-15 05:54:28.373873 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 05:54:28.374078 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 05:54:28.374275 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 05:54:28.374476 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 05:54:28.390035 | mon1 | ok: [mon1] 2026-10-15 05:54:28.390215 | mon1 | 2026-10-15 05:54:28.390397 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:54:28.390572 | mon1 | Thursday 15 October 2026 05:54:28 +0000 (0:00:01.126) 0:00:01.170 ****** 2026-10-15 05:54:28.722805 | mon1 | ok: [mon1] 2026-10-15 05:54:28.722929 | mon1 | 2026-10-15 05:54:28.723164 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:54:28.723353 | mon1 | Thursday 15 October 2026 05:54:28 +0000 (0:00:00.332) 0:00:01.503 ****** 2026-10-15 05:54:28.768337 | mon1 | skipping: [mon1] 2026-10-15 05:54:28.768481 | mon1 | 2026-10-15 05:54:28.768840 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 05:54:28.768988 | mon1 | Thursday 15 October 2026 05:54:28 +0000 (0:00:00.045) 0:00:01.548 ****** 2026-10-15 05:54:29.117853 | mon1 | changed: [mon1] 2026-10-15 05:54:29.118046 | mon1 | 2026-10-15 05:54:29.118410 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:54:29.118573 | mon1 | Thursday 15 October 2026 05:54:29 +0000 (0:00:00.349) 0:00:01.898 ****** 2026-10-15 05:54:29.242790 | mon1 | ok: [mon1] => { 2026-10-15 05:54:29.242953 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 05:54:29.243155 | mon1 | } 2026-10-15 05:54:29.243459 | mon1 | 2026-10-15 05:54:29.243540 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:54:29.243685 | mon1 | Thursday 15 October 2026 05:54:29 +0000 (0:00:00.124) 0:00:02.023 ****** 2026-10-15 05:54:29.938919 | mon1 | changed: [mon1] 2026-10-15 05:54:29.939000 | mon1 | 2026-10-15 05:54:29.939016 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:54:29.939152 | mon1 | Thursday 15 October 2026 05:54:29 +0000 (0:00:00.696) 0:00:02.719 ****** 2026-10-15 05:54:29.982386 | mon1 | skipping: [mon1] 2026-10-15 05:54:29.982505 | mon1 | 2026-10-15 05:54:29.982697 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:54:29.982947 | mon1 | Thursday 15 October 2026 05:54:29 +0000 (0:00:00.043) 0:00:02.763 ****** 2026-10-15 05:54:30.014811 | mon1 | skipping: [mon1] 2026-10-15 05:54:30.014875 | mon1 | 2026-10-15 05:54:30.015027 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:54:30.015149 | mon1 | Thursday 15 October 2026 05:54:30 +0000 (0:00:00.032) 0:00:02.795 ****** 2026-10-15 05:54:30.230520 | mon1 | ok: [mon1] 2026-10-15 05:54:30.230727 | mon1 | 2026-10-15 05:54:30.230972 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:54:30.231198 | mon1 | Thursday 15 October 2026 05:54:30 +0000 (0:00:00.214) 0:00:03.010 ****** 2026-10-15 05:54:31.599076 | mon1 | ok: [mon1] 2026-10-15 05:54:31.599307 | mon1 | 2026-10-15 05:54:31.599546 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:54:31.599754 | mon1 | Thursday 15 October 2026 05:54:31 +0000 (0:00:01.369) 0:00:04.379 ****** 2026-10-15 05:54:31.685620 | mon1 | ok: [mon1] => { 2026-10-15 05:54:31.685845 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 05:54:31.686042 | mon1 | } 2026-10-15 05:54:31.686234 | mon1 | 2026-10-15 05:54:31.686469 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:54:31.686668 | mon1 | Thursday 15 October 2026 05:54:31 +0000 (0:00:00.086) 0:00:04.466 ****** 2026-10-15 05:54:32.425855 | mon1 | changed: [mon1] 2026-10-15 05:54:32.426022 | mon1 | 2026-10-15 05:54:32.426253 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:54:32.426448 | mon1 | Thursday 15 October 2026 05:54:32 +0000 (0:00:00.740) 0:00:05.206 ****** 2026-10-15 05:54:35.441730 | mon1 | changed: [mon1] 2026-10-15 05:54:35.441816 | mon1 | 2026-10-15 05:54:35.441829 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 05:54:35.441838 | mon1 | Thursday 15 October 2026 05:54:35 +0000 (0:00:03.015) 0:00:08.222 ****** 2026-10-15 05:54:35.474404 | mon1 | skipping: [mon1] 2026-10-15 05:54:35.474557 | mon1 | 2026-10-15 05:54:35.474566 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 05:54:35.474573 | mon1 | Thursday 15 October 2026 05:54:35 +0000 (0:00:00.032) 0:00:08.255 ****** 2026-10-15 05:54:35.512107 | mon1 | skipping: [mon1] 2026-10-15 05:54:35.512745 | mon1 | 2026-10-15 05:54:35.512834 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 05:54:35.512846 | mon1 | Thursday 15 October 2026 05:54:35 +0000 (0:00:00.037) 0:00:08.292 ****** 2026-10-15 05:54:35.547730 | mon1 | skipping: [mon1] 2026-10-15 05:54:35.547897 | mon1 | 2026-10-15 05:54:35.548198 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 05:54:35.548479 | mon1 | Thursday 15 October 2026 05:54:35 +0000 (0:00:00.036) 0:00:08.328 ****** 2026-10-15 05:54:41.910197 | mon1 | changed: [mon1] 2026-10-15 05:54:41.910298 | mon1 | 2026-10-15 05:54:41.910505 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 05:54:41.910674 | mon1 | Thursday 15 October 2026 05:54:41 +0000 (0:00:06.362) 0:00:14.690 ****** 2026-10-15 05:54:42.570359 | mon1 | changed: [mon1] 2026-10-15 05:54:42.570459 | mon1 | 2026-10-15 05:54:42.570690 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 05:54:42.570855 | mon1 | Thursday 15 October 2026 05:54:42 +0000 (0:00:00.660) 0:00:15.350 ****** 2026-10-15 05:54:43.603216 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-10-15 05:54:43.603379 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 05:54:43.603607 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 05:54:43.603807 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 05:54:43.603990 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 05:54:43.604155 | mon1 | 2026-10-15 05:54:43.604321 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 05:54:43.604498 | mon1 | Thursday 15 October 2026 05:54:43 +0000 (0:00:01.032) 0:00:16.383 ****** 2026-10-15 05:54:44.285884 | mon1 | changed: [mon1] 2026-10-15 05:54:44.286177 | mon1 | 2026-10-15 05:54:44.286399 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 05:54:44.286619 | mon1 | Thursday 15 October 2026 05:54:44 +0000 (0:00:00.669) 0:00:17.052 ****** 2026-10-15 05:54:44.286785 | mon1 | 2026-10-15 05:54:44.286953 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-10-15 05:54:44.287126 | mon1 | Thursday 15 October 2026 05:54:44 +0000 (0:00:00.013) 0:00:17.066 ****** 2026-10-15 05:54:45.364923 | mon1 | ok: [mon1] 2026-10-15 05:54:45.365005 | mon1 | 2026-10-15 05:54:45.365018 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-10-15 05:54:45.365027 | mon1 | Thursday 15 October 2026 05:54:45 +0000 (0:00:01.078) 0:00:18.144 ****** 2026-10-15 05:54:45.882847 | mon1 | changed: [mon1] 2026-10-15 05:54:45.882949 | mon1 | 2026-10-15 05:54:45.883176 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 05:54:45.883238 | mon1 | Thursday 15 October 2026 05:54:45 +0000 (0:00:00.518) 0:00:18.663 ****** 2026-10-15 05:54:46.513220 | mon1 | changed: [mon1] 2026-10-15 05:54:46.513821 | mon1 | 2026-10-15 05:54:46.513856 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:54:46.513868 | mon1 | Thursday 15 October 2026 05:54:46 +0000 (0:00:00.630) 0:00:19.293 ****** 2026-10-15 05:54:46.736064 | mon1 | ok: [mon1] 2026-10-15 05:54:46.736136 | mon1 | 2026-10-15 05:54:46.736379 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:54:46.736401 | mon1 | Thursday 15 October 2026 05:54:46 +0000 (0:00:00.223) 0:00:19.517 ****** 2026-10-15 05:54:46.830282 | mon1 | ok: [mon1] => { 2026-10-15 05:54:46.830353 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 05:54:46.830412 | mon1 | } 2026-10-15 05:54:46.830722 | mon1 | 2026-10-15 05:54:46.830785 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:54:46.830792 | mon1 | Thursday 15 October 2026 05:54:46 +0000 (0:00:00.093) 0:00:19.611 ****** 2026-10-15 05:54:47.824560 | mon1 | changed: [mon1] 2026-10-15 05:54:47.824646 | mon1 | 2026-10-15 05:54:47.825136 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:54:47.825211 | mon1 | Thursday 15 October 2026 05:54:47 +0000 (0:00:00.993) 0:00:20.605 ****** 2026-10-15 05:54:52.293032 | mon1 | changed: [mon1] 2026-10-15 05:54:52.293714 | mon1 | 2026-10-15 05:54:52.293949 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 05:54:52.293967 | mon1 | Thursday 15 October 2026 05:54:52 +0000 (0:00:04.468) 0:00:25.073 ****** 2026-10-15 05:54:53.794403 | mon1 | ok: [mon1] 2026-10-15 05:54:53.794998 | mon1 | 2026-10-15 05:54:53.795059 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 05:54:53.795071 | mon1 | Thursday 15 October 2026 05:54:53 +0000 (0:00:01.501) 0:00:26.574 ****** 2026-10-15 05:54:54.186502 | mon1 | changed: [mon1] 2026-10-15 05:54:54.187135 | mon1 | 2026-10-15 05:54:54.187196 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 05:54:54.187207 | mon1 | Thursday 15 October 2026 05:54:54 +0000 (0:00:00.392) 0:00:26.966 ****** 2026-10-15 05:54:54.663444 | mon1 | changed: [mon1] 2026-10-15 05:54:54.663510 | mon1 | 2026-10-15 05:54:54.663565 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 05:54:54.663677 | mon1 | Thursday 15 October 2026 05:54:54 +0000 (0:00:00.477) 0:00:27.444 ****** 2026-10-15 05:54:55.266613 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-10-15 05:54:55.267484 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 05:54:55.267518 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 05:54:55.267529 | mon1 | 2026-10-15 05:54:55.267538 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 05:54:55.267547 | mon1 | Thursday 15 October 2026 05:54:55 +0000 (0:00:00.602) 0:00:28.047 ****** 2026-10-15 05:54:55.749646 | mon1 | changed: [mon1] 2026-10-15 05:54:55.749750 | mon1 | 2026-10-15 05:54:55.750147 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 05:54:55.750170 | mon1 | Thursday 15 October 2026 05:54:55 +0000 (0:00:00.483) 0:00:28.530 ****** 2026-10-15 05:54:56.256263 | mon1 | changed: [mon1] 2026-10-15 05:54:56.256367 | mon1 | 2026-10-15 05:54:56.257417 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 05:54:56.257512 | mon1 | Thursday 15 October 2026 05:54:56 +0000 (0:00:00.494) 0:00:29.024 ****** 2026-10-15 05:54:56.257526 | mon1 | 2026-10-15 05:54:56.257536 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-10-15 05:54:56.257569 | mon1 | Thursday 15 October 2026 05:54:56 +0000 (0:00:00.011) 0:00:29.036 ****** 2026-10-15 05:54:56.967831 | mon1 | ok: [mon1] 2026-10-15 05:54:56.968671 | mon1 | 2026-10-15 05:54:56.968726 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-10-15 05:54:56.968741 | mon1 | Thursday 15 October 2026 05:54:56 +0000 (0:00:00.711) 0:00:29.748 ****** 2026-10-15 05:54:57.865300 | mon1 | changed: [mon1] 2026-10-15 05:54:57.865365 | mon1 | 2026-10-15 05:54:57.865373 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 05:54:57.865379 | mon1 | Thursday 15 October 2026 05:54:57 +0000 (0:00:00.897) 0:00:30.646 ****** 2026-10-15 05:54:58.442226 | mon1 | changed: [mon1] 2026-10-15 05:54:58.442265 | mon1 | 2026-10-15 05:54:58.442270 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 05:54:58.442274 | mon1 | Thursday 15 October 2026 05:54:58 +0000 (0:00:00.576) 0:00:31.223 ****** 2026-10-15 05:54:58.503412 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 05:54:58.503459 | mon1 | 2026-10-15 05:54:58.503466 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 05:54:58.503472 | mon1 | Thursday 15 October 2026 05:54:58 +0000 (0:00:00.060) 0:00:31.284 ****** 2026-10-15 05:55:25.633588 | mon1 | changed: [mon1] 2026-10-15 05:55:25.633693 | mon1 | 2026-10-15 05:55:25.634017 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 05:55:25.634275 | mon1 | Thursday 15 October 2026 05:55:25 +0000 (0:00:27.129) 0:00:58.413 ****** 2026-10-15 05:55:26.455042 | mon1 | ok: [mon1] => (item=chronyd) 2026-10-15 05:55:26.455900 | mon1 | ok: [mon1] => (item=sshd) 2026-10-15 05:55:26.456114 | mon1 | 2026-10-15 05:55:26.456127 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 05:55:26.456138 | mon1 | Thursday 15 October 2026 05:55:26 +0000 (0:00:00.821) 0:00:59.235 ****** 2026-10-15 05:55:26.781439 | mon1 | changed: [mon1] 2026-10-15 05:55:26.781511 | mon1 | 2026-10-15 05:55:26.781526 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 05:55:26.781538 | mon1 | Thursday 15 October 2026 05:55:26 +0000 (0:00:00.325) 0:00:59.560 ****** 2026-10-15 05:55:26.988340 | mon1 | ok: [mon1] 2026-10-15 05:55:26.988930 | mon1 | 2026-10-15 05:55:26.988999 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 05:55:26.989011 | mon1 | Thursday 15 October 2026 05:55:26 +0000 (0:00:00.207) 0:00:59.768 ****** 2026-10-15 05:55:27.436902 | mon1 | changed: [mon1] 2026-10-15 05:55:27.436978 | mon1 | 2026-10-15 05:55:27.437243 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 05:55:27.437298 | mon1 | Thursday 15 October 2026 05:55:27 +0000 (0:00:00.449) 0:01:00.217 ****** 2026-10-15 05:55:27.767373 | mon1 | changed: [mon1] 2026-10-15 05:55:27.767455 | mon1 | 2026-10-15 05:55:27.767930 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-10-15 05:55:27.767982 | mon1 | Thursday 15 October 2026 05:55:27 +0000 (0:00:00.330) 0:01:00.548 ****** 2026-10-15 05:55:27.903520 | mon1 | ok: [mon1] 2026-10-15 05:55:27.904086 | mon1 | 2026-10-15 05:55:27.904145 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-10-15 05:55:27.904156 | mon1 | Thursday 15 October 2026 05:55:27 +0000 (0:00:00.135) 0:01:00.684 ****** 2026-10-15 05:55:28.143586 | mon1 | ok: [mon1] => (item=mon1) 2026-10-15 05:55:28.144178 | mon1 | 2026-10-15 05:55:28.144240 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-10-15 05:55:28.144252 | mon1 | Thursday 15 October 2026 05:55:28 +0000 (0:00:00.240) 0:01:00.924 ****** 2026-10-15 05:55:28.203862 | mon1 | ok: [mon1] 2026-10-15 05:55:28.204420 | mon1 | 2026-10-15 05:55:28.204481 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-10-15 05:55:28.204493 | mon1 | Thursday 15 October 2026 05:55:28 +0000 (0:00:00.060) 0:01:00.984 ****** 2026-10-15 05:55:28.299136 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-10-15 05:55:28.299233 | mon1 | 2026-10-15 05:55:28.299249 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-10-15 05:55:28.299390 | mon1 | Thursday 15 October 2026 05:55:28 +0000 (0:00:00.095) 0:01:01.080 ****** 2026-10-15 05:55:28.637365 | mon1 | changed: [mon1] 2026-10-15 05:55:28.637924 | mon1 | 2026-10-15 05:55:28.638032 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-10-15 05:55:28.638169 | mon1 | Thursday 15 October 2026 05:55:28 +0000 (0:00:00.337) 0:01:01.417 ****** 2026-10-15 05:55:29.346761 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-10-15 05:55:29.346843 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-10-15 05:55:29.347151 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-10-15 05:55:29.347167 | mon1 | 2026-10-15 05:55:29.347172 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-10-15 05:55:29.347176 | mon1 | Thursday 15 October 2026 05:55:29 +0000 (0:00:00.710) 0:01:02.127 ****** 2026-10-15 05:56:58.967971 | mon1 | ok: [mon1] 2026-10-15 05:56:58.968073 | mon1 | 2026-10-15 05:56:58.968086 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-10-15 05:56:58.968098 | mon1 | Thursday 15 October 2026 05:56:58 +0000 (0:01:29.618) 0:02:31.746 ****** 2026-10-15 05:56:59.205140 | mon1 | changed: [mon1] 2026-10-15 05:56:59.205243 | mon1 | 2026-10-15 05:56:59.205356 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-10-15 05:56:59.205501 | mon1 | Thursday 15 October 2026 05:56:59 +0000 (0:00:00.236) 0:02:31.983 ****** 2026-10-15 05:56:59.235265 | mon1 | ok: [mon1] 2026-10-15 05:56:59.235323 | mon1 | 2026-10-15 05:56:59.235457 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 05:56:59.235583 | mon1 | Thursday 15 October 2026 05:56:59 +0000 (0:00:00.033) 0:02:32.016 ****** 2026-10-15 05:56:59.295071 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-10-15 05:56:59.295126 | mon1 | 2026-10-15 05:56:59.295234 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 05:56:59.295323 | mon1 | Thursday 15 October 2026 05:56:59 +0000 (0:00:00.060) 0:02:32.076 ****** 2026-10-15 05:57:00.815490 | mon1 | ok: [mon1] 2026-10-15 05:57:00.815648 | mon1 | 2026-10-15 05:57:00.815859 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 05:57:00.816059 | mon1 | Thursday 15 October 2026 05:57:00 +0000 (0:00:01.519) 0:02:33.595 ****** 2026-10-15 05:57:00.876402 | mon1 | ok: [mon1] => (item=mon1) 2026-10-15 05:57:00.876448 | mon1 | 2026-10-15 05:57:00.876558 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 05:57:00.876649 | mon1 | Thursday 15 October 2026 05:57:00 +0000 (0:00:00.061) 0:02:33.657 ****** 2026-10-15 05:57:01.265109 | mon1 | ok: [mon1] 2026-10-15 05:57:01.265225 | mon1 | 2026-10-15 05:57:01.265372 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 05:57:01.265475 | mon1 | Thursday 15 October 2026 05:57:01 +0000 (0:00:00.388) 0:02:34.045 ****** 2026-10-15 05:57:03.440699 | mon1 | ok: [mon1] 2026-10-15 05:57:03.440776 | mon1 | 2026-10-15 05:57:03.440878 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-10-15 05:57:03.440992 | mon1 | Thursday 15 October 2026 05:57:03 +0000 (0:00:02.175) 0:02:36.221 ****** 2026-10-15 05:57:06.305923 | mon1 | changed: [mon1] 2026-10-15 05:57:06.306016 | mon1 | 2026-10-15 05:57:06.306039 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-10-15 05:57:06.306384 | mon1 | Thursday 15 October 2026 05:57:06 +0000 (0:00:02.864) 0:02:39.085 ****** 2026-10-15 05:57:07.909271 | mon1 | ok: [mon1] 2026-10-15 05:57:07.909371 | mon1 | 2026-10-15 05:57:07.909397 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 05:57:07.909405 | mon1 | Thursday 15 October 2026 05:57:07 +0000 (0:00:01.603) 0:02:40.689 ****** 2026-10-15 05:57:07.985325 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-10-15 05:57:07.985418 | mon1 | 2026-10-15 05:57:07.985428 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 05:57:07.985436 | mon1 | Thursday 15 October 2026 05:57:07 +0000 (0:00:00.076) 0:02:40.765 ****** 2026-10-15 05:57:08.041553 | mon1 | skipping: [mon1] 2026-10-15 05:57:08.041636 | mon1 | 2026-10-15 05:57:08.041644 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 05:57:08.041652 | mon1 | Thursday 15 October 2026 05:57:08 +0000 (0:00:00.056) 0:02:40.821 ****** 2026-10-15 05:57:08.097167 | mon1 | skipping: [mon1] => (item=mon1) 2026-10-15 05:57:08.097961 | mon1 | skipping: [mon1] 2026-10-15 05:57:08.098034 | mon1 | 2026-10-15 05:57:08.098046 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 05:57:08.098057 | mon1 | Thursday 15 October 2026 05:57:08 +0000 (0:00:00.055) 0:02:40.877 ****** 2026-10-15 05:57:08.382645 | mon1 | ok: [mon1] 2026-10-15 05:57:08.382714 | mon1 | 2026-10-15 05:57:08.382791 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 05:57:08.382868 | mon1 | Thursday 15 October 2026 05:57:08 +0000 (0:00:00.286) 0:02:41.163 ****** 2026-10-15 05:57:10.482971 | mon1 | ok: [mon1] 2026-10-15 05:57:10.483049 | mon1 | 2026-10-15 05:57:10.483368 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-10-15 05:57:10.483413 | mon1 | Thursday 15 October 2026 05:57:10 +0000 (0:00:02.100) 0:02:43.263 ****** 2026-10-15 05:57:13.508826 | mon1 | changed: [mon1] 2026-10-15 05:57:13.508946 | mon1 | 2026-10-15 05:57:13.509368 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-10-15 05:57:13.509439 | mon1 | Thursday 15 October 2026 05:57:13 +0000 (0:00:03.025) 0:02:46.289 ****** 2026-10-15 05:57:15.061938 | mon1 | ok: [mon1] 2026-10-15 05:57:15.062047 | mon1 | 2026-10-15 05:57:15.062060 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-10-15 05:57:15.062195 | mon1 | Thursday 15 October 2026 05:57:15 +0000 (0:00:01.553) 0:02:47.842 ****** 2026-10-15 05:57:20.633692 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-10-15 05:57:20.633807 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-10-15 05:57:20.633815 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-10-15 05:57:20.633820 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-10-15 05:57:20.633825 | mon1 | 2026-10-15 05:57:20.633830 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-10-15 05:57:20.633835 | mon1 | 2026-10-15 05:57:20.633839 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 05:57:20.633844 | mon1 | Thursday 15 October 2026 05:57:20 +0000 (0:00:05.571) 0:02:53.413 ****** 2026-10-15 05:57:21.818832 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-10-15 05:57:21.818878 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 05:57:21.818887 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 05:57:21.818894 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 05:57:21.818900 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 05:57:21.830857 | mon1 | ok: [osd1] 2026-10-15 05:57:21.831029 | mon1 | 2026-10-15 05:57:21.831255 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:57:21.831435 | mon1 | Thursday 15 October 2026 05:57:21 +0000 (0:00:01.197) 0:02:54.611 ****** 2026-10-15 05:57:22.075833 | mon1 | ok: [osd1] 2026-10-15 05:57:22.075975 | mon1 | 2026-10-15 05:57:22.076176 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:57:22.076371 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.245) 0:02:54.856 ****** 2026-10-15 05:57:22.114792 | mon1 | skipping: [osd1] 2026-10-15 05:57:22.114859 | mon1 | 2026-10-15 05:57:22.114877 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 05:57:22.115054 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.038) 0:02:54.895 ****** 2026-10-15 05:57:22.337809 | mon1 | changed: [osd1] 2026-10-15 05:57:22.337849 | mon1 | 2026-10-15 05:57:22.337855 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:57:22.337859 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.218) 0:02:55.113 ****** 2026-10-15 05:57:22.393818 | mon1 | ok: [osd1] => { 2026-10-15 05:57:22.393868 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 05:57:22.393874 | mon1 | } 2026-10-15 05:57:22.393878 | mon1 | 2026-10-15 05:57:22.393883 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:57:22.393887 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.058) 0:02:55.172 ****** 2026-10-15 05:57:22.919362 | mon1 | changed: [osd1] 2026-10-15 05:57:22.919420 | mon1 | 2026-10-15 05:57:22.919431 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:57:22.919441 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.526) 0:02:55.699 ****** 2026-10-15 05:57:22.963776 | mon1 | skipping: [osd1] 2026-10-15 05:57:22.963821 | mon1 | 2026-10-15 05:57:22.963828 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:57:22.963835 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.045) 0:02:55.744 ****** 2026-10-15 05:57:22.995391 | mon1 | skipping: [osd1] 2026-10-15 05:57:22.995432 | mon1 | 2026-10-15 05:57:22.995447 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:57:22.995454 | mon1 | Thursday 15 October 2026 05:57:22 +0000 (0:00:00.031) 0:02:55.776 ****** 2026-10-15 05:57:23.210914 | mon1 | ok: [osd1] 2026-10-15 05:57:23.210959 | mon1 | 2026-10-15 05:57:23.210967 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:57:23.210974 | mon1 | Thursday 15 October 2026 05:57:23 +0000 (0:00:00.215) 0:02:55.991 ****** 2026-10-15 05:57:24.305950 | mon1 | ok: [osd1] 2026-10-15 05:57:24.306550 | mon1 | 2026-10-15 05:57:24.306611 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:57:24.306624 | mon1 | Thursday 15 October 2026 05:57:24 +0000 (0:00:01.094) 0:02:57.086 ****** 2026-10-15 05:57:24.396528 | mon1 | ok: [osd1] => { 2026-10-15 05:57:24.396871 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 05:57:24.397054 | mon1 | } 2026-10-15 05:57:24.397243 | mon1 | 2026-10-15 05:57:24.397431 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:57:24.397610 | mon1 | Thursday 15 October 2026 05:57:24 +0000 (0:00:00.090) 0:02:57.176 ****** 2026-10-15 05:57:25.264808 | mon1 | changed: [osd1] 2026-10-15 05:57:25.264978 | mon1 | 2026-10-15 05:57:25.265308 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:57:25.265570 | mon1 | Thursday 15 October 2026 05:57:25 +0000 (0:00:00.869) 0:02:58.045 ****** 2026-10-15 05:57:27.951555 | mon1 | changed: [osd1] 2026-10-15 05:57:27.951613 | mon1 | 2026-10-15 05:57:27.951797 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 05:57:27.951925 | mon1 | Thursday 15 October 2026 05:57:27 +0000 (0:00:02.686) 0:03:00.732 ****** 2026-10-15 05:57:27.980435 | mon1 | skipping: [osd1] 2026-10-15 05:57:27.980650 | mon1 | 2026-10-15 05:57:27.980940 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 05:57:27.981258 | mon1 | Thursday 15 October 2026 05:57:27 +0000 (0:00:00.028) 0:03:00.760 ****** 2026-10-15 05:57:27.996415 | mon1 | skipping: [osd1] 2026-10-15 05:57:27.996485 | mon1 | 2026-10-15 05:57:27.996603 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 05:57:27.996701 | mon1 | Thursday 15 October 2026 05:57:27 +0000 (0:00:00.016) 0:03:00.777 ****** 2026-10-15 05:57:28.019999 | mon1 | skipping: [osd1] 2026-10-15 05:57:28.020076 | mon1 | 2026-10-15 05:57:28.020307 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 05:57:28.020360 | mon1 | Thursday 15 October 2026 05:57:28 +0000 (0:00:00.023) 0:03:00.801 ****** 2026-10-15 05:57:33.366981 | mon1 | changed: [osd1] 2026-10-15 05:57:33.367163 | mon1 | 2026-10-15 05:57:33.367411 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 05:57:33.367648 | mon1 | Thursday 15 October 2026 05:57:33 +0000 (0:00:05.346) 0:03:06.147 ****** 2026-10-15 05:57:33.800031 | mon1 | changed: [osd1] 2026-10-15 05:57:33.800224 | mon1 | 2026-10-15 05:57:33.800466 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 05:57:33.800717 | mon1 | Thursday 15 October 2026 05:57:33 +0000 (0:00:00.433) 0:03:06.580 ****** 2026-10-15 05:57:34.732835 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-10-15 05:57:34.732936 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 05:57:34.732949 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 05:57:34.732956 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 05:57:34.732962 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 05:57:34.732968 | mon1 | 2026-10-15 05:57:34.732973 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 05:57:34.732979 | mon1 | Thursday 15 October 2026 05:57:34 +0000 (0:00:00.932) 0:03:07.512 ****** 2026-10-15 05:57:35.344420 | mon1 | changed: [osd1] 2026-10-15 05:57:35.345507 | mon1 | 2026-10-15 05:57:35.345565 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 05:57:35.345577 | mon1 | Thursday 15 October 2026 05:57:35 +0000 (0:00:00.601) 0:03:08.114 ****** 2026-10-15 05:57:35.345587 | mon1 | 2026-10-15 05:57:35.345596 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-10-15 05:57:35.345605 | mon1 | Thursday 15 October 2026 05:57:35 +0000 (0:00:00.010) 0:03:08.125 ****** 2026-10-15 05:57:36.038666 | mon1 | ok: [osd1] 2026-10-15 05:57:36.038779 | mon1 | 2026-10-15 05:57:36.039043 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-10-15 05:57:36.039144 | mon1 | Thursday 15 October 2026 05:57:36 +0000 (0:00:00.694) 0:03:08.819 ****** 2026-10-15 05:57:36.497314 | mon1 | changed: [osd1] 2026-10-15 05:57:36.497441 | mon1 | 2026-10-15 05:57:36.497969 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 05:57:36.498042 | mon1 | Thursday 15 October 2026 05:57:36 +0000 (0:00:00.458) 0:03:09.277 ****** 2026-10-15 05:57:37.102726 | mon1 | changed: [osd1] 2026-10-15 05:57:37.103113 | mon1 | 2026-10-15 05:57:37.103511 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:57:37.103850 | mon1 | Thursday 15 October 2026 05:57:37 +0000 (0:00:00.604) 0:03:09.882 ****** 2026-10-15 05:57:37.329315 | mon1 | ok: [osd1] 2026-10-15 05:57:37.329373 | mon1 | 2026-10-15 05:57:37.329385 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:57:37.329396 | mon1 | Thursday 15 October 2026 05:57:37 +0000 (0:00:00.226) 0:03:10.108 ****** 2026-10-15 05:57:37.403325 | mon1 | ok: [osd1] => { 2026-10-15 05:57:37.403393 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 05:57:37.403409 | mon1 | } 2026-10-15 05:57:37.403423 | mon1 | 2026-10-15 05:57:37.403434 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:57:37.403444 | mon1 | Thursday 15 October 2026 05:57:37 +0000 (0:00:00.073) 0:03:10.182 ****** 2026-10-15 05:57:38.303450 | mon1 | changed: [osd1] 2026-10-15 05:57:38.304010 | mon1 | 2026-10-15 05:57:38.304068 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:57:38.304080 | mon1 | Thursday 15 October 2026 05:57:38 +0000 (0:00:00.901) 0:03:11.083 ****** 2026-10-15 05:57:42.739426 | mon1 | changed: [osd1] 2026-10-15 05:57:42.739542 | mon1 | 2026-10-15 05:57:42.739894 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 05:57:42.739964 | mon1 | Thursday 15 October 2026 05:57:42 +0000 (0:00:04.436) 0:03:15.520 ****** 2026-10-15 05:57:43.779819 | mon1 | ok: [osd1] 2026-10-15 05:57:43.780488 | mon1 | 2026-10-15 05:57:43.780548 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 05:57:43.780563 | mon1 | Thursday 15 October 2026 05:57:43 +0000 (0:00:01.039) 0:03:16.560 ****** 2026-10-15 05:57:44.044385 | mon1 | changed: [osd1] 2026-10-15 05:57:44.044988 | mon1 | 2026-10-15 05:57:44.045058 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 05:57:44.045071 | mon1 | Thursday 15 October 2026 05:57:44 +0000 (0:00:00.264) 0:03:16.824 ****** 2026-10-15 05:57:44.577723 | mon1 | changed: [osd1] 2026-10-15 05:57:44.578331 | mon1 | 2026-10-15 05:57:44.578394 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 05:57:44.578406 | mon1 | Thursday 15 October 2026 05:57:44 +0000 (0:00:00.533) 0:03:17.358 ****** 2026-10-15 05:57:45.218305 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-10-15 05:57:45.219234 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 05:57:45.219292 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 05:57:45.219304 | mon1 | 2026-10-15 05:57:45.219314 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 05:57:45.219323 | mon1 | Thursday 15 October 2026 05:57:45 +0000 (0:00:00.640) 0:03:17.998 ****** 2026-10-15 05:57:45.711134 | mon1 | changed: [osd1] 2026-10-15 05:57:45.712182 | mon1 | 2026-10-15 05:57:45.712220 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 05:57:45.712234 | mon1 | Thursday 15 October 2026 05:57:45 +0000 (0:00:00.492) 0:03:18.491 ****** 2026-10-15 05:57:46.216178 | mon1 | changed: [osd1] 2026-10-15 05:57:46.216273 | mon1 | 2026-10-15 05:57:46.216989 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 05:57:46.217036 | mon1 | Thursday 15 October 2026 05:57:46 +0000 (0:00:00.498) 0:03:18.989 ****** 2026-10-15 05:57:46.217045 | mon1 | 2026-10-15 05:57:46.217052 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-10-15 05:57:46.217058 | mon1 | Thursday 15 October 2026 05:57:46 +0000 (0:00:00.007) 0:03:18.997 ****** 2026-10-15 05:57:46.983506 | mon1 | ok: [osd1] 2026-10-15 05:57:46.983643 | mon1 | 2026-10-15 05:57:46.984058 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-10-15 05:57:46.984115 | mon1 | Thursday 15 October 2026 05:57:46 +0000 (0:00:00.766) 0:03:19.764 ****** 2026-10-15 05:57:47.805592 | mon1 | changed: [osd1] 2026-10-15 05:57:47.805679 | mon1 | 2026-10-15 05:57:47.806242 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 05:57:47.806301 | mon1 | Thursday 15 October 2026 05:57:47 +0000 (0:00:00.821) 0:03:20.586 ****** 2026-10-15 05:57:48.384510 | mon1 | changed: [osd1] 2026-10-15 05:57:48.384579 | mon1 | 2026-10-15 05:57:48.384905 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 05:57:48.384959 | mon1 | Thursday 15 October 2026 05:57:48 +0000 (0:00:00.579) 0:03:21.165 ****** 2026-10-15 05:57:48.445380 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 05:57:48.445970 | mon1 | 2026-10-15 05:57:48.446030 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 05:57:48.446047 | mon1 | Thursday 15 October 2026 05:57:48 +0000 (0:00:00.060) 0:03:21.225 ****** 2026-10-15 05:57:54.022302 | mon1 | changed: [osd1] 2026-10-15 05:57:54.022373 | mon1 | 2026-10-15 05:57:54.022468 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 05:57:54.022570 | mon1 | Thursday 15 October 2026 05:57:54 +0000 (0:00:05.576) 0:03:26.802 ****** 2026-10-15 05:57:54.689786 | mon1 | ok: [osd1] => (item=chronyd) 2026-10-15 05:57:54.689962 | mon1 | ok: [osd1] => (item=sshd) 2026-10-15 05:57:54.690139 | mon1 | 2026-10-15 05:57:54.690352 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 05:57:54.690538 | mon1 | Thursday 15 October 2026 05:57:54 +0000 (0:00:00.667) 0:03:27.470 ****** 2026-10-15 05:57:55.001182 | mon1 | changed: [osd1] 2026-10-15 05:57:55.001314 | mon1 | 2026-10-15 05:57:55.001499 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 05:57:55.001684 | mon1 | Thursday 15 October 2026 05:57:54 +0000 (0:00:00.311) 0:03:27.781 ****** 2026-10-15 05:57:55.217639 | mon1 | ok: [osd1] 2026-10-15 05:57:55.217796 | mon1 | 2026-10-15 05:57:55.218565 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 05:57:55.218828 | mon1 | Thursday 15 October 2026 05:57:55 +0000 (0:00:00.216) 0:03:27.998 ****** 2026-10-15 05:57:55.551500 | mon1 | changed: [osd1] 2026-10-15 05:57:55.551652 | mon1 | 2026-10-15 05:57:55.551945 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 05:57:55.552186 | mon1 | Thursday 15 October 2026 05:57:55 +0000 (0:00:00.334) 0:03:28.332 ****** 2026-10-15 05:57:55.779917 | mon1 | changed: [osd1] 2026-10-15 05:57:55.779989 | mon1 | 2026-10-15 05:57:55.780113 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-10-15 05:57:55.780382 | mon1 | Thursday 15 October 2026 05:57:55 +0000 (0:00:00.228) 0:03:28.560 ****** 2026-10-15 05:57:55.986129 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-10-15 05:57:55.986316 | mon1 | 2026-10-15 05:57:55.986520 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-10-15 05:57:55.986746 | mon1 | Thursday 15 October 2026 05:57:55 +0000 (0:00:00.206) 0:03:28.767 ****** 2026-10-15 05:57:56.038680 | mon1 | ok: [osd1] 2026-10-15 05:57:56.038796 | mon1 | 2026-10-15 05:57:56.038982 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 05:57:56.039180 | mon1 | Thursday 15 October 2026 05:57:56 +0000 (0:00:00.052) 0:03:28.819 ****** 2026-10-15 05:57:56.082840 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-10-15 05:57:56.083000 | mon1 | 2026-10-15 05:57:56.083322 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 05:57:56.083581 | mon1 | Thursday 15 October 2026 05:57:56 +0000 (0:00:00.044) 0:03:28.863 ****** 2026-10-15 05:57:57.520176 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:57:57.520315 | mon1 | 2026-10-15 05:57:57.520529 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 05:57:57.520718 | mon1 | Thursday 15 October 2026 05:57:57 +0000 (0:00:01.437) 0:03:30.301 ****** 2026-10-15 05:57:57.574354 | mon1 | ok: [osd1] => (item=osd1) 2026-10-15 05:57:57.574523 | mon1 | 2026-10-15 05:57:57.574718 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 05:57:57.574904 | mon1 | Thursday 15 October 2026 05:57:57 +0000 (0:00:00.053) 0:03:30.354 ****** 2026-10-15 05:57:57.856109 | mon1 | changed: [osd1] 2026-10-15 05:57:57.856307 | mon1 | 2026-10-15 05:57:57.856527 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 05:57:57.856787 | mon1 | Thursday 15 October 2026 05:57:57 +0000 (0:00:00.281) 0:03:30.636 ****** 2026-10-15 05:58:02.809823 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:58:02.810010 | mon1 | 2026-10-15 05:58:02.810021 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-10-15 05:58:02.810028 | mon1 | Thursday 15 October 2026 05:58:02 +0000 (0:00:04.953) 0:03:35.590 ****** 2026-10-15 05:58:03.505344 | mon1 | ok: [osd1] 2026-10-15 05:58:03.505748 | mon1 | 2026-10-15 05:58:03.505802 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-10-15 05:58:03.505816 | mon1 | Thursday 15 October 2026 05:58:03 +0000 (0:00:00.695) 0:03:36.286 ****** 2026-10-15 05:58:50.375390 | mon1 | ok: [osd1] 2026-10-15 05:58:50.376026 | mon1 | 2026-10-15 05:58:50.376082 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-10-15 05:58:50.376094 | mon1 | Thursday 15 October 2026 05:58:50 +0000 (0:00:46.869) 0:04:23.155 ****** 2026-10-15 05:59:32.619847 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-10-15 05:59:32.620834 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-10-15 05:59:32.620893 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-10-15 05:59:32.620904 | mon1 | 2026-10-15 05:59:32.620913 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-10-15 05:59:32.620922 | mon1 | Thursday 15 October 2026 05:59:32 +0000 (0:00:42.244) 0:05:05.400 ****** 2026-10-15 05:59:34.230561 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:59:34.230666 | mon1 | 2026-10-15 05:59:34.231094 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-10-15 05:59:34.231157 | mon1 | Thursday 15 October 2026 05:59:34 +0000 (0:00:01.610) 0:05:07.011 ****** 2026-10-15 05:59:35.822422 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:59:35.822963 | mon1 | 2026-10-15 05:59:35.822995 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-10-15 05:59:35.823006 | mon1 | Thursday 15 October 2026 05:59:35 +0000 (0:00:01.591) 0:05:08.603 ****** 2026-10-15 05:59:35.891015 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-10-15 05:59:35.891105 | mon1 | 2026-10-15 05:59:35.891453 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-10-15 05:59:35.891482 | mon1 | Thursday 15 October 2026 05:59:35 +0000 (0:00:00.069) 0:05:08.672 ****** 2026-10-15 05:59:35.940840 | mon1 | ok: [osd1] 2026-10-15 05:59:35.940903 | mon1 | 2026-10-15 05:59:35.941169 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-10-15 05:59:35.941190 | mon1 | Thursday 15 October 2026 05:59:35 +0000 (0:00:00.049) 0:05:08.721 ****** 2026-10-15 05:59:37.470696 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:59:37.470761 | mon1 | 2026-10-15 05:59:37.471112 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-10-15 05:59:37.471158 | mon1 | Thursday 15 October 2026 05:59:37 +0000 (0:00:01.529) 0:05:10.251 ****** 2026-10-15 05:59:37.520233 | mon1 | ok: [osd1] 2026-10-15 05:59:37.520412 | mon1 | 2026-10-15 05:59:37.520553 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-10-15 05:59:37.520683 | mon1 | Thursday 15 October 2026 05:59:37 +0000 (0:00:00.048) 0:05:10.300 ****** 2026-10-15 05:59:37.561233 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-10-15 05:59:37.577648 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 05:59:37.577822 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 05:59:37.578004 | mon1 | 2026-10-15 05:59:37.578344 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-10-15 05:59:37.578598 | mon1 | Thursday 15 October 2026 05:59:37 +0000 (0:00:00.057) 0:05:10.358 ****** 2026-10-15 05:59:37.610294 | mon1 | skipping: [osd1] 2026-10-15 05:59:37.610487 | mon1 | 2026-10-15 05:59:37.610736 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-10-15 05:59:37.610973 | mon1 | Thursday 15 October 2026 05:59:37 +0000 (0:00:00.032) 0:05:10.391 ****** 2026-10-15 05:59:42.647497 | mon1 | Pausing for 5 seconds 2026-10-15 05:59:42.647606 | mon1 | ok: [osd1] 2026-10-15 05:59:42.647614 | mon1 | 2026-10-15 05:59:42.647675 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-10-15 05:59:42.647764 | mon1 | Thursday 15 October 2026 05:59:42 +0000 (0:00:05.037) 0:05:15.428 ****** 2026-10-15 05:59:42.708070 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-10-15 05:59:42.708238 | mon1 | 2026-10-15 05:59:42.708428 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-10-15 05:59:42.708624 | mon1 | Thursday 15 October 2026 05:59:42 +0000 (0:00:00.060) 0:05:15.488 ****** 2026-10-15 05:59:42.758345 | mon1 | ok: [osd1] 2026-10-15 05:59:42.758472 | mon1 | 2026-10-15 05:59:42.758630 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-10-15 05:59:42.758817 | mon1 | Thursday 15 October 2026 05:59:42 +0000 (0:00:00.050) 0:05:15.539 ****** 2026-10-15 05:59:44.325925 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 05:59:44.326033 | mon1 | 2026-10-15 05:59:44.326078 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-10-15 05:59:44.326200 | mon1 | Thursday 15 October 2026 05:59:44 +0000 (0:00:01.567) 0:05:17.106 ****** 2026-10-15 05:59:44.377404 | mon1 | ok: [osd1] 2026-10-15 05:59:44.377492 | mon1 | 2026-10-15 05:59:44.377548 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-10-15 05:59:44.377679 | mon1 | Thursday 15 October 2026 05:59:44 +0000 (0:00:00.051) 0:05:17.158 ****** 2026-10-15 05:59:44.402135 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 05:59:44.402189 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 05:59:44.402303 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 05:59:44.402440 | mon1 | skipping: [osd1] 2026-10-15 05:59:44.402535 | mon1 | 2026-10-15 05:59:44.402644 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-10-15 05:59:44.402768 | mon1 | Thursday 15 October 2026 05:59:44 +0000 (0:00:00.024) 0:05:17.183 ****** 2026-10-15 05:59:44.451458 | mon1 | skipping: [osd1] 2026-10-15 05:59:44.451533 | mon1 | 2026-10-15 05:59:44.451609 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-10-15 05:59:44.451740 | mon1 | 2026-10-15 05:59:44.451822 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 05:59:44.451934 | mon1 | Thursday 15 October 2026 05:59:44 +0000 (0:00:00.049) 0:05:17.232 ****** 2026-10-15 05:59:45.341879 | mon1 | ok: [mon1] 2026-10-15 05:59:45.341986 | mon1 | 2026-10-15 05:59:45.341998 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:59:45.342009 | mon1 | Thursday 15 October 2026 05:59:45 +0000 (0:00:00.888) 0:05:18.121 ****** 2026-10-15 05:59:45.585228 | mon1 | ok: [mon1] 2026-10-15 05:59:45.585846 | mon1 | 2026-10-15 05:59:45.585902 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:59:45.585913 | mon1 | Thursday 15 October 2026 05:59:45 +0000 (0:00:00.244) 0:05:18.365 ****** 2026-10-15 05:59:45.621319 | mon1 | skipping: [mon1] 2026-10-15 05:59:45.621390 | mon1 | 2026-10-15 05:59:45.621797 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 05:59:45.621842 | mon1 | Thursday 15 October 2026 05:59:45 +0000 (0:00:00.036) 0:05:18.402 ****** 2026-10-15 05:59:45.862416 | mon1 | ok: [mon1] 2026-10-15 05:59:45.862487 | mon1 | 2026-10-15 05:59:45.862734 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:59:45.862781 | mon1 | Thursday 15 October 2026 05:59:45 +0000 (0:00:00.241) 0:05:18.643 ****** 2026-10-15 05:59:45.935915 | mon1 | ok: [mon1] => { 2026-10-15 05:59:45.935988 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 05:59:45.936000 | mon1 | } 2026-10-15 05:59:45.936302 | mon1 | 2026-10-15 05:59:45.936344 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:59:45.936349 | mon1 | Thursday 15 October 2026 05:59:45 +0000 (0:00:00.073) 0:05:18.717 ****** 2026-10-15 05:59:46.253806 | mon1 | ok: [mon1] 2026-10-15 05:59:46.254294 | mon1 | 2026-10-15 05:59:46.254347 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:59:46.254355 | mon1 | Thursday 15 October 2026 05:59:46 +0000 (0:00:00.317) 0:05:19.034 ****** 2026-10-15 05:59:46.304831 | mon1 | skipping: [mon1] 2026-10-15 05:59:46.305388 | mon1 | 2026-10-15 05:59:46.305435 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:59:46.305446 | mon1 | Thursday 15 October 2026 05:59:46 +0000 (0:00:00.050) 0:05:19.085 ****** 2026-10-15 05:59:46.347461 | mon1 | skipping: [mon1] 2026-10-15 05:59:46.347545 | mon1 | 2026-10-15 05:59:46.347667 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:59:46.347841 | mon1 | Thursday 15 October 2026 05:59:46 +0000 (0:00:00.042) 0:05:19.128 ****** 2026-10-15 05:59:46.568533 | mon1 | ok: [mon1] 2026-10-15 05:59:46.568596 | mon1 | 2026-10-15 05:59:46.568676 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 05:59:46.568759 | mon1 | Thursday 15 October 2026 05:59:46 +0000 (0:00:00.221) 0:05:19.349 ****** 2026-10-15 05:59:47.728117 | mon1 | ok: [mon1] 2026-10-15 05:59:47.728743 | mon1 | 2026-10-15 05:59:47.728855 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:59:47.728868 | mon1 | Thursday 15 October 2026 05:59:47 +0000 (0:00:01.158) 0:05:20.508 ****** 2026-10-15 05:59:47.818932 | mon1 | ok: [mon1] => { 2026-10-15 05:59:47.819121 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 05:59:47.819977 | mon1 | } 2026-10-15 05:59:47.820073 | mon1 | 2026-10-15 05:59:47.820086 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:59:47.820096 | mon1 | Thursday 15 October 2026 05:59:47 +0000 (0:00:00.090) 0:05:20.599 ****** 2026-10-15 05:59:48.194089 | mon1 | ok: [mon1] 2026-10-15 05:59:48.194695 | mon1 | 2026-10-15 05:59:48.194753 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:59:48.194765 | mon1 | Thursday 15 October 2026 05:59:48 +0000 (0:00:00.375) 0:05:20.974 ****** 2026-10-15 05:59:50.207435 | mon1 | ok: [mon1] 2026-10-15 05:59:50.208059 | mon1 | 2026-10-15 05:59:50.208130 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 05:59:50.208142 | mon1 | Thursday 15 October 2026 05:59:50 +0000 (0:00:02.013) 0:05:22.987 ****** 2026-10-15 05:59:50.236999 | mon1 | skipping: [mon1] 2026-10-15 05:59:50.237697 | mon1 | 2026-10-15 05:59:50.237745 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 05:59:50.237788 | mon1 | Thursday 15 October 2026 05:59:50 +0000 (0:00:00.029) 0:05:23.017 ****** 2026-10-15 05:59:50.270469 | mon1 | skipping: [mon1] 2026-10-15 05:59:50.271090 | mon1 | 2026-10-15 05:59:50.271156 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 05:59:50.271169 | mon1 | Thursday 15 October 2026 05:59:50 +0000 (0:00:00.033) 0:05:23.050 ****** 2026-10-15 05:59:50.302993 | mon1 | skipping: [mon1] 2026-10-15 05:59:50.303315 | mon1 | 2026-10-15 05:59:50.303390 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 05:59:50.303618 | mon1 | Thursday 15 October 2026 05:59:50 +0000 (0:00:00.032) 0:05:23.083 ****** 2026-10-15 05:59:51.649657 | mon1 | ok: [mon1] 2026-10-15 05:59:51.649753 | mon1 | 2026-10-15 05:59:51.650295 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 05:59:51.650357 | mon1 | Thursday 15 October 2026 05:59:51 +0000 (0:00:01.346) 0:05:24.429 ****** 2026-10-15 05:59:52.145132 | mon1 | ok: [mon1] 2026-10-15 05:59:52.145199 | mon1 | 2026-10-15 05:59:52.145450 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 05:59:52.145500 | mon1 | Thursday 15 October 2026 05:59:52 +0000 (0:00:00.496) 0:05:24.926 ****** 2026-10-15 05:59:53.178925 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-10-15 05:59:53.179197 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 05:59:53.180321 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 05:59:53.180404 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 05:59:53.180417 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 05:59:53.180448 | mon1 | 2026-10-15 05:59:53.180459 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 05:59:53.180469 | mon1 | Thursday 15 October 2026 05:59:53 +0000 (0:00:01.033) 0:05:25.959 ****** 2026-10-15 05:59:53.765827 | mon1 | ok: [mon1] 2026-10-15 05:59:53.765939 | mon1 | 2026-10-15 05:59:53.766991 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 05:59:53.767084 | mon1 | Thursday 15 October 2026 05:59:53 +0000 (0:00:00.576) 0:05:26.535 ****** 2026-10-15 05:59:53.767097 | mon1 | 2026-10-15 05:59:53.767107 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 05:59:53.767116 | mon1 | Thursday 15 October 2026 05:59:53 +0000 (0:00:00.010) 0:05:26.546 ****** 2026-10-15 05:59:54.160562 | mon1 | ok: [mon1] 2026-10-15 05:59:54.161273 | mon1 | 2026-10-15 05:59:54.161329 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 05:59:54.161341 | mon1 | Thursday 15 October 2026 05:59:54 +0000 (0:00:00.394) 0:05:26.941 ****** 2026-10-15 05:59:54.391519 | mon1 | ok: [mon1] 2026-10-15 05:59:54.392102 | mon1 | 2026-10-15 05:59:54.392160 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 05:59:54.392171 | mon1 | Thursday 15 October 2026 05:59:54 +0000 (0:00:00.230) 0:05:27.172 ****** 2026-10-15 05:59:54.460869 | mon1 | ok: [mon1] => { 2026-10-15 05:59:54.461972 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 05:59:54.462070 | mon1 | } 2026-10-15 05:59:54.462084 | mon1 | 2026-10-15 05:59:54.462093 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 05:59:54.462103 | mon1 | Thursday 15 October 2026 05:59:54 +0000 (0:00:00.069) 0:05:27.241 ****** 2026-10-15 05:59:54.827090 | mon1 | ok: [mon1] 2026-10-15 05:59:54.827908 | mon1 | 2026-10-15 05:59:54.827972 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 05:59:54.827988 | mon1 | Thursday 15 October 2026 05:59:54 +0000 (0:00:00.365) 0:05:27.607 ****** 2026-10-15 05:59:57.879337 | mon1 | ok: [mon1] 2026-10-15 05:59:57.879486 | mon1 | 2026-10-15 05:59:57.879725 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 05:59:57.879953 | mon1 | Thursday 15 October 2026 05:59:57 +0000 (0:00:03.051) 0:05:30.659 ****** 2026-10-15 05:59:58.995209 | mon1 | ok: [mon1] 2026-10-15 05:59:58.995380 | mon1 | 2026-10-15 05:59:58.995606 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 05:59:58.995815 | mon1 | Thursday 15 October 2026 05:59:58 +0000 (0:00:01.116) 0:05:31.775 ****** 2026-10-15 05:59:59.200883 | mon1 | ok: [mon1] 2026-10-15 05:59:59.201029 | mon1 | 2026-10-15 05:59:59.201274 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 05:59:59.201405 | mon1 | Thursday 15 October 2026 05:59:59 +0000 (0:00:00.205) 0:05:31.981 ****** 2026-10-15 05:59:59.640016 | mon1 | ok: [mon1] 2026-10-15 05:59:59.640153 | mon1 | 2026-10-15 05:59:59.640352 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 05:59:59.640521 | mon1 | Thursday 15 October 2026 05:59:59 +0000 (0:00:00.439) 0:05:32.421 ****** 2026-10-15 06:00:00.204199 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-10-15 06:00:00.205303 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 06:00:00.205343 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 06:00:00.205360 | mon1 | 2026-10-15 06:00:00.205374 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 06:00:00.205388 | mon1 | Thursday 15 October 2026 06:00:00 +0000 (0:00:00.563) 0:05:32.984 ****** 2026-10-15 06:00:00.639935 | mon1 | ok: [mon1] 2026-10-15 06:00:00.639996 | mon1 | 2026-10-15 06:00:00.640207 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 06:00:00.640283 | mon1 | Thursday 15 October 2026 06:00:00 +0000 (0:00:00.436) 0:05:33.421 ****** 2026-10-15 06:00:01.130670 | mon1 | ok: [mon1] 2026-10-15 06:00:01.131819 | mon1 | 2026-10-15 06:00:01.131878 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 06:00:01.131890 | mon1 | Thursday 15 October 2026 06:00:01 +0000 (0:00:00.480) 0:05:33.902 ****** 2026-10-15 06:00:01.131900 | mon1 | 2026-10-15 06:00:01.131909 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 06:00:01.131918 | mon1 | Thursday 15 October 2026 06:00:01 +0000 (0:00:00.009) 0:05:33.911 ****** 2026-10-15 06:00:01.525870 | mon1 | ok: [mon1] 2026-10-15 06:00:01.526444 | mon1 | 2026-10-15 06:00:01.526510 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 06:00:01.526522 | mon1 | Thursday 15 October 2026 06:00:01 +0000 (0:00:00.395) 0:05:34.306 ****** 2026-10-15 06:00:01.590670 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 06:00:01.591395 | mon1 | 2026-10-15 06:00:01.591429 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 06:00:01.591441 | mon1 | Thursday 15 October 2026 06:00:01 +0000 (0:00:00.064) 0:05:34.371 ****** 2026-10-15 06:00:02.632362 | mon1 | ok: [mon1] 2026-10-15 06:00:02.632413 | mon1 | 2026-10-15 06:00:02.632420 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 06:00:02.632426 | mon1 | Thursday 15 October 2026 06:00:02 +0000 (0:00:01.041) 0:05:35.413 ****** 2026-10-15 06:00:03.288153 | mon1 | ok: [mon1] => (item=chronyd) 2026-10-15 06:00:03.289605 | mon1 | ok: [mon1] => (item=sshd) 2026-10-15 06:00:03.289635 | mon1 | 2026-10-15 06:00:03.289651 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 06:00:03.289665 | mon1 | Thursday 15 October 2026 06:00:03 +0000 (0:00:00.656) 0:05:36.069 ****** 2026-10-15 06:00:03.577861 | mon1 | ok: [mon1] 2026-10-15 06:00:03.578166 | mon1 | 2026-10-15 06:00:03.578279 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 06:00:03.578285 | mon1 | Thursday 15 October 2026 06:00:03 +0000 (0:00:00.289) 0:05:36.359 ****** 2026-10-15 06:00:03.798901 | mon1 | ok: [mon1] 2026-10-15 06:00:03.798972 | mon1 | 2026-10-15 06:00:03.799202 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 06:00:03.799248 | mon1 | Thursday 15 October 2026 06:00:03 +0000 (0:00:00.220) 0:05:36.580 ****** 2026-10-15 06:00:04.061170 | mon1 | ok: [mon1] 2026-10-15 06:00:04.061241 | mon1 | 2026-10-15 06:00:04.061424 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 06:00:04.061462 | mon1 | Thursday 15 October 2026 06:00:04 +0000 (0:00:00.262) 0:05:36.842 ****** 2026-10-15 06:00:04.270578 | mon1 | ok: [mon1] 2026-10-15 06:00:04.270651 | mon1 | 2026-10-15 06:00:04.270669 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-10-15 06:00:04.270684 | mon1 | Thursday 15 October 2026 06:00:04 +0000 (0:00:00.207) 0:05:37.049 ****** 2026-10-15 06:00:07.177157 | mon1 | changed: [mon1] 2026-10-15 06:00:07.177311 | mon1 | 2026-10-15 06:00:07.177513 | mon1 | PLAY RECAP ********************************************************************* 2026-10-15 06:00:07.177718 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-10-15 06:00:07.177992 | mon1 | osd1 : ok=58 changed=24 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-10-15 06:00:07.178177 | mon1 | 2026-10-15 06:00:07.178325 | mon1 | 2026-10-15 06:00:07.178502 | mon1 | TASKS RECAP ******************************************************************** 2026-10-15 06:00:07.178682 | mon1 | Thursday 15 October 2026 06:00:07 +0000 (0:00:02.908) 0:05:39.957 ****** 2026-10-15 06:00:07.178845 | mon1 | =============================================================================== 2026-10-15 06:00:07.179019 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 89.62s 2026-10-15 06:00:07.179232 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 46.87s 2026-10-15 06:00:07.179404 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 42.24s 2026-10-15 06:00:07.179577 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 27.13s 2026-10-15 06:00:07.179749 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.36s 2026-10-15 06:00:07.179919 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.58s 2026-10-15 06:00:07.180115 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.57s 2026-10-15 06:00:07.180290 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.35s 2026-10-15 06:00:07.180462 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.04s 2026-10-15 06:00:07.180635 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 4.95s 2026-10-15 06:00:07.180807 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.47s 2026-10-15 06:00:07.181027 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.44s 2026-10-15 06:00:07.181241 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s 2026-10-15 06:00:07.181425 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.03s 2026-10-15 06:00:07.181606 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.02s 2026-10-15 06:00:07.181815 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 2.91s 2026-10-15 06:00:07.182026 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 2.86s 2026-10-15 06:00:07.182231 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.69s 2026-10-15 06:00:07.182417 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.18s 2026-10-15 06:00:07.182592 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.10s 2026-10-15 06:00:07.351086 | mon1 | INFO [default > converge] Executed: Successful 2026-10-15 06:00:07.351145 | mon1 | INFO [default > idempotence] Executing 2026-10-15 06:00:08.185275 | mon1 | 2026-10-15 06:00:08.185603 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-10-15 06:00:08.185896 | mon1 | 2026-10-15 06:00:08.186183 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 06:00:08.186430 | mon1 | Thursday 15 October 2026 06:00:08 +0000 (0:00:00.043) 0:00:00.043 ****** 2026-10-15 06:00:09.380125 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-10-15 06:00:09.380187 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 06:00:09.380199 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 06:00:09.380209 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 06:00:09.380218 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 06:00:09.396898 | mon1 | ok: [mon1] 2026-10-15 06:00:09.396950 | mon1 | 2026-10-15 06:00:09.396961 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:00:09.396973 | mon1 | Thursday 15 October 2026 06:00:09 +0000 (0:00:01.210) 0:00:01.253 ****** 2026-10-15 06:00:09.711058 | mon1 | ok: [mon1] 2026-10-15 06:00:09.711627 | mon1 | 2026-10-15 06:00:09.711682 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:09.711694 | mon1 | Thursday 15 October 2026 06:00:09 +0000 (0:00:00.314) 0:00:01.568 ****** 2026-10-15 06:00:09.746032 | mon1 | skipping: [mon1] 2026-10-15 06:00:09.746118 | mon1 | 2026-10-15 06:00:09.746434 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 06:00:09.746477 | mon1 | Thursday 15 October 2026 06:00:09 +0000 (0:00:00.035) 0:00:01.603 ****** 2026-10-15 06:00:10.053679 | mon1 | ok: [mon1] 2026-10-15 06:00:10.053805 | mon1 | 2026-10-15 06:00:10.054091 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:00:10.054166 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.307) 0:00:01.911 ****** 2026-10-15 06:00:10.151208 | mon1 | ok: [mon1] => { 2026-10-15 06:00:10.151319 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 06:00:10.152058 | mon1 | } 2026-10-15 06:00:10.152114 | mon1 | 2026-10-15 06:00:10.152126 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:00:10.152136 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.096) 0:00:02.008 ****** 2026-10-15 06:00:10.582649 | mon1 | ok: [mon1] 2026-10-15 06:00:10.582735 | mon1 | 2026-10-15 06:00:10.582747 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:00:10.582757 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.430) 0:00:02.438 ****** 2026-10-15 06:00:10.616641 | mon1 | skipping: [mon1] 2026-10-15 06:00:10.616741 | mon1 | 2026-10-15 06:00:10.616966 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:10.617171 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.036) 0:00:02.474 ****** 2026-10-15 06:00:10.647433 | mon1 | skipping: [mon1] 2026-10-15 06:00:10.647500 | mon1 | 2026-10-15 06:00:10.647706 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:00:10.647878 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.030) 0:00:02.505 ****** 2026-10-15 06:00:10.840108 | mon1 | ok: [mon1] 2026-10-15 06:00:10.840171 | mon1 | 2026-10-15 06:00:10.840240 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:10.840326 | mon1 | Thursday 15 October 2026 06:00:10 +0000 (0:00:00.192) 0:00:02.697 ****** 2026-10-15 06:00:12.065412 | mon1 | ok: [mon1] 2026-10-15 06:00:12.065534 | mon1 | 2026-10-15 06:00:12.065702 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:00:12.065966 | mon1 | Thursday 15 October 2026 06:00:12 +0000 (0:00:01.224) 0:00:03.922 ****** 2026-10-15 06:00:12.163085 | mon1 | ok: [mon1] => { 2026-10-15 06:00:12.163339 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 06:00:12.163575 | mon1 | } 2026-10-15 06:00:12.163713 | mon1 | 2026-10-15 06:00:12.163903 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:00:12.164104 | mon1 | Thursday 15 October 2026 06:00:12 +0000 (0:00:00.097) 0:00:04.020 ****** 2026-10-15 06:00:12.578463 | mon1 | ok: [mon1] 2026-10-15 06:00:12.578611 | mon1 | 2026-10-15 06:00:12.578799 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:00:12.579081 | mon1 | Thursday 15 October 2026 06:00:12 +0000 (0:00:00.415) 0:00:04.435 ****** 2026-10-15 06:00:15.927197 | mon1 | ok: [mon1] 2026-10-15 06:00:15.927271 | mon1 | 2026-10-15 06:00:15.927289 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 06:00:15.927305 | mon1 | Thursday 15 October 2026 06:00:15 +0000 (0:00:03.347) 0:00:07.783 ****** 2026-10-15 06:00:15.955300 | mon1 | skipping: [mon1] 2026-10-15 06:00:15.955853 | mon1 | 2026-10-15 06:00:15.955903 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 06:00:15.955915 | mon1 | Thursday 15 October 2026 06:00:15 +0000 (0:00:00.029) 0:00:07.812 ****** 2026-10-15 06:00:15.979662 | mon1 | skipping: [mon1] 2026-10-15 06:00:15.979762 | mon1 | 2026-10-15 06:00:15.980028 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 06:00:15.980176 | mon1 | Thursday 15 October 2026 06:00:15 +0000 (0:00:00.024) 0:00:07.837 ****** 2026-10-15 06:00:16.009016 | mon1 | skipping: [mon1] 2026-10-15 06:00:16.009630 | mon1 | 2026-10-15 06:00:16.009682 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 06:00:16.009693 | mon1 | Thursday 15 October 2026 06:00:16 +0000 (0:00:00.029) 0:00:07.866 ****** 2026-10-15 06:00:17.160330 | mon1 | ok: [mon1] 2026-10-15 06:00:17.160957 | mon1 | 2026-10-15 06:00:17.161012 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 06:00:17.161025 | mon1 | Thursday 15 October 2026 06:00:17 +0000 (0:00:01.151) 0:00:09.017 ****** 2026-10-15 06:00:17.612370 | mon1 | ok: [mon1] 2026-10-15 06:00:17.613126 | mon1 | 2026-10-15 06:00:17.613161 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 06:00:17.613175 | mon1 | Thursday 15 October 2026 06:00:17 +0000 (0:00:00.452) 0:00:09.469 ****** 2026-10-15 06:00:18.549139 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-10-15 06:00:18.549193 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 06:00:18.549205 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 06:00:18.549215 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 06:00:18.549224 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 06:00:18.549234 | mon1 | 2026-10-15 06:00:18.549243 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 06:00:18.549252 | mon1 | Thursday 15 October 2026 06:00:18 +0000 (0:00:00.935) 0:00:10.405 ****** 2026-10-15 06:00:19.152800 | mon1 | ok: [mon1] 2026-10-15 06:00:19.152871 | mon1 | 2026-10-15 06:00:19.153863 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 06:00:19.153914 | mon1 | Thursday 15 October 2026 06:00:19 +0000 (0:00:00.593) 0:00:10.998 ****** 2026-10-15 06:00:19.153921 | mon1 | 2026-10-15 06:00:19.153933 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 06:00:19.154220 | mon1 | Thursday 15 October 2026 06:00:19 +0000 (0:00:00.011) 0:00:11.010 ****** 2026-10-15 06:00:19.750087 | mon1 | ok: [mon1] 2026-10-15 06:00:19.750155 | mon1 | 2026-10-15 06:00:19.750383 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:00:19.750403 | mon1 | Thursday 15 October 2026 06:00:19 +0000 (0:00:00.597) 0:00:11.607 ****** 2026-10-15 06:00:19.998177 | mon1 | ok: [mon1] 2026-10-15 06:00:19.998780 | mon1 | 2026-10-15 06:00:19.998852 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:00:19.998869 | mon1 | Thursday 15 October 2026 06:00:19 +0000 (0:00:00.247) 0:00:11.855 ****** 2026-10-15 06:00:20.092775 | mon1 | ok: [mon1] => { 2026-10-15 06:00:20.093886 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 06:00:20.093951 | mon1 | } 2026-10-15 06:00:20.093963 | mon1 | 2026-10-15 06:00:20.093973 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:00:20.093990 | mon1 | Thursday 15 October 2026 06:00:20 +0000 (0:00:00.094) 0:00:11.949 ****** 2026-10-15 06:00:20.456886 | mon1 | ok: [mon1] 2026-10-15 06:00:20.457524 | mon1 | 2026-10-15 06:00:20.457579 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:00:20.457591 | mon1 | Thursday 15 October 2026 06:00:20 +0000 (0:00:00.364) 0:00:12.314 ****** 2026-10-15 06:00:23.633658 | mon1 | ok: [mon1] 2026-10-15 06:00:23.633724 | mon1 | 2026-10-15 06:00:23.634030 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 06:00:23.634193 | mon1 | Thursday 15 October 2026 06:00:23 +0000 (0:00:03.176) 0:00:15.491 ****** 2026-10-15 06:00:24.745830 | mon1 | ok: [mon1] 2026-10-15 06:00:24.746378 | mon1 | 2026-10-15 06:00:24.746426 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 06:00:24.746437 | mon1 | Thursday 15 October 2026 06:00:24 +0000 (0:00:01.112) 0:00:16.603 ****** 2026-10-15 06:00:25.092506 | mon1 | ok: [mon1] 2026-10-15 06:00:25.093114 | mon1 | 2026-10-15 06:00:25.093170 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 06:00:25.093181 | mon1 | Thursday 15 October 2026 06:00:25 +0000 (0:00:00.346) 0:00:16.949 ****** 2026-10-15 06:00:25.532169 | mon1 | ok: [mon1] 2026-10-15 06:00:25.532664 | mon1 | 2026-10-15 06:00:25.532713 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 06:00:25.532721 | mon1 | Thursday 15 October 2026 06:00:25 +0000 (0:00:00.440) 0:00:17.389 ****** 2026-10-15 06:00:26.148007 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-10-15 06:00:26.148103 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 06:00:26.148118 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 06:00:26.148417 | mon1 | 2026-10-15 06:00:26.148463 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 06:00:26.148471 | mon1 | Thursday 15 October 2026 06:00:26 +0000 (0:00:00.616) 0:00:18.005 ****** 2026-10-15 06:00:26.599718 | mon1 | ok: [mon1] 2026-10-15 06:00:26.600315 | mon1 | 2026-10-15 06:00:26.600372 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 06:00:26.600385 | mon1 | Thursday 15 October 2026 06:00:26 +0000 (0:00:00.451) 0:00:18.457 ****** 2026-10-15 06:00:27.059133 | mon1 | ok: [mon1] 2026-10-15 06:00:27.059245 | mon1 | 2026-10-15 06:00:27.059258 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 06:00:27.059761 | mon1 | Thursday 15 October 2026 06:00:27 +0000 (0:00:00.454) 0:00:18.911 ****** 2026-10-15 06:00:27.059815 | mon1 | 2026-10-15 06:00:27.059821 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 06:00:27.059826 | mon1 | Thursday 15 October 2026 06:00:27 +0000 (0:00:00.005) 0:00:18.917 ****** 2026-10-15 06:00:27.405073 | mon1 | ok: [mon1] 2026-10-15 06:00:27.405118 | mon1 | 2026-10-15 06:00:27.405206 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 06:00:27.405297 | mon1 | Thursday 15 October 2026 06:00:27 +0000 (0:00:00.345) 0:00:19.263 ****** 2026-10-15 06:00:27.458720 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 06:00:27.458777 | mon1 | 2026-10-15 06:00:27.459078 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 06:00:27.459271 | mon1 | Thursday 15 October 2026 06:00:27 +0000 (0:00:00.053) 0:00:19.316 ****** 2026-10-15 06:00:28.565937 | mon1 | ok: [mon1] 2026-10-15 06:00:28.566055 | mon1 | 2026-10-15 06:00:28.566372 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 06:00:28.566421 | mon1 | Thursday 15 October 2026 06:00:28 +0000 (0:00:01.106) 0:00:20.423 ****** 2026-10-15 06:00:29.236296 | mon1 | ok: [mon1] => (item=chronyd) 2026-10-15 06:00:29.237326 | mon1 | ok: [mon1] => (item=sshd) 2026-10-15 06:00:29.237386 | mon1 | 2026-10-15 06:00:29.237399 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 06:00:29.237412 | mon1 | Thursday 15 October 2026 06:00:29 +0000 (0:00:00.670) 0:00:21.093 ****** 2026-10-15 06:00:29.548441 | mon1 | ok: [mon1] 2026-10-15 06:00:29.548498 | mon1 | 2026-10-15 06:00:29.548771 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 06:00:29.548823 | mon1 | Thursday 15 October 2026 06:00:29 +0000 (0:00:00.312) 0:00:21.406 ****** 2026-10-15 06:00:29.734906 | mon1 | ok: [mon1] 2026-10-15 06:00:29.734970 | mon1 | 2026-10-15 06:00:29.735051 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 06:00:29.735172 | mon1 | Thursday 15 October 2026 06:00:29 +0000 (0:00:00.186) 0:00:21.592 ****** 2026-10-15 06:00:30.156266 | mon1 | ok: [mon1] 2026-10-15 06:00:30.156344 | mon1 | 2026-10-15 06:00:30.156358 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 06:00:30.156500 | mon1 | Thursday 15 October 2026 06:00:30 +0000 (0:00:00.421) 0:00:22.014 ****** 2026-10-15 06:00:30.494255 | mon1 | ok: [mon1] 2026-10-15 06:00:30.495372 | mon1 | 2026-10-15 06:00:30.495427 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-10-15 06:00:30.495438 | mon1 | Thursday 15 October 2026 06:00:30 +0000 (0:00:00.337) 0:00:22.351 ****** 2026-10-15 06:00:30.602600 | mon1 | ok: [mon1] 2026-10-15 06:00:30.603103 | mon1 | 2026-10-15 06:00:30.603154 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-10-15 06:00:30.603162 | mon1 | Thursday 15 October 2026 06:00:30 +0000 (0:00:00.108) 0:00:22.459 ****** 2026-10-15 06:00:30.933163 | mon1 | ok: [mon1] => (item=mon1) 2026-10-15 06:00:30.933209 | mon1 | 2026-10-15 06:00:30.933217 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-10-15 06:00:30.933223 | mon1 | Thursday 15 October 2026 06:00:30 +0000 (0:00:00.331) 0:00:22.790 ****** 2026-10-15 06:00:30.973659 | mon1 | ok: [mon1] 2026-10-15 06:00:30.973713 | mon1 | 2026-10-15 06:00:30.973724 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-10-15 06:00:30.973734 | mon1 | Thursday 15 October 2026 06:00:30 +0000 (0:00:00.039) 0:00:22.830 ****** 2026-10-15 06:00:31.021952 | mon1 | skipping: [mon1] 2026-10-15 06:00:31.022028 | mon1 | 2026-10-15 06:00:31.022519 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 06:00:31.022581 | mon1 | Thursday 15 October 2026 06:00:31 +0000 (0:00:00.048) 0:00:22.879 ****** 2026-10-15 06:00:31.096740 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-10-15 06:00:31.096828 | mon1 | 2026-10-15 06:00:31.096843 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 06:00:31.096965 | mon1 | Thursday 15 October 2026 06:00:31 +0000 (0:00:00.075) 0:00:22.954 ****** 2026-10-15 06:00:32.696985 | mon1 | ok: [mon1] 2026-10-15 06:00:32.697907 | mon1 | 2026-10-15 06:00:32.697938 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 06:00:32.697945 | mon1 | Thursday 15 October 2026 06:00:32 +0000 (0:00:01.599) 0:00:24.554 ****** 2026-10-15 06:00:32.733570 | mon1 | ok: [mon1] => (item=mon1) 2026-10-15 06:00:32.733879 | mon1 | 2026-10-15 06:00:32.734173 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 06:00:32.734197 | mon1 | Thursday 15 October 2026 06:00:32 +0000 (0:00:00.036) 0:00:24.590 ****** 2026-10-15 06:00:33.058325 | mon1 | ok: [mon1] 2026-10-15 06:00:33.058543 | mon1 | 2026-10-15 06:00:33.058557 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 06:00:33.058565 | mon1 | Thursday 15 October 2026 06:00:33 +0000 (0:00:00.325) 0:00:24.916 ****** 2026-10-15 06:00:35.212545 | mon1 | ok: [mon1] 2026-10-15 06:00:35.212622 | mon1 | 2026-10-15 06:00:35.212674 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-10-15 06:00:35.212814 | mon1 | Thursday 15 October 2026 06:00:35 +0000 (0:00:02.154) 0:00:27.070 ****** 2026-10-15 06:00:36.858300 | mon1 | ok: [mon1] 2026-10-15 06:00:36.858392 | mon1 | 2026-10-15 06:00:36.858623 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-10-15 06:00:36.858669 | mon1 | Thursday 15 October 2026 06:00:36 +0000 (0:00:01.645) 0:00:28.716 ****** 2026-10-15 06:00:38.471758 | mon1 | ok: [mon1] 2026-10-15 06:00:38.471848 | mon1 | 2026-10-15 06:00:38.471864 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 06:00:38.472024 | mon1 | Thursday 15 October 2026 06:00:38 +0000 (0:00:01.613) 0:00:30.329 ****** 2026-10-15 06:00:38.542522 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-10-15 06:00:38.542572 | mon1 | 2026-10-15 06:00:38.542663 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 06:00:38.542795 | mon1 | Thursday 15 October 2026 06:00:38 +0000 (0:00:00.070) 0:00:30.400 ****** 2026-10-15 06:00:38.598649 | mon1 | skipping: [mon1] 2026-10-15 06:00:38.598727 | mon1 | 2026-10-15 06:00:38.599111 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 06:00:38.599164 | mon1 | Thursday 15 October 2026 06:00:38 +0000 (0:00:00.055) 0:00:30.456 ****** 2026-10-15 06:00:38.637333 | mon1 | skipping: [mon1] => (item=mon1) 2026-10-15 06:00:38.637831 | mon1 | skipping: [mon1] 2026-10-15 06:00:38.637887 | mon1 | 2026-10-15 06:00:38.637898 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 06:00:38.638154 | mon1 | Thursday 15 October 2026 06:00:38 +0000 (0:00:00.038) 0:00:30.494 ****** 2026-10-15 06:00:38.917945 | mon1 | ok: [mon1] 2026-10-15 06:00:38.918556 | mon1 | 2026-10-15 06:00:38.918612 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 06:00:38.918639 | mon1 | Thursday 15 October 2026 06:00:38 +0000 (0:00:00.280) 0:00:30.775 ****** 2026-10-15 06:00:41.014803 | mon1 | ok: [mon1] 2026-10-15 06:00:41.015114 | mon1 | 2026-10-15 06:00:41.015140 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-10-15 06:00:41.015150 | mon1 | Thursday 15 October 2026 06:00:41 +0000 (0:00:02.096) 0:00:32.871 ****** 2026-10-15 06:00:42.619923 | mon1 | ok: [mon1] 2026-10-15 06:00:42.620052 | mon1 | 2026-10-15 06:00:42.620364 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-10-15 06:00:42.620416 | mon1 | Thursday 15 October 2026 06:00:42 +0000 (0:00:01.606) 0:00:34.477 ****** 2026-10-15 06:00:44.130557 | mon1 | ok: [mon1] 2026-10-15 06:00:44.130621 | mon1 | 2026-10-15 06:00:44.130633 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-10-15 06:00:44.130643 | mon1 | Thursday 15 October 2026 06:00:44 +0000 (0:00:01.509) 0:00:35.987 ****** 2026-10-15 06:00:50.783251 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-10-15 06:00:50.783312 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-10-15 06:00:50.783965 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-10-15 06:00:50.784057 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-10-15 06:00:50.784064 | mon1 | 2026-10-15 06:00:50.784069 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-10-15 06:00:50.784074 | mon1 | 2026-10-15 06:00:50.784078 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 06:00:50.784082 | mon1 | Thursday 15 October 2026 06:00:50 +0000 (0:00:06.653) 0:00:42.640 ****** 2026-10-15 06:00:52.017913 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-10-15 06:00:52.018052 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 06:00:52.018067 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 06:00:52.018078 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 06:00:52.018088 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 06:00:52.031202 | mon1 | ok: [osd1] 2026-10-15 06:00:52.031737 | mon1 | 2026-10-15 06:00:52.031770 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:00:52.031781 | mon1 | Thursday 15 October 2026 06:00:52 +0000 (0:00:01.247) 0:00:43.888 ****** 2026-10-15 06:00:52.282952 | mon1 | ok: [osd1] 2026-10-15 06:00:52.283066 | mon1 | 2026-10-15 06:00:52.283099 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:52.283118 | mon1 | Thursday 15 October 2026 06:00:52 +0000 (0:00:00.250) 0:00:44.139 ****** 2026-10-15 06:00:52.330438 | mon1 | skipping: [osd1] 2026-10-15 06:00:52.330487 | mon1 | 2026-10-15 06:00:52.330495 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 06:00:52.330501 | mon1 | Thursday 15 October 2026 06:00:52 +0000 (0:00:00.048) 0:00:44.187 ****** 2026-10-15 06:00:52.586689 | mon1 | ok: [osd1] 2026-10-15 06:00:52.586805 | mon1 | 2026-10-15 06:00:52.587139 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:00:52.587161 | mon1 | Thursday 15 October 2026 06:00:52 +0000 (0:00:00.256) 0:00:44.444 ****** 2026-10-15 06:00:52.699922 | mon1 | ok: [osd1] => { 2026-10-15 06:00:52.700086 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 06:00:52.700806 | mon1 | } 2026-10-15 06:00:52.700870 | mon1 | 2026-10-15 06:00:52.700881 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:00:52.700891 | mon1 | Thursday 15 October 2026 06:00:52 +0000 (0:00:00.112) 0:00:44.557 ****** 2026-10-15 06:00:53.056645 | mon1 | ok: [osd1] 2026-10-15 06:00:53.056775 | mon1 | 2026-10-15 06:00:53.057251 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:00:53.057338 | mon1 | Thursday 15 October 2026 06:00:53 +0000 (0:00:00.356) 0:00:44.913 ****** 2026-10-15 06:00:53.109300 | mon1 | skipping: [osd1] 2026-10-15 06:00:53.109378 | mon1 | 2026-10-15 06:00:53.109835 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:53.109869 | mon1 | Thursday 15 October 2026 06:00:53 +0000 (0:00:00.052) 0:00:44.966 ****** 2026-10-15 06:00:53.152051 | mon1 | skipping: [osd1] 2026-10-15 06:00:53.152356 | mon1 | 2026-10-15 06:00:53.152620 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:00:53.152877 | mon1 | Thursday 15 October 2026 06:00:53 +0000 (0:00:00.043) 0:00:45.009 ****** 2026-10-15 06:00:53.400240 | mon1 | ok: [osd1] 2026-10-15 06:00:53.400431 | mon1 | 2026-10-15 06:00:53.400576 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:00:53.400698 | mon1 | Thursday 15 October 2026 06:00:53 +0000 (0:00:00.247) 0:00:45.257 ****** 2026-10-15 06:00:54.539133 | mon1 | ok: [osd1] 2026-10-15 06:00:54.539326 | mon1 | 2026-10-15 06:00:54.539492 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:00:54.539657 | mon1 | Thursday 15 October 2026 06:00:54 +0000 (0:00:01.139) 0:00:46.397 ****** 2026-10-15 06:00:54.621859 | mon1 | ok: [osd1] => { 2026-10-15 06:00:54.622181 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 06:00:54.622398 | mon1 | } 2026-10-15 06:00:54.622583 | mon1 | 2026-10-15 06:00:54.622775 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:00:54.622994 | mon1 | Thursday 15 October 2026 06:00:54 +0000 (0:00:00.082) 0:00:46.479 ****** 2026-10-15 06:00:54.972635 | mon1 | ok: [osd1] 2026-10-15 06:00:54.973007 | mon1 | 2026-10-15 06:00:54.973331 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:00:54.973629 | mon1 | Thursday 15 October 2026 06:00:54 +0000 (0:00:00.350) 0:00:46.829 ****** 2026-10-15 06:00:56.973350 | mon1 | ok: [osd1] 2026-10-15 06:00:56.973418 | mon1 | 2026-10-15 06:00:56.973430 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 06:00:56.973440 | mon1 | Thursday 15 October 2026 06:00:56 +0000 (0:00:02.000) 0:00:48.830 ****** 2026-10-15 06:00:57.007988 | mon1 | skipping: [osd1] 2026-10-15 06:00:57.008137 | mon1 | 2026-10-15 06:00:57.008579 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 06:00:57.008669 | mon1 | Thursday 15 October 2026 06:00:57 +0000 (0:00:00.034) 0:00:48.864 ****** 2026-10-15 06:00:57.041634 | mon1 | skipping: [osd1] 2026-10-15 06:00:57.041922 | mon1 | 2026-10-15 06:00:57.042064 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 06:00:57.042240 | mon1 | Thursday 15 October 2026 06:00:57 +0000 (0:00:00.034) 0:00:48.898 ****** 2026-10-15 06:00:57.071064 | mon1 | skipping: [osd1] 2026-10-15 06:00:57.071224 | mon1 | 2026-10-15 06:00:57.071380 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 06:00:57.071565 | mon1 | Thursday 15 October 2026 06:00:57 +0000 (0:00:00.029) 0:00:48.928 ****** 2026-10-15 06:00:58.164221 | mon1 | ok: [osd1] 2026-10-15 06:00:58.164340 | mon1 | 2026-10-15 06:00:58.164352 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 06:00:58.164451 | mon1 | Thursday 15 October 2026 06:00:58 +0000 (0:00:01.093) 0:00:50.021 ****** 2026-10-15 06:00:58.613742 | mon1 | ok: [osd1] 2026-10-15 06:00:58.613894 | mon1 | 2026-10-15 06:00:58.614081 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 06:00:58.614269 | mon1 | Thursday 15 October 2026 06:00:58 +0000 (0:00:00.449) 0:00:50.471 ****** 2026-10-15 06:00:59.630925 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-10-15 06:00:59.631071 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 06:00:59.632291 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 06:00:59.632331 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 06:00:59.632366 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 06:00:59.632377 | mon1 | 2026-10-15 06:00:59.632392 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 06:00:59.632741 | mon1 | Thursday 15 October 2026 06:00:59 +0000 (0:00:01.016) 0:00:51.487 ****** 2026-10-15 06:01:00.208981 | mon1 | ok: [osd1] 2026-10-15 06:01:00.209834 | mon1 | 2026-10-15 06:01:00.209870 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 06:01:00.209882 | mon1 | Thursday 15 October 2026 06:01:00 +0000 (0:00:00.567) 0:00:52.055 ****** 2026-10-15 06:01:00.209891 | mon1 | 2026-10-15 06:01:00.210116 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 06:01:00.210445 | mon1 | Thursday 15 October 2026 06:01:00 +0000 (0:00:00.010) 0:00:52.066 ****** 2026-10-15 06:01:00.589272 | mon1 | ok: [osd1] 2026-10-15 06:01:00.589330 | mon1 | 2026-10-15 06:01:00.589342 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:01:00.589351 | mon1 | Thursday 15 October 2026 06:01:00 +0000 (0:00:00.379) 0:00:52.446 ****** 2026-10-15 06:01:00.816159 | mon1 | ok: [osd1] 2026-10-15 06:01:00.816254 | mon1 | 2026-10-15 06:01:00.816266 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:01:00.816276 | mon1 | Thursday 15 October 2026 06:01:00 +0000 (0:00:00.226) 0:00:52.672 ****** 2026-10-15 06:01:00.913359 | mon1 | ok: [osd1] => { 2026-10-15 06:01:00.913398 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 06:01:00.913410 | mon1 | } 2026-10-15 06:01:00.913419 | mon1 | 2026-10-15 06:01:00.913428 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:01:00.913437 | mon1 | Thursday 15 October 2026 06:01:00 +0000 (0:00:00.097) 0:00:52.769 ****** 2026-10-15 06:01:01.299313 | mon1 | ok: [osd1] 2026-10-15 06:01:01.299605 | mon1 | 2026-10-15 06:01:01.299859 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:01:01.300162 | mon1 | Thursday 15 October 2026 06:01:01 +0000 (0:00:00.387) 0:00:53.156 ****** 2026-10-15 06:01:04.441881 | mon1 | ok: [osd1] 2026-10-15 06:01:04.441951 | mon1 | 2026-10-15 06:01:04.442313 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 06:01:04.442374 | mon1 | Thursday 15 October 2026 06:01:04 +0000 (0:00:03.142) 0:00:56.299 ****** 2026-10-15 06:01:05.564473 | mon1 | ok: [osd1] 2026-10-15 06:01:05.565252 | mon1 | 2026-10-15 06:01:05.565307 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 06:01:05.565318 | mon1 | Thursday 15 October 2026 06:01:05 +0000 (0:00:01.122) 0:00:57.421 ****** 2026-10-15 06:01:05.779118 | mon1 | ok: [osd1] 2026-10-15 06:01:05.779187 | mon1 | 2026-10-15 06:01:05.779201 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 06:01:05.779335 | mon1 | Thursday 15 October 2026 06:01:05 +0000 (0:00:00.215) 0:00:57.637 ****** 2026-10-15 06:01:06.244783 | mon1 | ok: [osd1] 2026-10-15 06:01:06.244856 | mon1 | 2026-10-15 06:01:06.245055 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 06:01:06.245102 | mon1 | Thursday 15 October 2026 06:01:06 +0000 (0:00:00.465) 0:00:58.102 ****** 2026-10-15 06:01:06.828896 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-10-15 06:01:06.829009 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 06:01:06.829917 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 06:01:06.829944 | mon1 | 2026-10-15 06:01:06.829951 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 06:01:06.829958 | mon1 | Thursday 15 October 2026 06:01:06 +0000 (0:00:00.583) 0:00:58.686 ****** 2026-10-15 06:01:07.309616 | mon1 | ok: [osd1] 2026-10-15 06:01:07.309733 | mon1 | 2026-10-15 06:01:07.310203 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 06:01:07.310288 | mon1 | Thursday 15 October 2026 06:01:07 +0000 (0:00:00.480) 0:00:59.166 ****** 2026-10-15 06:01:07.762885 | mon1 | ok: [osd1] 2026-10-15 06:01:07.763002 | mon1 | 2026-10-15 06:01:07.763919 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 06:01:07.764000 | mon1 | Thursday 15 October 2026 06:01:07 +0000 (0:00:00.443) 0:00:59.610 ****** 2026-10-15 06:01:07.764012 | mon1 | 2026-10-15 06:01:07.764042 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 06:01:07.764051 | mon1 | Thursday 15 October 2026 06:01:07 +0000 (0:00:00.009) 0:00:59.620 ****** 2026-10-15 06:01:08.152362 | mon1 | ok: [osd1] 2026-10-15 06:01:08.152486 | mon1 | 2026-10-15 06:01:08.152499 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 06:01:08.152682 | mon1 | Thursday 15 October 2026 06:01:08 +0000 (0:00:00.389) 0:01:00.009 ****** 2026-10-15 06:01:08.216170 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 06:01:08.216287 | mon1 | 2026-10-15 06:01:08.216707 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 06:01:08.216786 | mon1 | Thursday 15 October 2026 06:01:08 +0000 (0:00:00.063) 0:01:00.073 ****** 2026-10-15 06:01:09.364247 | mon1 | ok: [osd1] 2026-10-15 06:01:09.364342 | mon1 | 2026-10-15 06:01:09.364355 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 06:01:09.364366 | mon1 | Thursday 15 October 2026 06:01:09 +0000 (0:00:01.147) 0:01:01.220 ****** 2026-10-15 06:01:10.073211 | mon1 | ok: [osd1] => (item=chronyd) 2026-10-15 06:01:10.073312 | mon1 | ok: [osd1] => (item=sshd) 2026-10-15 06:01:10.073318 | mon1 | 2026-10-15 06:01:10.073323 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 06:01:10.073339 | mon1 | Thursday 15 October 2026 06:01:10 +0000 (0:00:00.709) 0:01:01.929 ****** 2026-10-15 06:01:10.378005 | mon1 | ok: [osd1] 2026-10-15 06:01:10.378135 | mon1 | 2026-10-15 06:01:10.378542 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 06:01:10.378628 | mon1 | Thursday 15 October 2026 06:01:10 +0000 (0:00:00.304) 0:01:02.234 ****** 2026-10-15 06:01:10.599476 | mon1 | ok: [osd1] 2026-10-15 06:01:10.599616 | mon1 | 2026-10-15 06:01:10.599990 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 06:01:10.600080 | mon1 | Thursday 15 October 2026 06:01:10 +0000 (0:00:00.222) 0:01:02.456 ****** 2026-10-15 06:01:10.839820 | mon1 | ok: [osd1] 2026-10-15 06:01:10.839878 | mon1 | 2026-10-15 06:01:10.839890 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 06:01:10.839900 | mon1 | Thursday 15 October 2026 06:01:10 +0000 (0:00:00.239) 0:01:02.696 ****** 2026-10-15 06:01:11.078738 | mon1 | ok: [osd1] 2026-10-15 06:01:11.079336 | mon1 | 2026-10-15 06:01:11.079433 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-10-15 06:01:11.079445 | mon1 | Thursday 15 October 2026 06:01:11 +0000 (0:00:00.239) 0:01:02.935 ****** 2026-10-15 06:01:11.337974 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-10-15 06:01:11.338097 | mon1 | 2026-10-15 06:01:11.338137 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-10-15 06:01:11.338286 | mon1 | Thursday 15 October 2026 06:01:11 +0000 (0:00:00.259) 0:01:03.195 ****** 2026-10-15 06:01:11.392542 | mon1 | ok: [osd1] 2026-10-15 06:01:11.392659 | mon1 | 2026-10-15 06:01:11.392670 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-10-15 06:01:11.392677 | mon1 | Thursday 15 October 2026 06:01:11 +0000 (0:00:00.054) 0:01:03.249 ****** 2026-10-15 06:01:11.457953 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-10-15 06:01:11.458081 | mon1 | 2026-10-15 06:01:11.458238 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-10-15 06:01:11.458430 | mon1 | Thursday 15 October 2026 06:01:11 +0000 (0:00:00.065) 0:01:03.315 ****** 2026-10-15 06:01:13.086970 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 06:01:13.087099 | mon1 | 2026-10-15 06:01:13.087116 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-10-15 06:01:13.087130 | mon1 | Thursday 15 October 2026 06:01:13 +0000 (0:00:01.627) 0:01:04.943 ****** 2026-10-15 06:01:13.155555 | mon1 | ok: [osd1] => (item=osd1) 2026-10-15 06:01:13.155651 | mon1 | 2026-10-15 06:01:13.155736 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-10-15 06:01:13.155905 | mon1 | Thursday 15 October 2026 06:01:13 +0000 (0:00:00.069) 0:01:05.012 ****** 2026-10-15 06:01:13.436616 | mon1 | ok: [osd1] 2026-10-15 06:01:13.436735 | mon1 | 2026-10-15 06:01:13.437157 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-10-15 06:01:13.437238 | mon1 | Thursday 15 October 2026 06:01:13 +0000 (0:00:00.280) 0:01:05.293 ****** 2026-10-15 06:01:15.658537 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 06:01:15.658640 | mon1 | 2026-10-15 06:01:15.658692 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-10-15 06:01:15.658823 | mon1 | Thursday 15 October 2026 06:01:15 +0000 (0:00:02.221) 0:01:07.515 ****** 2026-10-15 06:01:21.834860 | mon1 | ok: [osd1] 2026-10-15 06:01:21.834990 | mon1 | 2026-10-15 06:01:21.835244 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-10-15 06:01:21.835437 | mon1 | Thursday 15 October 2026 06:01:21 +0000 (0:00:06.176) 0:01:13.691 ****** 2026-10-15 06:01:23.195863 | mon1 | ok: [osd1] 2026-10-15 06:01:23.195946 | mon1 | 2026-10-15 06:01:23.195959 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-10-15 06:01:23.195969 | mon1 | Thursday 15 October 2026 06:01:23 +0000 (0:00:01.359) 0:01:15.051 ****** 2026-10-15 06:01:23.281306 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-10-15 06:01:23.281503 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-10-15 06:01:23.281697 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-10-15 06:01:23.282000 | mon1 | skipping: [osd1] 2026-10-15 06:01:23.282339 | mon1 | 2026-10-15 06:01:23.282649 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-10-15 06:01:23.282923 | mon1 | Thursday 15 October 2026 06:01:23 +0000 (0:00:00.086) 0:01:15.138 ****** 2026-10-15 06:01:24.921552 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 06:01:24.922039 | mon1 | 2026-10-15 06:01:24.922162 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-10-15 06:01:24.922334 | mon1 | Thursday 15 October 2026 06:01:24 +0000 (0:00:01.640) 0:01:16.778 ****** 2026-10-15 06:01:26.390397 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 06:01:26.390446 | mon1 | 2026-10-15 06:01:26.390451 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-10-15 06:01:26.390456 | mon1 | Thursday 15 October 2026 06:01:26 +0000 (0:00:01.469) 0:01:18.248 ****** 2026-10-15 06:01:26.470111 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-10-15 06:01:26.470183 | mon1 | 2026-10-15 06:01:26.470494 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-10-15 06:01:26.470540 | mon1 | Thursday 15 October 2026 06:01:26 +0000 (0:00:00.079) 0:01:18.327 ****** 2026-10-15 06:01:26.520532 | mon1 | ok: [osd1] 2026-10-15 06:01:26.521130 | mon1 | 2026-10-15 06:01:26.521186 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-10-15 06:01:26.521198 | mon1 | Thursday 15 October 2026 06:01:26 +0000 (0:00:00.050) 0:01:18.378 ****** 2026-10-15 06:01:28.032756 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-10-15 06:01:28.032854 | mon1 | 2026-10-15 06:01:28.032945 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-10-15 06:01:28.033181 | mon1 | Thursday 15 October 2026 06:01:28 +0000 (0:00:01.511) 0:01:19.889 ****** 2026-10-15 06:01:28.091906 | mon1 | ok: [osd1] 2026-10-15 06:01:28.091967 | mon1 | 2026-10-15 06:01:28.091980 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-10-15 06:01:28.092030 | mon1 | Thursday 15 October 2026 06:01:28 +0000 (0:00:00.058) 0:01:19.948 ****** 2026-10-15 06:01:28.149155 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 06:01:28.149244 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 06:01:28.149986 | mon1 | skipping: [osd1] => (item=1) 2026-10-15 06:01:28.150141 | mon1 | skipping: [osd1] 2026-10-15 06:01:28.150156 | mon1 | 2026-10-15 06:01:28.150169 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-10-15 06:01:28.150183 | mon1 | Thursday 15 October 2026 06:01:28 +0000 (0:00:00.058) 0:01:20.006 ****** 2026-10-15 06:01:28.228140 | mon1 | skipping: [osd1] 2026-10-15 06:01:28.228266 | mon1 | 2026-10-15 06:01:28.228285 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-10-15 06:01:28.228700 | mon1 | 2026-10-15 06:01:28.228781 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 06:01:28.228790 | mon1 | Thursday 15 October 2026 06:01:28 +0000 (0:00:00.079) 0:01:20.085 ****** 2026-10-15 06:01:29.246959 | mon1 | ok: [mon1] 2026-10-15 06:01:29.247093 | mon1 | 2026-10-15 06:01:29.247544 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:01:29.247612 | mon1 | Thursday 15 October 2026 06:01:29 +0000 (0:00:01.018) 0:01:21.104 ****** 2026-10-15 06:01:29.508582 | mon1 | ok: [mon1] 2026-10-15 06:01:29.508707 | mon1 | 2026-10-15 06:01:29.509188 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:01:29.509274 | mon1 | Thursday 15 October 2026 06:01:29 +0000 (0:00:00.261) 0:01:21.365 ****** 2026-10-15 06:01:29.553469 | mon1 | skipping: [mon1] 2026-10-15 06:01:29.553968 | mon1 | 2026-10-15 06:01:29.554097 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-10-15 06:01:29.554114 | mon1 | Thursday 15 October 2026 06:01:29 +0000 (0:00:00.045) 0:01:21.410 ****** 2026-10-15 06:01:29.803000 | mon1 | ok: [mon1] 2026-10-15 06:01:29.803101 | mon1 | 2026-10-15 06:01:29.803141 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:01:29.803298 | mon1 | Thursday 15 October 2026 06:01:29 +0000 (0:00:00.250) 0:01:21.660 ****** 2026-10-15 06:01:29.873347 | mon1 | ok: [mon1] => { 2026-10-15 06:01:29.873468 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-10-15 06:01:29.873965 | mon1 | } 2026-10-15 06:01:29.874065 | mon1 | 2026-10-15 06:01:29.874405 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:01:29.874482 | mon1 | Thursday 15 October 2026 06:01:29 +0000 (0:00:00.069) 0:01:21.730 ****** 2026-10-15 06:01:30.208050 | mon1 | ok: [mon1] 2026-10-15 06:01:30.208165 | mon1 | 2026-10-15 06:01:30.208180 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:01:30.208196 | mon1 | Thursday 15 October 2026 06:01:30 +0000 (0:00:00.335) 0:01:22.065 ****** 2026-10-15 06:01:30.247489 | mon1 | skipping: [mon1] 2026-10-15 06:01:30.247601 | mon1 | 2026-10-15 06:01:30.247892 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:01:30.247957 | mon1 | Thursday 15 October 2026 06:01:30 +0000 (0:00:00.039) 0:01:22.105 ****** 2026-10-15 06:01:30.302526 | mon1 | skipping: [mon1] 2026-10-15 06:01:30.302608 | mon1 | 2026-10-15 06:01:30.302713 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:01:30.302853 | mon1 | Thursday 15 October 2026 06:01:30 +0000 (0:00:00.053) 0:01:22.159 ****** 2026-10-15 06:01:30.536083 | mon1 | ok: [mon1] 2026-10-15 06:01:30.536214 | mon1 | 2026-10-15 06:01:30.536381 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-10-15 06:01:30.536540 | mon1 | Thursday 15 October 2026 06:01:30 +0000 (0:00:00.234) 0:01:22.393 ****** 2026-10-15 06:01:31.632580 | mon1 | ok: [mon1] 2026-10-15 06:01:31.632800 | mon1 | 2026-10-15 06:01:31.633053 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:01:31.633251 | mon1 | Thursday 15 October 2026 06:01:31 +0000 (0:00:01.096) 0:01:23.489 ****** 2026-10-15 06:01:31.730329 | mon1 | ok: [mon1] => { 2026-10-15 06:01:31.730526 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-10-15 06:01:31.730724 | mon1 | } 2026-10-15 06:01:31.731079 | mon1 | 2026-10-15 06:01:31.731371 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:01:31.731669 | mon1 | Thursday 15 October 2026 06:01:31 +0000 (0:00:00.097) 0:01:23.587 ****** 2026-10-15 06:01:32.112446 | mon1 | ok: [mon1] 2026-10-15 06:01:32.112610 | mon1 | 2026-10-15 06:01:32.112748 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:01:32.112877 | mon1 | Thursday 15 October 2026 06:01:32 +0000 (0:00:00.382) 0:01:23.970 ****** 2026-10-15 06:01:34.118703 | mon1 | ok: [mon1] 2026-10-15 06:01:34.118981 | mon1 | 2026-10-15 06:01:34.118991 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-10-15 06:01:34.118999 | mon1 | Thursday 15 October 2026 06:01:34 +0000 (0:00:02.005) 0:01:25.975 ****** 2026-10-15 06:01:34.155000 | mon1 | skipping: [mon1] 2026-10-15 06:01:34.155825 | mon1 | 2026-10-15 06:01:34.155898 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-10-15 06:01:34.155911 | mon1 | Thursday 15 October 2026 06:01:34 +0000 (0:00:00.036) 0:01:26.012 ****** 2026-10-15 06:01:34.188216 | mon1 | skipping: [mon1] 2026-10-15 06:01:34.188800 | mon1 | 2026-10-15 06:01:34.188883 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-10-15 06:01:34.188895 | mon1 | Thursday 15 October 2026 06:01:34 +0000 (0:00:00.033) 0:01:26.045 ****** 2026-10-15 06:01:34.214048 | mon1 | skipping: [mon1] 2026-10-15 06:01:34.214151 | mon1 | 2026-10-15 06:01:34.214169 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-10-15 06:01:34.214179 | mon1 | Thursday 15 October 2026 06:01:34 +0000 (0:00:00.025) 0:01:26.071 ****** 2026-10-15 06:01:35.340533 | mon1 | ok: [mon1] 2026-10-15 06:01:35.340635 | mon1 | 2026-10-15 06:01:35.341156 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-10-15 06:01:35.341244 | mon1 | Thursday 15 October 2026 06:01:35 +0000 (0:00:01.126) 0:01:27.197 ****** 2026-10-15 06:01:35.810303 | mon1 | ok: [mon1] 2026-10-15 06:01:35.810380 | mon1 | 2026-10-15 06:01:35.810609 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-10-15 06:01:35.810629 | mon1 | Thursday 15 October 2026 06:01:35 +0000 (0:00:00.470) 0:01:27.667 ****** 2026-10-15 06:01:36.839269 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-10-15 06:01:36.840597 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-10-15 06:01:36.840634 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-10-15 06:01:36.840646 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-10-15 06:01:36.840657 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-10-15 06:01:36.840667 | mon1 | 2026-10-15 06:01:36.840676 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-10-15 06:01:36.840686 | mon1 | Thursday 15 October 2026 06:01:36 +0000 (0:00:01.028) 0:01:28.696 ****** 2026-10-15 06:01:37.397346 | mon1 | ok: [mon1] 2026-10-15 06:01:37.397442 | mon1 | 2026-10-15 06:01:37.397455 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-10-15 06:01:37.397522 | mon1 | Thursday 15 October 2026 06:01:37 +0000 (0:00:00.553) 0:01:29.250 ****** 2026-10-15 06:01:37.397849 | mon1 | 2026-10-15 06:01:37.397926 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-10-15 06:01:37.397932 | mon1 | Thursday 15 October 2026 06:01:37 +0000 (0:00:00.004) 0:01:29.255 ****** 2026-10-15 06:01:37.785613 | mon1 | ok: [mon1] 2026-10-15 06:01:37.785737 | mon1 | 2026-10-15 06:01:37.786281 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-10-15 06:01:37.786380 | mon1 | Thursday 15 October 2026 06:01:37 +0000 (0:00:00.387) 0:01:29.642 ****** 2026-10-15 06:01:38.049241 | mon1 | ok: [mon1] 2026-10-15 06:01:38.049413 | mon1 | 2026-10-15 06:01:38.049869 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-10-15 06:01:38.049912 | mon1 | Thursday 15 October 2026 06:01:38 +0000 (0:00:00.263) 0:01:29.906 ****** 2026-10-15 06:01:38.142264 | mon1 | ok: [mon1] => { 2026-10-15 06:01:38.142366 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-10-15 06:01:38.142859 | mon1 | } 2026-10-15 06:01:38.142888 | mon1 | 2026-10-15 06:01:38.142899 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-10-15 06:01:38.142909 | mon1 | Thursday 15 October 2026 06:01:38 +0000 (0:00:00.093) 0:01:29.999 ****** 2026-10-15 06:01:38.571256 | mon1 | ok: [mon1] 2026-10-15 06:01:38.571338 | mon1 | 2026-10-15 06:01:38.571853 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-10-15 06:01:38.571947 | mon1 | Thursday 15 October 2026 06:01:38 +0000 (0:00:00.428) 0:01:30.427 ****** 2026-10-15 06:01:41.712128 | mon1 | ok: [mon1] 2026-10-15 06:01:41.713557 | mon1 | 2026-10-15 06:01:41.713646 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-10-15 06:01:41.713658 | mon1 | Thursday 15 October 2026 06:01:41 +0000 (0:00:03.141) 0:01:33.568 ****** 2026-10-15 06:01:43.364226 | mon1 | ok: [mon1] 2026-10-15 06:01:43.364335 | mon1 | 2026-10-15 06:01:43.364838 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-10-15 06:01:43.364903 | mon1 | Thursday 15 October 2026 06:01:43 +0000 (0:00:01.652) 0:01:35.221 ****** 2026-10-15 06:01:43.601994 | mon1 | ok: [mon1] 2026-10-15 06:01:43.602100 | mon1 | 2026-10-15 06:01:43.602161 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-10-15 06:01:43.602323 | mon1 | Thursday 15 October 2026 06:01:43 +0000 (0:00:00.237) 0:01:35.459 ****** 2026-10-15 06:01:44.064271 | mon1 | ok: [mon1] 2026-10-15 06:01:44.064428 | mon1 | 2026-10-15 06:01:44.064994 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-10-15 06:01:44.065241 | mon1 | Thursday 15 October 2026 06:01:44 +0000 (0:00:00.462) 0:01:35.921 ****** 2026-10-15 06:01:44.685992 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-10-15 06:01:44.686986 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-10-15 06:01:44.687065 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-10-15 06:01:44.687077 | mon1 | 2026-10-15 06:01:44.687087 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-10-15 06:01:44.687097 | mon1 | Thursday 15 October 2026 06:01:44 +0000 (0:00:00.621) 0:01:36.543 ****** 2026-10-15 06:01:45.156213 | mon1 | ok: [mon1] 2026-10-15 06:01:45.156830 | mon1 | 2026-10-15 06:01:45.156917 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-10-15 06:01:45.156929 | mon1 | Thursday 15 October 2026 06:01:45 +0000 (0:00:00.469) 0:01:37.013 ****** 2026-10-15 06:01:45.632543 | mon1 | ok: [mon1] 2026-10-15 06:01:45.633635 | mon1 | 2026-10-15 06:01:45.633657 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-10-15 06:01:45.633666 | mon1 | Thursday 15 October 2026 06:01:45 +0000 (0:00:00.469) 0:01:37.482 ****** 2026-10-15 06:01:45.633674 | mon1 | 2026-10-15 06:01:45.633682 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-10-15 06:01:45.633690 | mon1 | Thursday 15 October 2026 06:01:45 +0000 (0:00:00.007) 0:01:37.490 ****** 2026-10-15 06:01:46.069954 | mon1 | ok: [mon1] 2026-10-15 06:01:46.070083 | mon1 | 2026-10-15 06:01:46.070099 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-10-15 06:01:46.070245 | mon1 | Thursday 15 October 2026 06:01:46 +0000 (0:00:00.437) 0:01:37.927 ****** 2026-10-15 06:01:46.138031 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-10-15 06:01:46.138213 | mon1 | 2026-10-15 06:01:46.138437 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-10-15 06:01:46.138643 | mon1 | Thursday 15 October 2026 06:01:46 +0000 (0:00:00.067) 0:01:37.995 ****** 2026-10-15 06:01:47.427231 | mon1 | ok: [mon1] 2026-10-15 06:01:47.427300 | mon1 | 2026-10-15 06:01:47.427313 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-10-15 06:01:47.427323 | mon1 | Thursday 15 October 2026 06:01:47 +0000 (0:00:01.288) 0:01:39.283 ****** 2026-10-15 06:01:48.132935 | mon1 | ok: [mon1] => (item=chronyd) 2026-10-15 06:01:48.133813 | mon1 | ok: [mon1] => (item=sshd) 2026-10-15 06:01:48.133911 | mon1 | 2026-10-15 06:01:48.133924 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-10-15 06:01:48.133936 | mon1 | Thursday 15 October 2026 06:01:48 +0000 (0:00:00.706) 0:01:39.989 ****** 2026-10-15 06:01:48.466889 | mon1 | ok: [mon1] 2026-10-15 06:01:48.466985 | mon1 | 2026-10-15 06:01:48.467017 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-10-15 06:01:48.467128 | mon1 | Thursday 15 October 2026 06:01:48 +0000 (0:00:00.334) 0:01:40.324 ****** 2026-10-15 06:01:48.714232 | mon1 | ok: [mon1] 2026-10-15 06:01:48.715136 | mon1 | 2026-10-15 06:01:48.715210 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-10-15 06:01:48.715225 | mon1 | Thursday 15 October 2026 06:01:48 +0000 (0:00:00.246) 0:01:40.571 ****** 2026-10-15 06:01:48.990228 | mon1 | ok: [mon1] 2026-10-15 06:01:48.990301 | mon1 | 2026-10-15 06:01:48.990589 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-10-15 06:01:48.990792 | mon1 | Thursday 15 October 2026 06:01:48 +0000 (0:00:00.276) 0:01:40.848 ****** 2026-10-15 06:01:49.213088 | mon1 | ok: [mon1] 2026-10-15 06:01:49.213191 | mon1 | 2026-10-15 06:01:49.213641 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-10-15 06:01:49.213708 | mon1 | Thursday 15 October 2026 06:01:49 +0000 (0:00:00.222) 0:01:41.070 ****** 2026-10-15 06:01:50.890526 | mon1 | ok: [mon1] 2026-10-15 06:01:50.890595 | mon1 | 2026-10-15 06:01:50.890661 | mon1 | PLAY RECAP ********************************************************************* 2026-10-15 06:01:50.893200 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-10-15 06:01:50.893245 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-10-15 06:01:50.893250 | mon1 | 2026-10-15 06:01:50.893255 | mon1 | 2026-10-15 06:01:50.893260 | mon1 | TASKS RECAP ******************************************************************** 2026-10-15 06:01:50.893265 | mon1 | Thursday 15 October 2026 06:01:50 +0000 (0:00:01.678) 0:01:42.748 ****** 2026-10-15 06:01:50.893269 | mon1 | =============================================================================== 2026-10-15 06:01:50.893272 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.65s 2026-10-15 06:01:50.893276 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 6.18s 2026-10-15 06:01:50.893280 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.35s 2026-10-15 06:01:50.893284 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.18s 2026-10-15 06:01:50.893288 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s 2026-10-15 06:01:50.893292 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s 2026-10-15 06:01:50.893296 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.22s 2026-10-15 06:01:50.893299 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.15s 2026-10-15 06:01:50.893303 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.10s 2026-10-15 06:01:50.893307 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.01s 2026-10-15 06:01:50.893311 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.00s 2026-10-15 06:01:50.893314 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 1.68s 2026-10-15 06:01:50.893329 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.65s 2026-10-15 06:01:50.893333 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 1.65s 2026-10-15 06:01:50.893337 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.64s 2026-10-15 06:01:50.893340 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.63s 2026-10-15 06:01:50.893344 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 1.61s 2026-10-15 06:01:50.893348 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 1.61s 2026-10-15 06:01:50.893352 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.60s 2026-10-15 06:01:50.893356 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.51s 2026-10-15 06:01:50.991863 | mon1 | INFO [default > idempotence] Executed: Successful 2026-10-15 06:01:51.000412 | mon1 | INFO [default > side_effect] Executing 2026-10-15 06:01:51.000839 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-10-15 06:01:51.008674 | mon1 | INFO [default > verify] Executing 2026-10-15 06:01:51.663343 | mon1 | 2026-10-15 06:01:51.663727 | mon1 | PLAY [Verify] ****************************************************************** 2026-10-15 06:01:51.664147 | mon1 | 2026-10-15 06:01:51.664499 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-10-15 06:01:51.664893 | mon1 | Thursday 15 October 2026 06:01:51 +0000 (0:00:00.007) 0:00:00.007 ****** 2026-10-15 06:01:52.809907 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-10-15 06:01:52.809974 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-10-15 06:01:52.809992 | mon1 | interpreter could change the meaning of that path. See 2026-10-15 06:01:52.810242 | mon1 | https://docs.ansible.com/ansible- 2026-10-15 06:01:52.810439 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-10-15 06:01:52.818458 | mon1 | ok: [mon1] 2026-10-15 06:01:52.818656 | mon1 | 2026-10-15 06:01:52.818853 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-10-15 06:01:52.819088 | mon1 | Thursday 15 October 2026 06:01:52 +0000 (0:00:01.154) 0:00:01.162 ****** 2026-10-15 06:01:58.459268 | mon1 | ok: [mon1] 2026-10-15 06:01:58.459447 | mon1 | 2026-10-15 06:01:58.459772 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-10-15 06:01:58.460062 | mon1 | Thursday 15 October 2026 06:01:58 +0000 (0:00:05.640) 0:00:06.802 ****** 2026-10-15 06:01:58.507918 | mon1 | ok: [mon1] 2026-10-15 06:01:58.508041 | mon1 | 2026-10-15 06:01:58.508175 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-10-15 06:01:58.508289 | mon1 | Thursday 15 October 2026 06:01:58 +0000 (0:00:00.049) 0:00:06.851 ****** 2026-10-15 06:01:58.537044 | mon1 | ok: [mon1] => { 2026-10-15 06:01:58.537266 | mon1 | "changed": false, 2026-10-15 06:01:58.537446 | mon1 | "msg": "All assertions passed" 2026-10-15 06:01:58.537618 | mon1 | } 2026-10-15 06:01:58.537805 | mon1 | 2026-10-15 06:01:58.538123 | mon1 | TASK [Get cluster health status] *********************************************** 2026-10-15 06:01:58.538358 | mon1 | Thursday 15 October 2026 06:01:58 +0000 (0:00:00.028) 0:00:06.880 ****** 2026-10-15 06:02:00.086994 | mon1 | ok: [mon1] 2026-10-15 06:02:00.087173 | mon1 | 2026-10-15 06:02:00.089143 | mon1 | TASK [Print cluster health status] ********************************************* 2026-10-15 06:02:00.089181 | mon1 | Thursday 15 October 2026 06:02:00 +0000 (0:00:01.549) 0:00:08.430 ****** 2026-10-15 06:02:00.131377 | mon1 | ok: [mon1] => { 2026-10-15 06:02:00.131566 | mon1 | "_ceph_health": { 2026-10-15 06:02:00.131750 | mon1 | "changed": false, 2026-10-15 06:02:00.131975 | mon1 | "cmd": [ 2026-10-15 06:02:00.132217 | mon1 | "cephadm", 2026-10-15 06:02:00.132399 | mon1 | "shell", 2026-10-15 06:02:00.132604 | mon1 | "--", 2026-10-15 06:02:00.132786 | mon1 | "ceph", 2026-10-15 06:02:00.132935 | mon1 | "health" 2026-10-15 06:02:00.133211 | mon1 | ], 2026-10-15 06:02:00.133401 | mon1 | "delta": "0:00:01.330729", 2026-10-15 06:02:00.133563 | mon1 | "end": "2026-10-15 06:02:00.038658", 2026-10-15 06:02:00.133735 | mon1 | "failed": false, 2026-10-15 06:02:00.133940 | mon1 | "msg": "", 2026-10-15 06:02:00.134180 | mon1 | "rc": 0, 2026-10-15 06:02:00.134374 | mon1 | "start": "2026-10-15 06:01:58.707929", 2026-10-15 06:02:00.134555 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-10-15 06:02:00.134725 | mon1 | "stderr_lines": [ 2026-10-15 06:02:00.134950 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-10-15 06:02:00.135172 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-10-15 06:02:00.135395 | mon1 | ], 2026-10-15 06:02:00.135573 | mon1 | "stdout": "HEALTH_OK", 2026-10-15 06:02:00.135742 | mon1 | "stdout_lines": [ 2026-10-15 06:02:00.135899 | mon1 | "HEALTH_OK" 2026-10-15 06:02:00.136085 | mon1 | ] 2026-10-15 06:02:00.136297 | mon1 | } 2026-10-15 06:02:00.136517 | mon1 | } 2026-10-15 06:02:00.136682 | mon1 | 2026-10-15 06:02:00.136861 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-10-15 06:02:00.137056 | mon1 | Thursday 15 October 2026 06:02:00 +0000 (0:00:00.044) 0:00:08.475 ****** 2026-10-15 06:02:00.171066 | mon1 | ok: [mon1] => { 2026-10-15 06:02:00.171313 | mon1 | "changed": false, 2026-10-15 06:02:00.171541 | mon1 | "msg": "All assertions passed" 2026-10-15 06:02:00.171779 | mon1 | } 2026-10-15 06:02:00.172035 | mon1 | 2026-10-15 06:02:00.172298 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-10-15 06:02:00.172573 | mon1 | Thursday 15 October 2026 06:02:00 +0000 (0:00:00.039) 0:00:08.514 ****** 2026-10-15 06:02:06.547426 | mon1 | changed: [mon1] 2026-10-15 06:02:06.547500 | mon1 | 2026-10-15 06:02:06.547515 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-10-15 06:02:06.547526 | mon1 | Thursday 15 October 2026 06:02:06 +0000 (0:00:06.375) 0:00:14.890 ****** 2026-10-15 06:02:08.903565 | mon1 | changed: [mon1] 2026-10-15 06:02:08.904122 | mon1 | 2026-10-15 06:02:08.904154 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-10-15 06:02:08.904165 | mon1 | Thursday 15 October 2026 06:02:08 +0000 (0:00:02.357) 0:00:17.247 ****** 2026-10-15 06:02:10.083717 | mon1 | ok: [mon1] 2026-10-15 06:02:10.083790 | mon1 | 2026-10-15 06:02:10.084064 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-10-15 06:02:10.084113 | mon1 | Thursday 15 October 2026 06:02:10 +0000 (0:00:01.180) 0:00:18.427 ****** 2026-10-15 06:02:10.141819 | mon1 | ok: [mon1] => { 2026-10-15 06:02:10.142986 | mon1 | "changed": false, 2026-10-15 06:02:10.143065 | mon1 | "msg": "All assertions passed" 2026-10-15 06:02:10.143078 | mon1 | } 2026-10-15 06:02:10.143089 | mon1 | 2026-10-15 06:02:10.143099 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-10-15 06:02:10.143109 | mon1 | Thursday 15 October 2026 06:02:10 +0000 (0:00:00.057) 0:00:18.485 ****** 2026-10-15 06:02:11.220174 | mon1 | ok: [mon1] 2026-10-15 06:02:11.220227 | mon1 | 2026-10-15 06:02:11.220234 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-10-15 06:02:11.220241 | mon1 | Thursday 15 October 2026 06:02:11 +0000 (0:00:01.078) 0:00:19.563 ****** 2026-10-15 06:02:11.261856 | mon1 | ok: [mon1] => { 2026-10-15 06:02:11.261900 | mon1 | "changed": false, 2026-10-15 06:02:11.261907 | mon1 | "msg": "All assertions passed" 2026-10-15 06:02:11.261914 | mon1 | } 2026-10-15 06:02:11.261920 | mon1 | 2026-10-15 06:02:11.261926 | mon1 | PLAY RECAP ********************************************************************* 2026-10-15 06:02:11.261932 | mon1 | mon1 : ok=13 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-10-15 06:02:11.261938 | mon1 | 2026-10-15 06:02:11.261943 | mon1 | 2026-10-15 06:02:11.261961 | mon1 | TASKS RECAP ******************************************************************** 2026-10-15 06:02:11.261966 | mon1 | Thursday 15 October 2026 06:02:11 +0000 (0:00:00.039) 0:00:19.603 ****** 2026-10-15 06:02:11.261972 | mon1 | =============================================================================== 2026-10-15 06:02:11.261977 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.38s 2026-10-15 06:02:11.261983 | mon1 | List locally deployed Ceph daemons -------------------------------------- 5.64s 2026-10-15 06:02:11.261988 | mon1 | Create a test Ceph key -------------------------------------------------- 2.36s 2026-10-15 06:02:11.261993 | mon1 | Get cluster health status ----------------------------------------------- 1.55s 2026-10-15 06:02:11.262019 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.18s 2026-10-15 06:02:11.262027 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s 2026-10-15 06:02:11.262033 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.08s 2026-10-15 06:02:11.262038 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.06s 2026-10-15 06:02:11.262044 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.05s 2026-10-15 06:02:11.262049 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-10-15 06:02:11.262054 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.04s 2026-10-15 06:02:11.262059 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-10-15 06:02:11.262065 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.03s 2026-10-15 06:02:11.321837 | mon1 | INFO [default > verify] Executed: Successful 2026-10-15 06:02:11.328686 | mon1 | INFO [default > cleanup] Executing 2026-10-15 06:02:11.329065 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-10-15 06:02:11.335582 | mon1 | INFO [default > destroy] Executing 2026-10-15 06:02:11.335707 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-10-15 06:02:11.335831 | mon1 | INFO [default > destroy] Executed: Successful 2026-10-15 06:02:11.336392 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-10-15 06:02:21.502061 | mon1 | ok: Runtime: 0:08:51.871119 2026-10-15 06:02:21.516668 | 2026-10-15 06:02:21.516732 | PLAY RECAP 2026-10-15 06:02:21.516778 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-10-15 06:02:21.516797 | 2026-10-15 06:02:21.686206 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-10-15 06:02:21.691763 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-10-15 06:02:22.348350 | 2026-10-15 06:02:22.348508 | PLAY [all] 2026-10-15 06:02:22.359304 | 2026-10-15 06:02:22.359404 | TASK [fetch-output : Set log path for multiple nodes] 2026-10-15 06:02:22.431508 | mon1 | ok 2026-10-15 06:02:22.448312 | osd1 | ok 2026-10-15 06:02:22.453265 | 2026-10-15 06:02:22.453389 | TASK [fetch-output : Set log path for single node] 2026-10-15 06:02:22.477154 | mon1 | skipping: Conditional result was False 2026-10-15 06:02:22.488212 | osd1 | skipping: Conditional result was False 2026-10-15 06:02:22.493255 | 2026-10-15 06:02:22.493326 | LOOP [fetch-output : Ensure local output dirs] 2026-10-15 06:02:22.913196 | osd1 -> localhost | changed: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/logs/osd1" 2026-10-15 06:02:22.940722 | mon1 -> localhost | changed: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/logs/mon1" 2026-10-15 06:02:23.121646 | osd1 -> localhost | changed: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/artifacts" 2026-10-15 06:02:23.171536 | mon1 -> localhost | ok: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/artifacts" 2026-10-15 06:02:23.323568 | osd1 -> localhost | changed: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/docs" 2026-10-15 06:02:23.386852 | mon1 -> localhost | ok: "/var/lib/zuul/builds/93ceb342aa0748afbc4cfbc0a436643d/work/docs" 2026-10-15 06:02:23.387038 | mon1 -> localhost | changed: All items complete 2026-10-15 06:02:23.387100 | 2026-10-15 06:02:23.404059 | 2026-10-15 06:02:23.404305 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-10-15 06:02:24.112683 | mon1 | changed: .d..t...... ./ 2026-10-15 06:02:24.121674 | osd1 | changed: .d..t...... ./ 2026-10-15 06:02:24.596920 | mon1 | changed: .d..t...... ./ 2026-10-15 06:02:24.606092 | osd1 | ok 2026-10-15 06:02:25.071155 | mon1 | changed: .d..t...... ./ 2026-10-15 06:02:25.116480 | osd1 | ok 2026-10-15 06:02:25.116692 | osd1 | changed: All items complete 2026-10-15 06:02:25.116744 | 2026-10-15 06:02:25.146720 | 2026-10-15 06:02:25.146820 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-10-15 06:02:25.607025 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008338 2026-10-15 06:02:25.844197 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007734 2026-10-15 06:02:25.872827 | 2026-10-15 06:02:25.872998 | PLAY [all] 2026-10-15 06:02:25.886162 | 2026-10-15 06:02:25.886417 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-10-15 06:02:26.366111 | mon1 | changed 2026-10-15 06:02:26.553774 | osd1 | changed 2026-10-15 06:02:26.580581 | 2026-10-15 06:02:26.580747 | PLAY RECAP 2026-10-15 06:02:26.580818 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-10-15 06:02:26.580862 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-10-15 06:02:26.580890 | 2026-10-15 06:02:26.763040 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-10-15 06:02:26.767960 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-10-15 06:02:27.366058 | 2026-10-15 06:02:27.366775 | PLAY [localhost] 2026-10-15 06:02:27.381419 | 2026-10-15 06:02:27.381568 | TASK [Generate Zuul manifest] 2026-10-15 06:02:27.401224 | localhost | ok 2026-10-15 06:02:27.420462 | 2026-10-15 06:02:27.420668 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-10-15 06:02:27.798500 | localhost | changed 2026-10-15 06:02:27.822022 | 2026-10-15 06:02:27.822346 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-10-15 06:02:27.856734 | localhost | ok 2026-10-15 06:02:27.871357 | 2026-10-15 06:02:27.871574 | TASK [Upload logs] 2026-10-15 06:02:27.892214 | localhost | ok 2026-10-15 06:02:27.958554 | 2026-10-15 06:02:27.958712 | TASK [Set zuul-log-path fact] 2026-10-15 06:02:27.977030 | localhost | ok 2026-10-15 06:02:27.989314 | 2026-10-15 06:02:27.989461 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-10-15 06:02:28.030946 | localhost | ok 2026-10-15 06:02:28.041679 | 2026-10-15 06:02:28.041800 | TASK [upload-logs : Create log directories] 2026-10-15 06:02:28.482938 | localhost | changed 2026-10-15 06:02:28.494070 | 2026-10-15 06:02:28.494284 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-10-15 06:02:28.924798 | localhost -> localhost | ok: Runtime: 0:00:00.005409 2026-10-15 06:02:28.932843 | 2026-10-15 06:02:28.933053 | TASK [upload-logs : Upload logs to log server] 2026-10-15 06:02:29.443216 | localhost | Output suppressed because no_log was given 2026-10-15 06:02:29.450389 | 2026-10-15 06:02:29.450571 | LOOP [upload-logs : Compress console log and json output] 2026-10-15 06:02:29.533064 | localhost | skipping: Conditional result was False 2026-10-15 06:02:29.539508 | localhost | skipping: Conditional result was False 2026-10-15 06:02:29.552156 | 2026-10-15 06:02:29.552291 | LOOP [upload-logs : Upload compressed console log and json output] 2026-10-15 06:02:29.623765 | localhost | skipping: Conditional result was False 2026-10-15 06:02:29.624130 | 2026-10-15 06:02:29.628183 | localhost | skipping: Conditional result was False 2026-10-15 06:02:29.698869 | 2026-10-15 06:02:29.699046 | LOOP [upload-logs : Upload console log and json output]