2026-07-27 16:57:09.242523 | Job console starting 2026-07-27 16:57:09.259078 | Updating git repos 2026-07-27 16:57:09.290385 | Cloning repos into workspace 2026-07-27 16:57:09.439859 | Restoring repo states 2026-07-27 16:57:09.453246 | Merging changes 2026-07-27 16:57:10.063543 | Checking out repos 2026-07-27 16:57:10.098217 | Preparing playbooks 2026-07-27 16:57:11.278753 | Running Ansible setup 2026-07-27 16:57:17.018074 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-07-27 16:57:17.631584 | 2026-07-27 16:57:17.632246 | PLAY [localhost] 2026-07-27 16:57:17.640341 | 2026-07-27 16:57:17.640413 | TASK [Gathering Facts] 2026-07-27 16:57:18.598919 | localhost | ok 2026-07-27 16:57:18.609169 | 2026-07-27 16:57:18.609271 | TASK [Setup log path fact] 2026-07-27 16:57:18.629047 | localhost | ok 2026-07-27 16:57:18.641719 | 2026-07-27 16:57:18.641794 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-27 16:57:18.674335 | localhost | ok 2026-07-27 16:57:18.682577 | 2026-07-27 16:57:18.682660 | TASK [emit-job-header : Print job information] 2026-07-27 16:57:18.724128 | # Job Information 2026-07-27 16:57:18.724354 | Ansible Version: 2.16.18 2026-07-27 16:57:18.724412 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-07-27 16:57:18.724448 | Pipeline: check 2026-07-27 16:57:18.724478 | Executor: 2d72f0692154 2026-07-27 16:57:18.724508 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/118 2026-07-27 16:57:18.724542 | Event ID: d47b0070-89db-11f1-9567-1ce6f0ccf375 2026-07-27 16:57:18.729098 | 2026-07-27 16:57:18.729207 | LOOP [emit-job-header : Print node information] 2026-07-27 16:57:18.825245 | localhost | ok: 2026-07-27 16:57:18.825560 | localhost | # Node Information 2026-07-27 16:57:18.825610 | localhost | Inventory Hostname: mon1 2026-07-27 16:57:18.825645 | localhost | Hostname: np0000187018 2026-07-27 16:57:18.825674 | localhost | Username: zuul 2026-07-27 16:57:18.825714 | localhost | Distro: Ubuntu 24.04 2026-07-27 16:57:18.825743 | localhost | Provider: yul1 2026-07-27 16:57:18.825770 | localhost | Region: ca-ymq-1 2026-07-27 16:57:18.825796 | localhost | Label: ubuntu-noble 2026-07-27 16:57:18.825821 | localhost | Product Name: OpenStack Nova 2026-07-27 16:57:18.825847 | localhost | Interface IP: 199.19.213.206 2026-07-27 16:57:18.878322 | localhost | ok: 2026-07-27 16:57:18.878494 | localhost | # Node Information 2026-07-27 16:57:18.878530 | localhost | Inventory Hostname: osd1 2026-07-27 16:57:18.878555 | localhost | Hostname: np0000187019 2026-07-27 16:57:18.878581 | localhost | Username: zuul 2026-07-27 16:57:18.878605 | localhost | Distro: Ubuntu 24.04 2026-07-27 16:57:18.878629 | localhost | Provider: yul1 2026-07-27 16:57:18.878652 | localhost | Region: ca-ymq-1 2026-07-27 16:57:18.878677 | localhost | Label: ubuntu-noble 2026-07-27 16:57:18.878700 | localhost | Product Name: OpenStack Nova 2026-07-27 16:57:18.878725 | localhost | Interface IP: 199.19.213.125 2026-07-27 16:57:18.890512 | 2026-07-27 16:57:18.890682 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-07-27 16:57:19.334654 | localhost -> localhost | changed 2026-07-27 16:57:19.342445 | 2026-07-27 16:57:19.342918 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-07-27 16:57:20.274505 | localhost -> localhost | changed 2026-07-27 16:57:20.287319 | 2026-07-27 16:57:20.287435 | PLAY [all] 2026-07-27 16:57:20.300093 | 2026-07-27 16:57:20.300214 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-07-27 16:57:20.556564 | mon1 -> localhost | ok 2026-07-27 16:57:20.564896 | 2026-07-27 16:57:20.565026 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-07-27 16:57:20.599493 | mon1 | ok 2026-07-27 16:57:20.614417 | osd1 | ok 2026-07-27 16:57:20.637459 | mon1 | included: /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-07-27 16:57:20.637536 | osd1 | included: /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-07-27 16:57:20.644182 | 2026-07-27 16:57:20.644251 | TASK [add-build-sshkey : Create Temp SSH key] 2026-07-27 16:57:21.849828 | mon1 -> localhost | Generating public/private rsa key pair. 2026-07-27 16:57:21.850018 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/d13607900e4f437e9d916ba9a7f7e4c0_id_rsa 2026-07-27 16:57:21.850052 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/d13607900e4f437e9d916ba9a7f7e4c0_id_rsa.pub 2026-07-27 16:57:21.850077 | mon1 -> localhost | The key fingerprint is: 2026-07-27 16:57:21.850099 | mon1 -> localhost | SHA256:9jaCial0JLFbMrquu9kAi3r5BV9QIRKochXVaUoDXJg zuul-build-sshkey 2026-07-27 16:57:21.850120 | mon1 -> localhost | The key's randomart image is: 2026-07-27 16:57:21.850141 | mon1 -> localhost | +---[RSA 3072]----+ 2026-07-27 16:57:21.850163 | mon1 -> localhost | | o=O+.oo | 2026-07-27 16:57:21.850183 | mon1 -> localhost | | . E.oo+ | 2026-07-27 16:57:21.850205 | mon1 -> localhost | | ... ..+ | 2026-07-27 16:57:21.850225 | mon1 -> localhost | |o .o .. | 2026-07-27 16:57:21.850245 | mon1 -> localhost | |o.= + S | 2026-07-27 16:57:21.850264 | mon1 -> localhost | |oo B = = . | 2026-07-27 16:57:21.850283 | mon1 -> localhost | |= o.+ = . + | 2026-07-27 16:57:21.850302 | mon1 -> localhost | |.*oo . o . | 2026-07-27 16:57:21.850321 | mon1 -> localhost | |X=o.. | 2026-07-27 16:57:21.850340 | mon1 -> localhost | +----[SHA256]-----+ 2026-07-27 16:57:21.850392 | mon1 -> localhost | ok: Runtime: 0:00:00.726666 2026-07-27 16:57:21.856217 | 2026-07-27 16:57:21.856285 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-07-27 16:57:21.895154 | mon1 | ok 2026-07-27 16:57:21.900561 | osd1 | ok 2026-07-27 16:57:21.915200 | mon1 | included: /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-07-27 16:57:21.915305 | osd1 | included: /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-07-27 16:57:21.927478 | 2026-07-27 16:57:21.927587 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-07-27 16:57:21.953353 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:21.964486 | osd1 | skipping: Conditional result was False 2026-07-27 16:57:21.976370 | 2026-07-27 16:57:21.976484 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-07-27 16:57:22.512823 | osd1 | changed 2026-07-27 16:57:22.553674 | mon1 | changed 2026-07-27 16:57:22.561298 | 2026-07-27 16:57:22.561377 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-07-27 16:57:22.811160 | mon1 | ok 2026-07-27 16:57:22.820242 | osd1 | ok 2026-07-27 16:57:22.829647 | 2026-07-27 16:57:22.829849 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-07-27 16:57:23.418144 | mon1 | changed 2026-07-27 16:57:23.470182 | osd1 | changed 2026-07-27 16:57:23.479101 | 2026-07-27 16:57:23.479396 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-07-27 16:57:24.049093 | mon1 | changed 2026-07-27 16:57:24.057298 | osd1 | changed 2026-07-27 16:57:24.063472 | 2026-07-27 16:57:24.063539 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-07-27 16:57:24.090049 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:24.101317 | osd1 | skipping: Conditional result was False 2026-07-27 16:57:24.111213 | 2026-07-27 16:57:24.111305 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-07-27 16:57:24.437745 | mon1 -> localhost | changed 2026-07-27 16:57:24.460169 | 2026-07-27 16:57:24.460316 | TASK [add-build-sshkey : Add back temp key] 2026-07-27 16:57:24.757797 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/d13607900e4f437e9d916ba9a7f7e4c0_id_rsa (zuul-build-sshkey) 2026-07-27 16:57:24.758065 | mon1 -> localhost | ok: Runtime: 0:00:00.015750 2026-07-27 16:57:24.764257 | 2026-07-27 16:57:24.764334 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-07-27 16:57:25.090149 | mon1 | ok 2026-07-27 16:57:25.095387 | osd1 | ok 2026-07-27 16:57:25.100378 | 2026-07-27 16:57:25.100446 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-07-27 16:57:25.128107 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:25.139429 | osd1 | skipping: Conditional result was False 2026-07-27 16:57:25.160377 | 2026-07-27 16:57:25.160515 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-07-27 16:57:25.489883 | osd1 | ok 2026-07-27 16:57:25.495194 | mon1 | ok 2026-07-27 16:57:25.501809 | 2026-07-27 16:57:25.501889 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-07-27 16:57:26.330979 | osd1 | Output suppressed because no_log was given 2026-07-27 16:57:26.431739 | mon1 | Output suppressed because no_log was given 2026-07-27 16:57:26.448684 | 2026-07-27 16:57:26.448778 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-07-27 16:57:26.685327 | mon1 | ok: "logs" 2026-07-27 16:57:26.685576 | mon1 | ok: All items complete 2026-07-27 16:57:26.685606 | 2026-07-27 16:57:26.691835 | osd1 | ok: "logs" 2026-07-27 16:57:26.899153 | mon1 | ok: "artifacts" 2026-07-27 16:57:26.934528 | osd1 | ok: "artifacts" 2026-07-27 16:57:27.096040 | mon1 | ok: "docs" 2026-07-27 16:57:27.154160 | osd1 | ok: "docs" 2026-07-27 16:57:27.173214 | 2026-07-27 16:57:27.173296 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-07-27 16:57:27.430007 | osd1 | changed: "logs" 2026-07-27 16:57:27.430377 | osd1 | ok: All items complete 2026-07-27 16:57:27.430416 | 2026-07-27 16:57:27.478212 | mon1 | changed: "logs" 2026-07-27 16:57:27.631858 | osd1 | changed: "artifacts" 2026-07-27 16:57:27.703189 | mon1 | changed: "artifacts" 2026-07-27 16:57:27.827934 | osd1 | changed: "docs" 2026-07-27 16:57:27.916041 | mon1 | changed: "docs" 2026-07-27 16:57:27.942020 | 2026-07-27 16:57:27.942093 | PLAY RECAP 2026-07-27 16:57:27.942146 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-27 16:57:27.942180 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-07-27 16:57:27.942207 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-07-27 16:57:27.942226 | 2026-07-27 16:57:28.111301 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-07-27 16:57:28.116928 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-07-27 16:57:28.743647 | 2026-07-27 16:57:28.743807 | PLAY [all] 2026-07-27 16:57:28.755781 | 2026-07-27 16:57:28.755878 | TASK [setup-uv : Extract archive] 2026-07-27 16:57:31.453195 | osd1 | changed 2026-07-27 16:57:33.486162 | mon1 | changed 2026-07-27 16:57:33.496460 | 2026-07-27 16:57:33.496731 | TASK [setup-uv : Print version] 2026-07-27 16:57:33.937115 | mon1 | uv 0.8.13 2026-07-27 16:57:33.960595 | osd1 | uv 0.8.13 2026-07-27 16:57:34.070654 | mon1 | ok: Runtime: 0:00:00.013270 2026-07-27 16:57:34.083394 | osd1 | ok: Runtime: 0:00:00.014773 2026-07-27 16:57:34.098641 | 2026-07-27 16:57:34.098778 | TASK [Install Ansible collection siblings] 2026-07-27 16:57:34.585669 | mon1 | ok: 2026-07-27 16:57:34.585956 | mon1 | Skipping community.general: no checked-out sibling 2026-07-27 16:57:34.586017 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-07-27 16:57:34.586060 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-07-27 16:57:34.589430 | 2026-07-27 16:57:34.589503 | PLAY RECAP 2026-07-27 16:57:34.589572 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-27 16:57:34.589634 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-27 16:57:34.589666 | 2026-07-27 16:57:34.740323 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-07-27 16:57:34.744740 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-07-27 16:57:35.437829 | 2026-07-27 16:57:35.437987 | PLAY [all] 2026-07-27 16:57:35.450430 | 2026-07-27 16:57:35.450527 | LOOP [Check inventory directories] 2026-07-27 16:57:35.863048 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-07-27 16:57:36.054357 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-07-27 16:57:36.257003 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-07-27 16:57:36.277018 | 2026-07-27 16:57:36.277268 | LOOP [Copy inventory file for Zuul] 2026-07-27 16:57:37.241337 | mon1 | changed: 2026-07-27 16:57:37.241653 | mon1 | { 2026-07-27 16:57:37.241725 | mon1 | "ansible_loop_var": "item", 2026-07-27 16:57:37.241765 | mon1 | "changed": false, 2026-07-27 16:57:37.241794 | mon1 | "failed": false, 2026-07-27 16:57:37.241823 | mon1 | "invocation": { 2026-07-27 16:57:37.241849 | mon1 | "module_args": { 2026-07-27 16:57:37.241873 | mon1 | "checksum_algorithm": "sha1", 2026-07-27 16:57:37.241897 | mon1 | "follow": true, 2026-07-27 16:57:37.241922 | mon1 | "get_attributes": true, 2026-07-27 16:57:37.241962 | mon1 | "get_checksum": true, 2026-07-27 16:57:37.242020 | mon1 | "get_mime": true, 2026-07-27 16:57:37.242056 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-07-27 16:57:37.242083 | mon1 | } 2026-07-27 16:57:37.242108 | mon1 | }, 2026-07-27 16:57:37.242132 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-07-27 16:57:37.242155 | mon1 | "stat": { 2026-07-27 16:57:37.242178 | mon1 | "atime": 1785171446.3110187, 2026-07-27 16:57:37.242203 | mon1 | "attr_flags": "e", 2026-07-27 16:57:37.242226 | mon1 | "attributes": [ 2026-07-27 16:57:37.242250 | mon1 | "extents" 2026-07-27 16:57:37.242273 | mon1 | ], 2026-07-27 16:57:37.242296 | mon1 | "block_size": 4096, 2026-07-27 16:57:37.242327 | mon1 | "blocks": 8, 2026-07-27 16:57:37.242350 | mon1 | "charset": "unknown", 2026-07-27 16:57:37.242377 | mon1 | "ctime": 1785171446.3280256, 2026-07-27 16:57:37.242401 | mon1 | "dev": 64769, 2026-07-27 16:57:37.242425 | mon1 | "device_type": 0, 2026-07-27 16:57:37.242448 | mon1 | "executable": true, 2026-07-27 16:57:37.242469 | mon1 | "exists": true, 2026-07-27 16:57:37.242485 | mon1 | "gid": 1000, 2026-07-27 16:57:37.242500 | mon1 | "gr_name": "zuul", 2026-07-27 16:57:37.242517 | mon1 | "inode": 1023520, 2026-07-27 16:57:37.242533 | mon1 | "isblk": false, 2026-07-27 16:57:37.242550 | mon1 | "ischr": false, 2026-07-27 16:57:37.242566 | mon1 | "isdir": true, 2026-07-27 16:57:37.242583 | mon1 | "isfifo": false, 2026-07-27 16:57:37.242599 | mon1 | "isgid": false, 2026-07-27 16:57:37.242615 | mon1 | "islnk": false, 2026-07-27 16:57:37.242631 | mon1 | "isreg": false, 2026-07-27 16:57:37.242647 | mon1 | "issock": false, 2026-07-27 16:57:37.242662 | mon1 | "isuid": false, 2026-07-27 16:57:37.242678 | mon1 | "mimetype": "unknown", 2026-07-27 16:57:37.242694 | mon1 | "mode": "0755", 2026-07-27 16:57:37.242710 | mon1 | "mtime": 1785171429.5207355, 2026-07-27 16:57:37.242725 | mon1 | "nlink": 10, 2026-07-27 16:57:37.242741 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-07-27 16:57:37.242758 | mon1 | "pw_name": "zuul", 2026-07-27 16:57:37.242780 | mon1 | "readable": true, 2026-07-27 16:57:37.242798 | mon1 | "rgrp": true, 2026-07-27 16:57:37.242815 | mon1 | "roth": true, 2026-07-27 16:57:37.242838 | mon1 | "rusr": true, 2026-07-27 16:57:37.242861 | mon1 | "size": 4096, 2026-07-27 16:57:37.242895 | mon1 | "uid": 1000, 2026-07-27 16:57:37.242913 | mon1 | "version": "3286955049", 2026-07-27 16:57:37.242931 | mon1 | "wgrp": false, 2026-07-27 16:57:37.242950 | mon1 | "woth": false, 2026-07-27 16:57:37.242974 | mon1 | "writeable": true, 2026-07-27 16:57:37.243024 | mon1 | "wusr": true, 2026-07-27 16:57:37.243050 | mon1 | "xgrp": true, 2026-07-27 16:57:37.243069 | mon1 | "xoth": true, 2026-07-27 16:57:37.243086 | mon1 | "xusr": true 2026-07-27 16:57:37.243103 | mon1 | } 2026-07-27 16:57:37.243121 | mon1 | } 2026-07-27 16:57:37.243162 | mon1 | ok: All items complete 2026-07-27 16:57:37.243184 | 2026-07-27 16:57:37.244544 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:37.245245 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:37.263344 | 2026-07-27 16:57:37.263531 | LOOP [Switch "ansible_host" to private IP] 2026-07-27 16:57:37.660883 | mon1 | changed: 2 replacements made 2026-07-27 16:57:37.662698 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:37.663289 | mon1 | skipping: Conditional result was False 2026-07-27 16:57:37.679315 | 2026-07-27 16:57:37.679443 | TASK [Run Molecule scenario] 2026-07-27 16:57:38.191887 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-07-27 16:57:38.192010 | mon1 | Creating virtual environment at: .venv 2026-07-27 16:57:38.459456 | mon1 | Downloading ansible-core (2.1MiB) 2026-07-27 16:57:38.459688 | mon1 | Downloading cryptography (4.3MiB) 2026-07-27 16:57:38.462633 | mon1 | Downloading pygments (1.2MiB) 2026-07-27 16:57:38.464122 | mon1 | Downloading netaddr (2.2MiB) 2026-07-27 16:57:38.660561 | mon1 | Downloading netaddr 2026-07-27 16:57:38.669750 | mon1 | Downloading cryptography 2026-07-27 16:57:38.729200 | mon1 | Downloading pygments 2026-07-27 16:57:38.879296 | mon1 | Downloading ansible-core 2026-07-27 16:57:38.928117 | mon1 | Installed 37 packages in 48ms 2026-07-27 16:57:39.868953 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-07-27 16:57:39.869085 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-07-27 16:57:40.566285 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-07-27 16:57:40.566436 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-07-27 16:57:58.395510 | mon1 | INFO [default > dependency] Executing 2026-07-27 16:57:58.395685 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-07-27 16:57:58.395991 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-07-27 16:57:58.396180 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-07-27 16:57:58.403388 | mon1 | INFO [default > cleanup] Executing 2026-07-27 16:57:58.403854 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-27 16:57:58.411056 | mon1 | INFO [default > destroy] Executing 2026-07-27 16:57:58.411098 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-07-27 16:57:58.411235 | mon1 | INFO [default > destroy] Executed: Successful 2026-07-27 16:57:58.417577 | mon1 | INFO [default > syntax] Executing 2026-07-27 16:57:59.669449 | mon1 | 2026-07-27 16:57:59.669724 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-07-27 16:57:59.735039 | mon1 | INFO [default > syntax] Executed: Successful 2026-07-27 16:57:59.744739 | mon1 | INFO [default > create] Executing 2026-07-27 16:57:59.746701 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-27 16:57:59.753091 | mon1 | INFO [default > prepare] Executing 2026-07-27 16:58:00.633799 | mon1 | 2026-07-27 16:58:00.634035 | mon1 | PLAY [Prepare] ***************************************************************** 2026-07-27 16:58:00.634300 | mon1 | 2026-07-27 16:58:00.634687 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 16:58:00.634940 | mon1 | Monday 27 July 2026 16:58:00 +0000 (0:00:00.041) 0:00:00.041 *********** 2026-07-27 16:58:01.988073 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-07-27 16:58:01.988294 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 16:58:01.988662 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 16:58:01.989004 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 16:58:01.989268 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 16:58:02.017552 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-07-27 16:58:02.017636 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 16:58:02.017667 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 16:58:02.017682 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 16:58:02.017692 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 16:58:02.027615 | mon1 | ok: [mon1] 2026-07-27 16:58:02.027664 | mon1 | ok: [osd1] 2026-07-27 16:58:02.027792 | mon1 | 2026-07-27 16:58:02.027909 | mon1 | TASK [Configure short hostname] ************************************************ 2026-07-27 16:58:02.028022 | mon1 | Monday 27 July 2026 16:58:02 +0000 (0:00:01.394) 0:00:01.435 *********** 2026-07-27 16:58:03.631790 | mon1 | changed: [mon1] 2026-07-27 16:58:03.631869 | mon1 | changed: [osd1] 2026-07-27 16:58:03.632047 | mon1 | 2026-07-27 16:58:03.632213 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-07-27 16:58:03.632405 | mon1 | Monday 27 July 2026 16:58:03 +0000 (0:00:01.604) 0:00:03.040 *********** 2026-07-27 16:58:03.974073 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-07-27 16:58:03.974337 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-07-27 16:58:03.974717 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-07-27 16:58:04.010682 | mon1 | changed: [mon1] 2026-07-27 16:58:04.011028 | mon1 | changed: [osd1] 2026-07-27 16:58:04.011325 | mon1 | 2026-07-27 16:58:04.011654 | mon1 | TASK [Update apt cache] ******************************************************** 2026-07-27 16:58:04.014688 | mon1 | Monday 27 July 2026 16:58:04 +0000 (0:00:00.378) 0:00:03.418 *********** 2026-07-27 16:58:10.894309 | mon1 | changed: [osd1] 2026-07-27 16:58:10.894720 | mon1 | changed: [mon1] 2026-07-27 16:58:10.895195 | mon1 | 2026-07-27 16:58:10.895561 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-07-27 16:58:10.895909 | mon1 | 2026-07-27 16:58:10.896169 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 16:58:10.896733 | mon1 | Monday 27 July 2026 16:58:10 +0000 (0:00:06.884) 0:00:10.302 *********** 2026-07-27 16:58:12.719948 | mon1 | ok: [osd1] 2026-07-27 16:58:12.720002 | mon1 | 2026-07-27 16:58:12.720202 | mon1 | TASK [Install depedencies] ***************************************************** 2026-07-27 16:58:12.720415 | mon1 | Monday 27 July 2026 16:58:12 +0000 (0:00:01.825) 0:00:12.128 *********** 2026-07-27 16:58:52.064975 | mon1 | changed: [osd1] 2026-07-27 16:58:52.065037 | mon1 | 2026-07-27 16:58:52.065048 | mon1 | TASK [Start up service] ******************************************************** 2026-07-27 16:58:52.065058 | mon1 | Monday 27 July 2026 16:58:52 +0000 (0:00:39.340) 0:00:51.468 *********** 2026-07-27 16:58:52.762412 | mon1 | ok: [osd1] 2026-07-27 16:58:52.762451 | mon1 | 2026-07-27 16:58:52.762461 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-07-27 16:58:52.762588 | mon1 | Monday 27 July 2026 16:58:52 +0000 (0:00:00.701) 0:00:52.169 *********** 2026-07-27 16:58:53.179268 | mon1 | ok: [osd1] 2026-07-27 16:58:53.179424 | mon1 | 2026-07-27 16:58:53.179586 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-07-27 16:58:53.179753 | mon1 | Monday 27 July 2026 16:58:53 +0000 (0:00:00.417) 0:00:52.587 *********** 2026-07-27 16:58:54.022027 | mon1 | changed: [osd1] 2026-07-27 16:58:54.022261 | mon1 | 2026-07-27 16:58:54.022572 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-07-27 16:58:54.022848 | mon1 | Monday 27 July 2026 16:58:54 +0000 (0:00:00.842) 0:00:53.430 *********** 2026-07-27 16:58:54.271275 | mon1 | ok: [osd1] 2026-07-27 16:58:54.271629 | mon1 | 2026-07-27 16:58:54.271912 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-07-27 16:58:54.272383 | mon1 | Monday 27 July 2026 16:58:54 +0000 (0:00:00.248) 0:00:53.679 *********** 2026-07-27 16:58:54.298421 | mon1 | skipping: [osd1] 2026-07-27 16:58:54.298650 | mon1 | 2026-07-27 16:58:54.299537 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-07-27 16:58:54.299622 | mon1 | Monday 27 July 2026 16:58:54 +0000 (0:00:00.027) 0:00:53.706 *********** 2026-07-27 16:58:55.175952 | mon1 | changed: [osd1] => (item=osd0) 2026-07-27 16:58:55.176191 | mon1 | changed: [osd1] => (item=osd1) 2026-07-27 16:58:55.176697 | mon1 | changed: [osd1] => (item=osd2) 2026-07-27 16:58:55.176972 | mon1 | 2026-07-27 16:58:55.177250 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-07-27 16:58:55.177701 | mon1 | Monday 27 July 2026 16:58:55 +0000 (0:00:00.878) 0:00:54.584 *********** 2026-07-27 16:58:56.032817 | mon1 | changed: [osd1] => (item=osd0) 2026-07-27 16:58:56.032947 | mon1 | changed: [osd1] => (item=osd1) 2026-07-27 16:58:56.033914 | mon1 | changed: [osd1] => (item=osd2) 2026-07-27 16:58:56.033985 | mon1 | 2026-07-27 16:58:56.033996 | mon1 | TASK [Start loop devices] ****************************************************** 2026-07-27 16:58:56.034006 | mon1 | Monday 27 July 2026 16:58:56 +0000 (0:00:00.855) 0:00:55.439 *********** 2026-07-27 16:58:56.899579 | mon1 | changed: [osd1] => (item=osd0) 2026-07-27 16:58:56.899661 | mon1 | changed: [osd1] => (item=osd1) 2026-07-27 16:58:56.900665 | mon1 | changed: [osd1] => (item=osd2) 2026-07-27 16:58:56.900698 | mon1 | 2026-07-27 16:58:56.900709 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-07-27 16:58:56.900718 | mon1 | Monday 27 July 2026 16:58:56 +0000 (0:00:00.866) 0:00:56.306 *********** 2026-07-27 16:58:58.459847 | mon1 | changed: [osd1] => (item=osd0) 2026-07-27 16:58:58.459898 | mon1 | changed: [osd1] => (item=osd1) 2026-07-27 16:58:58.459904 | mon1 | changed: [osd1] => (item=osd2) 2026-07-27 16:58:58.459910 | mon1 | 2026-07-27 16:58:58.459917 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-07-27 16:58:58.459923 | mon1 | Monday 27 July 2026 16:58:58 +0000 (0:00:01.560) 0:00:57.867 *********** 2026-07-27 16:58:59.916484 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-07-27 16:58:59.916556 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-07-27 16:58:59.916563 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-07-27 16:58:59.916568 | mon1 | 2026-07-27 16:58:59.916574 | mon1 | PLAY RECAP ********************************************************************* 2026-07-27 16:58:59.916581 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-07-27 16:58:59.917454 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-07-27 16:58:59.917520 | mon1 | 2026-07-27 16:58:59.917608 | mon1 | 2026-07-27 16:58:59.918028 | mon1 | TASKS RECAP ******************************************************************** 2026-07-27 16:58:59.918493 | mon1 | Monday 27 July 2026 16:58:59 +0000 (0:00:01.455) 0:00:59.322 *********** 2026-07-27 16:58:59.918909 | mon1 | =============================================================================== 2026-07-27 16:58:59.919323 | mon1 | Install depedencies ---------------------------------------------------- 39.34s 2026-07-27 16:58:59.919838 | mon1 | Update apt cache -------------------------------------------------------- 6.88s 2026-07-27 16:58:59.920251 | mon1 | Gathering Facts --------------------------------------------------------- 1.83s 2026-07-27 16:58:59.920452 | mon1 | Configure short hostname ------------------------------------------------ 1.60s 2026-07-27 16:58:59.920642 | mon1 | Create a volume group for each loop device ------------------------------ 1.56s 2026-07-27 16:58:59.920827 | mon1 | Create a logical volume for each loop device ---------------------------- 1.46s 2026-07-27 16:58:59.921012 | mon1 | Gathering Facts --------------------------------------------------------- 1.39s 2026-07-27 16:58:59.921195 | mon1 | Create devices for Ceph ------------------------------------------------- 0.88s 2026-07-27 16:58:59.921406 | mon1 | Start loop devices ------------------------------------------------------ 0.87s 2026-07-27 16:58:59.922503 | mon1 | Set permissions on loopback devices ------------------------------------- 0.86s 2026-07-27 16:58:59.922576 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.84s 2026-07-27 16:58:59.922584 | mon1 | Start up service -------------------------------------------------------- 0.70s 2026-07-27 16:58:59.922589 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.42s 2026-07-27 16:58:59.922593 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.38s 2026-07-27 16:58:59.922597 | mon1 | Get list of all loopback devices ---------------------------------------- 0.25s 2026-07-27 16:58:59.922607 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-07-27 16:58:59.989548 | mon1 | INFO [default > prepare] Executed: Successful 2026-07-27 16:58:59.995672 | mon1 | INFO [default > converge] Executing 2026-07-27 16:59:01.139810 | mon1 | 2026-07-27 16:59:01.140048 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-07-27 16:59:01.140295 | mon1 | 2026-07-27 16:59:01.140634 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 16:59:01.140872 | mon1 | Monday 27 July 2026 16:59:01 +0000 (0:00:00.067) 0:00:00.067 *********** 2026-07-27 16:59:02.278446 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-07-27 16:59:02.278714 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 16:59:02.279143 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 16:59:02.279287 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 16:59:02.279590 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 16:59:02.295070 | mon1 | ok: [mon1] 2026-07-27 16:59:02.295271 | mon1 | 2026-07-27 16:59:02.295662 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 16:59:02.295923 | mon1 | Monday 27 July 2026 16:59:02 +0000 (0:00:01.155) 0:00:01.223 *********** 2026-07-27 16:59:02.697766 | mon1 | ok: [mon1] 2026-07-27 16:59:02.697872 | mon1 | 2026-07-27 16:59:02.697884 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 16:59:02.698033 | mon1 | Monday 27 July 2026 16:59:02 +0000 (0:00:00.402) 0:00:01.625 *********** 2026-07-27 16:59:02.740675 | mon1 | skipping: [mon1] 2026-07-27 16:59:02.740772 | mon1 | 2026-07-27 16:59:02.740908 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 16:59:02.741116 | mon1 | Monday 27 July 2026 16:59:02 +0000 (0:00:00.042) 0:00:01.668 *********** 2026-07-27 16:59:03.119250 | mon1 | changed: [mon1] 2026-07-27 16:59:03.119517 | mon1 | 2026-07-27 16:59:03.119851 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 16:59:03.120080 | mon1 | Monday 27 July 2026 16:59:03 +0000 (0:00:00.378) 0:00:02.046 *********** 2026-07-27 16:59:03.245874 | mon1 | ok: [mon1] => { 2026-07-27 16:59:03.246043 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 16:59:03.246279 | mon1 | } 2026-07-27 16:59:03.246542 | mon1 | 2026-07-27 16:59:03.246792 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 16:59:03.247041 | mon1 | Monday 27 July 2026 16:59:03 +0000 (0:00:00.126) 0:00:02.173 *********** 2026-07-27 16:59:04.196590 | mon1 | changed: [mon1] 2026-07-27 16:59:04.196658 | mon1 | 2026-07-27 16:59:04.196668 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 16:59:04.196679 | mon1 | Monday 27 July 2026 16:59:04 +0000 (0:00:00.950) 0:00:03.123 *********** 2026-07-27 16:59:04.243836 | mon1 | skipping: [mon1] 2026-07-27 16:59:04.243909 | mon1 | 2026-07-27 16:59:04.243986 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 16:59:04.244095 | mon1 | Monday 27 July 2026 16:59:04 +0000 (0:00:00.047) 0:00:03.171 *********** 2026-07-27 16:59:04.292638 | mon1 | skipping: [mon1] 2026-07-27 16:59:04.292690 | mon1 | 2026-07-27 16:59:04.292697 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 16:59:04.292703 | mon1 | Monday 27 July 2026 16:59:04 +0000 (0:00:00.048) 0:00:03.219 *********** 2026-07-27 16:59:04.559897 | mon1 | ok: [mon1] 2026-07-27 16:59:04.559974 | mon1 | 2026-07-27 16:59:04.560112 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 16:59:04.560267 | mon1 | Monday 27 July 2026 16:59:04 +0000 (0:00:00.267) 0:00:03.487 *********** 2026-07-27 16:59:05.737256 | mon1 | ok: [mon1] 2026-07-27 16:59:05.737334 | mon1 | 2026-07-27 16:59:05.737345 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 16:59:05.737397 | mon1 | Monday 27 July 2026 16:59:05 +0000 (0:00:01.175) 0:00:04.662 *********** 2026-07-27 16:59:05.952318 | mon1 | ok: [mon1] => { 2026-07-27 16:59:05.952421 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 16:59:05.952486 | mon1 | } 2026-07-27 16:59:05.952493 | mon1 | 2026-07-27 16:59:05.952499 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 16:59:05.952505 | mon1 | Monday 27 July 2026 16:59:05 +0000 (0:00:00.215) 0:00:04.877 *********** 2026-07-27 16:59:07.019391 | mon1 | changed: [mon1] 2026-07-27 16:59:07.019481 | mon1 | 2026-07-27 16:59:07.019492 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 16:59:07.019501 | mon1 | Monday 27 July 2026 16:59:07 +0000 (0:00:01.066) 0:00:05.944 *********** 2026-07-27 16:59:10.476630 | mon1 | changed: [mon1] 2026-07-27 16:59:10.476741 | mon1 | 2026-07-27 16:59:10.476765 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 16:59:10.476839 | mon1 | Monday 27 July 2026 16:59:10 +0000 (0:00:03.455) 0:00:09.400 *********** 2026-07-27 16:59:10.509036 | mon1 | skipping: [mon1] 2026-07-27 16:59:10.509171 | mon1 | 2026-07-27 16:59:10.509470 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 16:59:10.509681 | mon1 | Monday 27 July 2026 16:59:10 +0000 (0:00:00.035) 0:00:09.436 *********** 2026-07-27 16:59:10.547507 | mon1 | skipping: [mon1] 2026-07-27 16:59:10.547569 | mon1 | 2026-07-27 16:59:10.547945 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 16:59:10.547969 | mon1 | Monday 27 July 2026 16:59:10 +0000 (0:00:00.038) 0:00:09.474 *********** 2026-07-27 16:59:10.582269 | mon1 | skipping: [mon1] 2026-07-27 16:59:10.582328 | mon1 | 2026-07-27 16:59:10.582339 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 16:59:10.582348 | mon1 | Monday 27 July 2026 16:59:10 +0000 (0:00:00.034) 0:00:09.509 *********** 2026-07-27 16:59:18.946165 | mon1 | changed: [mon1] 2026-07-27 16:59:18.946253 | mon1 | 2026-07-27 16:59:18.946264 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 16:59:18.946273 | mon1 | Monday 27 July 2026 16:59:18 +0000 (0:00:08.362) 0:00:17.871 *********** 2026-07-27 16:59:19.700405 | mon1 | changed: [mon1] 2026-07-27 16:59:19.700475 | mon1 | 2026-07-27 16:59:19.700489 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 16:59:19.700501 | mon1 | Monday 27 July 2026 16:59:19 +0000 (0:00:00.754) 0:00:18.626 *********** 2026-07-27 16:59:21.009474 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-27 16:59:21.009605 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 16:59:21.009619 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 16:59:21.009628 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 16:59:21.009638 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 16:59:21.009859 | mon1 | 2026-07-27 16:59:21.010538 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 16:59:21.010919 | mon1 | Monday 27 July 2026 16:59:21 +0000 (0:00:01.307) 0:00:19.934 *********** 2026-07-27 16:59:21.841332 | mon1 | changed: [mon1] 2026-07-27 16:59:21.841744 | mon1 | 2026-07-27 16:59:21.841760 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 16:59:21.841798 | mon1 | Monday 27 July 2026 16:59:21 +0000 (0:00:00.823) 0:00:20.757 *********** 2026-07-27 16:59:21.841919 | mon1 | 2026-07-27 16:59:21.842148 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-27 16:59:21.842190 | mon1 | Monday 27 July 2026 16:59:21 +0000 (0:00:00.010) 0:00:20.768 *********** 2026-07-27 16:59:23.100031 | mon1 | ok: [mon1] 2026-07-27 16:59:23.100129 | mon1 | 2026-07-27 16:59:23.100193 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-07-27 16:59:23.100345 | mon1 | Monday 27 July 2026 16:59:23 +0000 (0:00:01.258) 0:00:22.027 *********** 2026-07-27 16:59:23.733028 | mon1 | changed: [mon1] 2026-07-27 16:59:23.733179 | mon1 | 2026-07-27 16:59:23.733187 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 16:59:23.733642 | mon1 | Monday 27 July 2026 16:59:23 +0000 (0:00:00.632) 0:00:22.660 *********** 2026-07-27 16:59:24.520547 | mon1 | changed: [mon1] 2026-07-27 16:59:24.520618 | mon1 | 2026-07-27 16:59:24.521061 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 16:59:24.521109 | mon1 | Monday 27 July 2026 16:59:24 +0000 (0:00:00.788) 0:00:23.448 *********** 2026-07-27 16:59:24.827543 | mon1 | ok: [mon1] 2026-07-27 16:59:24.827593 | mon1 | 2026-07-27 16:59:24.827600 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 16:59:24.827606 | mon1 | Monday 27 July 2026 16:59:24 +0000 (0:00:00.306) 0:00:23.754 *********** 2026-07-27 16:59:24.925008 | mon1 | ok: [mon1] => { 2026-07-27 16:59:24.925059 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 16:59:24.925066 | mon1 | } 2026-07-27 16:59:24.925073 | mon1 | 2026-07-27 16:59:24.925079 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 16:59:24.925085 | mon1 | Monday 27 July 2026 16:59:24 +0000 (0:00:00.097) 0:00:23.851 *********** 2026-07-27 16:59:26.058104 | mon1 | changed: [mon1] 2026-07-27 16:59:26.058180 | mon1 | 2026-07-27 16:59:26.058189 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 16:59:26.058197 | mon1 | Monday 27 July 2026 16:59:26 +0000 (0:00:01.132) 0:00:24.984 *********** 2026-07-27 16:59:31.042593 | mon1 | changed: [mon1] 2026-07-27 16:59:31.042694 | mon1 | 2026-07-27 16:59:31.042701 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 16:59:31.042717 | mon1 | Monday 27 July 2026 16:59:31 +0000 (0:00:04.983) 0:00:29.968 *********** 2026-07-27 16:59:32.152891 | mon1 | ok: [mon1] 2026-07-27 16:59:32.152962 | mon1 | 2026-07-27 16:59:32.153031 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 16:59:32.153149 | mon1 | Monday 27 July 2026 16:59:32 +0000 (0:00:01.112) 0:00:31.080 *********** 2026-07-27 16:59:32.639572 | mon1 | changed: [mon1] 2026-07-27 16:59:32.639649 | mon1 | 2026-07-27 16:59:32.639663 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 16:59:32.639683 | mon1 | Monday 27 July 2026 16:59:32 +0000 (0:00:00.483) 0:00:31.564 *********** 2026-07-27 16:59:33.273349 | mon1 | changed: [mon1] 2026-07-27 16:59:33.273443 | mon1 | 2026-07-27 16:59:33.273457 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 16:59:33.273470 | mon1 | Monday 27 July 2026 16:59:33 +0000 (0:00:00.634) 0:00:32.199 *********** 2026-07-27 16:59:34.065091 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-07-27 16:59:34.065150 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 16:59:34.065160 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 16:59:34.065169 | mon1 | 2026-07-27 16:59:34.065177 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 16:59:34.065186 | mon1 | Monday 27 July 2026 16:59:34 +0000 (0:00:00.792) 0:00:32.991 *********** 2026-07-27 16:59:34.657534 | mon1 | changed: [mon1] 2026-07-27 16:59:34.657799 | mon1 | 2026-07-27 16:59:34.658408 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 16:59:34.658601 | mon1 | Monday 27 July 2026 16:59:34 +0000 (0:00:00.592) 0:00:33.584 *********** 2026-07-27 16:59:35.290195 | mon1 | changed: [mon1] 2026-07-27 16:59:35.290246 | mon1 | 2026-07-27 16:59:35.290255 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 16:59:35.290264 | mon1 | Monday 27 July 2026 16:59:35 +0000 (0:00:00.622) 0:00:34.207 *********** 2026-07-27 16:59:35.290272 | mon1 | 2026-07-27 16:59:35.290282 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-27 16:59:35.290291 | mon1 | Monday 27 July 2026 16:59:35 +0000 (0:00:00.009) 0:00:34.216 *********** 2026-07-27 16:59:36.228170 | mon1 | ok: [mon1] 2026-07-27 16:59:36.228240 | mon1 | 2026-07-27 16:59:36.228253 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-07-27 16:59:36.228265 | mon1 | Monday 27 July 2026 16:59:36 +0000 (0:00:00.938) 0:00:35.155 *********** 2026-07-27 16:59:39.888553 | mon1 | changed: [mon1] 2026-07-27 16:59:39.888638 | mon1 | 2026-07-27 16:59:39.889206 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 16:59:39.889270 | mon1 | Monday 27 July 2026 16:59:39 +0000 (0:00:03.660) 0:00:38.815 *********** 2026-07-27 16:59:40.683004 | mon1 | changed: [mon1] 2026-07-27 16:59:40.683260 | mon1 | 2026-07-27 16:59:40.683633 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 16:59:40.683971 | mon1 | Monday 27 July 2026 16:59:40 +0000 (0:00:00.793) 0:00:39.608 *********** 2026-07-27 16:59:40.747643 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 16:59:40.747715 | mon1 | 2026-07-27 16:59:40.747845 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 16:59:40.747960 | mon1 | Monday 27 July 2026 16:59:40 +0000 (0:00:00.066) 0:00:39.675 *********** 2026-07-27 17:00:05.752008 | mon1 | changed: [mon1] 2026-07-27 17:00:05.752080 | mon1 | 2026-07-27 17:00:05.752088 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:00:05.752099 | mon1 | Monday 27 July 2026 17:00:05 +0000 (0:00:24.998) 0:01:04.674 *********** 2026-07-27 17:00:06.676094 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-07-27 17:00:06.676460 | mon1 | ok: [mon1] => (item=ssh) 2026-07-27 17:00:06.676769 | mon1 | 2026-07-27 17:00:06.677036 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:00:06.677319 | mon1 | Monday 27 July 2026 17:00:06 +0000 (0:00:00.929) 0:01:05.603 *********** 2026-07-27 17:00:07.546384 | mon1 | changed: [mon1] 2026-07-27 17:00:07.546468 | mon1 | 2026-07-27 17:00:07.546478 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:00:07.546486 | mon1 | Monday 27 July 2026 17:00:07 +0000 (0:00:00.869) 0:01:06.473 *********** 2026-07-27 17:00:07.826968 | mon1 | ok: [mon1] 2026-07-27 17:00:07.827071 | mon1 | 2026-07-27 17:00:07.827239 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:00:07.827497 | mon1 | Monday 27 July 2026 17:00:07 +0000 (0:00:00.280) 0:01:06.754 *********** 2026-07-27 17:00:08.460035 | mon1 | changed: [mon1] 2026-07-27 17:00:08.460118 | mon1 | 2026-07-27 17:00:08.460128 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:00:08.460283 | mon1 | Monday 27 July 2026 17:00:08 +0000 (0:00:00.632) 0:01:07.386 *********** 2026-07-27 17:00:08.880137 | mon1 | changed: [mon1] 2026-07-27 17:00:08.880227 | mon1 | 2026-07-27 17:00:08.880333 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-07-27 17:00:08.880623 | mon1 | Monday 27 July 2026 17:00:08 +0000 (0:00:00.421) 0:01:07.808 *********** 2026-07-27 17:00:09.058032 | mon1 | ok: [mon1] 2026-07-27 17:00:09.058111 | mon1 | 2026-07-27 17:00:09.058275 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-07-27 17:00:09.058475 | mon1 | Monday 27 July 2026 17:00:09 +0000 (0:00:00.177) 0:01:07.985 *********** 2026-07-27 17:00:09.365161 | mon1 | ok: [mon1] => (item=mon1) 2026-07-27 17:00:09.365238 | mon1 | 2026-07-27 17:00:09.365251 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-07-27 17:00:09.365425 | mon1 | Monday 27 July 2026 17:00:09 +0000 (0:00:00.306) 0:01:08.292 *********** 2026-07-27 17:00:09.428686 | mon1 | ok: [mon1] 2026-07-27 17:00:09.428761 | mon1 | 2026-07-27 17:00:09.428769 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-07-27 17:00:09.428777 | mon1 | Monday 27 July 2026 17:00:09 +0000 (0:00:00.063) 0:01:08.355 *********** 2026-07-27 17:00:09.539148 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-07-27 17:00:09.539303 | mon1 | 2026-07-27 17:00:09.539318 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-07-27 17:00:09.539605 | mon1 | Monday 27 July 2026 17:00:09 +0000 (0:00:00.110) 0:01:08.465 *********** 2026-07-27 17:00:09.963275 | mon1 | changed: [mon1] 2026-07-27 17:00:09.963384 | mon1 | 2026-07-27 17:00:09.963408 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-07-27 17:00:09.963420 | mon1 | Monday 27 July 2026 17:00:09 +0000 (0:00:00.423) 0:01:08.888 *********** 2026-07-27 17:00:10.879625 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-07-27 17:00:10.879683 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-07-27 17:00:10.879693 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-07-27 17:00:10.879703 | mon1 | 2026-07-27 17:00:10.879713 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-07-27 17:00:10.879721 | mon1 | Monday 27 July 2026 17:00:10 +0000 (0:00:00.916) 0:01:09.805 *********** 2026-07-27 17:02:02.202135 | mon1 | ok: [mon1] 2026-07-27 17:02:02.202213 | mon1 | 2026-07-27 17:02:02.202225 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-07-27 17:02:02.202231 | mon1 | Monday 27 July 2026 17:02:02 +0000 (0:01:51.317) 0:03:01.122 *********** 2026-07-27 17:02:02.455468 | mon1 | changed: [mon1] 2026-07-27 17:02:02.455535 | mon1 | 2026-07-27 17:02:02.455551 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-07-27 17:02:02.455564 | mon1 | Monday 27 July 2026 17:02:02 +0000 (0:00:00.259) 0:03:01.382 *********** 2026-07-27 17:02:02.502169 | mon1 | ok: [mon1] 2026-07-27 17:02:02.502197 | mon1 | 2026-07-27 17:02:02.502203 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:02:02.502209 | mon1 | Monday 27 July 2026 17:02:02 +0000 (0:00:00.046) 0:03:01.429 *********** 2026-07-27 17:02:02.582790 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-27 17:02:02.582843 | mon1 | 2026-07-27 17:02:02.582978 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:02:02.583083 | mon1 | Monday 27 July 2026 17:02:02 +0000 (0:00:00.081) 0:03:01.510 *********** 2026-07-27 17:02:08.629579 | mon1 | ok: [mon1] 2026-07-27 17:02:08.629624 | mon1 | 2026-07-27 17:02:08.629634 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:02:08.629642 | mon1 | Monday 27 July 2026 17:02:08 +0000 (0:00:06.045) 0:03:07.556 *********** 2026-07-27 17:02:08.702031 | mon1 | ok: [mon1] => (item=mon1) 2026-07-27 17:02:08.702091 | mon1 | 2026-07-27 17:02:08.702108 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:02:08.702123 | mon1 | Monday 27 July 2026 17:02:08 +0000 (0:00:00.072) 0:03:07.628 *********** 2026-07-27 17:02:09.169958 | mon1 | ok: [mon1] 2026-07-27 17:02:09.170081 | mon1 | 2026-07-27 17:02:09.170256 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:02:09.170409 | mon1 | Monday 27 July 2026 17:02:09 +0000 (0:00:00.468) 0:03:08.097 *********** 2026-07-27 17:02:16.037946 | mon1 | ok: [mon1] 2026-07-27 17:02:16.038008 | mon1 | 2026-07-27 17:02:16.038022 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-07-27 17:02:16.038036 | mon1 | Monday 27 July 2026 17:02:16 +0000 (0:00:06.866) 0:03:14.964 *********** 2026-07-27 17:02:27.990277 | mon1 | changed: [mon1] 2026-07-27 17:02:27.990326 | mon1 | 2026-07-27 17:02:27.990333 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-07-27 17:02:27.990339 | mon1 | Monday 27 July 2026 17:02:27 +0000 (0:00:11.953) 0:03:26.918 *********** 2026-07-27 17:02:42.393929 | mon1 | ok: [mon1] 2026-07-27 17:02:42.394013 | mon1 | 2026-07-27 17:02:42.394187 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:02:42.394378 | mon1 | Monday 27 July 2026 17:02:42 +0000 (0:00:14.402) 0:03:41.320 *********** 2026-07-27 17:02:42.467406 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-27 17:02:42.467466 | mon1 | 2026-07-27 17:02:42.467595 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:02:42.467715 | mon1 | Monday 27 July 2026 17:02:42 +0000 (0:00:00.075) 0:03:41.395 *********** 2026-07-27 17:02:42.519706 | mon1 | skipping: [mon1] 2026-07-27 17:02:42.519754 | mon1 | 2026-07-27 17:02:42.519761 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:02:42.519767 | mon1 | Monday 27 July 2026 17:02:42 +0000 (0:00:00.050) 0:03:41.446 *********** 2026-07-27 17:02:42.568787 | mon1 | skipping: [mon1] => (item=mon1) 2026-07-27 17:02:42.568876 | mon1 | skipping: [mon1] 2026-07-27 17:02:42.569007 | mon1 | 2026-07-27 17:02:42.569283 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:02:42.569306 | mon1 | Monday 27 July 2026 17:02:42 +0000 (0:00:00.049) 0:03:41.496 *********** 2026-07-27 17:02:42.896793 | mon1 | ok: [mon1] 2026-07-27 17:02:42.896887 | mon1 | 2026-07-27 17:02:42.897015 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:02:42.897159 | mon1 | Monday 27 July 2026 17:02:42 +0000 (0:00:00.328) 0:03:41.824 *********** 2026-07-27 17:02:49.743309 | mon1 | ok: [mon1] 2026-07-27 17:02:49.743399 | mon1 | 2026-07-27 17:02:49.743415 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-07-27 17:02:49.743426 | mon1 | Monday 27 July 2026 17:02:49 +0000 (0:00:06.845) 0:03:48.670 *********** 2026-07-27 17:03:02.050514 | mon1 | changed: [mon1] 2026-07-27 17:03:02.050599 | mon1 | 2026-07-27 17:03:02.050621 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-07-27 17:03:02.050723 | mon1 | Monday 27 July 2026 17:03:02 +0000 (0:00:12.307) 0:04:00.977 *********** 2026-07-27 17:03:08.366497 | mon1 | ok: [mon1] 2026-07-27 17:03:08.366580 | mon1 | 2026-07-27 17:03:08.366602 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-07-27 17:03:08.366822 | mon1 | Monday 27 July 2026 17:03:08 +0000 (0:00:06.315) 0:04:07.293 *********** 2026-07-27 17:03:14.029410 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-07-27 17:03:14.029453 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-07-27 17:03:14.029459 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-07-27 17:03:14.029465 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-07-27 17:03:14.029470 | mon1 | 2026-07-27 17:03:14.029476 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-07-27 17:03:14.029481 | mon1 | 2026-07-27 17:03:14.029487 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:03:14.029492 | mon1 | Monday 27 July 2026 17:03:14 +0000 (0:00:05.661) 0:04:12.954 *********** 2026-07-27 17:03:15.296925 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-07-27 17:03:15.301166 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 17:03:15.301193 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 17:03:15.301201 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 17:03:15.301209 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 17:03:15.313497 | mon1 | ok: [osd1] 2026-07-27 17:03:15.313753 | mon1 | 2026-07-27 17:03:15.313978 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:03:15.314635 | mon1 | Monday 27 July 2026 17:03:15 +0000 (0:00:01.286) 0:04:14.240 *********** 2026-07-27 17:03:15.581324 | mon1 | ok: [osd1] 2026-07-27 17:03:15.584111 | mon1 | 2026-07-27 17:03:15.584128 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:03:15.584135 | mon1 | Monday 27 July 2026 17:03:15 +0000 (0:00:00.268) 0:04:14.509 *********** 2026-07-27 17:03:15.622634 | mon1 | skipping: [osd1] 2026-07-27 17:03:15.624766 | mon1 | 2026-07-27 17:03:15.624782 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 17:03:15.624799 | mon1 | Monday 27 July 2026 17:03:15 +0000 (0:00:00.041) 0:04:14.551 *********** 2026-07-27 17:03:15.885095 | mon1 | changed: [osd1] 2026-07-27 17:03:15.885125 | mon1 | 2026-07-27 17:03:15.885130 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:03:15.885135 | mon1 | Monday 27 July 2026 17:03:15 +0000 (0:00:00.259) 0:04:14.811 *********** 2026-07-27 17:03:15.950275 | mon1 | ok: [osd1] => { 2026-07-27 17:03:15.950303 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 17:03:15.950307 | mon1 | } 2026-07-27 17:03:15.950312 | mon1 | 2026-07-27 17:03:15.950316 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:03:15.950321 | mon1 | Monday 27 July 2026 17:03:15 +0000 (0:00:00.064) 0:04:14.875 *********** 2026-07-27 17:03:16.624720 | mon1 | changed: [osd1] 2026-07-27 17:03:16.624888 | mon1 | 2026-07-27 17:03:16.625041 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:03:16.625186 | mon1 | Monday 27 July 2026 17:03:16 +0000 (0:00:00.676) 0:04:15.552 *********** 2026-07-27 17:03:16.677483 | mon1 | skipping: [osd1] 2026-07-27 17:03:16.678572 | mon1 | 2026-07-27 17:03:16.678799 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:03:16.678991 | mon1 | Monday 27 July 2026 17:03:16 +0000 (0:00:00.053) 0:04:15.605 *********** 2026-07-27 17:03:16.732252 | mon1 | skipping: [osd1] 2026-07-27 17:03:16.732291 | mon1 | 2026-07-27 17:03:16.732297 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:03:16.732303 | mon1 | Monday 27 July 2026 17:03:16 +0000 (0:00:00.054) 0:04:15.659 *********** 2026-07-27 17:03:17.001185 | mon1 | ok: [osd1] 2026-07-27 17:03:17.001220 | mon1 | 2026-07-27 17:03:17.001225 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:03:17.001230 | mon1 | Monday 27 July 2026 17:03:16 +0000 (0:00:00.266) 0:04:15.926 *********** 2026-07-27 17:03:18.290228 | mon1 | ok: [osd1] 2026-07-27 17:03:18.291513 | mon1 | 2026-07-27 17:03:18.291672 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:03:18.291816 | mon1 | Monday 27 July 2026 17:03:18 +0000 (0:00:01.291) 0:04:17.218 *********** 2026-07-27 17:03:18.376773 | mon1 | ok: [osd1] => { 2026-07-27 17:03:18.377658 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 17:03:18.377871 | mon1 | } 2026-07-27 17:03:18.381836 | mon1 | 2026-07-27 17:03:18.381859 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:03:18.381865 | mon1 | Monday 27 July 2026 17:03:18 +0000 (0:00:00.086) 0:04:17.304 *********** 2026-07-27 17:03:19.247094 | mon1 | changed: [osd1] 2026-07-27 17:03:19.247324 | mon1 | 2026-07-27 17:03:19.247582 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:03:19.247824 | mon1 | Monday 27 July 2026 17:03:19 +0000 (0:00:00.870) 0:04:18.175 *********** 2026-07-27 17:03:22.182846 | mon1 | changed: [osd1] 2026-07-27 17:03:22.183107 | mon1 | 2026-07-27 17:03:22.184604 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 17:03:22.184831 | mon1 | Monday 27 July 2026 17:03:22 +0000 (0:00:02.935) 0:04:21.111 *********** 2026-07-27 17:03:22.219786 | mon1 | skipping: [osd1] 2026-07-27 17:03:22.220003 | mon1 | 2026-07-27 17:03:22.220200 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 17:03:22.220568 | mon1 | Monday 27 July 2026 17:03:22 +0000 (0:00:00.036) 0:04:21.147 *********** 2026-07-27 17:03:22.253540 | mon1 | skipping: [osd1] 2026-07-27 17:03:22.253571 | mon1 | 2026-07-27 17:03:22.253577 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 17:03:22.253583 | mon1 | Monday 27 July 2026 17:03:22 +0000 (0:00:00.033) 0:04:21.181 *********** 2026-07-27 17:03:22.286802 | mon1 | skipping: [osd1] 2026-07-27 17:03:22.287011 | mon1 | 2026-07-27 17:03:22.287207 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 17:03:22.287466 | mon1 | Monday 27 July 2026 17:03:22 +0000 (0:00:00.031) 0:04:21.213 *********** 2026-07-27 17:03:32.089651 | mon1 | changed: [osd1] 2026-07-27 17:03:32.089872 | mon1 | 2026-07-27 17:03:32.090285 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 17:03:32.090639 | mon1 | Monday 27 July 2026 17:03:32 +0000 (0:00:09.803) 0:04:31.016 *********** 2026-07-27 17:03:32.718003 | mon1 | changed: [osd1] 2026-07-27 17:03:32.718146 | mon1 | 2026-07-27 17:03:32.718310 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 17:03:32.718515 | mon1 | Monday 27 July 2026 17:03:32 +0000 (0:00:00.628) 0:04:31.645 *********** 2026-07-27 17:03:33.975427 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-07-27 17:03:33.975467 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 17:03:33.975474 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 17:03:33.975483 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 17:03:33.975495 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 17:03:33.975508 | mon1 | 2026-07-27 17:03:33.975729 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 17:03:33.975970 | mon1 | Monday 27 July 2026 17:03:33 +0000 (0:00:01.255) 0:04:32.900 *********** 2026-07-27 17:03:34.730226 | mon1 | changed: [osd1] 2026-07-27 17:03:34.731474 | mon1 | 2026-07-27 17:03:34.731549 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 17:03:34.731563 | mon1 | Monday 27 July 2026 17:03:34 +0000 (0:00:00.750) 0:04:33.651 *********** 2026-07-27 17:03:34.731582 | mon1 | 2026-07-27 17:03:34.731876 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-27 17:03:34.732213 | mon1 | Monday 27 July 2026 17:03:34 +0000 (0:00:00.006) 0:04:33.657 *********** 2026-07-27 17:03:35.714994 | mon1 | ok: [osd1] 2026-07-27 17:03:35.715103 | mon1 | 2026-07-27 17:03:35.715341 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-07-27 17:03:35.715549 | mon1 | Monday 27 July 2026 17:03:35 +0000 (0:00:00.984) 0:04:34.642 *********** 2026-07-27 17:03:36.312836 | mon1 | changed: [osd1] 2026-07-27 17:03:36.313000 | mon1 | 2026-07-27 17:03:36.313441 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 17:03:36.313517 | mon1 | Monday 27 July 2026 17:03:36 +0000 (0:00:00.598) 0:04:35.240 *********** 2026-07-27 17:03:37.061286 | mon1 | changed: [osd1] 2026-07-27 17:03:37.061545 | mon1 | 2026-07-27 17:03:37.061825 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:03:37.062098 | mon1 | Monday 27 July 2026 17:03:37 +0000 (0:00:00.748) 0:04:35.989 *********** 2026-07-27 17:03:37.321977 | mon1 | ok: [osd1] 2026-07-27 17:03:37.322162 | mon1 | 2026-07-27 17:03:37.322560 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:03:37.322930 | mon1 | Monday 27 July 2026 17:03:37 +0000 (0:00:00.260) 0:04:36.249 *********** 2026-07-27 17:03:37.388808 | mon1 | ok: [osd1] => { 2026-07-27 17:03:37.389116 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 17:03:37.389480 | mon1 | } 2026-07-27 17:03:37.389775 | mon1 | 2026-07-27 17:03:37.390145 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:03:37.390405 | mon1 | Monday 27 July 2026 17:03:37 +0000 (0:00:00.067) 0:04:36.316 *********** 2026-07-27 17:03:38.310929 | mon1 | changed: [osd1] 2026-07-27 17:03:38.311202 | mon1 | 2026-07-27 17:03:38.311579 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:03:38.311974 | mon1 | Monday 27 July 2026 17:03:38 +0000 (0:00:00.922) 0:04:37.238 *********** 2026-07-27 17:03:43.023482 | mon1 | changed: [osd1] 2026-07-27 17:03:43.023700 | mon1 | 2026-07-27 17:03:43.023978 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 17:03:43.024236 | mon1 | Monday 27 July 2026 17:03:43 +0000 (0:00:04.712) 0:04:41.951 *********** 2026-07-27 17:03:44.346588 | mon1 | ok: [osd1] 2026-07-27 17:03:44.346829 | mon1 | 2026-07-27 17:03:44.347081 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 17:03:44.347256 | mon1 | Monday 27 July 2026 17:03:44 +0000 (0:00:01.323) 0:04:43.274 *********** 2026-07-27 17:03:44.673875 | mon1 | changed: [osd1] 2026-07-27 17:03:44.674073 | mon1 | 2026-07-27 17:03:44.674334 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 17:03:44.674653 | mon1 | Monday 27 July 2026 17:03:44 +0000 (0:00:00.327) 0:04:43.601 *********** 2026-07-27 17:03:45.282310 | mon1 | changed: [osd1] 2026-07-27 17:03:45.282557 | mon1 | 2026-07-27 17:03:45.282913 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 17:03:45.283146 | mon1 | Monday 27 July 2026 17:03:45 +0000 (0:00:00.608) 0:04:44.210 *********** 2026-07-27 17:03:46.009636 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-07-27 17:03:46.009715 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 17:03:46.009730 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 17:03:46.009751 | mon1 | 2026-07-27 17:03:46.010244 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 17:03:46.010318 | mon1 | Monday 27 July 2026 17:03:46 +0000 (0:00:00.726) 0:04:44.936 *********** 2026-07-27 17:03:46.595562 | mon1 | changed: [osd1] 2026-07-27 17:03:46.595637 | mon1 | 2026-07-27 17:03:46.595655 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 17:03:46.595672 | mon1 | Monday 27 July 2026 17:03:46 +0000 (0:00:00.585) 0:04:45.521 *********** 2026-07-27 17:03:47.199552 | mon1 | changed: [osd1] 2026-07-27 17:03:47.199621 | mon1 | 2026-07-27 17:03:47.199635 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 17:03:47.199648 | mon1 | Monday 27 July 2026 17:03:47 +0000 (0:00:00.596) 0:04:46.118 *********** 2026-07-27 17:03:47.199659 | mon1 | 2026-07-27 17:03:47.199681 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-07-27 17:03:47.200020 | mon1 | Monday 27 July 2026 17:03:47 +0000 (0:00:00.006) 0:04:46.125 *********** 2026-07-27 17:03:48.163497 | mon1 | ok: [osd1] 2026-07-27 17:03:48.163567 | mon1 | 2026-07-27 17:03:48.164043 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-07-27 17:03:48.164102 | mon1 | Monday 27 July 2026 17:03:48 +0000 (0:00:00.965) 0:04:47.090 *********** 2026-07-27 17:03:49.080885 | mon1 | changed: [osd1] 2026-07-27 17:03:49.080976 | mon1 | 2026-07-27 17:03:49.084301 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 17:03:49.084389 | mon1 | Monday 27 July 2026 17:03:49 +0000 (0:00:00.918) 0:04:48.008 *********** 2026-07-27 17:03:49.842936 | mon1 | changed: [osd1] 2026-07-27 17:03:49.843139 | mon1 | 2026-07-27 17:03:49.843296 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 17:03:49.843479 | mon1 | Monday 27 July 2026 17:03:49 +0000 (0:00:00.762) 0:04:48.770 *********** 2026-07-27 17:03:49.901208 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 17:03:49.901805 | mon1 | 2026-07-27 17:03:49.902262 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 17:03:49.902748 | mon1 | Monday 27 July 2026 17:03:49 +0000 (0:00:00.057) 0:04:48.828 *********** 2026-07-27 17:03:51.050071 | mon1 | ok: [osd1] 2026-07-27 17:03:51.050525 | mon1 | 2026-07-27 17:03:51.050746 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:03:51.050952 | mon1 | Monday 27 July 2026 17:03:51 +0000 (0:00:01.148) 0:04:49.977 *********** 2026-07-27 17:03:51.912797 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-07-27 17:03:51.913061 | mon1 | ok: [osd1] => (item=ssh) 2026-07-27 17:03:51.913253 | mon1 | 2026-07-27 17:03:51.913470 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:03:51.916650 | mon1 | Monday 27 July 2026 17:03:51 +0000 (0:00:00.863) 0:04:50.840 *********** 2026-07-27 17:03:52.317050 | mon1 | changed: [osd1] 2026-07-27 17:03:52.317228 | mon1 | 2026-07-27 17:03:52.317409 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:03:52.317596 | mon1 | Monday 27 July 2026 17:03:52 +0000 (0:00:00.405) 0:04:51.245 *********** 2026-07-27 17:03:52.577900 | mon1 | ok: [osd1] 2026-07-27 17:03:52.578145 | mon1 | 2026-07-27 17:03:52.578455 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:03:52.578726 | mon1 | Monday 27 July 2026 17:03:52 +0000 (0:00:00.259) 0:04:51.505 *********** 2026-07-27 17:03:52.990000 | mon1 | changed: [osd1] 2026-07-27 17:03:52.990341 | mon1 | 2026-07-27 17:03:52.990675 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:03:52.990968 | mon1 | Monday 27 July 2026 17:03:52 +0000 (0:00:00.410) 0:04:51.916 *********** 2026-07-27 17:03:53.275268 | mon1 | changed: [osd1] 2026-07-27 17:03:53.275784 | mon1 | 2026-07-27 17:03:53.276196 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-07-27 17:03:53.276597 | mon1 | Monday 27 July 2026 17:03:53 +0000 (0:00:00.286) 0:04:52.202 *********** 2026-07-27 17:03:53.586028 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-07-27 17:03:53.586248 | mon1 | 2026-07-27 17:03:53.586468 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-07-27 17:03:53.586724 | mon1 | Monday 27 July 2026 17:03:53 +0000 (0:00:00.311) 0:04:52.514 *********** 2026-07-27 17:03:53.679122 | mon1 | ok: [osd1] 2026-07-27 17:03:53.679533 | mon1 | 2026-07-27 17:03:53.679945 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:03:53.680389 | mon1 | Monday 27 July 2026 17:03:53 +0000 (0:00:00.093) 0:04:52.607 *********** 2026-07-27 17:03:53.775767 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-07-27 17:03:53.775820 | mon1 | 2026-07-27 17:03:53.775938 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:03:53.776053 | mon1 | Monday 27 July 2026 17:03:53 +0000 (0:00:00.096) 0:04:52.703 *********** 2026-07-27 17:04:00.621775 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:04:00.621852 | mon1 | 2026-07-27 17:04:00.621867 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:04:00.621879 | mon1 | Monday 27 July 2026 17:04:00 +0000 (0:00:06.844) 0:04:59.548 *********** 2026-07-27 17:04:00.678438 | mon1 | ok: [osd1] => (item=osd1) 2026-07-27 17:04:00.678480 | mon1 | 2026-07-27 17:04:00.678489 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:04:00.678497 | mon1 | Monday 27 July 2026 17:04:00 +0000 (0:00:00.057) 0:04:59.605 *********** 2026-07-27 17:04:01.043644 | mon1 | changed: [osd1] 2026-07-27 17:04:01.043752 | mon1 | 2026-07-27 17:04:01.044470 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:04:01.044546 | mon1 | Monday 27 July 2026 17:04:01 +0000 (0:00:00.365) 0:04:59.970 *********** 2026-07-27 17:04:10.581514 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:04:10.581584 | mon1 | 2026-07-27 17:04:10.581963 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-07-27 17:04:10.581998 | mon1 | Monday 27 July 2026 17:04:10 +0000 (0:00:09.538) 0:05:09.508 *********** 2026-07-27 17:04:12.282292 | mon1 | ok: [osd1] 2026-07-27 17:04:12.282401 | mon1 | 2026-07-27 17:04:12.282413 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-07-27 17:04:12.282422 | mon1 | Monday 27 July 2026 17:04:12 +0000 (0:00:01.699) 0:05:11.208 *********** 2026-07-27 17:04:57.705574 | mon1 | ok: [osd1] 2026-07-27 17:04:57.705688 | mon1 | 2026-07-27 17:04:57.706524 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-07-27 17:04:57.706601 | mon1 | Monday 27 July 2026 17:04:57 +0000 (0:00:45.424) 0:05:56.632 *********** 2026-07-27 17:06:34.981976 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-07-27 17:06:34.982069 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-07-27 17:06:34.982133 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-07-27 17:06:34.982273 | mon1 | 2026-07-27 17:06:34.982338 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-07-27 17:06:34.982500 | mon1 | Monday 27 July 2026 17:06:34 +0000 (0:01:37.275) 0:07:33.908 *********** 2026-07-27 17:06:41.717813 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:06:41.717909 | mon1 | 2026-07-27 17:06:41.718156 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-07-27 17:06:41.718189 | mon1 | Monday 27 July 2026 17:06:41 +0000 (0:00:06.737) 0:07:40.645 *********** 2026-07-27 17:06:48.058284 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:06:48.058444 | mon1 | 2026-07-27 17:06:48.058754 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-07-27 17:06:48.059053 | mon1 | Monday 27 July 2026 17:06:48 +0000 (0:00:06.340) 0:07:46.985 *********** 2026-07-27 17:06:48.128534 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-07-27 17:06:48.128606 | mon1 | 2026-07-27 17:06:48.128622 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-07-27 17:06:48.128880 | mon1 | Monday 27 July 2026 17:06:48 +0000 (0:00:00.069) 0:07:47.055 *********** 2026-07-27 17:06:48.173993 | mon1 | ok: [osd1] 2026-07-27 17:06:48.174091 | mon1 | 2026-07-27 17:06:48.174379 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-07-27 17:06:48.174453 | mon1 | Monday 27 July 2026 17:06:48 +0000 (0:00:00.046) 0:07:47.101 *********** 2026-07-27 17:06:54.619081 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:06:54.619145 | mon1 | 2026-07-27 17:06:54.619161 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-07-27 17:06:54.619175 | mon1 | Monday 27 July 2026 17:06:54 +0000 (0:00:06.444) 0:07:53.545 *********** 2026-07-27 17:06:54.665874 | mon1 | ok: [osd1] 2026-07-27 17:06:54.665955 | mon1 | 2026-07-27 17:06:54.666021 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-07-27 17:06:54.666144 | mon1 | Monday 27 July 2026 17:06:54 +0000 (0:00:00.045) 0:07:53.591 *********** 2026-07-27 17:06:54.709991 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:06:54.710069 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:06:54.710163 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:06:54.710695 | mon1 | skipping: [osd1] 2026-07-27 17:06:54.710732 | mon1 | 2026-07-27 17:06:54.710738 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-07-27 17:06:54.710744 | mon1 | Monday 27 July 2026 17:06:54 +0000 (0:00:00.046) 0:07:53.638 *********** 2026-07-27 17:06:54.780681 | mon1 | skipping: [osd1] 2026-07-27 17:06:54.780715 | mon1 | 2026-07-27 17:06:54.780726 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-07-27 17:06:54.780732 | mon1 | 2026-07-27 17:06:54.780737 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:06:54.780868 | mon1 | Monday 27 July 2026 17:06:54 +0000 (0:00:00.068) 0:07:53.706 *********** 2026-07-27 17:06:55.731583 | mon1 | ok: [mon1] 2026-07-27 17:06:55.731665 | mon1 | 2026-07-27 17:06:55.731682 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:06:55.731701 | mon1 | Monday 27 July 2026 17:06:55 +0000 (0:00:00.951) 0:07:54.657 *********** 2026-07-27 17:06:55.990742 | mon1 | ok: [mon1] 2026-07-27 17:06:55.991050 | mon1 | 2026-07-27 17:06:55.991395 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:06:55.991754 | mon1 | Monday 27 July 2026 17:06:55 +0000 (0:00:00.260) 0:07:54.918 *********** 2026-07-27 17:06:56.026820 | mon1 | skipping: [mon1] 2026-07-27 17:06:56.027019 | mon1 | 2026-07-27 17:06:56.027453 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 17:06:56.027718 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.036) 0:07:54.954 *********** 2026-07-27 17:06:56.297228 | mon1 | ok: [mon1] 2026-07-27 17:06:56.297493 | mon1 | 2026-07-27 17:06:56.297772 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:06:56.298102 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.269) 0:07:55.224 *********** 2026-07-27 17:06:56.370432 | mon1 | ok: [mon1] => { 2026-07-27 17:06:56.370769 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 17:06:56.371162 | mon1 | } 2026-07-27 17:06:56.371335 | mon1 | 2026-07-27 17:06:56.371724 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:06:56.372043 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.073) 0:07:55.297 *********** 2026-07-27 17:06:56.794343 | mon1 | ok: [mon1] 2026-07-27 17:06:56.794403 | mon1 | 2026-07-27 17:06:56.794411 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:06:56.794417 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.423) 0:07:55.721 *********** 2026-07-27 17:06:56.843019 | mon1 | skipping: [mon1] 2026-07-27 17:06:56.843075 | mon1 | 2026-07-27 17:06:56.843086 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:06:56.843097 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.047) 0:07:55.769 *********** 2026-07-27 17:06:56.888340 | mon1 | skipping: [mon1] 2026-07-27 17:06:56.888401 | mon1 | 2026-07-27 17:06:56.888408 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:06:56.888413 | mon1 | Monday 27 July 2026 17:06:56 +0000 (0:00:00.045) 0:07:55.815 *********** 2026-07-27 17:06:57.158102 | mon1 | ok: [mon1] 2026-07-27 17:06:57.158161 | mon1 | 2026-07-27 17:06:57.158172 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:06:57.158184 | mon1 | Monday 27 July 2026 17:06:57 +0000 (0:00:00.269) 0:07:56.084 *********** 2026-07-27 17:06:58.150808 | mon1 | ok: [mon1] 2026-07-27 17:06:58.150872 | mon1 | 2026-07-27 17:06:58.151008 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:06:58.151125 | mon1 | Monday 27 July 2026 17:06:58 +0000 (0:00:00.993) 0:07:57.077 *********** 2026-07-27 17:06:58.255491 | mon1 | ok: [mon1] => { 2026-07-27 17:06:58.255596 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 17:06:58.256528 | mon1 | } 2026-07-27 17:06:58.256596 | mon1 | 2026-07-27 17:06:58.256609 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:06:58.256763 | mon1 | Monday 27 July 2026 17:06:58 +0000 (0:00:00.104) 0:07:57.182 *********** 2026-07-27 17:06:58.710216 | mon1 | ok: [mon1] 2026-07-27 17:06:58.710329 | mon1 | 2026-07-27 17:06:58.710469 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:06:58.710507 | mon1 | Monday 27 July 2026 17:06:58 +0000 (0:00:00.454) 0:07:57.637 *********** 2026-07-27 17:07:01.924384 | mon1 | ok: [mon1] 2026-07-27 17:07:01.924460 | mon1 | 2026-07-27 17:07:01.924468 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 17:07:01.924475 | mon1 | Monday 27 July 2026 17:07:01 +0000 (0:00:03.214) 0:08:00.852 *********** 2026-07-27 17:07:01.958804 | mon1 | skipping: [mon1] 2026-07-27 17:07:01.958911 | mon1 | 2026-07-27 17:07:01.959058 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 17:07:01.959177 | mon1 | Monday 27 July 2026 17:07:01 +0000 (0:00:00.034) 0:08:00.886 *********** 2026-07-27 17:07:01.995646 | mon1 | skipping: [mon1] 2026-07-27 17:07:01.995685 | mon1 | 2026-07-27 17:07:01.995694 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 17:07:01.995720 | mon1 | Monday 27 July 2026 17:07:01 +0000 (0:00:00.036) 0:08:00.922 *********** 2026-07-27 17:07:02.028108 | mon1 | skipping: [mon1] 2026-07-27 17:07:02.028197 | mon1 | 2026-07-27 17:07:02.028208 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 17:07:02.028218 | mon1 | Monday 27 July 2026 17:07:02 +0000 (0:00:00.030) 0:08:00.953 *********** 2026-07-27 17:07:03.051429 | mon1 | ok: [mon1] 2026-07-27 17:07:03.051483 | mon1 | 2026-07-27 17:07:03.051495 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 17:07:03.051505 | mon1 | Monday 27 July 2026 17:07:03 +0000 (0:00:01.024) 0:08:01.978 *********** 2026-07-27 17:07:03.657845 | mon1 | ok: [mon1] 2026-07-27 17:07:03.657893 | mon1 | 2026-07-27 17:07:03.657904 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 17:07:03.657914 | mon1 | Monday 27 July 2026 17:07:03 +0000 (0:00:00.606) 0:08:02.584 *********** 2026-07-27 17:07:04.834558 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-27 17:07:04.834620 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 17:07:04.834628 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 17:07:04.834639 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 17:07:04.834978 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 17:07:04.835211 | mon1 | 2026-07-27 17:07:04.835699 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 17:07:04.836076 | mon1 | Monday 27 July 2026 17:07:04 +0000 (0:00:01.176) 0:08:03.761 *********** 2026-07-27 17:07:05.549223 | mon1 | ok: [mon1] 2026-07-27 17:07:05.549266 | mon1 | 2026-07-27 17:07:05.549435 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 17:07:05.549584 | mon1 | Monday 27 July 2026 17:07:05 +0000 (0:00:00.708) 0:08:04.470 *********** 2026-07-27 17:07:05.549774 | mon1 | 2026-07-27 17:07:05.549859 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 17:07:05.549976 | mon1 | Monday 27 July 2026 17:07:05 +0000 (0:00:00.006) 0:08:04.477 *********** 2026-07-27 17:07:06.032459 | mon1 | ok: [mon1] 2026-07-27 17:07:06.032547 | mon1 | 2026-07-27 17:07:06.032727 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:07:06.032871 | mon1 | Monday 27 July 2026 17:07:06 +0000 (0:00:00.483) 0:08:04.960 *********** 2026-07-27 17:07:06.293839 | mon1 | ok: [mon1] 2026-07-27 17:07:06.294006 | mon1 | 2026-07-27 17:07:06.294290 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:07:06.294611 | mon1 | Monday 27 July 2026 17:07:06 +0000 (0:00:00.261) 0:08:05.221 *********** 2026-07-27 17:07:06.359343 | mon1 | ok: [mon1] => { 2026-07-27 17:07:06.359667 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 17:07:06.359942 | mon1 | } 2026-07-27 17:07:06.360182 | mon1 | 2026-07-27 17:07:06.360563 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:07:06.360871 | mon1 | Monday 27 July 2026 17:07:06 +0000 (0:00:00.065) 0:08:05.287 *********** 2026-07-27 17:07:06.794388 | mon1 | ok: [mon1] 2026-07-27 17:07:06.794618 | mon1 | 2026-07-27 17:07:06.794949 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:07:06.795219 | mon1 | Monday 27 July 2026 17:07:06 +0000 (0:00:00.435) 0:08:05.722 *********** 2026-07-27 17:07:10.198197 | mon1 | ok: [mon1] 2026-07-27 17:07:10.198296 | mon1 | 2026-07-27 17:07:10.198440 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 17:07:10.198555 | mon1 | Monday 27 July 2026 17:07:10 +0000 (0:00:03.403) 0:08:09.125 *********** 2026-07-27 17:07:11.282219 | mon1 | ok: [mon1] 2026-07-27 17:07:11.282326 | mon1 | 2026-07-27 17:07:11.282505 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 17:07:11.282730 | mon1 | Monday 27 July 2026 17:07:11 +0000 (0:00:01.084) 0:08:10.210 *********** 2026-07-27 17:07:11.551081 | mon1 | ok: [mon1] 2026-07-27 17:07:11.551211 | mon1 | 2026-07-27 17:07:11.551416 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 17:07:11.551617 | mon1 | Monday 27 July 2026 17:07:11 +0000 (0:00:00.268) 0:08:10.479 *********** 2026-07-27 17:07:12.103921 | mon1 | ok: [mon1] 2026-07-27 17:07:12.104258 | mon1 | 2026-07-27 17:07:12.104729 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 17:07:12.105072 | mon1 | Monday 27 July 2026 17:07:12 +0000 (0:00:00.552) 0:08:11.031 *********** 2026-07-27 17:07:12.822506 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-27 17:07:12.822562 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 17:07:12.823166 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 17:07:12.823215 | mon1 | 2026-07-27 17:07:12.823224 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 17:07:12.823232 | mon1 | Monday 27 July 2026 17:07:12 +0000 (0:00:00.718) 0:08:11.750 *********** 2026-07-27 17:07:13.377056 | mon1 | ok: [mon1] 2026-07-27 17:07:13.377115 | mon1 | 2026-07-27 17:07:13.377130 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 17:07:13.377144 | mon1 | Monday 27 July 2026 17:07:13 +0000 (0:00:00.553) 0:08:12.304 *********** 2026-07-27 17:07:13.919535 | mon1 | ok: [mon1] 2026-07-27 17:07:13.919704 | mon1 | 2026-07-27 17:07:13.920078 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 17:07:13.920347 | mon1 | Monday 27 July 2026 17:07:13 +0000 (0:00:00.536) 0:08:12.840 *********** 2026-07-27 17:07:13.920780 | mon1 | 2026-07-27 17:07:13.921190 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 17:07:13.921676 | mon1 | Monday 27 July 2026 17:07:13 +0000 (0:00:00.007) 0:08:12.847 *********** 2026-07-27 17:07:14.402306 | mon1 | ok: [mon1] 2026-07-27 17:07:14.402442 | mon1 | 2026-07-27 17:07:14.402574 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 17:07:14.402751 | mon1 | Monday 27 July 2026 17:07:14 +0000 (0:00:00.482) 0:08:13.329 *********** 2026-07-27 17:07:14.455123 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 17:07:14.455250 | mon1 | 2026-07-27 17:07:14.455653 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 17:07:14.455825 | mon1 | Monday 27 July 2026 17:07:14 +0000 (0:00:00.053) 0:08:13.383 *********** 2026-07-27 17:07:15.428548 | mon1 | ok: [mon1] 2026-07-27 17:07:15.428613 | mon1 | 2026-07-27 17:07:15.428627 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:07:15.428645 | mon1 | Monday 27 July 2026 17:07:15 +0000 (0:00:00.972) 0:08:14.355 *********** 2026-07-27 17:07:16.279023 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-07-27 17:07:16.279094 | mon1 | ok: [mon1] => (item=ssh) 2026-07-27 17:07:16.279178 | mon1 | 2026-07-27 17:07:16.279299 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:07:16.279451 | mon1 | Monday 27 July 2026 17:07:16 +0000 (0:00:00.851) 0:08:15.206 *********** 2026-07-27 17:07:16.703421 | mon1 | ok: [mon1] 2026-07-27 17:07:16.703464 | mon1 | 2026-07-27 17:07:16.703472 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:07:16.703479 | mon1 | Monday 27 July 2026 17:07:16 +0000 (0:00:00.423) 0:08:15.630 *********** 2026-07-27 17:07:16.960152 | mon1 | ok: [mon1] 2026-07-27 17:07:16.960213 | mon1 | 2026-07-27 17:07:16.960226 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:07:16.960239 | mon1 | Monday 27 July 2026 17:07:16 +0000 (0:00:00.255) 0:08:15.886 *********** 2026-07-27 17:07:17.270896 | mon1 | ok: [mon1] 2026-07-27 17:07:17.271418 | mon1 | 2026-07-27 17:07:17.271443 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:07:17.271468 | mon1 | Monday 27 July 2026 17:07:17 +0000 (0:00:00.310) 0:08:16.197 *********** 2026-07-27 17:07:17.526310 | mon1 | ok: [mon1] 2026-07-27 17:07:17.526438 | mon1 | 2026-07-27 17:07:17.526451 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-07-27 17:07:17.526461 | mon1 | Monday 27 July 2026 17:07:17 +0000 (0:00:00.255) 0:08:16.452 *********** 2026-07-27 17:07:39.782798 | mon1 | changed: [mon1] 2026-07-27 17:07:39.782900 | mon1 | 2026-07-27 17:07:39.783032 | mon1 | PLAY RECAP ********************************************************************* 2026-07-27 17:07:39.783183 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-07-27 17:07:39.783336 | mon1 | osd1 : ok=53 changed=23 unreachable=0 failed=0 skipped=8 rescued=0 ignored=0 2026-07-27 17:07:39.783499 | mon1 | 2026-07-27 17:07:39.783628 | mon1 | 2026-07-27 17:07:39.783773 | mon1 | TASKS RECAP ******************************************************************** 2026-07-27 17:07:39.783920 | mon1 | Monday 27 July 2026 17:07:39 +0000 (0:00:22.256) 0:08:38.708 *********** 2026-07-27 17:07:39.784056 | mon1 | =============================================================================== 2026-07-27 17:07:39.784204 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 111.32s 2026-07-27 17:07:39.784366 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 97.28s 2026-07-27 17:07:39.784519 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 45.42s 2026-07-27 17:07:39.784669 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 25.00s 2026-07-27 17:07:39.784814 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 22.26s 2026-07-27 17:07:39.784962 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.40s 2026-07-27 17:07:39.785121 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.31s 2026-07-27 17:07:39.785268 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 11.95s 2026-07-27 17:07:39.788556 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.80s 2026-07-27 17:07:39.788734 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.54s 2026-07-27 17:07:39.788889 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.36s 2026-07-27 17:07:39.789025 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.87s 2026-07-27 17:07:39.789120 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.85s 2026-07-27 17:07:39.789224 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.84s 2026-07-27 17:07:39.789335 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.74s 2026-07-27 17:07:39.789460 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.44s 2026-07-27 17:07:39.789569 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.34s 2026-07-27 17:07:39.789705 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.32s 2026-07-27 17:07:39.789821 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.05s 2026-07-27 17:07:39.789931 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.66s 2026-07-27 17:07:39.894389 | mon1 | INFO [default > converge] Executed: Successful 2026-07-27 17:07:39.899015 | mon1 | INFO [default > idempotence] Executing 2026-07-27 17:07:41.127954 | mon1 | 2026-07-27 17:07:41.128495 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-07-27 17:07:41.128834 | mon1 | 2026-07-27 17:07:41.129218 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:07:41.129594 | mon1 | Monday 27 July 2026 17:07:41 +0000 (0:00:00.067) 0:00:00.067 *********** 2026-07-27 17:07:42.580548 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-07-27 17:07:42.580633 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 17:07:42.580640 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 17:07:42.580646 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 17:07:42.580651 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 17:07:42.590886 | mon1 | ok: [mon1] 2026-07-27 17:07:42.591106 | mon1 | 2026-07-27 17:07:42.591320 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:07:42.591526 | mon1 | Monday 27 July 2026 17:07:42 +0000 (0:00:01.462) 0:00:01.530 *********** 2026-07-27 17:07:42.984134 | mon1 | ok: [mon1] 2026-07-27 17:07:42.984219 | mon1 | 2026-07-27 17:07:42.984402 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:07:42.984545 | mon1 | Monday 27 July 2026 17:07:42 +0000 (0:00:00.393) 0:00:01.923 *********** 2026-07-27 17:07:43.030087 | mon1 | skipping: [mon1] 2026-07-27 17:07:43.030255 | mon1 | 2026-07-27 17:07:43.030544 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 17:07:43.030734 | mon1 | Monday 27 July 2026 17:07:43 +0000 (0:00:00.045) 0:00:01.969 *********** 2026-07-27 17:07:43.434400 | mon1 | ok: [mon1] 2026-07-27 17:07:43.434765 | mon1 | 2026-07-27 17:07:43.435166 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:07:43.435623 | mon1 | Monday 27 July 2026 17:07:43 +0000 (0:00:00.404) 0:00:02.373 *********** 2026-07-27 17:07:43.561756 | mon1 | ok: [mon1] => { 2026-07-27 17:07:43.562060 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 17:07:43.562347 | mon1 | } 2026-07-27 17:07:43.562630 | mon1 | 2026-07-27 17:07:43.562956 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:07:43.563236 | mon1 | Monday 27 July 2026 17:07:43 +0000 (0:00:00.127) 0:00:02.500 *********** 2026-07-27 17:07:44.113520 | mon1 | ok: [mon1] 2026-07-27 17:07:44.113827 | mon1 | 2026-07-27 17:07:44.114162 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:07:44.114599 | mon1 | Monday 27 July 2026 17:07:44 +0000 (0:00:00.552) 0:00:03.053 *********** 2026-07-27 17:07:44.162763 | mon1 | skipping: [mon1] 2026-07-27 17:07:44.162969 | mon1 | 2026-07-27 17:07:44.163237 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:07:44.163525 | mon1 | Monday 27 July 2026 17:07:44 +0000 (0:00:00.049) 0:00:03.102 *********** 2026-07-27 17:07:44.216832 | mon1 | skipping: [mon1] 2026-07-27 17:07:44.216941 | mon1 | 2026-07-27 17:07:44.217094 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:07:44.217313 | mon1 | Monday 27 July 2026 17:07:44 +0000 (0:00:00.053) 0:00:03.156 *********** 2026-07-27 17:07:44.472334 | mon1 | ok: [mon1] 2026-07-27 17:07:44.472493 | mon1 | 2026-07-27 17:07:44.472716 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:07:44.472917 | mon1 | Monday 27 July 2026 17:07:44 +0000 (0:00:00.255) 0:00:03.412 *********** 2026-07-27 17:07:45.692089 | mon1 | ok: [mon1] 2026-07-27 17:07:45.692170 | mon1 | 2026-07-27 17:07:45.692200 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:07:45.692217 | mon1 | Monday 27 July 2026 17:07:45 +0000 (0:00:01.218) 0:00:04.630 *********** 2026-07-27 17:07:45.889572 | mon1 | ok: [mon1] => { 2026-07-27 17:07:45.889639 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 17:07:45.889677 | mon1 | } 2026-07-27 17:07:45.889706 | mon1 | 2026-07-27 17:07:45.889723 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:07:45.889951 | mon1 | Monday 27 July 2026 17:07:45 +0000 (0:00:00.197) 0:00:04.827 *********** 2026-07-27 17:07:46.480850 | mon1 | ok: [mon1] 2026-07-27 17:07:46.480949 | mon1 | 2026-07-27 17:07:46.481116 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:07:46.481273 | mon1 | Monday 27 July 2026 17:07:46 +0000 (0:00:00.591) 0:00:05.418 *********** 2026-07-27 17:07:49.099708 | mon1 | ok: [mon1] 2026-07-27 17:07:49.099807 | mon1 | 2026-07-27 17:07:49.099898 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 17:07:49.100019 | mon1 | Monday 27 July 2026 17:07:49 +0000 (0:00:02.620) 0:00:08.039 *********** 2026-07-27 17:07:49.138851 | mon1 | skipping: [mon1] 2026-07-27 17:07:49.138962 | mon1 | 2026-07-27 17:07:49.139236 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 17:07:49.139269 | mon1 | Monday 27 July 2026 17:07:49 +0000 (0:00:00.037) 0:00:08.077 *********** 2026-07-27 17:07:49.174989 | mon1 | skipping: [mon1] 2026-07-27 17:07:49.175045 | mon1 | 2026-07-27 17:07:49.175062 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 17:07:49.175078 | mon1 | Monday 27 July 2026 17:07:49 +0000 (0:00:00.035) 0:00:08.112 *********** 2026-07-27 17:07:49.210240 | mon1 | skipping: [mon1] 2026-07-27 17:07:49.210303 | mon1 | 2026-07-27 17:07:49.210317 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 17:07:49.210331 | mon1 | Monday 27 July 2026 17:07:49 +0000 (0:00:00.034) 0:00:08.147 *********** 2026-07-27 17:07:50.205604 | mon1 | ok: [mon1] 2026-07-27 17:07:50.205657 | mon1 | 2026-07-27 17:07:50.205668 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 17:07:50.205678 | mon1 | Monday 27 July 2026 17:07:50 +0000 (0:00:00.994) 0:00:09.142 *********** 2026-07-27 17:07:50.806405 | mon1 | ok: [mon1] 2026-07-27 17:07:50.806448 | mon1 | 2026-07-27 17:07:50.806457 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 17:07:50.806466 | mon1 | Monday 27 July 2026 17:07:50 +0000 (0:00:00.603) 0:00:09.745 *********** 2026-07-27 17:07:52.097545 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-27 17:07:52.097628 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 17:07:52.097638 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 17:07:52.097646 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 17:07:52.097654 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 17:07:52.097662 | mon1 | 2026-07-27 17:07:52.097669 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 17:07:52.097677 | mon1 | Monday 27 July 2026 17:07:52 +0000 (0:00:01.289) 0:00:11.035 *********** 2026-07-27 17:07:52.806950 | mon1 | ok: [mon1] 2026-07-27 17:07:52.806997 | mon1 | 2026-07-27 17:07:52.807006 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 17:07:52.807014 | mon1 | Monday 27 July 2026 17:07:52 +0000 (0:00:00.698) 0:00:11.733 *********** 2026-07-27 17:07:52.807022 | mon1 | 2026-07-27 17:07:52.807045 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 17:07:52.807052 | mon1 | Monday 27 July 2026 17:07:52 +0000 (0:00:00.011) 0:00:11.744 *********** 2026-07-27 17:07:53.549306 | mon1 | ok: [mon1] 2026-07-27 17:07:53.549384 | mon1 | 2026-07-27 17:07:53.549393 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:07:53.549399 | mon1 | Monday 27 July 2026 17:07:53 +0000 (0:00:00.743) 0:00:12.488 *********** 2026-07-27 17:07:53.822601 | mon1 | ok: [mon1] 2026-07-27 17:07:53.822709 | mon1 | 2026-07-27 17:07:53.822723 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:07:53.822737 | mon1 | Monday 27 July 2026 17:07:53 +0000 (0:00:00.271) 0:00:12.759 *********** 2026-07-27 17:07:53.948433 | mon1 | ok: [mon1] => { 2026-07-27 17:07:53.948528 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 17:07:53.948543 | mon1 | } 2026-07-27 17:07:53.948557 | mon1 | 2026-07-27 17:07:53.948570 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:07:53.948583 | mon1 | Monday 27 July 2026 17:07:53 +0000 (0:00:00.125) 0:00:12.884 *********** 2026-07-27 17:07:54.391414 | mon1 | ok: [mon1] 2026-07-27 17:07:54.391449 | mon1 | 2026-07-27 17:07:54.391456 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:07:54.391463 | mon1 | Monday 27 July 2026 17:07:54 +0000 (0:00:00.445) 0:00:13.330 *********** 2026-07-27 17:07:58.193385 | mon1 | ok: [mon1] 2026-07-27 17:07:58.193427 | mon1 | 2026-07-27 17:07:58.193434 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 17:07:58.193440 | mon1 | Monday 27 July 2026 17:07:58 +0000 (0:00:03.802) 0:00:17.132 *********** 2026-07-27 17:07:59.291478 | mon1 | ok: [mon1] 2026-07-27 17:07:59.291517 | mon1 | 2026-07-27 17:07:59.291522 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 17:07:59.291527 | mon1 | Monday 27 July 2026 17:07:59 +0000 (0:00:01.096) 0:00:18.228 *********** 2026-07-27 17:07:59.662080 | mon1 | ok: [mon1] 2026-07-27 17:07:59.662155 | mon1 | 2026-07-27 17:07:59.662303 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 17:07:59.662500 | mon1 | Monday 27 July 2026 17:07:59 +0000 (0:00:00.371) 0:00:18.600 *********** 2026-07-27 17:08:00.283532 | mon1 | ok: [mon1] 2026-07-27 17:08:00.283597 | mon1 | 2026-07-27 17:08:00.283613 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 17:08:00.283633 | mon1 | Monday 27 July 2026 17:08:00 +0000 (0:00:00.605) 0:00:19.205 *********** 2026-07-27 17:08:01.015458 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-27 17:08:01.015529 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 17:08:01.015544 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 17:08:01.015557 | mon1 | 2026-07-27 17:08:01.015572 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 17:08:01.015591 | mon1 | Monday 27 July 2026 17:08:01 +0000 (0:00:00.748) 0:00:19.954 *********** 2026-07-27 17:08:01.657529 | mon1 | ok: [mon1] 2026-07-27 17:08:01.657597 | mon1 | 2026-07-27 17:08:01.657690 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 17:08:01.657982 | mon1 | Monday 27 July 2026 17:08:01 +0000 (0:00:00.641) 0:00:20.595 *********** 2026-07-27 17:08:02.254029 | mon1 | ok: [mon1] 2026-07-27 17:08:02.254097 | mon1 | 2026-07-27 17:08:02.254226 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 17:08:02.255448 | mon1 | Monday 27 July 2026 17:08:02 +0000 (0:00:00.589) 0:00:21.184 *********** 2026-07-27 17:08:02.255511 | mon1 | 2026-07-27 17:08:02.255519 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 17:08:02.255525 | mon1 | Monday 27 July 2026 17:08:02 +0000 (0:00:00.008) 0:00:21.193 *********** 2026-07-27 17:08:02.732392 | mon1 | ok: [mon1] 2026-07-27 17:08:02.732426 | mon1 | 2026-07-27 17:08:02.732690 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 17:08:02.733027 | mon1 | Monday 27 July 2026 17:08:02 +0000 (0:00:00.477) 0:00:21.670 *********** 2026-07-27 17:08:02.786464 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 17:08:02.786557 | mon1 | 2026-07-27 17:08:02.786680 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 17:08:02.786808 | mon1 | Monday 27 July 2026 17:08:02 +0000 (0:00:00.055) 0:00:21.726 *********** 2026-07-27 17:08:03.752099 | mon1 | ok: [mon1] 2026-07-27 17:08:03.753113 | mon1 | 2026-07-27 17:08:03.753145 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:08:03.753159 | mon1 | Monday 27 July 2026 17:08:03 +0000 (0:00:00.965) 0:00:22.691 *********** 2026-07-27 17:08:04.660752 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-07-27 17:08:04.660853 | mon1 | ok: [mon1] => (item=ssh) 2026-07-27 17:08:04.660863 | mon1 | 2026-07-27 17:08:04.660872 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:08:04.660923 | mon1 | Monday 27 July 2026 17:08:04 +0000 (0:00:00.906) 0:00:23.598 *********** 2026-07-27 17:08:05.088956 | mon1 | ok: [mon1] 2026-07-27 17:08:05.089014 | mon1 | 2026-07-27 17:08:05.089026 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:08:05.089036 | mon1 | Monday 27 July 2026 17:08:05 +0000 (0:00:00.427) 0:00:24.025 *********** 2026-07-27 17:08:05.344798 | mon1 | ok: [mon1] 2026-07-27 17:08:05.344862 | mon1 | 2026-07-27 17:08:05.344970 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:08:05.345084 | mon1 | Monday 27 July 2026 17:08:05 +0000 (0:00:00.257) 0:00:24.283 *********** 2026-07-27 17:08:05.871549 | mon1 | ok: [mon1] 2026-07-27 17:08:05.871593 | mon1 | 2026-07-27 17:08:05.871600 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:08:05.871606 | mon1 | Monday 27 July 2026 17:08:05 +0000 (0:00:00.527) 0:00:24.810 *********** 2026-07-27 17:08:06.290507 | mon1 | ok: [mon1] 2026-07-27 17:08:06.290587 | mon1 | 2026-07-27 17:08:06.291118 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-07-27 17:08:06.291165 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.418) 0:00:25.228 *********** 2026-07-27 17:08:06.374420 | mon1 | ok: [mon1] 2026-07-27 17:08:06.374466 | mon1 | 2026-07-27 17:08:06.374474 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-07-27 17:08:06.374741 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.084) 0:00:25.312 *********** 2026-07-27 17:08:06.660790 | mon1 | ok: [mon1] => (item=mon1) 2026-07-27 17:08:06.660904 | mon1 | 2026-07-27 17:08:06.661164 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-07-27 17:08:06.661176 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.287) 0:00:25.599 *********** 2026-07-27 17:08:06.718924 | mon1 | ok: [mon1] 2026-07-27 17:08:06.718981 | mon1 | 2026-07-27 17:08:06.718992 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-07-27 17:08:06.719002 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.056) 0:00:25.656 *********** 2026-07-27 17:08:06.764869 | mon1 | skipping: [mon1] 2026-07-27 17:08:06.764919 | mon1 | 2026-07-27 17:08:06.765033 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:08:06.765146 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.046) 0:00:25.703 *********** 2026-07-27 17:08:06.839392 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-27 17:08:06.916702 | mon1 | 2026-07-27 17:08:06.916759 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:08:06.916775 | mon1 | Monday 27 July 2026 17:08:06 +0000 (0:00:00.075) 0:00:25.778 *********** 2026-07-27 17:08:13.542777 | mon1 | ok: [mon1] 2026-07-27 17:08:13.542855 | mon1 | 2026-07-27 17:08:13.542972 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:08:13.543088 | mon1 | Monday 27 July 2026 17:08:13 +0000 (0:00:06.701) 0:00:32.480 *********** 2026-07-27 17:08:13.606622 | mon1 | ok: [mon1] => (item=mon1) 2026-07-27 17:08:13.606692 | mon1 | 2026-07-27 17:08:13.606817 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:08:13.606932 | mon1 | Monday 27 July 2026 17:08:13 +0000 (0:00:00.066) 0:00:32.546 *********** 2026-07-27 17:08:14.072870 | mon1 | ok: [mon1] 2026-07-27 17:08:14.072989 | mon1 | 2026-07-27 17:08:14.073126 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:08:14.073325 | mon1 | Monday 27 July 2026 17:08:14 +0000 (0:00:00.466) 0:00:33.012 *********** 2026-07-27 17:08:20.877749 | mon1 | ok: [mon1] 2026-07-27 17:08:20.877813 | mon1 | 2026-07-27 17:08:20.877823 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-07-27 17:08:20.877833 | mon1 | Monday 27 July 2026 17:08:20 +0000 (0:00:06.804) 0:00:39.816 *********** 2026-07-27 17:08:27.246038 | mon1 | ok: [mon1] 2026-07-27 17:08:27.246135 | mon1 | 2026-07-27 17:08:27.246146 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-07-27 17:08:27.246206 | mon1 | Monday 27 July 2026 17:08:27 +0000 (0:00:06.367) 0:00:46.184 *********** 2026-07-27 17:08:43.854995 | mon1 | ok: [mon1] 2026-07-27 17:08:43.855059 | mon1 | 2026-07-27 17:08:43.855074 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:08:43.855087 | mon1 | Monday 27 July 2026 17:08:43 +0000 (0:00:16.609) 0:01:02.793 *********** 2026-07-27 17:08:43.927461 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-07-27 17:08:43.927509 | mon1 | 2026-07-27 17:08:43.927517 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:08:43.927525 | mon1 | Monday 27 July 2026 17:08:43 +0000 (0:00:00.072) 0:01:02.866 *********** 2026-07-27 17:08:43.982426 | mon1 | skipping: [mon1] 2026-07-27 17:08:43.982468 | mon1 | 2026-07-27 17:08:43.982705 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:08:43.983045 | mon1 | Monday 27 July 2026 17:08:43 +0000 (0:00:00.054) 0:01:02.921 *********** 2026-07-27 17:08:44.035539 | mon1 | skipping: [mon1] => (item=mon1) 2026-07-27 17:08:44.076462 | mon1 | skipping: [mon1] 2026-07-27 17:08:44.076493 | mon1 | 2026-07-27 17:08:44.076501 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:08:44.076508 | mon1 | Monday 27 July 2026 17:08:44 +0000 (0:00:00.053) 0:01:02.975 *********** 2026-07-27 17:08:44.350986 | mon1 | ok: [mon1] 2026-07-27 17:08:44.351045 | mon1 | 2026-07-27 17:08:44.351057 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:08:44.351068 | mon1 | Monday 27 July 2026 17:08:44 +0000 (0:00:00.315) 0:01:03.290 *********** 2026-07-27 17:08:51.214666 | mon1 | ok: [mon1] 2026-07-27 17:08:51.214734 | mon1 | 2026-07-27 17:08:51.214751 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-07-27 17:08:51.214764 | mon1 | Monday 27 July 2026 17:08:51 +0000 (0:00:06.862) 0:01:10.152 *********** 2026-07-27 17:08:57.563582 | mon1 | ok: [mon1] 2026-07-27 17:08:57.563666 | mon1 | 2026-07-27 17:08:57.563680 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-07-27 17:08:57.563693 | mon1 | Monday 27 July 2026 17:08:57 +0000 (0:00:06.349) 0:01:16.501 *********** 2026-07-27 17:09:03.915737 | mon1 | ok: [mon1] 2026-07-27 17:09:03.915828 | mon1 | 2026-07-27 17:09:03.915919 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-07-27 17:09:03.916029 | mon1 | Monday 27 July 2026 17:09:03 +0000 (0:00:06.353) 0:01:22.855 *********** 2026-07-27 17:09:10.866441 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-07-27 17:09:10.866493 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-07-27 17:09:10.866499 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-07-27 17:09:10.866505 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-07-27 17:09:10.866510 | mon1 | 2026-07-27 17:09:10.866515 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-07-27 17:09:10.866521 | mon1 | 2026-07-27 17:09:10.866889 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:09:10.866955 | mon1 | Monday 27 July 2026 17:09:10 +0000 (0:00:06.947) 0:01:29.803 *********** 2026-07-27 17:09:12.135604 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-07-27 17:09:12.135651 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 17:09:12.135659 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 17:09:12.135667 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 17:09:12.135674 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 17:09:12.148190 | mon1 | ok: [osd1] 2026-07-27 17:09:12.148222 | mon1 | 2026-07-27 17:09:12.148233 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:09:12.148242 | mon1 | Monday 27 July 2026 17:09:12 +0000 (0:00:01.284) 0:01:31.087 *********** 2026-07-27 17:09:12.453305 | mon1 | ok: [osd1] 2026-07-27 17:09:12.453423 | mon1 | 2026-07-27 17:09:12.453441 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:09:12.453498 | mon1 | Monday 27 July 2026 17:09:12 +0000 (0:00:00.304) 0:01:31.391 *********** 2026-07-27 17:09:12.499403 | mon1 | skipping: [osd1] 2026-07-27 17:09:12.499456 | mon1 | 2026-07-27 17:09:12.499462 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 17:09:12.499468 | mon1 | Monday 27 July 2026 17:09:12 +0000 (0:00:00.046) 0:01:31.438 *********** 2026-07-27 17:09:12.774888 | mon1 | ok: [osd1] 2026-07-27 17:09:12.774947 | mon1 | 2026-07-27 17:09:12.774957 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:09:12.774966 | mon1 | Monday 27 July 2026 17:09:12 +0000 (0:00:00.274) 0:01:31.712 *********** 2026-07-27 17:09:12.859539 | mon1 | ok: [osd1] => { 2026-07-27 17:09:12.859602 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 17:09:12.859612 | mon1 | } 2026-07-27 17:09:12.859622 | mon1 | 2026-07-27 17:09:12.859631 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:09:12.859645 | mon1 | Monday 27 July 2026 17:09:12 +0000 (0:00:00.083) 0:01:31.796 *********** 2026-07-27 17:09:13.276594 | mon1 | ok: [osd1] 2026-07-27 17:09:13.276719 | mon1 | 2026-07-27 17:09:13.276893 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:09:13.277074 | mon1 | Monday 27 July 2026 17:09:13 +0000 (0:00:00.419) 0:01:32.215 *********** 2026-07-27 17:09:13.333982 | mon1 | skipping: [osd1] 2026-07-27 17:09:13.334210 | mon1 | 2026-07-27 17:09:13.334647 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:09:13.334986 | mon1 | Monday 27 July 2026 17:09:13 +0000 (0:00:00.057) 0:01:32.273 *********** 2026-07-27 17:09:13.375392 | mon1 | skipping: [osd1] 2026-07-27 17:09:13.375497 | mon1 | 2026-07-27 17:09:13.375629 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:09:13.375750 | mon1 | Monday 27 July 2026 17:09:13 +0000 (0:00:00.041) 0:01:32.315 *********** 2026-07-27 17:09:13.629275 | mon1 | ok: [osd1] 2026-07-27 17:09:13.629401 | mon1 | 2026-07-27 17:09:13.629645 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:09:13.629835 | mon1 | Monday 27 July 2026 17:09:13 +0000 (0:00:00.253) 0:01:32.568 *********** 2026-07-27 17:09:14.850560 | mon1 | ok: [osd1] 2026-07-27 17:09:14.850625 | mon1 | 2026-07-27 17:09:14.851330 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:09:14.851396 | mon1 | Monday 27 July 2026 17:09:14 +0000 (0:00:01.221) 0:01:33.789 *********** 2026-07-27 17:09:15.078091 | mon1 | ok: [osd1] => { 2026-07-27 17:09:15.078165 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 17:09:15.078339 | mon1 | } 2026-07-27 17:09:15.078861 | mon1 | 2026-07-27 17:09:15.078903 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:09:15.078910 | mon1 | Monday 27 July 2026 17:09:15 +0000 (0:00:00.226) 0:01:34.016 *********** 2026-07-27 17:09:15.662091 | mon1 | ok: [osd1] 2026-07-27 17:09:15.662150 | mon1 | 2026-07-27 17:09:15.662163 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:09:15.662175 | mon1 | Monday 27 July 2026 17:09:15 +0000 (0:00:00.583) 0:01:34.599 *********** 2026-07-27 17:09:17.943802 | mon1 | ok: [osd1] 2026-07-27 17:09:17.943891 | mon1 | 2026-07-27 17:09:17.943975 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 17:09:17.944093 | mon1 | Monday 27 July 2026 17:09:17 +0000 (0:00:02.282) 0:01:36.882 *********** 2026-07-27 17:09:17.984017 | mon1 | skipping: [osd1] 2026-07-27 17:09:17.984076 | mon1 | 2026-07-27 17:09:17.984090 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 17:09:17.984104 | mon1 | Monday 27 July 2026 17:09:17 +0000 (0:00:00.039) 0:01:36.922 *********** 2026-07-27 17:09:18.011137 | mon1 | skipping: [osd1] 2026-07-27 17:09:18.011167 | mon1 | 2026-07-27 17:09:18.011184 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 17:09:18.011189 | mon1 | Monday 27 July 2026 17:09:18 +0000 (0:00:00.027) 0:01:36.949 *********** 2026-07-27 17:09:18.045452 | mon1 | skipping: [osd1] 2026-07-27 17:09:18.045494 | mon1 | 2026-07-27 17:09:18.045510 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 17:09:18.045822 | mon1 | Monday 27 July 2026 17:09:18 +0000 (0:00:00.034) 0:01:36.984 *********** 2026-07-27 17:09:18.950328 | mon1 | ok: [osd1] 2026-07-27 17:09:18.950416 | mon1 | 2026-07-27 17:09:18.950429 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 17:09:18.950439 | mon1 | Monday 27 July 2026 17:09:18 +0000 (0:00:00.903) 0:01:37.887 *********** 2026-07-27 17:09:19.498236 | mon1 | ok: [osd1] 2026-07-27 17:09:19.498292 | mon1 | 2026-07-27 17:09:19.498303 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 17:09:19.498313 | mon1 | Monday 27 July 2026 17:09:19 +0000 (0:00:00.548) 0:01:38.436 *********** 2026-07-27 17:09:20.662435 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-07-27 17:09:20.662507 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 17:09:20.662522 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 17:09:20.662533 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 17:09:20.662545 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 17:09:20.662557 | mon1 | 2026-07-27 17:09:20.662570 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 17:09:20.662977 | mon1 | Monday 27 July 2026 17:09:20 +0000 (0:00:01.162) 0:01:39.598 *********** 2026-07-27 17:09:21.369726 | mon1 | ok: [osd1] 2026-07-27 17:09:21.370148 | mon1 | 2026-07-27 17:09:21.370646 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 17:09:21.371204 | mon1 | Monday 27 July 2026 17:09:21 +0000 (0:00:00.703) 0:01:40.302 *********** 2026-07-27 17:09:21.371711 | mon1 | 2026-07-27 17:09:21.372135 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 17:09:21.372645 | mon1 | Monday 27 July 2026 17:09:21 +0000 (0:00:00.006) 0:01:40.309 *********** 2026-07-27 17:09:21.803925 | mon1 | ok: [osd1] 2026-07-27 17:09:21.804339 | mon1 | 2026-07-27 17:09:21.804744 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:09:21.805095 | mon1 | Monday 27 July 2026 17:09:21 +0000 (0:00:00.433) 0:01:40.743 *********** 2026-07-27 17:09:22.066010 | mon1 | ok: [osd1] 2026-07-27 17:09:22.066277 | mon1 | 2026-07-27 17:09:22.066531 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:09:22.066745 | mon1 | Monday 27 July 2026 17:09:22 +0000 (0:00:00.262) 0:01:41.005 *********** 2026-07-27 17:09:22.151140 | mon1 | ok: [osd1] => { 2026-07-27 17:09:22.151421 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 17:09:22.151622 | mon1 | } 2026-07-27 17:09:22.151825 | mon1 | 2026-07-27 17:09:22.152027 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:09:22.152223 | mon1 | Monday 27 July 2026 17:09:22 +0000 (0:00:00.084) 0:01:41.090 *********** 2026-07-27 17:09:22.586313 | mon1 | ok: [osd1] 2026-07-27 17:09:22.586839 | mon1 | 2026-07-27 17:09:22.587421 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:09:22.588035 | mon1 | Monday 27 July 2026 17:09:22 +0000 (0:00:00.434) 0:01:41.525 *********** 2026-07-27 17:09:26.866638 | mon1 | ok: [osd1] 2026-07-27 17:09:26.867022 | mon1 | 2026-07-27 17:09:26.867507 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 17:09:26.867862 | mon1 | Monday 27 July 2026 17:09:26 +0000 (0:00:04.280) 0:01:45.806 *********** 2026-07-27 17:09:27.799237 | mon1 | ok: [osd1] 2026-07-27 17:09:27.799687 | mon1 | 2026-07-27 17:09:27.800507 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 17:09:27.800559 | mon1 | Monday 27 July 2026 17:09:27 +0000 (0:00:00.932) 0:01:46.738 *********** 2026-07-27 17:09:28.048575 | mon1 | ok: [osd1] 2026-07-27 17:09:28.048840 | mon1 | 2026-07-27 17:09:28.049149 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 17:09:28.049476 | mon1 | Monday 27 July 2026 17:09:28 +0000 (0:00:00.249) 0:01:46.987 *********** 2026-07-27 17:09:28.618079 | mon1 | ok: [osd1] 2026-07-27 17:09:28.618332 | mon1 | 2026-07-27 17:09:28.618686 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 17:09:28.618984 | mon1 | Monday 27 July 2026 17:09:28 +0000 (0:00:00.569) 0:01:47.557 *********** 2026-07-27 17:09:29.319680 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-07-27 17:09:29.319939 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 17:09:29.320332 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 17:09:29.320667 | mon1 | 2026-07-27 17:09:29.320897 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 17:09:29.321466 | mon1 | Monday 27 July 2026 17:09:29 +0000 (0:00:00.701) 0:01:48.258 *********** 2026-07-27 17:09:29.861872 | mon1 | ok: [osd1] 2026-07-27 17:09:29.861940 | mon1 | 2026-07-27 17:09:29.862114 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 17:09:29.865424 | mon1 | Monday 27 July 2026 17:09:29 +0000 (0:00:00.542) 0:01:48.800 *********** 2026-07-27 17:09:30.422454 | mon1 | ok: [osd1] 2026-07-27 17:09:30.422711 | mon1 | 2026-07-27 17:09:30.422901 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 17:09:30.423090 | mon1 | Monday 27 July 2026 17:09:30 +0000 (0:00:00.553) 0:01:49.354 *********** 2026-07-27 17:09:30.423253 | mon1 | 2026-07-27 17:09:30.423456 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 17:09:30.423646 | mon1 | Monday 27 July 2026 17:09:30 +0000 (0:00:00.007) 0:01:49.361 *********** 2026-07-27 17:09:30.873835 | mon1 | ok: [osd1] 2026-07-27 17:09:30.873934 | mon1 | 2026-07-27 17:09:30.875552 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 17:09:30.875589 | mon1 | Monday 27 July 2026 17:09:30 +0000 (0:00:00.450) 0:01:49.812 *********** 2026-07-27 17:09:30.940996 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 17:09:30.941070 | mon1 | 2026-07-27 17:09:30.941143 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 17:09:30.941255 | mon1 | Monday 27 July 2026 17:09:30 +0000 (0:00:00.067) 0:01:49.879 *********** 2026-07-27 17:09:31.907795 | mon1 | ok: [osd1] 2026-07-27 17:09:31.907875 | mon1 | 2026-07-27 17:09:31.907983 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:09:31.908101 | mon1 | Monday 27 July 2026 17:09:31 +0000 (0:00:00.967) 0:01:50.846 *********** 2026-07-27 17:09:32.727562 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-07-27 17:09:32.727646 | mon1 | ok: [osd1] => (item=ssh) 2026-07-27 17:09:32.727674 | mon1 | 2026-07-27 17:09:32.728538 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:09:32.728600 | mon1 | Monday 27 July 2026 17:09:32 +0000 (0:00:00.819) 0:01:51.666 *********** 2026-07-27 17:09:33.137619 | mon1 | ok: [osd1] 2026-07-27 17:09:33.137687 | mon1 | 2026-07-27 17:09:33.137702 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:09:33.137715 | mon1 | Monday 27 July 2026 17:09:33 +0000 (0:00:00.409) 0:01:52.076 *********** 2026-07-27 17:09:33.380103 | mon1 | ok: [osd1] 2026-07-27 17:09:33.380283 | mon1 | 2026-07-27 17:09:33.380669 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:09:33.380998 | mon1 | Monday 27 July 2026 17:09:33 +0000 (0:00:00.243) 0:01:52.319 *********** 2026-07-27 17:09:33.687070 | mon1 | ok: [osd1] 2026-07-27 17:09:33.687316 | mon1 | 2026-07-27 17:09:33.687702 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:09:33.688004 | mon1 | Monday 27 July 2026 17:09:33 +0000 (0:00:00.307) 0:01:52.626 *********** 2026-07-27 17:09:33.946920 | mon1 | ok: [osd1] 2026-07-27 17:09:33.947026 | mon1 | 2026-07-27 17:09:33.947212 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-07-27 17:09:33.947447 | mon1 | Monday 27 July 2026 17:09:33 +0000 (0:00:00.259) 0:01:52.886 *********** 2026-07-27 17:09:34.227202 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-07-27 17:09:34.227435 | mon1 | 2026-07-27 17:09:34.227697 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-07-27 17:09:34.227956 | mon1 | Monday 27 July 2026 17:09:34 +0000 (0:00:00.279) 0:01:53.166 *********** 2026-07-27 17:09:34.278509 | mon1 | ok: [osd1] 2026-07-27 17:09:34.278549 | mon1 | 2026-07-27 17:09:34.278556 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-07-27 17:09:34.278562 | mon1 | Monday 27 July 2026 17:09:34 +0000 (0:00:00.051) 0:01:53.217 *********** 2026-07-27 17:09:34.341776 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-07-27 17:09:34.341997 | mon1 | 2026-07-27 17:09:34.342304 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-07-27 17:09:34.342588 | mon1 | Monday 27 July 2026 17:09:34 +0000 (0:00:00.063) 0:01:53.281 *********** 2026-07-27 17:09:40.655509 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:09:40.655572 | mon1 | 2026-07-27 17:09:40.655591 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-07-27 17:09:40.655765 | mon1 | Monday 27 July 2026 17:09:40 +0000 (0:00:06.313) 0:01:59.594 *********** 2026-07-27 17:09:40.716632 | mon1 | ok: [osd1] => (item=osd1) 2026-07-27 17:09:40.716730 | mon1 | 2026-07-27 17:09:40.716746 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-07-27 17:09:40.716758 | mon1 | Monday 27 July 2026 17:09:40 +0000 (0:00:00.059) 0:01:59.653 *********** 2026-07-27 17:09:41.056037 | mon1 | ok: [osd1] 2026-07-27 17:09:41.056099 | mon1 | 2026-07-27 17:09:41.056114 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-07-27 17:09:41.056128 | mon1 | Monday 27 July 2026 17:09:41 +0000 (0:00:00.339) 0:01:59.993 *********** 2026-07-27 17:09:47.873406 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:09:47.873457 | mon1 | 2026-07-27 17:09:47.873464 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-07-27 17:09:47.873471 | mon1 | Monday 27 July 2026 17:09:47 +0000 (0:00:06.818) 0:02:06.812 *********** 2026-07-27 17:09:53.503193 | mon1 | ok: [osd1] 2026-07-27 17:09:53.503257 | mon1 | 2026-07-27 17:09:53.503272 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-07-27 17:09:53.503285 | mon1 | Monday 27 July 2026 17:09:53 +0000 (0:00:05.630) 0:02:12.442 *********** 2026-07-27 17:10:15.895860 | mon1 | ok: [osd1] 2026-07-27 17:10:15.895939 | mon1 | 2026-07-27 17:10:15.895957 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-07-27 17:10:15.895974 | mon1 | Monday 27 July 2026 17:10:15 +0000 (0:00:22.390) 0:02:34.833 *********** 2026-07-27 17:10:15.974618 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-07-27 17:10:15.974687 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-07-27 17:10:15.974737 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-07-27 17:10:15.974756 | mon1 | skipping: [osd1] 2026-07-27 17:10:15.974979 | mon1 | 2026-07-27 17:10:15.975217 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-07-27 17:10:15.975503 | mon1 | Monday 27 July 2026 17:10:15 +0000 (0:00:00.079) 0:02:34.913 *********** 2026-07-27 17:10:22.327778 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:10:22.327942 | mon1 | 2026-07-27 17:10:22.328182 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-07-27 17:10:22.328470 | mon1 | Monday 27 July 2026 17:10:22 +0000 (0:00:06.354) 0:02:41.267 *********** 2026-07-27 17:10:28.552555 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:10:28.553571 | mon1 | 2026-07-27 17:10:28.553646 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-07-27 17:10:28.553667 | mon1 | Monday 27 July 2026 17:10:28 +0000 (0:00:06.224) 0:02:47.491 *********** 2026-07-27 17:10:28.619650 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-07-27 17:10:28.619702 | mon1 | 2026-07-27 17:10:28.619711 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-07-27 17:10:28.619719 | mon1 | Monday 27 July 2026 17:10:28 +0000 (0:00:00.066) 0:02:47.558 *********** 2026-07-27 17:10:28.660838 | mon1 | ok: [osd1] 2026-07-27 17:10:28.660901 | mon1 | 2026-07-27 17:10:28.661032 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-07-27 17:10:28.661147 | mon1 | Monday 27 July 2026 17:10:28 +0000 (0:00:00.042) 0:02:47.600 *********** 2026-07-27 17:10:34.979598 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-07-27 17:10:34.979665 | mon1 | 2026-07-27 17:10:34.979680 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-07-27 17:10:34.979693 | mon1 | Monday 27 July 2026 17:10:34 +0000 (0:00:06.317) 0:02:53.917 *********** 2026-07-27 17:10:35.033724 | mon1 | ok: [osd1] 2026-07-27 17:10:35.033776 | mon1 | 2026-07-27 17:10:35.033784 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-07-27 17:10:35.033792 | mon1 | Monday 27 July 2026 17:10:35 +0000 (0:00:00.054) 0:02:53.972 *********** 2026-07-27 17:10:35.083795 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:10:35.083863 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:10:35.083869 | mon1 | skipping: [osd1] => (item=1) 2026-07-27 17:10:35.083874 | mon1 | skipping: [osd1] 2026-07-27 17:10:35.083880 | mon1 | 2026-07-27 17:10:35.083886 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-07-27 17:10:35.083892 | mon1 | Monday 27 July 2026 17:10:35 +0000 (0:00:00.050) 0:02:54.022 *********** 2026-07-27 17:10:35.154969 | mon1 | skipping: [osd1] 2026-07-27 17:10:35.155036 | mon1 | 2026-07-27 17:10:35.155051 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-07-27 17:10:35.155065 | mon1 | 2026-07-27 17:10:35.155078 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:10:35.155091 | mon1 | Monday 27 July 2026 17:10:35 +0000 (0:00:00.070) 0:02:54.092 *********** 2026-07-27 17:10:36.135580 | mon1 | ok: [mon1] 2026-07-27 17:10:36.135667 | mon1 | 2026-07-27 17:10:36.135695 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:10:36.135972 | mon1 | Monday 27 July 2026 17:10:36 +0000 (0:00:00.981) 0:02:55.073 *********** 2026-07-27 17:10:36.400032 | mon1 | ok: [mon1] 2026-07-27 17:10:36.400086 | mon1 | 2026-07-27 17:10:36.400101 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:10:36.400115 | mon1 | Monday 27 July 2026 17:10:36 +0000 (0:00:00.264) 0:02:55.338 *********** 2026-07-27 17:10:36.443175 | mon1 | skipping: [mon1] 2026-07-27 17:10:36.443251 | mon1 | 2026-07-27 17:10:36.443269 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-07-27 17:10:36.443286 | mon1 | Monday 27 July 2026 17:10:36 +0000 (0:00:00.043) 0:02:55.381 *********** 2026-07-27 17:10:36.735570 | mon1 | ok: [mon1] 2026-07-27 17:10:36.735638 | mon1 | 2026-07-27 17:10:36.735653 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:10:36.735673 | mon1 | Monday 27 July 2026 17:10:36 +0000 (0:00:00.292) 0:02:55.674 *********** 2026-07-27 17:10:36.814547 | mon1 | ok: [mon1] => { 2026-07-27 17:10:36.814635 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-07-27 17:10:36.814655 | mon1 | } 2026-07-27 17:10:36.814678 | mon1 | 2026-07-27 17:10:36.814742 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:10:36.814932 | mon1 | Monday 27 July 2026 17:10:36 +0000 (0:00:00.079) 0:02:55.753 *********** 2026-07-27 17:10:37.205164 | mon1 | ok: [mon1] 2026-07-27 17:10:37.205195 | mon1 | 2026-07-27 17:10:37.205200 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:10:37.205204 | mon1 | Monday 27 July 2026 17:10:37 +0000 (0:00:00.390) 0:02:56.143 *********** 2026-07-27 17:10:37.251134 | mon1 | skipping: [mon1] 2026-07-27 17:10:37.251420 | mon1 | 2026-07-27 17:10:37.251731 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:10:37.252097 | mon1 | Monday 27 July 2026 17:10:37 +0000 (0:00:00.046) 0:02:56.189 *********** 2026-07-27 17:10:37.297595 | mon1 | skipping: [mon1] 2026-07-27 17:10:37.297632 | mon1 | 2026-07-27 17:10:37.297640 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:10:37.297646 | mon1 | Monday 27 July 2026 17:10:37 +0000 (0:00:00.046) 0:02:56.236 *********** 2026-07-27 17:10:37.542518 | mon1 | ok: [mon1] 2026-07-27 17:10:37.542590 | mon1 | 2026-07-27 17:10:37.543082 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-07-27 17:10:37.543135 | mon1 | Monday 27 July 2026 17:10:37 +0000 (0:00:00.245) 0:02:56.481 *********** 2026-07-27 17:10:38.494173 | mon1 | ok: [mon1] 2026-07-27 17:10:38.494207 | mon1 | 2026-07-27 17:10:38.494212 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:10:38.494217 | mon1 | Monday 27 July 2026 17:10:38 +0000 (0:00:00.951) 0:02:57.432 *********** 2026-07-27 17:10:38.703149 | mon1 | ok: [mon1] => { 2026-07-27 17:10:38.704440 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-07-27 17:10:38.704472 | mon1 | } 2026-07-27 17:10:38.704476 | mon1 | 2026-07-27 17:10:38.704481 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:10:38.704774 | mon1 | Monday 27 July 2026 17:10:38 +0000 (0:00:00.208) 0:02:57.641 *********** 2026-07-27 17:10:39.240481 | mon1 | ok: [mon1] 2026-07-27 17:10:39.240544 | mon1 | 2026-07-27 17:10:39.240561 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:10:39.240873 | mon1 | Monday 27 July 2026 17:10:39 +0000 (0:00:00.537) 0:02:58.179 *********** 2026-07-27 17:10:41.554874 | mon1 | ok: [mon1] 2026-07-27 17:10:41.555047 | mon1 | 2026-07-27 17:10:41.555284 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-07-27 17:10:41.555562 | mon1 | Monday 27 July 2026 17:10:41 +0000 (0:00:02.313) 0:03:00.493 *********** 2026-07-27 17:10:41.587788 | mon1 | skipping: [mon1] 2026-07-27 17:10:41.587951 | mon1 | 2026-07-27 17:10:41.588175 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-07-27 17:10:41.588425 | mon1 | Monday 27 July 2026 17:10:41 +0000 (0:00:00.034) 0:03:00.527 *********** 2026-07-27 17:10:41.613992 | mon1 | skipping: [mon1] 2026-07-27 17:10:41.614313 | mon1 | 2026-07-27 17:10:41.614737 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-07-27 17:10:41.615106 | mon1 | Monday 27 July 2026 17:10:41 +0000 (0:00:00.025) 0:03:00.553 *********** 2026-07-27 17:10:41.647955 | mon1 | skipping: [mon1] 2026-07-27 17:10:41.648084 | mon1 | 2026-07-27 17:10:41.648280 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-07-27 17:10:41.648477 | mon1 | Monday 27 July 2026 17:10:41 +0000 (0:00:00.034) 0:03:00.587 *********** 2026-07-27 17:10:42.608248 | mon1 | ok: [mon1] 2026-07-27 17:10:42.608476 | mon1 | 2026-07-27 17:10:42.608757 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-07-27 17:10:42.609014 | mon1 | Monday 27 July 2026 17:10:42 +0000 (0:00:00.959) 0:03:01.547 *********** 2026-07-27 17:10:43.234427 | mon1 | ok: [mon1] 2026-07-27 17:10:43.234576 | mon1 | 2026-07-27 17:10:43.234765 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-07-27 17:10:43.235088 | mon1 | Monday 27 July 2026 17:10:43 +0000 (0:00:00.626) 0:03:02.173 *********** 2026-07-27 17:10:44.541498 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-07-27 17:10:44.541541 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-07-27 17:10:44.541547 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-07-27 17:10:44.541552 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-07-27 17:10:44.542405 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-07-27 17:10:44.542420 | mon1 | 2026-07-27 17:10:44.542425 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-07-27 17:10:44.542840 | mon1 | Monday 27 July 2026 17:10:44 +0000 (0:00:01.305) 0:03:03.479 *********** 2026-07-27 17:10:45.233814 | mon1 | ok: [mon1] 2026-07-27 17:10:45.233851 | mon1 | 2026-07-27 17:10:45.233857 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-07-27 17:10:45.233863 | mon1 | Monday 27 July 2026 17:10:45 +0000 (0:00:00.684) 0:03:04.163 *********** 2026-07-27 17:10:45.233868 | mon1 | 2026-07-27 17:10:45.233880 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-07-27 17:10:45.233885 | mon1 | Monday 27 July 2026 17:10:45 +0000 (0:00:00.008) 0:03:04.171 *********** 2026-07-27 17:10:45.692888 | mon1 | ok: [mon1] 2026-07-27 17:10:45.692965 | mon1 | 2026-07-27 17:10:45.692976 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-07-27 17:10:45.692986 | mon1 | Monday 27 July 2026 17:10:45 +0000 (0:00:00.459) 0:03:04.631 *********** 2026-07-27 17:10:45.949098 | mon1 | ok: [mon1] 2026-07-27 17:10:45.949162 | mon1 | 2026-07-27 17:10:45.949175 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-07-27 17:10:45.949187 | mon1 | Monday 27 July 2026 17:10:45 +0000 (0:00:00.255) 0:03:04.886 *********** 2026-07-27 17:10:46.044264 | mon1 | ok: [mon1] => { 2026-07-27 17:10:46.044297 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-07-27 17:10:46.044307 | mon1 | } 2026-07-27 17:10:46.044317 | mon1 | 2026-07-27 17:10:46.044326 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-07-27 17:10:46.044334 | mon1 | Monday 27 July 2026 17:10:46 +0000 (0:00:00.095) 0:03:04.981 *********** 2026-07-27 17:10:46.497291 | mon1 | ok: [mon1] 2026-07-27 17:10:46.497345 | mon1 | 2026-07-27 17:10:46.497402 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-07-27 17:10:46.497413 | mon1 | Monday 27 July 2026 17:10:46 +0000 (0:00:00.453) 0:03:05.434 *********** 2026-07-27 17:10:49.816956 | mon1 | ok: [mon1] 2026-07-27 17:10:49.817013 | mon1 | 2026-07-27 17:10:49.817027 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-07-27 17:10:49.817040 | mon1 | Monday 27 July 2026 17:10:49 +0000 (0:00:03.319) 0:03:08.754 *********** 2026-07-27 17:10:50.769396 | mon1 | ok: [mon1] 2026-07-27 17:10:50.769448 | mon1 | 2026-07-27 17:10:50.769457 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-07-27 17:10:50.769465 | mon1 | Monday 27 July 2026 17:10:50 +0000 (0:00:00.953) 0:03:09.707 *********** 2026-07-27 17:10:51.028448 | mon1 | ok: [mon1] 2026-07-27 17:10:51.028489 | mon1 | 2026-07-27 17:10:51.028871 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-07-27 17:10:51.028927 | mon1 | Monday 27 July 2026 17:10:51 +0000 (0:00:00.259) 0:03:09.967 *********** 2026-07-27 17:10:51.560794 | mon1 | ok: [mon1] 2026-07-27 17:10:51.560842 | mon1 | 2026-07-27 17:10:51.560851 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-07-27 17:10:51.560859 | mon1 | Monday 27 July 2026 17:10:51 +0000 (0:00:00.531) 0:03:10.498 *********** 2026-07-27 17:10:52.252761 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-07-27 17:10:52.252845 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-07-27 17:10:52.252969 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-07-27 17:10:52.253299 | mon1 | 2026-07-27 17:10:52.253313 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-07-27 17:10:52.253331 | mon1 | Monday 27 July 2026 17:10:52 +0000 (0:00:00.691) 0:03:11.190 *********** 2026-07-27 17:10:52.794775 | mon1 | ok: [mon1] 2026-07-27 17:10:52.794846 | mon1 | 2026-07-27 17:10:52.794953 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-07-27 17:10:52.795070 | mon1 | Monday 27 July 2026 17:10:52 +0000 (0:00:00.541) 0:03:11.732 *********** 2026-07-27 17:10:53.352529 | mon1 | ok: [mon1] 2026-07-27 17:10:53.352583 | mon1 | 2026-07-27 17:10:53.352594 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-07-27 17:10:53.352604 | mon1 | Monday 27 July 2026 17:10:53 +0000 (0:00:00.553) 0:03:12.285 *********** 2026-07-27 17:10:53.352618 | mon1 | 2026-07-27 17:10:53.352629 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-07-27 17:10:53.352810 | mon1 | Monday 27 July 2026 17:10:53 +0000 (0:00:00.006) 0:03:12.292 *********** 2026-07-27 17:10:53.802800 | mon1 | ok: [mon1] 2026-07-27 17:10:53.802859 | mon1 | 2026-07-27 17:10:53.802966 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-07-27 17:10:53.803077 | mon1 | Monday 27 July 2026 17:10:53 +0000 (0:00:00.450) 0:03:12.742 *********** 2026-07-27 17:10:53.858457 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-07-27 17:10:53.858512 | mon1 | 2026-07-27 17:10:53.858525 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-07-27 17:10:53.858801 | mon1 | Monday 27 July 2026 17:10:53 +0000 (0:00:00.055) 0:03:12.797 *********** 2026-07-27 17:10:54.850487 | mon1 | ok: [mon1] 2026-07-27 17:10:54.850559 | mon1 | 2026-07-27 17:10:54.850575 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-07-27 17:10:54.850589 | mon1 | Monday 27 July 2026 17:10:54 +0000 (0:00:00.991) 0:03:13.789 *********** 2026-07-27 17:10:55.654032 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-07-27 17:10:55.654114 | mon1 | ok: [mon1] => (item=ssh) 2026-07-27 17:10:55.654250 | mon1 | 2026-07-27 17:10:55.654399 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-07-27 17:10:55.654601 | mon1 | Monday 27 July 2026 17:10:55 +0000 (0:00:00.803) 0:03:14.592 *********** 2026-07-27 17:10:56.048866 | mon1 | ok: [mon1] 2026-07-27 17:10:56.048962 | mon1 | 2026-07-27 17:10:56.048977 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-07-27 17:10:56.049068 | mon1 | Monday 27 July 2026 17:10:56 +0000 (0:00:00.394) 0:03:14.986 *********** 2026-07-27 17:10:56.305497 | mon1 | ok: [mon1] 2026-07-27 17:10:56.305575 | mon1 | 2026-07-27 17:10:56.305692 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-07-27 17:10:56.305806 | mon1 | Monday 27 July 2026 17:10:56 +0000 (0:00:00.258) 0:03:15.245 *********** 2026-07-27 17:10:56.627187 | mon1 | ok: [mon1] 2026-07-27 17:10:56.627239 | mon1 | 2026-07-27 17:10:56.627501 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-07-27 17:10:56.627541 | mon1 | Monday 27 July 2026 17:10:56 +0000 (0:00:00.321) 0:03:15.567 *********** 2026-07-27 17:10:56.879829 | mon1 | ok: [mon1] 2026-07-27 17:10:56.879912 | mon1 | 2026-07-27 17:10:56.880004 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-07-27 17:10:56.880134 | mon1 | Monday 27 July 2026 17:10:56 +0000 (0:00:00.252) 0:03:15.819 *********** 2026-07-27 17:11:03.140559 | mon1 | ok: [mon1] 2026-07-27 17:11:03.140662 | mon1 | 2026-07-27 17:11:03.140687 | mon1 | PLAY RECAP ********************************************************************* 2026-07-27 17:11:03.142419 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-07-27 17:11:03.142479 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-07-27 17:11:03.142492 | mon1 | 2026-07-27 17:11:03.142504 | mon1 | 2026-07-27 17:11:03.142516 | mon1 | TASKS RECAP ******************************************************************** 2026-07-27 17:11:03.142551 | mon1 | Monday 27 July 2026 17:11:03 +0000 (0:00:06.259) 0:03:22.079 *********** 2026-07-27 17:11:03.142560 | mon1 | =============================================================================== 2026-07-27 17:11:03.142856 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.39s 2026-07-27 17:11:03.143282 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 16.61s 2026-07-27 17:11:03.143538 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.95s 2026-07-27 17:11:03.143735 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.86s 2026-07-27 17:11:03.143926 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.82s 2026-07-27 17:11:03.144115 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.80s 2026-07-27 17:11:03.144309 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.70s 2026-07-27 17:11:03.144521 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.37s 2026-07-27 17:11:03.144716 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.35s 2026-07-27 17:11:03.144906 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.35s 2026-07-27 17:11:03.145096 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.35s 2026-07-27 17:11:03.145283 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.32s 2026-07-27 17:11:03.145502 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.31s 2026-07-27 17:11:03.145698 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.26s 2026-07-27 17:11:03.145892 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.22s 2026-07-27 17:11:03.146135 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.63s 2026-07-27 17:11:03.146331 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.28s 2026-07-27 17:11:03.146553 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.80s 2026-07-27 17:11:03.146750 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.32s 2026-07-27 17:11:03.146940 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.62s 2026-07-27 17:11:03.229924 | mon1 | INFO [default > idempotence] Executed: Successful 2026-07-27 17:11:03.240430 | mon1 | INFO [default > side_effect] Executing 2026-07-27 17:11:03.240780 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-27 17:11:03.246560 | mon1 | INFO [default > verify] Executing 2026-07-27 17:11:04.006838 | mon1 | 2026-07-27 17:11:04.007287 | mon1 | PLAY [Verify] ****************************************************************** 2026-07-27 17:11:04.007647 | mon1 | 2026-07-27 17:11:04.008003 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-07-27 17:11:04.008484 | mon1 | Monday 27 July 2026 17:11:04 +0000 (0:00:00.008) 0:00:00.008 *********** 2026-07-27 17:11:05.373898 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-07-27 17:11:05.374560 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-07-27 17:11:05.374627 | mon1 | interpreter could change the meaning of that path. See 2026-07-27 17:11:05.374789 | mon1 | https://docs.ansible.com/ansible- 2026-07-27 17:11:05.375017 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-07-27 17:11:05.382706 | mon1 | ok: [mon1] 2026-07-27 17:11:05.382914 | mon1 | 2026-07-27 17:11:05.383140 | mon1 | TASK [Get cluster health status] *********************************************** 2026-07-27 17:11:05.383396 | mon1 | Monday 27 July 2026 17:11:05 +0000 (0:00:01.376) 0:00:01.385 *********** 2026-07-27 17:11:15.823531 | mon1 | ok: [mon1] 2026-07-27 17:11:15.823646 | mon1 | 2026-07-27 17:11:15.823818 | mon1 | TASK [Print cluster health status] ********************************************* 2026-07-27 17:11:15.823984 | mon1 | Monday 27 July 2026 17:11:15 +0000 (0:00:10.440) 0:00:11.825 *********** 2026-07-27 17:11:15.861418 | mon1 | ok: [mon1] => { 2026-07-27 17:11:15.861669 | mon1 | "_ceph_health": { 2026-07-27 17:11:15.861955 | mon1 | "changed": false, 2026-07-27 17:11:15.862210 | mon1 | "cmd": [ 2026-07-27 17:11:15.862540 | mon1 | "cephadm", 2026-07-27 17:11:15.862791 | mon1 | "shell", 2026-07-27 17:11:15.863051 | mon1 | "--", 2026-07-27 17:11:15.863346 | mon1 | "ceph", 2026-07-27 17:11:15.863799 | mon1 | "health" 2026-07-27 17:11:15.864057 | mon1 | ], 2026-07-27 17:11:15.864222 | mon1 | "delta": "0:00:10.078266", 2026-07-27 17:11:15.864409 | mon1 | "end": "2026-07-27 17:11:15.779004", 2026-07-27 17:11:15.864560 | mon1 | "failed": false, 2026-07-27 17:11:15.864711 | mon1 | "msg": "", 2026-07-27 17:11:15.864852 | mon1 | "rc": 0, 2026-07-27 17:11:15.865006 | mon1 | "start": "2026-07-27 17:11:05.700738", 2026-07-27 17:11:15.865179 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-07-27 17:11:15.865340 | mon1 | "stderr_lines": [ 2026-07-27 17:11:15.865569 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-07-27 17:11:15.865729 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-07-27 17:11:15.865875 | mon1 | ], 2026-07-27 17:11:15.866026 | mon1 | "stdout": "HEALTH_OK", 2026-07-27 17:11:15.866176 | mon1 | "stdout_lines": [ 2026-07-27 17:11:15.866324 | mon1 | "HEALTH_OK" 2026-07-27 17:11:15.866507 | mon1 | ] 2026-07-27 17:11:15.866646 | mon1 | } 2026-07-27 17:11:15.866791 | mon1 | } 2026-07-27 17:11:15.866933 | mon1 | 2026-07-27 17:11:15.867099 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-07-27 17:11:15.867252 | mon1 | Monday 27 July 2026 17:11:15 +0000 (0:00:00.038) 0:00:11.863 *********** 2026-07-27 17:11:15.897407 | mon1 | ok: [mon1] => { 2026-07-27 17:11:15.897803 | mon1 | "changed": false, 2026-07-27 17:11:15.898085 | mon1 | "msg": "All assertions passed" 2026-07-27 17:11:15.898328 | mon1 | } 2026-07-27 17:11:15.898685 | mon1 | 2026-07-27 17:11:15.898980 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-07-27 17:11:15.899237 | mon1 | Monday 27 July 2026 17:11:15 +0000 (0:00:00.035) 0:00:11.898 *********** 2026-07-27 17:11:22.678010 | mon1 | changed: [mon1] 2026-07-27 17:11:22.678347 | mon1 | 2026-07-27 17:11:22.678679 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-07-27 17:11:22.678965 | mon1 | Monday 27 July 2026 17:11:22 +0000 (0:00:06.781) 0:00:18.679 *********** 2026-07-27 17:11:24.986026 | mon1 | changed: [mon1] 2026-07-27 17:11:24.986239 | mon1 | 2026-07-27 17:11:24.986568 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-07-27 17:11:24.986880 | mon1 | Monday 27 July 2026 17:11:24 +0000 (0:00:02.307) 0:00:20.987 *********** 2026-07-27 17:11:26.146462 | mon1 | ok: [mon1] 2026-07-27 17:11:26.147443 | mon1 | 2026-07-27 17:11:26.147498 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-07-27 17:11:26.147507 | mon1 | Monday 27 July 2026 17:11:26 +0000 (0:00:01.160) 0:00:22.148 *********** 2026-07-27 17:11:26.194409 | mon1 | ok: [mon1] => { 2026-07-27 17:11:26.194445 | mon1 | "changed": false, 2026-07-27 17:11:26.194452 | mon1 | "msg": "All assertions passed" 2026-07-27 17:11:26.194459 | mon1 | } 2026-07-27 17:11:26.194464 | mon1 | 2026-07-27 17:11:26.194470 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-07-27 17:11:26.194696 | mon1 | Monday 27 July 2026 17:11:26 +0000 (0:00:00.046) 0:00:22.195 *********** 2026-07-27 17:11:27.239073 | mon1 | ok: [mon1] 2026-07-27 17:11:27.239160 | mon1 | 2026-07-27 17:11:27.239180 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-07-27 17:11:27.239324 | mon1 | Monday 27 July 2026 17:11:27 +0000 (0:00:01.042) 0:00:23.237 *********** 2026-07-27 17:11:27.281090 | mon1 | ok: [mon1] => { 2026-07-27 17:11:27.281330 | mon1 | "changed": false, 2026-07-27 17:11:27.282623 | mon1 | "msg": "All assertions passed" 2026-07-27 17:11:27.282689 | mon1 | } 2026-07-27 17:11:27.282697 | mon1 | 2026-07-27 17:11:27.282703 | mon1 | PLAY RECAP ********************************************************************* 2026-07-27 17:11:27.282716 | mon1 | mon1 : ok=10 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-07-27 17:11:27.283434 | mon1 | 2026-07-27 17:11:27.283509 | mon1 | 2026-07-27 17:11:27.283611 | mon1 | TASKS RECAP ******************************************************************** 2026-07-27 17:11:27.283951 | mon1 | Monday 27 July 2026 17:11:27 +0000 (0:00:00.045) 0:00:23.283 *********** 2026-07-27 17:11:27.284268 | mon1 | =============================================================================== 2026-07-27 17:11:27.284610 | mon1 | Get cluster health status ---------------------------------------------- 10.44s 2026-07-27 17:11:27.284925 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.78s 2026-07-27 17:11:27.285240 | mon1 | Create a test Ceph key -------------------------------------------------- 2.31s 2026-07-27 17:11:27.285606 | mon1 | Gathering Facts --------------------------------------------------------- 1.38s 2026-07-27 17:11:27.286801 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.16s 2026-07-27 17:11:27.286815 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.04s 2026-07-27 17:11:27.286819 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.05s 2026-07-27 17:11:27.286823 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-07-27 17:11:27.286827 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-07-27 17:11:27.286831 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s 2026-07-27 17:11:27.416456 | mon1 | INFO [default > verify] Executed: Successful 2026-07-27 17:11:27.423322 | mon1 | INFO [default > cleanup] Executing 2026-07-27 17:11:27.423825 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-07-27 17:11:27.477766 | mon1 | INFO [default > destroy] Executing 2026-07-27 17:11:27.477915 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-07-27 17:11:27.478024 | mon1 | INFO [default > destroy] Executed: Successful 2026-07-27 17:11:27.478432 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-07-27 17:11:27.972249 | mon1 | ok: Runtime: 0:13:49.513314 2026-07-27 17:11:27.989508 | 2026-07-27 17:11:27.989618 | PLAY RECAP 2026-07-27 17:11:27.989674 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-27 17:11:27.989699 | 2026-07-27 17:11:28.137345 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-07-27 17:11:28.440118 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-07-27 17:11:30.835656 | 2026-07-27 17:11:30.836554 | PLAY [all] 2026-07-27 17:11:30.858246 | 2026-07-27 17:11:30.858438 | TASK [fetch-output : Set log path for multiple nodes] 2026-07-27 17:11:30.917202 | mon1 | ok 2026-07-27 17:11:30.922097 | osd1 | ok 2026-07-27 17:11:30.927122 | 2026-07-27 17:11:30.927208 | TASK [fetch-output : Set log path for single node] 2026-07-27 17:11:30.953758 | mon1 | skipping: Conditional result was False 2026-07-27 17:11:30.965245 | osd1 | skipping: Conditional result was False 2026-07-27 17:11:30.973443 | 2026-07-27 17:11:30.973589 | LOOP [fetch-output : Ensure local output dirs] 2026-07-27 17:11:31.374712 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/logs/mon1" 2026-07-27 17:11:31.380119 | osd1 -> localhost | changed: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/logs/osd1" 2026-07-27 17:11:31.582522 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/artifacts" 2026-07-27 17:11:31.615265 | osd1 -> localhost | ok: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/artifacts" 2026-07-27 17:11:31.803811 | mon1 -> localhost | changed: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/docs" 2026-07-27 17:11:31.826418 | osd1 -> localhost | ok: "/var/lib/zuul/builds/d13607900e4f437e9d916ba9a7f7e4c0/work/docs" 2026-07-27 17:11:31.826567 | osd1 -> localhost | changed: All items complete 2026-07-27 17:11:31.826596 | 2026-07-27 17:11:31.843326 | 2026-07-27 17:11:31.843541 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-07-27 17:11:32.483102 | osd1 | changed: .d..t...... ./ 2026-07-27 17:11:32.491015 | mon1 | changed: .d..t...... ./ 2026-07-27 17:11:32.962960 | mon1 | changed: .d..t...... ./ 2026-07-27 17:11:32.968021 | osd1 | ok 2026-07-27 17:11:33.426118 | mon1 | changed: .d..t...... ./ 2026-07-27 17:11:33.468220 | osd1 | ok 2026-07-27 17:11:33.468416 | osd1 | changed: All items complete 2026-07-27 17:11:33.468455 | 2026-07-27 17:11:33.491261 | 2026-07-27 17:11:33.491436 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-07-27 17:11:33.913860 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006546 2026-07-27 17:11:34.135368 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006082 2026-07-27 17:11:34.163948 | 2026-07-27 17:11:34.164096 | PLAY [all] 2026-07-27 17:11:34.171208 | 2026-07-27 17:11:34.171295 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-07-27 17:11:34.714283 | mon1 | changed 2026-07-27 17:11:34.878047 | osd1 | changed 2026-07-27 17:11:34.918140 | 2026-07-27 17:11:34.918253 | PLAY RECAP 2026-07-27 17:11:34.918304 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-07-27 17:11:34.918335 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-07-27 17:11:34.918355 | 2026-07-27 17:11:35.285922 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-07-27 17:11:35.288602 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-07-27 17:11:35.968387 | 2026-07-27 17:11:35.968598 | PLAY [localhost] 2026-07-27 17:11:35.978610 | 2026-07-27 17:11:35.978707 | TASK [Generate Zuul manifest] 2026-07-27 17:11:36.000486 | localhost | ok 2026-07-27 17:11:36.018175 | 2026-07-27 17:11:36.018285 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-07-27 17:11:36.447824 | localhost | changed 2026-07-27 17:11:36.459723 | 2026-07-27 17:11:36.459848 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-07-27 17:11:36.657666 | localhost | ok 2026-07-27 17:11:36.667780 | 2026-07-27 17:11:36.667873 | TASK [Upload logs] 2026-07-27 17:11:36.687721 | localhost | ok 2026-07-27 17:11:36.770568 | 2026-07-27 17:11:36.770711 | TASK [Set zuul-log-path fact] 2026-07-27 17:11:36.792700 | localhost | ok 2026-07-27 17:11:36.805588 | 2026-07-27 17:11:36.805697 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-27 17:11:36.836827 | localhost | ok 2026-07-27 17:11:36.846369 | 2026-07-27 17:11:36.846509 | TASK [upload-logs : Create log directories] 2026-07-27 17:11:37.289577 | localhost | changed 2026-07-27 17:11:37.294518 | 2026-07-27 17:11:37.294588 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-07-27 17:11:37.724028 | localhost -> localhost | ok: Runtime: 0:00:00.006394 2026-07-27 17:11:37.730552 | 2026-07-27 17:11:37.730616 | TASK [upload-logs : Upload logs to log server] 2026-07-27 17:11:38.199812 | localhost | Output suppressed because no_log was given 2026-07-27 17:11:38.205184 | 2026-07-27 17:11:38.205264 | LOOP [upload-logs : Compress console log and json output] 2026-07-27 17:11:38.298536 | localhost | skipping: Conditional result was False 2026-07-27 17:11:38.306056 | localhost | skipping: Conditional result was False 2026-07-27 17:11:38.321239 | 2026-07-27 17:11:38.321415 | LOOP [upload-logs : Upload compressed console log and json output] 2026-07-27 17:11:38.402505 | localhost | skipping: Conditional result was False 2026-07-27 17:11:38.402795 | 2026-07-27 17:11:38.407775 | localhost | skipping: Conditional result was False 2026-07-27 17:11:38.468349 | 2026-07-27 17:11:38.468510 | LOOP [upload-logs : Upload console log and json output]