2026-08-14 08:43:56.481049 | Job console starting
2026-08-14 08:43:56.496251 | Updating git repos
2026-08-14 08:43:56.524694 | Cloning repos into workspace
2026-08-14 08:44:23.257614 | Restoring repo states
2026-08-14 08:44:23.267160 | Merging changes
2026-08-14 08:44:32.736887 | Checking out repos
2026-08-14 08:44:38.494631 | Preparing playbooks
2026-08-14 08:45:25.936874 | Running Ansible setup
2026-08-14 08:45:37.548561 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-14 08:45:38.240000 | 
2026-08-14 08:45:38.766000 | PLAY [localhost]
2026-08-14 08:45:38.788991 | 
2026-08-14 08:45:38.789275 | TASK [Gathering Facts]
2026-08-14 08:45:39.921876 | localhost | ok
2026-08-14 08:45:39.938737 | 
2026-08-14 08:45:39.938888 | TASK [Setup log path fact]
2026-08-14 08:45:39.958417 | localhost | ok
2026-08-14 08:45:39.971311 | 
2026-08-14 08:45:39.971392 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-14 08:45:40.003602 | localhost | ok
2026-08-14 08:45:40.012952 | 
2026-08-14 08:45:40.013127 | TASK [emit-job-header : Print job information]
2026-08-14 08:45:40.054991 | # Job Information
2026-08-14 08:45:40.055201 | Ansible Version: 2.16.18
2026-08-14 08:45:40.055246 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-08-14 08:45:40.055278 | Pipeline: check
2026-08-14 08:45:40.055306 | Executor: 2d72f0692154
2026-08-14 08:45:40.055334 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/42
2026-08-14 08:45:40.055365 | Event ID: 79328020-97ba-11f1-889f-efc7e8d733b6
2026-08-14 08:45:40.059355 | 
2026-08-14 08:45:40.059455 | LOOP [emit-job-header : Print node information]
2026-08-14 08:45:40.160045 | localhost | ok:
2026-08-14 08:45:40.160351 | localhost | # Node Information
2026-08-14 08:45:40.160395 | localhost | Inventory Hostname: mon1
2026-08-14 08:45:40.160428 | localhost | Hostname: np0000189594
2026-08-14 08:45:40.160458 | localhost | Username: zuul
2026-08-14 08:45:40.160493 | localhost | Distro: Ubuntu 22.04
2026-08-14 08:45:40.160522 | localhost | Provider: yul1
2026-08-14 08:45:40.160561 | localhost | Region: ca-ymq-1
2026-08-14 08:45:40.160768 | localhost | Label: ubuntu-jammy
2026-08-14 08:45:40.160810 | localhost | Product Name: OpenStack Nova
2026-08-14 08:45:40.160853 | localhost | Interface IP: 199.19.213.246
2026-08-14 08:45:40.206501 | localhost | ok:
2026-08-14 08:45:40.206625 | localhost | # Node Information
2026-08-14 08:45:40.206682 | localhost | Inventory Hostname: osd1
2026-08-14 08:45:40.206743 | localhost | Hostname: np0000189595
2026-08-14 08:45:40.206809 | localhost | Username: zuul
2026-08-14 08:45:40.206862 | localhost | Distro: Ubuntu 22.04
2026-08-14 08:45:40.206907 | localhost | Provider: yul1
2026-08-14 08:45:40.206952 | localhost | Region: ca-ymq-1
2026-08-14 08:45:40.206995 | localhost | Label: ubuntu-jammy
2026-08-14 08:45:40.207053 | localhost | Product Name: OpenStack Nova
2026-08-14 08:45:40.207106 | localhost | Interface IP: 199.19.213.222
2026-08-14 08:45:40.219835 | 
2026-08-14 08:45:40.220009 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-14 08:45:40.665891 | localhost -> localhost | changed
2026-08-14 08:45:40.671784 | 
2026-08-14 08:45:40.672118 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-14 08:45:41.703944 | localhost -> localhost | changed
2026-08-14 08:45:41.714584 | 
2026-08-14 08:45:41.714653 | PLAY [all]
2026-08-14 08:45:41.723750 | 
2026-08-14 08:45:41.723816 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-14 08:45:42.577221 | mon1 -> localhost | ok
2026-08-14 08:45:42.587255 | 
2026-08-14 08:45:42.587346 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-14 08:45:42.621870 | mon1 | ok
2026-08-14 08:45:42.627426 | osd1 | ok
2026-08-14 08:45:42.650917 | mon1 | included: /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-14 08:45:42.651059 | osd1 | included: /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-14 08:45:42.657609 | 
2026-08-14 08:45:42.657724 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-14 08:45:45.046168 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-14 08:45:45.046376 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/451317d567184a33b4185fc6e944e7ef_id_rsa
2026-08-14 08:45:45.046595 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/451317d567184a33b4185fc6e944e7ef_id_rsa.pub
2026-08-14 08:45:45.046642 | mon1 -> localhost | The key fingerprint is:
2026-08-14 08:45:45.046674 | mon1 -> localhost | SHA256:xxteanRJoabL+pIPHWipHkP/m5kwwdbBZQq3fxoYvjs zuul-build-sshkey
2026-08-14 08:45:45.046699 | mon1 -> localhost | The key's randomart image is:
2026-08-14 08:45:45.046722 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-14 08:45:45.046744 | mon1 -> localhost | |      . . o .    |
2026-08-14 08:45:45.046766 | mon1 -> localhost | |       + = . .   |
2026-08-14 08:45:45.046791 | mon1 -> localhost | |        * o .    |
2026-08-14 08:45:45.046814 | mon1 -> localhost | |     . = O . .   |
2026-08-14 08:45:45.046834 | mon1 -> localhost | |    . B S B =    |
2026-08-14 08:45:45.046855 | mon1 -> localhost | |   . = + B X     |
2026-08-14 08:45:45.046874 | mon1 -> localhost | |    + =.= *      |
2026-08-14 08:45:45.046894 | mon1 -> localhost | |   . oo*E*       |
2026-08-14 08:45:45.046914 | mon1 -> localhost | |    . .+Xo       |
2026-08-14 08:45:45.046934 | mon1 -> localhost | +----[SHA256]-----+
2026-08-14 08:45:45.047008 | mon1 -> localhost | ok: Runtime: 0:00:01.892016
2026-08-14 08:45:45.058435 | 
2026-08-14 08:45:45.061100 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-14 08:45:45.108723 | mon1 | ok
2026-08-14 08:45:45.115739 | osd1 | ok
2026-08-14 08:45:45.127623 | mon1 | included: /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-14 08:45:45.127674 | osd1 | included: /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-14 08:45:45.137644 | 
2026-08-14 08:45:45.137712 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-14 08:45:45.161829 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:45.173009 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:45.182193 | 
2026-08-14 08:45:45.182282 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-14 08:45:45.665914 | osd1 | changed
2026-08-14 08:45:45.816937 | mon1 | changed
2026-08-14 08:45:45.823443 | 
2026-08-14 08:45:45.823511 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-14 08:45:46.027541 | mon1 | ok
2026-08-14 08:45:46.033871 | osd1 | ok
2026-08-14 08:45:46.044992 | 
2026-08-14 08:45:46.045129 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-14 08:45:46.532138 | osd1 | changed
2026-08-14 08:45:46.550670 | mon1 | changed
2026-08-14 08:45:46.558410 | 
2026-08-14 08:45:46.558504 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-14 08:45:47.076130 | mon1 | changed
2026-08-14 08:45:47.182423 | osd1 | changed
2026-08-14 08:45:47.187795 | 
2026-08-14 08:45:47.187864 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-14 08:45:47.219164 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:47.230451 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:47.243209 | 
2026-08-14 08:45:47.243333 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-14 08:45:47.629088 | mon1 -> localhost | changed
2026-08-14 08:45:47.648069 | 
2026-08-14 08:45:47.648211 | TASK [add-build-sshkey : Add back temp key]
2026-08-14 08:45:47.935832 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/451317d567184a33b4185fc6e944e7ef_id_rsa (zuul-build-sshkey)
2026-08-14 08:45:47.936084 | mon1 -> localhost | ok: Runtime: 0:00:00.016362
2026-08-14 08:45:47.941064 | 
2026-08-14 08:45:47.941129 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-14 08:45:48.199624 | mon1 | ok
2026-08-14 08:45:48.231278 | osd1 | ok
2026-08-14 08:45:48.236775 | 
2026-08-14 08:45:48.236851 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-14 08:45:48.262372 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:48.273686 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:48.293242 | 
2026-08-14 08:45:48.293316 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-14 08:45:48.571308 | mon1 | ok
2026-08-14 08:45:48.575348 | osd1 | ok
2026-08-14 08:45:48.580663 | 
2026-08-14 08:45:48.580726 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-14 08:45:49.308550 | osd1 | Output suppressed because no_log was given
2026-08-14 08:45:49.531627 | mon1 | Output suppressed because no_log was given
2026-08-14 08:45:49.569074 | 
2026-08-14 08:45:49.569199 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-14 08:45:49.779501 | mon1 | ok: "logs"
2026-08-14 08:45:49.779853 | mon1 | ok: All items complete
2026-08-14 08:45:49.779897 | 
2026-08-14 08:45:49.787713 | osd1 | ok: "logs"
2026-08-14 08:45:49.955164 | osd1 | ok: "artifacts"
2026-08-14 08:45:49.968455 | mon1 | ok: "artifacts"
2026-08-14 08:45:50.119203 | osd1 | ok: "docs"
2026-08-14 08:45:50.131505 | mon1 | ok: "docs"
2026-08-14 08:45:50.142900 | 
2026-08-14 08:45:50.143033 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-14 08:45:50.330693 | mon1 | changed: "logs"
2026-08-14 08:45:50.330952 | mon1 | ok: All items complete
2026-08-14 08:45:50.330980 | 
2026-08-14 08:45:50.340541 | osd1 | changed: "logs"
2026-08-14 08:45:50.472476 | osd1 | changed: "artifacts"
2026-08-14 08:45:50.488348 | mon1 | changed: "artifacts"
2026-08-14 08:45:50.626903 | osd1 | changed: "docs"
2026-08-14 08:45:50.659820 | mon1 | changed: "docs"
2026-08-14 08:45:50.684621 | 
2026-08-14 08:45:50.684826 | PLAY RECAP
2026-08-14 08:45:50.684878 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:50.684910 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-14 08:45:50.684936 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-14 08:45:50.684999 | 
2026-08-14 08:45:50.874359 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-14 08:45:50.877393 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-14 08:45:51.619326 | 
2026-08-14 08:45:51.619466 | PLAY [all]
2026-08-14 08:45:51.630722 | 
2026-08-14 08:45:51.630797 | TASK [setup-uv : Extract archive]
2026-08-14 08:45:54.192916 | mon1 | changed
2026-08-14 08:45:54.901776 | osd1 | changed
2026-08-14 08:45:54.910524 | 
2026-08-14 08:45:54.910655 | TASK [setup-uv : Print version]
2026-08-14 08:45:55.380021 | osd1 | uv 0.8.13
2026-08-14 08:45:55.376182 | mon1 | uv 0.8.13
2026-08-14 08:45:56.620167 | osd1 | ok: Runtime: 0:00:00.012397
2026-08-14 08:45:56.632897 | mon1 | ok: Runtime: 0:00:00.011912
2026-08-14 08:45:56.649913 | 
2026-08-14 08:45:56.650039 | TASK [Install Ansible collection siblings]
2026-08-14 08:45:57.045223 | mon1 | ok:
2026-08-14 08:45:57.045452 | mon1 | Skipping community.general: no checked-out sibling
2026-08-14 08:45:57.045511 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-14 08:45:57.045538 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-14 08:45:57.047265 | 
2026-08-14 08:45:57.047311 | PLAY RECAP
2026-08-14 08:45:57.047360 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:57.047478 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:57.047507 | 
2026-08-14 08:45:57.258050 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-14 08:45:57.261249 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-14 08:45:58.387863 | 
2026-08-14 08:45:58.388078 | PLAY [all]
2026-08-14 08:45:58.402964 | 
2026-08-14 08:45:58.403161 | LOOP [Check inventory directories]
2026-08-14 08:45:58.766475 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-14 08:46:03.735185 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-14 08:46:04.345343 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-14 08:46:04.361965 | 
2026-08-14 08:46:04.362212 | LOOP [Copy inventory file for Zuul]
2026-08-14 08:46:05.587123 | mon1 | changed:
2026-08-14 08:46:05.587359 | mon1 | {
2026-08-14 08:46:05.587404 | mon1 |   "ansible_loop_var": "item",
2026-08-14 08:46:05.587441 | mon1 |   "changed": false,
2026-08-14 08:46:05.587473 | mon1 |   "failed": false,
2026-08-14 08:46:05.587514 | mon1 |   "invocation": {
2026-08-14 08:46:05.587546 | mon1 |     "module_args": {
2026-08-14 08:46:05.587575 | mon1 |       "checksum_algorithm": "sha1",
2026-08-14 08:46:05.587601 | mon1 |       "follow": true,
2026-08-14 08:46:05.587627 | mon1 |       "get_attributes": true,
2026-08-14 08:46:05.587655 | mon1 |       "get_checksum": true,
2026-08-14 08:46:05.587684 | mon1 |       "get_mime": true,
2026-08-14 08:46:05.587712 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-14 08:46:05.587741 | mon1 |     }
2026-08-14 08:46:05.587768 | mon1 |   },
2026-08-14 08:46:05.587793 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-14 08:46:05.587821 | mon1 |   "stat": {
2026-08-14 08:46:05.587849 | mon1 |     "atime": 1786697149.42718,
2026-08-14 08:46:05.587877 | mon1 |     "attr_flags": "e",
2026-08-14 08:46:05.587904 | mon1 |     "attributes": [
2026-08-14 08:46:05.587931 | mon1 |       "extents"
2026-08-14 08:46:05.587958 | mon1 |     ],
2026-08-14 08:46:05.587984 | mon1 |     "block_size": 4096,
2026-08-14 08:46:05.588010 | mon1 |     "blocks": 8,
2026-08-14 08:46:05.588037 | mon1 |     "charset": "unknown",
2026-08-14 08:46:05.588067 | mon1 |     "ctime": 1786697149.43118,
2026-08-14 08:46:05.588094 | mon1 |     "dev": 64513,
2026-08-14 08:46:05.588122 | mon1 |     "device_type": 0,
2026-08-14 08:46:05.588150 | mon1 |     "executable": true,
2026-08-14 08:46:05.588174 | mon1 |     "exists": true,
2026-08-14 08:46:05.588197 | mon1 |     "gid": 1000,
2026-08-14 08:46:05.588220 | mon1 |     "gr_name": "zuul",
2026-08-14 08:46:05.588244 | mon1 |     "inode": 1042461,
2026-08-14 08:46:05.588269 | mon1 |     "isblk": false,
2026-08-14 08:46:05.588295 | mon1 |     "ischr": false,
2026-08-14 08:46:05.588319 | mon1 |     "isdir": true,
2026-08-14 08:46:05.588345 | mon1 |     "isfifo": false,
2026-08-14 08:46:05.588372 | mon1 |     "isgid": false,
2026-08-14 08:46:05.588397 | mon1 |     "islnk": false,
2026-08-14 08:46:05.588422 | mon1 |     "isreg": false,
2026-08-14 08:46:05.588446 | mon1 |     "issock": false,
2026-08-14 08:46:05.588469 | mon1 |     "isuid": false,
2026-08-14 08:46:05.588493 | mon1 |     "mimetype": "unknown",
2026-08-14 08:46:05.588516 | mon1 |     "mode": "0755",
2026-08-14 08:46:05.588540 | mon1 |     "mtime": 1786697066.683693,
2026-08-14 08:46:05.588564 | mon1 |     "nlink": 10,
2026-08-14 08:46:05.588588 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-14 08:46:05.588616 | mon1 |     "pw_name": "zuul",
2026-08-14 08:46:05.588647 | mon1 |     "readable": true,
2026-08-14 08:46:05.588675 | mon1 |     "rgrp": true,
2026-08-14 08:46:05.588703 | mon1 |     "roth": true,
2026-08-14 08:46:05.588728 | mon1 |     "rusr": true,
2026-08-14 08:46:05.588751 | mon1 |     "size": 4096,
2026-08-14 08:46:05.588791 | mon1 |     "uid": 1000,
2026-08-14 08:46:05.588817 | mon1 |     "version": "828376068",
2026-08-14 08:46:05.588840 | mon1 |     "wgrp": false,
2026-08-14 08:46:05.588866 | mon1 |     "woth": false,
2026-08-14 08:46:05.588891 | mon1 |     "writeable": true,
2026-08-14 08:46:05.588914 | mon1 |     "wusr": true,
2026-08-14 08:46:05.588938 | mon1 |     "xgrp": true,
2026-08-14 08:46:05.588985 | mon1 |     "xoth": true,
2026-08-14 08:46:05.589011 | mon1 |     "xusr": true
2026-08-14 08:46:05.589036 | mon1 |   }
2026-08-14 08:46:05.589064 | mon1 | }
2026-08-14 08:46:05.589111 | mon1 | ok: All items complete
2026-08-14 08:46:05.589140 | 
2026-08-14 08:46:05.600897 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:05.601924 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:05.621266 | 
2026-08-14 08:46:05.621485 | LOOP [Switch "ansible_host" to private IP]
2026-08-14 08:46:05.975323 | mon1 | changed: 2 replacements made
2026-08-14 08:46:05.977071 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:05.977681 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:05.993997 | 
2026-08-14 08:46:05.994157 | TASK [Run Molecule scenario]
2026-08-14 08:46:07.021167 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-08-14 08:46:07.832618 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-08-14 08:46:08.047381 | mon1 | Using CPython 3.13.7
2026-08-14 08:46:08.047468 | mon1 | Creating virtual environment at: .venv
2026-08-14 08:46:08.330288 | mon1 | Downloading ansible-core (2.1MiB)
2026-08-14 08:46:08.330669 | mon1 | Downloading cryptography (4.3MiB)
2026-08-14 08:46:08.334559 | mon1 | Downloading pygments (1.2MiB)
2026-08-14 08:46:08.337310 | mon1 | Downloading netaddr (2.2MiB)
2026-08-14 08:46:08.525819 | mon1 |  Downloading netaddr
2026-08-14 08:46:08.535978 | mon1 |  Downloading cryptography
2026-08-14 08:46:08.576661 | mon1 |  Downloading pygments
2026-08-14 08:46:08.695302 | mon1 |  Downloading ansible-core
2026-08-14 08:46:08.725270 | mon1 | Installed 36 packages in 29ms
2026-08-14 08:46:09.896521 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-14 08:46:09.896617 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-14 08:46:10.583254 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-14 08:46:10.583329 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-14 08:46:44.884795 | mon1 | INFO     [default > dependency] Executing
2026-08-14 08:46:44.885149 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-14 08:46:44.885609 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-14 08:46:44.885847 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-14 08:46:44.891387 | mon1 | INFO     [default > cleanup] Executing
2026-08-14 08:46:44.891654 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-14 08:46:44.896643 | mon1 | INFO     [default > destroy] Executing
2026-08-14 08:46:44.896678 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-14 08:46:44.896761 | mon1 | INFO     [default > destroy] Executed: Successful
2026-08-14 08:46:44.901716 | mon1 | INFO     [default > syntax] Executing
2026-08-14 08:46:45.997793 | mon1 |
2026-08-14 08:46:45.997924 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 08:46:46.064644 | mon1 | INFO     [default > syntax] Executed: Successful
2026-08-14 08:46:46.078438 | mon1 | INFO     [default > create] Executing
2026-08-14 08:46:46.079777 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-14 08:46:46.085013 | mon1 | INFO     [default > prepare] Executing
2026-08-14 08:46:46.838855 | mon1 |
2026-08-14 08:46:46.838931 | mon1 | PLAY [Prepare] *****************************************************************
2026-08-14 08:46:46.839066 | mon1 |
2026-08-14 08:46:46.839204 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:46:46.839335 | mon1 | Friday 14 August 2026  08:46:46 +0000 (0:00:00.062)       0:00:00.062 *********
2026-08-14 08:46:47.968027 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-14 08:46:47.968291 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-14 08:46:47.968752 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:46:47.969082 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:46:47.969418 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:46:47.991585 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-14 08:46:47.991637 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-14 08:46:47.991732 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:46:47.991826 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:46:47.991922 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:46:47.998751 | mon1 | ok: [osd1]
2026-08-14 08:46:47.998835 | mon1 | ok: [mon1]
2026-08-14 08:46:47.998919 | mon1 |
2026-08-14 08:46:47.999012 | mon1 | TASK [Configure short hostname] ************************************************
2026-08-14 08:46:47.999103 | mon1 | Friday 14 August 2026  08:46:47 +0000 (0:00:01.161)       0:00:01.223 *********
2026-08-14 08:46:48.690671 | mon1 | changed: [mon1]
2026-08-14 08:46:48.690826 | mon1 | changed: [osd1]
2026-08-14 08:46:48.691017 | mon1 |
2026-08-14 08:46:48.691230 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-14 08:46:48.691482 | mon1 | Friday 14 August 2026  08:46:48 +0000 (0:00:00.691)       0:00:01.914 *********
2026-08-14 08:46:48.966802 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-14 08:46:48.967037 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-14 08:46:48.967283 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-14 08:46:48.983514 | mon1 | changed: [mon1]
2026-08-14 08:46:48.983592 | mon1 | changed: [osd1]
2026-08-14 08:46:48.983693 | mon1 |
2026-08-14 08:46:48.983842 | mon1 | TASK [Update apt cache] ********************************************************
2026-08-14 08:46:48.983994 | mon1 | Friday 14 August 2026  08:46:48 +0000 (0:00:00.293)       0:00:02.207 *********
2026-08-14 08:47:15.502894 | mon1 | changed: [mon1]
2026-08-14 08:47:15.503094 | mon1 | changed: [osd1]
2026-08-14 08:47:15.503264 | mon1 |
2026-08-14 08:47:15.503440 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-08-14 08:47:15.503597 | mon1 |
2026-08-14 08:47:15.503770 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:47:15.503961 | mon1 | Friday 14 August 2026  08:47:15 +0000 (0:00:26.519)       0:00:28.727 *********
2026-08-14 08:47:16.174392 | mon1 | ok: [osd1]
2026-08-14 08:47:16.174592 | mon1 |
2026-08-14 08:47:16.174887 | mon1 | TASK [Install depedencies] *****************************************************
2026-08-14 08:47:16.175177 | mon1 | Friday 14 August 2026  08:47:16 +0000 (0:00:00.671)       0:00:29.398 *********
2026-08-14 08:48:48.220876 | mon1 | changed: [osd1]
2026-08-14 08:48:48.220961 | mon1 |
2026-08-14 08:48:48.220968 | mon1 | TASK [Start up service] ********************************************************
2026-08-14 08:48:48.220974 | mon1 | Friday 14 August 2026  08:48:48 +0000 (0:01:32.045)       0:02:01.443 *********
2026-08-14 08:48:48.745744 | mon1 | ok: [osd1]
2026-08-14 08:48:48.745817 | mon1 |
2026-08-14 08:48:48.745900 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-08-14 08:48:48.745996 | mon1 | Friday 14 August 2026  08:48:48 +0000 (0:00:00.526)       0:02:01.969 *********
2026-08-14 08:48:49.089823 | mon1 | ok: [osd1]
2026-08-14 08:48:49.089940 | mon1 |
2026-08-14 08:48:49.089952 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-14 08:48:49.090087 | mon1 | Friday 14 August 2026  08:48:49 +0000 (0:00:00.344)       0:02:02.314 *********
2026-08-14 08:48:49.789500 | mon1 | changed: [osd1]
2026-08-14 08:48:49.789612 | mon1 |
2026-08-14 08:48:49.789728 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-08-14 08:48:49.789865 | mon1 | Friday 14 August 2026  08:48:49 +0000 (0:00:00.699)       0:02:03.013 *********
2026-08-14 08:48:49.980622 | mon1 | ok: [osd1]
2026-08-14 08:48:49.980782 | mon1 |
2026-08-14 08:48:49.980916 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-14 08:48:49.981047 | mon1 | Friday 14 August 2026  08:48:49 +0000 (0:00:00.191)       0:02:03.205 *********
2026-08-14 08:48:50.002195 | mon1 | skipping: [osd1]
2026-08-14 08:48:50.002328 | mon1 |
2026-08-14 08:48:50.002342 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-08-14 08:48:50.002349 | mon1 | Friday 14 August 2026  08:48:50 +0000 (0:00:00.021)       0:02:03.226 *********
2026-08-14 08:48:50.541926 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:48:50.542048 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:48:50.542302 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:48:50.542449 | mon1 |
2026-08-14 08:48:50.542668 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-08-14 08:48:50.542828 | mon1 | Friday 14 August 2026  08:48:50 +0000 (0:00:00.539)       0:02:03.765 *********
2026-08-14 08:48:51.197459 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:48:51.197513 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:48:51.197519 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:48:51.197525 | mon1 |
2026-08-14 08:48:51.197531 | mon1 | TASK [Start loop devices] ******************************************************
2026-08-14 08:48:51.197537 | mon1 | Friday 14 August 2026  08:48:51 +0000 (0:00:00.655)       0:02:04.421 *********
2026-08-14 08:48:51.934257 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:48:51.934377 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:48:51.934542 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:48:51.934702 | mon1 |
2026-08-14 08:48:51.934756 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-08-14 08:48:51.934860 | mon1 | Friday 14 August 2026  08:48:51 +0000 (0:00:00.737)       0:02:05.158 *********
2026-08-14 08:48:55.098354 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:48:55.098558 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:48:55.099909 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:48:55.099925 | mon1 |
2026-08-14 08:48:55.099932 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-14 08:48:55.099938 | mon1 | Friday 14 August 2026  08:48:55 +0000 (0:00:03.163)       0:02:08.321 *********
2026-08-14 08:48:57.156906 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-08-14 08:48:57.157089 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-08-14 08:48:57.157309 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-08-14 08:48:57.157508 | mon1 |
2026-08-14 08:48:57.157759 | mon1 | PLAY RECAP *********************************************************************
2026-08-14 08:48:57.157977 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-08-14 08:48:57.158185 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-14 08:48:57.158427 | mon1 |
2026-08-14 08:48:57.158646 | mon1 |
2026-08-14 08:48:57.158846 | mon1 | TASKS RECAP ********************************************************************
2026-08-14 08:48:57.159286 | mon1 | Friday 14 August 2026  08:48:57 +0000 (0:00:02.059)       0:02:10.380 *********
2026-08-14 08:48:57.159533 | mon1 | ===============================================================================
2026-08-14 08:48:57.159793 | mon1 | Install depedencies ---------------------------------------------------- 92.05s
2026-08-14 08:48:57.159999 | mon1 | Update apt cache ------------------------------------------------------- 26.52s
2026-08-14 08:48:57.160209 | mon1 | Create a volume group for each loop device ------------------------------ 3.16s
2026-08-14 08:48:57.160399 | mon1 | Create a logical volume for each loop device ---------------------------- 2.06s
2026-08-14 08:48:57.160587 | mon1 | Gathering Facts --------------------------------------------------------- 1.16s
2026-08-14 08:48:57.160781 | mon1 | Start loop devices ------------------------------------------------------ 0.74s
2026-08-14 08:48:57.160979 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.70s
2026-08-14 08:48:57.161157 | mon1 | Configure short hostname ------------------------------------------------ 0.69s
2026-08-14 08:48:57.161516 | mon1 | Gathering Facts --------------------------------------------------------- 0.67s
2026-08-14 08:48:57.161724 | mon1 | Set permissions on loopback devices ------------------------------------- 0.66s
2026-08-14 08:48:57.161908 | mon1 | Create devices for Ceph ------------------------------------------------- 0.54s
2026-08-14 08:48:57.162096 | mon1 | Start up service -------------------------------------------------------- 0.53s
2026-08-14 08:48:57.162314 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.34s
2026-08-14 08:48:57.162514 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-14 08:48:57.162715 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s
2026-08-14 08:48:57.163196 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-08-14 08:48:57.238115 | mon1 | INFO     [default > prepare] Executed: Successful
2026-08-14 08:48:57.246549 | mon1 | INFO     [default > converge] Executing
2026-08-14 08:48:58.180178 | mon1 |
2026-08-14 08:48:58.180383 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-14 08:48:58.180605 | mon1 |
2026-08-14 08:48:58.180847 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:48:58.181108 | mon1 | Friday 14 August 2026  08:48:58 +0000 (0:00:00.055)       0:00:00.055 *********
2026-08-14 08:48:59.300036 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-14 08:48:59.300307 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-14 08:48:59.300529 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:48:59.300756 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:48:59.300965 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:48:59.314663 | mon1 | ok: [mon1]
2026-08-14 08:48:59.314720 | mon1 |
2026-08-14 08:48:59.314843 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:48:59.315005 | mon1 | Friday 14 August 2026  08:48:59 +0000 (0:00:01.134)       0:00:01.189 *********
2026-08-14 08:48:59.619559 | mon1 | ok: [mon1]
2026-08-14 08:48:59.619599 | mon1 |
2026-08-14 08:48:59.619605 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:48:59.619610 | mon1 | Friday 14 August 2026  08:48:59 +0000 (0:00:00.304)       0:00:01.494 *********
2026-08-14 08:48:59.654402 | mon1 | skipping: [mon1]
2026-08-14 08:48:59.654473 | mon1 |
2026-08-14 08:48:59.654485 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 08:48:59.654495 | mon1 | Friday 14 August 2026  08:48:59 +0000 (0:00:00.034)       0:00:01.528 *********
2026-08-14 08:49:00.006732 | mon1 | changed: [mon1]
2026-08-14 08:49:00.006803 | mon1 |
2026-08-14 08:49:00.006865 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:49:00.006946 | mon1 | Friday 14 August 2026  08:49:00 +0000 (0:00:00.352)       0:00:01.881 *********
2026-08-14 08:49:00.103049 | mon1 | ok: [mon1] => {
2026-08-14 08:49:00.103100 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 08:49:00.103106 | mon1 | }
2026-08-14 08:49:00.103111 | mon1 |
2026-08-14 08:49:00.103115 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:49:00.103120 | mon1 | Friday 14 August 2026  08:49:00 +0000 (0:00:00.095)       0:00:01.977 *********
2026-08-14 08:49:00.894876 | mon1 | changed: [mon1]
2026-08-14 08:49:00.894944 | mon1 |
2026-08-14 08:49:00.895261 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:49:00.895303 | mon1 | Friday 14 August 2026  08:49:00 +0000 (0:00:00.792)       0:00:02.770 *********
2026-08-14 08:49:00.935753 | mon1 | skipping: [mon1]
2026-08-14 08:49:00.935825 | mon1 |
2026-08-14 08:49:00.935881 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:49:00.936006 | mon1 | Friday 14 August 2026  08:49:00 +0000 (0:00:00.041)       0:00:02.811 *********
2026-08-14 08:49:00.974986 | mon1 | skipping: [mon1]
2026-08-14 08:49:00.975063 | mon1 |
2026-08-14 08:49:00.975334 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:49:00.975376 | mon1 | Friday 14 August 2026  08:49:00 +0000 (0:00:00.039)       0:00:02.850 *********
2026-08-14 08:49:01.191096 | mon1 | ok: [mon1]
2026-08-14 08:49:01.191300 | mon1 |
2026-08-14 08:49:01.191314 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:49:01.191328 | mon1 | Friday 14 August 2026  08:49:01 +0000 (0:00:00.216)       0:00:03.066 *********
2026-08-14 08:49:02.465600 | mon1 | ok: [mon1]
2026-08-14 08:49:02.465671 | mon1 |
2026-08-14 08:49:02.465977 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:49:02.466028 | mon1 | Friday 14 August 2026  08:49:02 +0000 (0:00:01.274)       0:00:04.340 *********
2026-08-14 08:49:02.540125 | mon1 | ok: [mon1] => {
2026-08-14 08:49:02.540185 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 08:49:02.540773 | mon1 | }
2026-08-14 08:49:02.540821 | mon1 |
2026-08-14 08:49:02.540828 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:49:02.540835 | mon1 | Friday 14 August 2026  08:49:02 +0000 (0:00:00.074)       0:00:04.415 *********
2026-08-14 08:49:03.304032 | mon1 | changed: [mon1]
2026-08-14 08:49:03.304161 | mon1 |
2026-08-14 08:49:03.304409 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:49:03.304454 | mon1 | Friday 14 August 2026  08:49:03 +0000 (0:00:00.763)       0:00:05.179 *********
2026-08-14 08:49:06.532476 | mon1 | changed: [mon1]
2026-08-14 08:49:06.532546 | mon1 |
2026-08-14 08:49:06.532557 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 08:49:06.532568 | mon1 | Friday 14 August 2026  08:49:06 +0000 (0:00:03.216)       0:00:08.396 *********
2026-08-14 08:49:06.542699 | mon1 | skipping: [mon1]
2026-08-14 08:49:06.542799 | mon1 |
2026-08-14 08:49:06.543011 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 08:49:06.543050 | mon1 | Friday 14 August 2026  08:49:06 +0000 (0:00:00.021)       0:00:08.418 *********
2026-08-14 08:49:06.570009 | mon1 | skipping: [mon1]
2026-08-14 08:49:06.570309 | mon1 |
2026-08-14 08:49:06.570364 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 08:49:06.570525 | mon1 | Friday 14 August 2026  08:49:06 +0000 (0:00:00.026)       0:00:08.445 *********
2026-08-14 08:49:06.595279 | mon1 | skipping: [mon1]
2026-08-14 08:49:06.595359 | mon1 |
2026-08-14 08:49:06.595503 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 08:49:06.595655 | mon1 | Friday 14 August 2026  08:49:06 +0000 (0:00:00.025)       0:00:08.470 *********
2026-08-14 08:50:01.210460 | mon1 | changed: [mon1]
2026-08-14 08:50:01.210680 | mon1 |
2026-08-14 08:50:01.210694 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 08:50:01.210705 | mon1 | Friday 14 August 2026  08:50:01 +0000 (0:00:54.615)       0:01:03.085 *********
2026-08-14 08:50:01.822842 | mon1 | changed: [mon1]
2026-08-14 08:50:01.822949 | mon1 |
2026-08-14 08:50:01.823251 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 08:50:01.823299 | mon1 | Friday 14 August 2026  08:50:01 +0000 (0:00:00.612)       0:01:03.698 *********
2026-08-14 08:50:02.750486 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-08-14 08:50:02.750557 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 08:50:02.751049 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 08:50:02.751130 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 08:50:02.751149 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 08:50:02.751164 | mon1 |
2026-08-14 08:50:02.751186 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 08:50:02.751199 | mon1 | Friday 14 August 2026  08:50:02 +0000 (0:00:00.927)       0:01:04.625 *********
2026-08-14 08:50:03.364859 | mon1 | changed: [mon1]
2026-08-14 08:50:03.364901 | mon1 |
2026-08-14 08:50:03.364906 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 08:50:03.364911 | mon1 | Friday 14 August 2026  08:50:03 +0000 (0:00:00.607)       0:01:05.233 *********
2026-08-14 08:50:03.364915 | mon1 |
2026-08-14 08:50:03.364919 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:50:03.364924 | mon1 | Friday 14 August 2026  08:50:03 +0000 (0:00:00.006)       0:01:05.239 *********
2026-08-14 08:50:04.271485 | mon1 | ok: [mon1]
2026-08-14 08:50:04.271552 | mon1 |
2026-08-14 08:50:04.271863 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-14 08:50:04.271885 | mon1 | Friday 14 August 2026  08:50:04 +0000 (0:00:00.906)       0:01:06.146 *********
2026-08-14 08:50:04.947932 | mon1 | changed: [mon1]
2026-08-14 08:50:04.948184 | mon1 |
2026-08-14 08:50:04.948197 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 08:50:04.948208 | mon1 | Friday 14 August 2026  08:50:04 +0000 (0:00:00.676)       0:01:06.823 *********
2026-08-14 08:50:05.511283 | mon1 | changed: [mon1]
2026-08-14 08:50:05.511358 | mon1 |
2026-08-14 08:50:05.511431 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:50:05.511560 | mon1 | Friday 14 August 2026  08:50:05 +0000 (0:00:00.563)       0:01:07.386 *********
2026-08-14 08:50:05.715534 | mon1 | ok: [mon1]
2026-08-14 08:50:05.715601 | mon1 |
2026-08-14 08:50:05.715826 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:50:05.715870 | mon1 | Friday 14 August 2026  08:50:05 +0000 (0:00:00.204)       0:01:07.590 *********
2026-08-14 08:50:05.868713 | mon1 | ok: [mon1] => {
2026-08-14 08:50:05.868800 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 08:50:05.869301 | mon1 | }
2026-08-14 08:50:05.869348 | mon1 |
2026-08-14 08:50:05.869356 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:50:05.869362 | mon1 | Friday 14 August 2026  08:50:05 +0000 (0:00:00.153)       0:01:07.743 *********
2026-08-14 08:50:06.718260 | mon1 | changed: [mon1]
2026-08-14 08:50:06.718326 | mon1 |
2026-08-14 08:50:06.718415 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:50:06.718609 | mon1 | Friday 14 August 2026  08:50:06 +0000 (0:00:00.849)       0:01:08.593 *********
2026-08-14 08:50:11.258708 | mon1 | changed: [mon1]
2026-08-14 08:50:11.258783 | mon1 |
2026-08-14 08:50:11.258789 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 08:50:11.258794 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:04.539)       0:01:13.133 *********
2026-08-14 08:50:12.304905 | mon1 | ok: [mon1]
2026-08-14 08:50:12.304947 | mon1 |
2026-08-14 08:50:12.304953 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 08:50:12.304958 | mon1 | Friday 14 August 2026  08:50:12 +0000 (0:00:01.046)       0:01:14.180 *********
2026-08-14 08:50:13.349334 | mon1 | changed: [mon1]
2026-08-14 08:50:13.349408 | mon1 |
2026-08-14 08:50:13.349468 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 08:50:13.349592 | mon1 | Friday 14 August 2026  08:50:13 +0000 (0:00:01.044)       0:01:15.224 *********
2026-08-14 08:50:13.845737 | mon1 | changed: [mon1]
2026-08-14 08:50:13.846158 | mon1 |
2026-08-14 08:50:13.846210 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 08:50:13.846249 | mon1 | Friday 14 August 2026  08:50:13 +0000 (0:00:00.496)       0:01:15.720 *********
2026-08-14 08:50:14.414694 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-08-14 08:50:14.414764 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 08:50:14.415140 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 08:50:14.415187 | mon1 |
2026-08-14 08:50:14.415192 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 08:50:14.415197 | mon1 | Friday 14 August 2026  08:50:14 +0000 (0:00:00.568)       0:01:16.289 *********
2026-08-14 08:50:14.904166 | mon1 | changed: [mon1]
2026-08-14 08:50:14.904233 | mon1 |
2026-08-14 08:50:14.904563 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 08:50:14.904612 | mon1 | Friday 14 August 2026  08:50:14 +0000 (0:00:00.489)       0:01:16.779 *********
2026-08-14 08:50:15.362715 | mon1 | changed: [mon1]
2026-08-14 08:50:15.362784 | mon1 |
2026-08-14 08:50:15.362797 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 08:50:15.363164 | mon1 | Friday 14 August 2026  08:50:15 +0000 (0:00:00.452)       0:01:17.232 *********
2026-08-14 08:50:15.363203 | mon1 |
2026-08-14 08:50:15.363209 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:50:15.363223 | mon1 | Friday 14 August 2026  08:50:15 +0000 (0:00:00.005)       0:01:17.238 *********
2026-08-14 08:50:16.061605 | mon1 | ok: [mon1]
2026-08-14 08:50:16.061669 | mon1 |
2026-08-14 08:50:16.061681 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-14 08:50:16.061691 | mon1 | Friday 14 August 2026  08:50:16 +0000 (0:00:00.682)       0:01:17.920 *********
2026-08-14 08:50:20.900290 | mon1 | changed: [mon1]
2026-08-14 08:50:20.900374 | mon1 |
2026-08-14 08:50:20.900668 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 08:50:20.900719 | mon1 | Friday 14 August 2026  08:50:20 +0000 (0:00:04.854)       0:01:22.775 *********
2026-08-14 08:50:21.431428 | mon1 | changed: [mon1]
2026-08-14 08:50:21.431540 | mon1 |
2026-08-14 08:50:21.431611 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 08:50:21.431699 | mon1 | Friday 14 August 2026  08:50:21 +0000 (0:00:00.531)       0:01:23.306 *********
2026-08-14 08:50:21.479731 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-14 08:50:21.480118 | mon1 |
2026-08-14 08:50:21.480139 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 08:50:21.480147 | mon1 | Friday 14 August 2026  08:50:21 +0000 (0:00:00.047)       0:01:23.354 *********
2026-08-14 08:51:08.596232 | mon1 | changed: [mon1]
2026-08-14 08:51:08.596305 | mon1 |
2026-08-14 08:51:08.596349 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 08:51:08.596523 | mon1 | Friday 14 August 2026  08:51:08 +0000 (0:00:47.116)       0:02:10.471 *********
2026-08-14 08:51:09.294750 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-14 08:51:09.294827 | mon1 | ok: [mon1] => (item=sshd)
2026-08-14 08:51:09.295272 | mon1 |
2026-08-14 08:51:09.295316 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 08:51:09.295324 | mon1 | Friday 14 August 2026  08:51:09 +0000 (0:00:00.698)       0:02:11.169 *********
2026-08-14 08:51:09.599085 | mon1 | changed: [mon1]
2026-08-14 08:51:09.599175 | mon1 |
2026-08-14 08:51:09.599492 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 08:51:09.599542 | mon1 | Friday 14 August 2026  08:51:09 +0000 (0:00:00.304)       0:02:11.474 *********
2026-08-14 08:51:09.787992 | mon1 | ok: [mon1]
2026-08-14 08:51:09.788036 | mon1 |
2026-08-14 08:51:09.788144 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 08:51:09.788279 | mon1 | Friday 14 August 2026  08:51:09 +0000 (0:00:00.189)       0:02:11.663 *********
2026-08-14 08:51:10.375796 | mon1 | changed: [mon1]
2026-08-14 08:51:10.375874 | mon1 |
2026-08-14 08:51:10.376086 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 08:51:10.376128 | mon1 | Friday 14 August 2026  08:51:10 +0000 (0:00:00.587)       0:02:12.250 *********
2026-08-14 08:51:10.706032 | mon1 | changed: [mon1]
2026-08-14 08:51:10.706104 | mon1 |
2026-08-14 08:51:10.706266 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-14 08:51:10.706374 | mon1 | Friday 14 August 2026  08:51:10 +0000 (0:00:00.330)       0:02:12.581 *********
2026-08-14 08:51:10.822836 | mon1 | ok: [mon1]
2026-08-14 08:51:10.822911 | mon1 |
2026-08-14 08:51:10.822970 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-14 08:51:10.823077 | mon1 | Friday 14 August 2026  08:51:10 +0000 (0:00:00.116)       0:02:12.697 *********
2026-08-14 08:51:11.044647 | mon1 | ok: [mon1] => (item=mon1)
2026-08-14 08:51:11.045141 | mon1 |
2026-08-14 08:51:11.045192 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-14 08:51:11.045201 | mon1 | Friday 14 August 2026  08:51:11 +0000 (0:00:00.221)       0:02:12.919 *********
2026-08-14 08:51:11.085786 | mon1 | ok: [mon1]
2026-08-14 08:51:11.085899 | mon1 |
2026-08-14 08:51:11.086237 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-14 08:51:11.086259 | mon1 | Friday 14 August 2026  08:51:11 +0000 (0:00:00.041)       0:02:12.960 *********
2026-08-14 08:51:11.152485 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-08-14 08:51:11.152559 | mon1 |
2026-08-14 08:51:11.152575 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-14 08:51:11.152716 | mon1 | Friday 14 August 2026  08:51:11 +0000 (0:00:00.066)       0:02:13.027 *********
2026-08-14 08:51:11.435088 | mon1 | changed: [mon1]
2026-08-14 08:51:11.435226 | mon1 |
2026-08-14 08:51:11.435244 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-14 08:51:11.435373 | mon1 | Friday 14 August 2026  08:51:11 +0000 (0:00:00.282)       0:02:13.310 *********
2026-08-14 08:51:12.083939 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-14 08:51:12.084627 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-14 08:51:12.084677 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-08-14 08:51:12.084689 | mon1 |
2026-08-14 08:51:12.084698 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-14 08:51:12.084707 | mon1 | Friday 14 August 2026  08:51:12 +0000 (0:00:00.648)       0:02:13.959 *********
2026-08-14 08:53:32.834101 | mon1 | ok: [mon1]
2026-08-14 08:53:32.834163 | mon1 |
2026-08-14 08:53:32.834256 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-14 08:53:32.834349 | mon1 | Friday 14 August 2026  08:53:32 +0000 (0:02:20.750)       0:04:34.709 *********
2026-08-14 08:53:33.032963 | mon1 | changed: [mon1]
2026-08-14 08:53:33.033644 | mon1 |
2026-08-14 08:53:33.033702 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-14 08:53:33.033715 | mon1 | Friday 14 August 2026  08:53:33 +0000 (0:00:00.198)       0:04:34.907 *********
2026-08-14 08:53:33.071966 | mon1 | ok: [mon1]
2026-08-14 08:53:33.072069 | mon1 |
2026-08-14 08:53:33.072349 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:53:33.072369 | mon1 | Friday 14 August 2026  08:53:33 +0000 (0:00:00.039)       0:04:34.947 *********
2026-08-14 08:53:33.141882 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-14 08:53:33.141949 | mon1 |
2026-08-14 08:53:33.142398 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:53:33.142469 | mon1 | Friday 14 August 2026  08:53:33 +0000 (0:00:00.069)       0:04:35.017 *********
2026-08-14 08:53:34.993112 | mon1 | ok: [mon1]
2026-08-14 08:53:34.993189 | mon1 |
2026-08-14 08:53:34.993195 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:53:34.993201 | mon1 | Friday 14 August 2026  08:53:34 +0000 (0:00:01.850)       0:04:36.868 *********
2026-08-14 08:53:35.042060 | mon1 | ok: [mon1] => (item=mon1)
2026-08-14 08:53:35.042108 | mon1 |
2026-08-14 08:53:35.042115 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:53:35.042122 | mon1 | Friday 14 August 2026  08:53:35 +0000 (0:00:00.048)       0:04:36.916 *********
2026-08-14 08:53:35.412480 | mon1 | ok: [mon1]
2026-08-14 08:53:35.412551 | mon1 |
2026-08-14 08:53:35.412767 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:53:35.412786 | mon1 | Friday 14 August 2026  08:53:35 +0000 (0:00:00.371)       0:04:37.287 *********
2026-08-14 08:53:39.604028 | mon1 | ok: [mon1]
2026-08-14 08:53:39.604071 | mon1 |
2026-08-14 08:53:39.604077 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-14 08:53:39.604083 | mon1 | Friday 14 August 2026  08:53:39 +0000 (0:00:04.191)       0:04:41.478 *********
2026-08-14 08:53:44.033047 | mon1 | changed: [mon1]
2026-08-14 08:53:44.033157 | mon1 |
2026-08-14 08:53:44.033460 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-14 08:53:44.033514 | mon1 | Friday 14 August 2026  08:53:44 +0000 (0:00:04.428)       0:04:45.907 *********
2026-08-14 08:53:46.126826 | mon1 | ok: [mon1]
2026-08-14 08:53:46.126916 | mon1 |
2026-08-14 08:53:46.126949 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:53:46.127082 | mon1 | Friday 14 August 2026  08:53:46 +0000 (0:00:02.094)       0:04:48.002 *********
2026-08-14 08:53:46.194812 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-14 08:53:46.194932 | mon1 |
2026-08-14 08:53:46.195106 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:53:46.195251 | mon1 | Friday 14 August 2026  08:53:46 +0000 (0:00:00.067)       0:04:48.069 *********
2026-08-14 08:53:46.240671 | mon1 | skipping: [mon1]
2026-08-14 08:53:46.241153 | mon1 |
2026-08-14 08:53:46.241209 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:53:46.241218 | mon1 | Friday 14 August 2026  08:53:46 +0000 (0:00:00.045)       0:04:48.115 *********
2026-08-14 08:53:46.280367 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-14 08:53:46.286864 | mon1 | skipping: [mon1]
2026-08-14 08:53:46.286887 | mon1 |
2026-08-14 08:53:46.286910 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:53:46.286918 | mon1 | Friday 14 August 2026  08:53:46 +0000 (0:00:00.039)       0:04:48.154 *********
2026-08-14 08:53:46.533108 | mon1 | ok: [mon1]
2026-08-14 08:53:46.533153 | mon1 |
2026-08-14 08:53:46.533158 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:53:46.533170 | mon1 | Friday 14 August 2026  08:53:46 +0000 (0:00:00.251)       0:04:48.405 *********
2026-08-14 08:53:51.115202 | mon1 | ok: [mon1]
2026-08-14 08:53:51.115276 | mon1 |
2026-08-14 08:53:51.115326 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-14 08:53:51.115449 | mon1 | Friday 14 August 2026  08:53:51 +0000 (0:00:04.584)       0:04:52.990 *********
2026-08-14 08:53:55.209858 | mon1 | changed: [mon1]
2026-08-14 08:53:55.209944 | mon1 |
2026-08-14 08:53:55.210255 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-14 08:53:55.210303 | mon1 | Friday 14 August 2026  08:53:55 +0000 (0:00:04.094)       0:04:57.085 *********
2026-08-14 08:53:57.558695 | mon1 | ok: [mon1]
2026-08-14 08:53:57.558778 | mon1 |
2026-08-14 08:53:57.559117 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-14 08:53:57.559167 | mon1 | Friday 14 August 2026  08:53:57 +0000 (0:00:02.348)       0:04:59.433 *********
2026-08-14 08:54:13.575021 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-14 08:54:13.575111 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-14 08:54:13.575812 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-08-14 08:54:13.575829 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-14 08:54:13.575835 | mon1 |
2026-08-14 08:54:13.575840 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-14 08:54:13.575844 | mon1 |
2026-08-14 08:54:13.575848 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:54:13.575852 | mon1 | Friday 14 August 2026  08:54:13 +0000 (0:00:16.016)       0:05:15.450 *********
2026-08-14 08:54:14.667951 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-14 08:54:14.668904 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-14 08:54:14.668999 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:54:14.669011 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:54:14.669022 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:54:14.682121 | mon1 | ok: [osd1]
2026-08-14 08:54:14.682765 | mon1 |
2026-08-14 08:54:14.682826 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:54:14.682837 | mon1 | Friday 14 August 2026  08:54:14 +0000 (0:00:01.106)       0:05:16.556 *********
2026-08-14 08:54:14.901421 | mon1 | ok: [osd1]
2026-08-14 08:54:14.901492 | mon1 |
2026-08-14 08:54:14.901631 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:54:14.901794 | mon1 | Friday 14 August 2026  08:54:14 +0000 (0:00:00.219)       0:05:16.776 *********
2026-08-14 08:54:14.933451 | mon1 | skipping: [osd1]
2026-08-14 08:54:14.933550 | mon1 |
2026-08-14 08:54:14.933616 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 08:54:14.933766 | mon1 | Friday 14 August 2026  08:54:14 +0000 (0:00:00.032)       0:05:16.808 *********
2026-08-14 08:54:15.145847 | mon1 | changed: [osd1]
2026-08-14 08:54:15.145934 | mon1 |
2026-08-14 08:54:15.145946 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:54:15.146057 | mon1 | Friday 14 August 2026  08:54:15 +0000 (0:00:00.212)       0:05:17.021 *********
2026-08-14 08:54:15.198563 | mon1 | ok: [osd1] => {
2026-08-14 08:54:15.198644 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 08:54:15.198698 | mon1 | }
2026-08-14 08:54:15.198788 | mon1 |
2026-08-14 08:54:15.198961 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:54:15.199089 | mon1 | Friday 14 August 2026  08:54:15 +0000 (0:00:00.052)       0:05:17.073 *********
2026-08-14 08:54:15.746995 | mon1 | changed: [osd1]
2026-08-14 08:54:15.747072 | mon1 |
2026-08-14 08:54:15.747327 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:54:15.747375 | mon1 | Friday 14 August 2026  08:54:15 +0000 (0:00:00.548)       0:05:17.622 *********
2026-08-14 08:54:15.782234 | mon1 | skipping: [osd1]
2026-08-14 08:54:15.782310 | mon1 |
2026-08-14 08:54:15.782379 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:54:15.782485 | mon1 | Friday 14 August 2026  08:54:15 +0000 (0:00:00.035)       0:05:17.657 *********
2026-08-14 08:54:15.816588 | mon1 | skipping: [osd1]
2026-08-14 08:54:15.816716 | mon1 |
2026-08-14 08:54:15.816877 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:54:15.817051 | mon1 | Friday 14 August 2026  08:54:15 +0000 (0:00:00.033)       0:05:17.691 *********
2026-08-14 08:54:16.015329 | mon1 | ok: [osd1]
2026-08-14 08:54:16.015442 | mon1 |
2026-08-14 08:54:16.015589 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:54:16.015730 | mon1 | Friday 14 August 2026  08:54:16 +0000 (0:00:00.199)       0:05:17.890 *********
2026-08-14 08:54:17.060991 | mon1 | ok: [osd1]
2026-08-14 08:54:17.061120 | mon1 |
2026-08-14 08:54:17.061269 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:54:17.061434 | mon1 | Friday 14 August 2026  08:54:17 +0000 (0:00:01.045)       0:05:18.936 *********
2026-08-14 08:54:17.131616 | mon1 | ok: [osd1] => {
2026-08-14 08:54:17.131836 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 08:54:17.132044 | mon1 | }
2026-08-14 08:54:17.132239 | mon1 |
2026-08-14 08:54:17.132457 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:54:17.132696 | mon1 | Friday 14 August 2026  08:54:17 +0000 (0:00:00.070)       0:05:19.006 *********
2026-08-14 08:54:17.909402 | mon1 | changed: [osd1]
2026-08-14 08:54:17.909648 | mon1 |
2026-08-14 08:54:17.909991 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:54:17.910359 | mon1 | Friday 14 August 2026  08:54:17 +0000 (0:00:00.777)       0:05:19.784 *********
2026-08-14 08:54:20.586340 | mon1 | changed: [osd1]
2026-08-14 08:54:20.586406 | mon1 |
2026-08-14 08:54:20.586414 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 08:54:20.586426 | mon1 | Friday 14 August 2026  08:54:20 +0000 (0:00:02.676)       0:05:22.460 *********
2026-08-14 08:54:20.610305 | mon1 | skipping: [osd1]
2026-08-14 08:54:20.610400 | mon1 |
2026-08-14 08:54:20.610689 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 08:54:20.610736 | mon1 | Friday 14 August 2026  08:54:20 +0000 (0:00:00.024)       0:05:22.485 *********
2026-08-14 08:54:20.645282 | mon1 | skipping: [osd1]
2026-08-14 08:54:20.645357 | mon1 |
2026-08-14 08:54:20.645421 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 08:54:20.645546 | mon1 | Friday 14 August 2026  08:54:20 +0000 (0:00:00.034)       0:05:22.520 *********
2026-08-14 08:54:20.679310 | mon1 | skipping: [osd1]
2026-08-14 08:54:20.679378 | mon1 |
2026-08-14 08:54:20.679757 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 08:54:20.679802 | mon1 | Friday 14 August 2026  08:54:20 +0000 (0:00:00.033)       0:05:22.554 *********
2026-08-14 08:54:29.179963 | mon1 | changed: [osd1]
2026-08-14 08:54:29.180101 | mon1 |
2026-08-14 08:54:29.180115 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 08:54:29.180127 | mon1 | Friday 14 August 2026  08:54:29 +0000 (0:00:08.490)       0:05:31.044 *********
2026-08-14 08:54:29.659460 | mon1 | changed: [osd1]
2026-08-14 08:54:29.659541 | mon1 |
2026-08-14 08:54:29.659826 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 08:54:29.659880 | mon1 | Friday 14 August 2026  08:54:29 +0000 (0:00:00.489)       0:05:31.534 *********
2026-08-14 08:54:30.598978 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-08-14 08:54:30.599085 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 08:54:30.599881 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 08:54:30.599959 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 08:54:30.599968 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 08:54:30.599976 | mon1 |
2026-08-14 08:54:30.599982 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 08:54:30.599989 | mon1 | Friday 14 August 2026  08:54:30 +0000 (0:00:00.939)       0:05:32.474 *********
2026-08-14 08:54:31.160111 | mon1 | changed: [osd1]
2026-08-14 08:54:31.160153 | mon1 |
2026-08-14 08:54:31.160158 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 08:54:31.160163 | mon1 | Friday 14 August 2026  08:54:31 +0000 (0:00:00.553)       0:05:33.027 *********
2026-08-14 08:54:31.160167 | mon1 |
2026-08-14 08:54:31.160171 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:54:31.160175 | mon1 | Friday 14 August 2026  08:54:31 +0000 (0:00:00.007)       0:05:33.034 *********
2026-08-14 08:54:31.832885 | mon1 | ok: [osd1]
2026-08-14 08:54:31.832953 | mon1 |
2026-08-14 08:54:31.833040 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-14 08:54:31.833177 | mon1 | Friday 14 August 2026  08:54:31 +0000 (0:00:00.673)       0:05:33.708 *********
2026-08-14 08:54:32.302489 | mon1 | changed: [osd1]
2026-08-14 08:54:32.302613 | mon1 |
2026-08-14 08:54:32.302806 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 08:54:32.302991 | mon1 | Friday 14 August 2026  08:54:32 +0000 (0:00:00.469)       0:05:34.177 *********
2026-08-14 08:54:32.847875 | mon1 | changed: [osd1]
2026-08-14 08:54:32.848058 | mon1 |
2026-08-14 08:54:32.848278 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:54:32.848527 | mon1 | Friday 14 August 2026  08:54:32 +0000 (0:00:00.545)       0:05:34.723 *********
2026-08-14 08:54:33.054075 | mon1 | ok: [osd1]
2026-08-14 08:54:33.054309 | mon1 |
2026-08-14 08:54:33.054555 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:54:33.054799 | mon1 | Friday 14 August 2026  08:54:33 +0000 (0:00:00.205)       0:05:34.928 *********
2026-08-14 08:54:33.111261 | mon1 | ok: [osd1] => {
2026-08-14 08:54:33.111336 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 08:54:33.111589 | mon1 | }
2026-08-14 08:54:33.111697 | mon1 |
2026-08-14 08:54:33.111733 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:54:33.111875 | mon1 | Friday 14 August 2026  08:54:33 +0000 (0:00:00.057)       0:05:34.986 *********
2026-08-14 08:54:33.946869 | mon1 | changed: [osd1]
2026-08-14 08:54:33.947308 | mon1 |
2026-08-14 08:54:33.947682 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:54:33.948026 | mon1 | Friday 14 August 2026  08:54:33 +0000 (0:00:00.834)       0:05:35.821 *********
2026-08-14 08:54:38.412023 | mon1 | changed: [osd1]
2026-08-14 08:54:38.412160 | mon1 |
2026-08-14 08:54:38.412172 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 08:54:38.412183 | mon1 | Friday 14 August 2026  08:54:38 +0000 (0:00:04.466)       0:05:40.287 *********
2026-08-14 08:54:39.413137 | mon1 | ok: [osd1]
2026-08-14 08:54:39.413197 | mon1 |
2026-08-14 08:54:39.413276 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 08:54:39.413378 | mon1 | Friday 14 August 2026  08:54:39 +0000 (0:00:01.001)       0:05:41.288 *********
2026-08-14 08:54:40.533108 | mon1 | changed: [osd1]
2026-08-14 08:54:40.533160 | mon1 |
2026-08-14 08:54:40.533411 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 08:54:40.533455 | mon1 | Friday 14 August 2026  08:54:40 +0000 (0:00:01.119)       0:05:42.408 *********
2026-08-14 08:54:40.999955 | mon1 | changed: [osd1]
2026-08-14 08:54:41.000034 | mon1 |
2026-08-14 08:54:41.000046 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 08:54:41.000181 | mon1 | Friday 14 August 2026  08:54:40 +0000 (0:00:00.466)       0:05:42.875 *********
2026-08-14 08:54:41.551808 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-08-14 08:54:41.551932 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 08:54:41.552407 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 08:54:41.552452 | mon1 |
2026-08-14 08:54:41.552458 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 08:54:41.552463 | mon1 | Friday 14 August 2026  08:54:41 +0000 (0:00:00.551)       0:05:43.426 *********
2026-08-14 08:54:42.007321 | mon1 | changed: [osd1]
2026-08-14 08:54:42.007386 | mon1 |
2026-08-14 08:54:42.007397 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 08:54:42.007408 | mon1 | Friday 14 August 2026  08:54:42 +0000 (0:00:00.454)       0:05:43.881 *********
2026-08-14 08:54:42.467008 | mon1 | changed: [osd1]
2026-08-14 08:54:42.467080 | mon1 |
2026-08-14 08:54:42.467092 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 08:54:42.467101 | mon1 | Friday 14 August 2026  08:54:42 +0000 (0:00:00.448)       0:05:44.329 *********
2026-08-14 08:54:42.467110 | mon1 |
2026-08-14 08:54:42.467119 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:54:42.467128 | mon1 | Friday 14 August 2026  08:54:42 +0000 (0:00:00.005)       0:05:44.335 *********
2026-08-14 08:54:43.147677 | mon1 | ok: [osd1]
2026-08-14 08:54:43.147752 | mon1 |
2026-08-14 08:54:43.147818 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-14 08:54:43.147943 | mon1 | Friday 14 August 2026  08:54:43 +0000 (0:00:00.687)       0:05:45.022 *********
2026-08-14 08:54:44.871926 | mon1 | changed: [osd1]
2026-08-14 08:54:44.872010 | mon1 |
2026-08-14 08:54:44.872305 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 08:54:44.872389 | mon1 | Friday 14 August 2026  08:54:44 +0000 (0:00:01.723)       0:05:46.746 *********
2026-08-14 08:54:45.421568 | mon1 | changed: [osd1]
2026-08-14 08:54:45.421688 | mon1 |
2026-08-14 08:54:45.421699 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 08:54:45.421763 | mon1 | Friday 14 August 2026  08:54:45 +0000 (0:00:00.550)       0:05:47.296 *********
2026-08-14 08:54:45.473077 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-14 08:54:45.473144 | mon1 |
2026-08-14 08:54:45.473154 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 08:54:45.473162 | mon1 | Friday 14 August 2026  08:54:45 +0000 (0:00:00.050)       0:05:47.347 *********
2026-08-14 08:54:51.420242 | mon1 | changed: [osd1]
2026-08-14 08:54:51.420309 | mon1 |
2026-08-14 08:54:51.420332 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 08:54:51.420343 | mon1 | Friday 14 August 2026  08:54:51 +0000 (0:00:05.946)       0:05:53.294 *********
2026-08-14 08:54:52.069117 | mon1 | ok: [osd1] => (item=chronyd)
2026-08-14 08:54:52.069202 | mon1 | ok: [osd1] => (item=sshd)
2026-08-14 08:54:52.069671 | mon1 |
2026-08-14 08:54:52.069724 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 08:54:52.069733 | mon1 | Friday 14 August 2026  08:54:52 +0000 (0:00:00.649)       0:05:53.944 *********
2026-08-14 08:54:52.374091 | mon1 | changed: [osd1]
2026-08-14 08:54:52.374179 | mon1 |
2026-08-14 08:54:52.374580 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 08:54:52.374672 | mon1 | Friday 14 August 2026  08:54:52 +0000 (0:00:00.304)       0:05:54.248 *********
2026-08-14 08:54:52.567038 | mon1 | ok: [osd1]
2026-08-14 08:54:52.567162 | mon1 |
2026-08-14 08:54:52.567175 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 08:54:52.568053 | mon1 | Friday 14 August 2026  08:54:52 +0000 (0:00:00.193)       0:05:54.441 *********
2026-08-14 08:54:53.008074 | mon1 | changed: [osd1]
2026-08-14 08:54:53.008121 | mon1 |
2026-08-14 08:54:53.008127 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 08:54:53.008132 | mon1 | Friday 14 August 2026  08:54:53 +0000 (0:00:00.441)       0:05:54.883 *********
2026-08-14 08:54:53.230185 | mon1 | changed: [osd1]
2026-08-14 08:54:53.230324 | mon1 |
2026-08-14 08:54:53.230586 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-14 08:54:53.230607 | mon1 | Friday 14 August 2026  08:54:53 +0000 (0:00:00.222)       0:05:55.105 *********
2026-08-14 08:54:53.452729 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-14 08:54:53.452937 | mon1 |
2026-08-14 08:54:53.452950 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-14 08:54:53.452956 | mon1 | Friday 14 August 2026  08:54:53 +0000 (0:00:00.222)       0:05:55.327 *********
2026-08-14 08:54:53.501430 | mon1 | ok: [osd1]
2026-08-14 08:54:53.501465 | mon1 |
2026-08-14 08:54:53.501470 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:54:53.501475 | mon1 | Friday 14 August 2026  08:54:53 +0000 (0:00:00.048)       0:05:55.376 *********
2026-08-14 08:54:53.557601 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-14 08:54:53.557637 | mon1 |
2026-08-14 08:54:53.557643 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:54:53.557647 | mon1 | Friday 14 August 2026  08:54:53 +0000 (0:00:00.056)       0:05:55.432 *********
2026-08-14 08:54:55.481023 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:54:55.481116 | mon1 |
2026-08-14 08:54:55.481418 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:54:55.481470 | mon1 | Friday 14 August 2026  08:54:55 +0000 (0:00:01.923)       0:05:57.356 *********
2026-08-14 08:54:55.524732 | mon1 | ok: [osd1] => (item=osd1)
2026-08-14 08:54:55.524810 | mon1 |
2026-08-14 08:54:55.525139 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:54:55.525188 | mon1 | Friday 14 August 2026  08:54:55 +0000 (0:00:00.043)       0:05:57.400 *********
2026-08-14 08:54:55.813891 | mon1 | changed: [osd1]
2026-08-14 08:54:55.813964 | mon1 |
2026-08-14 08:54:55.814403 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:54:55.814473 | mon1 | Friday 14 August 2026  08:54:55 +0000 (0:00:00.289)       0:05:57.689 *********
2026-08-14 08:55:01.999259 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:55:01.999329 | mon1 |
2026-08-14 08:55:01.999524 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-14 08:55:01.999539 | mon1 | Friday 14 August 2026  08:55:01 +0000 (0:00:06.185)       0:06:03.874 *********
2026-08-14 08:55:02.664121 | mon1 | ok: [osd1]
2026-08-14 08:55:02.664192 | mon1 |
2026-08-14 08:55:02.664257 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-14 08:55:02.664389 | mon1 | Friday 14 August 2026  08:55:02 +0000 (0:00:00.664)       0:06:04.539 *********
2026-08-14 08:56:11.945340 | mon1 | ok: [osd1]
2026-08-14 08:56:11.945425 | mon1 |
2026-08-14 08:56:11.945438 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-14 08:56:11.945537 | mon1 | Friday 14 August 2026  08:56:11 +0000 (0:01:09.280)       0:07:13.820 *********
2026-08-14 08:59:55.409256 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-08-14 08:59:55.409355 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-08-14 08:59:55.409403 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-08-14 08:59:55.409857 | mon1 |
2026-08-14 08:59:55.409907 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-14 08:59:55.409916 | mon1 | Friday 14 August 2026  08:59:55 +0000 (0:03:43.463)       0:10:57.283 *********
2026-08-14 09:00:06.461545 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 09:00:06.461642 | mon1 |
2026-08-14 09:00:06.461911 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-14 09:00:06.461967 | mon1 | Friday 14 August 2026  09:00:06 +0000 (0:00:11.052)       0:11:08.336 *********
2026-08-14 09:00:08.974515 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 09:00:08.974655 | mon1 |
2026-08-14 09:00:08.974867 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-14 09:00:08.975065 | mon1 | Friday 14 August 2026  09:00:08 +0000 (0:00:02.512)       0:11:10.849 *********
2026-08-14 09:00:09.025506 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-14 09:00:09.025838 | mon1 |
2026-08-14 09:00:09.026068 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-14 09:00:09.026346 | mon1 | Friday 14 August 2026  09:00:09 +0000 (0:00:00.051)       0:11:10.900 *********
2026-08-14 09:00:09.065281 | mon1 | ok: [osd1]
2026-08-14 09:00:09.065479 | mon1 |
2026-08-14 09:00:09.065721 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-14 09:00:09.065945 | mon1 | Friday 14 August 2026  09:00:09 +0000 (0:00:00.039)       0:11:10.940 *********
2026-08-14 09:00:10.810762 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 09:00:10.810959 | mon1 |
2026-08-14 09:00:10.811250 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-14 09:00:10.811576 | mon1 | Friday 14 August 2026  09:00:10 +0000 (0:00:01.745)       0:11:12.685 *********
2026-08-14 09:00:10.853091 | mon1 | ok: [osd1]
2026-08-14 09:00:10.853184 | mon1 |
2026-08-14 09:00:10.853338 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-14 09:00:10.853523 | mon1 | Friday 14 August 2026  09:00:10 +0000 (0:00:00.042)       0:11:12.728 *********
2026-08-14 09:00:10.889253 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 09:00:10.889528 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 09:00:10.889705 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 09:00:10.890038 | mon1 | skipping: [osd1]
2026-08-14 09:00:10.890338 | mon1 |
2026-08-14 09:00:10.890575 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-14 09:00:10.890899 | mon1 | Friday 14 August 2026  09:00:10 +0000 (0:00:00.035)       0:11:12.764 *********
2026-08-14 09:00:10.946461 | mon1 | skipping: [osd1]
2026-08-14 09:00:10.947875 | mon1 |
2026-08-14 09:00:10.947919 | mon1 | PLAY [Upgrade check] ***********************************************************
2026-08-14 09:00:10.947945 | mon1 |
2026-08-14 09:00:10.947957 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 09:00:10.947967 | mon1 | Friday 14 August 2026  09:00:10 +0000 (0:00:00.057)       0:11:12.821 *********
2026-08-14 09:00:11.863835 | mon1 | ok: [mon1]
2026-08-14 09:00:11.863905 | mon1 |
2026-08-14 09:00:11.864067 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 09:00:11.864177 | mon1 | Friday 14 August 2026  09:00:11 +0000 (0:00:00.917)       0:11:13.739 *********
2026-08-14 09:00:12.080615 | mon1 | ok: [mon1]
2026-08-14 09:00:12.080738 | mon1 |
2026-08-14 09:00:12.080936 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 09:00:12.081176 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.216)       0:11:13.955 *********
2026-08-14 09:00:12.117973 | mon1 | skipping: [mon1]
2026-08-14 09:00:12.118064 | mon1 |
2026-08-14 09:00:12.118336 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 09:00:12.118532 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.037)       0:11:13.993 *********
2026-08-14 09:00:12.338587 | mon1 | ok: [mon1]
2026-08-14 09:00:12.338756 | mon1 |
2026-08-14 09:00:12.339053 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 09:00:12.339301 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.220)       0:11:14.213 *********
2026-08-14 09:00:12.403957 | mon1 | ok: [mon1] => {
2026-08-14 09:00:12.404083 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 09:00:12.404217 | mon1 | }
2026-08-14 09:00:12.404370 | mon1 |
2026-08-14 09:00:12.404559 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 09:00:12.404771 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.065)       0:11:14.278 *********
2026-08-14 09:00:12.720686 | mon1 | ok: [mon1]
2026-08-14 09:00:12.720753 | mon1 |
2026-08-14 09:00:12.720841 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 09:00:12.720956 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.316)       0:11:14.595 *********
2026-08-14 09:00:12.761192 | mon1 | skipping: [mon1]
2026-08-14 09:00:12.761429 | mon1 |
2026-08-14 09:00:12.761689 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 09:00:12.761933 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.040)       0:11:14.636 *********
2026-08-14 09:00:12.798922 | mon1 | skipping: [mon1]
2026-08-14 09:00:12.799131 | mon1 |
2026-08-14 09:00:12.799431 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 09:00:12.799661 | mon1 | Friday 14 August 2026  09:00:12 +0000 (0:00:00.037)       0:11:14.673 *********
2026-08-14 09:00:13.028359 | mon1 | ok: [mon1]
2026-08-14 09:00:13.028425 | mon1 |
2026-08-14 09:00:13.028441 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 09:00:13.028455 | mon1 | Friday 14 August 2026  09:00:13 +0000 (0:00:00.228)       0:11:14.902 *********
2026-08-14 09:00:14.228795 | mon1 | ok: [mon1]
2026-08-14 09:00:14.228914 | mon1 |
2026-08-14 09:00:14.228927 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 09:00:14.229000 | mon1 | Friday 14 August 2026  09:00:14 +0000 (0:00:01.201)       0:11:16.104 *********
2026-08-14 09:00:14.304333 | mon1 | ok: [mon1] => {
2026-08-14 09:00:14.304403 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 09:00:14.304416 | mon1 | }
2026-08-14 09:00:14.304426 | mon1 |
2026-08-14 09:00:14.304437 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 09:00:14.304447 | mon1 | Friday 14 August 2026  09:00:14 +0000 (0:00:00.072)       0:11:16.176 *********
2026-08-14 09:00:14.675770 | mon1 | ok: [mon1]
2026-08-14 09:00:14.675886 | mon1 |
2026-08-14 09:00:14.676188 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 09:00:14.676247 | mon1 | Friday 14 August 2026  09:00:14 +0000 (0:00:00.373)       0:11:16.550 *********
2026-08-14 09:00:16.711337 | mon1 | ok: [mon1]
2026-08-14 09:00:16.711446 | mon1 |
2026-08-14 09:00:16.711462 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 09:00:16.711620 | mon1 | Friday 14 August 2026  09:00:16 +0000 (0:00:02.035)       0:11:18.586 *********
2026-08-14 09:00:16.743657 | mon1 | skipping: [mon1]
2026-08-14 09:00:16.743725 | mon1 |
2026-08-14 09:00:16.744000 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 09:00:16.744073 | mon1 | Friday 14 August 2026  09:00:16 +0000 (0:00:00.031)       0:11:18.618 *********
2026-08-14 09:00:16.774558 | mon1 | skipping: [mon1]
2026-08-14 09:00:16.774688 | mon1 |
2026-08-14 09:00:16.774700 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 09:00:16.774842 | mon1 | Friday 14 August 2026  09:00:16 +0000 (0:00:00.030)       0:11:18.649 *********
2026-08-14 09:00:16.805631 | mon1 | skipping: [mon1]
2026-08-14 09:00:16.805718 | mon1 |
2026-08-14 09:00:16.805975 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 09:00:16.806020 | mon1 | Friday 14 August 2026  09:00:16 +0000 (0:00:00.031)       0:11:18.680 *********
2026-08-14 09:00:18.100743 | mon1 | ok: [mon1]
2026-08-14 09:00:18.101295 | mon1 |
2026-08-14 09:00:18.101343 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 09:00:18.101352 | mon1 | Friday 14 August 2026  09:00:18 +0000 (0:00:01.295)       0:11:19.975 *********
2026-08-14 09:00:18.559162 | mon1 | ok: [mon1]
2026-08-14 09:00:18.559238 | mon1 |
2026-08-14 09:00:18.559609 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 09:00:18.559658 | mon1 | Friday 14 August 2026  09:00:18 +0000 (0:00:00.458)       0:11:20.434 *********
2026-08-14 09:00:19.543781 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-14 09:00:19.543873 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 09:00:19.544515 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 09:00:19.544535 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 09:00:19.544541 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 09:00:19.544547 | mon1 |
2026-08-14 09:00:19.544552 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 09:00:19.544557 | mon1 | Friday 14 August 2026  09:00:19 +0000 (0:00:00.984)       0:11:21.418 *********
2026-08-14 09:00:20.061221 | mon1 | ok: [mon1]
2026-08-14 09:00:20.061288 | mon1 |
2026-08-14 09:00:20.061379 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 09:00:20.061785 | mon1 | Friday 14 August 2026  09:00:20 +0000 (0:00:00.513)       0:11:21.932 *********
2026-08-14 09:00:20.061828 | mon1 |
2026-08-14 09:00:20.061834 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 09:00:20.061838 | mon1 | Friday 14 August 2026  09:00:20 +0000 (0:00:00.004)       0:11:21.936 *********
2026-08-14 09:00:20.445944 | mon1 | ok: [mon1]
2026-08-14 09:00:20.446066 | mon1 |
2026-08-14 09:00:20.446359 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 09:00:20.446455 | mon1 | Friday 14 August 2026  09:00:20 +0000 (0:00:00.384)       0:11:22.321 *********
2026-08-14 09:00:20.639776 | mon1 | ok: [mon1]
2026-08-14 09:00:20.640014 | mon1 |
2026-08-14 09:00:20.640027 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 09:00:20.640037 | mon1 | Friday 14 August 2026  09:00:20 +0000 (0:00:00.192)       0:11:22.514 *********
2026-08-14 09:00:20.693824 | mon1 | ok: [mon1] => {
2026-08-14 09:00:20.693942 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 09:00:20.694361 | mon1 | }
2026-08-14 09:00:20.694422 | mon1 |
2026-08-14 09:00:20.694436 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 09:00:20.694536 | mon1 | Friday 14 August 2026  09:00:20 +0000 (0:00:00.054)       0:11:22.568 *********
2026-08-14 09:00:21.079515 | mon1 | ok: [mon1]
2026-08-14 09:00:21.079595 | mon1 |
2026-08-14 09:00:21.079935 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 09:00:21.079961 | mon1 | Friday 14 August 2026  09:00:21 +0000 (0:00:00.385)       0:11:22.954 *********
2026-08-14 09:00:24.396106 | mon1 | ok: [mon1]
2026-08-14 09:00:24.396188 | mon1 |
2026-08-14 09:00:24.396500 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 09:00:24.396552 | mon1 | Friday 14 August 2026  09:00:24 +0000 (0:00:03.316)       0:11:26.271 *********
2026-08-14 09:00:25.586103 | mon1 | ok: [mon1]
2026-08-14 09:00:25.586198 | mon1 |
2026-08-14 09:00:25.586415 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 09:00:25.586582 | mon1 | Friday 14 August 2026  09:00:25 +0000 (0:00:01.189)       0:11:27.461 *********
2026-08-14 09:00:25.787824 | mon1 | ok: [mon1]
2026-08-14 09:00:25.788038 | mon1 |
2026-08-14 09:00:25.788287 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 09:00:25.788511 | mon1 | Friday 14 August 2026  09:00:25 +0000 (0:00:00.201)       0:11:27.662 *********
2026-08-14 09:00:26.215883 | mon1 | ok: [mon1]
2026-08-14 09:00:26.216078 | mon1 |
2026-08-14 09:00:26.216341 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 09:00:26.216576 | mon1 | Friday 14 August 2026  09:00:26 +0000 (0:00:00.428)       0:11:28.091 *********
2026-08-14 09:00:26.851512 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-14 09:00:26.851724 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 09:00:26.851961 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 09:00:26.852168 | mon1 |
2026-08-14 09:00:26.852532 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 09:00:26.852892 | mon1 | Friday 14 August 2026  09:00:26 +0000 (0:00:00.635)       0:11:28.726 *********
2026-08-14 09:00:27.304651 | mon1 | ok: [mon1]
2026-08-14 09:00:27.304794 | mon1 |
2026-08-14 09:00:27.304994 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 09:00:27.305185 | mon1 | Friday 14 August 2026  09:00:27 +0000 (0:00:00.453)       0:11:29.179 *********
2026-08-14 09:00:27.779609 | mon1 | ok: [mon1]
2026-08-14 09:00:27.779849 | mon1 |
2026-08-14 09:00:27.780131 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 09:00:27.780319 | mon1 | Friday 14 August 2026  09:00:27 +0000 (0:00:00.468)       0:11:29.648 *********
2026-08-14 09:00:27.780452 | mon1 |
2026-08-14 09:00:27.780645 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 09:00:27.780803 | mon1 | Friday 14 August 2026  09:00:27 +0000 (0:00:00.006)       0:11:29.654 *********
2026-08-14 09:00:28.162160 | mon1 | ok: [mon1]
2026-08-14 09:00:28.162263 | mon1 |
2026-08-14 09:00:28.162279 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 09:00:28.162291 | mon1 | Friday 14 August 2026  09:00:28 +0000 (0:00:00.381)       0:11:30.036 *********
2026-08-14 09:00:28.206598 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-14 09:00:28.207059 | mon1 |
2026-08-14 09:00:28.207112 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 09:00:28.207120 | mon1 | Friday 14 August 2026  09:00:28 +0000 (0:00:00.045)       0:11:30.081 *********
2026-08-14 09:00:29.302499 | mon1 | ok: [mon1]
2026-08-14 09:00:29.302575 | mon1 |
2026-08-14 09:00:29.302794 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 09:00:29.302839 | mon1 | Friday 14 August 2026  09:00:29 +0000 (0:00:01.096)       0:11:31.177 *********
2026-08-14 09:00:29.947258 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-14 09:00:29.947347 | mon1 | ok: [mon1] => (item=sshd)
2026-08-14 09:00:29.947677 | mon1 |
2026-08-14 09:00:29.947719 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 09:00:29.947726 | mon1 | Friday 14 August 2026  09:00:29 +0000 (0:00:00.644)       0:11:31.822 *********
2026-08-14 09:00:30.273542 | mon1 | ok: [mon1]
2026-08-14 09:00:30.273987 | mon1 |
2026-08-14 09:00:30.274171 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 09:00:30.274180 | mon1 | Friday 14 August 2026  09:00:30 +0000 (0:00:00.326)       0:11:32.148 *********
2026-08-14 09:00:30.480662 | mon1 | ok: [mon1]
2026-08-14 09:00:30.486348 | mon1 |
2026-08-14 09:00:30.486382 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 09:00:30.486392 | mon1 | Friday 14 August 2026  09:00:30 +0000 (0:00:00.207)       0:11:32.356 *********
2026-08-14 09:00:30.787032 | mon1 | ok: [mon1]
2026-08-14 09:00:30.787126 | mon1 |
2026-08-14 09:00:30.787133 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 09:00:30.787140 | mon1 | Friday 14 August 2026  09:00:30 +0000 (0:00:00.305)       0:11:32.661 *********
2026-08-14 09:00:31.139285 | mon1 | ok: [mon1]
2026-08-14 09:00:31.139407 | mon1 |
2026-08-14 09:00:31.139699 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] **************************
2026-08-14 09:00:31.139758 | mon1 | Friday 14 August 2026  09:00:31 +0000 (0:00:00.352)       0:11:33.014 *********
2026-08-14 09:00:45.473786 | mon1 | ok: [mon1]
2026-08-14 09:00:45.474050 | mon1 |
2026-08-14 09:00:45.474127 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] *********************
2026-08-14 09:00:45.474254 | mon1 | Friday 14 August 2026  09:00:45 +0000 (0:00:14.334)       0:11:47.349 *********
2026-08-14 09:00:45.501780 | mon1 | fatal: [mon1]: FAILED! => {"msg": "The task includes an option with an undefined variable.. 'ceph_version' is undefined\n\nThe error appears to be in '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/upgrade_check/tasks/main.yml': line 21, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Check upgrade version\n  ^ here\n"}
2026-08-14 09:00:45.508804 | mon1 |
2026-08-14 09:00:45.509035 | mon1 | PLAY RECAP *********************************************************************
2026-08-14 09:00:45.509908 | mon1 | mon1                       : ok=93   changed=29   unreachable=0    failed=1    skipped=14   rescued=0    ignored=0
2026-08-14 09:00:45.509969 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-08-14 09:00:45.509982 | mon1 |
2026-08-14 09:00:45.510030 | mon1 |
2026-08-14 09:00:45.514340 | mon1 | TASKS RECAP ********************************************************************
2026-08-14 09:00:45.514443 | mon1 | Friday 14 August 2026  09:00:45 +0000 (0:00:00.034)       0:11:47.383 *********
2026-08-14 09:00:45.514454 | mon1 | ===============================================================================
2026-08-14 09:00:45.514464 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 223.46s
2026-08-14 09:00:45.514473 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 140.75s
2026-08-14 09:00:45.514482 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 69.28s
2026-08-14 09:00:45.514492 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 54.62s
2026-08-14 09:00:45.514501 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 47.12s
2026-08-14 09:00:45.514509 | mon1 | vexxhost.ceph.mgr : Configure manager modules -------------------------- 16.02s
2026-08-14 09:00:45.514518 | mon1 | vexxhost.ceph.upgrade_check : Get ceph version ------------------------- 14.33s
2026-08-14 09:00:45.514527 | mon1 | vexxhost.ceph.osd : Get mon dump --------------------------------------- 11.05s
2026-08-14 09:00:45.514536 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.49s
2026-08-14 09:00:45.514544 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.19s
2026-08-14 09:00:45.514553 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 5.95s
2026-08-14 09:00:45.514562 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 4.85s
2026-08-14 09:00:45.514571 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 4.58s
2026-08-14 09:00:45.514580 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.54s
2026-08-14 09:00:45.514589 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.47s
2026-08-14 09:00:45.514608 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 4.43s
2026-08-14 09:00:45.514739 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 4.19s
2026-08-14 09:00:45.515081 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 4.09s
2026-08-14 09:00:45.515387 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.32s
2026-08-14 09:00:45.515672 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.22s
2026-08-14 09:00:45.618132 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 09:00:45.618478 | mon1 | ERROR    [default > converge] Executed: Failed
2026-08-14 09:00:45.618720 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 09:00:55.784691 | mon1 | ERROR
2026-08-14 09:00:58.422711 | mon1 | {
2026-08-14 09:00:58.422901 | mon1 |   "delta": "0:14:39.251449",
2026-08-14 09:00:58.422999 | mon1 |   "end": "2026-08-14 09:00:45.695700",
2026-08-14 09:00:58.423058 | mon1 |   "msg": "non-zero return code",
2026-08-14 09:00:58.423101 | mon1 |   "rc": 2,
2026-08-14 09:00:58.423141 | mon1 |   "start": "2026-08-14 08:46:06.444251"
2026-08-14 09:00:58.423181 | mon1 | }
failure
2026-08-14 09:00:58.753705 | 
2026-08-14 09:00:58.753879 | PLAY RECAP
2026-08-14 09:00:58.753973 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-14 09:00:58.754023 | 
2026-08-14 09:00:58.996018 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-14 09:00:58.999346 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-14 09:01:00.074190 | 
2026-08-14 09:01:00.074344 | PLAY [all]
2026-08-14 09:01:00.172668 | 
2026-08-14 09:01:00.172979 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-14 09:01:00.240180 | mon1 | ok
2026-08-14 09:01:00.245386 | osd1 | ok
2026-08-14 09:01:00.250090 | 
2026-08-14 09:01:00.250174 | TASK [fetch-output : Set log path for single node]
2026-08-14 09:01:00.276868 | mon1 | skipping: Conditional result was False
2026-08-14 09:01:00.288317 | osd1 | skipping: Conditional result was False
2026-08-14 09:01:00.299429 | 
2026-08-14 09:01:00.299542 | LOOP [fetch-output : Ensure local output dirs]
2026-08-14 09:01:00.818973 | mon1 -> localhost | changed: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/logs/mon1"
2026-08-14 09:01:00.840780 | osd1 -> localhost | changed: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/logs/osd1"
2026-08-14 09:01:01.063322 | osd1 -> localhost | changed: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/artifacts"
2026-08-14 09:01:01.092068 | mon1 -> localhost | ok: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/artifacts"
2026-08-14 09:01:01.773574 | mon1 -> localhost | ok: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/docs"
2026-08-14 09:01:01.775757 | osd1 -> localhost | changed: "/var/lib/zuul/builds/451317d567184a33b4185fc6e944e7ef/work/docs"
2026-08-14 09:01:01.795751 | 
2026-08-14 09:01:01.795855 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-14 09:01:02.652455 | osd1 | changed: .d..t...... ./
2026-08-14 09:01:02.652747 | osd1 | changed: All items complete
2026-08-14 09:01:02.652790 | 
2026-08-14 09:01:02.659334 | mon1 | changed: .d..t...... ./
2026-08-14 09:01:03.136980 | mon1 | changed: .d..t...... ./
2026-08-14 09:01:03.143368 | osd1 | ok
2026-08-14 09:01:03.624365 | mon1 | changed: .d..t...... ./
2026-08-14 09:01:03.645639 | osd1 | ok
2026-08-14 09:01:03.674114 | 
2026-08-14 09:01:03.674273 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-14 09:01:04.158625 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.009747
2026-08-14 09:01:04.158931 | mon1 -> localhost | changed: All items complete
2026-08-14 09:01:04.158980 | 
2026-08-14 09:01:04.390938 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007449
2026-08-14 09:01:04.415832 | 
2026-08-14 09:01:04.415968 | PLAY [all]
2026-08-14 09:01:04.423643 | 
2026-08-14 09:01:04.423723 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-14 09:01:04.967055 | mon1 | changed
2026-08-14 09:01:05.098852 | osd1 | changed
2026-08-14 09:01:05.118745 | 
2026-08-14 09:01:05.118980 | PLAY RECAP
2026-08-14 09:01:05.119080 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-14 09:01:05.119121 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-14 09:01:05.119185 | 
2026-08-14 09:01:05.331925 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-14 09:01:05.339038 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-14 09:01:06.053027 | 
2026-08-14 09:01:06.053188 | PLAY [localhost]
2026-08-14 09:01:06.064622 | 
2026-08-14 09:01:06.064747 | TASK [Generate Zuul manifest]
2026-08-14 09:01:06.087075 | localhost | ok
2026-08-14 09:01:06.389428 | 
2026-08-14 09:01:06.559391 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-14 09:01:07.226483 | localhost | changed
2026-08-14 09:01:07.238550 | 
2026-08-14 09:01:07.238660 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-14 09:01:07.270974 | localhost | ok
2026-08-14 09:01:07.278542 | 
2026-08-14 09:01:07.278611 | TASK [Upload logs]
2026-08-14 09:01:07.300065 | localhost | ok
2026-08-14 09:01:07.726343 | 
2026-08-14 09:01:07.726513 | TASK [Set zuul-log-path fact]
2026-08-14 09:01:07.750014 | localhost | ok
2026-08-14 09:01:08.034280 | 
2026-08-14 09:01:08.034459 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-14 09:01:08.068020 | localhost | ok
2026-08-14 09:01:08.075361 | 
2026-08-14 09:01:08.075505 | TASK [upload-logs : Create log directories]
2026-08-14 09:01:08.552426 | localhost | changed
2026-08-14 09:01:08.559194 | 
2026-08-14 09:01:08.559326 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-14 09:01:08.988129 | localhost -> localhost | ok: Runtime: 0:00:00.005724
2026-08-14 09:01:08.995174 | 
2026-08-14 09:01:08.995243 | TASK [upload-logs : Upload logs to log server]
2026-08-14 09:01:10.334878 | localhost | Output suppressed because no_log was given
2026-08-14 09:01:10.340081 | 
2026-08-14 09:01:10.340173 | LOOP [upload-logs : Compress console log and json output]
2026-08-14 09:01:10.433226 | localhost | skipping: Conditional result was False
2026-08-14 09:01:10.440532 | localhost | skipping: Conditional result was False
2026-08-14 09:01:10.457366 | 
2026-08-14 09:01:10.457535 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-14 09:01:10.543143 | localhost | skipping: Conditional result was False
2026-08-14 09:01:10.543519 | 
2026-08-14 09:01:10.547767 | localhost | skipping: Conditional result was False
2026-08-14 09:01:10.605478 | 
2026-08-14 09:01:10.605893 | LOOP [upload-logs : Upload console log and json output]