2026-08-14 08:43:57.222496 | Job console starting
2026-08-14 08:43:57.237915 | Updating git repos
2026-08-14 08:43:57.269987 | Cloning repos into workspace
2026-08-14 08:44:19.894973 | Restoring repo states
2026-08-14 08:44:19.904574 | Merging changes
2026-08-14 08:44:33.772496 | Checking out repos
2026-08-14 08:44:38.746203 | Preparing playbooks
2026-08-14 08:45:25.932385 | Running Ansible setup
2026-08-14 08:45:37.547066 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-14 08:45:38.249900 | 
2026-08-14 08:45:38.766060 | PLAY [localhost]
2026-08-14 08:45:38.786764 | 
2026-08-14 08:45:38.786929 | TASK [Gathering Facts]
2026-08-14 08:45:39.921604 | localhost | ok
2026-08-14 08:45:39.936130 | 
2026-08-14 08:45:39.940076 | TASK [Setup log path fact]
2026-08-14 08:45:39.963748 | localhost | ok
2026-08-14 08:45:39.975896 | 
2026-08-14 08:45:39.975966 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-14 08:45:40.009765 | localhost | ok
2026-08-14 08:45:40.018334 | 
2026-08-14 08:45:40.018416 | TASK [emit-job-header : Print job information]
2026-08-14 08:45:40.061959 | # Job Information
2026-08-14 08:45:40.062173 | Ansible Version: 2.16.18
2026-08-14 08:45:40.062228 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-14 08:45:40.062274 | Pipeline: check
2026-08-14 08:45:40.062305 | Executor: 2d72f0692154
2026-08-14 08:45:40.062359 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/42
2026-08-14 08:45:40.062435 | Event ID: 79328020-97ba-11f1-889f-efc7e8d733b6
2026-08-14 08:45:40.066467 | 
2026-08-14 08:45:40.066565 | LOOP [emit-job-header : Print node information]
2026-08-14 08:45:40.167643 | localhost | ok:
2026-08-14 08:45:40.168000 | localhost | # Node Information
2026-08-14 08:45:40.168072 | localhost | Inventory Hostname: mon1
2026-08-14 08:45:40.168128 | localhost | Hostname: np0000189596
2026-08-14 08:45:40.168180 | localhost | Username: zuul
2026-08-14 08:45:40.168232 | localhost | Distro: Ubuntu 24.04
2026-08-14 08:45:40.168269 | localhost | Provider: yul1
2026-08-14 08:45:40.168303 | localhost | Region: ca-ymq-1
2026-08-14 08:45:40.168330 | localhost | Label: ubuntu-noble
2026-08-14 08:45:40.168357 | localhost | Product Name: OpenStack Nova
2026-08-14 08:45:40.168397 | localhost | Interface IP: 199.19.213.241
2026-08-14 08:45:40.221873 | localhost | ok:
2026-08-14 08:45:40.222027 | localhost | # Node Information
2026-08-14 08:45:40.222148 | localhost | Inventory Hostname: osd1
2026-08-14 08:45:40.222201 | localhost | Hostname: np0000189597
2026-08-14 08:45:40.222246 | localhost | Username: zuul
2026-08-14 08:45:40.222289 | localhost | Distro: Ubuntu 24.04
2026-08-14 08:45:40.222332 | localhost | Provider: yul1
2026-08-14 08:45:40.222374 | localhost | Region: ca-ymq-1
2026-08-14 08:45:40.222415 | localhost | Label: ubuntu-noble
2026-08-14 08:45:40.222458 | localhost | Product Name: OpenStack Nova
2026-08-14 08:45:40.222501 | localhost | Interface IP: 199.19.213.20
2026-08-14 08:45:40.239986 | 
2026-08-14 08:45:40.240085 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-14 08:45:40.658312 | localhost -> localhost | changed
2026-08-14 08:45:40.675777 | 
2026-08-14 08:45:40.676181 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-14 08:45:41.714386 | localhost -> localhost | changed
2026-08-14 08:45:41.730387 | 
2026-08-14 08:45:41.730503 | PLAY [all]
2026-08-14 08:45:41.749030 | 
2026-08-14 08:45:41.749180 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-14 08:45:42.578126 | mon1 -> localhost | ok
2026-08-14 08:45:42.596451 | 
2026-08-14 08:45:42.596617 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-14 08:45:42.630028 | mon1 | ok
2026-08-14 08:45:42.634917 | osd1 | ok
2026-08-14 08:45:42.652698 | mon1 | included: /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-14 08:45:42.652753 | osd1 | included: /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-14 08:45:42.659099 | 
2026-08-14 08:45:42.659157 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-14 08:45:43.734861 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-14 08:45:43.735054 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/587887a598ee4cd79e08dea0eae4b2cb_id_rsa
2026-08-14 08:45:43.735085 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/587887a598ee4cd79e08dea0eae4b2cb_id_rsa.pub
2026-08-14 08:45:43.735109 | mon1 -> localhost | The key fingerprint is:
2026-08-14 08:45:43.735130 | mon1 -> localhost | SHA256:eXFfZJnXYiIm8gHYa4BUZZ6z25ytgUbSMPzxJcrAOQw zuul-build-sshkey
2026-08-14 08:45:43.735151 | mon1 -> localhost | The key's randomart image is:
2026-08-14 08:45:43.735171 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-14 08:45:43.735190 | mon1 -> localhost | | .Eo.++.        *|
2026-08-14 08:45:43.735211 | mon1 -> localhost | |  .=o+o.o o . o=o|
2026-08-14 08:45:43.735230 | mon1 -> localhost | |    X.=+.+o..o .o|
2026-08-14 08:45:43.735250 | mon1 -> localhost | |     Oo*.+ o . . |
2026-08-14 08:45:43.735269 | mon1 -> localhost | |    ..B S .   .  |
2026-08-14 08:45:43.735288 | mon1 -> localhost | |     o = +       |
2026-08-14 08:45:43.735307 | mon1 -> localhost | |      + = .      |
2026-08-14 08:45:43.735325 | mon1 -> localhost | |     .   o       |
2026-08-14 08:45:43.735344 | mon1 -> localhost | |        .        |
2026-08-14 08:45:43.735362 | mon1 -> localhost | +----[SHA256]-----+
2026-08-14 08:45:43.735421 | mon1 -> localhost | ok: Runtime: 0:00:00.567766
2026-08-14 08:45:43.742085 | 
2026-08-14 08:45:43.742148 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-14 08:45:43.779052 | mon1 | ok
2026-08-14 08:45:43.784491 | osd1 | ok
2026-08-14 08:45:43.799543 | mon1 | included: /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-14 08:45:43.799597 | osd1 | included: /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-14 08:45:43.811674 | 
2026-08-14 08:45:43.811747 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-14 08:45:43.840461 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:43.851666 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:43.863043 | 
2026-08-14 08:45:43.863149 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-14 08:45:44.430562 | mon1 | changed
2026-08-14 08:45:45.007877 | osd1 | changed
2026-08-14 08:45:45.017135 | 
2026-08-14 08:45:45.017228 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-14 08:45:45.242811 | mon1 | ok
2026-08-14 08:45:45.250527 | osd1 | ok
2026-08-14 08:45:45.256047 | 
2026-08-14 08:45:45.256113 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-14 08:45:45.822191 | mon1 | changed
2026-08-14 08:45:45.910116 | osd1 | changed
2026-08-14 08:45:45.917574 | 
2026-08-14 08:45:45.917680 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-14 08:45:46.489081 | mon1 | changed
2026-08-14 08:45:46.507163 | osd1 | changed
2026-08-14 08:45:46.514479 | 
2026-08-14 08:45:46.514547 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-14 08:45:46.540683 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:46.552350 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:46.564064 | 
2026-08-14 08:45:46.564136 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-14 08:45:47.187484 | mon1 -> localhost | changed
2026-08-14 08:45:47.208587 | 
2026-08-14 08:45:47.208713 | TASK [add-build-sshkey : Add back temp key]
2026-08-14 08:45:47.528197 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/587887a598ee4cd79e08dea0eae4b2cb_id_rsa (zuul-build-sshkey)
2026-08-14 08:45:47.528453 | mon1 -> localhost | ok: Runtime: 0:00:00.015533
2026-08-14 08:45:47.534557 | 
2026-08-14 08:45:47.534636 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-14 08:45:47.848425 | osd1 | ok
2026-08-14 08:45:47.855813 | mon1 | ok
2026-08-14 08:45:47.860930 | 
2026-08-14 08:45:47.861016 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-14 08:45:47.886647 | mon1 | skipping: Conditional result was False
2026-08-14 08:45:47.897815 | osd1 | skipping: Conditional result was False
2026-08-14 08:45:47.921119 | 
2026-08-14 08:45:47.921200 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-14 08:45:48.243677 | osd1 | ok
2026-08-14 08:45:48.259589 | mon1 | ok
2026-08-14 08:45:48.266359 | 
2026-08-14 08:45:48.266426 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-14 08:45:49.101482 | mon1 | Output suppressed because no_log was given
2026-08-14 08:45:49.107377 | osd1 | Output suppressed because no_log was given
2026-08-14 08:45:49.122837 | 
2026-08-14 08:45:49.124417 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-14 08:45:49.358625 | osd1 | ok: "logs"
2026-08-14 08:45:49.358956 | osd1 | ok: All items complete
2026-08-14 08:45:49.358992 | 
2026-08-14 08:45:49.364011 | mon1 | ok: "logs"
2026-08-14 08:45:49.562797 | mon1 | ok: "artifacts"
2026-08-14 08:45:49.567980 | osd1 | ok: "artifacts"
2026-08-14 08:45:49.771727 | mon1 | ok: "docs"
2026-08-14 08:45:49.791090 | osd1 | ok: "docs"
2026-08-14 08:45:49.806314 | 
2026-08-14 08:45:49.806487 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-14 08:45:50.078559 | mon1 | changed: "logs"
2026-08-14 08:45:50.079542 | mon1 | ok: All items complete
2026-08-14 08:45:50.079601 | 
2026-08-14 08:45:50.102152 | osd1 | changed: "logs"
2026-08-14 08:45:50.285731 | osd1 | changed: "artifacts"
2026-08-14 08:45:50.320102 | mon1 | changed: "artifacts"
2026-08-14 08:45:50.486750 | osd1 | changed: "docs"
2026-08-14 08:45:50.507015 | mon1 | changed: "docs"
2026-08-14 08:45:50.537664 | 
2026-08-14 08:45:50.537802 | PLAY RECAP
2026-08-14 08:45:50.537852 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:50.537952 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-14 08:45:50.538004 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-14 08:45:50.538037 | 
2026-08-14 08:45:50.718966 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-14 08:45:50.723005 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-14 08:45:51.480723 | 
2026-08-14 08:45:51.480867 | PLAY [all]
2026-08-14 08:45:51.496898 | 
2026-08-14 08:45:51.497013 | TASK [setup-uv : Extract archive]
2026-08-14 08:45:53.997955 | osd1 | changed
2026-08-14 08:45:54.076601 | mon1 | changed
2026-08-14 08:45:54.084059 | 
2026-08-14 08:45:54.084169 | TASK [setup-uv : Print version]
2026-08-14 08:45:54.811912 | osd1 | uv 0.8.13
2026-08-14 08:45:54.792888 | mon1 | uv 0.8.13
2026-08-14 08:45:55.250497 | mon1 | ok: Runtime: 0:00:00.012953
2026-08-14 08:45:55.264819 | osd1 | ok: Runtime: 0:00:00.013526
2026-08-14 08:45:55.296361 | 
2026-08-14 08:45:55.296526 | TASK [Install Ansible collection siblings]
2026-08-14 08:45:56.804415 | mon1 | ok:
2026-08-14 08:45:56.804587 | mon1 | Skipping community.general: no checked-out sibling
2026-08-14 08:45:56.804616 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-14 08:45:56.804638 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-14 08:45:56.806562 | 
2026-08-14 08:45:56.806616 | PLAY RECAP
2026-08-14 08:45:56.806669 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:56.806714 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:45:56.806735 | 
2026-08-14 08:45:56.981187 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-14 08:45:56.986093 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-14 08:45:57.801637 | 
2026-08-14 08:45:57.801840 | PLAY [all]
2026-08-14 08:45:57.819375 | 
2026-08-14 08:45:57.819548 | LOOP [Check inventory directories]
2026-08-14 08:45:58.255200 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-14 08:45:58.473239 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-14 08:45:58.663387 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-14 08:45:58.683414 | 
2026-08-14 08:45:58.683647 | LOOP [Copy inventory file for Zuul]
2026-08-14 08:46:04.471749 | mon1 | changed:
2026-08-14 08:46:04.471949 | mon1 | {
2026-08-14 08:46:04.471977 | mon1 |   "ansible_loop_var": "item",
2026-08-14 08:46:04.472043 | mon1 |   "changed": false,
2026-08-14 08:46:04.472079 | mon1 |   "failed": false,
2026-08-14 08:46:04.472105 | mon1 |   "invocation": {
2026-08-14 08:46:04.472125 | mon1 |     "module_args": {
2026-08-14 08:46:04.472143 | mon1 |       "checksum_algorithm": "sha1",
2026-08-14 08:46:04.472161 | mon1 |       "follow": true,
2026-08-14 08:46:04.472178 | mon1 |       "get_attributes": true,
2026-08-14 08:46:04.472198 | mon1 |       "get_checksum": true,
2026-08-14 08:46:04.472215 | mon1 |       "get_mime": true,
2026-08-14 08:46:04.472233 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-14 08:46:04.472250 | mon1 |     }
2026-08-14 08:46:04.472267 | mon1 |   },
2026-08-14 08:46:04.472284 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-14 08:46:04.472300 | mon1 |   "stat": {
2026-08-14 08:46:04.472317 | mon1 |     "atime": 1786697148.9945545,
2026-08-14 08:46:04.472334 | mon1 |     "attr_flags": "e",
2026-08-14 08:46:04.472351 | mon1 |     "attributes": [
2026-08-14 08:46:04.472367 | mon1 |       "extents"
2026-08-14 08:46:04.472435 | mon1 |     ],
2026-08-14 08:46:04.472468 | mon1 |     "block_size": 4096,
2026-08-14 08:46:04.472488 | mon1 |     "blocks": 8,
2026-08-14 08:46:04.472507 | mon1 |     "charset": "unknown",
2026-08-14 08:46:04.472526 | mon1 |     "ctime": 1786697149.0045545,
2026-08-14 08:46:04.472543 | mon1 |     "dev": 64769,
2026-08-14 08:46:04.472560 | mon1 |     "device_type": 0,
2026-08-14 08:46:04.472576 | mon1 |     "executable": true,
2026-08-14 08:46:04.472593 | mon1 |     "exists": true,
2026-08-14 08:46:04.472609 | mon1 |     "gid": 1000,
2026-08-14 08:46:04.472626 | mon1 |     "gr_name": "zuul",
2026-08-14 08:46:04.472642 | mon1 |     "inode": 1034272,
2026-08-14 08:46:04.472658 | mon1 |     "isblk": false,
2026-08-14 08:46:04.472675 | mon1 |     "ischr": false,
2026-08-14 08:46:04.472691 | mon1 |     "isdir": true,
2026-08-14 08:46:04.472708 | mon1 |     "isfifo": false,
2026-08-14 08:46:04.472724 | mon1 |     "isgid": false,
2026-08-14 08:46:04.472740 | mon1 |     "islnk": false,
2026-08-14 08:46:04.472756 | mon1 |     "isreg": false,
2026-08-14 08:46:04.472772 | mon1 |     "issock": false,
2026-08-14 08:46:04.472788 | mon1 |     "isuid": false,
2026-08-14 08:46:04.472804 | mon1 |     "mimetype": "unknown",
2026-08-14 08:46:04.472821 | mon1 |     "mode": "0755",
2026-08-14 08:46:04.472837 | mon1 |     "mtime": 1786697066.6716926,
2026-08-14 08:46:04.472853 | mon1 |     "nlink": 10,
2026-08-14 08:46:04.472869 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-14 08:46:04.472885 | mon1 |     "pw_name": "zuul",
2026-08-14 08:46:04.472904 | mon1 |     "readable": true,
2026-08-14 08:46:04.472921 | mon1 |     "rgrp": true,
2026-08-14 08:46:04.472937 | mon1 |     "roth": true,
2026-08-14 08:46:04.473063 | mon1 |     "rusr": true,
2026-08-14 08:46:04.473085 | mon1 |     "size": 4096,
2026-08-14 08:46:04.473115 | mon1 |     "uid": 1000,
2026-08-14 08:46:04.473133 | mon1 |     "version": "1206943912",
2026-08-14 08:46:04.473150 | mon1 |     "wgrp": false,
2026-08-14 08:46:04.473168 | mon1 |     "woth": false,
2026-08-14 08:46:04.473185 | mon1 |     "writeable": true,
2026-08-14 08:46:04.473202 | mon1 |     "wusr": true,
2026-08-14 08:46:04.473218 | mon1 |     "xgrp": true,
2026-08-14 08:46:04.473234 | mon1 |     "xoth": true,
2026-08-14 08:46:04.473251 | mon1 |     "xusr": true
2026-08-14 08:46:04.473267 | mon1 |   }
2026-08-14 08:46:04.473284 | mon1 | }
2026-08-14 08:46:04.473318 | mon1 | ok: All items complete
2026-08-14 08:46:04.473339 | 
2026-08-14 08:46:04.475123 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:04.483926 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:04.495887 | 
2026-08-14 08:46:04.496118 | LOOP [Switch "ansible_host" to private IP]
2026-08-14 08:46:04.937742 | mon1 | changed: 2 replacements made
2026-08-14 08:46:04.939335 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:04.943407 | mon1 | skipping: Conditional result was False
2026-08-14 08:46:04.953303 | 
2026-08-14 08:46:04.953442 | TASK [Run Molecule scenario]
2026-08-14 08:46:05.996109 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-08-14 08:46:05.996237 | mon1 | Creating virtual environment at: .venv
2026-08-14 08:46:06.245979 | mon1 | Downloading pygments (1.2MiB)
2026-08-14 08:46:06.246614 | mon1 | Downloading ansible-core (2.1MiB)
2026-08-14 08:46:06.247704 | mon1 | Downloading cryptography (4.3MiB)
2026-08-14 08:46:06.248131 | mon1 | Downloading netaddr (2.2MiB)
2026-08-14 08:46:06.415809 | mon1 |  Downloading netaddr
2026-08-14 08:46:06.425116 | mon1 |  Downloading cryptography
2026-08-14 08:46:06.476307 | mon1 |  Downloading pygments
2026-08-14 08:46:06.596409 | mon1 |  Downloading ansible-core
2026-08-14 08:46:06.637206 | mon1 | Installed 37 packages in 40ms
2026-08-14 08:46:07.433139 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-14 08:46:07.433220 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-14 08:46:08.080052 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-14 08:46:08.080131 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-14 08:46:40.474262 | mon1 | INFO     [default > dependency] Executing
2026-08-14 08:46:40.474451 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-14 08:46:40.474674 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-14 08:46:40.474802 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-14 08:46:40.480719 | mon1 | INFO     [default > cleanup] Executing
2026-08-14 08:46:40.480992 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-14 08:46:40.486725 | mon1 | INFO     [default > destroy] Executing
2026-08-14 08:46:40.486760 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-14 08:46:40.486780 | mon1 | INFO     [default > destroy] Executed: Successful
2026-08-14 08:46:40.492606 | mon1 | INFO     [default > syntax] Executing
2026-08-14 08:46:41.708559 | mon1 |
2026-08-14 08:46:41.708883 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 08:46:41.765354 | mon1 | INFO     [default > syntax] Executed: Successful
2026-08-14 08:46:41.777503 | mon1 | INFO     [default > create] Executing
2026-08-14 08:46:41.779097 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-14 08:46:41.784850 | mon1 | INFO     [default > prepare] Executing
2026-08-14 08:46:42.542246 | mon1 |
2026-08-14 08:46:42.542717 | mon1 | PLAY [Prepare] *****************************************************************
2026-08-14 08:46:42.542979 | mon1 |
2026-08-14 08:46:42.543283 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:46:42.543597 | mon1 | Friday 14 August 2026  08:46:42 +0000 (0:00:00.034)       0:00:00.034 *********
2026-08-14 08:46:43.882116 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-14 08:46:43.882235 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-14 08:46:43.882442 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:46:43.882601 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:46:43.882776 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:46:44.817526 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-14 08:46:44.817736 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-14 08:46:44.818016 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:46:44.818263 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:46:44.818554 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:46:44.827949 | mon1 | ok: [osd1]
2026-08-14 08:46:44.828154 | mon1 | ok: [mon1]
2026-08-14 08:46:44.828413 | mon1 |
2026-08-14 08:46:44.828661 | mon1 | TASK [Configure short hostname] ************************************************
2026-08-14 08:46:44.828909 | mon1 | Friday 14 August 2026  08:46:44 +0000 (0:00:02.285)       0:00:02.319 *********
2026-08-14 08:46:45.624981 | mon1 | changed: [mon1]
2026-08-14 08:46:45.625182 | mon1 | changed: [osd1]
2026-08-14 08:46:45.625447 | mon1 |
2026-08-14 08:46:45.625703 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-14 08:46:45.625984 | mon1 | Friday 14 August 2026  08:46:45 +0000 (0:00:00.796)       0:00:03.116 *********
2026-08-14 08:46:45.946797 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-14 08:46:45.947053 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-14 08:46:45.947308 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-14 08:46:45.983219 | mon1 | changed: [mon1]
2026-08-14 08:46:45.983385 | mon1 | changed: [osd1]
2026-08-14 08:46:45.983558 | mon1 |
2026-08-14 08:46:45.983749 | mon1 | TASK [Update apt cache] ********************************************************
2026-08-14 08:46:45.983943 | mon1 | Friday 14 August 2026  08:46:45 +0000 (0:00:00.358)       0:00:03.475 *********
2026-08-14 08:46:52.122357 | mon1 | changed: [osd1]
2026-08-14 08:46:52.122387 | mon1 | changed: [mon1]
2026-08-14 08:46:52.122392 | mon1 |
2026-08-14 08:46:52.122397 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-08-14 08:46:52.122401 | mon1 |
2026-08-14 08:46:52.122405 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:46:52.122478 | mon1 | Friday 14 August 2026  08:46:52 +0000 (0:00:06.139)       0:00:09.614 *********
2026-08-14 08:46:52.913241 | mon1 | ok: [osd1]
2026-08-14 08:46:52.913405 | mon1 |
2026-08-14 08:46:52.913570 | mon1 | TASK [Install depedencies] *****************************************************
2026-08-14 08:46:52.913730 | mon1 | Friday 14 August 2026  08:46:52 +0000 (0:00:00.791)       0:00:10.405 *********
2026-08-14 08:47:21.778823 | mon1 | changed: [osd1]
2026-08-14 08:47:21.779051 | mon1 |
2026-08-14 08:47:21.779306 | mon1 | TASK [Start up service] ********************************************************
2026-08-14 08:47:21.779585 | mon1 | Friday 14 August 2026  08:47:21 +0000 (0:00:28.865)       0:00:39.270 *********
2026-08-14 08:47:22.443202 | mon1 | ok: [osd1]
2026-08-14 08:47:22.443488 | mon1 |
2026-08-14 08:47:22.443759 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-08-14 08:47:22.444021 | mon1 | Friday 14 August 2026  08:47:22 +0000 (0:00:00.664)       0:00:39.935 *********
2026-08-14 08:47:22.799030 | mon1 | ok: [osd1]
2026-08-14 08:47:22.799055 | mon1 |
2026-08-14 08:47:22.799062 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-14 08:47:22.799068 | mon1 | Friday 14 August 2026  08:47:22 +0000 (0:00:00.355)       0:00:40.290 *********
2026-08-14 08:47:23.586736 | mon1 | changed: [osd1]
2026-08-14 08:47:23.586980 | mon1 |
2026-08-14 08:47:23.587287 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-08-14 08:47:23.587617 | mon1 | Friday 14 August 2026  08:47:23 +0000 (0:00:00.787)       0:00:41.077 *********
2026-08-14 08:47:23.848919 | mon1 | ok: [osd1]
2026-08-14 08:47:23.849151 | mon1 |
2026-08-14 08:47:23.849640 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-14 08:47:23.849898 | mon1 | Friday 14 August 2026  08:47:23 +0000 (0:00:00.263)       0:00:41.340 *********
2026-08-14 08:47:23.876818 | mon1 | skipping: [osd1]
2026-08-14 08:47:23.877054 | mon1 |
2026-08-14 08:47:23.879105 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-08-14 08:47:23.879121 | mon1 | Friday 14 August 2026  08:47:23 +0000 (0:00:00.027)       0:00:41.368 *********
2026-08-14 08:47:24.603198 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:47:24.606246 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:47:24.606265 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:47:24.606273 | mon1 |
2026-08-14 08:47:24.606281 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-08-14 08:47:24.606296 | mon1 | Friday 14 August 2026  08:47:24 +0000 (0:00:00.726)       0:00:42.094 *********
2026-08-14 08:47:25.404363 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:47:25.404411 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:47:25.404417 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:47:25.404423 | mon1 |
2026-08-14 08:47:25.404429 | mon1 | TASK [Start loop devices] ******************************************************
2026-08-14 08:47:25.404435 | mon1 | Friday 14 August 2026  08:47:25 +0000 (0:00:00.798)       0:00:42.892 *********
2026-08-14 08:47:27.211784 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:47:27.212047 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:47:27.212244 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:47:27.212463 | mon1 |
2026-08-14 08:47:27.213782 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-08-14 08:47:27.214064 | mon1 | Friday 14 August 2026  08:47:27 +0000 (0:00:01.810)       0:00:44.703 *********
2026-08-14 08:47:28.631111 | mon1 | changed: [osd1] => (item=osd0)
2026-08-14 08:47:28.631624 | mon1 | changed: [osd1] => (item=osd1)
2026-08-14 08:47:28.631952 | mon1 | changed: [osd1] => (item=osd2)
2026-08-14 08:47:28.632249 | mon1 |
2026-08-14 08:47:28.632613 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-14 08:47:28.632941 | mon1 | Friday 14 August 2026  08:47:28 +0000 (0:00:01.419)       0:00:46.122 *********
2026-08-14 08:47:30.088509 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-08-14 08:47:30.088899 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-08-14 08:47:30.089230 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-08-14 08:47:30.089588 | mon1 |
2026-08-14 08:47:30.089919 | mon1 | PLAY RECAP *********************************************************************
2026-08-14 08:47:30.090263 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-08-14 08:47:30.090701 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-14 08:47:30.091009 | mon1 |
2026-08-14 08:47:30.091299 | mon1 |
2026-08-14 08:47:30.091690 | mon1 | TASKS RECAP ********************************************************************
2026-08-14 08:47:30.092028 | mon1 | Friday 14 August 2026  08:47:30 +0000 (0:00:01.457)       0:00:47.580 *********
2026-08-14 08:47:30.095363 | mon1 | ===============================================================================
2026-08-14 08:47:30.095818 | mon1 | Install depedencies ---------------------------------------------------- 28.87s
2026-08-14 08:47:30.096150 | mon1 | Update apt cache -------------------------------------------------------- 6.14s
2026-08-14 08:47:30.096532 | mon1 | Gathering Facts --------------------------------------------------------- 2.29s
2026-08-14 08:47:30.096863 | mon1 | Start loop devices ------------------------------------------------------ 1.81s
2026-08-14 08:47:30.097197 | mon1 | Create a logical volume for each loop device ---------------------------- 1.46s
2026-08-14 08:47:30.097555 | mon1 | Create a volume group for each loop device ------------------------------ 1.42s
2026-08-14 08:47:30.097883 | mon1 | Set permissions on loopback devices ------------------------------------- 0.80s
2026-08-14 08:47:30.098221 | mon1 | Configure short hostname ------------------------------------------------ 0.80s
2026-08-14 08:47:30.098648 | mon1 | Gathering Facts --------------------------------------------------------- 0.79s
2026-08-14 08:47:30.098979 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.79s
2026-08-14 08:47:30.099365 | mon1 | Create devices for Ceph ------------------------------------------------- 0.73s
2026-08-14 08:47:30.099591 | mon1 | Start up service -------------------------------------------------------- 0.66s
2026-08-14 08:47:30.099802 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.36s
2026-08-14 08:47:30.099998 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s
2026-08-14 08:47:30.100217 | mon1 | Get list of all loopback devices ---------------------------------------- 0.26s
2026-08-14 08:47:30.100448 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-08-14 08:47:30.165616 | mon1 | INFO     [default > prepare] Executed: Successful
2026-08-14 08:47:30.177685 | mon1 | INFO     [default > converge] Executing
2026-08-14 08:47:31.264117 | mon1 |
2026-08-14 08:47:31.264567 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-14 08:47:31.264885 | mon1 |
2026-08-14 08:47:31.265204 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:47:31.265579 | mon1 | Friday 14 August 2026  08:47:31 +0000 (0:00:00.052)       0:00:00.052 *********
2026-08-14 08:47:33.362393 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-14 08:47:33.365370 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-14 08:47:33.365412 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:47:33.365422 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:47:33.365431 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:47:33.376804 | mon1 | ok: [mon1]
2026-08-14 08:47:33.377056 | mon1 |
2026-08-14 08:47:33.377306 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:47:33.377587 | mon1 | Friday 14 August 2026  08:47:33 +0000 (0:00:02.112)       0:00:02.164 *********
2026-08-14 08:47:33.717696 | mon1 | ok: [mon1]
2026-08-14 08:47:33.717942 | mon1 |
2026-08-14 08:47:33.718153 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:47:33.718427 | mon1 | Friday 14 August 2026  08:47:33 +0000 (0:00:00.340)       0:00:02.505 *********
2026-08-14 08:47:33.764793 | mon1 | skipping: [mon1]
2026-08-14 08:47:33.765076 | mon1 |
2026-08-14 08:47:33.765394 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 08:47:33.765634 | mon1 | Friday 14 August 2026  08:47:33 +0000 (0:00:00.047)       0:00:02.553 *********
2026-08-14 08:47:34.128403 | mon1 | changed: [mon1]
2026-08-14 08:47:34.128656 | mon1 |
2026-08-14 08:47:34.128922 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:47:34.129174 | mon1 | Friday 14 August 2026  08:47:34 +0000 (0:00:00.362)       0:00:02.915 *********
2026-08-14 08:47:34.239044 | mon1 | ok: [mon1] => {
2026-08-14 08:47:34.239252 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 08:47:34.239542 | mon1 | }
2026-08-14 08:47:34.239757 | mon1 |
2026-08-14 08:47:34.240021 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:47:34.240287 | mon1 | Friday 14 August 2026  08:47:34 +0000 (0:00:00.111)       0:00:03.027 *********
2026-08-14 08:47:35.100225 | mon1 | changed: [mon1]
2026-08-14 08:47:35.100439 | mon1 |
2026-08-14 08:47:35.100713 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:47:35.100966 | mon1 | Friday 14 August 2026  08:47:35 +0000 (0:00:00.860)       0:00:03.888 *********
2026-08-14 08:47:35.152790 | mon1 | skipping: [mon1]
2026-08-14 08:47:35.152950 | mon1 |
2026-08-14 08:47:35.153190 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:47:35.153499 | mon1 | Friday 14 August 2026  08:47:35 +0000 (0:00:00.052)       0:00:03.940 *********
2026-08-14 08:47:35.207386 | mon1 | skipping: [mon1]
2026-08-14 08:47:35.207606 | mon1 |
2026-08-14 08:47:35.207854 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:47:35.208154 | mon1 | Friday 14 August 2026  08:47:35 +0000 (0:00:00.054)       0:00:03.995 *********
2026-08-14 08:47:35.460178 | mon1 | ok: [mon1]
2026-08-14 08:47:35.460380 | mon1 |
2026-08-14 08:47:35.460652 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:47:35.460910 | mon1 | Friday 14 August 2026  08:47:35 +0000 (0:00:00.252)       0:00:04.248 *********
2026-08-14 08:47:36.494408 | mon1 | ok: [mon1]
2026-08-14 08:47:36.494463 | mon1 |
2026-08-14 08:47:36.494475 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:47:36.494486 | mon1 | Friday 14 August 2026  08:47:36 +0000 (0:00:01.032)       0:00:05.280 *********
2026-08-14 08:47:36.699467 | mon1 | ok: [mon1] => {
2026-08-14 08:47:36.699503 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 08:47:36.699522 | mon1 | }
2026-08-14 08:47:36.699581 | mon1 |
2026-08-14 08:47:36.699742 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:47:36.699911 | mon1 | Friday 14 August 2026  08:47:36 +0000 (0:00:00.206)       0:00:05.487 *********
2026-08-14 08:47:37.629497 | mon1 | changed: [mon1]
2026-08-14 08:47:37.629552 | mon1 |
2026-08-14 08:47:37.629950 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:47:37.629994 | mon1 | Friday 14 August 2026  08:47:37 +0000 (0:00:00.929)       0:00:06.417 *********
2026-08-14 08:47:40.862004 | mon1 | changed: [mon1]
2026-08-14 08:47:40.862068 | mon1 |
2026-08-14 08:47:40.862079 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 08:47:40.862088 | mon1 | Friday 14 August 2026  08:47:40 +0000 (0:00:03.231)       0:00:09.648 *********
2026-08-14 08:47:40.894705 | mon1 | skipping: [mon1]
2026-08-14 08:47:40.894738 | mon1 |
2026-08-14 08:47:40.894748 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 08:47:40.894759 | mon1 | Friday 14 August 2026  08:47:40 +0000 (0:00:00.033)       0:00:09.681 *********
2026-08-14 08:47:40.924124 | mon1 | skipping: [mon1]
2026-08-14 08:47:40.924225 | mon1 |
2026-08-14 08:47:40.924238 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 08:47:40.924248 | mon1 | Friday 14 August 2026  08:47:40 +0000 (0:00:00.028)       0:00:09.710 *********
2026-08-14 08:47:40.959885 | mon1 | skipping: [mon1]
2026-08-14 08:47:40.959939 | mon1 |
2026-08-14 08:47:40.960349 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 08:47:40.960390 | mon1 | Friday 14 August 2026  08:47:40 +0000 (0:00:00.036)       0:00:09.746 *********
2026-08-14 08:47:48.185048 | mon1 | changed: [mon1]
2026-08-14 08:47:48.185098 | mon1 |
2026-08-14 08:47:48.185109 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 08:47:48.185119 | mon1 | Friday 14 August 2026  08:47:48 +0000 (0:00:07.223)       0:00:16.970 *********
2026-08-14 08:47:48.856756 | mon1 | changed: [mon1]
2026-08-14 08:47:48.856800 | mon1 |
2026-08-14 08:47:48.856811 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 08:47:48.856820 | mon1 | Friday 14 August 2026  08:47:48 +0000 (0:00:00.672)       0:00:17.643 *********
2026-08-14 08:47:49.969036 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-08-14 08:47:49.969144 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 08:47:49.969160 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 08:47:49.969173 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 08:47:49.969185 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 08:47:49.969197 | mon1 |
2026-08-14 08:47:49.969210 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 08:47:49.969222 | mon1 | Friday 14 August 2026  08:47:49 +0000 (0:00:01.111)       0:00:18.754 *********
2026-08-14 08:47:50.730494 | mon1 | changed: [mon1]
2026-08-14 08:47:50.730531 | mon1 |
2026-08-14 08:47:50.730540 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 08:47:50.730547 | mon1 | Friday 14 August 2026  08:47:50 +0000 (0:00:00.751)       0:00:19.506 *********
2026-08-14 08:47:50.730558 | mon1 |
2026-08-14 08:47:50.731261 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:47:50.731339 | mon1 | Friday 14 August 2026  08:47:50 +0000 (0:00:00.009)       0:00:19.516 *********
2026-08-14 08:47:51.817747 | mon1 | ok: [mon1]
2026-08-14 08:47:51.817823 | mon1 |
2026-08-14 08:47:51.817898 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-14 08:47:51.818010 | mon1 | Friday 14 August 2026  08:47:51 +0000 (0:00:01.086)       0:00:20.603 *********
2026-08-14 08:47:53.380477 | mon1 | changed: [mon1]
2026-08-14 08:47:53.380567 | mon1 |
2026-08-14 08:47:53.380578 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 08:47:53.380593 | mon1 | Friday 14 August 2026  08:47:53 +0000 (0:00:01.564)       0:00:22.168 *********
2026-08-14 08:47:54.085830 | mon1 | changed: [mon1]
2026-08-14 08:47:54.085862 | mon1 |
2026-08-14 08:47:54.085867 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:47:54.085872 | mon1 | Friday 14 August 2026  08:47:54 +0000 (0:00:00.703)       0:00:22.871 *********
2026-08-14 08:47:54.348951 | mon1 | ok: [mon1]
2026-08-14 08:47:54.349006 | mon1 |
2026-08-14 08:47:54.349019 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:47:54.349031 | mon1 | Friday 14 August 2026  08:47:54 +0000 (0:00:00.264)       0:00:23.135 *********
2026-08-14 08:47:54.452780 | mon1 | ok: [mon1] => {
2026-08-14 08:47:54.452845 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 08:47:54.452949 | mon1 | }
2026-08-14 08:47:54.453049 | mon1 |
2026-08-14 08:47:54.453165 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:47:54.453278 | mon1 | Friday 14 August 2026  08:47:54 +0000 (0:00:00.104)       0:00:23.240 *********
2026-08-14 08:47:55.573595 | mon1 | changed: [mon1]
2026-08-14 08:47:55.573646 | mon1 |
2026-08-14 08:47:55.573657 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:47:55.573667 | mon1 | Friday 14 August 2026  08:47:55 +0000 (0:00:01.119)       0:00:24.360 *********
2026-08-14 08:48:00.118041 | mon1 | changed: [mon1]
2026-08-14 08:48:00.118093 | mon1 |
2026-08-14 08:48:00.118104 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 08:48:00.118114 | mon1 | Friday 14 August 2026  08:48:00 +0000 (0:00:04.544)       0:00:28.904 *********
2026-08-14 08:48:01.007203 | mon1 | ok: [mon1]
2026-08-14 08:48:01.007297 | mon1 |
2026-08-14 08:48:01.007309 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 08:48:01.007368 | mon1 | Friday 14 August 2026  08:48:01 +0000 (0:00:00.888)       0:00:29.793 *********
2026-08-14 08:48:01.477903 | mon1 | changed: [mon1]
2026-08-14 08:48:01.477957 | mon1 |
2026-08-14 08:48:01.477967 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 08:48:01.477977 | mon1 | Friday 14 August 2026  08:48:01 +0000 (0:00:00.471)       0:00:30.264 *********
2026-08-14 08:48:02.060747 | mon1 | changed: [mon1]
2026-08-14 08:48:02.060802 | mon1 |
2026-08-14 08:48:02.060939 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 08:48:02.061056 | mon1 | Friday 14 August 2026  08:48:02 +0000 (0:00:00.583)       0:00:30.847 *********
2026-08-14 08:48:02.770420 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-08-14 08:48:02.770477 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 08:48:02.770487 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 08:48:02.770497 | mon1 |
2026-08-14 08:48:02.770506 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 08:48:02.770521 | mon1 | Friday 14 August 2026  08:48:02 +0000 (0:00:00.708)       0:00:31.556 *********
2026-08-14 08:48:03.300789 | mon1 | changed: [mon1]
2026-08-14 08:48:03.300900 | mon1 |
2026-08-14 08:48:03.301054 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 08:48:03.301209 | mon1 | Friday 14 August 2026  08:48:03 +0000 (0:00:00.531)       0:00:32.087 *********
2026-08-14 08:48:03.866682 | mon1 | changed: [mon1]
2026-08-14 08:48:03.866713 | mon1 |
2026-08-14 08:48:03.866718 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 08:48:03.866723 | mon1 | Friday 14 August 2026  08:48:03 +0000 (0:00:00.559)       0:00:32.647 *********
2026-08-14 08:48:03.866728 | mon1 |
2026-08-14 08:48:03.866732 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:48:03.866736 | mon1 | Friday 14 August 2026  08:48:03 +0000 (0:00:00.007)       0:00:32.654 *********
2026-08-14 08:48:04.745120 | mon1 | ok: [mon1]
2026-08-14 08:48:04.745164 | mon1 |
2026-08-14 08:48:04.745170 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-14 08:48:04.745176 | mon1 | Friday 14 August 2026  08:48:04 +0000 (0:00:00.878)       0:00:33.532 *********
2026-08-14 08:48:05.846088 | mon1 | changed: [mon1]
2026-08-14 08:48:05.846167 | mon1 |
2026-08-14 08:48:05.846181 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 08:48:05.846194 | mon1 | Friday 14 August 2026  08:48:05 +0000 (0:00:01.099)       0:00:34.632 *********
2026-08-14 08:48:06.559035 | mon1 | changed: [mon1]
2026-08-14 08:48:06.559096 | mon1 |
2026-08-14 08:48:06.559111 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 08:48:06.559125 | mon1 | Friday 14 August 2026  08:48:06 +0000 (0:00:00.713)       0:00:35.345 *********
2026-08-14 08:48:06.615422 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-14 08:48:06.615472 | mon1 |
2026-08-14 08:48:06.615486 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 08:48:06.615636 | mon1 | Friday 14 August 2026  08:48:06 +0000 (0:00:00.056)       0:00:35.402 *********
2026-08-14 08:48:24.830845 | mon1 | changed: [mon1]
2026-08-14 08:48:24.830914 | mon1 |
2026-08-14 08:48:24.831029 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 08:48:24.831148 | mon1 | Friday 14 August 2026  08:48:24 +0000 (0:00:18.215)       0:00:53.618 *********
2026-08-14 08:48:25.659112 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-14 08:48:25.659168 | mon1 | ok: [mon1] => (item=ssh)
2026-08-14 08:48:25.659182 | mon1 |
2026-08-14 08:48:25.659194 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 08:48:25.659207 | mon1 | Friday 14 August 2026  08:48:25 +0000 (0:00:00.827)       0:00:54.446 *********
2026-08-14 08:48:26.070812 | mon1 | changed: [mon1]
2026-08-14 08:48:26.070885 | mon1 |
2026-08-14 08:48:26.070899 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 08:48:26.070912 | mon1 | Friday 14 August 2026  08:48:26 +0000 (0:00:00.411)       0:00:54.857 *********
2026-08-14 08:48:26.318941 | mon1 | ok: [mon1]
2026-08-14 08:48:26.318972 | mon1 |
2026-08-14 08:48:26.318979 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 08:48:26.318985 | mon1 | Friday 14 August 2026  08:48:26 +0000 (0:00:00.246)       0:00:55.104 *********
2026-08-14 08:48:26.830300 | mon1 | changed: [mon1]
2026-08-14 08:48:26.830404 | mon1 |
2026-08-14 08:48:26.830418 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 08:48:26.830431 | mon1 | Friday 14 August 2026  08:48:26 +0000 (0:00:00.511)       0:00:55.616 *********
2026-08-14 08:48:28.197474 | mon1 | changed: [mon1]
2026-08-14 08:48:28.198215 | mon1 |
2026-08-14 08:48:28.198368 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-14 08:48:28.198390 | mon1 | Friday 14 August 2026  08:48:28 +0000 (0:00:01.368)       0:00:56.984 *********
2026-08-14 08:48:28.334253 | mon1 | ok: [mon1]
2026-08-14 08:48:28.334369 | mon1 |
2026-08-14 08:48:28.334388 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-14 08:48:28.334402 | mon1 | Friday 14 August 2026  08:48:28 +0000 (0:00:00.135)       0:00:57.120 *********
2026-08-14 08:48:28.633124 | mon1 | ok: [mon1] => (item=mon1)
2026-08-14 08:48:28.633198 | mon1 |
2026-08-14 08:48:28.633213 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-14 08:48:28.633227 | mon1 | Friday 14 August 2026  08:48:28 +0000 (0:00:00.299)       0:00:57.419 *********
2026-08-14 08:48:28.694964 | mon1 | ok: [mon1]
2026-08-14 08:48:28.695044 | mon1 |
2026-08-14 08:48:28.695110 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-14 08:48:28.695276 | mon1 | Friday 14 August 2026  08:48:28 +0000 (0:00:00.062)       0:00:57.482 *********
2026-08-14 08:48:28.796444 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-08-14 08:48:28.796529 | mon1 |
2026-08-14 08:48:28.796547 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-14 08:48:28.796843 | mon1 | Friday 14 August 2026  08:48:28 +0000 (0:00:00.100)       0:00:57.583 *********
2026-08-14 08:48:29.135542 | mon1 | changed: [mon1]
2026-08-14 08:48:29.135648 | mon1 |
2026-08-14 08:48:29.135668 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-14 08:48:29.136057 | mon1 | Friday 14 August 2026  08:48:29 +0000 (0:00:00.339)       0:00:57.922 *********
2026-08-14 08:48:29.922520 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-14 08:48:29.922559 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-14 08:48:29.922565 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-08-14 08:48:29.922570 | mon1 |
2026-08-14 08:48:29.922575 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-14 08:48:29.922580 | mon1 | Friday 14 August 2026  08:48:29 +0000 (0:00:00.787)       0:00:58.709 *********
2026-08-14 08:49:59.709412 | mon1 | ok: [mon1]
2026-08-14 08:49:59.709454 | mon1 |
2026-08-14 08:49:59.709463 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-14 08:49:59.709471 | mon1 | Friday 14 August 2026  08:49:59 +0000 (0:01:29.786)       0:02:28.495 *********
2026-08-14 08:49:59.982945 | mon1 | changed: [mon1]
2026-08-14 08:49:59.983008 | mon1 |
2026-08-14 08:49:59.983024 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-14 08:49:59.983038 | mon1 | Friday 14 August 2026  08:49:59 +0000 (0:00:00.273)       0:02:28.769 *********
2026-08-14 08:50:00.026115 | mon1 | ok: [mon1]
2026-08-14 08:50:00.026153 | mon1 |
2026-08-14 08:50:00.026160 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:50:00.026166 | mon1 | Friday 14 August 2026  08:50:00 +0000 (0:00:00.044)       0:02:28.813 *********
2026-08-14 08:50:00.117881 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-14 08:50:00.117932 | mon1 |
2026-08-14 08:50:00.117960 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:50:00.117974 | mon1 | Friday 14 August 2026  08:50:00 +0000 (0:00:00.091)       0:02:28.905 *********
2026-08-14 08:50:02.130796 | mon1 | ok: [mon1]
2026-08-14 08:50:02.130917 | mon1 |
2026-08-14 08:50:02.131093 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:50:02.131286 | mon1 | Friday 14 August 2026  08:50:02 +0000 (0:00:02.012)       0:02:30.917 *********
2026-08-14 08:50:02.191692 | mon1 | ok: [mon1] => (item=mon1)
2026-08-14 08:50:02.191744 | mon1 |
2026-08-14 08:50:02.191893 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:50:02.192007 | mon1 | Friday 14 August 2026  08:50:02 +0000 (0:00:00.061)       0:02:30.979 *********
2026-08-14 08:50:02.610494 | mon1 | ok: [mon1]
2026-08-14 08:50:02.610722 | mon1 |
2026-08-14 08:50:02.610996 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:50:02.611372 | mon1 | Friday 14 August 2026  08:50:02 +0000 (0:00:00.418)       0:02:31.397 *********
2026-08-14 08:50:05.543119 | mon1 | ok: [mon1]
2026-08-14 08:50:05.543349 | mon1 |
2026-08-14 08:50:05.543673 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-14 08:50:05.543927 | mon1 | Friday 14 August 2026  08:50:05 +0000 (0:00:02.933)       0:02:34.330 *********
2026-08-14 08:50:09.096435 | mon1 | changed: [mon1]
2026-08-14 08:50:09.096505 | mon1 |
2026-08-14 08:50:09.096521 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-14 08:50:09.096541 | mon1 | Friday 14 August 2026  08:50:09 +0000 (0:00:03.552)       0:02:37.883 *********
2026-08-14 08:50:11.005839 | mon1 | ok: [mon1]
2026-08-14 08:50:11.005933 | mon1 |
2026-08-14 08:50:11.005951 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:50:11.006086 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:01.910)       0:02:39.794 *********
2026-08-14 08:50:11.081818 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-14 08:50:11.081851 | mon1 |
2026-08-14 08:50:11.081998 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:50:11.082081 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:00.074)       0:02:39.868 *********
2026-08-14 08:50:11.131658 | mon1 | skipping: [mon1]
2026-08-14 08:50:11.131728 | mon1 |
2026-08-14 08:50:11.131850 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:50:11.131964 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:00.051)       0:02:39.920 *********
2026-08-14 08:50:11.183920 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-14 08:50:11.183956 | mon1 | skipping: [mon1]
2026-08-14 08:50:11.183961 | mon1 |
2026-08-14 08:50:11.183965 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:50:11.183970 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:00.049)       0:02:39.970 *********
2026-08-14 08:50:11.508838 | mon1 | ok: [mon1]
2026-08-14 08:50:11.510136 | mon1 |
2026-08-14 08:50:11.510161 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:50:11.510169 | mon1 | Friday 14 August 2026  08:50:11 +0000 (0:00:00.324)       0:02:40.294 *********
2026-08-14 08:50:14.223492 | mon1 | ok: [mon1]
2026-08-14 08:50:14.223632 | mon1 |
2026-08-14 08:50:14.223959 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-14 08:50:14.224301 | mon1 | Friday 14 August 2026  08:50:14 +0000 (0:00:02.716)       0:02:43.011 *********
2026-08-14 08:50:17.508137 | mon1 | changed: [mon1]
2026-08-14 08:50:17.508382 | mon1 |
2026-08-14 08:50:17.508666 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-14 08:50:17.508914 | mon1 | Friday 14 August 2026  08:50:17 +0000 (0:00:03.284)       0:02:46.296 *********
2026-08-14 08:50:19.384931 | mon1 | ok: [mon1]
2026-08-14 08:50:19.384995 | mon1 |
2026-08-14 08:50:19.385009 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-14 08:50:19.385022 | mon1 | Friday 14 August 2026  08:50:19 +0000 (0:00:01.875)       0:02:48.171 *********
2026-08-14 08:50:26.720951 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-14 08:50:26.721068 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-14 08:50:26.721268 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-08-14 08:50:26.721459 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-14 08:50:26.721582 | mon1 |
2026-08-14 08:50:26.721740 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-14 08:50:26.721864 | mon1 |
2026-08-14 08:50:26.722015 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:50:26.722172 | mon1 | Friday 14 August 2026  08:50:26 +0000 (0:00:07.335)       0:02:55.507 *********
2026-08-14 08:50:27.952889 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-14 08:50:27.952933 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-14 08:50:27.952939 | mon1 | interpreter could change the meaning of that path. See
2026-08-14 08:50:27.952953 | mon1 | https://docs.ansible.com/ansible-
2026-08-14 08:50:27.952959 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-14 08:50:27.967402 | mon1 | ok: [osd1]
2026-08-14 08:50:27.967455 | mon1 |
2026-08-14 08:50:27.967469 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:50:27.967481 | mon1 | Friday 14 August 2026  08:50:27 +0000 (0:00:01.246)       0:02:56.754 *********
2026-08-14 08:50:28.209763 | mon1 | ok: [osd1]
2026-08-14 08:50:28.209849 | mon1 |
2026-08-14 08:50:28.209967 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:50:28.210085 | mon1 | Friday 14 August 2026  08:50:28 +0000 (0:00:00.241)       0:02:56.995 *********
2026-08-14 08:50:28.246837 | mon1 | skipping: [osd1]
2026-08-14 08:50:28.246940 | mon1 |
2026-08-14 08:50:28.247058 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 08:50:28.247183 | mon1 | Friday 14 August 2026  08:50:28 +0000 (0:00:00.039)       0:02:57.035 *********
2026-08-14 08:50:28.521009 | mon1 | changed: [osd1]
2026-08-14 08:50:28.521069 | mon1 |
2026-08-14 08:50:28.521200 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:50:28.521336 | mon1 | Friday 14 August 2026  08:50:28 +0000 (0:00:00.274)       0:02:57.309 *********
2026-08-14 08:50:28.601613 | mon1 | ok: [osd1] => {
2026-08-14 08:50:28.601870 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 08:50:28.602121 | mon1 | }
2026-08-14 08:50:28.602395 | mon1 |
2026-08-14 08:50:28.602960 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:50:28.602998 | mon1 | Friday 14 August 2026  08:50:28 +0000 (0:00:00.079)       0:02:57.389 *********
2026-08-14 08:50:29.372952 | mon1 | changed: [osd1]
2026-08-14 08:50:29.373014 | mon1 |
2026-08-14 08:50:29.373025 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:50:29.373035 | mon1 | Friday 14 August 2026  08:50:29 +0000 (0:00:00.770)       0:02:58.159 *********
2026-08-14 08:50:29.422511 | mon1 | skipping: [osd1]
2026-08-14 08:50:29.422585 | mon1 |
2026-08-14 08:50:29.422651 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:50:29.422895 | mon1 | Friday 14 August 2026  08:50:29 +0000 (0:00:00.050)       0:02:58.210 *********
2026-08-14 08:50:29.470047 | mon1 | skipping: [osd1]
2026-08-14 08:50:29.470256 | mon1 |
2026-08-14 08:50:29.470556 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:50:29.470790 | mon1 | Friday 14 August 2026  08:50:29 +0000 (0:00:00.047)       0:02:58.258 *********
2026-08-14 08:50:29.742150 | mon1 | ok: [osd1]
2026-08-14 08:50:29.742456 | mon1 |
2026-08-14 08:50:29.743741 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:50:29.743771 | mon1 | Friday 14 August 2026  08:50:29 +0000 (0:00:00.271)       0:02:58.530 *********
2026-08-14 08:50:30.707746 | mon1 | ok: [osd1]
2026-08-14 08:50:30.707905 | mon1 |
2026-08-14 08:50:30.708165 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:50:30.708455 | mon1 | Friday 14 August 2026  08:50:30 +0000 (0:00:00.965)       0:02:59.495 *********
2026-08-14 08:50:30.796797 | mon1 | ok: [osd1] => {
2026-08-14 08:50:30.797014 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 08:50:30.797291 | mon1 | }
2026-08-14 08:50:30.797559 | mon1 |
2026-08-14 08:50:30.797846 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:50:30.798077 | mon1 | Friday 14 August 2026  08:50:30 +0000 (0:00:00.089)       0:02:59.585 *********
2026-08-14 08:50:31.606506 | mon1 | changed: [osd1]
2026-08-14 08:50:31.606574 | mon1 |
2026-08-14 08:50:31.606734 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:50:31.606985 | mon1 | Friday 14 August 2026  08:50:31 +0000 (0:00:00.809)       0:03:00.394 *********
2026-08-14 08:50:34.504381 | mon1 | changed: [osd1]
2026-08-14 08:50:34.504470 | mon1 |
2026-08-14 08:50:34.504785 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 08:50:34.505038 | mon1 | Friday 14 August 2026  08:50:34 +0000 (0:00:02.897)       0:03:03.291 *********
2026-08-14 08:50:34.535894 | mon1 | skipping: [osd1]
2026-08-14 08:50:34.536109 | mon1 |
2026-08-14 08:50:34.536643 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 08:50:34.536662 | mon1 | Friday 14 August 2026  08:50:34 +0000 (0:00:00.032)       0:03:03.324 *********
2026-08-14 08:50:34.568661 | mon1 | skipping: [osd1]
2026-08-14 08:50:34.568852 | mon1 |
2026-08-14 08:50:34.569198 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 08:50:34.569388 | mon1 | Friday 14 August 2026  08:50:34 +0000 (0:00:00.032)       0:03:03.357 *********
2026-08-14 08:50:34.600555 | mon1 | skipping: [osd1]
2026-08-14 08:50:34.600766 | mon1 |
2026-08-14 08:50:34.601021 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 08:50:34.601268 | mon1 | Friday 14 August 2026  08:50:34 +0000 (0:00:00.031)       0:03:03.389 *********
2026-08-14 08:50:42.915615 | mon1 | changed: [osd1]
2026-08-14 08:50:42.915890 | mon1 |
2026-08-14 08:50:42.916163 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 08:50:42.916482 | mon1 | Friday 14 August 2026  08:50:42 +0000 (0:00:08.314)       0:03:11.703 *********
2026-08-14 08:50:43.515392 | mon1 | changed: [osd1]
2026-08-14 08:50:43.515621 | mon1 |
2026-08-14 08:50:43.515894 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 08:50:43.516155 | mon1 | Friday 14 August 2026  08:50:43 +0000 (0:00:00.600)       0:03:12.303 *********
2026-08-14 08:50:44.649474 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-08-14 08:50:44.649536 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 08:50:44.649555 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 08:50:44.649779 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 08:50:44.650024 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 08:50:44.650284 | mon1 |
2026-08-14 08:50:44.650672 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 08:50:44.650959 | mon1 | Friday 14 August 2026  08:50:44 +0000 (0:00:01.133)       0:03:13.437 *********
2026-08-14 08:50:45.387976 | mon1 | changed: [osd1]
2026-08-14 08:50:45.388176 | mon1 |
2026-08-14 08:50:45.388507 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 08:50:45.388808 | mon1 | Friday 14 August 2026  08:50:45 +0000 (0:00:00.732)       0:03:14.169 *********
2026-08-14 08:50:45.389051 | mon1 |
2026-08-14 08:50:45.389344 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:50:45.389644 | mon1 | Friday 14 August 2026  08:50:45 +0000 (0:00:00.006)       0:03:14.176 *********
2026-08-14 08:50:46.289822 | mon1 | ok: [osd1]
2026-08-14 08:50:46.289992 | mon1 |
2026-08-14 08:50:46.290255 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-14 08:50:46.290551 | mon1 | Friday 14 August 2026  08:50:46 +0000 (0:00:00.901)       0:03:15.077 *********
2026-08-14 08:50:46.861607 | mon1 | changed: [osd1]
2026-08-14 08:50:46.861818 | mon1 |
2026-08-14 08:50:46.862144 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 08:50:46.862435 | mon1 | Friday 14 August 2026  08:50:46 +0000 (0:00:00.571)       0:03:15.649 *********
2026-08-14 08:50:47.553954 | mon1 | changed: [osd1]
2026-08-14 08:50:47.554015 | mon1 |
2026-08-14 08:50:47.554026 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:50:47.554036 | mon1 | Friday 14 August 2026  08:50:47 +0000 (0:00:00.691)       0:03:16.341 *********
2026-08-14 08:50:47.819951 | mon1 | ok: [osd1]
2026-08-14 08:50:47.820007 | mon1 |
2026-08-14 08:50:47.820018 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:50:47.820028 | mon1 | Friday 14 August 2026  08:50:47 +0000 (0:00:00.265)       0:03:16.606 *********
2026-08-14 08:50:47.884459 | mon1 | ok: [osd1] => {
2026-08-14 08:50:47.884499 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 08:50:47.884509 | mon1 | }
2026-08-14 08:50:47.885285 | mon1 |
2026-08-14 08:50:47.885353 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:50:47.885374 | mon1 | Friday 14 August 2026  08:50:47 +0000 (0:00:00.065)       0:03:16.671 *********
2026-08-14 08:50:48.807964 | mon1 | changed: [osd1]
2026-08-14 08:50:48.808025 | mon1 |
2026-08-14 08:50:48.808036 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:50:48.808045 | mon1 | Friday 14 August 2026  08:50:48 +0000 (0:00:00.922)       0:03:17.594 *********
2026-08-14 08:50:53.320414 | mon1 | changed: [osd1]
2026-08-14 08:50:53.320474 | mon1 |
2026-08-14 08:50:53.320917 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 08:50:53.320962 | mon1 | Friday 14 August 2026  08:50:53 +0000 (0:00:04.513)       0:03:22.107 *********
2026-08-14 08:50:54.228829 | mon1 | ok: [osd1]
2026-08-14 08:50:54.228873 | mon1 |
2026-08-14 08:50:54.228884 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 08:50:54.228894 | mon1 | Friday 14 August 2026  08:50:54 +0000 (0:00:00.908)       0:03:23.016 *********
2026-08-14 08:50:54.522423 | mon1 | changed: [osd1]
2026-08-14 08:50:54.522463 | mon1 |
2026-08-14 08:50:54.522471 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 08:50:54.522479 | mon1 | Friday 14 August 2026  08:50:54 +0000 (0:00:00.292)       0:03:23.309 *********
2026-08-14 08:50:55.103536 | mon1 | changed: [osd1]
2026-08-14 08:50:55.103593 | mon1 |
2026-08-14 08:50:55.104440 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 08:50:55.104531 | mon1 | Friday 14 August 2026  08:50:55 +0000 (0:00:00.581)       0:03:23.890 *********
2026-08-14 08:50:55.807563 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-08-14 08:50:55.807619 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 08:50:55.807630 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 08:50:55.807640 | mon1 |
2026-08-14 08:50:55.807652 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 08:50:55.807662 | mon1 | Friday 14 August 2026  08:50:55 +0000 (0:00:00.702)       0:03:24.593 *********
2026-08-14 08:50:56.351589 | mon1 | changed: [osd1]
2026-08-14 08:50:56.351660 | mon1 |
2026-08-14 08:50:56.351683 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 08:50:56.351977 | mon1 | Friday 14 August 2026  08:50:56 +0000 (0:00:00.545)       0:03:25.138 *********
2026-08-14 08:50:56.931731 | mon1 | changed: [osd1]
2026-08-14 08:50:56.931786 | mon1 |
2026-08-14 08:50:56.931921 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 08:50:56.932038 | mon1 | Friday 14 August 2026  08:50:56 +0000 (0:00:00.575)       0:03:25.714 *********
2026-08-14 08:50:56.932143 | mon1 |
2026-08-14 08:50:56.932262 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-14 08:50:56.932444 | mon1 | Friday 14 August 2026  08:50:56 +0000 (0:00:00.006)       0:03:25.720 *********
2026-08-14 08:50:57.861724 | mon1 | ok: [osd1]
2026-08-14 08:50:57.861791 | mon1 |
2026-08-14 08:50:57.861903 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-14 08:50:57.862018 | mon1 | Friday 14 August 2026  08:50:57 +0000 (0:00:00.929)       0:03:26.649 *********
2026-08-14 08:50:58.736436 | mon1 | changed: [osd1]
2026-08-14 08:50:58.736514 | mon1 |
2026-08-14 08:50:58.737076 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 08:50:58.737137 | mon1 | Friday 14 August 2026  08:50:58 +0000 (0:00:00.873)       0:03:27.522 *********
2026-08-14 08:50:59.441002 | mon1 | changed: [osd1]
2026-08-14 08:50:59.441086 | mon1 |
2026-08-14 08:50:59.441101 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 08:50:59.441231 | mon1 | Friday 14 August 2026  08:50:59 +0000 (0:00:00.705)       0:03:28.228 *********
2026-08-14 08:50:59.502076 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-14 08:50:59.502133 | mon1 |
2026-08-14 08:50:59.502140 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 08:50:59.502147 | mon1 | Friday 14 August 2026  08:50:59 +0000 (0:00:00.060)       0:03:28.289 *********
2026-08-14 08:51:00.426428 | mon1 | ok: [osd1]
2026-08-14 08:51:00.426497 | mon1 |
2026-08-14 08:51:00.427013 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 08:51:00.427074 | mon1 | Friday 14 August 2026  08:51:00 +0000 (0:00:00.924)       0:03:29.213 *********
2026-08-14 08:51:01.311254 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-08-14 08:51:01.311378 | mon1 | ok: [osd1] => (item=ssh)
2026-08-14 08:51:01.311395 | mon1 |
2026-08-14 08:51:01.311405 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 08:51:01.311415 | mon1 | Friday 14 August 2026  08:51:01 +0000 (0:00:00.883)       0:03:30.097 *********
2026-08-14 08:51:01.726458 | mon1 | changed: [osd1]
2026-08-14 08:51:01.726525 | mon1 |
2026-08-14 08:51:01.727002 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 08:51:01.727047 | mon1 | Friday 14 August 2026  08:51:01 +0000 (0:00:00.415)       0:03:30.513 *********
2026-08-14 08:51:01.973840 | mon1 | ok: [osd1]
2026-08-14 08:51:01.973938 | mon1 |
2026-08-14 08:51:01.974122 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 08:51:01.974277 | mon1 | Friday 14 August 2026  08:51:01 +0000 (0:00:00.248)       0:03:30.761 *********
2026-08-14 08:51:02.371222 | mon1 | changed: [osd1]
2026-08-14 08:51:02.371283 | mon1 |
2026-08-14 08:51:02.371294 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 08:51:02.371368 | mon1 | Friday 14 August 2026  08:51:02 +0000 (0:00:00.396)       0:03:31.157 *********
2026-08-14 08:51:02.638926 | mon1 | changed: [osd1]
2026-08-14 08:51:02.638981 | mon1 |
2026-08-14 08:51:02.638992 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-14 08:51:02.639002 | mon1 | Friday 14 August 2026  08:51:02 +0000 (0:00:00.268)       0:03:31.425 *********
2026-08-14 08:51:02.917455 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-14 08:51:02.917502 | mon1 |
2026-08-14 08:51:02.917767 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-14 08:51:02.917966 | mon1 | Friday 14 August 2026  08:51:02 +0000 (0:00:00.279)       0:03:31.704 *********
2026-08-14 08:51:02.966996 | mon1 | ok: [osd1]
2026-08-14 08:51:02.967243 | mon1 |
2026-08-14 08:51:02.967566 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-14 08:51:02.967864 | mon1 | Friday 14 August 2026  08:51:02 +0000 (0:00:00.050)       0:03:31.755 *********
2026-08-14 08:51:03.030220 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-14 08:51:03.030279 | mon1 |
2026-08-14 08:51:03.030500 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-14 08:51:03.030858 | mon1 | Friday 14 August 2026  08:51:03 +0000 (0:00:00.063)       0:03:31.818 *********
2026-08-14 08:51:04.937942 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:51:04.938188 | mon1 |
2026-08-14 08:51:04.938552 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-14 08:51:04.938829 | mon1 | Friday 14 August 2026  08:51:04 +0000 (0:00:01.906)       0:03:33.725 *********
2026-08-14 08:51:04.989111 | mon1 | ok: [osd1] => (item=osd1)
2026-08-14 08:51:04.989412 | mon1 |
2026-08-14 08:51:04.989703 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-14 08:51:04.989969 | mon1 | Friday 14 August 2026  08:51:04 +0000 (0:00:00.051)       0:03:33.777 *********
2026-08-14 08:51:05.300595 | mon1 | changed: [osd1]
2026-08-14 08:51:05.300785 | mon1 |
2026-08-14 08:51:05.301049 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-14 08:51:05.301467 | mon1 | Friday 14 August 2026  08:51:05 +0000 (0:00:00.310)       0:03:34.088 *********
2026-08-14 08:51:11.228550 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:51:11.228626 | mon1 |
2026-08-14 08:51:11.228647 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-14 08:51:11.228863 | mon1 | Friday 14 August 2026  08:51:11 +0000 (0:00:05.927)       0:03:40.015 *********
2026-08-14 08:51:12.158786 | mon1 | ok: [osd1]
2026-08-14 08:51:12.159035 | mon1 |
2026-08-14 08:51:12.159316 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-14 08:51:12.159662 | mon1 | Friday 14 August 2026  08:51:12 +0000 (0:00:00.930)       0:03:40.946 *********
2026-08-14 08:51:54.405603 | mon1 | ok: [osd1]
2026-08-14 08:51:54.405797 | mon1 |
2026-08-14 08:51:54.405995 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-14 08:51:54.406243 | mon1 | Friday 14 August 2026  08:51:54 +0000 (0:00:42.246)       0:04:23.193 *********
2026-08-14 08:52:39.525541 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-08-14 08:52:39.525628 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-08-14 08:52:39.525899 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-08-14 08:52:39.526145 | mon1 |
2026-08-14 08:52:39.526465 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-14 08:52:39.526726 | mon1 | Friday 14 August 2026  08:52:39 +0000 (0:00:45.119)       0:05:08.312 *********
2026-08-14 08:52:41.681629 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:52:41.681921 | mon1 |
2026-08-14 08:52:41.682279 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-14 08:52:41.682601 | mon1 | Friday 14 August 2026  08:52:41 +0000 (0:00:02.156)       0:05:10.468 *********
2026-08-14 08:52:43.630587 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:52:43.630682 | mon1 |
2026-08-14 08:52:43.630710 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-14 08:52:43.631009 | mon1 | Friday 14 August 2026  08:52:43 +0000 (0:00:01.949)       0:05:12.418 *********
2026-08-14 08:52:43.695478 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-14 08:52:43.695545 | mon1 |
2026-08-14 08:52:43.696212 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-14 08:52:43.696264 | mon1 | Friday 14 August 2026  08:52:43 +0000 (0:00:00.064)       0:05:12.482 *********
2026-08-14 08:52:43.751078 | mon1 | ok: [osd1]
2026-08-14 08:52:43.751144 | mon1 |
2026-08-14 08:52:43.751159 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-14 08:52:43.751173 | mon1 | Friday 14 August 2026  08:52:43 +0000 (0:00:00.055)       0:05:12.537 *********
2026-08-14 08:52:45.666970 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:52:45.667030 | mon1 |
2026-08-14 08:52:45.667044 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-14 08:52:45.667057 | mon1 | Friday 14 August 2026  08:52:45 +0000 (0:00:01.915)       0:05:14.453 *********
2026-08-14 08:52:45.710891 | mon1 | ok: [osd1]
2026-08-14 08:52:45.711148 | mon1 |
2026-08-14 08:52:45.711447 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-14 08:52:45.711700 | mon1 | Friday 14 August 2026  08:52:45 +0000 (0:00:00.045)       0:05:14.498 *********
2026-08-14 08:52:45.747363 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"}
2026-08-14 08:52:45.763558 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 08:52:45.763807 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 08:52:45.764010 | mon1 |
2026-08-14 08:52:45.764252 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] **********************************
2026-08-14 08:52:45.764531 | mon1 | Friday 14 August 2026  08:52:45 +0000 (0:00:00.053)       0:05:14.551 *********
2026-08-14 08:52:45.801365 | mon1 | skipping: [osd1]
2026-08-14 08:52:45.801656 | mon1 |
2026-08-14 08:52:45.802032 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] *******************
2026-08-14 08:52:45.802344 | mon1 | Friday 14 August 2026  08:52:45 +0000 (0:00:00.037)       0:05:14.589 *********
2026-08-14 08:52:50.846986 | mon1 | Pausing for 5 seconds
2026-08-14 08:52:50.847256 | mon1 | ok: [osd1]
2026-08-14 08:52:50.847518 | mon1 |
2026-08-14 08:52:50.847810 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] ****************************************
2026-08-14 08:52:50.848063 | mon1 | Friday 14 August 2026  08:52:50 +0000 (0:00:05.044)       0:05:19.634 *********
2026-08-14 08:52:50.907171 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-14 08:52:50.907448 | mon1 |
2026-08-14 08:52:50.907746 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-14 08:52:50.908006 | mon1 | Friday 14 August 2026  08:52:50 +0000 (0:00:00.060)       0:05:19.695 *********
2026-08-14 08:52:50.955536 | mon1 | ok: [osd1]
2026-08-14 08:52:50.955672 | mon1 |
2026-08-14 08:52:50.955924 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-14 08:52:50.956173 | mon1 | Friday 14 August 2026  08:52:50 +0000 (0:00:00.048)       0:05:19.743 *********
2026-08-14 08:52:52.877508 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-14 08:52:52.877569 | mon1 |
2026-08-14 08:52:52.878042 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-14 08:52:52.878122 | mon1 | Friday 14 August 2026  08:52:52 +0000 (0:00:01.921)       0:05:21.664 *********
2026-08-14 08:52:52.925953 | mon1 | ok: [osd1]
2026-08-14 08:52:52.926024 | mon1 |
2026-08-14 08:52:52.926156 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-14 08:52:52.926278 | mon1 | Friday 14 August 2026  08:52:52 +0000 (0:00:00.048)       0:05:21.713 *********
2026-08-14 08:52:52.965280 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 08:52:52.965423 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 08:52:52.965438 | mon1 | skipping: [osd1] => (item=1)
2026-08-14 08:52:52.965449 | mon1 | skipping: [osd1]
2026-08-14 08:52:52.965462 | mon1 |
2026-08-14 08:52:52.965474 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-14 08:52:52.965488 | mon1 | Friday 14 August 2026  08:52:52 +0000 (0:00:00.037)       0:05:21.751 *********
2026-08-14 08:52:53.031444 | mon1 | skipping: [osd1]
2026-08-14 08:52:53.031525 | mon1 |
2026-08-14 08:52:53.031541 | mon1 | PLAY [Upgrade check] ***********************************************************
2026-08-14 08:52:53.031589 | mon1 |
2026-08-14 08:52:53.031605 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-14 08:52:53.031796 | mon1 | Friday 14 August 2026  08:52:53 +0000 (0:00:00.068)       0:05:21.819 *********
2026-08-14 08:52:54.020032 | mon1 | ok: [mon1]
2026-08-14 08:52:54.020123 | mon1 |
2026-08-14 08:52:54.020134 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:52:54.020143 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.987)       0:05:22.806 *********
2026-08-14 08:52:54.261792 | mon1 | ok: [mon1]
2026-08-14 08:52:54.261883 | mon1 |
2026-08-14 08:52:54.261932 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:52:54.262048 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.241)       0:05:23.048 *********
2026-08-14 08:52:54.301049 | mon1 | skipping: [mon1]
2026-08-14 08:52:54.301093 | mon1 |
2026-08-14 08:52:54.301219 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-14 08:52:54.301404 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.041)       0:05:23.089 *********
2026-08-14 08:52:54.555507 | mon1 | ok: [mon1]
2026-08-14 08:52:54.555558 | mon1 |
2026-08-14 08:52:54.555926 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:52:54.555960 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.252)       0:05:23.342 *********
2026-08-14 08:52:54.611351 | mon1 | ok: [mon1] => {
2026-08-14 08:52:54.611409 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-14 08:52:54.611438 | mon1 | }
2026-08-14 08:52:54.611451 | mon1 |
2026-08-14 08:52:54.611494 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:52:54.611514 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.054)       0:05:23.397 *********
2026-08-14 08:52:54.996409 | mon1 | ok: [mon1]
2026-08-14 08:52:54.996457 | mon1 |
2026-08-14 08:52:54.996466 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:52:54.996475 | mon1 | Friday 14 August 2026  08:52:54 +0000 (0:00:00.386)       0:05:23.783 *********
2026-08-14 08:52:55.043129 | mon1 | skipping: [mon1]
2026-08-14 08:52:55.043188 | mon1 |
2026-08-14 08:52:55.043201 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:52:55.043215 | mon1 | Friday 14 August 2026  08:52:55 +0000 (0:00:00.045)       0:05:23.829 *********
2026-08-14 08:52:55.085641 | mon1 | skipping: [mon1]
2026-08-14 08:52:55.085679 | mon1 |
2026-08-14 08:52:55.085690 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:52:55.085699 | mon1 | Friday 14 August 2026  08:52:55 +0000 (0:00:00.043)       0:05:23.873 *********
2026-08-14 08:52:55.338850 | mon1 | ok: [mon1]
2026-08-14 08:52:55.338899 | mon1 |
2026-08-14 08:52:55.338910 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-14 08:52:55.338920 | mon1 | Friday 14 August 2026  08:52:55 +0000 (0:00:00.252)       0:05:24.125 *********
2026-08-14 08:52:56.265218 | mon1 | ok: [mon1]
2026-08-14 08:52:56.265258 | mon1 |
2026-08-14 08:52:56.265263 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:52:56.265268 | mon1 | Friday 14 August 2026  08:52:56 +0000 (0:00:00.927)       0:05:25.053 *********
2026-08-14 08:52:56.337431 | mon1 | ok: [mon1] => {
2026-08-14 08:52:56.337482 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-14 08:52:56.338355 | mon1 | }
2026-08-14 08:52:56.338368 | mon1 |
2026-08-14 08:52:56.338374 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:52:56.338749 | mon1 | Friday 14 August 2026  08:52:56 +0000 (0:00:00.071)       0:05:25.124 *********
2026-08-14 08:52:56.746037 | mon1 | ok: [mon1]
2026-08-14 08:52:56.746066 | mon1 |
2026-08-14 08:52:56.746071 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:52:56.746076 | mon1 | Friday 14 August 2026  08:52:56 +0000 (0:00:00.406)       0:05:25.531 *********
2026-08-14 08:52:58.821515 | mon1 | ok: [mon1]
2026-08-14 08:52:58.821580 | mon1 |
2026-08-14 08:52:58.821691 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-14 08:52:58.822378 | mon1 | Friday 14 August 2026  08:52:58 +0000 (0:00:02.078)       0:05:27.609 *********
2026-08-14 08:52:58.859514 | mon1 | skipping: [mon1]
2026-08-14 08:52:58.859573 | mon1 |
2026-08-14 08:52:58.859584 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-14 08:52:58.859677 | mon1 | Friday 14 August 2026  08:52:58 +0000 (0:00:00.037)       0:05:27.647 *********
2026-08-14 08:52:58.891814 | mon1 | skipping: [mon1]
2026-08-14 08:52:58.892000 | mon1 |
2026-08-14 08:52:58.892281 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-14 08:52:58.892615 | mon1 | Friday 14 August 2026  08:52:58 +0000 (0:00:00.033)       0:05:27.680 *********
2026-08-14 08:52:58.923861 | mon1 | skipping: [mon1]
2026-08-14 08:52:58.924029 | mon1 |
2026-08-14 08:52:58.924284 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-14 08:52:58.924654 | mon1 | Friday 14 August 2026  08:52:58 +0000 (0:00:00.032)       0:05:27.712 *********
2026-08-14 08:52:59.846528 | mon1 | ok: [mon1]
2026-08-14 08:52:59.846624 | mon1 |
2026-08-14 08:52:59.846821 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-14 08:52:59.846981 | mon1 | Friday 14 August 2026  08:52:59 +0000 (0:00:00.922)       0:05:28.634 *********
2026-08-14 08:53:00.387438 | mon1 | ok: [mon1]
2026-08-14 08:53:00.387498 | mon1 |
2026-08-14 08:53:00.387694 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-14 08:53:00.387946 | mon1 | Friday 14 August 2026  08:53:00 +0000 (0:00:00.540)       0:05:29.175 *********
2026-08-14 08:53:01.488804 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-14 08:53:01.489071 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-14 08:53:01.489429 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-14 08:53:01.489730 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-14 08:53:01.490028 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-14 08:53:01.490295 | mon1 |
2026-08-14 08:53:01.490730 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-14 08:53:01.491147 | mon1 | Friday 14 August 2026  08:53:01 +0000 (0:00:01.101)       0:05:30.276 *********
2026-08-14 08:53:02.123461 | mon1 | ok: [mon1]
2026-08-14 08:53:02.123515 | mon1 |
2026-08-14 08:53:02.123526 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-14 08:53:02.123638 | mon1 | Friday 14 August 2026  08:53:02 +0000 (0:00:00.624)       0:05:30.901 *********
2026-08-14 08:53:02.123899 | mon1 |
2026-08-14 08:53:02.124245 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-14 08:53:02.124551 | mon1 | Friday 14 August 2026  08:53:02 +0000 (0:00:00.008)       0:05:30.910 *********
2026-08-14 08:53:02.569497 | mon1 | ok: [mon1]
2026-08-14 08:53:02.569558 | mon1 |
2026-08-14 08:53:02.569578 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-14 08:53:02.569764 | mon1 | Friday 14 August 2026  08:53:02 +0000 (0:00:00.446)       0:05:31.357 *********
2026-08-14 08:53:02.816767 | mon1 | ok: [mon1]
2026-08-14 08:53:02.816835 | mon1 |
2026-08-14 08:53:02.816955 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-14 08:53:02.817098 | mon1 | Friday 14 August 2026  08:53:02 +0000 (0:00:00.247)       0:05:31.604 *********
2026-08-14 08:53:02.892531 | mon1 | ok: [mon1] => {
2026-08-14 08:53:02.892587 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-14 08:53:02.892597 | mon1 | }
2026-08-14 08:53:02.893278 | mon1 |
2026-08-14 08:53:02.893311 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-14 08:53:02.893351 | mon1 | Friday 14 August 2026  08:53:02 +0000 (0:00:00.075)       0:05:31.679 *********
2026-08-14 08:53:03.300466 | mon1 | ok: [mon1]
2026-08-14 08:53:03.300527 | mon1 |
2026-08-14 08:53:03.300546 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-14 08:53:03.300845 | mon1 | Friday 14 August 2026  08:53:03 +0000 (0:00:00.407)       0:05:32.087 *********
2026-08-14 08:53:07.577489 | mon1 | ok: [mon1]
2026-08-14 08:53:07.577551 | mon1 |
2026-08-14 08:53:07.577964 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-14 08:53:07.578005 | mon1 | Friday 14 August 2026  08:53:07 +0000 (0:00:04.277)       0:05:36.364 *********
2026-08-14 08:53:08.490856 | mon1 | ok: [mon1]
2026-08-14 08:53:08.490908 | mon1 |
2026-08-14 08:53:08.490919 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-14 08:53:08.490929 | mon1 | Friday 14 August 2026  08:53:08 +0000 (0:00:00.912)       0:05:37.277 *********
2026-08-14 08:53:08.731548 | mon1 | ok: [mon1]
2026-08-14 08:53:08.731645 | mon1 |
2026-08-14 08:53:08.731656 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-14 08:53:08.731667 | mon1 | Friday 14 August 2026  08:53:08 +0000 (0:00:00.240)       0:05:37.517 *********
2026-08-14 08:53:09.275676 | mon1 | ok: [mon1]
2026-08-14 08:53:09.275776 | mon1 |
2026-08-14 08:53:09.275784 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-14 08:53:09.275790 | mon1 | Friday 14 August 2026  08:53:09 +0000 (0:00:00.545)       0:05:38.063 *********
2026-08-14 08:53:09.955740 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-14 08:53:09.955822 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-14 08:53:09.955833 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-14 08:53:09.955842 | mon1 |
2026-08-14 08:53:09.955854 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-14 08:53:09.955864 | mon1 | Friday 14 August 2026  08:53:09 +0000 (0:00:00.678)       0:05:38.742 *********
2026-08-14 08:53:10.485405 | mon1 | ok: [mon1]
2026-08-14 08:53:10.485466 | mon1 |
2026-08-14 08:53:10.485695 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-14 08:53:10.485947 | mon1 | Friday 14 August 2026  08:53:10 +0000 (0:00:00.530)       0:05:39.273 *********
2026-08-14 08:53:11.034858 | mon1 | ok: [mon1]
2026-08-14 08:53:11.035070 | mon1 |
2026-08-14 08:53:11.035360 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-14 08:53:11.035636 | mon1 | Friday 14 August 2026  08:53:11 +0000 (0:00:00.542)       0:05:39.815 *********
2026-08-14 08:53:11.035860 | mon1 |
2026-08-14 08:53:11.036111 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-14 08:53:11.036377 | mon1 | Friday 14 August 2026  08:53:11 +0000 (0:00:00.007)       0:05:39.822 *********
2026-08-14 08:53:11.487361 | mon1 | ok: [mon1]
2026-08-14 08:53:11.487397 | mon1 |
2026-08-14 08:53:11.487639 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-14 08:53:11.487893 | mon1 | Friday 14 August 2026  08:53:11 +0000 (0:00:00.452)       0:05:40.275 *********
2026-08-14 08:53:11.542051 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-14 08:53:11.542278 | mon1 |
2026-08-14 08:53:11.542572 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-14 08:53:11.542827 | mon1 | Friday 14 August 2026  08:53:11 +0000 (0:00:00.055)       0:05:40.330 *********
2026-08-14 08:53:12.423028 | mon1 | ok: [mon1]
2026-08-14 08:53:12.423131 | mon1 |
2026-08-14 08:53:12.423245 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-14 08:53:12.423445 | mon1 | Friday 14 August 2026  08:53:12 +0000 (0:00:00.880)       0:05:41.210 *********
2026-08-14 08:53:13.238400 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-08-14 08:53:13.238665 | mon1 | ok: [mon1] => (item=ssh)
2026-08-14 08:53:13.239028 | mon1 |
2026-08-14 08:53:13.239363 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-14 08:53:13.239658 | mon1 | Friday 14 August 2026  08:53:13 +0000 (0:00:00.815)       0:05:42.026 *********
2026-08-14 08:53:13.738510 | mon1 | ok: [mon1]
2026-08-14 08:53:13.738745 | mon1 |
2026-08-14 08:53:13.739030 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-14 08:53:13.739301 | mon1 | Friday 14 August 2026  08:53:13 +0000 (0:00:00.500)       0:05:42.526 *********
2026-08-14 08:53:13.992378 | mon1 | ok: [mon1]
2026-08-14 08:53:13.992657 | mon1 |
2026-08-14 08:53:13.992942 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-14 08:53:13.993224 | mon1 | Friday 14 August 2026  08:53:13 +0000 (0:00:00.253)       0:05:42.780 *********
2026-08-14 08:53:14.326053 | mon1 | ok: [mon1]
2026-08-14 08:53:14.326276 | mon1 |
2026-08-14 08:53:14.326637 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-14 08:53:14.326896 | mon1 | Friday 14 August 2026  08:53:14 +0000 (0:00:00.334)       0:05:43.114 *********
2026-08-14 08:53:14.573755 | mon1 | ok: [mon1]
2026-08-14 08:53:14.573815 | mon1 |
2026-08-14 08:53:14.573949 | mon1 | TASK [vexxhost.ceph.upgrade_check : Get ceph version] **************************
2026-08-14 08:53:14.574048 | mon1 | Friday 14 August 2026  08:53:14 +0000 (0:00:00.247)       0:05:43.361 *********
2026-08-14 08:53:16.580857 | mon1 | ok: [mon1]
2026-08-14 08:53:16.580946 | mon1 |
2026-08-14 08:53:16.581134 | mon1 | TASK [vexxhost.ceph.upgrade_check : Check upgrade version] *********************
2026-08-14 08:53:16.581313 | mon1 | Friday 14 August 2026  08:53:16 +0000 (0:00:02.004)       0:05:45.366 *********
2026-08-14 08:53:16.608127 | mon1 | fatal: [mon1]: FAILED! => {"msg": "The task includes an option with an undefined variable.. 'ceph_version' is undefined\n\nThe error appears to be in '/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/upgrade_check/tasks/main.yml': line 21, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n\n- name: Check upgrade version\n  ^ here\n"}
2026-08-14 08:53:16.611019 | mon1 |
2026-08-14 08:53:16.611173 | mon1 | PLAY RECAP *********************************************************************
2026-08-14 08:53:16.611432 | mon1 | mon1                       : ok=93   changed=29   unreachable=0    failed=1    skipped=14   rescued=0    ignored=0
2026-08-14 08:53:16.613484 | mon1 | osd1                       : ok=58   changed=23   unreachable=0    failed=0    skipped=9    rescued=1    ignored=0
2026-08-14 08:53:16.613539 | mon1 |
2026-08-14 08:53:16.613571 | mon1 |
2026-08-14 08:53:16.613581 | mon1 | TASKS RECAP ********************************************************************
2026-08-14 08:53:16.613591 | mon1 | Friday 14 August 2026  08:53:16 +0000 (0:00:00.033)       0:05:45.399 *********
2026-08-14 08:53:16.613600 | mon1 | ===============================================================================
2026-08-14 08:53:16.613608 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 89.79s
2026-08-14 08:53:16.613617 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 45.12s
2026-08-14 08:53:16.613625 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.25s
2026-08-14 08:53:16.613634 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.22s
2026-08-14 08:53:16.613642 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.31s
2026-08-14 08:53:16.613656 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.34s
2026-08-14 08:53:16.613729 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.22s
2026-08-14 08:53:16.613923 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.93s
2026-08-14 08:53:16.614099 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.04s
2026-08-14 08:53:16.614262 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.54s
2026-08-14 08:53:16.614457 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.51s
2026-08-14 08:53:16.614615 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.28s
2026-08-14 08:53:16.614793 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.55s
2026-08-14 08:53:16.615014 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.28s
2026-08-14 08:53:16.615173 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.23s
2026-08-14 08:53:16.615382 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.93s
2026-08-14 08:53:16.615541 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.90s
2026-08-14 08:53:16.615713 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.72s
2026-08-14 08:53:16.615871 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 2.16s
2026-08-14 08:53:16.616023 | mon1 | Gathering Facts --------------------------------------------------------- 2.11s
2026-08-14 08:53:16.714817 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 08:53:16.714907 | mon1 | ERROR    [default > converge] Executed: Failed
2026-08-14 08:53:16.715018 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-14 08:53:27.111006 | mon1 | ERROR
2026-08-14 08:53:27.111239 | mon1 | {
2026-08-14 08:53:27.111280 | mon1 |   "delta": "0:07:10.892399",
2026-08-14 08:53:27.111309 | mon1 |   "end": "2026-08-14 08:53:16.808942",
2026-08-14 08:53:27.111335 | mon1 |   "msg": "non-zero return code",
2026-08-14 08:53:27.111360 | mon1 |   "rc": 2,
2026-08-14 08:53:27.111386 | mon1 |   "start": "2026-08-14 08:46:05.916543"
2026-08-14 08:53:27.111410 | mon1 | }
failure
2026-08-14 08:53:27.123443 | 
2026-08-14 08:53:27.123535 | PLAY RECAP
2026-08-14 08:53:27.123585 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-14 08:53:27.123607 | 
2026-08-14 08:53:27.326231 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-14 08:53:27.331362 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-14 08:53:29.435612 | 
2026-08-14 08:53:29.435831 | PLAY [all]
2026-08-14 08:53:29.456064 | 
2026-08-14 08:53:29.456275 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-14 08:53:29.515226 | mon1 | ok
2026-08-14 08:53:29.534750 | osd1 | ok
2026-08-14 08:53:29.540608 | 
2026-08-14 08:53:29.540724 | TASK [fetch-output : Set log path for single node]
2026-08-14 08:53:29.568167 | mon1 | skipping: Conditional result was False
2026-08-14 08:53:29.867741 | osd1 | skipping: Conditional result was False
2026-08-14 08:53:29.879398 | 
2026-08-14 08:53:29.879601 | LOOP [fetch-output : Ensure local output dirs]
2026-08-14 08:53:30.786412 | osd1 -> localhost | changed: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/logs/osd1"
2026-08-14 08:53:30.918748 | mon1 -> localhost | changed: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/logs/mon1"
2026-08-14 08:53:31.031472 | osd1 -> localhost | changed: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/artifacts"
2026-08-14 08:53:31.190403 | mon1 -> localhost | ok: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/artifacts"
2026-08-14 08:53:31.287948 | osd1 -> localhost | changed: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/docs"
2026-08-14 08:53:31.423826 | mon1 -> localhost | ok: "/var/lib/zuul/builds/587887a598ee4cd79e08dea0eae4b2cb/work/docs"
2026-08-14 08:53:31.424029 | mon1 -> localhost | changed: All items complete
2026-08-14 08:53:31.424096 | 
2026-08-14 08:53:31.439986 | 
2026-08-14 08:53:31.440099 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-14 08:53:32.696233 | mon1 | changed: .d..t...... ./
2026-08-14 08:53:32.706119 | osd1 | changed: .d..t...... ./
2026-08-14 08:53:33.213368 | mon1 | changed: .d..t...... ./
2026-08-14 08:53:33.237227 | osd1 | ok
2026-08-14 08:53:33.752379 | mon1 | changed: .d..t...... ./
2026-08-14 08:53:33.771622 | osd1 | ok
2026-08-14 08:53:33.771857 | osd1 | changed: All items complete
2026-08-14 08:53:33.771959 | 
2026-08-14 08:53:33.805950 | 
2026-08-14 08:53:33.806476 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-14 08:53:34.275243 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007719
2026-08-14 08:53:34.542947 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007350
2026-08-14 08:53:34.574316 | 
2026-08-14 08:53:34.574535 | PLAY [all]
2026-08-14 08:53:34.586778 | 
2026-08-14 08:53:34.587306 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-14 08:53:35.104600 | mon1 | changed
2026-08-14 08:53:35.323135 | osd1 | changed
2026-08-14 08:53:35.334410 | 
2026-08-14 08:53:35.334463 | PLAY RECAP
2026-08-14 08:53:35.334508 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-14 08:53:35.334538 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-14 08:53:35.334558 | 
2026-08-14 08:53:35.527726 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-14 08:53:35.543405 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-14 08:53:36.869172 | 
2026-08-14 08:53:36.869435 | PLAY [localhost]
2026-08-14 08:53:36.881241 | 
2026-08-14 08:53:36.881403 | TASK [Generate Zuul manifest]
2026-08-14 08:53:36.902996 | localhost | ok
2026-08-14 08:53:37.152205 | 
2026-08-14 08:53:37.175955 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-14 08:53:37.820441 | localhost | changed
2026-08-14 08:53:37.835566 | 
2026-08-14 08:53:37.850402 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-14 08:53:37.905096 | localhost | ok
2026-08-14 08:53:37.915231 | 
2026-08-14 08:53:37.915386 | TASK [Upload logs]
2026-08-14 08:53:37.936861 | localhost | ok
2026-08-14 08:53:38.120265 | 
2026-08-14 08:53:38.120473 | TASK [Set zuul-log-path fact]
2026-08-14 08:53:38.143782 | localhost | ok
2026-08-14 08:53:38.160882 | 
2026-08-14 08:53:38.161079 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-14 08:53:38.193777 | localhost | ok
2026-08-14 08:53:38.201322 | 
2026-08-14 08:53:38.201416 | TASK [upload-logs : Create log directories]
2026-08-14 08:53:38.711428 | localhost | changed
2026-08-14 08:53:38.735799 | 
2026-08-14 08:53:38.736019 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-14 08:53:39.542454 | localhost -> localhost | ok: Runtime: 0:00:00.242664
2026-08-14 08:53:39.620649 | 
2026-08-14 08:53:39.620788 | TASK [upload-logs : Upload logs to log server]
2026-08-14 08:53:40.416249 | localhost | Output suppressed because no_log was given
2026-08-14 08:53:40.423148 | 
2026-08-14 08:53:40.423240 | LOOP [upload-logs : Compress console log and json output]
2026-08-14 08:53:40.515839 | localhost | skipping: Conditional result was False
2026-08-14 08:53:40.522835 | localhost | skipping: Conditional result was False
2026-08-14 08:53:40.539235 | 
2026-08-14 08:53:40.539412 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-14 08:53:40.625295 | localhost | skipping: Conditional result was False
2026-08-14 08:53:40.625675 | 
2026-08-14 08:53:40.629380 | localhost | skipping: Conditional result was False
2026-08-14 08:53:40.688971 | 
2026-08-14 08:53:40.689155 | LOOP [upload-logs : Upload console log and json output]