2026-04-18 16:22:29.364943 | Job console starting
2026-04-18 16:22:29.392428 | Updating git repos
2026-04-18 16:22:29.475059 | Cloning repos into workspace
2026-04-18 16:22:29.519401 | Restoring repo states
2026-04-18 16:22:29.528906 | Merging changes
2026-04-18 16:22:29.784083 | Checking out repos
2026-04-18 16:22:29.828664 | Preparing playbooks
2026-04-18 16:22:31.587374 | Running Ansible setup
2026-04-18 16:22:36.850372 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:22:37.512748 | 
2026-04-18 16:22:37.512930 | PLAY [localhost]
2026-04-18 16:22:37.528591 | 
2026-04-18 16:22:37.528861 | TASK [Gathering Facts]
2026-04-18 16:22:38.536934 | localhost | ok
2026-04-18 16:22:38.550485 | 
2026-04-18 16:22:38.551835 | TASK [Setup log path fact]
2026-04-18 16:22:38.574658 | localhost | ok
2026-04-18 16:22:38.591931 | 
2026-04-18 16:22:38.592581 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:22:38.622978 | localhost | ok
2026-04-18 16:22:38.631842 | 
2026-04-18 16:22:38.631989 | TASK [emit-job-header : Print job information]
2026-04-18 16:22:38.687965 | # Job Information
2026-04-18 16:22:38.688287 | Ansible Version: 2.16.16
2026-04-18 16:22:38.688343 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-04-18 16:22:38.688377 | Pipeline: check
2026-04-18 16:22:38.688407 | Executor: 0a8996d2b663
2026-04-18 16:22:38.688437 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/98
2026-04-18 16:22:38.688471 | Event ID: aaf30690-3b42-11f1-8507-cd2bc4fcb791
2026-04-18 16:22:38.693112 | 
2026-04-18 16:22:38.693186 | LOOP [emit-job-header : Print node information]
2026-04-18 16:22:38.814332 | localhost | ok:
2026-04-18 16:22:38.815252 | localhost | # Node Information
2026-04-18 16:22:38.815303 | localhost | Inventory Hostname: mon1
2026-04-18 16:22:38.815336 | localhost | Hostname: np0000167306
2026-04-18 16:22:38.815364 | localhost | Username: zuul
2026-04-18 16:22:38.815396 | localhost | Distro: Ubuntu 24.04
2026-04-18 16:22:38.815425 | localhost | Provider: yul1
2026-04-18 16:22:38.815453 | localhost | Region: ca-ymq-1
2026-04-18 16:22:38.815479 | localhost | Label: ubuntu-noble
2026-04-18 16:22:38.815506 | localhost | Product Name: OpenStack Nova
2026-04-18 16:22:38.815584 | localhost | Interface IP: 199.204.45.22
2026-04-18 16:22:38.864790 | localhost | ok:
2026-04-18 16:22:38.865070 | localhost | # Node Information
2026-04-18 16:22:38.865136 | localhost | Inventory Hostname: osd1
2026-04-18 16:22:38.865185 | localhost | Hostname: np0000167307
2026-04-18 16:22:38.865233 | localhost | Username: zuul
2026-04-18 16:22:38.865277 | localhost | Distro: Ubuntu 24.04
2026-04-18 16:22:38.865319 | localhost | Provider: yul1
2026-04-18 16:22:38.865362 | localhost | Region: ca-ymq-1
2026-04-18 16:22:38.865403 | localhost | Label: ubuntu-noble
2026-04-18 16:22:38.865444 | localhost | Product Name: OpenStack Nova
2026-04-18 16:22:38.865488 | localhost | Interface IP: 199.204.45.4
2026-04-18 16:22:38.883875 | 
2026-04-18 16:22:38.884028 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-18 16:22:39.336807 | localhost -> localhost | changed
2026-04-18 16:22:39.346366 | 
2026-04-18 16:22:39.346468 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-18 16:22:40.438963 | localhost -> localhost | changed
2026-04-18 16:22:40.450453 | 
2026-04-18 16:22:40.450512 | PLAY [all]
2026-04-18 16:22:40.460788 | 
2026-04-18 16:22:40.460871 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-18 16:22:40.678878 | mon1 -> localhost | ok
2026-04-18 16:22:40.691630 | 
2026-04-18 16:22:40.691731 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-18 16:22:40.728771 | mon1 | ok
2026-04-18 16:22:40.733745 | osd1 | ok
2026-04-18 16:22:40.753084 | mon1 | included: /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:22:40.753157 | osd1 | included: /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:22:40.759934 | 
2026-04-18 16:22:40.759995 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-18 16:22:41.802141 | mon1 -> localhost | Generating public/private rsa key pair.
2026-04-18 16:22:41.802353 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/aa487577cedb46eea49e0c5c3bba8d99_id_rsa
2026-04-18 16:22:41.802386 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/aa487577cedb46eea49e0c5c3bba8d99_id_rsa.pub
2026-04-18 16:22:41.802410 | mon1 -> localhost | The key fingerprint is:
2026-04-18 16:22:41.802433 | mon1 -> localhost | SHA256:2lvtK7jspSrBQF/WUKCYAEkxXyoPKSPdr8p1k3ut7sk zuul-build-sshkey
2026-04-18 16:22:41.802454 | mon1 -> localhost | The key's randomart image is:
2026-04-18 16:22:41.802475 | mon1 -> localhost | +---[RSA 3072]----+
2026-04-18 16:22:41.802496 | mon1 -> localhost | |==.  .o=.        |
2026-04-18 16:22:41.802517 | mon1 -> localhost | |.o=+o.o .        |
2026-04-18 16:22:41.802538 | mon1 -> localhost | |+=++oo           |
2026-04-18 16:22:41.802559 | mon1 -> localhost | |o.= ..           |
2026-04-18 16:22:41.802579 | mon1 -> localhost | |   +  . S        |
2026-04-18 16:22:41.802598 | mon1 -> localhost | |    o. +   .     |
2026-04-18 16:22:41.802618 | mon1 -> localhost | |    o.= .oo .    |
2026-04-18 16:22:41.802637 | mon1 -> localhost | | . o.. =o*o.     |
2026-04-18 16:22:41.802656 | mon1 -> localhost | |  o  .o*Eo .o.   |
2026-04-18 16:22:41.802675 | mon1 -> localhost | +----[SHA256]-----+
2026-04-18 16:22:41.802804 | mon1 -> localhost | ok: Runtime: 0:00:00.581274
2026-04-18 16:22:41.810267 | 
2026-04-18 16:22:41.810346 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-18 16:22:41.844624 | mon1 | ok
2026-04-18 16:22:41.850016 | osd1 | ok
2026-04-18 16:22:41.864280 | mon1 | included: /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:22:41.864335 | osd1 | included: /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:22:41.875099 | 
2026-04-18 16:22:41.875163 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-18 16:22:41.908390 | mon1 | skipping: Conditional result was False
2026-04-18 16:22:41.929864 | osd1 | skipping: Conditional result was False
2026-04-18 16:22:41.941146 | 
2026-04-18 16:22:41.941218 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-18 16:22:42.469541 | mon1 | changed
2026-04-18 16:22:42.492416 | osd1 | changed
2026-04-18 16:22:42.498945 | 
2026-04-18 16:22:42.499017 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-18 16:22:42.733853 | mon1 | ok
2026-04-18 16:22:42.740836 | osd1 | ok
2026-04-18 16:22:42.747123 | 
2026-04-18 16:22:42.747202 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-18 16:22:43.329500 | mon1 | changed
2026-04-18 16:22:43.334473 | osd1 | changed
2026-04-18 16:22:43.339632 | 
2026-04-18 16:22:43.339693 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-18 16:22:44.011451 | mon1 | changed
2026-04-18 16:22:44.022046 | osd1 | changed
2026-04-18 16:22:44.027304 | 
2026-04-18 16:22:44.027371 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-18 16:22:44.054729 | mon1 | skipping: Conditional result was False
2026-04-18 16:22:44.065780 | osd1 | skipping: Conditional result was False
2026-04-18 16:22:44.077395 | 
2026-04-18 16:22:44.077471 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-18 16:22:44.395268 | mon1 -> localhost | changed
2026-04-18 16:22:44.429631 | 
2026-04-18 16:22:44.429774 | TASK [add-build-sshkey : Add back temp key]
2026-04-18 16:22:44.714746 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/aa487577cedb46eea49e0c5c3bba8d99_id_rsa (zuul-build-sshkey)
2026-04-18 16:22:44.715031 | mon1 -> localhost | ok: Runtime: 0:00:00.013952
2026-04-18 16:22:44.723262 | 
2026-04-18 16:22:44.723327 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-18 16:22:45.023153 | osd1 | ok
2026-04-18 16:22:45.028501 | mon1 | ok
2026-04-18 16:22:45.033416 | 
2026-04-18 16:22:45.033482 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-18 16:22:45.059927 | mon1 | skipping: Conditional result was False
2026-04-18 16:22:45.071507 | osd1 | skipping: Conditional result was False
2026-04-18 16:22:45.094375 | 
2026-04-18 16:22:45.094548 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-18 16:22:45.478574 | mon1 | ok
2026-04-18 16:22:45.485557 | osd1 | ok
2026-04-18 16:22:45.492024 | 
2026-04-18 16:22:45.492089 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-18 16:22:46.299326 | mon1 | Output suppressed because no_log was given
2026-04-18 16:22:46.359740 | osd1 | Output suppressed because no_log was given
2026-04-18 16:22:46.378832 | 
2026-04-18 16:22:46.378923 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-18 16:22:46.629042 | mon1 | ok: "logs"
2026-04-18 16:22:46.629344 | mon1 | ok: All items complete
2026-04-18 16:22:46.629385 | 
2026-04-18 16:22:46.635279 | osd1 | ok: "logs"
2026-04-18 16:22:46.837281 | osd1 | ok: "artifacts"
2026-04-18 16:22:46.844240 | mon1 | ok: "artifacts"
2026-04-18 16:22:47.031561 | mon1 | ok: "docs"
2026-04-18 16:22:47.038091 | osd1 | ok: "docs"
2026-04-18 16:22:47.052590 | 
2026-04-18 16:22:47.052733 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-18 16:22:47.279339 | mon1 | changed: "logs"
2026-04-18 16:22:47.279584 | mon1 | ok: All items complete
2026-04-18 16:22:47.279612 | 
2026-04-18 16:22:47.285238 | osd1 | changed: "logs"
2026-04-18 16:22:47.481860 | mon1 | changed: "artifacts"
2026-04-18 16:22:47.491989 | osd1 | changed: "artifacts"
2026-04-18 16:22:47.677832 | mon1 | changed: "docs"
2026-04-18 16:22:47.688442 | osd1 | changed: "docs"
2026-04-18 16:22:47.715710 | 
2026-04-18 16:22:47.715836 | PLAY RECAP
2026-04-18 16:22:47.715889 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:22:47.715919 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:22:47.715946 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:22:47.715964 | 
2026-04-18 16:22:47.871333 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:22:47.874323 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:22:48.469394 | 
2026-04-18 16:22:48.469558 | PLAY [all]
2026-04-18 16:22:48.481915 | 
2026-04-18 16:22:48.481995 | TASK [setup-uv : Extract archive]
2026-04-18 16:22:50.893695 | mon1 | changed
2026-04-18 16:22:50.914277 | osd1 | changed
2026-04-18 16:22:50.920503 | 
2026-04-18 16:22:50.920586 | TASK [setup-uv : Print version]
2026-04-18 16:22:50.503902 | osd1 | uv 0.8.13
2026-04-18 16:22:50.208099 | mon1 | uv 0.8.13
2026-04-18 16:22:51.488569 | osd1 | ok: Runtime: 0:00:00.015092
2026-04-18 16:22:51.500326 | mon1 | ok: Runtime: 0:00:00.015091
2026-04-18 16:22:51.512688 | 
2026-04-18 16:22:51.512766 | PLAY RECAP
2026-04-18 16:22:51.512816 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:22:51.512843 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:22:51.512862 | 
2026-04-18 16:22:51.672568 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:22:51.677653 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:22:52.256768 | 
2026-04-18 16:22:52.256907 | PLAY [all]
2026-04-18 16:22:52.268927 | 
2026-04-18 16:22:52.269034 | TASK [Copy inventory file for Zuul]
2026-04-18 16:22:53.240292 | mon1 | changed
2026-04-18 16:22:53.246011 | 
2026-04-18 16:22:53.246100 | TASK [Switch "ansible_host" to private IP]
2026-04-18 16:22:53.648260 | mon1 | changed: 2 replacements made
2026-04-18 16:22:53.656173 | 
2026-04-18 16:22:53.656246 | TASK [Run Molecule scenario]
2026-04-18 16:22:53.044471 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-04-18 16:22:53.044664 | mon1 | Creating virtual environment at: .venv
2026-04-18 16:22:54.434299 | mon1 | Downloading netaddr (2.2MiB)
2026-04-18 16:22:54.434474 | mon1 | Downloading ansible-core (2.1MiB)
2026-04-18 16:22:54.436836 | mon1 | Downloading cryptography (4.3MiB)
2026-04-18 16:22:54.437567 | mon1 | Downloading pygments (1.2MiB)
2026-04-18 16:22:54.636592 | mon1 |  Downloading netaddr
2026-04-18 16:22:54.650461 | mon1 |  Downloading cryptography
2026-04-18 16:22:54.715946 | mon1 |  Downloading pygments
2026-04-18 16:22:54.885355 | mon1 |  Downloading ansible-core
2026-04-18 16:22:54.933427 | mon1 | Installed 37 packages in 47ms
2026-04-18 16:22:55.733829 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-04-18 16:22:55.733865 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-04-18 16:22:56.394132 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-18 16:22:56.394198 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-04-18 16:23:08.481736 | mon1 | INFO     [default > dependency] Executing
2026-04-18 16:23:08.481856 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-04-18 16:23:08.482076 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-04-18 16:23:08.482212 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-18 16:23:08.488072 | mon1 | INFO     [default > cleanup] Executing
2026-04-18 16:23:08.488399 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:23:08.494084 | mon1 | INFO     [default > destroy] Executing
2026-04-18 16:23:08.494184 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-18 16:23:08.494257 | mon1 | INFO     [default > destroy] Executed: Successful
2026-04-18 16:23:08.499871 | mon1 | INFO     [default > syntax] Executing
2026-04-18 16:23:09.594588 | mon1 |
2026-04-18 16:23:09.594705 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:23:09.647157 | mon1 | INFO     [default > syntax] Executed: Successful
2026-04-18 16:23:09.656321 | mon1 | INFO     [default > create] Executing
2026-04-18 16:23:09.673408 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:23:09.682796 | mon1 | INFO     [default > prepare] Executing
2026-04-18 16:23:10.583904 | mon1 |
2026-04-18 16:23:10.584218 | mon1 | PLAY [Prepare] *****************************************************************
2026-04-18 16:23:10.584514 | mon1 |
2026-04-18 16:23:10.584771 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:23:10.585079 | mon1 | Saturday 18 April 2026  16:23:10 +0000 (0:00:00.035)       0:00:00.035 ********
2026-04-18 16:23:11.911724 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-18 16:23:11.911797 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:23:11.911839 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:23:11.911962 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:23:11.912088 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:23:11.915641 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:23:11.915937 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:23:11.916332 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:23:11.916546 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:23:11.916778 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:23:11.923929 | mon1 | ok: [osd1]
2026-04-18 16:23:11.924203 | mon1 | ok: [mon1]
2026-04-18 16:23:11.924432 | mon1 |
2026-04-18 16:23:11.924679 | mon1 | TASK [Configure short hostname] ************************************************
2026-04-18 16:23:11.924931 | mon1 | Saturday 18 April 2026  16:23:11 +0000 (0:00:01.341)       0:00:01.376 ********
2026-04-18 16:23:12.721604 | mon1 | changed: [mon1]
2026-04-18 16:23:12.721819 | mon1 | changed: [osd1]
2026-04-18 16:23:12.722084 | mon1 |
2026-04-18 16:23:12.722480 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-18 16:23:12.722771 | mon1 | Saturday 18 April 2026  16:23:12 +0000 (0:00:00.796)       0:00:02.173 ********
2026-04-18 16:23:13.035575 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-18 16:23:13.036267 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-04-18 16:23:13.036290 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-18 16:23:13.049712 | mon1 | changed: [osd1]
2026-04-18 16:23:13.049875 | mon1 | changed: [mon1]
2026-04-18 16:23:13.050040 | mon1 |
2026-04-18 16:23:13.050204 | mon1 | TASK [Update apt cache] ********************************************************
2026-04-18 16:23:13.050363 | mon1 | Saturday 18 April 2026  16:23:13 +0000 (0:00:00.328)       0:00:02.502 ********
2026-04-18 16:23:30.685222 | mon1 | changed: [osd1]
2026-04-18 16:23:30.685448 | mon1 | changed: [mon1]
2026-04-18 16:23:30.685695 | mon1 |
2026-04-18 16:23:30.685978 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-04-18 16:23:30.686245 | mon1 |
2026-04-18 16:23:30.686508 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:23:30.686784 | mon1 | Saturday 18 April 2026  16:23:30 +0000 (0:00:17.635)       0:00:20.137 ********
2026-04-18 16:23:31.585250 | mon1 | ok: [osd1]
2026-04-18 16:23:31.585860 | mon1 |
2026-04-18 16:23:31.585886 | mon1 | TASK [Install depedencies] *****************************************************
2026-04-18 16:23:31.585908 | mon1 | Saturday 18 April 2026  16:23:31 +0000 (0:00:00.897)       0:00:21.034 ********
2026-04-18 16:23:53.220222 | mon1 | changed: [osd1]
2026-04-18 16:23:53.220395 | mon1 |
2026-04-18 16:23:53.220675 | mon1 | TASK [Start up service] ********************************************************
2026-04-18 16:23:53.221080 | mon1 | Saturday 18 April 2026  16:23:53 +0000 (0:00:21.636)       0:00:42.671 ********
2026-04-18 16:23:53.918430 | mon1 | ok: [osd1]
2026-04-18 16:23:53.918737 | mon1 |
2026-04-18 16:23:53.919096 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-04-18 16:23:53.919409 | mon1 | Saturday 18 April 2026  16:23:53 +0000 (0:00:00.698)       0:00:43.370 ********
2026-04-18 16:23:54.296900 | mon1 | ok: [osd1]
2026-04-18 16:23:54.297165 | mon1 |
2026-04-18 16:23:54.297442 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-18 16:23:54.297714 | mon1 | Saturday 18 April 2026  16:23:54 +0000 (0:00:00.378)       0:00:43.748 ********
2026-04-18 16:23:55.111807 | mon1 | changed: [osd1]
2026-04-18 16:23:55.112056 | mon1 |
2026-04-18 16:23:55.112474 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-04-18 16:23:55.112808 | mon1 | Saturday 18 April 2026  16:23:55 +0000 (0:00:00.815)       0:00:44.564 ********
2026-04-18 16:23:55.371534 | mon1 | ok: [osd1]
2026-04-18 16:23:55.371590 | mon1 |
2026-04-18 16:23:55.371779 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-04-18 16:23:55.371954 | mon1 | Saturday 18 April 2026  16:23:55 +0000 (0:00:00.259)       0:00:44.823 ********
2026-04-18 16:23:55.401330 | mon1 | skipping: [osd1]
2026-04-18 16:23:55.401429 | mon1 |
2026-04-18 16:23:55.401587 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-04-18 16:23:55.401738 | mon1 | Saturday 18 April 2026  16:23:55 +0000 (0:00:00.030)       0:00:44.853 ********
2026-04-18 16:23:56.102748 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:23:56.102947 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:23:56.103287 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:23:56.103548 | mon1 |
2026-04-18 16:23:56.103845 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-04-18 16:23:56.104156 | mon1 | Saturday 18 April 2026  16:23:56 +0000 (0:00:00.701)       0:00:45.554 ********
2026-04-18 16:23:56.891834 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:23:56.891984 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:23:56.892181 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:23:56.892436 | mon1 |
2026-04-18 16:23:56.892676 | mon1 | TASK [Start loop devices] ******************************************************
2026-04-18 16:23:56.892932 | mon1 | Saturday 18 April 2026  16:23:56 +0000 (0:00:00.789)       0:00:46.343 ********
2026-04-18 16:23:57.727553 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:23:57.727664 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:23:57.727675 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:23:57.727689 | mon1 |
2026-04-18 16:23:57.728200 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-04-18 16:23:57.728232 | mon1 | Saturday 18 April 2026  16:23:57 +0000 (0:00:00.835)       0:00:47.179 ********
2026-04-18 16:24:00.252833 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:24:00.252952 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:24:00.253180 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:24:00.253322 | mon1 |
2026-04-18 16:24:00.253476 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-04-18 16:24:00.254210 | mon1 | Saturday 18 April 2026  16:24:00 +0000 (0:00:02.525)       0:00:49.704 ********
2026-04-18 16:24:01.609824 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-04-18 16:24:01.610091 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-04-18 16:24:01.610364 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-04-18 16:24:01.610569 | mon1 |
2026-04-18 16:24:01.610804 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:24:01.611123 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-18 16:24:01.611431 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-18 16:24:01.611640 | mon1 |
2026-04-18 16:24:01.611864 | mon1 |
2026-04-18 16:24:01.612147 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:24:01.612441 | mon1 | Saturday 18 April 2026  16:24:01 +0000 (0:00:01.356)       0:00:51.061 ********
2026-04-18 16:24:01.612662 | mon1 | ===============================================================================
2026-04-18 16:24:01.612910 | mon1 | Install depedencies ---------------------------------------------------- 21.64s
2026-04-18 16:24:01.613216 | mon1 | Update apt cache ------------------------------------------------------- 17.64s
2026-04-18 16:24:01.613574 | mon1 | Create a volume group for each loop device ------------------------------ 2.53s
2026-04-18 16:24:01.613880 | mon1 | Create a logical volume for each loop device ---------------------------- 1.36s
2026-04-18 16:24:01.614207 | mon1 | Gathering Facts --------------------------------------------------------- 1.34s
2026-04-18 16:24:01.614440 | mon1 | Gathering Facts --------------------------------------------------------- 0.90s
2026-04-18 16:24:01.614691 | mon1 | Start loop devices ------------------------------------------------------ 0.84s
2026-04-18 16:24:01.614947 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.82s
2026-04-18 16:24:01.615235 | mon1 | Configure short hostname ------------------------------------------------ 0.80s
2026-04-18 16:24:01.615520 | mon1 | Set permissions on loopback devices ------------------------------------- 0.79s
2026-04-18 16:24:01.615746 | mon1 | Create devices for Ceph ------------------------------------------------- 0.70s
2026-04-18 16:24:01.616022 | mon1 | Start up service -------------------------------------------------------- 0.70s
2026-04-18 16:24:01.616281 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.38s
2026-04-18 16:24:01.616537 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s
2026-04-18 16:24:01.616805 | mon1 | Get list of all loopback devices ---------------------------------------- 0.26s
2026-04-18 16:24:01.617124 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-04-18 16:24:01.687821 | mon1 | INFO     [default > prepare] Executed: Successful
2026-04-18 16:24:01.697539 | mon1 | INFO     [default > converge] Executing
2026-04-18 16:24:02.653384 | mon1 |
2026-04-18 16:24:02.653626 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-18 16:24:02.653856 | mon1 |
2026-04-18 16:24:02.654204 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:24:02.654498 | mon1 | Saturday 18 April 2026  16:24:02 +0000 (0:00:00.051)       0:00:00.051 ********
2026-04-18 16:24:03.738809 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:24:03.739084 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:24:03.739341 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:24:03.739569 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:24:03.739823 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:24:03.752677 | mon1 | ok: [mon1]
2026-04-18 16:24:03.752890 | mon1 |
2026-04-18 16:24:03.753217 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:24:03.753447 | mon1 | Saturday 18 April 2026  16:24:03 +0000 (0:00:01.099)       0:00:01.150 ********
2026-04-18 16:24:04.106296 | mon1 | ok: [mon1]
2026-04-18 16:24:04.106360 | mon1 |
2026-04-18 16:24:04.106504 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:24:04.106649 | mon1 | Saturday 18 April 2026  16:24:04 +0000 (0:00:00.353)       0:00:01.504 ********
2026-04-18 16:24:04.150872 | mon1 | skipping: [mon1]
2026-04-18 16:24:04.151037 | mon1 |
2026-04-18 16:24:04.151250 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-18 16:24:04.151440 | mon1 | Saturday 18 April 2026  16:24:04 +0000 (0:00:00.044)       0:00:01.548 ********
2026-04-18 16:24:04.528457 | mon1 | changed: [mon1]
2026-04-18 16:24:04.528721 | mon1 |
2026-04-18 16:24:04.529034 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:24:04.529326 | mon1 | Saturday 18 April 2026  16:24:04 +0000 (0:00:00.377)       0:00:01.926 ********
2026-04-18 16:24:04.643849 | mon1 | ok: [mon1] => {
2026-04-18 16:24:04.644135 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-18 16:24:04.644388 | mon1 | }
2026-04-18 16:24:04.644602 | mon1 |
2026-04-18 16:24:04.644857 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:24:04.645147 | mon1 | Saturday 18 April 2026  16:24:04 +0000 (0:00:00.114)       0:00:02.041 ********
2026-04-18 16:24:05.453666 | mon1 | changed: [mon1]
2026-04-18 16:24:05.453834 | mon1 |
2026-04-18 16:24:05.454186 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:24:05.454442 | mon1 | Saturday 18 April 2026  16:24:05 +0000 (0:00:00.810)       0:00:02.851 ********
2026-04-18 16:24:05.504516 | mon1 | skipping: [mon1]
2026-04-18 16:24:05.504596 | mon1 |
2026-04-18 16:24:05.504712 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:24:05.504829 | mon1 | Saturday 18 April 2026  16:24:05 +0000 (0:00:00.051)       0:00:02.902 ********
2026-04-18 16:24:05.553316 | mon1 | skipping: [mon1]
2026-04-18 16:24:05.553396 | mon1 |
2026-04-18 16:24:05.553526 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:24:05.553646 | mon1 | Saturday 18 April 2026  16:24:05 +0000 (0:00:00.048)       0:00:02.951 ********
2026-04-18 16:24:05.820938 | mon1 | ok: [mon1]
2026-04-18 16:24:05.821063 | mon1 |
2026-04-18 16:24:05.821299 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:24:05.821584 | mon1 | Saturday 18 April 2026  16:24:05 +0000 (0:00:00.267)       0:00:03.218 ********
2026-04-18 16:24:07.234508 | mon1 | ok: [mon1]
2026-04-18 16:24:07.234779 | mon1 |
2026-04-18 16:24:07.235173 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:24:07.235506 | mon1 | Saturday 18 April 2026  16:24:07 +0000 (0:00:01.413)       0:00:04.632 ********
2026-04-18 16:24:07.437668 | mon1 | ok: [mon1] => {
2026-04-18 16:24:07.437886 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.2/containerd-2.2.2-linux-amd64.tar.gz"
2026-04-18 16:24:07.438182 | mon1 | }
2026-04-18 16:24:07.438420 | mon1 |
2026-04-18 16:24:07.438690 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:24:07.439093 | mon1 | Saturday 18 April 2026  16:24:07 +0000 (0:00:00.203)       0:00:04.835 ********
2026-04-18 16:24:08.491266 | mon1 | changed: [mon1]
2026-04-18 16:24:08.491319 | mon1 |
2026-04-18 16:24:08.491330 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:24:08.491340 | mon1 | Saturday 18 April 2026  16:24:08 +0000 (0:00:01.052)       0:00:05.888 ********
2026-04-18 16:24:11.956222 | mon1 | changed: [mon1]
2026-04-18 16:24:11.956291 | mon1 |
2026-04-18 16:24:11.956923 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-04-18 16:24:11.956949 | mon1 | Saturday 18 April 2026  16:24:11 +0000 (0:00:03.465)       0:00:09.353 ********
2026-04-18 16:24:11.996094 | mon1 | skipping: [mon1]
2026-04-18 16:24:11.996322 | mon1 |
2026-04-18 16:24:11.996583 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-04-18 16:24:11.996831 | mon1 | Saturday 18 April 2026  16:24:11 +0000 (0:00:00.039)       0:00:09.393 ********
2026-04-18 16:24:12.031571 | mon1 | skipping: [mon1]
2026-04-18 16:24:12.031783 | mon1 |
2026-04-18 16:24:12.032075 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-04-18 16:24:12.032350 | mon1 | Saturday 18 April 2026  16:24:12 +0000 (0:00:00.036)       0:00:09.429 ********
2026-04-18 16:24:12.068458 | mon1 | skipping: [mon1]
2026-04-18 16:24:12.068639 | mon1 |
2026-04-18 16:24:12.068912 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-04-18 16:24:12.069262 | mon1 | Saturday 18 April 2026  16:24:12 +0000 (0:00:00.036)       0:00:09.465 ********
2026-04-18 16:24:20.728033 | mon1 | changed: [mon1]
2026-04-18 16:24:20.728065 | mon1 |
2026-04-18 16:24:20.728163 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-04-18 16:24:20.728368 | mon1 | Saturday 18 April 2026  16:24:20 +0000 (0:00:08.659)       0:00:18.125 ********
2026-04-18 16:24:21.444706 | mon1 | changed: [mon1]
2026-04-18 16:24:21.444980 | mon1 |
2026-04-18 16:24:21.445283 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-04-18 16:24:21.445539 | mon1 | Saturday 18 April 2026  16:24:21 +0000 (0:00:00.716)       0:00:18.842 ********
2026-04-18 16:24:22.664621 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-04-18 16:24:22.664703 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-04-18 16:24:22.664792 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-04-18 16:24:22.664912 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-04-18 16:24:22.665054 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-04-18 16:24:22.665160 | mon1 |
2026-04-18 16:24:22.665270 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-04-18 16:24:22.665399 | mon1 | Saturday 18 April 2026  16:24:22 +0000 (0:00:01.219)       0:00:20.062 ********
2026-04-18 16:24:23.460102 | mon1 | changed: [mon1]
2026-04-18 16:24:23.461554 | mon1 |
2026-04-18 16:24:23.461612 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-04-18 16:24:23.461626 | mon1 | Saturday 18 April 2026  16:24:23 +0000 (0:00:00.785)       0:00:20.847 ********
2026-04-18 16:24:23.461639 | mon1 |
2026-04-18 16:24:23.461651 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-18 16:24:23.461662 | mon1 | Saturday 18 April 2026  16:24:23 +0000 (0:00:00.009)       0:00:20.857 ********
2026-04-18 16:24:24.617156 | mon1 | ok: [mon1]
2026-04-18 16:24:24.617224 | mon1 |
2026-04-18 16:24:24.617751 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-04-18 16:24:24.617809 | mon1 | Saturday 18 April 2026  16:24:24 +0000 (0:00:01.157)       0:00:22.014 ********
2026-04-18 16:24:25.214517 | mon1 | changed: [mon1]
2026-04-18 16:24:25.214672 | mon1 |
2026-04-18 16:24:25.214688 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-04-18 16:24:25.214992 | mon1 | Saturday 18 April 2026  16:24:25 +0000 (0:00:00.597)       0:00:22.612 ********
2026-04-18 16:24:25.912804 | mon1 | changed: [mon1]
2026-04-18 16:24:25.912863 | mon1 |
2026-04-18 16:24:25.912877 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:24:25.912889 | mon1 | Saturday 18 April 2026  16:24:25 +0000 (0:00:00.697)       0:00:23.309 ********
2026-04-18 16:24:26.225901 | mon1 | ok: [mon1]
2026-04-18 16:24:26.225971 | mon1 |
2026-04-18 16:24:26.225983 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:24:26.226026 | mon1 | Saturday 18 April 2026  16:24:26 +0000 (0:00:00.313)       0:00:23.622 ********
2026-04-18 16:24:26.299023 | mon1 | ok: [mon1] => {
2026-04-18 16:24:26.299077 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-04-18 16:24:26.299087 | mon1 | }
2026-04-18 16:24:26.299097 | mon1 |
2026-04-18 16:24:26.299106 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:24:26.299115 | mon1 | Saturday 18 April 2026  16:24:26 +0000 (0:00:00.072)       0:00:23.694 ********
2026-04-18 16:24:27.225623 | mon1 | changed: [mon1]
2026-04-18 16:24:27.225684 | mon1 |
2026-04-18 16:24:27.225695 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-04-18 16:24:27.225705 | mon1 | Saturday 18 April 2026  16:24:27 +0000 (0:00:00.926)       0:00:24.621 ********
2026-04-18 16:24:32.946150 | mon1 | changed: [mon1]
2026-04-18 16:24:32.946223 | mon1 |
2026-04-18 16:24:32.946237 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-04-18 16:24:32.946256 | mon1 | Saturday 18 April 2026  16:24:32 +0000 (0:00:05.721)       0:00:30.342 ********
2026-04-18 16:24:34.168480 | mon1 | ok: [mon1]
2026-04-18 16:24:34.168561 | mon1 |
2026-04-18 16:24:34.168575 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-04-18 16:24:34.168588 | mon1 | Saturday 18 April 2026  16:24:34 +0000 (0:00:01.222)       0:00:31.564 ********
2026-04-18 16:24:35.039789 | mon1 | changed: [mon1]
2026-04-18 16:24:35.039837 | mon1 |
2026-04-18 16:24:35.039965 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-04-18 16:24:35.040136 | mon1 | Saturday 18 April 2026  16:24:35 +0000 (0:00:00.872)       0:00:32.437 ********
2026-04-18 16:24:35.639175 | mon1 | changed: [mon1]
2026-04-18 16:24:35.639244 | mon1 |
2026-04-18 16:24:35.639731 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-04-18 16:24:35.639790 | mon1 | Saturday 18 April 2026  16:24:35 +0000 (0:00:00.599)       0:00:33.036 ********
2026-04-18 16:24:36.346224 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-04-18 16:24:36.346295 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-04-18 16:24:36.346308 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-04-18 16:24:36.346321 | mon1 |
2026-04-18 16:24:36.346333 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-04-18 16:24:36.346345 | mon1 | Saturday 18 April 2026  16:24:36 +0000 (0:00:00.706)       0:00:33.742 ********
2026-04-18 16:24:36.916141 | mon1 | changed: [mon1]
2026-04-18 16:24:36.916215 | mon1 |
2026-04-18 16:24:36.916800 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-04-18 16:24:36.916881 | mon1 | Saturday 18 April 2026  16:24:36 +0000 (0:00:00.570)       0:00:34.312 ********
2026-04-18 16:24:37.530667 | mon1 | changed: [mon1]
2026-04-18 16:24:37.530746 | mon1 |
2026-04-18 16:24:37.530760 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-04-18 16:24:37.530775 | mon1 | Saturday 18 April 2026  16:24:37 +0000 (0:00:00.605)       0:00:34.918 ********
2026-04-18 16:24:37.530787 | mon1 |
2026-04-18 16:24:37.530798 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-04-18 16:24:37.530810 | mon1 | Saturday 18 April 2026  16:24:37 +0000 (0:00:00.008)       0:00:34.926 ********
2026-04-18 16:24:38.435744 | mon1 | ok: [mon1]
2026-04-18 16:24:38.435783 | mon1 |
2026-04-18 16:24:38.435788 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-04-18 16:24:38.435793 | mon1 | Saturday 18 April 2026  16:24:38 +0000 (0:00:00.903)       0:00:35.830 ********
2026-04-18 16:24:39.797951 | mon1 | changed: [mon1]
2026-04-18 16:24:39.798051 | mon1 |
2026-04-18 16:24:39.798261 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-04-18 16:24:39.798301 | mon1 | Saturday 18 April 2026  16:24:39 +0000 (0:00:01.366)       0:00:37.196 ********
2026-04-18 16:24:40.557110 | mon1 | changed: [mon1]
2026-04-18 16:24:40.557188 | mon1 |
2026-04-18 16:24:40.557763 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-04-18 16:24:40.557830 | mon1 | Saturday 18 April 2026  16:24:40 +0000 (0:00:00.757)       0:00:37.953 ********
2026-04-18 16:24:40.620892 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-04-18 16:24:40.620940 | mon1 |
2026-04-18 16:24:40.620946 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-04-18 16:24:40.620952 | mon1 | Saturday 18 April 2026  16:24:40 +0000 (0:00:00.063)       0:00:38.017 ********
2026-04-18 16:25:00.041800 | mon1 | changed: [mon1]
2026-04-18 16:25:00.041838 | mon1 |
2026-04-18 16:25:00.041845 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-04-18 16:25:00.041851 | mon1 | Saturday 18 April 2026  16:25:00 +0000 (0:00:19.421)       0:00:57.438 ********
2026-04-18 16:25:00.857784 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-04-18 16:25:00.857842 | mon1 | ok: [mon1] => (item=ssh)
2026-04-18 16:25:00.857856 | mon1 |
2026-04-18 16:25:00.857869 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-04-18 16:25:00.857881 | mon1 | Saturday 18 April 2026  16:25:00 +0000 (0:00:00.814)       0:00:58.253 ********
2026-04-18 16:25:01.223821 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-21.0.0/el9/noarch/cephadm"}
2026-04-18 16:25:01.227449 | mon1 |
2026-04-18 16:25:01.227521 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:25:01.227651 | mon1 | mon1                       : ok=33   changed=20   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-04-18 16:25:01.227754 | mon1 |
2026-04-18 16:25:01.227853 | mon1 |
2026-04-18 16:25:01.227965 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:25:01.230063 | mon1 | Saturday 18 April 2026  16:25:01 +0000 (0:00:00.371)       0:00:58.625 ********
2026-04-18 16:25:01.230108 | mon1 | ===============================================================================
2026-04-18 16:25:01.230114 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.42s
2026-04-18 16:25:01.230119 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.66s
2026-04-18 16:25:01.230125 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 5.72s
2026-04-18 16:25:01.230130 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.47s
2026-04-18 16:25:01.230135 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 2.06s
2026-04-18 16:25:01.230140 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.41s
2026-04-18 16:25:01.230146 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.37s
2026-04-18 16:25:01.230151 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.22s
2026-04-18 16:25:01.230156 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.22s
2026-04-18 16:25:01.230161 | mon1 | Gathering Facts --------------------------------------------------------- 1.10s
2026-04-18 16:25:01.230166 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 1.05s
2026-04-18 16:25:01.230171 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.93s
2026-04-18 16:25:01.230190 | mon1 | vexxhost.containers.docker : Ensure group "docker" exists --------------- 0.87s
2026-04-18 16:25:01.230194 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.81s
2026-04-18 16:25:01.230198 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.81s
2026-04-18 16:25:01.230202 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.79s
2026-04-18 16:25:01.230256 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.76s
2026-04-18 16:25:01.230399 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.72s
2026-04-18 16:25:01.230538 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.71s
2026-04-18 16:25:01.230673 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.70s
2026-04-18 16:25:01.328125 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:25:01.328277 | mon1 | ERROR    [default > converge] Executed: Failed
2026-04-18 16:25:01.328381 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:25:11.881811 | mon1 | ERROR
2026-04-18 16:25:11.882008 | mon1 | {
2026-04-18 16:25:11.882041 | mon1 |   "delta": "0:02:08.427556",
2026-04-18 16:25:11.882062 | mon1 |   "end": "2026-04-18 16:25:01.393911",
2026-04-18 16:25:11.882080 | mon1 |   "msg": "non-zero return code",
2026-04-18 16:25:11.882098 | mon1 |   "rc": 2,
2026-04-18 16:25:11.882118 | mon1 |   "start": "2026-04-18 16:22:52.966355"
2026-04-18 16:25:11.882135 | mon1 | }
failure
2026-04-18 16:25:11.888230 | 
2026-04-18 16:25:11.888280 | PLAY RECAP
2026-04-18 16:25:11.888328 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:25:11.888349 | 
2026-04-18 16:25:12.022182 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:25:12.025173 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:25:12.564483 | 
2026-04-18 16:25:12.564611 | PLAY [all]
2026-04-18 16:25:12.576436 | 
2026-04-18 16:25:12.576508 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-18 16:25:12.630462 | mon1 | ok
2026-04-18 16:25:12.636697 | osd1 | ok
2026-04-18 16:25:12.642509 | 
2026-04-18 16:25:12.642582 | TASK [fetch-output : Set log path for single node]
2026-04-18 16:25:12.665250 | mon1 | skipping: Conditional result was False
2026-04-18 16:25:12.676240 | osd1 | skipping: Conditional result was False
2026-04-18 16:25:12.688094 | 
2026-04-18 16:25:12.688244 | LOOP [fetch-output : Ensure local output dirs]
2026-04-18 16:25:13.043522 | mon1 -> localhost | changed: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/logs/mon1"
2026-04-18 16:25:13.045269 | osd1 -> localhost | changed: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/logs/osd1"
2026-04-18 16:25:13.250371 | osd1 -> localhost | ok: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/artifacts"
2026-04-18 16:25:13.251881 | mon1 -> localhost | changed: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/artifacts"
2026-04-18 16:25:13.458909 | osd1 -> localhost | changed: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/docs"
2026-04-18 16:25:13.461661 | mon1 -> localhost | ok: "/var/lib/zuul/builds/aa487577cedb46eea49e0c5c3bba8d99/work/docs"
2026-04-18 16:25:13.484484 | 
2026-04-18 16:25:13.484554 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-18 16:25:14.106251 | mon1 | changed: .d..t...... ./
2026-04-18 16:25:14.106659 | mon1 | changed: All items complete
2026-04-18 16:25:14.106705 | 
2026-04-18 16:25:14.114684 | osd1 | changed: .d..t...... ./
2026-04-18 16:25:14.552796 | mon1 | changed: .d..t...... ./
2026-04-18 16:25:14.571592 | osd1 | ok
2026-04-18 16:25:15.035166 | mon1 | changed: .d..t...... ./
2026-04-18 16:25:15.042206 | osd1 | ok
2026-04-18 16:25:15.066631 | 
2026-04-18 16:25:15.066749 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-18 16:25:15.457319 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007349
2026-04-18 16:25:15.457572 | mon1 -> localhost | changed: All items complete
2026-04-18 16:25:15.457618 | 
2026-04-18 16:25:15.677752 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007794
2026-04-18 16:25:15.704262 | 
2026-04-18 16:25:15.704361 | PLAY [all]
2026-04-18 16:25:15.710513 | 
2026-04-18 16:25:15.710575 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-18 16:25:16.211783 | mon1 | changed
2026-04-18 16:25:16.394105 | osd1 | changed
2026-04-18 16:25:16.404282 | 
2026-04-18 16:25:16.404330 | PLAY RECAP
2026-04-18 16:25:16.404376 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:25:16.404404 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:25:16.404423 | 
2026-04-18 16:25:16.521754 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:25:16.527034 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-18 16:25:17.085191 | 
2026-04-18 16:25:17.085518 | PLAY [localhost]
2026-04-18 16:25:17.095267 | 
2026-04-18 16:25:17.095334 | TASK [Generate Zuul manifest]
2026-04-18 16:25:17.117752 | localhost | ok
2026-04-18 16:25:17.131315 | 
2026-04-18 16:25:17.131392 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-18 16:25:17.447555 | localhost | changed
2026-04-18 16:25:17.458496 | 
2026-04-18 16:25:17.458569 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-18 16:25:17.489218 | localhost | ok
2026-04-18 16:25:17.499219 | 
2026-04-18 16:25:17.499303 | TASK [Upload logs]
2026-04-18 16:25:17.521370 | localhost | ok
2026-04-18 16:25:17.576321 | 
2026-04-18 16:25:17.576417 | TASK [Set zuul-log-path fact]
2026-04-18 16:25:17.597467 | localhost | ok
2026-04-18 16:25:17.609669 | 
2026-04-18 16:25:17.609731 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:25:17.640506 | localhost | ok
2026-04-18 16:25:17.648987 | 
2026-04-18 16:25:17.649048 | TASK [upload-logs : Create log directories]
2026-04-18 16:25:18.035902 | localhost | changed
2026-04-18 16:25:18.042785 | 
2026-04-18 16:25:18.042851 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-18 16:25:18.428776 | localhost -> localhost | ok: Runtime: 0:00:00.005515
2026-04-18 16:25:18.434890 | 
2026-04-18 16:25:18.434955 | TASK [upload-logs : Upload logs to log server]
2026-04-18 16:25:18.882668 | localhost | Output suppressed because no_log was given
2026-04-18 16:25:18.886406 | 
2026-04-18 16:25:18.886467 | LOOP [upload-logs : Compress console log and json output]
2026-04-18 16:25:18.927648 | localhost | skipping: Conditional result was False
2026-04-18 16:25:18.934574 | localhost | skipping: Conditional result was False
2026-04-18 16:25:18.949543 | 
2026-04-18 16:25:18.949736 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-18 16:25:18.987670 | localhost | skipping: Conditional result was False
2026-04-18 16:25:18.987975 | 
2026-04-18 16:25:18.991845 | localhost | skipping: Conditional result was False
2026-04-18 16:25:19.000295 | 
2026-04-18 16:25:19.000409 | LOOP [upload-logs : Upload console log and json output]