2026-03-26 14:16:10.724393 | Job console starting
2026-03-26 14:16:10.852723 | Updating git repos
2026-03-26 14:16:10.890026 | Cloning repos into workspace
2026-03-26 14:16:11.136315 | Restoring repo states
2026-03-26 14:16:11.143753 | Merging changes
2026-03-26 14:16:11.527086 | Checking out repos
2026-03-26 14:16:11.650075 | Preparing playbooks
2026-03-26 14:16:13.825543 | Running Ansible setup
2026-03-26 14:16:18.394704 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-26 14:16:18.984694 | 
2026-03-26 14:16:18.984909 | PLAY [localhost]
2026-03-26 14:16:18.993340 | 
2026-03-26 14:16:18.993421 | TASK [Gathering Facts]
2026-03-26 14:16:19.884164 | localhost | ok
2026-03-26 14:16:19.893286 | 
2026-03-26 14:16:19.893366 | TASK [Setup log path fact]
2026-03-26 14:16:19.912493 | localhost | ok
2026-03-26 14:16:19.927123 | 
2026-03-26 14:16:19.927204 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-26 14:16:19.957996 | localhost | ok
2026-03-26 14:16:19.966683 | 
2026-03-26 14:16:19.966750 | TASK [emit-job-header : Print job information]
2026-03-26 14:16:20.007089 | # Job Information
2026-03-26 14:16:20.007315 | Ansible Version: 2.16.16
2026-03-26 14:16:20.007365 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-03-26 14:16:20.007398 | Pipeline: check
2026-03-26 14:16:20.007426 | Executor: 0a8996d2b663
2026-03-26 14:16:20.007468 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/98
2026-03-26 14:16:20.007502 | Event ID: 1e5264f0-291e-11f1-8b7d-c26118e25f19
2026-03-26 14:16:20.012290 | 
2026-03-26 14:16:20.012381 | LOOP [emit-job-header : Print node information]
2026-03-26 14:16:20.124290 | localhost | ok:
2026-03-26 14:16:20.124614 | localhost | # Node Information
2026-03-26 14:16:20.124680 | localhost | Inventory Hostname: mon1
2026-03-26 14:16:20.124730 | localhost | Hostname: np0000161064
2026-03-26 14:16:20.124775 | localhost | Username: zuul
2026-03-26 14:16:20.124825 | localhost | Distro: Ubuntu 24.04
2026-03-26 14:16:20.124869 | localhost | Provider: yul1
2026-03-26 14:16:20.124911 | localhost | Region: ca-ymq-1
2026-03-26 14:16:20.124952 | localhost | Label: ubuntu-noble
2026-03-26 14:16:20.125079 | localhost | Product Name: OpenStack Nova
2026-03-26 14:16:20.125165 | localhost | Interface IP: 199.204.45.156
2026-03-26 14:16:20.178211 | localhost | ok:
2026-03-26 14:16:20.178318 | localhost | # Node Information
2026-03-26 14:16:20.178347 | localhost | Inventory Hostname: osd1
2026-03-26 14:16:20.178368 | localhost | Hostname: np0000161065
2026-03-26 14:16:20.178388 | localhost | Username: zuul
2026-03-26 14:16:20.178407 | localhost | Distro: Ubuntu 24.04
2026-03-26 14:16:20.178426 | localhost | Provider: yul1
2026-03-26 14:16:20.178445 | localhost | Region: ca-ymq-1
2026-03-26 14:16:20.178464 | localhost | Label: ubuntu-noble
2026-03-26 14:16:20.178482 | localhost | Product Name: OpenStack Nova
2026-03-26 14:16:20.178501 | localhost | Interface IP: 199.204.45.72
2026-03-26 14:16:20.192471 | 
2026-03-26 14:16:20.192635 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-26 14:16:20.589610 | localhost -> localhost | changed
2026-03-26 14:16:20.597284 | 
2026-03-26 14:16:20.597387 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-26 14:16:21.427906 | localhost -> localhost | changed
2026-03-26 14:16:21.435902 | 
2026-03-26 14:16:21.436030 | PLAY [all]
2026-03-26 14:16:21.449573 | 
2026-03-26 14:16:21.449750 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-26 14:16:21.675493 | mon1 -> localhost | ok
2026-03-26 14:16:21.684369 | 
2026-03-26 14:16:21.684461 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-26 14:16:21.715297 | mon1 | ok
2026-03-26 14:16:21.720081 | osd1 | ok
2026-03-26 14:16:21.738497 | mon1 | included: /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-26 14:16:21.738557 | osd1 | included: /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-26 14:16:21.744824 | 
2026-03-26 14:16:21.744895 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-26 14:16:22.944749 | mon1 -> localhost | Generating public/private rsa key pair.
2026-03-26 14:16:22.944957 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/37f4574ba2c3487886ea45933c60c2e6_id_rsa
2026-03-26 14:16:22.945055 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/37f4574ba2c3487886ea45933c60c2e6_id_rsa.pub
2026-03-26 14:16:22.945090 | mon1 -> localhost | The key fingerprint is:
2026-03-26 14:16:22.945122 | mon1 -> localhost | SHA256:BU5ICjrK7YH9HxQ39mRCfNAV0ltmZiDrDtSH2QjY7uw zuul-build-sshkey
2026-03-26 14:16:22.945152 | mon1 -> localhost | The key's randomart image is:
2026-03-26 14:16:22.945181 | mon1 -> localhost | +---[RSA 3072]----+
2026-03-26 14:16:22.945210 | mon1 -> localhost | |  .  ...*+ooo+o  |
2026-03-26 14:16:22.945239 | mon1 -> localhost | | . . ..+.+ooO. * |
2026-03-26 14:16:22.945266 | mon1 -> localhost | |o   .  .o*oO oB  |
2026-03-26 14:16:22.945295 | mon1 -> localhost | |o.+     =oB ..   |
2026-03-26 14:16:22.945323 | mon1 -> localhost | |.o +   .S. o     |
2026-03-26 14:16:22.945350 | mon1 -> localhost | |  . o .  oo      |
2026-03-26 14:16:22.945377 | mon1 -> localhost | |   . . ..  .     |
2026-03-26 14:16:22.945404 | mon1 -> localhost | |      . .E       |
2026-03-26 14:16:22.945432 | mon1 -> localhost | |       .         |
2026-03-26 14:16:22.945459 | mon1 -> localhost | +----[SHA256]-----+
2026-03-26 14:16:22.945523 | mon1 -> localhost | ok: Runtime: 0:00:00.706144
2026-03-26 14:16:22.954477 | 
2026-03-26 14:16:22.954564 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-26 14:16:22.988138 | mon1 | ok
2026-03-26 14:16:22.992526 | osd1 | ok
2026-03-26 14:16:23.005900 | mon1 | included: /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-26 14:16:23.005950 | osd1 | included: /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-26 14:16:23.016502 | 
2026-03-26 14:16:23.016565 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-26 14:16:23.041800 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:23.052856 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:23.062871 | 
2026-03-26 14:16:23.062960 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-26 14:16:23.608987 | mon1 | changed
2026-03-26 14:16:23.615221 | osd1 | changed
2026-03-26 14:16:23.620642 | 
2026-03-26 14:16:23.620708 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-26 14:16:23.840778 | mon1 | ok
2026-03-26 14:16:23.860151 | osd1 | ok
2026-03-26 14:16:23.870015 | 
2026-03-26 14:16:23.870145 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-26 14:16:24.471130 | osd1 | changed
2026-03-26 14:16:24.509965 | mon1 | changed
2026-03-26 14:16:24.516405 | 
2026-03-26 14:16:24.516471 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-26 14:16:25.123899 | mon1 | changed
2026-03-26 14:16:25.128931 | osd1 | changed
2026-03-26 14:16:25.134447 | 
2026-03-26 14:16:25.134573 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-26 14:16:25.161472 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:25.172767 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:25.184661 | 
2026-03-26 14:16:25.184797 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-26 14:16:25.504038 | mon1 -> localhost | changed
2026-03-26 14:16:25.522662 | 
2026-03-26 14:16:25.522737 | TASK [add-build-sshkey : Add back temp key]
2026-03-26 14:16:25.795278 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/37f4574ba2c3487886ea45933c60c2e6_id_rsa (zuul-build-sshkey)
2026-03-26 14:16:25.795477 | mon1 -> localhost | ok: Runtime: 0:00:00.013178
2026-03-26 14:16:25.800870 | 
2026-03-26 14:16:25.800932 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-26 14:16:26.111621 | mon1 | ok
2026-03-26 14:16:26.117893 | osd1 | ok
2026-03-26 14:16:26.122819 | 
2026-03-26 14:16:26.122881 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-26 14:16:26.148073 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:26.159069 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:26.181690 | 
2026-03-26 14:16:26.181781 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-26 14:16:26.491469 | osd1 | ok
2026-03-26 14:16:26.521210 | mon1 | ok
2026-03-26 14:16:26.528979 | 
2026-03-26 14:16:26.529060 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-26 14:16:27.252426 | osd1 | Output suppressed because no_log was given
2026-03-26 14:16:27.257072 | mon1 | Output suppressed because no_log was given
2026-03-26 14:16:27.271262 | 
2026-03-26 14:16:27.271324 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-26 14:16:27.494429 | mon1 | ok: "logs"
2026-03-26 14:16:27.494711 | mon1 | ok: All items complete
2026-03-26 14:16:27.494750 | 
2026-03-26 14:16:27.510478 | osd1 | ok: "logs"
2026-03-26 14:16:27.693421 | mon1 | ok: "artifacts"
2026-03-26 14:16:27.710382 | osd1 | ok: "artifacts"
2026-03-26 14:16:27.884926 | mon1 | ok: "docs"
2026-03-26 14:16:27.910315 | osd1 | ok: "docs"
2026-03-26 14:16:27.931271 | 
2026-03-26 14:16:27.931422 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-26 14:16:28.154611 | mon1 | changed: "logs"
2026-03-26 14:16:28.154842 | mon1 | ok: All items complete
2026-03-26 14:16:28.154872 | 
2026-03-26 14:16:28.160454 | osd1 | changed: "logs"
2026-03-26 14:16:28.353521 | mon1 | changed: "artifacts"
2026-03-26 14:16:28.365068 | osd1 | changed: "artifacts"
2026-03-26 14:16:28.553810 | mon1 | changed: "docs"
2026-03-26 14:16:28.574821 | osd1 | changed: "docs"
2026-03-26 14:16:28.601521 | 
2026-03-26 14:16:28.601630 | PLAY RECAP
2026-03-26 14:16:28.601679 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:28.601720 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-26 14:16:28.601750 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-26 14:16:28.601769 | 
2026-03-26 14:16:28.740625 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-26 14:16:28.745427 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-26 14:16:29.302725 | 
2026-03-26 14:16:29.302902 | PLAY [all]
2026-03-26 14:16:29.316658 | 
2026-03-26 14:16:29.316822 | TASK [setup-uv : Extract archive]
2026-03-26 14:16:31.761328 | osd1 | changed
2026-03-26 14:16:32.164212 | mon1 | changed
2026-03-26 14:16:32.171863 | 
2026-03-26 14:16:32.172007 | TASK [setup-uv : Print version]
2026-03-26 14:16:32.135010 | osd1 | uv 0.8.13
2026-03-26 14:16:32.342290 | mon1 | uv 0.8.13
2026-03-26 14:16:32.740007 | mon1 | ok: Runtime: 0:00:00.015592
2026-03-26 14:16:32.749730 | osd1 | ok: Runtime: 0:00:00.015154
2026-03-26 14:16:32.761383 | 
2026-03-26 14:16:32.761459 | PLAY RECAP
2026-03-26 14:16:32.761505 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:32.761532 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:32.761552 | 
2026-03-26 14:16:32.869424 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-26 14:16:32.874047 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-26 14:16:33.428692 | 
2026-03-26 14:16:33.428835 | PLAY [all]
2026-03-26 14:16:33.440193 | 
2026-03-26 14:16:33.440269 | TASK [Copy inventory file for Zuul]
2026-03-26 14:16:34.488725 | mon1 | changed
2026-03-26 14:16:34.494995 | 
2026-03-26 14:16:34.495123 | TASK [Switch "ansible_host" to private IP]
2026-03-26 14:16:34.845920 | mon1 | changed: 2 replacements made
2026-03-26 14:16:34.853518 | 
2026-03-26 14:16:34.853589 | TASK [Run Molecule scenario]
2026-03-26 14:16:35.173874 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-03-26 14:16:35.174018 | mon1 | Creating virtual environment at: .venv
2026-03-26 14:16:35.516479 | mon1 | Downloading netaddr (2.2MiB)
2026-03-26 14:16:35.516974 | mon1 | Downloading pygments (1.2MiB)
2026-03-26 14:16:35.526812 | mon1 | Downloading ansible-core (2.1MiB)
2026-03-26 14:16:35.527009 | mon1 | Downloading cryptography (4.3MiB)
2026-03-26 14:16:35.739577 | mon1 |  Downloading netaddr
2026-03-26 14:16:35.751924 | mon1 |  Downloading cryptography
2026-03-26 14:16:35.819039 | mon1 |  Downloading pygments
2026-03-26 14:16:36.020692 | mon1 |  Downloading ansible-core
2026-03-26 14:16:36.067518 | mon1 | Installed 37 packages in 46ms
2026-03-26 14:16:36.857715 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-03-26 14:16:36.857828 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-26 14:16:37.533001 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-26 14:16:37.533088 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-26 14:16:53.941162 | mon1 | INFO     [default > dependency] Executing
2026-03-26 14:16:53.941274 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-26 14:16:53.941477 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-26 14:16:53.941651 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-26 14:16:53.947373 | mon1 | INFO     [default > cleanup] Executing
2026-03-26 14:16:53.947704 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-26 14:16:53.953342 | mon1 | INFO     [default > destroy] Executing
2026-03-26 14:16:53.953381 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-26 14:16:53.953438 | mon1 | INFO     [default > destroy] Executed: Successful
2026-03-26 14:16:53.959193 | mon1 | INFO     [default > syntax] Executing
2026-03-26 14:16:55.079402 | mon1 |
2026-03-26 14:16:55.079694 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:16:55.136481 | mon1 | INFO     [default > syntax] Executed: Successful
2026-03-26 14:16:55.146396 | mon1 | INFO     [default > create] Executing
2026-03-26 14:16:55.148405 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-26 14:16:55.154245 | mon1 | INFO     [default > prepare] Executing
2026-03-26 14:16:55.920085 | mon1 |
2026-03-26 14:16:55.920301 | mon1 | PLAY [Prepare] *****************************************************************
2026-03-26 14:16:55.920519 | mon1 |
2026-03-26 14:16:55.920873 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:16:55.921123 | mon1 | Thursday 26 March 2026  14:16:55 +0000 (0:00:00.032)       0:00:00.032 ********
2026-03-26 14:16:57.206377 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-26 14:16:57.206572 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-26 14:16:57.206959 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:16:57.207167 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:16:57.207413 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:16:57.248756 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-03-26 14:16:57.248932 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-26 14:16:57.249177 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:16:57.249412 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:16:57.249683 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:16:57.258773 | mon1 | ok: [mon1]
2026-03-26 14:16:57.259042 | mon1 | ok: [osd1]
2026-03-26 14:16:57.259252 | mon1 |
2026-03-26 14:16:57.259496 | mon1 | TASK [Configure short hostname] ************************************************
2026-03-26 14:16:57.259783 | mon1 | Thursday 26 March 2026  14:16:57 +0000 (0:00:01.339)       0:00:01.371 ********
2026-03-26 14:16:58.052294 | mon1 | changed: [osd1]
2026-03-26 14:16:58.052498 | mon1 | changed: [mon1]
2026-03-26 14:16:58.052821 | mon1 |
2026-03-26 14:16:58.053083 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-26 14:16:58.053341 | mon1 | Thursday 26 March 2026  14:16:58 +0000 (0:00:00.792)       0:00:02.164 ********
2026-03-26 14:16:58.379165 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-26 14:16:58.379498 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-03-26 14:16:58.379954 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-26 14:16:58.423716 | mon1 | changed: [mon1]
2026-03-26 14:16:58.423948 | mon1 | changed: [osd1]
2026-03-26 14:16:58.424180 | mon1 |
2026-03-26 14:16:58.424427 | mon1 | TASK [Update apt cache] ********************************************************
2026-03-26 14:16:58.424812 | mon1 | Thursday 26 March 2026  14:16:58 +0000 (0:00:00.371)       0:00:02.536 ********
2026-03-26 14:17:05.018795 | mon1 | changed: [osd1]
2026-03-26 14:17:05.018893 | mon1 | changed: [mon1]
2026-03-26 14:17:05.018904 | mon1 |
2026-03-26 14:17:05.018926 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-03-26 14:17:05.019209 | mon1 |
2026-03-26 14:17:05.019489 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:17:05.019773 | mon1 | Thursday 26 March 2026  14:17:05 +0000 (0:00:06.594)       0:00:09.131 ********
2026-03-26 14:17:05.862694 | mon1 | ok: [osd1]
2026-03-26 14:17:05.862854 | mon1 |
2026-03-26 14:17:05.863112 | mon1 | TASK [Install depedencies] *****************************************************
2026-03-26 14:17:05.863350 | mon1 | Thursday 26 March 2026  14:17:05 +0000 (0:00:00.844)       0:00:09.975 ********
2026-03-26 14:17:36.112918 | mon1 | changed: [osd1]
2026-03-26 14:17:36.113030 | mon1 |
2026-03-26 14:17:36.113326 | mon1 | TASK [Start up service] ********************************************************
2026-03-26 14:17:36.113567 | mon1 | Thursday 26 March 2026  14:17:36 +0000 (0:00:30.249)       0:00:40.224 ********
2026-03-26 14:17:36.725549 | mon1 | ok: [osd1]
2026-03-26 14:17:36.725790 | mon1 |
2026-03-26 14:17:36.726070 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-03-26 14:17:36.726334 | mon1 | Thursday 26 March 2026  14:17:36 +0000 (0:00:00.613)       0:00:40.838 ********
2026-03-26 14:17:37.088277 | mon1 | ok: [osd1]
2026-03-26 14:17:37.088362 | mon1 |
2026-03-26 14:17:37.088369 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-26 14:17:37.088479 | mon1 | Thursday 26 March 2026  14:17:37 +0000 (0:00:00.363)       0:00:41.201 ********
2026-03-26 14:17:37.883047 | mon1 | changed: [osd1]
2026-03-26 14:17:37.883244 | mon1 |
2026-03-26 14:17:37.883499 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-03-26 14:17:37.883802 | mon1 | Thursday 26 March 2026  14:17:37 +0000 (0:00:00.794)       0:00:41.995 ********
2026-03-26 14:17:38.183108 | mon1 | ok: [osd1]
2026-03-26 14:17:38.183215 | mon1 |
2026-03-26 14:17:38.183490 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-03-26 14:17:38.183791 | mon1 | Thursday 26 March 2026  14:17:38 +0000 (0:00:00.299)       0:00:42.294 ********
2026-03-26 14:17:38.211267 | mon1 | skipping: [osd1]
2026-03-26 14:17:38.211350 | mon1 |
2026-03-26 14:17:38.211641 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-03-26 14:17:38.211922 | mon1 | Thursday 26 March 2026  14:17:38 +0000 (0:00:00.029)       0:00:42.324 ********
2026-03-26 14:17:38.907072 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:17:38.907284 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:17:38.907529 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:17:38.907792 | mon1 |
2026-03-26 14:17:38.908039 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-03-26 14:17:38.908337 | mon1 | Thursday 26 March 2026  14:17:38 +0000 (0:00:00.695)       0:00:43.019 ********
2026-03-26 14:17:39.731365 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:17:39.731496 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:17:39.731653 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:17:39.731826 | mon1 |
2026-03-26 14:17:39.732001 | mon1 | TASK [Start loop devices] ******************************************************
2026-03-26 14:17:39.732151 | mon1 | Thursday 26 March 2026  14:17:39 +0000 (0:00:00.823)       0:00:43.843 ********
2026-03-26 14:17:40.563422 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:17:40.563509 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:17:40.563628 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:17:40.563786 | mon1 |
2026-03-26 14:17:40.563931 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-03-26 14:17:40.564076 | mon1 | Thursday 26 March 2026  14:17:40 +0000 (0:00:00.832)       0:00:44.675 ********
2026-03-26 14:17:43.033269 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:17:43.033436 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:17:43.033777 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:17:43.034004 | mon1 |
2026-03-26 14:17:43.034268 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-03-26 14:17:43.034523 | mon1 | Thursday 26 March 2026  14:17:43 +0000 (0:00:02.469)       0:00:47.145 ********
2026-03-26 14:17:44.401428 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-03-26 14:17:44.401533 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-03-26 14:17:44.401782 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-03-26 14:17:44.401955 | mon1 |
2026-03-26 14:17:44.402125 | mon1 | PLAY RECAP *********************************************************************
2026-03-26 14:17:44.402314 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-26 14:17:44.402499 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-26 14:17:44.402661 | mon1 |
2026-03-26 14:17:44.402812 | mon1 |
2026-03-26 14:17:44.402975 | mon1 | TASKS RECAP ********************************************************************
2026-03-26 14:17:44.403143 | mon1 | Thursday 26 March 2026  14:17:44 +0000 (0:00:01.369)       0:00:48.514 ********
2026-03-26 14:17:44.403303 | mon1 | ===============================================================================
2026-03-26 14:17:44.403468 | mon1 | Install depedencies ---------------------------------------------------- 30.25s
2026-03-26 14:17:44.403662 | mon1 | Update apt cache -------------------------------------------------------- 6.59s
2026-03-26 14:17:44.403832 | mon1 | Create a volume group for each loop device ------------------------------ 2.47s
2026-03-26 14:17:44.404002 | mon1 | Create a logical volume for each loop device ---------------------------- 1.37s
2026-03-26 14:17:44.404166 | mon1 | Gathering Facts --------------------------------------------------------- 1.34s
2026-03-26 14:17:44.404330 | mon1 | Gathering Facts --------------------------------------------------------- 0.84s
2026-03-26 14:17:44.404499 | mon1 | Start loop devices ------------------------------------------------------ 0.83s
2026-03-26 14:17:44.404698 | mon1 | Set permissions on loopback devices ------------------------------------- 0.82s
2026-03-26 14:17:44.404864 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.79s
2026-03-26 14:17:44.405079 | mon1 | Configure short hostname ------------------------------------------------ 0.79s
2026-03-26 14:17:44.405333 | mon1 | Create devices for Ceph ------------------------------------------------- 0.70s
2026-03-26 14:17:44.405496 | mon1 | Start up service -------------------------------------------------------- 0.61s
2026-03-26 14:17:44.405688 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.37s
2026-03-26 14:17:44.405852 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.36s
2026-03-26 14:17:44.406020 | mon1 | Get list of all loopback devices ---------------------------------------- 0.30s
2026-03-26 14:17:44.406186 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-03-26 14:17:44.483243 | mon1 | INFO     [default > prepare] Executed: Successful
2026-03-26 14:17:44.493392 | mon1 | INFO     [default > converge] Executing
2026-03-26 14:17:45.500447 | mon1 |
2026-03-26 14:17:45.500568 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-26 14:17:45.500580 | mon1 |
2026-03-26 14:17:45.500589 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:17:45.500628 | mon1 | Thursday 26 March 2026  14:17:45 +0000 (0:00:00.057)       0:00:00.057 ********
2026-03-26 14:17:47.592264 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-26 14:17:47.592345 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-26 14:17:47.592374 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:17:47.592384 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:17:47.592397 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:17:47.598989 | mon1 | ok: [mon1]
2026-03-26 14:17:47.599196 | mon1 |
2026-03-26 14:17:47.599443 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:17:47.599762 | mon1 | Thursday 26 March 2026  14:17:47 +0000 (0:00:02.101)       0:00:02.158 ********
2026-03-26 14:17:47.950515 | mon1 | ok: [mon1]
2026-03-26 14:17:47.950669 | mon1 |
2026-03-26 14:17:47.950689 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:17:47.950701 | mon1 | Thursday 26 March 2026  14:17:47 +0000 (0:00:00.350)       0:00:02.508 ********
2026-03-26 14:17:47.991848 | mon1 | skipping: [mon1]
2026-03-26 14:17:47.991962 | mon1 |
2026-03-26 14:17:47.991975 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-26 14:17:47.991993 | mon1 | Thursday 26 March 2026  14:17:47 +0000 (0:00:00.042)       0:00:02.550 ********
2026-03-26 14:17:48.345819 | mon1 | changed: [mon1]
2026-03-26 14:17:48.345917 | mon1 |
2026-03-26 14:17:48.346151 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:17:48.346420 | mon1 | Thursday 26 March 2026  14:17:48 +0000 (0:00:00.354)       0:00:02.904 ********
2026-03-26 14:17:48.446693 | mon1 | ok: [mon1] => {
2026-03-26 14:17:48.446938 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-26 14:17:48.447213 | mon1 | }
2026-03-26 14:17:48.447449 | mon1 |
2026-03-26 14:17:48.447733 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:17:48.447945 | mon1 | Thursday 26 March 2026  14:17:48 +0000 (0:00:00.100)       0:00:03.005 ********
2026-03-26 14:17:49.244573 | mon1 | changed: [mon1]
2026-03-26 14:17:49.244926 | mon1 |
2026-03-26 14:17:49.245236 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:17:49.245557 | mon1 | Thursday 26 March 2026  14:17:49 +0000 (0:00:00.797)       0:00:03.803 ********
2026-03-26 14:17:49.292016 | mon1 | skipping: [mon1]
2026-03-26 14:17:49.292116 | mon1 |
2026-03-26 14:17:49.292262 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:17:49.292399 | mon1 | Thursday 26 March 2026  14:17:49 +0000 (0:00:00.047)       0:00:03.851 ********
2026-03-26 14:17:49.338647 | mon1 | skipping: [mon1]
2026-03-26 14:17:49.338922 | mon1 |
2026-03-26 14:17:49.339262 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:17:49.339579 | mon1 | Thursday 26 March 2026  14:17:49 +0000 (0:00:00.046)       0:00:03.898 ********
2026-03-26 14:17:49.592454 | mon1 | ok: [mon1]
2026-03-26 14:17:49.592700 | mon1 |
2026-03-26 14:17:49.592960 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:17:49.593199 | mon1 | Thursday 26 March 2026  14:17:49 +0000 (0:00:00.252)       0:00:04.151 ********
2026-03-26 14:17:50.643883 | mon1 | ok: [mon1]
2026-03-26 14:17:50.643930 | mon1 |
2026-03-26 14:17:50.643941 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:17:50.643956 | mon1 | Thursday 26 March 2026  14:17:50 +0000 (0:00:01.051)       0:00:05.202 ********
2026-03-26 14:17:50.839757 | mon1 | ok: [mon1] => {
2026-03-26 14:17:50.839815 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-26 14:17:50.839894 | mon1 | }
2026-03-26 14:17:50.839903 | mon1 |
2026-03-26 14:17:50.839919 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:17:50.840450 | mon1 | Thursday 26 March 2026  14:17:50 +0000 (0:00:00.195)       0:00:05.397 ********
2026-03-26 14:17:51.826870 | mon1 | changed: [mon1]
2026-03-26 14:17:51.826950 | mon1 |
2026-03-26 14:17:51.826961 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:17:51.826977 | mon1 | Thursday 26 March 2026  14:17:51 +0000 (0:00:00.987)       0:00:06.385 ********
2026-03-26 14:17:55.026585 | mon1 | changed: [mon1]
2026-03-26 14:17:55.026685 | mon1 |
2026-03-26 14:17:55.026700 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-26 14:17:55.026712 | mon1 | Thursday 26 March 2026  14:17:55 +0000 (0:00:03.199)       0:00:09.584 ********
2026-03-26 14:17:55.063430 | mon1 | skipping: [mon1]
2026-03-26 14:17:55.063461 | mon1 |
2026-03-26 14:17:55.063633 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-26 14:17:55.063893 | mon1 | Thursday 26 March 2026  14:17:55 +0000 (0:00:00.035)       0:00:09.620 ********
2026-03-26 14:17:55.096831 | mon1 | skipping: [mon1]
2026-03-26 14:17:55.096890 | mon1 |
2026-03-26 14:17:55.096896 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-26 14:17:55.096903 | mon1 | Thursday 26 March 2026  14:17:55 +0000 (0:00:00.034)       0:00:09.655 ********
2026-03-26 14:17:55.133188 | mon1 | skipping: [mon1]
2026-03-26 14:17:55.133241 | mon1 |
2026-03-26 14:17:55.133256 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-26 14:17:55.133269 | mon1 | Thursday 26 March 2026  14:17:55 +0000 (0:00:00.035)       0:00:09.691 ********
2026-03-26 14:18:02.380546 | mon1 | changed: [mon1]
2026-03-26 14:18:02.380673 | mon1 |
2026-03-26 14:18:02.380691 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-26 14:18:02.380704 | mon1 | Thursday 26 March 2026  14:18:02 +0000 (0:00:07.242)       0:00:16.933 ********
2026-03-26 14:18:03.035512 | mon1 | changed: [mon1]
2026-03-26 14:18:03.035549 | mon1 |
2026-03-26 14:18:03.035555 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-26 14:18:03.035561 | mon1 | Thursday 26 March 2026  14:18:03 +0000 (0:00:00.658)       0:00:17.592 ********
2026-03-26 14:18:04.132723 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-03-26 14:18:04.132825 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-26 14:18:04.132846 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-26 14:18:04.133440 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-26 14:18:04.133492 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-26 14:18:04.133499 | mon1 |
2026-03-26 14:18:04.133507 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-26 14:18:04.133514 | mon1 | Thursday 26 March 2026  14:18:04 +0000 (0:00:01.100)       0:00:18.692 ********
2026-03-26 14:18:04.836742 | mon1 | changed: [mon1]
2026-03-26 14:18:04.836799 | mon1 |
2026-03-26 14:18:04.836919 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-26 14:18:04.837181 | mon1 | Thursday 26 March 2026  14:18:04 +0000 (0:00:00.695)       0:00:19.388 ********
2026-03-26 14:18:04.837410 | mon1 |
2026-03-26 14:18:04.837725 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-26 14:18:04.838046 | mon1 | Thursday 26 March 2026  14:18:04 +0000 (0:00:00.007)       0:00:19.395 ********
2026-03-26 14:18:05.959116 | mon1 | ok: [mon1]
2026-03-26 14:18:05.960672 | mon1 |
2026-03-26 14:18:05.960696 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-26 14:18:05.960705 | mon1 | Thursday 26 March 2026  14:18:05 +0000 (0:00:01.122)       0:00:20.517 ********
2026-03-26 14:18:06.537883 | mon1 | changed: [mon1]
2026-03-26 14:18:06.538026 | mon1 |
2026-03-26 14:18:06.538298 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-26 14:18:06.538861 | mon1 | Thursday 26 March 2026  14:18:06 +0000 (0:00:00.579)       0:00:21.097 ********
2026-03-26 14:18:07.241837 | mon1 | changed: [mon1]
2026-03-26 14:18:07.241903 | mon1 |
2026-03-26 14:18:07.241914 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:18:07.242095 | mon1 | Thursday 26 March 2026  14:18:07 +0000 (0:00:00.703)       0:00:21.800 ********
2026-03-26 14:18:07.502590 | mon1 | ok: [mon1]
2026-03-26 14:18:07.502668 | mon1 |
2026-03-26 14:18:07.502683 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:18:07.502695 | mon1 | Thursday 26 March 2026  14:18:07 +0000 (0:00:00.258)       0:00:22.059 ********
2026-03-26 14:18:07.573395 | mon1 | ok: [mon1] => {
2026-03-26 14:18:07.573431 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-26 14:18:07.573441 | mon1 | }
2026-03-26 14:18:07.573450 | mon1 |
2026-03-26 14:18:07.573459 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:18:07.573468 | mon1 | Thursday 26 March 2026  14:18:07 +0000 (0:00:00.071)       0:00:22.131 ********
2026-03-26 14:18:08.587406 | mon1 | changed: [mon1]
2026-03-26 14:18:08.587464 | mon1 |
2026-03-26 14:18:08.587475 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:18:08.587484 | mon1 | Thursday 26 March 2026  14:18:08 +0000 (0:00:01.013)       0:00:23.144 ********
2026-03-26 14:18:13.230311 | mon1 | changed: [mon1]
2026-03-26 14:18:13.230364 | mon1 |
2026-03-26 14:18:13.230376 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-26 14:18:13.230387 | mon1 | Thursday 26 March 2026  14:18:13 +0000 (0:00:04.643)       0:00:27.788 ********
2026-03-26 14:18:14.261215 | mon1 | ok: [mon1]
2026-03-26 14:18:14.261286 | mon1 |
2026-03-26 14:18:14.261298 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-26 14:18:14.261309 | mon1 | Thursday 26 March 2026  14:18:14 +0000 (0:00:01.030)       0:00:28.818 ********
2026-03-26 14:18:15.107172 | mon1 | changed: [mon1]
2026-03-26 14:18:15.107225 | mon1 |
2026-03-26 14:18:15.107235 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-26 14:18:15.107245 | mon1 | Thursday 26 March 2026  14:18:15 +0000 (0:00:00.846)       0:00:29.665 ********
2026-03-26 14:18:15.704697 | mon1 | changed: [mon1]
2026-03-26 14:18:15.704730 | mon1 |
2026-03-26 14:18:15.705122 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-26 14:18:15.705146 | mon1 | Thursday 26 March 2026  14:18:15 +0000 (0:00:00.596)       0:00:30.262 ********
2026-03-26 14:18:16.388728 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-03-26 14:18:16.388777 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-26 14:18:16.388787 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-26 14:18:16.388797 | mon1 |
2026-03-26 14:18:16.388806 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-26 14:18:16.388815 | mon1 | Thursday 26 March 2026  14:18:16 +0000 (0:00:00.683)       0:00:30.946 ********
2026-03-26 14:18:16.987114 | mon1 | changed: [mon1]
2026-03-26 14:18:16.987163 | mon1 |
2026-03-26 14:18:16.987174 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-26 14:18:16.987183 | mon1 | Thursday 26 March 2026  14:18:16 +0000 (0:00:00.598)       0:00:31.544 ********
2026-03-26 14:18:17.555667 | mon1 | changed: [mon1]
2026-03-26 14:18:17.555700 | mon1 |
2026-03-26 14:18:17.555705 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-26 14:18:17.555710 | mon1 | Thursday 26 March 2026  14:18:17 +0000 (0:00:00.561)       0:00:32.106 ********
2026-03-26 14:18:17.555714 | mon1 |
2026-03-26 14:18:17.555718 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-26 14:18:17.555722 | mon1 | Thursday 26 March 2026  14:18:17 +0000 (0:00:00.007)       0:00:32.113 ********
2026-03-26 14:18:18.429768 | mon1 | ok: [mon1]
2026-03-26 14:18:18.429818 | mon1 |
2026-03-26 14:18:18.429830 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-26 14:18:18.429941 | mon1 | Thursday 26 March 2026  14:18:18 +0000 (0:00:00.873)       0:00:32.987 ********
2026-03-26 14:18:20.369349 | mon1 | changed: [mon1]
2026-03-26 14:18:20.369544 | mon1 |
2026-03-26 14:18:20.369847 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-26 14:18:20.370103 | mon1 | Thursday 26 March 2026  14:18:20 +0000 (0:00:01.940)       0:00:34.928 ********
2026-03-26 14:18:21.050255 | mon1 | changed: [mon1]
2026-03-26 14:18:21.050336 | mon1 |
2026-03-26 14:18:21.050687 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-26 14:18:21.050979 | mon1 | Thursday 26 March 2026  14:18:21 +0000 (0:00:00.680)       0:00:35.609 ********
2026-03-26 14:18:21.104211 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-03-26 14:18:21.104384 | mon1 |
2026-03-26 14:18:21.104671 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-26 14:18:21.104926 | mon1 | Thursday 26 March 2026  14:18:21 +0000 (0:00:00.054)       0:00:35.663 ********
2026-03-26 14:19:00.881820 | mon1 | changed: [mon1]
2026-03-26 14:19:00.881880 | mon1 |
2026-03-26 14:19:00.881892 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-26 14:19:00.882070 | mon1 | Thursday 26 March 2026  14:19:00 +0000 (0:00:39.777)       0:01:15.440 ********
2026-03-26 14:19:01.680559 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-03-26 14:19:01.680656 | mon1 | ok: [mon1] => (item=ssh)
2026-03-26 14:19:01.680674 | mon1 |
2026-03-26 14:19:01.680687 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-26 14:19:01.680699 | mon1 | Thursday 26 March 2026  14:19:01 +0000 (0:00:00.797)       0:01:16.238 ********
2026-03-26 14:19:02.031241 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-21.0.0/el9/noarch/cephadm"}
2026-03-26 14:19:02.036261 | mon1 |
2026-03-26 14:19:02.036682 | mon1 | PLAY RECAP *********************************************************************
2026-03-26 14:19:02.037707 | mon1 | mon1                       : ok=33   changed=20   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-03-26 14:19:02.037736 | mon1 |
2026-03-26 14:19:02.037746 | mon1 |
2026-03-26 14:19:02.037756 | mon1 | TASKS RECAP ********************************************************************
2026-03-26 14:19:02.038626 | mon1 | Thursday 26 March 2026  14:19:02 +0000 (0:00:00.356)       0:01:16.594 ********
2026-03-26 14:19:02.038642 | mon1 | ===============================================================================
2026-03-26 14:19:02.038648 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 39.78s
2026-03-26 14:19:02.038653 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.24s
2026-03-26 14:19:02.038658 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.64s
2026-03-26 14:19:02.038759 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.20s
2026-03-26 14:19:02.038898 | mon1 | Gathering Facts --------------------------------------------------------- 2.10s
2026-03-26 14:19:02.039038 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 2.00s
2026-03-26 14:19:02.039182 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.94s
2026-03-26 14:19:02.039325 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.10s
2026-03-26 14:19:02.039466 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.05s
2026-03-26 14:19:02.039623 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.03s
2026-03-26 14:19:02.039767 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 1.01s
2026-03-26 14:19:02.039910 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.99s
2026-03-26 14:19:02.040064 | mon1 | vexxhost.containers.docker : Ensure group "docker" exists --------------- 0.85s
2026-03-26 14:19:02.040203 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.80s
2026-03-26 14:19:02.040350 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.80s
2026-03-26 14:19:02.040486 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.70s
2026-03-26 14:19:02.040637 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.70s
2026-03-26 14:19:02.040780 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.68s
2026-03-26 14:19:02.040915 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.68s
2026-03-26 14:19:02.041052 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.66s
2026-03-26 14:19:02.116236 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:19:02.116517 | mon1 | ERROR    [default > converge] Executed: Failed
2026-03-26 14:19:02.116762 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:19:12.554503 | mon1 | ERROR
2026-03-26 14:19:12.555090 | mon1 | {
2026-03-26 14:19:12.555156 | mon1 |   "delta": "0:02:27.095875",
2026-03-26 14:19:12.555190 | mon1 |   "end": "2026-03-26 14:19:02.185725",
2026-03-26 14:19:12.555228 | mon1 |   "msg": "non-zero return code",
2026-03-26 14:19:12.555255 | mon1 |   "rc": 2,
2026-03-26 14:19:12.555284 | mon1 |   "start": "2026-03-26 14:16:35.089850"
2026-03-26 14:19:12.555310 | mon1 | }
failure
2026-03-26 14:19:12.560485 | 
2026-03-26 14:19:12.560534 | PLAY RECAP
2026-03-26 14:19:12.560580 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:19:12.560601 | 
2026-03-26 14:19:12.681235 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-26 14:19:12.684916 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-26 14:19:13.301633 | 
2026-03-26 14:19:13.301804 | PLAY [all]
2026-03-26 14:19:13.315627 | 
2026-03-26 14:19:13.315759 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-26 14:19:13.369757 | mon1 | ok
2026-03-26 14:19:13.378881 | osd1 | ok
2026-03-26 14:19:13.385528 | 
2026-03-26 14:19:13.385603 | TASK [fetch-output : Set log path for single node]
2026-03-26 14:19:13.411984 | mon1 | skipping: Conditional result was False
2026-03-26 14:19:13.423456 | osd1 | skipping: Conditional result was False
2026-03-26 14:19:13.431279 | 
2026-03-26 14:19:13.431540 | LOOP [fetch-output : Ensure local output dirs]
2026-03-26 14:19:13.788598 | mon1 -> localhost | changed: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/logs/mon1"
2026-03-26 14:19:13.802015 | osd1 -> localhost | changed: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/logs/osd1"
2026-03-26 14:19:13.995924 | mon1 -> localhost | changed: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/artifacts"
2026-03-26 14:19:14.001698 | osd1 -> localhost | ok: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/artifacts"
2026-03-26 14:19:14.201682 | mon1 -> localhost | changed: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/docs"
2026-03-26 14:19:14.204144 | osd1 -> localhost | ok: "/var/lib/zuul/builds/37f4574ba2c3487886ea45933c60c2e6/work/docs"
2026-03-26 14:19:14.227424 | 
2026-03-26 14:19:14.227639 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-26 14:19:14.853124 | osd1 | changed: .d..t...... ./
2026-03-26 14:19:14.853355 | osd1 | changed: All items complete
2026-03-26 14:19:14.853386 | 
2026-03-26 14:19:14.858321 | mon1 | changed: .d..t...... ./
2026-03-26 14:19:15.328887 | osd1 | changed: .d..t...... ./
2026-03-26 14:19:15.335906 | mon1 | changed: .d..t...... ./
2026-03-26 14:19:15.793062 | osd1 | changed: .d..t...... ./
2026-03-26 14:19:15.837528 | mon1 | ok
2026-03-26 14:19:15.868244 | 
2026-03-26 14:19:15.868550 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-26 14:19:16.291080 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007659
2026-03-26 14:19:16.291447 | mon1 -> localhost | changed: All items complete
2026-03-26 14:19:16.291512 | 
2026-03-26 14:19:16.513450 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006585
2026-03-26 14:19:16.527879 | 
2026-03-26 14:19:16.528315 | PLAY [all]
2026-03-26 14:19:16.534681 | 
2026-03-26 14:19:16.534749 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-26 14:19:17.018929 | mon1 | changed
2026-03-26 14:19:17.182230 | osd1 | changed
2026-03-26 14:19:17.202547 | 
2026-03-26 14:19:17.202708 | PLAY RECAP
2026-03-26 14:19:17.202767 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-26 14:19:17.202799 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-26 14:19:17.202819 | 
2026-03-26 14:19:17.435628 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-26 14:19:17.441604 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-26 14:19:18.035392 | 
2026-03-26 14:19:18.035536 | PLAY [localhost]
2026-03-26 14:19:18.045424 | 
2026-03-26 14:19:18.045504 | TASK [Generate Zuul manifest]
2026-03-26 14:19:18.068570 | localhost | ok
2026-03-26 14:19:18.082784 | 
2026-03-26 14:19:18.082861 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-26 14:19:18.414539 | localhost | changed
2026-03-26 14:19:18.424269 | 
2026-03-26 14:19:18.424352 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-26 14:19:18.454874 | localhost | ok
2026-03-26 14:19:18.487408 | 
2026-03-26 14:19:18.487527 | TASK [Upload logs]
2026-03-26 14:19:18.512223 | localhost | ok
2026-03-26 14:19:18.582748 | 
2026-03-26 14:19:18.582909 | TASK [Set zuul-log-path fact]
2026-03-26 14:19:18.605319 | localhost | ok
2026-03-26 14:19:18.618790 | 
2026-03-26 14:19:18.618866 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-26 14:19:18.651264 | localhost | ok
2026-03-26 14:19:18.660576 | 
2026-03-26 14:19:18.660668 | TASK [upload-logs : Create log directories]
2026-03-26 14:19:19.094945 | localhost | changed
2026-03-26 14:19:19.101117 | 
2026-03-26 14:19:19.101207 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-26 14:19:19.504190 | localhost -> localhost | ok: Runtime: 0:00:00.004846
2026-03-26 14:19:19.510786 | 
2026-03-26 14:19:19.510859 | TASK [upload-logs : Upload logs to log server]
2026-03-26 14:19:19.985764 | localhost | Output suppressed because no_log was given
2026-03-26 14:19:19.989652 | 
2026-03-26 14:19:19.989719 | LOOP [upload-logs : Compress console log and json output]
2026-03-26 14:19:20.036562 | localhost | skipping: Conditional result was False
2026-03-26 14:19:20.044334 | localhost | skipping: Conditional result was False
2026-03-26 14:19:20.055625 | 
2026-03-26 14:19:20.055893 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-26 14:19:20.107748 | localhost | skipping: Conditional result was False
2026-03-26 14:19:20.108063 | 
2026-03-26 14:19:20.113634 | localhost | skipping: Conditional result was False
2026-03-26 14:19:20.132174 | 
2026-03-26 14:19:20.132325 | LOOP [upload-logs : Upload console log and json output]