2026-03-26 14:16:10.148410 | Job console starting
2026-03-26 14:16:10.200590 | Updating git repos
2026-03-26 14:16:10.244648 | Cloning repos into workspace
2026-03-26 14:16:10.603006 | Restoring repo states
2026-03-26 14:16:10.611256 | Merging changes
2026-03-26 14:16:10.938563 | Checking out repos
2026-03-26 14:16:11.033034 | Preparing playbooks
2026-03-26 14:16:13.501317 | Running Ansible setup
2026-03-26 14:16:17.524365 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-26 14:16:18.156054 | 
2026-03-26 14:16:18.156199 | PLAY [localhost]
2026-03-26 14:16:18.165639 | 
2026-03-26 14:16:18.165774 | TASK [Gathering Facts]
2026-03-26 14:16:19.085764 | localhost | ok
2026-03-26 14:16:19.092317 | 
2026-03-26 14:16:19.092394 | TASK [Setup log path fact]
2026-03-26 14:16:19.112070 | localhost | ok
2026-03-26 14:16:19.125356 | 
2026-03-26 14:16:19.125429 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-26 14:16:19.155121 | localhost | ok
2026-03-26 14:16:19.162806 | 
2026-03-26 14:16:19.162876 | TASK [emit-job-header : Print job information]
2026-03-26 14:16:19.205247 | # Job Information
2026-03-26 14:16:19.205523 | Ansible Version: 2.16.16
2026-03-26 14:16:19.205594 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-03-26 14:16:19.205643 | Pipeline: check
2026-03-26 14:16:19.205688 | Executor: 0a8996d2b663
2026-03-26 14:16:19.205731 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/98
2026-03-26 14:16:19.205780 | Event ID: 1e5264f0-291e-11f1-8b7d-c26118e25f19
2026-03-26 14:16:19.210796 | 
2026-03-26 14:16:19.210860 | LOOP [emit-job-header : Print node information]
2026-03-26 14:16:19.300886 | localhost | ok:
2026-03-26 14:16:19.301240 | localhost | # Node Information
2026-03-26 14:16:19.301305 | localhost | Inventory Hostname: mon1
2026-03-26 14:16:19.301353 | localhost | Hostname: np0000161062
2026-03-26 14:16:19.301397 | localhost | Username: zuul
2026-03-26 14:16:19.301498 | localhost | Distro: Ubuntu 22.04
2026-03-26 14:16:19.301549 | localhost | Provider: yul1
2026-03-26 14:16:19.301594 | localhost | Region: ca-ymq-1
2026-03-26 14:16:19.301635 | localhost | Label: ubuntu-jammy
2026-03-26 14:16:19.301676 | localhost | Product Name: OpenStack Nova
2026-03-26 14:16:19.301717 | localhost | Interface IP: 199.204.45.53
2026-03-26 14:16:19.343807 | localhost | ok:
2026-03-26 14:16:19.343948 | localhost | # Node Information
2026-03-26 14:16:19.343987 | localhost | Inventory Hostname: osd1
2026-03-26 14:16:19.344018 | localhost | Hostname: np0000161063
2026-03-26 14:16:19.344048 | localhost | Username: zuul
2026-03-26 14:16:19.344077 | localhost | Distro: Ubuntu 22.04
2026-03-26 14:16:19.344106 | localhost | Provider: yul1
2026-03-26 14:16:19.344134 | localhost | Region: ca-ymq-1
2026-03-26 14:16:19.344161 | localhost | Label: ubuntu-jammy
2026-03-26 14:16:19.344189 | localhost | Product Name: OpenStack Nova
2026-03-26 14:16:19.344218 | localhost | Interface IP: 199.204.45.70
2026-03-26 14:16:19.359255 | 
2026-03-26 14:16:19.359424 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-26 14:16:19.709125 | localhost -> localhost | changed
2026-03-26 14:16:19.718244 | 
2026-03-26 14:16:19.718386 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-26 14:16:20.573184 | localhost -> localhost | changed
2026-03-26 14:16:20.583134 | 
2026-03-26 14:16:20.583243 | PLAY [all]
2026-03-26 14:16:20.594520 | 
2026-03-26 14:16:20.594633 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-26 14:16:20.812763 | mon1 -> localhost | ok
2026-03-26 14:16:20.822581 | 
2026-03-26 14:16:20.822709 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-26 14:16:20.879240 | mon1 | ok
2026-03-26 14:16:20.883244 | osd1 | ok
2026-03-26 14:16:20.900674 | mon1 | included: /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-26 14:16:20.900740 | osd1 | included: /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-26 14:16:20.907095 | 
2026-03-26 14:16:20.907164 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-26 14:16:22.008612 | mon1 -> localhost | Generating public/private rsa key pair.
2026-03-26 14:16:22.008799 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/1f4ee8d4432d4b299c1e195295f39c74_id_rsa
2026-03-26 14:16:22.008842 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/1f4ee8d4432d4b299c1e195295f39c74_id_rsa.pub
2026-03-26 14:16:22.008876 | mon1 -> localhost | The key fingerprint is:
2026-03-26 14:16:22.008908 | mon1 -> localhost | SHA256:zQdgbNftlMby+sIYZ46hPNwktKZz+VBy0ZzRP4IT+6U zuul-build-sshkey
2026-03-26 14:16:22.008938 | mon1 -> localhost | The key's randomart image is:
2026-03-26 14:16:22.009000 | mon1 -> localhost | +---[RSA 3072]----+
2026-03-26 14:16:22.009044 | mon1 -> localhost | |       .o  ..+ . |
2026-03-26 14:16:22.009074 | mon1 -> localhost | |       .o..+ooB  |
2026-03-26 14:16:22.009102 | mon1 -> localhost | |       . .o B* . |
2026-03-26 14:16:22.009130 | mon1 -> localhost | |        .o * .oo.|
2026-03-26 14:16:22.009157 | mon1 -> localhost | |       .S.= +.+ .|
2026-03-26 14:16:22.009184 | mon1 -> localhost | |        +++.+E   |
2026-03-26 14:16:22.009215 | mon1 -> localhost | |       =.* X .   |
2026-03-26 14:16:22.009253 | mon1 -> localhost | |      o B.+ + .  |
2026-03-26 14:16:22.009289 | mon1 -> localhost | |       o o.  .   |
2026-03-26 14:16:22.009325 | mon1 -> localhost | +----[SHA256]-----+
2026-03-26 14:16:22.009406 | mon1 -> localhost | ok: Runtime: 0:00:00.725933
2026-03-26 14:16:22.015442 | 
2026-03-26 14:16:22.015502 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-26 14:16:22.051946 | mon1 | ok
2026-03-26 14:16:22.056127 | osd1 | ok
2026-03-26 14:16:22.067848 | mon1 | included: /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-26 14:16:22.067896 | osd1 | included: /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-26 14:16:22.077582 | 
2026-03-26 14:16:22.077640 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-26 14:16:22.098758 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:22.109668 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:22.118317 | 
2026-03-26 14:16:22.118400 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-26 14:16:22.565000 | mon1 | changed
2026-03-26 14:16:22.570453 | osd1 | changed
2026-03-26 14:16:22.576826 | 
2026-03-26 14:16:22.576890 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-26 14:16:22.770675 | mon1 | ok
2026-03-26 14:16:22.776386 | osd1 | ok
2026-03-26 14:16:22.781311 | 
2026-03-26 14:16:22.781818 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-26 14:16:23.252020 | mon1 | changed
2026-03-26 14:16:23.268740 | osd1 | changed
2026-03-26 14:16:23.276589 | 
2026-03-26 14:16:23.276656 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-26 14:16:23.734435 | osd1 | changed
2026-03-26 14:16:23.740411 | mon1 | changed
2026-03-26 14:16:23.745323 | 
2026-03-26 14:16:23.745386 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-26 14:16:23.772722 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:23.784068 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:23.836854 | 
2026-03-26 14:16:23.837056 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-26 14:16:24.176918 | mon1 -> localhost | changed
2026-03-26 14:16:24.198138 | 
2026-03-26 14:16:24.198307 | TASK [add-build-sshkey : Add back temp key]
2026-03-26 14:16:24.463058 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/1f4ee8d4432d4b299c1e195295f39c74_id_rsa (zuul-build-sshkey)
2026-03-26 14:16:24.463315 | mon1 -> localhost | ok: Runtime: 0:00:00.012768
2026-03-26 14:16:24.469072 | 
2026-03-26 14:16:24.469133 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-26 14:16:24.737945 | mon1 | ok
2026-03-26 14:16:24.744401 | osd1 | ok
2026-03-26 14:16:24.749050 | 
2026-03-26 14:16:24.749125 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-26 14:16:24.771958 | mon1 | skipping: Conditional result was False
2026-03-26 14:16:24.783025 | osd1 | skipping: Conditional result was False
2026-03-26 14:16:24.806390 | 
2026-03-26 14:16:24.806533 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-26 14:16:25.081869 | mon1 | ok
2026-03-26 14:16:25.121242 | osd1 | ok
2026-03-26 14:16:25.131682 | 
2026-03-26 14:16:25.131797 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-26 14:16:25.787755 | osd1 | Output suppressed because no_log was given
2026-03-26 14:16:25.827281 | mon1 | Output suppressed because no_log was given
2026-03-26 14:16:25.842634 | 
2026-03-26 14:16:25.842734 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-26 14:16:26.032608 | mon1 | ok: "logs"
2026-03-26 14:16:26.033180 | mon1 | ok: All items complete
2026-03-26 14:16:26.033212 | 
2026-03-26 14:16:26.040570 | osd1 | ok: "logs"
2026-03-26 14:16:26.187736 | mon1 | ok: "artifacts"
2026-03-26 14:16:26.202410 | osd1 | ok: "artifacts"
2026-03-26 14:16:26.348655 | mon1 | ok: "docs"
2026-03-26 14:16:26.362187 | osd1 | ok: "docs"
2026-03-26 14:16:26.381964 | 
2026-03-26 14:16:26.382118 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-26 14:16:26.571362 | mon1 | changed: "logs"
2026-03-26 14:16:26.571694 | mon1 | ok: All items complete
2026-03-26 14:16:26.571735 | 
2026-03-26 14:16:26.577115 | osd1 | changed: "logs"
2026-03-26 14:16:26.723222 | mon1 | changed: "artifacts"
2026-03-26 14:16:26.739037 | osd1 | changed: "artifacts"
2026-03-26 14:16:26.900937 | mon1 | changed: "docs"
2026-03-26 14:16:26.910530 | osd1 | changed: "docs"
2026-03-26 14:16:26.927868 | 
2026-03-26 14:16:26.927954 | PLAY RECAP
2026-03-26 14:16:26.927997 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:26.928025 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-26 14:16:26.928050 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-26 14:16:26.928068 | 
2026-03-26 14:16:27.049641 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-26 14:16:27.055302 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-26 14:16:27.656934 | 
2026-03-26 14:16:27.657106 | PLAY [all]
2026-03-26 14:16:27.668583 | 
2026-03-26 14:16:27.668663 | TASK [setup-uv : Extract archive]
2026-03-26 14:16:29.910682 | mon1 | changed
2026-03-26 14:16:29.919822 | osd1 | changed
2026-03-26 14:16:29.926063 | 
2026-03-26 14:16:29.926148 | TASK [setup-uv : Print version]
2026-03-26 14:16:30.266782 | mon1 | uv 0.8.13
2026-03-26 14:16:30.345323 | osd1 | uv 0.8.13
2026-03-26 14:16:30.522089 | mon1 | ok: Runtime: 0:00:00.021451
2026-03-26 14:16:30.533141 | osd1 | ok: Runtime: 0:00:00.013810
2026-03-26 14:16:30.545543 | 
2026-03-26 14:16:30.545624 | PLAY RECAP
2026-03-26 14:16:30.545686 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:30.545720 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:16:30.545747 | 
2026-03-26 14:16:30.683765 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-26 14:16:30.690021 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-26 14:16:31.297339 | 
2026-03-26 14:16:31.297522 | PLAY [all]
2026-03-26 14:16:31.308657 | 
2026-03-26 14:16:31.308747 | TASK [Copy inventory file for Zuul]
2026-03-26 14:16:32.134628 | mon1 | changed
2026-03-26 14:16:32.141220 | 
2026-03-26 14:16:32.141296 | TASK [Switch "ansible_host" to private IP]
2026-03-26 14:16:32.439647 | mon1 | changed: 2 replacements made
2026-03-26 14:16:32.445055 | 
2026-03-26 14:16:32.445125 | TASK [Run Molecule scenario]
2026-03-26 14:16:32.910645 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-03-26 14:16:33.713940 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-03-26 14:16:33.922540 | mon1 | Using CPython 3.13.7
2026-03-26 14:16:33.922639 | mon1 | Creating virtual environment at: .venv
2026-03-26 14:16:34.249200 | mon1 | Downloading netaddr (2.2MiB)
2026-03-26 14:16:34.254392 | mon1 | Downloading pygments (1.2MiB)
2026-03-26 14:16:34.255216 | mon1 | Downloading cryptography (4.3MiB)
2026-03-26 14:16:34.255444 | mon1 | Downloading ansible-core (2.1MiB)
2026-03-26 14:16:34.467499 | mon1 |  Downloading netaddr
2026-03-26 14:16:34.479440 | mon1 |  Downloading cryptography
2026-03-26 14:16:34.531987 | mon1 |  Downloading pygments
2026-03-26 14:16:34.659215 | mon1 |  Downloading ansible-core
2026-03-26 14:16:34.688487 | mon1 | Installed 36 packages in 28ms
2026-03-26 14:16:35.798208 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-03-26 14:16:35.798304 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-26 14:16:36.452249 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-26 14:16:36.452331 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-26 14:16:50.849957 | mon1 | INFO     [default > dependency] Executing
2026-03-26 14:16:50.850183 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-26 14:16:50.850360 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-26 14:16:50.850473 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-26 14:16:50.856261 | mon1 | INFO     [default > cleanup] Executing
2026-03-26 14:16:50.856530 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-26 14:16:50.866646 | mon1 | INFO     [default > destroy] Executing
2026-03-26 14:16:50.866680 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-26 14:16:50.866697 | mon1 | INFO     [default > destroy] Executed: Successful
2026-03-26 14:16:50.878850 | mon1 | INFO     [default > syntax] Executing
2026-03-26 14:16:51.880447 | mon1 |
2026-03-26 14:16:51.880712 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:16:51.949960 | mon1 | INFO     [default > syntax] Executed: Successful
2026-03-26 14:16:51.960603 | mon1 | INFO     [default > create] Executing
2026-03-26 14:16:51.962817 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-26 14:16:51.968862 | mon1 | INFO     [default > prepare] Executing
2026-03-26 14:16:52.677137 | mon1 |
2026-03-26 14:16:52.677347 | mon1 | PLAY [Prepare] *****************************************************************
2026-03-26 14:16:52.677559 | mon1 |
2026-03-26 14:16:52.677825 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:16:52.678206 | mon1 | Thursday 26 March 2026  14:16:52 +0000 (0:00:00.032)       0:00:00.032 ********
2026-03-26 14:16:53.836141 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-26 14:16:53.836440 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-26 14:16:53.836702 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:16:53.837005 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:16:53.837208 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:16:53.840174 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-03-26 14:16:53.840387 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-26 14:16:53.840656 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:16:53.840885 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:16:53.841095 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:16:53.848224 | mon1 | ok: [mon1]
2026-03-26 14:16:53.848464 | mon1 | ok: [osd1]
2026-03-26 14:16:53.848678 | mon1 |
2026-03-26 14:16:53.848912 | mon1 | TASK [Configure short hostname] ************************************************
2026-03-26 14:16:53.849134 | mon1 | Thursday 26 March 2026  14:16:53 +0000 (0:00:01.171)       0:00:01.203 ********
2026-03-26 14:16:54.551862 | mon1 | changed: [mon1]
2026-03-26 14:16:54.552131 | mon1 | changed: [osd1]
2026-03-26 14:16:54.552291 | mon1 |
2026-03-26 14:16:54.552495 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-26 14:16:54.552714 | mon1 | Thursday 26 March 2026  14:16:54 +0000 (0:00:00.703)       0:00:01.907 ********
2026-03-26 14:16:54.832825 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-26 14:16:54.832901 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-03-26 14:16:54.833127 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-26 14:16:54.852687 | mon1 | changed: [mon1]
2026-03-26 14:16:54.852922 | mon1 | changed: [osd1]
2026-03-26 14:16:54.853201 | mon1 |
2026-03-26 14:16:54.853423 | mon1 | TASK [Update apt cache] ********************************************************
2026-03-26 14:16:54.853631 | mon1 | Thursday 26 March 2026  14:16:54 +0000 (0:00:00.301)       0:00:02.208 ********
2026-03-26 14:22:31.731454 | mon1 | changed: [mon1]
2026-03-26 14:22:31.731618 | mon1 | changed: [osd1]
2026-03-26 14:22:31.731812 | mon1 |
2026-03-26 14:22:31.732056 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-03-26 14:22:31.732224 | mon1 |
2026-03-26 14:22:31.732430 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:22:31.732638 | mon1 | Thursday 26 March 2026  14:22:31 +0000 (0:05:36.879)       0:05:39.087 ********
2026-03-26 14:22:32.412402 | mon1 | ok: [osd1]
2026-03-26 14:22:32.412474 | mon1 |
2026-03-26 14:22:32.412648 | mon1 | TASK [Install depedencies] *****************************************************
2026-03-26 14:22:32.412823 | mon1 | Thursday 26 March 2026  14:22:32 +0000 (0:00:00.680)       0:05:39.768 ********
2026-03-26 14:22:56.285019 | mon1 | changed: [osd1]
2026-03-26 14:22:56.285166 | mon1 |
2026-03-26 14:22:56.285377 | mon1 | TASK [Start up service] ********************************************************
2026-03-26 14:22:56.285593 | mon1 | Thursday 26 March 2026  14:22:56 +0000 (0:00:23.872)       0:06:03.641 ********
2026-03-26 14:22:56.880823 | mon1 | ok: [osd1]
2026-03-26 14:22:56.880897 | mon1 |
2026-03-26 14:22:56.881069 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-03-26 14:22:56.881191 | mon1 | Thursday 26 March 2026  14:22:56 +0000 (0:00:00.595)       0:06:04.236 ********
2026-03-26 14:22:57.182500 | mon1 | ok: [osd1]
2026-03-26 14:22:57.182667 | mon1 |
2026-03-26 14:22:57.182897 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-26 14:22:57.183120 | mon1 | Thursday 26 March 2026  14:22:57 +0000 (0:00:00.301)       0:06:04.538 ********
2026-03-26 14:22:57.856567 | mon1 | changed: [osd1]
2026-03-26 14:22:57.856743 | mon1 |
2026-03-26 14:22:57.856957 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-03-26 14:22:57.857193 | mon1 | Thursday 26 March 2026  14:22:57 +0000 (0:00:00.673)       0:06:05.212 ********
2026-03-26 14:22:58.043083 | mon1 | ok: [osd1]
2026-03-26 14:22:58.043243 | mon1 |
2026-03-26 14:22:58.043456 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-03-26 14:22:58.043679 | mon1 | Thursday 26 March 2026  14:22:58 +0000 (0:00:00.186)       0:06:05.399 ********
2026-03-26 14:22:58.064895 | mon1 | skipping: [osd1]
2026-03-26 14:22:58.065055 | mon1 |
2026-03-26 14:22:58.065257 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-03-26 14:22:58.065468 | mon1 | Thursday 26 March 2026  14:22:58 +0000 (0:00:00.021)       0:06:05.420 ********
2026-03-26 14:22:58.597882 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:22:58.597945 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:22:58.598070 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:22:58.598205 | mon1 |
2026-03-26 14:22:58.598339 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-03-26 14:22:58.598459 | mon1 | Thursday 26 March 2026  14:22:58 +0000 (0:00:00.532)       0:06:05.953 ********
2026-03-26 14:22:59.233750 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:22:59.233967 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:22:59.234236 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:22:59.234417 | mon1 |
2026-03-26 14:22:59.234627 | mon1 | TASK [Start loop devices] ******************************************************
2026-03-26 14:22:59.234832 | mon1 | Thursday 26 March 2026  14:22:59 +0000 (0:00:00.635)       0:06:06.589 ********
2026-03-26 14:22:59.892601 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:22:59.892719 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:22:59.892862 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:22:59.892991 | mon1 |
2026-03-26 14:22:59.893139 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-03-26 14:22:59.893280 | mon1 | Thursday 26 March 2026  14:22:59 +0000 (0:00:00.659)       0:06:07.248 ********
2026-03-26 14:23:03.323311 | mon1 | changed: [osd1] => (item=osd0)
2026-03-26 14:23:03.323484 | mon1 | changed: [osd1] => (item=osd1)
2026-03-26 14:23:03.323741 | mon1 | changed: [osd1] => (item=osd2)
2026-03-26 14:23:03.323999 | mon1 |
2026-03-26 14:23:03.324228 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-03-26 14:23:03.324450 | mon1 | Thursday 26 March 2026  14:23:03 +0000 (0:00:03.430)       0:06:10.679 ********
2026-03-26 14:23:06.419623 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-03-26 14:23:06.419824 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-03-26 14:23:06.420194 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-03-26 14:23:06.420420 | mon1 |
2026-03-26 14:23:06.420590 | mon1 | PLAY RECAP *********************************************************************
2026-03-26 14:23:06.420807 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-26 14:23:06.421019 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-26 14:23:06.421195 | mon1 |
2026-03-26 14:23:06.421358 | mon1 |
2026-03-26 14:23:06.421545 | mon1 | TASKS RECAP ********************************************************************
2026-03-26 14:23:06.421875 | mon1 | Thursday 26 March 2026  14:23:06 +0000 (0:00:03.096)       0:06:13.775 ********
2026-03-26 14:23:06.422139 | mon1 | ===============================================================================
2026-03-26 14:23:06.422407 | mon1 | Update apt cache ------------------------------------------------------ 336.88s
2026-03-26 14:23:06.422691 | mon1 | Install depedencies ---------------------------------------------------- 23.87s
2026-03-26 14:23:06.423052 | mon1 | Create a volume group for each loop device ------------------------------ 3.43s
2026-03-26 14:23:06.423274 | mon1 | Create a logical volume for each loop device ---------------------------- 3.10s
2026-03-26 14:23:06.423474 | mon1 | Gathering Facts --------------------------------------------------------- 1.17s
2026-03-26 14:23:06.423687 | mon1 | Configure short hostname ------------------------------------------------ 0.70s
2026-03-26 14:23:06.423934 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s
2026-03-26 14:23:06.424132 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.67s
2026-03-26 14:23:06.424327 | mon1 | Start loop devices ------------------------------------------------------ 0.66s
2026-03-26 14:23:06.424525 | mon1 | Set permissions on loopback devices ------------------------------------- 0.64s
2026-03-26 14:23:06.424717 | mon1 | Start up service -------------------------------------------------------- 0.60s
2026-03-26 14:23:06.424918 | mon1 | Create devices for Ceph ------------------------------------------------- 0.53s
2026-03-26 14:23:06.425106 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s
2026-03-26 14:23:06.425313 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.30s
2026-03-26 14:23:06.425521 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s
2026-03-26 14:23:06.425750 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-03-26 14:23:06.514995 | mon1 | INFO     [default > prepare] Executed: Successful
2026-03-26 14:23:06.525625 | mon1 | INFO     [default > converge] Executing
2026-03-26 14:23:07.332612 | mon1 |
2026-03-26 14:23:07.332800 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-26 14:23:07.332981 | mon1 |
2026-03-26 14:23:07.333180 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-26 14:23:07.333378 | mon1 | Thursday 26 March 2026  14:23:07 +0000 (0:00:00.045)       0:00:00.045 ********
2026-03-26 14:23:08.467781 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-26 14:23:08.467917 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-03-26 14:23:08.468089 | mon1 | interpreter could change the meaning of that path. See
2026-03-26 14:23:08.468252 | mon1 | https://docs.ansible.com/ansible-
2026-03-26 14:23:08.468402 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-26 14:23:08.480394 | mon1 | ok: [mon1]
2026-03-26 14:23:08.480593 | mon1 |
2026-03-26 14:23:08.480816 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:23:08.481148 | mon1 | Thursday 26 March 2026  14:23:08 +0000 (0:00:01.147)       0:00:01.192 ********
2026-03-26 14:23:08.779708 | mon1 | ok: [mon1]
2026-03-26 14:23:08.779784 | mon1 |
2026-03-26 14:23:08.779837 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:23:08.779934 | mon1 | Thursday 26 March 2026  14:23:08 +0000 (0:00:00.299)       0:00:01.492 ********
2026-03-26 14:23:08.816794 | mon1 | skipping: [mon1]
2026-03-26 14:23:08.816955 | mon1 |
2026-03-26 14:23:08.817165 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-26 14:23:08.817366 | mon1 | Thursday 26 March 2026  14:23:08 +0000 (0:00:00.036)       0:00:01.529 ********
2026-03-26 14:23:09.173504 | mon1 | changed: [mon1]
2026-03-26 14:23:09.173662 | mon1 |
2026-03-26 14:23:09.173891 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:23:09.174109 | mon1 | Thursday 26 March 2026  14:23:09 +0000 (0:00:00.356)       0:00:01.885 ********
2026-03-26 14:23:09.279583 | mon1 | ok: [mon1] => {
2026-03-26 14:23:09.279673 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-26 14:23:09.279912 | mon1 | }
2026-03-26 14:23:09.280093 | mon1 |
2026-03-26 14:23:09.280296 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:23:09.280494 | mon1 | Thursday 26 March 2026  14:23:09 +0000 (0:00:00.106)       0:00:01.991 ********
2026-03-26 14:23:10.025207 | mon1 | changed: [mon1]
2026-03-26 14:23:10.025356 | mon1 |
2026-03-26 14:23:10.025578 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:23:10.025853 | mon1 | Thursday 26 March 2026  14:23:10 +0000 (0:00:00.745)       0:00:02.737 ********
2026-03-26 14:23:10.069145 | mon1 | skipping: [mon1]
2026-03-26 14:23:10.069289 | mon1 |
2026-03-26 14:23:10.069512 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:23:10.069729 | mon1 | Thursday 26 March 2026  14:23:10 +0000 (0:00:00.044)       0:00:02.781 ********
2026-03-26 14:23:10.112662 | mon1 | skipping: [mon1]
2026-03-26 14:23:10.112816 | mon1 |
2026-03-26 14:23:10.113060 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:23:10.113291 | mon1 | Thursday 26 March 2026  14:23:10 +0000 (0:00:00.043)       0:00:02.824 ********
2026-03-26 14:23:10.327252 | mon1 | ok: [mon1]
2026-03-26 14:23:10.327320 | mon1 |
2026-03-26 14:23:10.327345 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-26 14:23:10.327448 | mon1 | Thursday 26 March 2026  14:23:10 +0000 (0:00:00.215)       0:00:03.039 ********
2026-03-26 14:23:11.637406 | mon1 | ok: [mon1]
2026-03-26 14:23:11.637771 | mon1 |
2026-03-26 14:23:11.638208 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:23:11.638600 | mon1 | Thursday 26 March 2026  14:23:11 +0000 (0:00:01.309)       0:00:04.349 ********
2026-03-26 14:23:11.707942 | mon1 | ok: [mon1] => {
2026-03-26 14:23:11.708123 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-26 14:23:11.708252 | mon1 | }
2026-03-26 14:23:11.708372 | mon1 |
2026-03-26 14:23:11.708500 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:23:11.708630 | mon1 | Thursday 26 March 2026  14:23:11 +0000 (0:00:00.070)       0:00:04.419 ********
2026-03-26 14:23:12.470192 | mon1 | changed: [mon1]
2026-03-26 14:23:12.470390 | mon1 |
2026-03-26 14:23:12.470520 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:23:12.470644 | mon1 | Thursday 26 March 2026  14:23:12 +0000 (0:00:00.759)       0:00:05.179 ********
2026-03-26 14:23:15.380031 | mon1 | changed: [mon1]
2026-03-26 14:23:15.380102 | mon1 |
2026-03-26 14:23:15.380353 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-26 14:23:15.380439 | mon1 | Thursday 26 March 2026  14:23:15 +0000 (0:00:02.912)       0:00:08.092 ********
2026-03-26 14:23:15.405153 | mon1 | skipping: [mon1]
2026-03-26 14:23:15.405230 | mon1 |
2026-03-26 14:23:15.405584 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-26 14:23:15.405777 | mon1 | Thursday 26 March 2026  14:23:15 +0000 (0:00:00.025)       0:00:08.117 ********
2026-03-26 14:23:15.436834 | mon1 | skipping: [mon1]
2026-03-26 14:23:15.436911 | mon1 |
2026-03-26 14:23:15.436974 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-26 14:23:15.437113 | mon1 | Thursday 26 March 2026  14:23:15 +0000 (0:00:00.031)       0:00:08.149 ********
2026-03-26 14:23:15.465897 | mon1 | skipping: [mon1]
2026-03-26 14:23:15.465971 | mon1 |
2026-03-26 14:23:15.466214 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-26 14:23:15.466474 | mon1 | Thursday 26 March 2026  14:23:15 +0000 (0:00:00.028)       0:00:08.178 ********
2026-03-26 14:23:23.744381 | mon1 | changed: [mon1]
2026-03-26 14:23:23.744451 | mon1 |
2026-03-26 14:23:23.744683 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-26 14:23:23.744749 | mon1 | Thursday 26 March 2026  14:23:23 +0000 (0:00:08.278)       0:00:16.456 ********
2026-03-26 14:23:24.302150 | mon1 | changed: [mon1]
2026-03-26 14:23:24.302246 | mon1 |
2026-03-26 14:23:24.302479 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-26 14:23:24.302536 | mon1 | Thursday 26 March 2026  14:23:24 +0000 (0:00:00.558)       0:00:17.014 ********
2026-03-26 14:23:25.219100 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-03-26 14:23:25.219174 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-26 14:23:25.219844 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-26 14:23:25.219885 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-26 14:23:25.219891 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-26 14:23:25.219896 | mon1 |
2026-03-26 14:23:25.219901 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-26 14:23:25.219905 | mon1 | Thursday 26 March 2026  14:23:25 +0000 (0:00:00.916)       0:00:17.931 ********
2026-03-26 14:23:25.763336 | mon1 | changed: [mon1]
2026-03-26 14:23:25.763414 | mon1 |
2026-03-26 14:23:25.763421 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-26 14:23:25.763427 | mon1 | Thursday 26 March 2026  14:23:25 +0000 (0:00:00.536)       0:00:18.468 ********
2026-03-26 14:23:25.763431 | mon1 |
2026-03-26 14:23:25.763435 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-26 14:23:25.763439 | mon1 | Thursday 26 March 2026  14:23:25 +0000 (0:00:00.006)       0:00:18.475 ********
2026-03-26 14:23:26.701432 | mon1 | ok: [mon1]
2026-03-26 14:23:26.701530 | mon1 |
2026-03-26 14:23:26.701900 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-26 14:23:26.701987 | mon1 | Thursday 26 March 2026  14:23:26 +0000 (0:00:00.938)       0:00:19.413 ********
2026-03-26 14:23:27.149807 | mon1 | changed: [mon1]
2026-03-26 14:23:27.149961 | mon1 |
2026-03-26 14:23:27.149980 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-26 14:23:27.149999 | mon1 | Thursday 26 March 2026  14:23:27 +0000 (0:00:00.448)       0:00:19.862 ********
2026-03-26 14:23:27.663181 | mon1 | changed: [mon1]
2026-03-26 14:23:27.663287 | mon1 |
2026-03-26 14:23:27.663300 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-26 14:23:27.663455 | mon1 | Thursday 26 March 2026  14:23:27 +0000 (0:00:00.513)       0:00:20.375 ********
2026-03-26 14:23:27.860694 | mon1 | ok: [mon1]
2026-03-26 14:23:27.860771 | mon1 |
2026-03-26 14:23:27.860832 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-26 14:23:27.860942 | mon1 | Thursday 26 March 2026  14:23:27 +0000 (0:00:00.197)       0:00:20.573 ********
2026-03-26 14:23:27.932167 | mon1 | ok: [mon1] => {
2026-03-26 14:23:27.932243 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-26 14:23:27.932716 | mon1 | }
2026-03-26 14:23:27.932806 | mon1 |
2026-03-26 14:23:27.932813 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-26 14:23:27.932820 | mon1 | Thursday 26 March 2026  14:23:27 +0000 (0:00:00.070)       0:00:20.644 ********
2026-03-26 14:23:28.734131 | mon1 | changed: [mon1]
2026-03-26 14:23:28.734205 | mon1 |
2026-03-26 14:23:28.734422 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-26 14:23:28.734468 | mon1 | Thursday 26 March 2026  14:23:28 +0000 (0:00:00.802)       0:00:21.446 ********
2026-03-26 14:23:33.105164 | mon1 | changed: [mon1]
2026-03-26 14:23:33.105833 | mon1 |
2026-03-26 14:23:33.105898 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-26 14:23:33.105913 | mon1 | Thursday 26 March 2026  14:23:33 +0000 (0:00:04.369)       0:00:25.816 ********
2026-03-26 14:23:34.293063 | mon1 | ok: [mon1]
2026-03-26 14:23:34.293273 | mon1 |
2026-03-26 14:23:34.293286 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-26 14:23:34.293296 | mon1 | Thursday 26 March 2026  14:23:34 +0000 (0:00:01.188)       0:00:27.005 ********
2026-03-26 14:23:35.014140 | mon1 | changed: [mon1]
2026-03-26 14:23:35.014209 | mon1 |
2026-03-26 14:23:35.014376 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-26 14:23:35.014391 | mon1 | Thursday 26 March 2026  14:23:35 +0000 (0:00:00.721)       0:00:27.726 ********
2026-03-26 14:23:35.459757 | mon1 | changed: [mon1]
2026-03-26 14:23:35.459824 | mon1 |
2026-03-26 14:23:35.459913 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-26 14:23:35.460050 | mon1 | Thursday 26 March 2026  14:23:35 +0000 (0:00:00.445)       0:00:28.172 ********
2026-03-26 14:23:36.030477 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-03-26 14:23:36.030556 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-26 14:23:36.031002 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-26 14:23:36.031051 | mon1 |
2026-03-26 14:23:36.031058 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-26 14:23:36.031063 | mon1 | Thursday 26 March 2026  14:23:36 +0000 (0:00:00.570)       0:00:28.743 ********
2026-03-26 14:23:36.476291 | mon1 | changed: [mon1]
2026-03-26 14:23:36.476363 | mon1 |
2026-03-26 14:23:36.476717 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-26 14:23:36.476773 | mon1 | Thursday 26 March 2026  14:23:36 +0000 (0:00:00.445)       0:00:29.188 ********
2026-03-26 14:23:36.927356 | mon1 | changed: [mon1]
2026-03-26 14:23:36.927439 | mon1 |
2026-03-26 14:23:36.927500 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-26 14:23:36.927878 | mon1 | Thursday 26 March 2026  14:23:36 +0000 (0:00:00.445)       0:00:29.634 ********
2026-03-26 14:23:36.927918 | mon1 |
2026-03-26 14:23:36.927924 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-26 14:23:36.927939 | mon1 | Thursday 26 March 2026  14:23:36 +0000 (0:00:00.005)       0:00:29.640 ********
2026-03-26 14:23:37.548154 | mon1 | ok: [mon1]
2026-03-26 14:23:37.548268 | mon1 |
2026-03-26 14:23:37.548637 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-26 14:23:37.548686 | mon1 | Thursday 26 March 2026  14:23:37 +0000 (0:00:00.620)       0:00:30.260 ********
2026-03-26 14:23:39.522261 | mon1 | changed: [mon1]
2026-03-26 14:23:39.522358 | mon1 |
2026-03-26 14:23:39.522388 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-26 14:23:39.522516 | mon1 | Thursday 26 March 2026  14:23:39 +0000 (0:00:01.974)       0:00:32.234 ********
2026-03-26 14:23:40.047164 | mon1 | changed: [mon1]
2026-03-26 14:23:40.047238 | mon1 |
2026-03-26 14:23:40.047440 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-26 14:23:40.047480 | mon1 | Thursday 26 March 2026  14:23:40 +0000 (0:00:00.524)       0:00:32.759 ********
2026-03-26 14:23:40.091452 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-03-26 14:23:40.091521 | mon1 |
2026-03-26 14:23:40.091697 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-26 14:23:40.091721 | mon1 | Thursday 26 March 2026  14:23:40 +0000 (0:00:00.044)       0:00:32.804 ********
2026-03-26 14:24:16.265115 | mon1 | changed: [mon1]
2026-03-26 14:24:16.265333 | mon1 |
2026-03-26 14:24:16.265626 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-26 14:24:16.265647 | mon1 | Thursday 26 March 2026  14:24:16 +0000 (0:00:36.173)       0:01:08.977 ********
2026-03-26 14:24:16.930791 | mon1 | ok: [mon1] => (item=chronyd)
2026-03-26 14:24:16.930865 | mon1 | ok: [mon1] => (item=sshd)
2026-03-26 14:24:16.930924 | mon1 |
2026-03-26 14:24:16.931152 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-26 14:24:16.931199 | mon1 | Thursday 26 March 2026  14:24:16 +0000 (0:00:00.665)       0:01:09.643 ********
2026-03-26 14:24:17.214529 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-21.0.0/el9/noarch/cephadm"}
2026-03-26 14:24:17.215822 | mon1 |
2026-03-26 14:24:17.215940 | mon1 | PLAY RECAP *********************************************************************
2026-03-26 14:24:17.216085 | mon1 | mon1                       : ok=33   changed=20   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-03-26 14:24:17.218192 | mon1 |
2026-03-26 14:24:17.218263 | mon1 |
2026-03-26 14:24:17.218270 | mon1 | TASKS RECAP ********************************************************************
2026-03-26 14:24:17.218275 | mon1 | Thursday 26 March 2026  14:24:17 +0000 (0:00:00.285)       0:01:09.928 ********
2026-03-26 14:24:17.218281 | mon1 | ===============================================================================
2026-03-26 14:24:17.218286 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 36.17s
2026-03-26 14:24:17.218291 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.28s
2026-03-26 14:24:17.218296 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.37s
2026-03-26 14:24:17.218301 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.91s
2026-03-26 14:24:17.218306 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.97s
2026-03-26 14:24:17.218311 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.56s
2026-03-26 14:24:17.218316 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.31s
2026-03-26 14:24:17.218321 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 1.19s
2026-03-26 14:24:17.218326 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s
2026-03-26 14:24:17.218331 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 0.92s
2026-03-26 14:24:17.218348 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.80s
2026-03-26 14:24:17.218353 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.76s
2026-03-26 14:24:17.218391 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.75s
2026-03-26 14:24:17.218397 | mon1 | vexxhost.containers.docker : Ensure group "docker" exists --------------- 0.72s
2026-03-26 14:24:17.219092 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.67s
2026-03-26 14:24:17.219243 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.57s
2026-03-26 14:24:17.219370 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.56s
2026-03-26 14:24:17.219479 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.54s
2026-03-26 14:24:17.219571 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.52s
2026-03-26 14:24:17.219664 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.51s
2026-03-26 14:24:17.287363 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:24:17.287453 | mon1 | ERROR    [default > converge] Executed: Failed
2026-03-26 14:24:17.287577 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-26 14:24:27.666531 | mon1 | ERROR
2026-03-26 14:24:27.666818 | mon1 | {
2026-03-26 14:24:27.666884 | mon1 |   "delta": "0:07:44.611599",
2026-03-26 14:24:27.666929 | mon1 |   "end": "2026-03-26 14:24:17.368574",
2026-03-26 14:24:27.667025 | mon1 |   "msg": "non-zero return code",
2026-03-26 14:24:27.667066 | mon1 |   "rc": 2,
2026-03-26 14:24:27.667113 | mon1 |   "start": "2026-03-26 14:16:32.756975"
2026-03-26 14:24:27.667153 | mon1 | }
failure
2026-03-26 14:24:27.672447 | 
2026-03-26 14:24:27.672505 | PLAY RECAP
2026-03-26 14:24:27.672559 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-26 14:24:27.672588 | 
2026-03-26 14:24:27.765371 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-26 14:24:27.771364 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-26 14:24:28.330945 | 
2026-03-26 14:24:28.331070 | PLAY [all]
2026-03-26 14:24:28.342944 | 
2026-03-26 14:24:28.343031 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-26 14:24:28.394418 | mon1 | ok
2026-03-26 14:24:28.400231 | osd1 | ok
2026-03-26 14:24:28.404410 | 
2026-03-26 14:24:28.404484 | TASK [fetch-output : Set log path for single node]
2026-03-26 14:24:28.426503 | mon1 | skipping: Conditional result was False
2026-03-26 14:24:28.437844 | osd1 | skipping: Conditional result was False
2026-03-26 14:24:28.446519 | 
2026-03-26 14:24:28.446612 | LOOP [fetch-output : Ensure local output dirs]
2026-03-26 14:24:28.808202 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/logs/mon1"
2026-03-26 14:24:28.834189 | osd1 -> localhost | changed: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/logs/osd1"
2026-03-26 14:24:29.016050 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/artifacts"
2026-03-26 14:24:29.040278 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/artifacts"
2026-03-26 14:24:29.241848 | mon1 -> localhost | changed: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/docs"
2026-03-26 14:24:29.247741 | osd1 -> localhost | ok: "/var/lib/zuul/builds/1f4ee8d4432d4b299c1e195295f39c74/work/docs"
2026-03-26 14:24:29.267966 | 
2026-03-26 14:24:29.268133 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-26 14:24:29.879989 | osd1 | changed: .d..t...... ./
2026-03-26 14:24:29.880489 | osd1 | changed: All items complete
2026-03-26 14:24:29.880558 | 
2026-03-26 14:24:29.889393 | mon1 | changed: .d..t...... ./
2026-03-26 14:24:30.305280 | osd1 | changed: .d..t...... ./
2026-03-26 14:24:30.312801 | mon1 | ok
2026-03-26 14:24:30.753485 | osd1 | changed: .d..t...... ./
2026-03-26 14:24:30.763569 | mon1 | ok
2026-03-26 14:24:30.788505 | 
2026-03-26 14:24:30.788698 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-26 14:24:31.202038 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007673
2026-03-26 14:24:31.202292 | mon1 -> localhost | changed: All items complete
2026-03-26 14:24:31.202321 | 
2026-03-26 14:24:31.431168 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008065
2026-03-26 14:24:31.458662 | 
2026-03-26 14:24:31.458781 | PLAY [all]
2026-03-26 14:24:31.465866 | 
2026-03-26 14:24:31.465962 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-26 14:24:31.881835 | mon1 | changed
2026-03-26 14:24:32.034349 | osd1 | changed
2026-03-26 14:24:32.044876 | 
2026-03-26 14:24:32.044975 | PLAY RECAP
2026-03-26 14:24:32.045027 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-26 14:24:32.045056 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-26 14:24:32.045075 | 
2026-03-26 14:24:32.185553 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-26 14:24:32.188246 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-26 14:24:32.749115 | 
2026-03-26 14:24:32.749670 | PLAY [localhost]
2026-03-26 14:24:32.760153 | 
2026-03-26 14:24:32.760240 | TASK [Generate Zuul manifest]
2026-03-26 14:24:32.781890 | localhost | ok
2026-03-26 14:24:32.799344 | 
2026-03-26 14:24:32.799430 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-26 14:24:33.147075 | localhost | changed
2026-03-26 14:24:33.157350 | 
2026-03-26 14:24:33.157430 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-26 14:24:33.522243 | localhost | ok
2026-03-26 14:24:33.530013 | 
2026-03-26 14:24:33.530084 | TASK [Upload logs]
2026-03-26 14:24:33.551446 | localhost | ok
2026-03-26 14:24:33.609472 | 
2026-03-26 14:24:33.609605 | TASK [Set zuul-log-path fact]
2026-03-26 14:24:33.629253 | localhost | ok
2026-03-26 14:24:33.643715 | 
2026-03-26 14:24:33.643815 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-26 14:24:33.675958 | localhost | ok
2026-03-26 14:24:33.682965 | 
2026-03-26 14:24:33.683029 | TASK [upload-logs : Create log directories]
2026-03-26 14:24:34.092501 | localhost | changed
2026-03-26 14:24:34.098570 | 
2026-03-26 14:24:34.098643 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-26 14:24:34.495896 | localhost -> localhost | ok: Runtime: 0:00:00.006264
2026-03-26 14:24:34.501736 | 
2026-03-26 14:24:34.501800 | TASK [upload-logs : Upload logs to log server]
2026-03-26 14:24:34.982067 | localhost | Output suppressed because no_log was given
2026-03-26 14:24:34.986604 | 
2026-03-26 14:24:34.986666 | LOOP [upload-logs : Compress console log and json output]
2026-03-26 14:24:35.033129 | localhost | skipping: Conditional result was False
2026-03-26 14:24:35.040569 | localhost | skipping: Conditional result was False
2026-03-26 14:24:35.053342 | 
2026-03-26 14:24:35.053600 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-26 14:24:35.096959 | localhost | skipping: Conditional result was False
2026-03-26 14:24:35.097431 | 
2026-03-26 14:24:35.100820 | localhost | skipping: Conditional result was False
2026-03-26 14:24:35.118112 | 
2026-03-26 14:24:35.118212 | LOOP [upload-logs : Upload console log and json output]