2026-03-12 19:00:12.557340 | Job console starting 2026-03-12 19:00:12.577402 | Updating git repos 2026-03-12 19:00:12.621925 | Cloning repos into workspace 2026-03-12 19:00:12.657497 | Restoring repo states 2026-03-12 19:00:12.663108 | Merging changes 2026-03-12 19:00:12.971110 | Checking out repos 2026-03-12 19:00:13.010652 | Preparing playbooks 2026-03-12 19:00:13.920517 | Running Ansible setup 2026-03-12 19:00:19.278707 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-12 19:00:19.864187 | 2026-03-12 19:00:19.864304 | PLAY [localhost] 2026-03-12 19:00:19.871891 | 2026-03-12 19:00:19.871960 | TASK [Gathering Facts] 2026-03-12 19:00:21.004566 | localhost | ok 2026-03-12 19:00:21.015101 | 2026-03-12 19:00:21.015225 | TASK [Setup log path fact] 2026-03-12 19:00:21.037251 | localhost | ok 2026-03-12 19:00:21.051483 | 2026-03-12 19:00:21.051570 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-12 19:00:21.080397 | localhost | ok 2026-03-12 19:00:21.088071 | 2026-03-12 19:00:21.088160 | TASK [emit-job-header : Print job information] 2026-03-12 19:00:21.128394 | # Job Information 2026-03-12 19:00:21.128549 | Ansible Version: 2.16.16 2026-03-12 19:00:21.128595 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-12 19:00:21.128625 | Pipeline: check 2026-03-12 19:00:21.128652 | Executor: 0a8996d2b663 2026-03-12 19:00:21.128678 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/97 2026-03-12 19:00:21.128709 | Event ID: 64481ba0-1e45-11f1-9154-be3c1d63f3c8 2026-03-12 19:00:21.132283 | 2026-03-12 19:00:21.132372 | LOOP [emit-job-header : Print node information] 2026-03-12 19:00:21.222635 | localhost | ok: 2026-03-12 19:00:21.223032 | localhost | # Node Information 2026-03-12 19:00:21.223140 | localhost | Inventory Hostname: mon1 2026-03-12 19:00:21.223191 | localhost | Hostname: np0000158596 2026-03-12 19:00:21.223236 | localhost | Username: zuul 2026-03-12 19:00:21.223284 | localhost | Distro: Ubuntu 22.04 2026-03-12 19:00:21.223327 | localhost | Provider: yul1 2026-03-12 19:00:21.223369 | localhost | Region: ca-ymq-1 2026-03-12 19:00:21.223412 | localhost | Label: ubuntu-jammy 2026-03-12 19:00:21.223452 | localhost | Product Name: OpenStack Nova 2026-03-12 19:00:21.223493 | localhost | Interface IP: 162.253.55.12 2026-03-12 19:00:21.268044 | localhost | ok: 2026-03-12 19:00:21.268099 | localhost | # Node Information 2026-03-12 19:00:21.268152 | localhost | Inventory Hostname: osd1 2026-03-12 19:00:21.268178 | localhost | Hostname: np0000158597 2026-03-12 19:00:21.268225 | localhost | Username: zuul 2026-03-12 19:00:21.268248 | localhost | Distro: Ubuntu 22.04 2026-03-12 19:00:21.268267 | localhost | Provider: yul1 2026-03-12 19:00:21.268286 | localhost | Region: ca-ymq-1 2026-03-12 19:00:21.268325 | localhost | Label: ubuntu-jammy 2026-03-12 19:00:21.268349 | localhost | Product Name: OpenStack Nova 2026-03-12 19:00:21.268392 | localhost | Interface IP: 162.253.55.49 2026-03-12 19:00:21.284197 | 2026-03-12 19:00:21.284349 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-12 19:00:21.643676 | localhost -> localhost | changed 2026-03-12 19:00:21.652645 | 2026-03-12 19:00:21.652746 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-12 19:00:23.731721 | localhost -> localhost | changed 2026-03-12 19:00:23.742231 | 2026-03-12 19:00:23.742301 | PLAY [all] 2026-03-12 19:00:23.752776 | 2026-03-12 19:00:23.752839 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-12 19:00:23.989186 | mon1 -> localhost | ok 2026-03-12 19:00:23.999710 | 2026-03-12 19:00:23.999803 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-12 19:00:24.035035 | mon1 | ok 2026-03-12 19:00:24.039330 | osd1 | ok 2026-03-12 19:00:24.057506 | mon1 | included: /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-12 19:00:24.057567 | osd1 | included: /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-12 19:00:24.063583 | 2026-03-12 19:00:24.063647 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-12 19:00:25.507675 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-12 19:00:25.507885 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/ca0bdf49ca354c61a88f274719176e2c_id_rsa 2026-03-12 19:00:25.507930 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/ca0bdf49ca354c61a88f274719176e2c_id_rsa.pub 2026-03-12 19:00:25.507962 | mon1 -> localhost | The key fingerprint is: 2026-03-12 19:00:25.507992 | mon1 -> localhost | SHA256:kNXv/gt6r+6e2t/sc+ww94Tu8+S/fhZVWH1p0ognfSc zuul-build-sshkey 2026-03-12 19:00:25.508021 | mon1 -> localhost | The key's randomart image is: 2026-03-12 19:00:25.508049 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-12 19:00:25.508078 | mon1 -> localhost | | .. o oo+| 2026-03-12 19:00:25.508119 | mon1 -> localhost | | o .o =E==| 2026-03-12 19:00:25.508148 | mon1 -> localhost | | o .o +.+| 2026-03-12 19:00:25.508184 | mon1 -> localhost | | . . .| 2026-03-12 19:00:25.508212 | mon1 -> localhost | | S . .| 2026-03-12 19:00:25.508239 | mon1 -> localhost | | . o | 2026-03-12 19:00:25.508265 | mon1 -> localhost | | .. +.=| 2026-03-12 19:00:25.508291 | mon1 -> localhost | | oo+.@*| 2026-03-12 19:00:25.508317 | mon1 -> localhost | | o*B*OX/| 2026-03-12 19:00:25.508343 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-12 19:00:25.508402 | mon1 -> localhost | ok: Runtime: 0:00:01.049947 2026-03-12 19:00:25.515265 | 2026-03-12 19:00:25.515351 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-12 19:00:25.551173 | mon1 | ok 2026-03-12 19:00:25.555488 | osd1 | ok 2026-03-12 19:00:25.567053 | mon1 | included: /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-12 19:00:25.567102 | osd1 | included: /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-12 19:00:25.576562 | 2026-03-12 19:00:25.576623 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-12 19:00:25.598750 | mon1 | skipping: Conditional result was False 2026-03-12 19:00:25.609710 | osd1 | skipping: Conditional result was False 2026-03-12 19:00:25.622598 | 2026-03-12 19:00:25.622660 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-12 19:00:26.050003 | mon1 | changed 2026-03-12 19:00:26.057969 | osd1 | changed 2026-03-12 19:00:26.062940 | 2026-03-12 19:00:26.063001 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-12 19:00:26.243893 | mon1 | ok 2026-03-12 19:00:26.250614 | osd1 | ok 2026-03-12 19:00:26.255650 | 2026-03-12 19:00:26.255720 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-12 19:00:26.717374 | osd1 | changed 2026-03-12 19:00:26.736686 | mon1 | changed 2026-03-12 19:00:26.745667 | 2026-03-12 19:00:26.745731 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-12 19:00:27.191796 | osd1 | changed 2026-03-12 19:00:27.208226 | mon1 | changed 2026-03-12 19:00:27.214754 | 2026-03-12 19:00:27.214839 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-12 19:00:27.239355 | mon1 | skipping: Conditional result was False 2026-03-12 19:00:27.250819 | osd1 | skipping: Conditional result was False 2026-03-12 19:00:27.293419 | 2026-03-12 19:00:27.293568 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-12 19:00:27.611626 | mon1 -> localhost | changed 2026-03-12 19:00:27.634897 | 2026-03-12 19:00:27.634973 | TASK [add-build-sshkey : Add back temp key] 2026-03-12 19:00:27.907738 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/ca0bdf49ca354c61a88f274719176e2c_id_rsa (zuul-build-sshkey) 2026-03-12 19:00:27.908008 | mon1 -> localhost | ok: Runtime: 0:00:00.017145 2026-03-12 19:00:27.914995 | 2026-03-12 19:00:27.915085 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-12 19:00:28.180825 | osd1 | ok 2026-03-12 19:00:28.186581 | mon1 | ok 2026-03-12 19:00:28.191308 | 2026-03-12 19:00:28.191375 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-12 19:00:28.214234 | mon1 | skipping: Conditional result was False 2026-03-12 19:00:28.225362 | osd1 | skipping: Conditional result was False 2026-03-12 19:00:28.244737 | 2026-03-12 19:00:28.244803 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-12 19:00:28.522110 | mon1 | ok 2026-03-12 19:00:28.527839 | osd1 | ok 2026-03-12 19:00:28.534393 | 2026-03-12 19:00:28.534459 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-12 19:00:29.206641 | mon1 | Output suppressed because no_log was given 2026-03-12 19:00:29.212255 | osd1 | Output suppressed because no_log was given 2026-03-12 19:00:29.225135 | 2026-03-12 19:00:29.225194 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-12 19:00:29.409166 | mon1 | ok: "logs" 2026-03-12 19:00:29.409475 | mon1 | ok: All items complete 2026-03-12 19:00:29.409516 | 2026-03-12 19:00:29.414769 | osd1 | ok: "logs" 2026-03-12 19:00:29.567770 | osd1 | ok: "artifacts" 2026-03-12 19:00:29.572256 | mon1 | ok: "artifacts" 2026-03-12 19:00:29.719055 | osd1 | ok: "docs" 2026-03-12 19:00:29.735123 | mon1 | ok: "docs" 2026-03-12 19:00:29.748249 | 2026-03-12 19:00:29.748375 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-12 19:00:29.930114 | mon1 | changed: "logs" 2026-03-12 19:00:29.930380 | mon1 | ok: All items complete 2026-03-12 19:00:29.930418 | 2026-03-12 19:00:29.935215 | osd1 | changed: "logs" 2026-03-12 19:00:30.080568 | mon1 | changed: "artifacts" 2026-03-12 19:00:30.107152 | osd1 | changed: "artifacts" 2026-03-12 19:00:30.235538 | mon1 | changed: "docs" 2026-03-12 19:00:30.261583 | osd1 | changed: "docs" 2026-03-12 19:00:30.278214 | 2026-03-12 19:00:30.278319 | PLAY RECAP 2026-03-12 19:00:30.278366 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-12 19:00:30.278397 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-12 19:00:30.278421 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-12 19:00:30.278440 | 2026-03-12 19:00:30.399432 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-12 19:00:30.404159 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-12 19:00:30.999004 | 2026-03-12 19:00:30.999190 | PLAY [all] 2026-03-12 19:00:31.014105 | 2026-03-12 19:00:31.014302 | TASK [setup-uv : Extract archive] 2026-03-12 19:00:33.180563 | osd1 | changed 2026-03-12 19:00:33.257008 | mon1 | changed 2026-03-12 19:00:33.265711 | 2026-03-12 19:00:33.265831 | TASK [setup-uv : Print version] 2026-03-12 19:00:33.661103 | osd1 | uv 0.8.13 2026-03-12 19:00:33.663376 | mon1 | uv 0.8.13 2026-03-12 19:00:33.831341 | mon1 | ok: Runtime: 0:00:00.026204 2026-03-12 19:00:33.841241 | osd1 | ok: Runtime: 0:00:00.020969 2026-03-12 19:00:33.851456 | 2026-03-12 19:00:33.851514 | PLAY RECAP 2026-03-12 19:00:33.851567 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-12 19:00:33.851596 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-12 19:00:33.851615 | 2026-03-12 19:00:33.997690 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-12 19:00:34.002773 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-12 19:00:34.584727 | 2026-03-12 19:00:34.584845 | PLAY [all] 2026-03-12 19:00:34.595859 | 2026-03-12 19:00:34.595933 | TASK [Copy inventory file for Zuul] 2026-03-12 19:00:35.418695 | mon1 | changed 2026-03-12 19:00:35.423487 | 2026-03-12 19:00:35.423558 | TASK [Switch "ansible_host" to private IP] 2026-03-12 19:00:36.560536 | mon1 | changed: 2 replacements made 2026-03-12 19:00:36.567781 | 2026-03-12 19:00:36.567872 | TASK [Run Molecule scenario] 2026-03-12 19:00:37.149052 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-12 19:00:37.896181 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-12 19:00:38.124664 | mon1 | Using CPython 3.13.7 2026-03-12 19:00:38.124753 | mon1 | Creating virtual environment at: .venv 2026-03-12 19:00:38.534339 | mon1 | Downloading netaddr (2.2MiB) 2026-03-12 19:00:38.535584 | mon1 | Downloading pygments (1.2MiB) 2026-03-12 19:00:38.537223 | mon1 | Downloading cryptography (4.3MiB) 2026-03-12 19:00:38.553298 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-12 19:00:38.729175 | mon1 | Downloading netaddr 2026-03-12 19:00:38.740891 | mon1 | Downloading cryptography 2026-03-12 19:00:38.783455 | mon1 | Downloading pygments 2026-03-12 19:00:38.918462 | mon1 | Downloading ansible-core 2026-03-12 19:00:38.952629 | mon1 | Installed 36 packages in 33ms 2026-03-12 19:00:40.056852 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-12 19:00:40.056975 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-12 19:00:40.741142 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-12 19:00:40.741286 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-12 19:01:38.413990 | mon1 | INFO [default > dependency] Executing 2026-03-12 19:01:38.414092 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-12 19:01:38.414280 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-12 19:01:38.414394 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-12 19:01:38.419407 | mon1 | INFO [default > cleanup] Executing 2026-03-12 19:01:38.419687 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-12 19:01:38.424640 | mon1 | INFO [default > destroy] Executing 2026-03-12 19:01:38.424675 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-12 19:01:38.424739 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-12 19:01:38.429684 | mon1 | INFO [default > syntax] Executing 2026-03-12 19:01:39.406972 | mon1 | 2026-03-12 19:01:39.407224 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-12 19:01:39.481980 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-12 19:01:39.492521 | mon1 | INFO [default > create] Executing 2026-03-12 19:01:39.493796 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-12 19:01:39.498715 | mon1 | INFO [default > prepare] Executing 2026-03-12 19:01:40.177412 | mon1 | 2026-03-12 19:01:40.177606 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-12 19:01:40.177794 | mon1 | 2026-03-12 19:01:40.178000 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-12 19:01:40.178202 | mon1 | Thursday 12 March 2026 19:01:40 +0000 (0:00:00.029) 0:00:00.029 ******** 2026-03-12 19:01:41.268339 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-12 19:01:41.268413 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-12 19:01:41.268545 | mon1 | interpreter could change the meaning of that path. See 2026-03-12 19:01:41.268666 | mon1 | https://docs.ansible.com/ansible- 2026-03-12 19:01:41.268796 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-12 19:01:41.286899 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-12 19:01:41.287134 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-12 19:01:41.287348 | mon1 | interpreter could change the meaning of that path. See 2026-03-12 19:01:41.287624 | mon1 | https://docs.ansible.com/ansible- 2026-03-12 19:01:41.287840 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-12 19:01:41.294345 | mon1 | ok: [osd1] 2026-03-12 19:01:41.294551 | mon1 | ok: [mon1] 2026-03-12 19:01:41.294752 | mon1 | 2026-03-12 19:01:41.294970 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-12 19:01:41.295176 | mon1 | Thursday 12 March 2026 19:01:41 +0000 (0:00:01.117) 0:00:01.147 ******** 2026-03-12 19:01:41.982054 | mon1 | changed: [mon1] 2026-03-12 19:01:41.982116 | mon1 | changed: [osd1] 2026-03-12 19:01:41.982191 | mon1 | 2026-03-12 19:01:41.982285 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-12 19:01:41.982388 | mon1 | Thursday 12 March 2026 19:01:41 +0000 (0:00:00.687) 0:00:01.834 ******** 2026-03-12 19:01:42.247597 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-12 19:01:42.247679 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-12 19:01:42.247837 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-12 19:01:42.255570 | mon1 | changed: [mon1] 2026-03-12 19:01:42.255776 | mon1 | changed: [osd1] 2026-03-12 19:01:42.255973 | mon1 | 2026-03-12 19:01:42.256191 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-12 19:01:42.256442 | mon1 | Thursday 12 March 2026 19:01:42 +0000 (0:00:00.273) 0:00:02.108 ******** 2026-03-12 19:01:49.730411 | mon1 | changed: [mon1] 2026-03-12 19:01:49.730536 | mon1 | changed: [osd1] 2026-03-12 19:01:49.730770 | mon1 | 2026-03-12 19:01:49.730933 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-12 19:01:49.731179 | mon1 | 2026-03-12 19:01:49.731315 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-12 19:01:49.731522 | mon1 | Thursday 12 March 2026 19:01:49 +0000 (0:00:07.474) 0:00:09.583 ******** 2026-03-12 19:01:50.406023 | mon1 | ok: [osd1] 2026-03-12 19:01:50.406144 | mon1 | 2026-03-12 19:01:50.406321 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-12 19:01:50.406515 | mon1 | Thursday 12 March 2026 19:01:50 +0000 (0:00:00.675) 0:00:10.258 ******** 2026-03-12 19:02:18.108793 | mon1 | changed: [osd1] 2026-03-12 19:02:18.108894 | mon1 | 2026-03-12 19:02:18.109142 | mon1 | TASK [Start up service] ******************************************************** 2026-03-12 19:02:18.109340 | mon1 | Thursday 12 March 2026 19:02:18 +0000 (0:00:27.702) 0:00:37.961 ******** 2026-03-12 19:02:18.650680 | mon1 | ok: [osd1] 2026-03-12 19:02:18.650833 | mon1 | 2026-03-12 19:02:18.651021 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-12 19:02:18.651265 | mon1 | Thursday 12 March 2026 19:02:18 +0000 (0:00:00.541) 0:00:38.503 ******** 2026-03-12 19:02:18.946955 | mon1 | ok: [osd1] 2026-03-12 19:02:18.947126 | mon1 | 2026-03-12 19:02:18.947332 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-12 19:02:18.947569 | mon1 | Thursday 12 March 2026 19:02:18 +0000 (0:00:00.296) 0:00:38.799 ******** 2026-03-12 19:02:19.600465 | mon1 | changed: [osd1] 2026-03-12 19:02:19.600639 | mon1 | 2026-03-12 19:02:19.600862 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-12 19:02:19.601091 | mon1 | Thursday 12 March 2026 19:02:19 +0000 (0:00:00.653) 0:00:39.452 ******** 2026-03-12 19:02:19.792400 | mon1 | ok: [osd1] 2026-03-12 19:02:19.792489 | mon1 | 2026-03-12 19:02:19.792584 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-12 19:02:19.792704 | mon1 | Thursday 12 March 2026 19:02:19 +0000 (0:00:00.192) 0:00:39.645 ******** 2026-03-12 19:02:19.815095 | mon1 | skipping: [osd1] 2026-03-12 19:02:19.815160 | mon1 | 2026-03-12 19:02:19.815173 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-12 19:02:19.815184 | mon1 | Thursday 12 March 2026 19:02:19 +0000 (0:00:00.021) 0:00:39.667 ******** 2026-03-12 19:02:20.362010 | mon1 | changed: [osd1] => (item=osd0) 2026-03-12 19:02:20.362246 | mon1 | changed: [osd1] => (item=osd1) 2026-03-12 19:02:20.362512 | mon1 | changed: [osd1] => (item=osd2) 2026-03-12 19:02:20.362703 | mon1 | 2026-03-12 19:02:20.362913 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-12 19:02:20.363120 | mon1 | Thursday 12 March 2026 19:02:20 +0000 (0:00:00.547) 0:00:40.214 ******** 2026-03-12 19:02:20.954904 | mon1 | changed: [osd1] => (item=osd0) 2026-03-12 19:02:20.954981 | mon1 | changed: [osd1] => (item=osd1) 2026-03-12 19:02:20.955117 | mon1 | changed: [osd1] => (item=osd2) 2026-03-12 19:02:20.955248 | mon1 | 2026-03-12 19:02:20.955388 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-12 19:02:20.955529 | mon1 | Thursday 12 March 2026 19:02:20 +0000 (0:00:00.593) 0:00:40.807 ******** 2026-03-12 19:02:21.624672 | mon1 | changed: [osd1] => (item=osd0) 2026-03-12 19:02:21.624870 | mon1 | changed: [osd1] => (item=osd1) 2026-03-12 19:02:21.625141 | mon1 | changed: [osd1] => (item=osd2) 2026-03-12 19:02:21.625323 | mon1 | 2026-03-12 19:02:21.625582 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-12 19:02:21.625800 | mon1 | Thursday 12 March 2026 19:02:21 +0000 (0:00:00.668) 0:00:41.476 ******** 2026-03-12 19:02:25.180305 | mon1 | changed: [osd1] => (item=osd0) 2026-03-12 19:02:25.180474 | mon1 | changed: [osd1] => (item=osd1) 2026-03-12 19:02:25.180675 | mon1 | changed: [osd1] => (item=osd2) 2026-03-12 19:02:25.180878 | mon1 | 2026-03-12 19:02:25.181114 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-12 19:02:25.181370 | mon1 | Thursday 12 March 2026 19:02:25 +0000 (0:00:03.556) 0:00:45.033 ******** 2026-03-12 19:02:26.995978 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-12 19:02:26.996135 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-12 19:02:26.996360 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-12 19:02:26.996586 | mon1 | 2026-03-12 19:02:26.996819 | mon1 | PLAY RECAP ********************************************************************* 2026-03-12 19:02:26.997099 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-12 19:02:26.997398 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-12 19:02:26.997600 | mon1 | 2026-03-12 19:02:26.997782 | mon1 | 2026-03-12 19:02:26.997982 | mon1 | TASKS RECAP ******************************************************************** 2026-03-12 19:02:26.998185 | mon1 | Thursday 12 March 2026 19:02:26 +0000 (0:00:01.816) 0:00:46.849 ******** 2026-03-12 19:02:26.998399 | mon1 | =============================================================================== 2026-03-12 19:02:26.998671 | mon1 | Install depedencies ---------------------------------------------------- 27.70s 2026-03-12 19:02:26.998881 | mon1 | Update apt cache -------------------------------------------------------- 7.47s 2026-03-12 19:02:26.999080 | mon1 | Create a volume group for each loop device ------------------------------ 3.56s 2026-03-12 19:02:26.999299 | mon1 | Create a logical volume for each loop device ---------------------------- 1.82s 2026-03-12 19:02:26.999503 | mon1 | Gathering Facts --------------------------------------------------------- 1.12s 2026-03-12 19:02:26.999691 | mon1 | Configure short hostname ------------------------------------------------ 0.69s 2026-03-12 19:02:26.999820 | mon1 | Gathering Facts --------------------------------------------------------- 0.68s 2026-03-12 19:02:26.999954 | mon1 | Start loop devices ------------------------------------------------------ 0.67s 2026-03-12 19:02:27.000087 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s 2026-03-12 19:02:27.000222 | mon1 | Set permissions on loopback devices ------------------------------------- 0.59s 2026-03-12 19:02:27.000370 | mon1 | Create devices for Ceph ------------------------------------------------- 0.55s 2026-03-12 19:02:27.000506 | mon1 | Start up service -------------------------------------------------------- 0.54s 2026-03-12 19:02:27.000645 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s 2026-03-12 19:02:27.000782 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.27s 2026-03-12 19:02:27.000923 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s 2026-03-12 19:02:27.001090 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-03-12 19:02:27.066878 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-12 19:02:27.074606 | mon1 | INFO [default > converge] Executing 2026-03-12 19:02:27.920963 | mon1 | 2026-03-12 19:02:27.921176 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-12 19:02:27.921453 | mon1 | 2026-03-12 19:02:27.921701 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-12 19:02:27.922057 | mon1 | Thursday 12 March 2026 19:02:27 +0000 (0:00:00.044) 0:00:00.044 ******** 2026-03-12 19:02:28.859994 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-12 19:02:28.860165 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-12 19:02:28.860379 | mon1 | interpreter could change the meaning of that path. See 2026-03-12 19:02:28.860593 | mon1 | https://docs.ansible.com/ansible- 2026-03-12 19:02:28.860842 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-12 19:02:28.871015 | mon1 | ok: [mon1] 2026-03-12 19:02:28.871143 | mon1 | 2026-03-12 19:02:28.871395 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-12 19:02:28.871551 | mon1 | Thursday 12 March 2026 19:02:28 +0000 (0:00:00.950) 0:00:00.994 ******** 2026-03-12 19:02:29.152060 | mon1 | ok: [mon1] 2026-03-12 19:02:29.152256 | mon1 | 2026-03-12 19:02:29.152501 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-12 19:02:29.152731 | mon1 | Thursday 12 March 2026 19:02:29 +0000 (0:00:00.280) 0:00:01.275 ******** 2026-03-12 19:02:29.186178 | mon1 | skipping: [mon1] 2026-03-12 19:02:29.186331 | mon1 | 2026-03-12 19:02:29.186540 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-12 19:02:29.186747 | mon1 | Thursday 12 March 2026 19:02:29 +0000 (0:00:00.034) 0:00:01.310 ******** 2026-03-12 19:02:29.486423 | mon1 | changed: [mon1] 2026-03-12 19:02:29.486567 | mon1 | 2026-03-12 19:02:29.486829 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-12 19:02:29.486992 | mon1 | Thursday 12 March 2026 19:02:29 +0000 (0:00:00.299) 0:00:01.609 ******** 2026-03-12 19:02:29.590789 | mon1 | ok: [mon1] => { 2026-03-12 19:02:29.591039 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-12 19:02:29.591208 | mon1 | } 2026-03-12 19:02:29.591447 | mon1 | 2026-03-12 19:02:29.591638 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-12 19:02:29.591821 | mon1 | Thursday 12 March 2026 19:02:29 +0000 (0:00:00.104) 0:00:01.714 ******** 2026-03-12 19:02:30.225575 | mon1 | changed: [mon1] 2026-03-12 19:02:30.225735 | mon1 | 2026-03-12 19:02:30.225953 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-12 19:02:30.226160 | mon1 | Thursday 12 March 2026 19:02:30 +0000 (0:00:00.634) 0:00:02.349 ******** 2026-03-12 19:02:30.259538 | mon1 | skipping: [mon1] 2026-03-12 19:02:30.259687 | mon1 | 2026-03-12 19:02:30.259886 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-12 19:02:30.260083 | mon1 | Thursday 12 March 2026 19:02:30 +0000 (0:00:00.034) 0:00:02.383 ******** 2026-03-12 19:02:30.294563 | mon1 | skipping: [mon1] 2026-03-12 19:02:30.294756 | mon1 | 2026-03-12 19:02:30.294982 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-12 19:02:30.295163 | mon1 | Thursday 12 March 2026 19:02:30 +0000 (0:00:00.034) 0:00:02.418 ******** 2026-03-12 19:02:30.482299 | mon1 | ok: [mon1] 2026-03-12 19:02:30.482467 | mon1 | 2026-03-12 19:02:30.482736 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-12 19:02:30.483042 | mon1 | Thursday 12 March 2026 19:02:30 +0000 (0:00:00.187) 0:00:02.606 ******** 2026-03-12 19:02:31.717282 | mon1 | ok: [mon1] 2026-03-12 19:02:31.717418 | mon1 | 2026-03-12 19:02:31.717675 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-12 19:02:31.717879 | mon1 | Thursday 12 March 2026 19:02:31 +0000 (0:00:01.234) 0:00:03.841 ******** 2026-03-12 19:02:31.791419 | mon1 | ok: [mon1] => { 2026-03-12 19:02:31.791654 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-12 19:02:31.791807 | mon1 | } 2026-03-12 19:02:31.792079 | mon1 | 2026-03-12 19:02:31.792312 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-12 19:02:31.792462 | mon1 | Thursday 12 March 2026 19:02:31 +0000 (0:00:00.074) 0:00:03.915 ******** 2026-03-12 19:02:32.558613 | mon1 | changed: [mon1] 2026-03-12 19:02:32.558777 | mon1 | 2026-03-12 19:02:32.558996 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-12 19:02:32.559201 | mon1 | Thursday 12 March 2026 19:02:32 +0000 (0:00:00.767) 0:00:04.682 ******** 2026-03-12 19:02:35.363133 | mon1 | changed: [mon1] 2026-03-12 19:02:35.363448 | mon1 | 2026-03-12 19:02:35.363790 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-12 19:02:35.364065 | mon1 | Thursday 12 March 2026 19:02:35 +0000 (0:00:02.804) 0:00:07.487 ******** 2026-03-12 19:02:35.391520 | mon1 | skipping: [mon1] 2026-03-12 19:02:35.391883 | mon1 | 2026-03-12 19:02:35.392016 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-12 19:02:35.392152 | mon1 | Thursday 12 March 2026 19:02:35 +0000 (0:00:00.026) 0:00:07.513 ******** 2026-03-12 19:02:35.417761 | mon1 | skipping: [mon1] 2026-03-12 19:02:35.417987 | mon1 | 2026-03-12 19:02:35.418262 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-12 19:02:35.418528 | mon1 | Thursday 12 March 2026 19:02:35 +0000 (0:00:00.027) 0:00:07.541 ******** 2026-03-12 19:02:35.443635 | mon1 | skipping: [mon1] 2026-03-12 19:02:35.443924 | mon1 | 2026-03-12 19:02:35.444221 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-12 19:02:35.444485 | mon1 | Thursday 12 March 2026 19:02:35 +0000 (0:00:00.025) 0:00:07.567 ******** 2026-03-12 19:02:41.139687 | mon1 | changed: [mon1] 2026-03-12 19:02:41.139742 | mon1 | 2026-03-12 19:02:41.139750 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-12 19:02:41.139757 | mon1 | Thursday 12 March 2026 19:02:41 +0000 (0:00:05.695) 0:00:13.263 ******** 2026-03-12 19:02:41.660336 | mon1 | changed: [mon1] 2026-03-12 19:02:41.660397 | mon1 | 2026-03-12 19:02:41.660420 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-12 19:02:41.660431 | mon1 | Thursday 12 March 2026 19:02:41 +0000 (0:00:00.520) 0:00:13.783 ******** 2026-03-12 19:02:42.530839 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-12 19:02:42.530883 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-12 19:02:42.530889 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-12 19:02:42.530893 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-12 19:02:42.530898 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-12 19:02:42.530903 | mon1 | 2026-03-12 19:02:42.530907 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-12 19:02:42.530916 | mon1 | Thursday 12 March 2026 19:02:42 +0000 (0:00:00.869) 0:00:14.653 ******** 2026-03-12 19:02:43.032473 | mon1 | changed: [mon1] 2026-03-12 19:02:43.032636 | mon1 | 2026-03-12 19:02:43.032768 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-12 19:02:43.032896 | mon1 | Thursday 12 March 2026 19:02:43 +0000 (0:00:00.495) 0:00:15.149 ******** 2026-03-12 19:02:43.033010 | mon1 | 2026-03-12 19:02:43.033156 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-12 19:02:43.033281 | mon1 | Thursday 12 March 2026 19:02:43 +0000 (0:00:00.007) 0:00:15.156 ******** 2026-03-12 19:02:43.866464 | mon1 | ok: [mon1] 2026-03-12 19:02:43.866553 | mon1 | 2026-03-12 19:02:43.866612 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-12 19:02:43.866750 | mon1 | Thursday 12 March 2026 19:02:43 +0000 (0:00:00.833) 0:00:15.990 ******** 2026-03-12 19:02:44.292676 | mon1 | changed: [mon1] 2026-03-12 19:02:44.292757 | mon1 | 2026-03-12 19:02:44.293064 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-12 19:02:44.293109 | mon1 | Thursday 12 March 2026 19:02:44 +0000 (0:00:00.426) 0:00:16.416 ******** 2026-03-12 19:02:44.780198 | mon1 | changed: [mon1] 2026-03-12 19:02:44.780266 | mon1 | 2026-03-12 19:02:44.780343 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-12 19:02:44.780475 | mon1 | Thursday 12 March 2026 19:02:44 +0000 (0:00:00.487) 0:00:16.904 ******** 2026-03-12 19:02:44.969304 | mon1 | ok: [mon1] 2026-03-12 19:02:44.969343 | mon1 | 2026-03-12 19:02:44.969548 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-12 19:02:44.969573 | mon1 | Thursday 12 March 2026 19:02:44 +0000 (0:00:00.188) 0:00:17.093 ******** 2026-03-12 19:02:45.036171 | mon1 | ok: [mon1] => { 2026-03-12 19:02:45.036210 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-12 19:02:45.036309 | mon1 | } 2026-03-12 19:02:45.036573 | mon1 | 2026-03-12 19:02:45.036593 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-12 19:02:45.036599 | mon1 | Thursday 12 March 2026 19:02:45 +0000 (0:00:00.067) 0:00:17.160 ******** 2026-03-12 19:02:45.980111 | mon1 | changed: [mon1] 2026-03-12 19:02:45.980174 | mon1 | 2026-03-12 19:02:45.980548 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-12 19:02:45.980596 | mon1 | Thursday 12 March 2026 19:02:45 +0000 (0:00:00.943) 0:00:18.104 ******** 2026-03-12 19:02:50.241137 | mon1 | changed: [mon1] 2026-03-12 19:02:50.241207 | mon1 | 2026-03-12 19:02:50.241414 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-12 19:02:50.241460 | mon1 | Thursday 12 March 2026 19:02:50 +0000 (0:00:04.261) 0:00:22.365 ******** 2026-03-12 19:02:51.190499 | mon1 | ok: [mon1] 2026-03-12 19:02:51.190566 | mon1 | 2026-03-12 19:02:51.190646 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-12 19:02:51.190776 | mon1 | Thursday 12 March 2026 19:02:51 +0000 (0:00:00.949) 0:00:23.314 ******** 2026-03-12 19:02:51.628452 | mon1 | changed: [mon1] 2026-03-12 19:02:51.628516 | mon1 | 2026-03-12 19:02:51.628740 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-12 19:02:51.628782 | mon1 | Thursday 12 March 2026 19:02:51 +0000 (0:00:00.437) 0:00:23.752 ******** 2026-03-12 19:02:52.066240 | mon1 | changed: [mon1] 2026-03-12 19:02:52.066294 | mon1 | 2026-03-12 19:02:52.066385 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-12 19:02:52.066514 | mon1 | Thursday 12 March 2026 19:02:52 +0000 (0:00:00.437) 0:00:24.190 ******** 2026-03-12 19:02:52.587564 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-12 19:02:52.587667 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-12 19:02:52.588185 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-12 19:02:52.588233 | mon1 | 2026-03-12 19:02:52.588241 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-12 19:02:52.588247 | mon1 | Thursday 12 March 2026 19:02:52 +0000 (0:00:00.521) 0:00:24.711 ******** 2026-03-12 19:02:53.018570 | mon1 | changed: [mon1] 2026-03-12 19:02:53.018642 | mon1 | 2026-03-12 19:02:53.018657 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-12 19:02:53.018788 | mon1 | Thursday 12 March 2026 19:02:53 +0000 (0:00:00.431) 0:00:25.142 ******** 2026-03-12 19:02:53.435763 | mon1 | changed: [mon1] 2026-03-12 19:02:53.435831 | mon1 | 2026-03-12 19:02:53.435903 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-12 19:02:53.436294 | mon1 | Thursday 12 March 2026 19:02:53 +0000 (0:00:00.411) 0:00:25.553 ******** 2026-03-12 19:02:53.436425 | mon1 | 2026-03-12 19:02:53.436431 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-12 19:02:53.436445 | mon1 | Thursday 12 March 2026 19:02:53 +0000 (0:00:00.005) 0:00:25.559 ******** 2026-03-12 19:02:54.071226 | mon1 | ok: [mon1] 2026-03-12 19:02:54.071288 | mon1 | 2026-03-12 19:02:54.071364 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-12 19:02:54.071492 | mon1 | Thursday 12 March 2026 19:02:54 +0000 (0:00:00.635) 0:00:26.195 ******** 2026-03-12 19:02:55.887854 | mon1 | changed: [mon1] 2026-03-12 19:02:55.887922 | mon1 | 2026-03-12 19:02:55.888231 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-12 19:02:55.888278 | mon1 | Thursday 12 March 2026 19:02:55 +0000 (0:00:01.816) 0:00:28.011 ******** 2026-03-12 19:02:56.397142 | mon1 | changed: [mon1] 2026-03-12 19:02:56.397200 | mon1 | 2026-03-12 19:02:56.397291 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-12 19:02:56.397386 | mon1 | Thursday 12 March 2026 19:02:56 +0000 (0:00:00.509) 0:00:28.521 ******** 2026-03-12 19:02:56.440622 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-12 19:02:56.440683 | mon1 | 2026-03-12 19:02:56.440758 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-12 19:02:56.440850 | mon1 | Thursday 12 March 2026 19:02:56 +0000 (0:00:00.043) 0:00:28.564 ******** 2026-03-12 19:03:28.164087 | mon1 | changed: [mon1] 2026-03-12 19:03:28.164161 | mon1 | 2026-03-12 19:03:28.164354 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-12 19:03:28.164395 | mon1 | Thursday 12 March 2026 19:03:28 +0000 (0:00:31.723) 0:01:00.288 ******** 2026-03-12 19:03:28.793596 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-12 19:03:28.794077 | mon1 | ok: [mon1] => (item=sshd) 2026-03-12 19:03:28.794211 | mon1 | 2026-03-12 19:03:28.794222 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-12 19:03:28.794230 | mon1 | Thursday 12 March 2026 19:03:28 +0000 (0:00:00.629) 0:01:00.917 ******** 2026-03-12 19:03:29.041667 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-18.2.8/el9/noarch/cephadm"} 2026-03-12 19:03:29.043707 | mon1 | 2026-03-12 19:03:29.043853 | mon1 | PLAY RECAP ********************************************************************* 2026-03-12 19:03:29.044014 | mon1 | mon1 : ok=33 changed=20 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 2026-03-12 19:03:29.045102 | mon1 | 2026-03-12 19:03:29.045157 | mon1 | 2026-03-12 19:03:29.045165 | mon1 | TASKS RECAP ******************************************************************** 2026-03-12 19:03:29.045172 | mon1 | Thursday 12 March 2026 19:03:29 +0000 (0:00:00.250) 0:01:01.168 ******** 2026-03-12 19:03:29.045178 | mon1 | =============================================================================== 2026-03-12 19:03:29.045184 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 31.72s 2026-03-12 19:03:29.045189 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.70s 2026-03-12 19:03:29.045195 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.26s 2026-03-12 19:03:29.045206 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.80s 2026-03-12 19:03:29.047224 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.82s 2026-03-12 19:03:29.047277 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.47s 2026-03-12 19:03:29.047285 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.23s 2026-03-12 19:03:29.047291 | mon1 | Gathering Facts --------------------------------------------------------- 0.95s 2026-03-12 19:03:29.047297 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 0.95s 2026-03-12 19:03:29.047302 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.94s 2026-03-12 19:03:29.047321 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 0.87s 2026-03-12 19:03:29.047327 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.77s 2026-03-12 19:03:29.047333 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.63s 2026-03-12 19:03:29.047338 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.63s 2026-03-12 19:03:29.047344 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.52s 2026-03-12 19:03:29.047350 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.52s 2026-03-12 19:03:29.047356 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.51s 2026-03-12 19:03:29.047362 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.50s 2026-03-12 19:03:29.047367 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.49s 2026-03-12 19:03:29.047373 | mon1 | vexxhost.containers.docker : Create systemd service file for docker ----- 0.44s 2026-03-12 19:03:29.122668 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-12 19:03:29.122924 | mon1 | ERROR [default > converge] Executed: Failed 2026-03-12 19:03:29.123101 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-12 19:03:39.526985 | mon1 | ERROR 2026-03-12 19:03:39.527289 | mon1 | { 2026-03-12 19:03:39.527332 | mon1 | "delta": "0:02:52.270296", 2026-03-12 19:03:39.527361 | mon1 | "end": "2026-03-12 19:03:29.185333", 2026-03-12 19:03:39.527388 | mon1 | "msg": "non-zero return code", 2026-03-12 19:03:39.527412 | mon1 | "rc": 2, 2026-03-12 19:03:39.527440 | mon1 | "start": "2026-03-12 19:00:36.915037" 2026-03-12 19:03:39.527465 | mon1 | } failure 2026-03-12 19:03:39.533386 | 2026-03-12 19:03:39.533438 | PLAY RECAP 2026-03-12 19:03:39.533485 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-03-12 19:03:39.533506 | 2026-03-12 19:03:39.678732 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-12 19:03:39.683254 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-12 19:03:40.249501 | 2026-03-12 19:03:40.249660 | PLAY [all] 2026-03-12 19:03:40.261791 | 2026-03-12 19:03:40.261869 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-12 19:03:40.315821 | mon1 | ok 2026-03-12 19:03:40.322781 | osd1 | ok 2026-03-12 19:03:40.327020 | 2026-03-12 19:03:40.327098 | TASK [fetch-output : Set log path for single node] 2026-03-12 19:03:40.352046 | mon1 | skipping: Conditional result was False 2026-03-12 19:03:40.363445 | osd1 | skipping: Conditional result was False 2026-03-12 19:03:40.374045 | 2026-03-12 19:03:40.374188 | LOOP [fetch-output : Ensure local output dirs] 2026-03-12 19:03:40.766806 | mon1 -> localhost | changed: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/logs/mon1" 2026-03-12 19:03:40.770782 | osd1 -> localhost | changed: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/logs/osd1" 2026-03-12 19:03:40.971631 | osd1 -> localhost | changed: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/artifacts" 2026-03-12 19:03:40.978928 | mon1 -> localhost | ok: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/artifacts" 2026-03-12 19:03:41.171562 | osd1 -> localhost | changed: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/docs" 2026-03-12 19:03:41.176595 | mon1 -> localhost | ok: "/var/lib/zuul/builds/ca0bdf49ca354c61a88f274719176e2c/work/docs" 2026-03-12 19:03:41.194327 | 2026-03-12 19:03:41.194457 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-12 19:03:41.835704 | mon1 | changed: .d..t...... ./ 2026-03-12 19:03:41.836016 | mon1 | changed: All items complete 2026-03-12 19:03:41.836072 | 2026-03-12 19:03:41.841901 | osd1 | changed: .d..t...... ./ 2026-03-12 19:03:42.273501 | mon1 | changed: .d..t...... ./ 2026-03-12 19:03:42.288639 | osd1 | ok 2026-03-12 19:03:42.709598 | mon1 | changed: .d..t...... ./ 2026-03-12 19:03:42.748874 | osd1 | ok 2026-03-12 19:03:42.780375 | 2026-03-12 19:03:42.780497 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-12 19:03:43.196240 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006317 2026-03-12 19:03:43.196521 | mon1 -> localhost | changed: All items complete 2026-03-12 19:03:43.196555 | 2026-03-12 19:03:43.413583 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007905 2026-03-12 19:03:43.430699 | 2026-03-12 19:03:43.431013 | PLAY [all] 2026-03-12 19:03:43.440028 | 2026-03-12 19:03:43.440093 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-12 19:03:43.849347 | mon1 | changed 2026-03-12 19:03:44.030562 | osd1 | changed 2026-03-12 19:03:44.040592 | 2026-03-12 19:03:44.040639 | PLAY RECAP 2026-03-12 19:03:44.040682 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-12 19:03:44.040710 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-12 19:03:44.040729 | 2026-03-12 19:03:44.153488 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-12 19:03:44.296509 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-12 19:03:44.833307 | 2026-03-12 19:03:44.833415 | PLAY [localhost] 2026-03-12 19:03:44.842879 | 2026-03-12 19:03:44.842947 | TASK [Generate Zuul manifest] 2026-03-12 19:03:44.862509 | localhost | ok 2026-03-12 19:03:44.877437 | 2026-03-12 19:03:44.877510 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-12 19:03:45.190475 | localhost | changed 2026-03-12 19:03:45.203533 | 2026-03-12 19:03:45.203601 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-12 19:03:45.254788 | localhost | ok 2026-03-12 19:03:45.263902 | 2026-03-12 19:03:45.263964 | TASK [Upload logs] 2026-03-12 19:03:45.288649 | localhost | ok 2026-03-12 19:03:45.342031 | 2026-03-12 19:03:45.342137 | TASK [Set zuul-log-path fact] 2026-03-12 19:03:45.361966 | localhost | ok 2026-03-12 19:03:45.373705 | 2026-03-12 19:03:45.373769 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-12 19:03:45.403923 | localhost | ok 2026-03-12 19:03:45.412621 | 2026-03-12 19:03:45.412704 | TASK [upload-logs : Create log directories] 2026-03-12 19:03:45.786209 | localhost | changed 2026-03-12 19:03:45.792337 | 2026-03-12 19:03:45.792412 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-12 19:03:46.217966 | localhost -> localhost | ok: Runtime: 0:00:00.005220 2026-03-12 19:03:46.224118 | 2026-03-12 19:03:46.224204 | TASK [upload-logs : Upload logs to log server] 2026-03-12 19:03:46.760088 | localhost | Output suppressed because no_log was given 2026-03-12 19:03:46.764837 | 2026-03-12 19:03:46.764905 | LOOP [upload-logs : Compress console log and json output] 2026-03-12 19:03:46.811292 | localhost | skipping: Conditional result was False 2026-03-12 19:03:46.818405 | localhost | skipping: Conditional result was False 2026-03-12 19:03:46.830875 | 2026-03-12 19:03:46.831067 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-12 19:03:46.871859 | localhost | skipping: Conditional result was False 2026-03-12 19:03:46.872286 | 2026-03-12 19:03:46.875849 | localhost | skipping: Conditional result was False 2026-03-12 19:03:46.885294 | 2026-03-12 19:03:46.885448 | LOOP [upload-logs : Upload console log and json output]