2026-03-03 15:02:49.629045 | Job console starting 2026-03-03 15:02:49.641073 | Updating git repos 2026-03-03 15:02:49.675091 | Cloning repos into workspace 2026-03-03 15:02:49.723949 | Restoring repo states 2026-03-03 15:02:49.731088 | Merging changes 2026-03-03 15:02:49.994169 | Checking out repos 2026-03-03 15:02:50.029794 | Preparing playbooks 2026-03-03 15:02:50.850377 | Running Ansible setup 2026-03-03 15:02:55.119909 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-03 15:02:55.712636 | 2026-03-03 15:02:55.712798 | PLAY [localhost] 2026-03-03 15:02:55.721529 | 2026-03-03 15:02:55.721607 | TASK [Gathering Facts] 2026-03-03 15:02:56.583277 | localhost | ok 2026-03-03 15:02:56.593775 | 2026-03-03 15:02:56.593878 | TASK [Setup log path fact] 2026-03-03 15:02:56.613361 | localhost | ok 2026-03-03 15:02:56.626546 | 2026-03-03 15:02:56.626609 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-03 15:02:56.656225 | localhost | ok 2026-03-03 15:02:56.663962 | 2026-03-03 15:02:56.664033 | TASK [emit-job-header : Print job information] 2026-03-03 15:02:56.704644 | # Job Information 2026-03-03 15:02:56.704850 | Ansible Version: 2.16.16 2026-03-03 15:02:56.704923 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy 2026-03-03 15:02:56.705021 | Pipeline: check 2026-03-03 15:02:56.705073 | Executor: 0a8996d2b663 2026-03-03 15:02:56.705116 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/92 2026-03-03 15:02:56.705166 | Event ID: de0d4310-1711-11f1-8c26-759768f4d989 2026-03-03 15:02:56.709385 | 2026-03-03 15:02:56.709450 | LOOP [emit-job-header : Print node information] 2026-03-03 15:02:56.801044 | localhost | ok: 2026-03-03 15:02:56.801465 | localhost | # Node Information 2026-03-03 15:02:56.801534 | localhost | Inventory Hostname: mon1 2026-03-03 15:02:56.801584 | localhost | Hostname: np0000157677 2026-03-03 15:02:56.801629 | localhost | Username: zuul 2026-03-03 15:02:56.801678 | localhost | Distro: Ubuntu 22.04 2026-03-03 15:02:56.801723 | localhost | Provider: yul1 2026-03-03 15:02:56.801765 | localhost | Region: ca-ymq-1 2026-03-03 15:02:56.801807 | localhost | Label: ubuntu-jammy 2026-03-03 15:02:56.801848 | localhost | Product Name: OpenStack Nova 2026-03-03 15:02:56.801889 | localhost | Interface IP: 199.19.213.181 2026-03-03 15:02:56.842703 | localhost | ok: 2026-03-03 15:02:56.842772 | localhost | # Node Information 2026-03-03 15:02:56.842808 | localhost | Inventory Hostname: osd1 2026-03-03 15:02:56.842837 | localhost | Hostname: np0000157678 2026-03-03 15:02:56.842864 | localhost | Username: zuul 2026-03-03 15:02:56.842890 | localhost | Distro: Ubuntu 22.04 2026-03-03 15:02:56.842916 | localhost | Provider: yul1 2026-03-03 15:02:56.842941 | localhost | Region: ca-ymq-1 2026-03-03 15:02:56.842967 | localhost | Label: ubuntu-jammy 2026-03-03 15:02:56.842991 | localhost | Product Name: OpenStack Nova 2026-03-03 15:02:56.843018 | localhost | Interface IP: 199.19.213.20 2026-03-03 15:02:56.858270 | 2026-03-03 15:02:56.858383 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-03-03 15:02:57.242004 | localhost -> localhost | changed 2026-03-03 15:02:57.249820 | 2026-03-03 15:02:57.249915 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-03-03 15:02:58.049662 | localhost -> localhost | changed 2026-03-03 15:02:58.061190 | 2026-03-03 15:02:58.061245 | PLAY [all] 2026-03-03 15:02:58.070374 | 2026-03-03 15:02:58.070440 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-03-03 15:02:58.288255 | mon1 -> localhost | ok 2026-03-03 15:02:58.297392 | 2026-03-03 15:02:58.297497 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-03-03 15:02:58.329286 | mon1 | ok 2026-03-03 15:02:58.335124 | osd1 | ok 2026-03-03 15:02:58.352775 | mon1 | included: /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-03 15:02:58.352870 | osd1 | included: /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-03-03 15:02:58.358712 | 2026-03-03 15:02:58.358785 | TASK [add-build-sshkey : Create Temp SSH key] 2026-03-03 15:02:59.198969 | mon1 -> localhost | Generating public/private rsa key pair. 2026-03-03 15:02:59.199318 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/c31ca5c960104334845b432577da92d6_id_rsa 2026-03-03 15:02:59.199381 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/c31ca5c960104334845b432577da92d6_id_rsa.pub 2026-03-03 15:02:59.199418 | mon1 -> localhost | The key fingerprint is: 2026-03-03 15:02:59.199450 | mon1 -> localhost | SHA256:RiYTzNWzxWqoeDyxsKz19AZXKm1u4N4VBZxtN5mzxM4 zuul-build-sshkey 2026-03-03 15:02:59.199480 | mon1 -> localhost | The key's randomart image is: 2026-03-03 15:02:59.199509 | mon1 -> localhost | +---[RSA 3072]----+ 2026-03-03 15:02:59.199538 | mon1 -> localhost | | o...o.+ . o | 2026-03-03 15:02:59.199567 | mon1 -> localhost | | o. =.= O | 2026-03-03 15:02:59.199595 | mon1 -> localhost | | o o. *.= + | 2026-03-03 15:02:59.199624 | mon1 -> localhost | | . .=. =. E | 2026-03-03 15:02:59.199651 | mon1 -> localhost | | . = =S+. | 2026-03-03 15:02:59.199741 | mon1 -> localhost | | = @.= . | 2026-03-03 15:02:59.199778 | mon1 -> localhost | | o = X . | 2026-03-03 15:02:59.199828 | mon1 -> localhost | | . o.=. | 2026-03-03 15:02:59.199861 | mon1 -> localhost | | ..o. | 2026-03-03 15:02:59.199890 | mon1 -> localhost | +----[SHA256]-----+ 2026-03-03 15:02:59.199966 | mon1 -> localhost | ok: Runtime: 0:00:00.433614 2026-03-03 15:02:59.206656 | 2026-03-03 15:02:59.206729 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-03-03 15:02:59.243241 | mon1 | ok 2026-03-03 15:02:59.247728 | osd1 | ok 2026-03-03 15:02:59.268983 | mon1 | included: /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-03 15:02:59.269118 | osd1 | included: /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-03-03 15:02:59.279028 | 2026-03-03 15:02:59.279098 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-03-03 15:02:59.303509 | mon1 | skipping: Conditional result was False 2026-03-03 15:02:59.317687 | osd1 | skipping: Conditional result was False 2026-03-03 15:02:59.329316 | 2026-03-03 15:02:59.329418 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-03-03 15:02:59.777772 | mon1 | changed 2026-03-03 15:02:59.785078 | osd1 | changed 2026-03-03 15:02:59.790220 | 2026-03-03 15:02:59.790288 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-03-03 15:02:59.973143 | mon1 | ok 2026-03-03 15:02:59.977890 | osd1 | ok 2026-03-03 15:02:59.982690 | 2026-03-03 15:02:59.982760 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-03-03 15:03:00.444277 | mon1 | changed 2026-03-03 15:03:00.473824 | osd1 | changed 2026-03-03 15:03:00.480529 | 2026-03-03 15:03:00.480594 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-03-03 15:03:00.939761 | mon1 | changed 2026-03-03 15:03:00.960071 | osd1 | changed 2026-03-03 15:03:00.964904 | 2026-03-03 15:03:00.964971 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-03-03 15:03:00.988821 | mon1 | skipping: Conditional result was False 2026-03-03 15:03:00.999909 | osd1 | skipping: Conditional result was False 2026-03-03 15:03:01.045797 | 2026-03-03 15:03:01.045946 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-03-03 15:03:01.365252 | mon1 -> localhost | changed 2026-03-03 15:03:01.384606 | 2026-03-03 15:03:01.384676 | TASK [add-build-sshkey : Add back temp key] 2026-03-03 15:03:01.662600 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/c31ca5c960104334845b432577da92d6_id_rsa (zuul-build-sshkey) 2026-03-03 15:03:01.662817 | mon1 -> localhost | ok: Runtime: 0:00:00.014809 2026-03-03 15:03:01.668147 | 2026-03-03 15:03:01.668216 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-03-03 15:03:01.935644 | mon1 | ok 2026-03-03 15:03:01.940533 | osd1 | ok 2026-03-03 15:03:01.944963 | 2026-03-03 15:03:01.945040 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-03-03 15:03:01.968805 | mon1 | skipping: Conditional result was False 2026-03-03 15:03:01.979864 | osd1 | skipping: Conditional result was False 2026-03-03 15:03:02.000190 | 2026-03-03 15:03:02.000257 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-03-03 15:03:02.269541 | mon1 | ok 2026-03-03 15:03:02.273788 | osd1 | ok 2026-03-03 15:03:02.279379 | 2026-03-03 15:03:02.279450 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-03-03 15:03:02.975301 | osd1 | Output suppressed because no_log was given 2026-03-03 15:03:02.981038 | mon1 | Output suppressed because no_log was given 2026-03-03 15:03:02.996213 | 2026-03-03 15:03:02.996278 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-03-03 15:03:03.177371 | mon1 | ok: "logs" 2026-03-03 15:03:03.177677 | mon1 | ok: All items complete 2026-03-03 15:03:03.177707 | 2026-03-03 15:03:03.187098 | osd1 | ok: "logs" 2026-03-03 15:03:03.335122 | mon1 | ok: "artifacts" 2026-03-03 15:03:03.348817 | osd1 | ok: "artifacts" 2026-03-03 15:03:03.499901 | mon1 | ok: "docs" 2026-03-03 15:03:03.506616 | osd1 | ok: "docs" 2026-03-03 15:03:03.514612 | 2026-03-03 15:03:03.514770 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-03-03 15:03:03.690818 | mon1 | changed: "logs" 2026-03-03 15:03:03.691169 | mon1 | ok: All items complete 2026-03-03 15:03:03.691208 | 2026-03-03 15:03:03.712365 | osd1 | changed: "logs" 2026-03-03 15:03:03.847897 | mon1 | changed: "artifacts" 2026-03-03 15:03:03.869968 | osd1 | changed: "artifacts" 2026-03-03 15:03:04.004260 | mon1 | changed: "docs" 2026-03-03 15:03:04.028951 | osd1 | changed: "docs" 2026-03-03 15:03:04.049412 | 2026-03-03 15:03:04.049528 | PLAY RECAP 2026-03-03 15:03:04.049575 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-03 15:03:04.049608 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-03 15:03:04.049634 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-03-03 15:03:04.049659 | 2026-03-03 15:03:04.187167 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-03-03 15:03:04.192191 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-03 15:03:04.784004 | 2026-03-03 15:03:04.784158 | PLAY [all] 2026-03-03 15:03:04.796197 | 2026-03-03 15:03:04.796274 | TASK [setup-uv : Extract archive] 2026-03-03 15:03:07.027257 | mon1 | changed 2026-03-03 15:03:07.033627 | osd1 | changed 2026-03-03 15:03:07.039314 | 2026-03-03 15:03:07.039401 | TASK [setup-uv : Print version] 2026-03-03 15:03:07.668518 | osd1 | uv 0.8.13 2026-03-03 15:03:07.384317 | mon1 | uv 0.8.13 2026-03-03 15:03:07.595635 | osd1 | ok: Runtime: 0:00:00.017593 2026-03-03 15:03:07.606079 | mon1 | ok: Runtime: 0:00:00.023344 2026-03-03 15:03:07.615911 | 2026-03-03 15:03:07.615964 | PLAY RECAP 2026-03-03 15:03:07.616010 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-03 15:03:07.616037 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-03-03 15:03:07.616055 | 2026-03-03 15:03:07.753183 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-03-03 15:03:07.757963 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-03 15:03:08.318355 | 2026-03-03 15:03:08.318513 | PLAY [all] 2026-03-03 15:03:08.329841 | 2026-03-03 15:03:08.329952 | TASK [Copy inventory file for Zuul] 2026-03-03 15:03:09.174867 | mon1 | changed 2026-03-03 15:03:09.181102 | 2026-03-03 15:03:09.181175 | TASK [Switch "ansible_host" to private IP] 2026-03-03 15:03:09.457686 | mon1 | changed: 2 replacements made 2026-03-03 15:03:09.465155 | 2026-03-03 15:03:09.465231 | TASK [Run Molecule scenario] 2026-03-03 15:03:10.012555 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-03-03 15:03:10.744981 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-03-03 15:03:10.941294 | mon1 | Using CPython 3.13.7 2026-03-03 15:03:10.941394 | mon1 | Creating virtual environment at: .venv 2026-03-03 15:03:11.199997 | mon1 | Downloading pygments (1.2MiB) 2026-03-03 15:03:11.201751 | mon1 | Downloading cryptography (4.3MiB) 2026-03-03 15:03:11.204266 | mon1 | Downloading netaddr (2.2MiB) 2026-03-03 15:03:11.204610 | mon1 | Downloading ansible-core (2.1MiB) 2026-03-03 15:03:11.414192 | mon1 | Downloading netaddr 2026-03-03 15:03:11.423420 | mon1 | Downloading cryptography 2026-03-03 15:03:11.471130 | mon1 | Downloading pygments 2026-03-03 15:03:11.617271 | mon1 | Downloading ansible-core 2026-03-03 15:03:11.651768 | mon1 | Installed 36 packages in 33ms 2026-03-03 15:03:12.781456 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-03-03 15:03:12.781542 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-03-03 15:03:13.424247 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-03-03 15:03:13.424341 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-03-03 15:03:44.967852 | mon1 | INFO [default > dependency] Executing 2026-03-03 15:03:44.967971 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-03-03 15:03:44.968175 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-03-03 15:03:44.968306 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-03-03 15:03:44.973901 | mon1 | INFO [default > cleanup] Executing 2026-03-03 15:03:44.974184 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-03 15:03:44.979358 | mon1 | INFO [default > destroy] Executing 2026-03-03 15:03:44.979422 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-03-03 15:03:44.979483 | mon1 | INFO [default > destroy] Executed: Successful 2026-03-03 15:03:44.984847 | mon1 | INFO [default > syntax] Executing 2026-03-03 15:03:45.980505 | mon1 | 2026-03-03 15:03:45.980741 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-03 15:03:46.035135 | mon1 | INFO [default > syntax] Executed: Successful 2026-03-03 15:03:46.040784 | mon1 | INFO [default > create] Executing 2026-03-03 15:03:46.042140 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-03-03 15:03:46.047089 | mon1 | INFO [default > prepare] Executing 2026-03-03 15:03:46.677674 | mon1 | 2026-03-03 15:03:46.677766 | mon1 | PLAY [Prepare] ***************************************************************** 2026-03-03 15:03:46.677944 | mon1 | 2026-03-03 15:03:46.678061 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-03 15:03:46.678186 | mon1 | Tuesday 03 March 2026 15:03:46 +0000 (0:00:00.030) 0:00:00.030 ********* 2026-03-03 15:03:47.809016 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-03 15:03:47.809226 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-03 15:03:47.809441 | mon1 | interpreter could change the meaning of that path. See 2026-03-03 15:03:47.809648 | mon1 | https://docs.ansible.com/ansible- 2026-03-03 15:03:47.809889 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-03 15:03:47.817596 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-03-03 15:03:47.817834 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-03 15:03:47.818033 | mon1 | interpreter could change the meaning of that path. See 2026-03-03 15:03:47.818228 | mon1 | https://docs.ansible.com/ansible- 2026-03-03 15:03:47.818434 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-03 15:03:47.824350 | mon1 | ok: [mon1] 2026-03-03 15:03:47.824515 | mon1 | ok: [osd1] 2026-03-03 15:03:47.824879 | mon1 | 2026-03-03 15:03:47.824934 | mon1 | TASK [Configure short hostname] ************************************************ 2026-03-03 15:03:47.825103 | mon1 | Tuesday 03 March 2026 15:03:47 +0000 (0:00:01.147) 0:00:01.177 ********* 2026-03-03 15:03:48.544126 | mon1 | changed: [mon1] 2026-03-03 15:03:48.544329 | mon1 | changed: [osd1] 2026-03-03 15:03:48.544544 | mon1 | 2026-03-03 15:03:48.544773 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-03-03 15:03:48.545001 | mon1 | Tuesday 03 March 2026 15:03:48 +0000 (0:00:00.719) 0:00:01.896 ********* 2026-03-03 15:03:48.811812 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-03-03 15:03:48.811918 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-03-03 15:03:48.812042 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-03-03 15:03:48.821725 | mon1 | changed: [mon1] 2026-03-03 15:03:48.822001 | mon1 | changed: [osd1] 2026-03-03 15:03:48.822246 | mon1 | 2026-03-03 15:03:48.822484 | mon1 | TASK [Update apt cache] ******************************************************** 2026-03-03 15:03:48.822711 | mon1 | Tuesday 03 March 2026 15:03:48 +0000 (0:00:00.278) 0:00:02.174 ********* 2026-03-03 15:03:56.633123 | mon1 | changed: [mon1] 2026-03-03 15:03:56.633364 | mon1 | changed: [osd1] 2026-03-03 15:03:56.633379 | mon1 | 2026-03-03 15:03:56.633393 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-03-03 15:03:56.633520 | mon1 | 2026-03-03 15:03:56.633638 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-03 15:03:56.633766 | mon1 | Tuesday 03 March 2026 15:03:56 +0000 (0:00:07.810) 0:00:09.985 ********* 2026-03-03 15:03:57.326372 | mon1 | ok: [osd1] 2026-03-03 15:03:57.326533 | mon1 | 2026-03-03 15:03:57.326735 | mon1 | TASK [Install depedencies] ***************************************************** 2026-03-03 15:03:57.326951 | mon1 | Tuesday 03 March 2026 15:03:57 +0000 (0:00:00.693) 0:00:10.678 ********* 2026-03-03 15:04:20.059747 | mon1 | changed: [osd1] 2026-03-03 15:04:20.059931 | mon1 | 2026-03-03 15:04:20.060262 | mon1 | TASK [Start up service] ******************************************************** 2026-03-03 15:04:20.060547 | mon1 | Tuesday 03 March 2026 15:04:20 +0000 (0:00:22.733) 0:00:33.412 ********* 2026-03-03 15:04:20.625965 | mon1 | ok: [osd1] 2026-03-03 15:04:20.626057 | mon1 | 2026-03-03 15:04:20.626072 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-03-03 15:04:20.626203 | mon1 | Tuesday 03 March 2026 15:04:20 +0000 (0:00:00.564) 0:00:33.976 ********* 2026-03-03 15:04:20.928983 | mon1 | ok: [osd1] 2026-03-03 15:04:20.929070 | mon1 | 2026-03-03 15:04:20.929159 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-03-03 15:04:20.929230 | mon1 | Tuesday 03 March 2026 15:04:20 +0000 (0:00:00.305) 0:00:34.281 ********* 2026-03-03 15:04:21.676897 | mon1 | changed: [osd1] 2026-03-03 15:04:21.677000 | mon1 | 2026-03-03 15:04:21.677151 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-03-03 15:04:21.677303 | mon1 | Tuesday 03 March 2026 15:04:21 +0000 (0:00:00.747) 0:00:35.029 ********* 2026-03-03 15:04:21.880087 | mon1 | ok: [osd1] 2026-03-03 15:04:21.880271 | mon1 | 2026-03-03 15:04:21.880498 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-03-03 15:04:21.880710 | mon1 | Tuesday 03 March 2026 15:04:21 +0000 (0:00:00.202) 0:00:35.232 ********* 2026-03-03 15:04:21.904913 | mon1 | skipping: [osd1] 2026-03-03 15:04:21.905074 | mon1 | 2026-03-03 15:04:21.905331 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-03-03 15:04:21.905545 | mon1 | Tuesday 03 March 2026 15:04:21 +0000 (0:00:00.024) 0:00:35.257 ********* 2026-03-03 15:04:22.450011 | mon1 | changed: [osd1] => (item=osd0) 2026-03-03 15:04:22.450202 | mon1 | changed: [osd1] => (item=osd1) 2026-03-03 15:04:22.450408 | mon1 | changed: [osd1] => (item=osd2) 2026-03-03 15:04:22.450594 | mon1 | 2026-03-03 15:04:22.450804 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-03-03 15:04:22.451005 | mon1 | Tuesday 03 March 2026 15:04:22 +0000 (0:00:00.545) 0:00:35.802 ********* 2026-03-03 15:04:23.149021 | mon1 | changed: [osd1] => (item=osd0) 2026-03-03 15:04:23.149106 | mon1 | changed: [osd1] => (item=osd1) 2026-03-03 15:04:23.149270 | mon1 | changed: [osd1] => (item=osd2) 2026-03-03 15:04:23.149417 | mon1 | 2026-03-03 15:04:23.149566 | mon1 | TASK [Start loop devices] ****************************************************** 2026-03-03 15:04:23.149724 | mon1 | Tuesday 03 March 2026 15:04:23 +0000 (0:00:00.698) 0:00:36.501 ********* 2026-03-03 15:04:23.878248 | mon1 | changed: [osd1] => (item=osd0) 2026-03-03 15:04:23.878425 | mon1 | changed: [osd1] => (item=osd1) 2026-03-03 15:04:23.878632 | mon1 | changed: [osd1] => (item=osd2) 2026-03-03 15:04:23.878820 | mon1 | 2026-03-03 15:04:23.879029 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-03-03 15:04:23.879283 | mon1 | Tuesday 03 March 2026 15:04:23 +0000 (0:00:00.729) 0:00:37.230 ********* 2026-03-03 15:04:26.834063 | mon1 | changed: [osd1] => (item=osd0) 2026-03-03 15:04:26.834159 | mon1 | changed: [osd1] => (item=osd1) 2026-03-03 15:04:26.834412 | mon1 | changed: [osd1] => (item=osd2) 2026-03-03 15:04:26.834428 | mon1 | 2026-03-03 15:04:26.834466 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-03-03 15:04:26.834561 | mon1 | Tuesday 03 March 2026 15:04:26 +0000 (0:00:02.956) 0:00:40.187 ********* 2026-03-03 15:04:28.656868 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-03-03 15:04:28.657046 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-03-03 15:04:28.657253 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-03-03 15:04:28.657508 | mon1 | 2026-03-03 15:04:28.657710 | mon1 | PLAY RECAP ********************************************************************* 2026-03-03 15:04:28.657985 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-03-03 15:04:28.658198 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-03-03 15:04:28.658316 | mon1 | 2026-03-03 15:04:28.658428 | mon1 | 2026-03-03 15:04:28.658552 | mon1 | TASKS RECAP ******************************************************************** 2026-03-03 15:04:28.658684 | mon1 | Tuesday 03 March 2026 15:04:28 +0000 (0:00:01.822) 0:00:42.009 ********* 2026-03-03 15:04:28.658798 | mon1 | =============================================================================== 2026-03-03 15:04:28.658922 | mon1 | Install depedencies ---------------------------------------------------- 22.73s 2026-03-03 15:04:28.659046 | mon1 | Update apt cache -------------------------------------------------------- 7.81s 2026-03-03 15:04:28.659169 | mon1 | Create a volume group for each loop device ------------------------------ 2.96s 2026-03-03 15:04:28.659340 | mon1 | Create a logical volume for each loop device ---------------------------- 1.82s 2026-03-03 15:04:28.659416 | mon1 | Gathering Facts --------------------------------------------------------- 1.15s 2026-03-03 15:04:28.659539 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.75s 2026-03-03 15:04:28.659662 | mon1 | Start loop devices ------------------------------------------------------ 0.73s 2026-03-03 15:04:28.659789 | mon1 | Configure short hostname ------------------------------------------------ 0.72s 2026-03-03 15:04:28.659915 | mon1 | Set permissions on loopback devices ------------------------------------- 0.70s 2026-03-03 15:04:28.660036 | mon1 | Gathering Facts --------------------------------------------------------- 0.69s 2026-03-03 15:04:28.660162 | mon1 | Start up service -------------------------------------------------------- 0.56s 2026-03-03 15:04:28.660282 | mon1 | Create devices for Ceph ------------------------------------------------- 0.55s 2026-03-03 15:04:28.660411 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s 2026-03-03 15:04:28.660535 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.28s 2026-03-03 15:04:28.660660 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s 2026-03-03 15:04:28.660787 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-03-03 15:04:28.741808 | mon1 | INFO [default > prepare] Executed: Successful 2026-03-03 15:04:28.752347 | mon1 | INFO [default > converge] Executing 2026-03-03 15:04:29.583330 | mon1 | 2026-03-03 15:04:29.583480 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-03-03 15:04:29.583741 | mon1 | 2026-03-03 15:04:29.583903 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-03-03 15:04:29.584248 | mon1 | Tuesday 03 March 2026 15:04:29 +0000 (0:00:00.047) 0:00:00.047 ********* 2026-03-03 15:04:30.579596 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-03-03 15:04:30.579803 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python 2026-03-03 15:04:30.579995 | mon1 | interpreter could change the meaning of that path. See 2026-03-03 15:04:30.580200 | mon1 | https://docs.ansible.com/ansible- 2026-03-03 15:04:30.580406 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-03-03 15:04:30.595358 | mon1 | ok: [mon1] 2026-03-03 15:04:30.595552 | mon1 | 2026-03-03 15:04:30.595800 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-03 15:04:30.595980 | mon1 | Tuesday 03 March 2026 15:04:30 +0000 (0:00:01.012) 0:00:01.060 ********* 2026-03-03 15:04:30.894760 | mon1 | ok: [mon1] 2026-03-03 15:04:30.894838 | mon1 | 2026-03-03 15:04:30.894935 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-03 15:04:30.895039 | mon1 | Tuesday 03 March 2026 15:04:30 +0000 (0:00:00.299) 0:00:01.359 ********* 2026-03-03 15:04:30.933613 | mon1 | skipping: [mon1] 2026-03-03 15:04:30.933666 | mon1 | 2026-03-03 15:04:30.933762 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-03-03 15:04:30.933881 | mon1 | Tuesday 03 March 2026 15:04:30 +0000 (0:00:00.039) 0:00:01.399 ********* 2026-03-03 15:04:31.253609 | mon1 | changed: [mon1] 2026-03-03 15:04:31.253709 | mon1 | 2026-03-03 15:04:31.253883 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-03 15:04:31.254092 | mon1 | Tuesday 03 March 2026 15:04:31 +0000 (0:00:00.319) 0:00:01.718 ********* 2026-03-03 15:04:31.373606 | mon1 | ok: [mon1] => { 2026-03-03 15:04:31.373715 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64" 2026-03-03 15:04:31.373961 | mon1 | } 2026-03-03 15:04:31.374146 | mon1 | 2026-03-03 15:04:31.374374 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-03 15:04:31.374598 | mon1 | Tuesday 03 March 2026 15:04:31 +0000 (0:00:00.118) 0:00:01.837 ********* 2026-03-03 15:04:32.054401 | mon1 | changed: [mon1] 2026-03-03 15:04:32.054490 | mon1 | 2026-03-03 15:04:32.054619 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-03 15:04:32.054760 | mon1 | Tuesday 03 March 2026 15:04:32 +0000 (0:00:00.682) 0:00:02.519 ********* 2026-03-03 15:04:32.099023 | mon1 | skipping: [mon1] 2026-03-03 15:04:32.099249 | mon1 | 2026-03-03 15:04:32.099490 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-03 15:04:32.099705 | mon1 | Tuesday 03 March 2026 15:04:32 +0000 (0:00:00.044) 0:00:02.564 ********* 2026-03-03 15:04:32.139646 | mon1 | skipping: [mon1] 2026-03-03 15:04:32.139948 | mon1 | 2026-03-03 15:04:32.140207 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-03 15:04:32.140421 | mon1 | Tuesday 03 March 2026 15:04:32 +0000 (0:00:00.040) 0:00:02.604 ********* 2026-03-03 15:04:32.351186 | mon1 | ok: [mon1] 2026-03-03 15:04:32.351274 | mon1 | 2026-03-03 15:04:32.351414 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-03-03 15:04:32.351546 | mon1 | Tuesday 03 March 2026 15:04:32 +0000 (0:00:00.211) 0:00:02.816 ********* 2026-03-03 15:04:33.499833 | mon1 | ok: [mon1] 2026-03-03 15:04:33.500090 | mon1 | 2026-03-03 15:04:33.500415 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-03 15:04:33.500654 | mon1 | Tuesday 03 March 2026 15:04:33 +0000 (0:00:01.148) 0:00:03.964 ********* 2026-03-03 15:04:33.576119 | mon1 | ok: [mon1] => { 2026-03-03 15:04:33.576359 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz" 2026-03-03 15:04:33.576600 | mon1 | } 2026-03-03 15:04:33.576839 | mon1 | 2026-03-03 15:04:33.577208 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-03 15:04:33.577266 | mon1 | Tuesday 03 March 2026 15:04:33 +0000 (0:00:00.076) 0:00:04.041 ********* 2026-03-03 15:04:34.453529 | mon1 | changed: [mon1] 2026-03-03 15:04:34.453715 | mon1 | 2026-03-03 15:04:34.454038 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-03 15:04:34.454305 | mon1 | Tuesday 03 March 2026 15:04:34 +0000 (0:00:00.877) 0:00:04.918 ********* 2026-03-03 15:04:37.399077 | mon1 | changed: [mon1] 2026-03-03 15:04:37.399334 | mon1 | 2026-03-03 15:04:37.399484 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-03-03 15:04:37.399699 | mon1 | Tuesday 03 March 2026 15:04:37 +0000 (0:00:02.945) 0:00:07.863 ********* 2026-03-03 15:04:37.430568 | mon1 | skipping: [mon1] 2026-03-03 15:04:37.430671 | mon1 | 2026-03-03 15:04:37.430954 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-03-03 15:04:37.431161 | mon1 | Tuesday 03 March 2026 15:04:37 +0000 (0:00:00.031) 0:00:07.895 ********* 2026-03-03 15:04:37.463151 | mon1 | skipping: [mon1] 2026-03-03 15:04:37.463409 | mon1 | 2026-03-03 15:04:37.463652 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-03-03 15:04:37.463866 | mon1 | Tuesday 03 March 2026 15:04:37 +0000 (0:00:00.033) 0:00:07.928 ********* 2026-03-03 15:04:37.486198 | mon1 | skipping: [mon1] 2026-03-03 15:04:37.486467 | mon1 | 2026-03-03 15:04:37.486782 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-03-03 15:04:37.487040 | mon1 | Tuesday 03 March 2026 15:04:37 +0000 (0:00:00.023) 0:00:07.951 ********* 2026-03-03 15:04:43.989669 | mon1 | changed: [mon1] 2026-03-03 15:04:43.989880 | mon1 | 2026-03-03 15:04:43.990109 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-03-03 15:04:43.990314 | mon1 | Tuesday 03 March 2026 15:04:43 +0000 (0:00:06.502) 0:00:14.453 ********* 2026-03-03 15:04:44.576689 | mon1 | changed: [mon1] 2026-03-03 15:04:44.576855 | mon1 | 2026-03-03 15:04:44.577081 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-03-03 15:04:44.577277 | mon1 | Tuesday 03 March 2026 15:04:44 +0000 (0:00:00.587) 0:00:15.041 ********* 2026-03-03 15:04:45.501487 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-03-03 15:04:45.501573 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-03-03 15:04:45.501587 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-03-03 15:04:45.501597 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-03-03 15:04:45.501608 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-03-03 15:04:45.501619 | mon1 | 2026-03-03 15:04:45.501629 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-03-03 15:04:45.501638 | mon1 | Tuesday 03 March 2026 15:04:45 +0000 (0:00:00.923) 0:00:15.964 ********* 2026-03-03 15:04:46.099830 | mon1 | changed: [mon1] 2026-03-03 15:04:46.100038 | mon1 | 2026-03-03 15:04:46.100170 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-03-03 15:04:46.100296 | mon1 | Tuesday 03 March 2026 15:04:46 +0000 (0:00:00.585) 0:00:16.550 ********* 2026-03-03 15:04:46.100412 | mon1 | 2026-03-03 15:04:46.100535 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-03 15:04:46.100655 | mon1 | Tuesday 03 March 2026 15:04:46 +0000 (0:00:00.006) 0:00:16.556 ********* 2026-03-03 15:04:47.037102 | mon1 | ok: [mon1] 2026-03-03 15:04:47.037491 | mon1 | 2026-03-03 15:04:47.037818 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-03-03 15:04:47.038110 | mon1 | Tuesday 03 March 2026 15:04:47 +0000 (0:00:00.945) 0:00:17.502 ********* 2026-03-03 15:04:47.487651 | mon1 | changed: [mon1] 2026-03-03 15:04:47.488097 | mon1 | 2026-03-03 15:04:47.488449 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-03-03 15:04:47.488753 | mon1 | Tuesday 03 March 2026 15:04:47 +0000 (0:00:00.450) 0:00:17.952 ********* 2026-03-03 15:04:48.028270 | mon1 | changed: [mon1] 2026-03-03 15:04:48.028653 | mon1 | 2026-03-03 15:04:48.029013 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-03-03 15:04:48.029305 | mon1 | Tuesday 03 March 2026 15:04:48 +0000 (0:00:00.540) 0:00:18.493 ********* 2026-03-03 15:04:48.238744 | mon1 | ok: [mon1] 2026-03-03 15:04:48.238811 | mon1 | 2026-03-03 15:04:48.238817 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-03-03 15:04:48.238822 | mon1 | Tuesday 03 March 2026 15:04:48 +0000 (0:00:00.210) 0:00:18.703 ********* 2026-03-03 15:04:48.310577 | mon1 | ok: [mon1] => { 2026-03-03 15:04:48.310611 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-03-03 15:04:48.310617 | mon1 | } 2026-03-03 15:04:48.310622 | mon1 | 2026-03-03 15:04:48.310626 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-03-03 15:04:48.310631 | mon1 | Tuesday 03 March 2026 15:04:48 +0000 (0:00:00.072) 0:00:18.775 ********* 2026-03-03 15:04:49.246936 | mon1 | changed: [mon1] 2026-03-03 15:04:49.247024 | mon1 | 2026-03-03 15:04:49.247089 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-03-03 15:04:49.247252 | mon1 | Tuesday 03 March 2026 15:04:49 +0000 (0:00:00.936) 0:00:19.712 ********* 2026-03-03 15:04:53.618525 | mon1 | changed: [mon1] 2026-03-03 15:04:53.618605 | mon1 | 2026-03-03 15:04:53.618666 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-03-03 15:04:53.618810 | mon1 | Tuesday 03 March 2026 15:04:53 +0000 (0:00:04.371) 0:00:24.083 ********* 2026-03-03 15:04:54.559773 | mon1 | ok: [mon1] 2026-03-03 15:04:54.559860 | mon1 | 2026-03-03 15:04:54.559919 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-03-03 15:04:54.560055 | mon1 | Tuesday 03 March 2026 15:04:54 +0000 (0:00:00.941) 0:00:25.024 ********* 2026-03-03 15:04:55.113498 | mon1 | changed: [mon1] 2026-03-03 15:04:55.113595 | mon1 | 2026-03-03 15:04:55.113915 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-03-03 15:04:55.113988 | mon1 | Tuesday 03 March 2026 15:04:55 +0000 (0:00:00.553) 0:00:25.578 ********* 2026-03-03 15:04:55.610243 | mon1 | changed: [mon1] 2026-03-03 15:04:55.610314 | mon1 | 2026-03-03 15:04:55.610531 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-03-03 15:04:55.610590 | mon1 | Tuesday 03 March 2026 15:04:55 +0000 (0:00:00.497) 0:00:26.075 ********* 2026-03-03 15:04:56.200402 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-03-03 15:04:56.200459 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-03-03 15:04:56.200466 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-03-03 15:04:56.200471 | mon1 | 2026-03-03 15:04:56.200476 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-03-03 15:04:56.200480 | mon1 | Tuesday 03 March 2026 15:04:56 +0000 (0:00:00.589) 0:00:26.665 ********* 2026-03-03 15:04:56.669208 | mon1 | changed: [mon1] 2026-03-03 15:04:56.669292 | mon1 | 2026-03-03 15:04:56.669514 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-03-03 15:04:56.669562 | mon1 | Tuesday 03 March 2026 15:04:56 +0000 (0:00:00.469) 0:00:27.134 ********* 2026-03-03 15:04:57.155325 | mon1 | changed: [mon1] 2026-03-03 15:04:57.155399 | mon1 | 2026-03-03 15:04:57.155461 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-03-03 15:04:57.155851 | mon1 | Tuesday 03 March 2026 15:04:57 +0000 (0:00:00.480) 0:00:27.614 ********* 2026-03-03 15:04:57.155914 | mon1 | 2026-03-03 15:04:57.155922 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-03-03 15:04:57.155943 | mon1 | Tuesday 03 March 2026 15:04:57 +0000 (0:00:00.005) 0:00:27.620 ********* 2026-03-03 15:04:57.865932 | mon1 | ok: [mon1] 2026-03-03 15:04:57.866031 | mon1 | 2026-03-03 15:04:57.866307 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-03-03 15:04:57.866373 | mon1 | Tuesday 03 March 2026 15:04:57 +0000 (0:00:00.710) 0:00:28.331 ********* 2026-03-03 15:04:58.789637 | mon1 | changed: [mon1] 2026-03-03 15:04:58.789716 | mon1 | 2026-03-03 15:04:58.790067 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-03-03 15:04:58.790135 | mon1 | Tuesday 03 March 2026 15:04:58 +0000 (0:00:00.923) 0:00:29.254 ********* 2026-03-03 15:04:59.327379 | mon1 | changed: [mon1] 2026-03-03 15:04:59.327464 | mon1 | 2026-03-03 15:04:59.327527 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-03-03 15:04:59.327655 | mon1 | Tuesday 03 March 2026 15:04:59 +0000 (0:00:00.538) 0:00:29.792 ********* 2026-03-03 15:04:59.372782 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-03-03 15:04:59.372868 | mon1 | 2026-03-03 15:04:59.372933 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-03-03 15:04:59.373066 | mon1 | Tuesday 03 March 2026 15:04:59 +0000 (0:00:00.045) 0:00:29.837 ********* 2026-03-03 15:05:26.063057 | mon1 | changed: [mon1] 2026-03-03 15:05:26.063150 | mon1 | 2026-03-03 15:05:26.063192 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-03-03 15:05:26.063288 | mon1 | Tuesday 03 March 2026 15:05:26 +0000 (0:00:26.682) 0:00:56.520 ********* 2026-03-03 15:05:26.705710 | mon1 | ok: [mon1] => (item=chronyd) 2026-03-03 15:05:26.705924 | mon1 | ok: [mon1] => (item=sshd) 2026-03-03 15:05:26.706134 | mon1 | 2026-03-03 15:05:26.706364 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-03-03 15:05:26.706567 | mon1 | Tuesday 03 March 2026 15:05:26 +0000 (0:00:00.650) 0:00:57.170 ********* 2026-03-03 15:05:26.967068 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed: ", "url": "https://download.ceph.com/rpm-18.2.7/el9/noarch/cephadm"} 2026-03-03 15:05:26.969487 | mon1 | 2026-03-03 15:05:26.969701 | mon1 | PLAY RECAP ********************************************************************* 2026-03-03 15:05:26.969988 | mon1 | mon1 : ok=33 changed=20 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 2026-03-03 15:05:26.970205 | mon1 | 2026-03-03 15:05:26.970372 | mon1 | 2026-03-03 15:05:26.970565 | mon1 | TASKS RECAP ******************************************************************** 2026-03-03 15:05:26.970783 | mon1 | Tuesday 03 March 2026 15:05:26 +0000 (0:00:00.264) 0:00:57.435 ********* 2026-03-03 15:05:26.970950 | mon1 | =============================================================================== 2026-03-03 15:05:26.971200 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.68s 2026-03-03 15:05:26.971409 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.50s 2026-03-03 15:05:26.971605 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.37s 2026-03-03 15:05:26.971806 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.95s 2026-03-03 15:05:26.971999 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.66s 2026-03-03 15:05:26.972193 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.15s 2026-03-03 15:05:26.972397 | mon1 | Gathering Facts --------------------------------------------------------- 1.01s 2026-03-03 15:05:26.972583 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 0.94s 2026-03-03 15:05:26.972776 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.94s 2026-03-03 15:05:26.972967 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 0.92s 2026-03-03 15:05:26.973160 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 0.92s 2026-03-03 15:05:26.973356 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.88s 2026-03-03 15:05:26.973549 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.68s 2026-03-03 15:05:26.973749 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.65s 2026-03-03 15:05:26.974032 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.59s 2026-03-03 15:05:26.974243 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.59s 2026-03-03 15:05:26.974451 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.59s 2026-03-03 15:05:26.974650 | mon1 | vexxhost.containers.docker : Ensure group "docker" exists --------------- 0.55s 2026-03-03 15:05:26.975045 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.54s 2026-03-03 15:05:26.975343 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.54s 2026-03-03 15:05:27.064087 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-03 15:05:27.064184 | mon1 | ERROR [default > converge] Executed: Failed 2026-03-03 15:05:27.064258 | mon1 | ERROR Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-03-03 15:05:37.451534 | mon1 | ERROR 2026-03-03 15:05:37.451793 | mon1 | { 2026-03-03 15:05:37.451834 | mon1 | "delta": "0:02:17.371659", 2026-03-03 15:05:37.451863 | mon1 | "end": "2026-03-03 15:05:27.140107", 2026-03-03 15:05:37.451889 | mon1 | "msg": "non-zero return code", 2026-03-03 15:05:37.451914 | mon1 | "rc": 2, 2026-03-03 15:05:37.451941 | mon1 | "start": "2026-03-03 15:03:09.768448" 2026-03-03 15:05:37.451967 | mon1 | } failure 2026-03-03 15:05:37.460236 | 2026-03-03 15:05:37.460286 | PLAY RECAP 2026-03-03 15:05:37.460336 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-03-03 15:05:37.460357 | 2026-03-03 15:05:37.579731 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-03-03 15:05:37.583408 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-03 15:05:38.173342 | 2026-03-03 15:05:38.173477 | PLAY [all] 2026-03-03 15:05:38.185277 | 2026-03-03 15:05:38.185356 | TASK [fetch-output : Set log path for multiple nodes] 2026-03-03 15:05:38.232867 | mon1 | ok 2026-03-03 15:05:38.247486 | osd1 | ok 2026-03-03 15:05:38.251822 | 2026-03-03 15:05:38.251912 | TASK [fetch-output : Set log path for single node] 2026-03-03 15:05:38.276807 | mon1 | skipping: Conditional result was False 2026-03-03 15:05:38.287825 | osd1 | skipping: Conditional result was False 2026-03-03 15:05:38.292954 | 2026-03-03 15:05:38.293048 | LOOP [fetch-output : Ensure local output dirs] 2026-03-03 15:05:38.666056 | mon1 -> localhost | changed: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/logs/mon1" 2026-03-03 15:05:38.670685 | osd1 -> localhost | changed: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/logs/osd1" 2026-03-03 15:05:38.874454 | osd1 -> localhost | changed: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/artifacts" 2026-03-03 15:05:38.891563 | mon1 -> localhost | ok: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/artifacts" 2026-03-03 15:05:39.089994 | mon1 -> localhost | changed: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/docs" 2026-03-03 15:05:39.107473 | osd1 -> localhost | ok: "/var/lib/zuul/builds/c31ca5c960104334845b432577da92d6/work/docs" 2026-03-03 15:05:39.107592 | osd1 -> localhost | changed: All items complete 2026-03-03 15:05:39.107652 | 2026-03-03 15:05:39.129446 | 2026-03-03 15:05:39.129591 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-03-03 15:05:39.768699 | mon1 | changed: .d..t...... ./ 2026-03-03 15:05:39.773144 | osd1 | changed: .d..t...... ./ 2026-03-03 15:05:40.210560 | mon1 | changed: .d..t...... ./ 2026-03-03 15:05:40.222209 | osd1 | changed: .d..t...... ./ 2026-03-03 15:05:40.671351 | mon1 | changed: .d..t...... ./ 2026-03-03 15:05:40.675981 | osd1 | changed: .d..t...... ./ 2026-03-03 15:05:40.701042 | 2026-03-03 15:05:40.701190 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-03-03 15:05:41.117853 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008010 2026-03-03 15:05:41.118089 | mon1 -> localhost | changed: All items complete 2026-03-03 15:05:41.118128 | 2026-03-03 15:05:41.344866 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008180 2026-03-03 15:05:41.371985 | 2026-03-03 15:05:41.372144 | PLAY [all] 2026-03-03 15:05:41.378211 | 2026-03-03 15:05:41.378275 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-03-03 15:05:41.796830 | mon1 | changed 2026-03-03 15:05:41.948964 | osd1 | changed 2026-03-03 15:05:41.961313 | 2026-03-03 15:05:41.961569 | PLAY RECAP 2026-03-03 15:05:41.961682 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-03 15:05:41.961748 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-03-03 15:05:41.961792 | 2026-03-03 15:05:42.118051 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-03-03 15:05:42.123466 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-03-03 15:05:42.680623 | 2026-03-03 15:05:42.680753 | PLAY [localhost] 2026-03-03 15:05:42.690363 | 2026-03-03 15:05:42.690433 | TASK [Generate Zuul manifest] 2026-03-03 15:05:42.714209 | localhost | ok 2026-03-03 15:05:42.728239 | 2026-03-03 15:05:42.728317 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-03-03 15:05:43.034520 | localhost | changed 2026-03-03 15:05:43.047043 | 2026-03-03 15:05:43.047131 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-03-03 15:05:43.079870 | localhost | ok 2026-03-03 15:05:43.088455 | 2026-03-03 15:05:43.088520 | TASK [Upload logs] 2026-03-03 15:05:43.115928 | localhost | ok 2026-03-03 15:05:43.172078 | 2026-03-03 15:05:43.172227 | TASK [Set zuul-log-path fact] 2026-03-03 15:05:43.196385 | localhost | ok 2026-03-03 15:05:43.207460 | 2026-03-03 15:05:43.207546 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-03-03 15:05:43.240549 | localhost | ok 2026-03-03 15:05:43.249604 | 2026-03-03 15:05:43.249674 | TASK [upload-logs : Create log directories] 2026-03-03 15:05:43.648388 | localhost | changed 2026-03-03 15:05:43.654356 | 2026-03-03 15:05:43.654430 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-03-03 15:05:44.052822 | localhost -> localhost | ok: Runtime: 0:00:00.006275 2026-03-03 15:05:44.059846 | 2026-03-03 15:05:44.059914 | TASK [upload-logs : Upload logs to log server] 2026-03-03 15:05:44.511598 | localhost | Output suppressed because no_log was given 2026-03-03 15:05:44.516546 | 2026-03-03 15:05:44.516664 | LOOP [upload-logs : Compress console log and json output] 2026-03-03 15:05:44.561796 | localhost | skipping: Conditional result was False 2026-03-03 15:05:44.568320 | localhost | skipping: Conditional result was False 2026-03-03 15:05:44.582313 | 2026-03-03 15:05:44.582513 | LOOP [upload-logs : Upload compressed console log and json output] 2026-03-03 15:05:44.627346 | localhost | skipping: Conditional result was False 2026-03-03 15:05:44.627753 | 2026-03-03 15:05:44.631354 | localhost | skipping: Conditional result was False 2026-03-03 15:05:44.648037 | 2026-03-03 15:05:44.648234 | LOOP [upload-logs : Upload console log and json output]