2026-03-12 18:59:34.070122 | Job console starting
2026-03-12 18:59:34.096249 | Updating git repos
2026-03-12 18:59:34.131499 | Cloning repos into workspace
2026-03-12 18:59:34.169763 | Restoring repo states
2026-03-12 18:59:34.175681 | Merging changes
2026-03-12 18:59:34.890574 | Checking out repos
2026-03-12 18:59:35.345974 | Preparing playbooks
2026-03-12 18:59:36.997933 | Running Ansible setup
2026-03-12 18:59:41.552118 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-12 18:59:42.146818 | 
2026-03-12 18:59:42.146977 | PLAY [localhost]
2026-03-12 18:59:42.156305 | 
2026-03-12 18:59:42.156378 | TASK [Gathering Facts]
2026-03-12 18:59:43.007492 | localhost | ok
2026-03-12 18:59:43.021355 | 
2026-03-12 18:59:43.021437 | TASK [Setup log path fact]
2026-03-12 18:59:43.044440 | localhost | ok
2026-03-12 18:59:43.059234 | 
2026-03-12 18:59:43.059298 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-12 18:59:43.089897 | localhost | ok
2026-03-12 18:59:43.100376 | 
2026-03-12 18:59:43.100439 | TASK [emit-job-header : Print job information]
2026-03-12 18:59:43.139037 | # Job Information
2026-03-12 18:59:43.139190 | Ansible Version: 2.16.16
2026-03-12 18:59:43.139234 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-03-12 18:59:43.139265 | Pipeline: check
2026-03-12 18:59:43.139292 | Executor: 0a8996d2b663
2026-03-12 18:59:43.139318 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/97
2026-03-12 18:59:43.139349 | Event ID: 64481ba0-1e45-11f1-9154-be3c1d63f3c8
2026-03-12 18:59:43.144209 | 
2026-03-12 18:59:43.144298 | LOOP [emit-job-header : Print node information]
2026-03-12 18:59:43.243907 | localhost | ok:
2026-03-12 18:59:43.244222 | localhost | # Node Information
2026-03-12 18:59:43.244285 | localhost | Inventory Hostname: mon1
2026-03-12 18:59:43.244333 | localhost | Hostname: np0000158598
2026-03-12 18:59:43.244377 | localhost | Username: zuul
2026-03-12 18:59:43.244426 | localhost | Distro: Ubuntu 24.04
2026-03-12 18:59:43.244469 | localhost | Provider: yul1
2026-03-12 18:59:43.244510 | localhost | Region: ca-ymq-1
2026-03-12 18:59:43.244551 | localhost | Label: ubuntu-noble
2026-03-12 18:59:43.244591 | localhost | Product Name: OpenStack Nova
2026-03-12 18:59:43.244631 | localhost | Interface IP: 199.204.45.144
2026-03-12 18:59:43.290560 | localhost | ok:
2026-03-12 18:59:43.290684 | localhost | # Node Information
2026-03-12 18:59:43.290740 | localhost | Inventory Hostname: osd1
2026-03-12 18:59:43.290784 | localhost | Hostname: np0000158599
2026-03-12 18:59:43.290826 | localhost | Username: zuul
2026-03-12 18:59:43.290866 | localhost | Distro: Ubuntu 24.04
2026-03-12 18:59:43.290906 | localhost | Provider: yul1
2026-03-12 18:59:43.290947 | localhost | Region: ca-ymq-1
2026-03-12 18:59:43.290987 | localhost | Label: ubuntu-noble
2026-03-12 18:59:43.291027 | localhost | Product Name: OpenStack Nova
2026-03-12 18:59:43.291068 | localhost | Interface IP: 199.204.45.69
2026-03-12 18:59:43.307466 | 
2026-03-12 18:59:43.307656 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-03-12 18:59:43.670872 | localhost -> localhost | changed
2026-03-12 18:59:43.679489 | 
2026-03-12 18:59:43.679567 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-03-12 18:59:44.582977 | localhost -> localhost | changed
2026-03-12 18:59:44.590312 | 
2026-03-12 18:59:44.590364 | PLAY [all]
2026-03-12 18:59:44.600656 | 
2026-03-12 18:59:44.600999 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-03-12 18:59:44.816162 | mon1 -> localhost | ok
2026-03-12 18:59:44.824435 | 
2026-03-12 18:59:44.824516 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-03-12 18:59:44.856656 | mon1 | ok
2026-03-12 18:59:44.862878 | osd1 | ok
2026-03-12 18:59:44.881689 | mon1 | included: /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-12 18:59:44.881743 | osd1 | included: /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-03-12 18:59:44.888059 | 
2026-03-12 18:59:44.888119 | TASK [add-build-sshkey : Create Temp SSH key]
2026-03-12 18:59:45.810645 | mon1 -> localhost | Generating public/private rsa key pair.
2026-03-12 18:59:45.810837 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/883c9270bba247a689cecfedbfdf3caf_id_rsa
2026-03-12 18:59:45.810880 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/883c9270bba247a689cecfedbfdf3caf_id_rsa.pub
2026-03-12 18:59:45.810912 | mon1 -> localhost | The key fingerprint is:
2026-03-12 18:59:45.810943 | mon1 -> localhost | SHA256:lHXy/3SQFsFqgR4RacA2qzdVcrqN+Ip1y9ebJbBjMQI zuul-build-sshkey
2026-03-12 18:59:45.810973 | mon1 -> localhost | The key's randomart image is:
2026-03-12 18:59:45.811002 | mon1 -> localhost | +---[RSA 3072]----+
2026-03-12 18:59:45.811035 | mon1 -> localhost | |       ...==..o. |
2026-03-12 18:59:45.811067 | mon1 -> localhost | |        +o*++ .o |
2026-03-12 18:59:45.811096 | mon1 -> localhost | |       .E= *.o+  |
2026-03-12 18:59:45.811124 | mon1 -> localhost | |       ...+ oo . |
2026-03-12 18:59:45.811152 | mon1 -> localhost | |       .So.=+ . o|
2026-03-12 18:59:45.811179 | mon1 -> localhost | |      . + o..= o.|
2026-03-12 18:59:45.811207 | mon1 -> localhost | |       ..o. +.. o|
2026-03-12 18:59:45.811234 | mon1 -> localhost | |       o o.o...+ |
2026-03-12 18:59:45.811261 | mon1 -> localhost | |      . ..o.  o. |
2026-03-12 18:59:45.811288 | mon1 -> localhost | +----[SHA256]-----+
2026-03-12 18:59:45.811345 | mon1 -> localhost | ok: Runtime: 0:00:00.521610
2026-03-12 18:59:45.823062 | 
2026-03-12 18:59:45.823125 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-03-12 18:59:45.864225 | mon1 | ok
2026-03-12 18:59:45.871371 | osd1 | ok
2026-03-12 18:59:45.893733 | mon1 | included: /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-12 18:59:45.893790 | osd1 | included: /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-03-12 18:59:45.904787 | 
2026-03-12 18:59:45.904849 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-03-12 18:59:45.931085 | mon1 | skipping: Conditional result was False
2026-03-12 18:59:45.942292 | osd1 | skipping: Conditional result was False
2026-03-12 18:59:45.952214 | 
2026-03-12 18:59:45.952300 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-03-12 18:59:46.453954 | mon1 | changed
2026-03-12 18:59:46.505180 | osd1 | changed
2026-03-12 18:59:46.512454 | 
2026-03-12 18:59:46.512519 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-03-12 18:59:46.735654 | mon1 | ok
2026-03-12 18:59:46.741645 | osd1 | ok
2026-03-12 18:59:46.747634 | 
2026-03-12 18:59:46.747697 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-03-12 18:59:47.312869 | mon1 | changed
2026-03-12 18:59:47.460880 | osd1 | changed
2026-03-12 18:59:47.467614 | 
2026-03-12 18:59:47.467685 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-03-12 18:59:48.080072 | mon1 | changed
2026-03-12 18:59:48.085284 | osd1 | changed
2026-03-12 18:59:48.090601 | 
2026-03-12 18:59:48.090660 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-03-12 18:59:48.115113 | mon1 | skipping: Conditional result was False
2026-03-12 18:59:48.125986 | osd1 | skipping: Conditional result was False
2026-03-12 18:59:48.135881 | 
2026-03-12 18:59:48.135972 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-03-12 18:59:48.462150 | mon1 -> localhost | changed
2026-03-12 18:59:48.480122 | 
2026-03-12 18:59:48.480190 | TASK [add-build-sshkey : Add back temp key]
2026-03-12 18:59:48.746855 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/883c9270bba247a689cecfedbfdf3caf_id_rsa (zuul-build-sshkey)
2026-03-12 18:59:48.747083 | mon1 -> localhost | ok: Runtime: 0:00:00.014295
2026-03-12 18:59:48.754126 | 
2026-03-12 18:59:48.754187 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-03-12 18:59:49.053825 | osd1 | ok
2026-03-12 18:59:49.059098 | mon1 | ok
2026-03-12 18:59:49.063965 | 
2026-03-12 18:59:49.064029 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-03-12 18:59:49.086887 | mon1 | skipping: Conditional result was False
2026-03-12 18:59:49.098078 | osd1 | skipping: Conditional result was False
2026-03-12 18:59:49.118055 | 
2026-03-12 18:59:49.118118 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-03-12 18:59:49.430413 | osd1 | ok
2026-03-12 18:59:49.436622 | mon1 | ok
2026-03-12 18:59:49.470116 | 
2026-03-12 18:59:49.470267 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-03-12 18:59:50.223828 | mon1 | Output suppressed because no_log was given
2026-03-12 18:59:50.243783 | osd1 | Output suppressed because no_log was given
2026-03-12 18:59:50.261518 | 
2026-03-12 18:59:50.261581 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-03-12 18:59:50.483172 | mon1 | ok: "logs"
2026-03-12 18:59:50.493113 | mon1 | ok: All items complete
2026-03-12 18:59:50.493161 | 
2026-03-12 18:59:50.503307 | osd1 | ok: "logs"
2026-03-12 18:59:50.675593 | mon1 | ok: "artifacts"
2026-03-12 18:59:50.708771 | osd1 | ok: "artifacts"
2026-03-12 18:59:50.862160 | mon1 | ok: "docs"
2026-03-12 18:59:50.896050 | osd1 | ok: "docs"
2026-03-12 18:59:50.911389 | 
2026-03-12 18:59:50.911519 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-03-12 18:59:51.131311 | mon1 | changed: "logs"
2026-03-12 18:59:51.131624 | mon1 | ok: All items complete
2026-03-12 18:59:51.131656 | 
2026-03-12 18:59:51.136816 | osd1 | changed: "logs"
2026-03-12 18:59:51.318290 | mon1 | changed: "artifacts"
2026-03-12 18:59:51.430635 | osd1 | changed: "artifacts"
2026-03-12 18:59:51.512024 | mon1 | changed: "docs"
2026-03-12 18:59:51.522758 | osd1 | changed: "docs"
2026-03-12 18:59:51.545910 | 
2026-03-12 18:59:51.546032 | PLAY RECAP
2026-03-12 18:59:51.546078 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-12 18:59:51.546108 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-12 18:59:51.546133 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-03-12 18:59:51.546151 | 
2026-03-12 18:59:51.668627 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-03-12 18:59:51.671954 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-12 18:59:52.229913 | 
2026-03-12 18:59:52.230040 | PLAY [all]
2026-03-12 18:59:52.241905 | 
2026-03-12 18:59:52.241978 | TASK [setup-uv : Extract archive]
2026-03-12 18:59:54.698879 | osd1 | changed
2026-03-12 18:59:54.811440 | mon1 | changed
2026-03-12 18:59:54.818542 | 
2026-03-12 18:59:54.818715 | TASK [setup-uv : Print version]
2026-03-12 18:59:55.111700 | mon1 | uv 0.8.13
2026-03-12 18:59:55.250703 | osd1 | uv 0.8.13
2026-03-12 18:59:55.403349 | mon1 | ok: Runtime: 0:00:00.015944
2026-03-12 18:59:55.416195 | osd1 | ok: Runtime: 0:00:00.015530
2026-03-12 18:59:55.427127 | 
2026-03-12 18:59:55.427179 | PLAY RECAP
2026-03-12 18:59:55.427255 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-12 18:59:55.427285 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-03-12 18:59:55.427304 | 
2026-03-12 18:59:55.533722 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-03-12 18:59:55.539159 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-12 18:59:56.084192 | 
2026-03-12 18:59:56.285753 | PLAY [all]
2026-03-12 18:59:56.303427 | 
2026-03-12 18:59:56.303529 | TASK [Copy inventory file for Zuul]
2026-03-12 18:59:57.240923 | mon1 | changed
2026-03-12 18:59:57.246201 | 
2026-03-12 18:59:57.246269 | TASK [Switch "ansible_host" to private IP]
2026-03-12 18:59:57.574144 | mon1 | changed: 2 replacements made
2026-03-12 18:59:57.580175 | 
2026-03-12 18:59:57.580234 | TASK [Run Molecule scenario]
2026-03-12 18:59:57.929810 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-03-12 18:59:57.929920 | mon1 | Creating virtual environment at: .venv
2026-03-12 18:59:58.235131 | mon1 | Downloading netaddr (2.2MiB)
2026-03-12 18:59:58.241579 | mon1 | Downloading cryptography (4.3MiB)
2026-03-12 18:59:58.242085 | mon1 | Downloading pygments (1.2MiB)
2026-03-12 18:59:58.242373 | mon1 | Downloading ansible-core (2.1MiB)
2026-03-12 18:59:58.433373 | mon1 |  Downloading netaddr
2026-03-12 18:59:58.443281 | mon1 |  Downloading cryptography
2026-03-12 18:59:58.505958 | mon1 |  Downloading pygments
2026-03-12 18:59:58.687939 | mon1 |  Downloading ansible-core
2026-03-12 18:59:58.732112 | mon1 | Installed 37 packages in 43ms
2026-03-12 18:59:59.508688 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-03-12 18:59:59.508772 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-03-12 19:00:00.157109 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-03-12 19:00:00.157160 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-03-12 19:00:48.694394 | mon1 | INFO     [default > dependency] Executing
2026-03-12 19:00:48.694599 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-03-12 19:00:48.694819 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-03-12 19:00:48.694942 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-03-12 19:00:48.700778 | mon1 | INFO     [default > cleanup] Executing
2026-03-12 19:00:48.701103 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-12 19:00:48.706827 | mon1 | INFO     [default > destroy] Executing
2026-03-12 19:00:48.706869 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-03-12 19:00:48.706887 | mon1 | INFO     [default > destroy] Executed: Successful
2026-03-12 19:00:48.712597 | mon1 | INFO     [default > syntax] Executing
2026-03-12 19:00:49.826507 | mon1 |
2026-03-12 19:00:49.826571 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-12 19:00:49.894056 | mon1 | INFO     [default > syntax] Executed: Successful
2026-03-12 19:00:49.906279 | mon1 | INFO     [default > create] Executing
2026-03-12 19:00:49.907898 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-03-12 19:00:49.913748 | mon1 | INFO     [default > prepare] Executing
2026-03-12 19:00:50.711641 | mon1 |
2026-03-12 19:00:50.712487 | mon1 | PLAY [Prepare] *****************************************************************
2026-03-12 19:00:50.712540 | mon1 |
2026-03-12 19:00:50.712559 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-12 19:00:50.712581 | mon1 | Thursday 12 March 2026  19:00:50 +0000 (0:00:00.037)       0:00:00.037 ********
2026-03-12 19:00:51.987382 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-12 19:00:51.987422 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-12 19:00:51.987579 | mon1 | interpreter could change the meaning of that path. See
2026-03-12 19:00:51.987859 | mon1 | https://docs.ansible.com/ansible-
2026-03-12 19:00:51.988123 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-12 19:00:51.989269 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-03-12 19:00:51.989565 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-12 19:00:51.989838 | mon1 | interpreter could change the meaning of that path. See
2026-03-12 19:00:51.990087 | mon1 | https://docs.ansible.com/ansible-
2026-03-12 19:00:51.990487 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-12 19:00:51.997313 | mon1 | ok: [mon1]
2026-03-12 19:00:51.997466 | mon1 | ok: [osd1]
2026-03-12 19:00:51.997606 | mon1 |
2026-03-12 19:00:51.997761 | mon1 | TASK [Configure short hostname] ************************************************
2026-03-12 19:00:51.997924 | mon1 | Thursday 12 March 2026  19:00:51 +0000 (0:00:01.287)       0:00:01.324 ********
2026-03-12 19:00:52.782693 | mon1 | changed: [mon1]
2026-03-12 19:00:52.782831 | mon1 | changed: [osd1]
2026-03-12 19:00:52.782993 | mon1 |
2026-03-12 19:00:52.783174 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-03-12 19:00:52.783378 | mon1 | Thursday 12 March 2026  19:00:52 +0000 (0:00:00.784)       0:00:02.109 ********
2026-03-12 19:00:53.109049 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-03-12 19:00:53.109353 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-03-12 19:00:53.109703 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-03-12 19:00:53.121361 | mon1 | changed: [mon1]
2026-03-12 19:00:53.121711 | mon1 | changed: [osd1]
2026-03-12 19:00:53.121973 | mon1 |
2026-03-12 19:00:53.122239 | mon1 | TASK [Update apt cache] ********************************************************
2026-03-12 19:00:53.122547 | mon1 | Thursday 12 March 2026  19:00:53 +0000 (0:00:00.339)       0:00:02.448 ********
2026-03-12 19:00:59.559688 | mon1 | changed: [mon1]
2026-03-12 19:00:59.559902 | mon1 | changed: [osd1]
2026-03-12 19:00:59.560130 | mon1 |
2026-03-12 19:00:59.560414 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-03-12 19:00:59.560633 | mon1 |
2026-03-12 19:00:59.560874 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-12 19:00:59.561127 | mon1 | Thursday 12 March 2026  19:00:59 +0000 (0:00:06.438)       0:00:08.886 ********
2026-03-12 19:01:00.338133 | mon1 | ok: [osd1]
2026-03-12 19:01:00.338327 | mon1 |
2026-03-12 19:01:00.338600 | mon1 | TASK [Install depedencies] *****************************************************
2026-03-12 19:01:00.338845 | mon1 | Thursday 12 March 2026  19:01:00 +0000 (0:00:00.778)       0:00:09.664 ********
2026-03-12 19:01:20.175439 | mon1 | changed: [osd1]
2026-03-12 19:01:20.175576 | mon1 |
2026-03-12 19:01:20.175592 | mon1 | TASK [Start up service] ********************************************************
2026-03-12 19:01:20.175608 | mon1 | Thursday 12 March 2026  19:01:20 +0000 (0:00:19.836)       0:00:29.501 ********
2026-03-12 19:01:20.815958 | mon1 | ok: [osd1]
2026-03-12 19:01:20.816175 | mon1 |
2026-03-12 19:01:20.816460 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-03-12 19:01:20.816739 | mon1 | Thursday 12 March 2026  19:01:20 +0000 (0:00:00.641)       0:00:30.142 ********
2026-03-12 19:01:21.159030 | mon1 | ok: [osd1]
2026-03-12 19:01:21.159250 | mon1 |
2026-03-12 19:01:21.159544 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-03-12 19:01:21.159795 | mon1 | Thursday 12 March 2026  19:01:21 +0000 (0:00:00.343)       0:00:30.485 ********
2026-03-12 19:01:21.904698 | mon1 | changed: [osd1]
2026-03-12 19:01:21.904819 | mon1 |
2026-03-12 19:01:21.904994 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-03-12 19:01:21.905137 | mon1 | Thursday 12 March 2026  19:01:21 +0000 (0:00:00.745)       0:00:31.231 ********
2026-03-12 19:01:22.138550 | mon1 | ok: [osd1]
2026-03-12 19:01:22.138725 | mon1 |
2026-03-12 19:01:22.138999 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-03-12 19:01:22.139259 | mon1 | Thursday 12 March 2026  19:01:22 +0000 (0:00:00.233)       0:00:31.465 ********
2026-03-12 19:01:22.159974 | mon1 | skipping: [osd1]
2026-03-12 19:01:22.160204 | mon1 |
2026-03-12 19:01:22.160541 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-03-12 19:01:22.160803 | mon1 | Thursday 12 March 2026  19:01:22 +0000 (0:00:00.021)       0:00:31.487 ********
2026-03-12 19:01:22.873662 | mon1 | changed: [osd1] => (item=osd0)
2026-03-12 19:01:22.873883 | mon1 | changed: [osd1] => (item=osd1)
2026-03-12 19:01:22.874143 | mon1 | changed: [osd1] => (item=osd2)
2026-03-12 19:01:22.874422 | mon1 |
2026-03-12 19:01:22.874719 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-03-12 19:01:22.875000 | mon1 | Thursday 12 March 2026  19:01:22 +0000 (0:00:00.712)       0:00:32.200 ********
2026-03-12 19:01:23.645693 | mon1 | changed: [osd1] => (item=osd0)
2026-03-12 19:01:23.645903 | mon1 | changed: [osd1] => (item=osd1)
2026-03-12 19:01:23.646151 | mon1 | changed: [osd1] => (item=osd2)
2026-03-12 19:01:23.646413 | mon1 |
2026-03-12 19:01:23.646665 | mon1 | TASK [Start loop devices] ******************************************************
2026-03-12 19:01:23.646912 | mon1 | Thursday 12 March 2026  19:01:23 +0000 (0:00:00.772)       0:00:32.972 ********
2026-03-12 19:01:24.474295 | mon1 | changed: [osd1] => (item=osd0)
2026-03-12 19:01:24.474567 | mon1 | changed: [osd1] => (item=osd1)
2026-03-12 19:01:24.474815 | mon1 | changed: [osd1] => (item=osd2)
2026-03-12 19:01:24.475048 | mon1 |
2026-03-12 19:01:24.475352 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-03-12 19:01:24.475625 | mon1 | Thursday 12 March 2026  19:01:24 +0000 (0:00:00.828)       0:00:33.800 ********
2026-03-12 19:01:26.976603 | mon1 | changed: [osd1] => (item=osd0)
2026-03-12 19:01:26.976810 | mon1 | changed: [osd1] => (item=osd1)
2026-03-12 19:01:26.977058 | mon1 | changed: [osd1] => (item=osd2)
2026-03-12 19:01:26.977288 | mon1 |
2026-03-12 19:01:26.977585 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-03-12 19:01:26.977833 | mon1 | Thursday 12 March 2026  19:01:26 +0000 (0:00:02.501)       0:00:36.302 ********
2026-03-12 19:01:28.300852 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-03-12 19:01:28.300958 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-03-12 19:01:28.302438 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-03-12 19:01:28.302489 | mon1 |
2026-03-12 19:01:28.302496 | mon1 | PLAY RECAP *********************************************************************
2026-03-12 19:01:28.302503 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-03-12 19:01:28.302509 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-03-12 19:01:28.302515 | mon1 |
2026-03-12 19:01:28.302520 | mon1 |
2026-03-12 19:01:28.302526 | mon1 | TASKS RECAP ********************************************************************
2026-03-12 19:01:28.302531 | mon1 | Thursday 12 March 2026  19:01:28 +0000 (0:00:01.325)       0:00:37.628 ********
2026-03-12 19:01:28.302542 | mon1 | ===============================================================================
2026-03-12 19:01:28.302668 | mon1 | Install depedencies ---------------------------------------------------- 19.84s
2026-03-12 19:01:28.302818 | mon1 | Update apt cache -------------------------------------------------------- 6.44s
2026-03-12 19:01:28.303089 | mon1 | Create a volume group for each loop device ------------------------------ 2.50s
2026-03-12 19:01:28.303274 | mon1 | Create a logical volume for each loop device ---------------------------- 1.33s
2026-03-12 19:01:28.303457 | mon1 | Gathering Facts --------------------------------------------------------- 1.29s
2026-03-12 19:01:28.303606 | mon1 | Start loop devices ------------------------------------------------------ 0.83s
2026-03-12 19:01:28.303770 | mon1 | Configure short hostname ------------------------------------------------ 0.78s
2026-03-12 19:01:28.303936 | mon1 | Gathering Facts --------------------------------------------------------- 0.78s
2026-03-12 19:01:28.304044 | mon1 | Set permissions on loopback devices ------------------------------------- 0.77s
2026-03-12 19:01:28.304152 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.75s
2026-03-12 19:01:28.304259 | mon1 | Create devices for Ceph ------------------------------------------------- 0.71s
2026-03-12 19:01:28.304386 | mon1 | Start up service -------------------------------------------------------- 0.64s
2026-03-12 19:01:28.304493 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.34s
2026-03-12 19:01:28.304606 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.34s
2026-03-12 19:01:28.304720 | mon1 | Get list of all loopback devices ---------------------------------------- 0.23s
2026-03-12 19:01:28.304837 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-03-12 19:01:28.393469 | mon1 | INFO     [default > prepare] Executed: Successful
2026-03-12 19:01:28.403145 | mon1 | INFO     [default > converge] Executing
2026-03-12 19:01:29.392920 | mon1 |
2026-03-12 19:01:29.393791 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-03-12 19:01:29.394952 | mon1 |
2026-03-12 19:01:29.395240 | mon1 | TASK [Gathering Facts] *********************************************************
2026-03-12 19:01:29.395530 | mon1 | Thursday 12 March 2026  19:01:29 +0000 (0:00:00.052)       0:00:00.052 ********
2026-03-12 19:01:30.476389 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-03-12 19:01:30.476616 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-03-12 19:01:30.476894 | mon1 | interpreter could change the meaning of that path. See
2026-03-12 19:01:30.477125 | mon1 | https://docs.ansible.com/ansible-
2026-03-12 19:01:30.477433 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-03-12 19:01:30.486477 | mon1 | ok: [mon1]
2026-03-12 19:01:30.486703 | mon1 |
2026-03-12 19:01:30.486957 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-12 19:01:30.487236 | mon1 | Thursday 12 March 2026  19:01:30 +0000 (0:00:01.097)       0:00:01.149 ********
2026-03-12 19:01:30.827786 | mon1 | ok: [mon1]
2026-03-12 19:01:30.827984 | mon1 |
2026-03-12 19:01:30.828235 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-12 19:01:30.828592 | mon1 | Thursday 12 March 2026  19:01:30 +0000 (0:00:00.341)       0:00:01.491 ********
2026-03-12 19:01:30.871617 | mon1 | skipping: [mon1]
2026-03-12 19:01:30.871837 | mon1 |
2026-03-12 19:01:30.872123 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-03-12 19:01:30.872399 | mon1 | Thursday 12 March 2026  19:01:30 +0000 (0:00:00.043)       0:00:01.534 ********
2026-03-12 19:01:31.219277 | mon1 | changed: [mon1]
2026-03-12 19:01:31.219402 | mon1 |
2026-03-12 19:01:31.219506 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-12 19:01:31.219640 | mon1 | Thursday 12 March 2026  19:01:31 +0000 (0:00:00.347)       0:00:01.882 ********
2026-03-12 19:01:31.323008 | mon1 | ok: [mon1] => {
2026-03-12 19:01:31.323228 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.0/runc.amd64"
2026-03-12 19:01:31.323513 | mon1 | }
2026-03-12 19:01:31.323737 | mon1 |
2026-03-12 19:01:31.323986 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-12 19:01:31.324234 | mon1 | Thursday 12 March 2026  19:01:31 +0000 (0:00:00.104)       0:00:01.986 ********
2026-03-12 19:01:32.120217 | mon1 | changed: [mon1]
2026-03-12 19:01:32.120450 | mon1 |
2026-03-12 19:01:32.120709 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-12 19:01:32.120957 | mon1 | Thursday 12 March 2026  19:01:32 +0000 (0:00:00.796)       0:00:02.783 ********
2026-03-12 19:01:32.167508 | mon1 | skipping: [mon1]
2026-03-12 19:01:32.167706 | mon1 |
2026-03-12 19:01:32.167954 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-12 19:01:32.168210 | mon1 | Thursday 12 March 2026  19:01:32 +0000 (0:00:00.048)       0:00:02.831 ********
2026-03-12 19:01:32.214192 | mon1 | skipping: [mon1]
2026-03-12 19:01:32.214425 | mon1 |
2026-03-12 19:01:32.214673 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-12 19:01:32.214915 | mon1 | Thursday 12 March 2026  19:01:32 +0000 (0:00:00.046)       0:00:02.877 ********
2026-03-12 19:01:32.462522 | mon1 | ok: [mon1]
2026-03-12 19:01:32.462725 | mon1 |
2026-03-12 19:01:32.462989 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-03-12 19:01:32.463252 | mon1 | Thursday 12 March 2026  19:01:32 +0000 (0:00:00.247)       0:00:03.125 ********
2026-03-12 19:01:33.505542 | mon1 | ok: [mon1]
2026-03-12 19:01:33.505612 | mon1 |
2026-03-12 19:01:33.505759 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-12 19:01:33.505889 | mon1 | Thursday 12 March 2026  19:01:33 +0000 (0:00:01.043)       0:00:04.168 ********
2026-03-12 19:01:33.709486 | mon1 | ok: [mon1] => {
2026-03-12 19:01:33.709741 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.0/containerd-2.2.0-linux-amd64.tar.gz"
2026-03-12 19:01:33.709979 | mon1 | }
2026-03-12 19:01:33.710192 | mon1 |
2026-03-12 19:01:33.710490 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-12 19:01:33.710746 | mon1 | Thursday 12 March 2026  19:01:33 +0000 (0:00:00.203)       0:00:04.372 ********
2026-03-12 19:01:34.828480 | mon1 | changed: [mon1]
2026-03-12 19:01:34.828564 | mon1 |
2026-03-12 19:01:34.829156 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-12 19:01:34.829196 | mon1 | Thursday 12 March 2026  19:01:34 +0000 (0:00:01.118)       0:00:05.491 ********
2026-03-12 19:01:38.010712 | mon1 | changed: [mon1]
2026-03-12 19:01:38.010773 | mon1 |
2026-03-12 19:01:38.010779 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-03-12 19:01:38.010785 | mon1 | Thursday 12 March 2026  19:01:37 +0000 (0:00:03.172)       0:00:08.664 ********
2026-03-12 19:01:38.037940 | mon1 | skipping: [mon1]
2026-03-12 19:01:38.037998 | mon1 |
2026-03-12 19:01:38.038012 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-03-12 19:01:38.038025 | mon1 | Thursday 12 March 2026  19:01:38 +0000 (0:00:00.035)       0:00:08.699 ********
2026-03-12 19:01:38.069809 | mon1 | skipping: [mon1]
2026-03-12 19:01:38.069854 | mon1 |
2026-03-12 19:01:38.069868 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-03-12 19:01:38.069881 | mon1 | Thursday 12 March 2026  19:01:38 +0000 (0:00:00.031)       0:00:08.731 ********
2026-03-12 19:01:38.100868 | mon1 | skipping: [mon1]
2026-03-12 19:01:38.100965 | mon1 |
2026-03-12 19:01:38.100984 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-03-12 19:01:38.100999 | mon1 | Thursday 12 March 2026  19:01:38 +0000 (0:00:00.031)       0:00:08.762 ********
2026-03-12 19:01:45.724887 | mon1 | changed: [mon1]
2026-03-12 19:01:45.724940 | mon1 |
2026-03-12 19:01:45.724955 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-03-12 19:01:45.724967 | mon1 | Thursday 12 March 2026  19:01:45 +0000 (0:00:07.624)       0:00:16.387 ********
2026-03-12 19:01:46.370696 | mon1 | changed: [mon1]
2026-03-12 19:01:46.370741 | mon1 |
2026-03-12 19:01:46.370754 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-03-12 19:01:46.370767 | mon1 | Thursday 12 March 2026  19:01:46 +0000 (0:00:00.645)       0:00:17.033 ********
2026-03-12 19:01:47.434753 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-03-12 19:01:47.434836 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-03-12 19:01:47.435509 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-03-12 19:01:47.435568 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-03-12 19:01:47.435574 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-03-12 19:01:47.435580 | mon1 |
2026-03-12 19:01:47.435585 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-03-12 19:01:47.435591 | mon1 | Thursday 12 March 2026  19:01:47 +0000 (0:00:01.064)       0:00:18.097 ********
2026-03-12 19:01:48.118269 | mon1 | changed: [mon1]
2026-03-12 19:01:48.118306 | mon1 |
2026-03-12 19:01:48.118502 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-03-12 19:01:48.118752 | mon1 | Thursday 12 March 2026  19:01:48 +0000 (0:00:00.674)       0:00:18.772 ********
2026-03-12 19:01:48.118972 | mon1 |
2026-03-12 19:01:48.119225 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-12 19:01:48.119525 | mon1 | Thursday 12 March 2026  19:01:48 +0000 (0:00:00.007)       0:00:18.779 ********
2026-03-12 19:01:49.193117 | mon1 | ok: [mon1]
2026-03-12 19:01:49.193390 | mon1 |
2026-03-12 19:01:49.193674 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-03-12 19:01:49.194516 | mon1 | Thursday 12 March 2026  19:01:49 +0000 (0:00:01.076)       0:00:19.856 ********
2026-03-12 19:01:49.740464 | mon1 | changed: [mon1]
2026-03-12 19:01:49.740555 | mon1 |
2026-03-12 19:01:49.740566 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-03-12 19:01:49.740576 | mon1 | Thursday 12 March 2026  19:01:49 +0000 (0:00:00.546)       0:00:20.402 ********
2026-03-12 19:01:50.401511 | mon1 | changed: [mon1]
2026-03-12 19:01:50.401576 | mon1 |
2026-03-12 19:01:50.401583 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-03-12 19:01:50.401589 | mon1 | Thursday 12 March 2026  19:01:50 +0000 (0:00:00.661)       0:00:21.064 ********
2026-03-12 19:01:50.640501 | mon1 | ok: [mon1]
2026-03-12 19:01:50.640556 | mon1 |
2026-03-12 19:01:50.640567 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-03-12 19:01:50.640622 | mon1 | Thursday 12 March 2026  19:01:50 +0000 (0:00:00.238)       0:00:21.303 ********
2026-03-12 19:01:50.712291 | mon1 | ok: [mon1] => {
2026-03-12 19:01:50.712617 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-03-12 19:01:50.712866 | mon1 | }
2026-03-12 19:01:50.713100 | mon1 |
2026-03-12 19:01:50.713427 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-03-12 19:01:50.713887 | mon1 | Thursday 12 March 2026  19:01:50 +0000 (0:00:00.072)       0:00:21.375 ********
2026-03-12 19:01:51.762891 | mon1 | changed: [mon1]
2026-03-12 19:01:51.763099 | mon1 |
2026-03-12 19:01:51.763412 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-03-12 19:01:51.763685 | mon1 | Thursday 12 March 2026  19:01:51 +0000 (0:00:01.050)       0:00:22.426 ********
2026-03-12 19:01:56.304427 | mon1 | changed: [mon1]
2026-03-12 19:01:56.304494 | mon1 |
2026-03-12 19:01:56.304635 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-03-12 19:01:56.304885 | mon1 | Thursday 12 March 2026  19:01:56 +0000 (0:00:04.541)       0:00:26.967 ********
2026-03-12 19:01:57.225139 | mon1 | ok: [mon1]
2026-03-12 19:01:57.225358 | mon1 |
2026-03-12 19:01:57.225638 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-03-12 19:01:57.225887 | mon1 | Thursday 12 March 2026  19:01:57 +0000 (0:00:00.920)       0:00:27.888 ********
2026-03-12 19:01:57.614445 | mon1 | changed: [mon1]
2026-03-12 19:01:57.614532 | mon1 |
2026-03-12 19:01:57.614906 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-03-12 19:01:57.614950 | mon1 | Thursday 12 March 2026  19:01:57 +0000 (0:00:00.389)       0:00:28.277 ********
2026-03-12 19:01:58.167378 | mon1 | changed: [mon1]
2026-03-12 19:01:58.167414 | mon1 |
2026-03-12 19:01:58.167422 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-03-12 19:01:58.167429 | mon1 | Thursday 12 March 2026  19:01:58 +0000 (0:00:00.552)       0:00:28.830 ********
2026-03-12 19:01:58.841802 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-03-12 19:01:58.842372 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-03-12 19:01:58.842391 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-03-12 19:01:58.842398 | mon1 |
2026-03-12 19:01:58.842404 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-03-12 19:01:58.842410 | mon1 | Thursday 12 March 2026  19:01:58 +0000 (0:00:00.674)       0:00:29.504 ********
2026-03-12 19:01:59.426413 | mon1 | changed: [mon1]
2026-03-12 19:01:59.426478 | mon1 |
2026-03-12 19:01:59.426951 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-03-12 19:01:59.427008 | mon1 | Thursday 12 March 2026  19:01:59 +0000 (0:00:00.583)       0:00:30.088 ********
2026-03-12 19:02:00.010767 | mon1 | changed: [mon1]
2026-03-12 19:02:00.010841 | mon1 |
2026-03-12 19:02:00.011398 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-03-12 19:02:00.011436 | mon1 | Thursday 12 March 2026  19:01:59 +0000 (0:00:00.577)       0:00:30.665 ********
2026-03-12 19:02:00.011443 | mon1 |
2026-03-12 19:02:00.011449 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-03-12 19:02:00.011454 | mon1 | Thursday 12 March 2026  19:02:00 +0000 (0:00:00.007)       0:00:30.673 ********
2026-03-12 19:02:00.871824 | mon1 | ok: [mon1]
2026-03-12 19:02:00.875352 | mon1 |
2026-03-12 19:02:00.875381 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-03-12 19:02:00.875392 | mon1 | Thursday 12 March 2026  19:02:00 +0000 (0:00:00.861)       0:00:31.534 ********
2026-03-12 19:02:02.184054 | mon1 | changed: [mon1]
2026-03-12 19:02:02.184474 | mon1 |
2026-03-12 19:02:02.184858 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-03-12 19:02:02.185192 | mon1 | Thursday 12 March 2026  19:02:02 +0000 (0:00:01.312)       0:00:32.847 ********
2026-03-12 19:02:02.861762 | mon1 | changed: [mon1]
2026-03-12 19:02:02.861824 | mon1 |
2026-03-12 19:02:02.862039 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-03-12 19:02:02.862069 | mon1 | Thursday 12 March 2026  19:02:02 +0000 (0:00:00.677)       0:00:33.524 ********
2026-03-12 19:02:02.920895 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-03-12 19:02:02.920932 | mon1 |
2026-03-12 19:02:02.920946 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-03-12 19:02:02.920958 | mon1 | Thursday 12 March 2026  19:02:02 +0000 (0:00:00.058)       0:00:33.583 ********
2026-03-12 19:02:21.615480 | mon1 | changed: [mon1]
2026-03-12 19:02:21.615588 | mon1 |
2026-03-12 19:02:21.615619 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-03-12 19:02:21.615633 | mon1 | Thursday 12 March 2026  19:02:21 +0000 (0:00:18.693)       0:00:52.276 ********
2026-03-12 19:02:22.415744 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-03-12 19:02:22.415811 | mon1 | ok: [mon1] => (item=ssh)
2026-03-12 19:02:22.416151 | mon1 |
2026-03-12 19:02:22.416203 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-03-12 19:02:22.416210 | mon1 | Thursday 12 March 2026  19:02:22 +0000 (0:00:00.802)       0:00:53.078 ********
2026-03-12 19:02:22.783622 | mon1 | fatal: [mon1]: FAILED! => {"changed": false, "dest": "/usr/bin/cephadm", "elapsed": 0, "msg": "Request failed", "response": "HTTP Error 404: Not Found", "status_code": 404, "url": "https://download.ceph.com/rpm-18.2.8/el9/noarch/cephadm"}
2026-03-12 19:02:22.787430 | mon1 |
2026-03-12 19:02:22.787496 | mon1 | PLAY RECAP *********************************************************************
2026-03-12 19:02:22.787707 | mon1 | mon1                       : ok=33   changed=20   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
2026-03-12 19:02:22.787928 | mon1 |
2026-03-12 19:02:22.788148 | mon1 |
2026-03-12 19:02:22.788415 | mon1 | TASKS RECAP ********************************************************************
2026-03-12 19:02:22.788706 | mon1 | Thursday 12 March 2026  19:02:22 +0000 (0:00:00.370)       0:00:53.449 ********
2026-03-12 19:02:22.788922 | mon1 | ===============================================================================
2026-03-12 19:02:22.789167 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.69s
2026-03-12 19:02:22.789516 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.62s
2026-03-12 19:02:22.789760 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.54s
2026-03-12 19:02:22.790001 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s
2026-03-12 19:02:22.790185 | mon1 | vexxhost.containers.containerd : Reload systemd ------------------------- 1.94s
2026-03-12 19:02:22.790343 | mon1 | vexxhost.containers.docker : Restart docker ----------------------------- 1.31s
2026-03-12 19:02:22.790496 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 1.12s
2026-03-12 19:02:22.790648 | mon1 | Gathering Facts --------------------------------------------------------- 1.10s
2026-03-12 19:02:22.790798 | mon1 | vexxhost.containers.containerd : Create folders for configuration ------- 1.06s
2026-03-12 19:02:22.790946 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 1.05s
2026-03-12 19:02:22.791096 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 1.04s
2026-03-12 19:02:22.791246 | mon1 | vexxhost.containers.docker : Install AppArmor packages ------------------ 0.92s
2026-03-12 19:02:22.791421 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 0.80s
2026-03-12 19:02:22.791570 | mon1 | vexxhost.containers.download_artifact : Download item ------------------- 0.80s
2026-03-12 19:02:22.791727 | mon1 | vexxhost.containers.docker : Enable and start service ------------------- 0.68s
2026-03-12 19:02:22.791877 | mon1 | vexxhost.containers.containerd : Create containerd config file ---------- 0.67s
2026-03-12 19:02:22.792027 | mon1 | vexxhost.containers.docker : Create folders for configuration ----------- 0.67s
2026-03-12 19:02:22.792176 | mon1 | vexxhost.containers.containerd : Enable and start service --------------- 0.66s
2026-03-12 19:02:22.792368 | mon1 | vexxhost.containers.containerd : Create systemd service file for containerd --- 0.65s
2026-03-12 19:02:22.792522 | mon1 | vexxhost.containers.docker : Create systemd socket file for docker ------ 0.58s
2026-03-12 19:02:22.914733 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-12 19:02:22.914862 | mon1 | ERROR    [default > converge] Executed: Failed
2026-03-12 19:02:22.915033 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-03-12 19:02:33.512288 | mon1 | ERROR
2026-03-12 19:02:33.512462 | mon1 | {
2026-03-12 19:02:33.512492 | mon1 |   "delta": "0:02:25.131788",
2026-03-12 19:02:33.512513 | mon1 |   "end": "2026-03-12 19:02:22.986496",
2026-03-12 19:02:33.512532 | mon1 |   "msg": "non-zero return code",
2026-03-12 19:02:33.512551 | mon1 |   "rc": 2,
2026-03-12 19:02:33.512572 | mon1 |   "start": "2026-03-12 18:59:57.854708"
2026-03-12 19:02:33.512590 | mon1 | }
failure
2026-03-12 19:02:33.516577 | 
2026-03-12 19:02:33.516670 | PLAY RECAP
2026-03-12 19:02:33.516715 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-03-12 19:02:33.516737 | 
2026-03-12 19:02:33.599723 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-03-12 19:02:33.604879 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-12 19:02:34.166279 | 
2026-03-12 19:02:34.166391 | PLAY [all]
2026-03-12 19:02:34.178267 | 
2026-03-12 19:02:34.178342 | TASK [fetch-output : Set log path for multiple nodes]
2026-03-12 19:02:34.228341 | mon1 | ok
2026-03-12 19:02:34.233975 | osd1 | ok
2026-03-12 19:02:34.239003 | 
2026-03-12 19:02:34.239075 | TASK [fetch-output : Set log path for single node]
2026-03-12 19:02:34.261592 | mon1 | skipping: Conditional result was False
2026-03-12 19:02:34.272502 | osd1 | skipping: Conditional result was False
2026-03-12 19:02:34.284052 | 
2026-03-12 19:02:34.284117 | LOOP [fetch-output : Ensure local output dirs]
2026-03-12 19:02:34.627595 | osd1 -> localhost | changed: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/logs/osd1"
2026-03-12 19:02:34.633895 | mon1 -> localhost | changed: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/logs/mon1"
2026-03-12 19:02:34.826979 | mon1 -> localhost | changed: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/artifacts"
2026-03-12 19:02:34.829294 | osd1 -> localhost | ok: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/artifacts"
2026-03-12 19:02:35.078693 | mon1 -> localhost | changed: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/docs"
2026-03-12 19:02:35.079803 | osd1 -> localhost | ok: "/var/lib/zuul/builds/883c9270bba247a689cecfedbfdf3caf/work/docs"
2026-03-12 19:02:35.097404 | 
2026-03-12 19:02:35.097528 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-03-12 19:02:35.719567 | mon1 | changed: .d..t...... ./
2026-03-12 19:02:35.719793 | mon1 | changed: All items complete
2026-03-12 19:02:35.719829 | 
2026-03-12 19:02:35.725140 | osd1 | changed: .d..t...... ./
2026-03-12 19:02:36.183458 | osd1 | changed: .d..t...... ./
2026-03-12 19:02:36.188099 | mon1 | ok
2026-03-12 19:02:36.672495 | mon1 | changed: .d..t...... ./
2026-03-12 19:02:36.681148 | osd1 | ok
2026-03-12 19:02:36.704400 | 
2026-03-12 19:02:36.704595 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-03-12 19:02:37.110986 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007776
2026-03-12 19:02:37.111299 | mon1 -> localhost | changed: All items complete
2026-03-12 19:02:37.111346 | 
2026-03-12 19:02:37.333611 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007975
2026-03-12 19:02:37.360116 | 
2026-03-12 19:02:37.360271 | PLAY [all]
2026-03-12 19:02:37.367115 | 
2026-03-12 19:02:37.367186 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-03-12 19:02:37.945319 | mon1 | changed
2026-03-12 19:02:38.058546 | osd1 | changed
2026-03-12 19:02:38.069924 | 
2026-03-12 19:02:38.069979 | PLAY RECAP
2026-03-12 19:02:38.070026 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-12 19:02:38.070056 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-03-12 19:02:38.070076 | 
2026-03-12 19:02:38.211607 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-03-12 19:02:38.217264 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-03-12 19:02:38.766855 | 
2026-03-12 19:02:38.766974 | PLAY [localhost]
2026-03-12 19:02:38.776581 | 
2026-03-12 19:02:38.776652 | TASK [Generate Zuul manifest]
2026-03-12 19:02:38.796244 | localhost | ok
2026-03-12 19:02:38.812827 | 
2026-03-12 19:02:38.812905 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-03-12 19:02:39.119185 | localhost | changed
2026-03-12 19:02:39.130661 | 
2026-03-12 19:02:39.130752 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-03-12 19:02:39.161867 | localhost | ok
2026-03-12 19:02:39.169961 | 
2026-03-12 19:02:39.170035 | TASK [Upload logs]
2026-03-12 19:02:39.191570 | localhost | ok
2026-03-12 19:02:39.248439 | 
2026-03-12 19:02:39.248560 | TASK [Set zuul-log-path fact]
2026-03-12 19:02:39.270325 | localhost | ok
2026-03-12 19:02:39.282837 | 
2026-03-12 19:02:39.282929 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-03-12 19:02:39.312571 | localhost | ok
2026-03-12 19:02:39.320443 | 
2026-03-12 19:02:39.320535 | TASK [upload-logs : Create log directories]
2026-03-12 19:02:39.687174 | localhost | changed
2026-03-12 19:02:39.692241 | 
2026-03-12 19:02:39.692305 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-03-12 19:02:40.055485 | localhost -> localhost | ok: Runtime: 0:00:00.004601
2026-03-12 19:02:40.060948 | 
2026-03-12 19:02:40.061028 | TASK [upload-logs : Upload logs to log server]
2026-03-12 19:02:40.508308 | localhost | Output suppressed because no_log was given
2026-03-12 19:02:40.513280 | 
2026-03-12 19:02:40.513371 | LOOP [upload-logs : Compress console log and json output]
2026-03-12 19:02:40.556289 | localhost | skipping: Conditional result was False
2026-03-12 19:02:40.563554 | localhost | skipping: Conditional result was False
2026-03-12 19:02:40.575962 | 
2026-03-12 19:02:40.576127 | LOOP [upload-logs : Upload compressed console log and json output]
2026-03-12 19:02:40.615675 | localhost | skipping: Conditional result was False
2026-03-12 19:02:40.616055 | 
2026-03-12 19:02:40.619824 | localhost | skipping: Conditional result was False
2026-03-12 19:02:40.629943 | 
2026-03-12 19:02:40.630147 | LOOP [upload-logs : Upload console log and json output]