2026-04-22 09:22:51.847518 | Job console starting 2026-04-22 09:22:51.855529 | Updating git repos 2026-04-22 09:22:51.884620 | Cloning repos into workspace 2026-04-22 09:22:51.925702 | Restoring repo states 2026-04-22 09:22:51.931525 | Merging changes 2026-04-22 09:22:52.382173 | Checking out repos 2026-04-22 09:22:52.413810 | Preparing playbooks 2026-04-22 09:22:53.613615 | Running Ansible setup 2026-04-22 09:22:57.303454 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-22 09:22:57.935572 | 2026-04-22 09:22:57.935720 | PLAY [localhost] 2026-04-22 09:22:57.943130 | 2026-04-22 09:22:57.943199 | TASK [Gathering Facts] 2026-04-22 09:22:58.832792 | localhost | ok 2026-04-22 09:22:58.843723 | 2026-04-22 09:22:58.843834 | TASK [Setup log path fact] 2026-04-22 09:22:58.861344 | localhost | ok 2026-04-22 09:22:58.871228 | 2026-04-22 09:22:58.871308 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-22 09:22:58.899680 | localhost | ok 2026-04-22 09:22:58.906556 | 2026-04-22 09:22:58.906620 | TASK [emit-job-header : Print job information] 2026-04-22 09:22:58.945654 | # Job Information 2026-04-22 09:22:58.945890 | Ansible Version: 2.16.16 2026-04-22 09:22:58.945963 | Job: ansible-collection-ceph-molecule-aio-ubuntu-jammy 2026-04-22 09:22:58.946014 | Pipeline: check 2026-04-22 09:22:58.946060 | Executor: 0a8996d2b663 2026-04-22 09:22:58.946104 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/105 2026-04-22 09:22:58.946155 | Event ID: bbfeff10-3e2c-11f1-86f2-b239997f8a66 2026-04-22 09:22:58.951635 | 2026-04-22 09:22:58.951704 | LOOP [emit-job-header : Print node information] 2026-04-22 09:22:59.043323 | localhost | ok: 2026-04-22 09:22:59.043504 | localhost | # Node Information 2026-04-22 09:22:59.043532 | localhost | Inventory Hostname: aio 2026-04-22 09:22:59.043554 | localhost | Hostname: np0000169230 2026-04-22 09:22:59.043574 | localhost | Username: zuul 2026-04-22 09:22:59.043596 | localhost | Distro: Ubuntu 22.04 2026-04-22 09:22:59.043616 | localhost | Provider: yul1 2026-04-22 09:22:59.043635 | localhost | Region: ca-ymq-1 2026-04-22 09:22:59.043652 | localhost | Label: ubuntu-jammy 2026-04-22 09:22:59.043671 | localhost | Product Name: OpenStack Nova 2026-04-22 09:22:59.043690 | localhost | Interface IP: 199.19.213.163 2026-04-22 09:22:59.055030 | 2026-04-22 09:22:59.055190 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-04-22 09:22:59.459468 | localhost -> localhost | changed 2026-04-22 09:22:59.464458 | 2026-04-22 09:22:59.464527 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-04-22 09:23:00.404204 | localhost -> localhost | changed 2026-04-22 09:23:00.411090 | 2026-04-22 09:23:00.411142 | PLAY [all] 2026-04-22 09:23:00.418666 | 2026-04-22 09:23:00.418733 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-04-22 09:23:00.676663 | aio -> localhost | ok 2026-04-22 09:23:00.683124 | 2026-04-22 09:23:00.683184 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-04-22 09:23:00.711696 | aio | ok 2026-04-22 09:23:00.724676 | aio | included: /var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-04-22 09:23:00.730043 | 2026-04-22 09:23:00.730100 | TASK [add-build-sshkey : Create Temp SSH key] 2026-04-22 09:23:02.221710 | aio -> localhost | Generating public/private rsa key pair. 2026-04-22 09:23:02.221923 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/0ac57b87e22c413aa4631d4597c559c4_id_rsa 2026-04-22 09:23:02.221966 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/0ac57b87e22c413aa4631d4597c559c4_id_rsa.pub 2026-04-22 09:23:02.222043 | aio -> localhost | The key fingerprint is: 2026-04-22 09:23:02.222075 | aio -> localhost | SHA256:gNg9bMD8Zix8t8P4TTOoR6SnlhPvvygP2OonJ4iYaI4 zuul-build-sshkey 2026-04-22 09:23:02.222122 | aio -> localhost | The key's randomart image is: 2026-04-22 09:23:02.222153 | aio -> localhost | +---[RSA 3072]----+ 2026-04-22 09:23:02.222189 | aio -> localhost | | o. | 2026-04-22 09:23:02.222219 | aio -> localhost | | oo= | 2026-04-22 09:23:02.222247 | aio -> localhost | | ..oo* | 2026-04-22 09:23:02.222278 | aio -> localhost | | o.*oo | 2026-04-22 09:23:02.222311 | aio -> localhost | | = *So | 2026-04-22 09:23:02.222339 | aio -> localhost | | o+ B + | 2026-04-22 09:23:02.222367 | aio -> localhost | |oo .. oX + o | 2026-04-22 09:23:02.222395 | aio -> localhost | |*.. o.X.+.. | 2026-04-22 09:23:02.222427 | aio -> localhost | |E. .o* *+.o. | 2026-04-22 09:23:02.222456 | aio -> localhost | +----[SHA256]-----+ 2026-04-22 09:23:02.222525 | aio -> localhost | ok: Runtime: 0:00:01.055422 2026-04-22 09:23:02.230549 | 2026-04-22 09:23:02.230640 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-04-22 09:23:02.268918 | aio | ok 2026-04-22 09:23:02.285484 | aio | included: /var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-04-22 09:23:02.296371 | 2026-04-22 09:23:02.296469 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-04-22 09:23:02.321770 | aio | skipping: Conditional result was False 2026-04-22 09:23:02.331577 | 2026-04-22 09:23:02.331779 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-04-22 09:23:02.762458 | aio | changed 2026-04-22 09:23:02.767821 | 2026-04-22 09:23:02.767887 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-04-22 09:23:02.997882 | aio | ok 2026-04-22 09:23:03.004251 | 2026-04-22 09:23:03.004317 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-04-22 09:23:03.478164 | aio | changed 2026-04-22 09:23:03.490733 | 2026-04-22 09:23:03.490921 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-04-22 09:23:03.935451 | aio | changed 2026-04-22 09:23:03.940925 | 2026-04-22 09:23:03.940995 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-04-22 09:23:03.954552 | aio | skipping: Conditional result was False 2026-04-22 09:23:03.963604 | 2026-04-22 09:23:03.963708 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-04-22 09:23:04.331124 | aio -> localhost | changed 2026-04-22 09:23:04.343896 | 2026-04-22 09:23:04.344057 | TASK [add-build-sshkey : Add back temp key] 2026-04-22 09:23:04.606153 | aio -> localhost | Identity added: /var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/0ac57b87e22c413aa4631d4597c559c4_id_rsa (zuul-build-sshkey) 2026-04-22 09:23:04.606456 | aio -> localhost | ok: Runtime: 0:00:00.012128 2026-04-22 09:23:04.613748 | 2026-04-22 09:23:04.613838 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-04-22 09:23:04.971901 | aio | ok 2026-04-22 09:23:04.981233 | 2026-04-22 09:23:04.981312 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-04-22 09:23:05.027113 | aio | skipping: Conditional result was False 2026-04-22 09:23:05.040756 | 2026-04-22 09:23:05.041049 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-04-22 09:23:05.393615 | aio | ok 2026-04-22 09:23:05.399315 | 2026-04-22 09:23:05.399380 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-04-22 09:23:06.138021 | aio | Output suppressed because no_log was given 2026-04-22 09:23:06.148181 | 2026-04-22 09:23:06.148247 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-04-22 09:23:06.334452 | aio | ok: "logs" 2026-04-22 09:23:06.334802 | aio | ok: All items complete 2026-04-22 09:23:06.334843 | 2026-04-22 09:23:06.484623 | aio | ok: "artifacts" 2026-04-22 09:23:06.639493 | aio | ok: "docs" 2026-04-22 09:23:06.655543 | 2026-04-22 09:23:06.655704 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-04-22 09:23:06.880205 | aio | changed: "logs" 2026-04-22 09:23:06.986662 | aio | changed: "artifacts" 2026-04-22 09:23:07.139698 | aio | changed: "docs" 2026-04-22 09:23:07.504162 | 2026-04-22 09:23:07.504277 | PLAY RECAP 2026-04-22 09:23:07.504328 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-04-22 09:23:07.504357 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-22 09:23:07.504378 | 2026-04-22 09:23:07.616336 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-04-22 09:23:07.618675 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-22 09:23:08.180501 | 2026-04-22 09:23:08.180629 | PLAY [all] 2026-04-22 09:23:08.191737 | 2026-04-22 09:23:08.191843 | TASK [setup-uv : Extract archive] 2026-04-22 09:23:10.483829 | aio | changed 2026-04-22 09:23:10.491751 | 2026-04-22 09:23:10.491835 | TASK [setup-uv : Print version] 2026-04-22 09:23:10.262503 | aio | uv 0.8.13 2026-04-22 09:23:11.028762 | aio | ok: Runtime: 0:00:00.010148 2026-04-22 09:23:11.036873 | 2026-04-22 09:23:11.037038 | PLAY RECAP 2026-04-22 09:23:11.037093 | aio | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-22 09:23:11.037125 | 2026-04-22 09:23:11.150437 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-04-22 09:23:11.153818 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-22 09:23:11.748611 | 2026-04-22 09:23:11.748769 | PLAY [all] 2026-04-22 09:23:11.760407 | 2026-04-22 09:23:11.760480 | TASK [Copy inventory file for Zuul] 2026-04-22 09:23:12.587426 | aio | changed 2026-04-22 09:23:12.594146 | 2026-04-22 09:23:12.594223 | TASK [Switch "ansible_host" to private IP] 2026-04-22 09:23:12.853094 | aio | changed: 1 replacements made 2026-04-22 09:23:12.860530 | 2026-04-22 09:23:12.860600 | TASK [Run Molecule scenario] 2026-04-22 09:23:13.073974 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB) 2026-04-22 09:23:14.454655 | aio | Downloading cpython-3.13.7-linux-x86_64-gnu (download) 2026-04-22 09:23:15.557293 | aio | Using CPython 3.13.7 2026-04-22 09:23:15.557374 | aio | Creating virtual environment at: .venv 2026-04-22 09:23:16.012054 | aio | Downloading pygments (1.2MiB) 2026-04-22 09:23:16.012168 | aio | Downloading netaddr (2.2MiB) 2026-04-22 09:23:16.012338 | aio | Downloading cryptography (4.3MiB) 2026-04-22 09:23:16.018527 | aio | Downloading ansible-core (2.3MiB) 2026-04-22 09:23:16.197440 | aio | Downloading netaddr 2026-04-22 09:23:16.209313 | aio | Downloading cryptography 2026-04-22 09:23:16.259132 | aio | Downloading pygments 2026-04-22 09:23:16.414065 | aio | Downloading ansible-core 2026-04-22 09:23:16.699734 | aio | Installed 36 packages in 285ms 2026-04-22 09:23:17.784214 | aio | INFO Collection 'vexxhost.ceph' detected. 2026-04-22 09:23:17.784306 | aio | INFO Scenarios will be used from 'extensions/molecule' 2026-04-22 09:23:18.746742 | aio | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-04-22 09:23:18.746815 | aio | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-04-22 09:23:32.518573 | aio | INFO [default > dependency] Executing 2026-04-22 09:23:32.518824 | aio | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-04-22 09:23:32.519089 | aio | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-04-22 09:23:32.519230 | aio | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-04-22 09:23:32.524431 | aio | INFO [default > cleanup] Executing 2026-04-22 09:23:32.524713 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-22 09:23:32.529655 | aio | INFO [default > destroy] Executing 2026-04-22 09:23:32.529716 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-22 09:23:32.529787 | aio | INFO [default > destroy] Executed: Successful 2026-04-22 09:23:32.534700 | aio | INFO [default > syntax] Executing 2026-04-22 09:23:33.676050 | aio | 2026-04-22 09:23:33.676390 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-04-22 09:23:33.765637 | aio | INFO [default > syntax] Executed: Successful 2026-04-22 09:23:33.775431 | aio | INFO [default > create] Executing 2026-04-22 09:23:33.776920 | aio | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-22 09:23:33.781807 | aio | INFO [default > prepare] Executing 2026-04-22 09:23:34.641738 | aio | 2026-04-22 09:23:34.641979 | aio | PLAY [Prepare] ***************************************************************** 2026-04-22 09:23:34.642184 | aio | 2026-04-22 09:23:34.642416 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:23:34.642666 | aio | Wednesday 22 April 2026 09:23:34 +0000 (0:00:00.033) 0:00:00.033 ******* 2026-04-22 09:23:35.858326 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-04-22 09:23:35.863744 | aio | ok: [aio] 2026-04-22 09:23:35.864006 | aio | 2026-04-22 09:23:35.864234 | aio | TASK [Configure short hostname] ************************************************ 2026-04-22 09:23:35.864461 | aio | Wednesday 22 April 2026 09:23:35 +0000 (0:00:01.223) 0:00:01.257 ******* 2026-04-22 09:23:36.673552 | aio | changed: [aio] 2026-04-22 09:23:36.673767 | aio | 2026-04-22 09:23:36.674037 | aio | TASK [Ensure hostname inside hosts file] *************************************** 2026-04-22 09:23:36.674305 | aio | Wednesday 22 April 2026 09:23:36 +0000 (0:00:00.808) 0:00:02.066 ******* 2026-04-22 09:23:37.026744 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2026-04-22 09:23:37.031522 | aio | changed: [aio] 2026-04-22 09:23:37.031762 | aio | 2026-04-22 09:23:37.032001 | aio | TASK [Update apt cache] ******************************************************** 2026-04-22 09:23:37.032264 | aio | Wednesday 22 April 2026 09:23:37 +0000 (0:00:00.358) 0:00:02.424 ******* 2026-04-22 09:23:45.179247 | aio | changed: [aio] 2026-04-22 09:23:45.179546 | aio | 2026-04-22 09:23:45.179561 | aio | PLAY [Create devices for Ceph] ************************************************* 2026-04-22 09:23:45.179572 | aio | 2026-04-22 09:23:45.179581 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:23:45.179628 | aio | Wednesday 22 April 2026 09:23:45 +0000 (0:00:08.147) 0:00:10.572 ******* 2026-04-22 09:23:45.969066 | aio | ok: [aio] 2026-04-22 09:23:45.969184 | aio | 2026-04-22 09:23:45.969335 | aio | TASK [Install depedencies] ***************************************************** 2026-04-22 09:23:45.969491 | aio | Wednesday 22 April 2026 09:23:45 +0000 (0:00:00.789) 0:00:11.362 ******* 2026-04-22 09:24:09.818493 | aio | changed: [aio] 2026-04-22 09:24:09.818665 | aio | 2026-04-22 09:24:09.818890 | aio | TASK [Start up service] ******************************************************** 2026-04-22 09:24:09.819154 | aio | Wednesday 22 April 2026 09:24:09 +0000 (0:00:23.849) 0:00:35.211 ******* 2026-04-22 09:24:10.482517 | aio | ok: [aio] 2026-04-22 09:24:10.482657 | aio | 2026-04-22 09:24:10.482895 | aio | TASK [Generate lvm.conf] ******************************************************* 2026-04-22 09:24:10.483100 | aio | Wednesday 22 April 2026 09:24:10 +0000 (0:00:00.664) 0:00:35.875 ******* 2026-04-22 09:24:10.869738 | aio | ok: [aio] 2026-04-22 09:24:10.869815 | aio | 2026-04-22 09:24:10.869949 | aio | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-04-22 09:24:10.870080 | aio | Wednesday 22 April 2026 09:24:10 +0000 (0:00:00.387) 0:00:36.262 ******* 2026-04-22 09:24:11.710607 | aio | changed: [aio] 2026-04-22 09:24:11.710801 | aio | 2026-04-22 09:24:11.711040 | aio | TASK [Get list of all loopback devices] **************************************** 2026-04-22 09:24:11.711291 | aio | Wednesday 22 April 2026 09:24:11 +0000 (0:00:00.840) 0:00:37.103 ******* 2026-04-22 09:24:11.963058 | aio | ok: [aio] 2026-04-22 09:24:11.963250 | aio | 2026-04-22 09:24:11.963497 | aio | TASK [Fail if there is any existing loopback devices] ************************** 2026-04-22 09:24:11.963730 | aio | Wednesday 22 April 2026 09:24:11 +0000 (0:00:00.252) 0:00:37.355 ******* 2026-04-22 09:24:11.986149 | aio | skipping: [aio] 2026-04-22 09:24:11.986381 | aio | 2026-04-22 09:24:11.986619 | aio | TASK [Create devices for Ceph] ************************************************* 2026-04-22 09:24:11.986855 | aio | Wednesday 22 April 2026 09:24:11 +0000 (0:00:00.022) 0:00:37.378 ******* 2026-04-22 09:24:12.699021 | aio | changed: [aio] => (item=osd0) 2026-04-22 09:24:12.699224 | aio | changed: [aio] => (item=osd1) 2026-04-22 09:24:12.699471 | aio | changed: [aio] => (item=osd2) 2026-04-22 09:24:12.699684 | aio | 2026-04-22 09:24:12.699932 | aio | TASK [Set permissions on loopback devices] ************************************* 2026-04-22 09:24:12.700161 | aio | Wednesday 22 April 2026 09:24:12 +0000 (0:00:00.712) 0:00:38.091 ******* 2026-04-22 09:24:13.532259 | aio | changed: [aio] => (item=osd0) 2026-04-22 09:24:13.532456 | aio | changed: [aio] => (item=osd1) 2026-04-22 09:24:13.532607 | aio | changed: [aio] => (item=osd2) 2026-04-22 09:24:13.532839 | aio | 2026-04-22 09:24:13.532943 | aio | TASK [Start loop devices] ****************************************************** 2026-04-22 09:24:13.533087 | aio | Wednesday 22 April 2026 09:24:13 +0000 (0:00:00.833) 0:00:38.925 ******* 2026-04-22 09:24:14.466728 | aio | changed: [aio] => (item=osd0) 2026-04-22 09:24:14.466791 | aio | changed: [aio] => (item=osd1) 2026-04-22 09:24:14.466905 | aio | changed: [aio] => (item=osd2) 2026-04-22 09:24:14.466985 | aio | 2026-04-22 09:24:14.467086 | aio | TASK [Create a volume group for each loop device] ****************************** 2026-04-22 09:24:14.467190 | aio | Wednesday 22 April 2026 09:24:14 +0000 (0:00:00.934) 0:00:39.859 ******* 2026-04-22 09:24:17.595138 | aio | changed: [aio] => (item=osd0) 2026-04-22 09:24:17.595325 | aio | changed: [aio] => (item=osd1) 2026-04-22 09:24:17.595532 | aio | changed: [aio] => (item=osd2) 2026-04-22 09:24:17.595716 | aio | 2026-04-22 09:24:17.595930 | aio | TASK [Create a logical volume for each loop device] **************************** 2026-04-22 09:24:17.596124 | aio | Wednesday 22 April 2026 09:24:17 +0000 (0:00:03.128) 0:00:42.988 ******* 2026-04-22 09:24:19.686435 | aio | changed: [aio] => (item=ceph-aio-osd0) 2026-04-22 09:24:19.686647 | aio | changed: [aio] => (item=ceph-aio-osd1) 2026-04-22 09:24:19.686873 | aio | changed: [aio] => (item=ceph-aio-osd2) 2026-04-22 09:24:19.687077 | aio | 2026-04-22 09:24:19.687333 | aio | PLAY RECAP ********************************************************************* 2026-04-22 09:24:19.687629 | aio | aio : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-04-22 09:24:19.687883 | aio | 2026-04-22 09:24:19.688094 | aio | 2026-04-22 09:24:19.688292 | aio | TASKS RECAP ******************************************************************** 2026-04-22 09:24:19.688493 | aio | Wednesday 22 April 2026 09:24:19 +0000 (0:00:02.091) 0:00:45.079 ******* 2026-04-22 09:24:19.688680 | aio | =============================================================================== 2026-04-22 09:24:19.688904 | aio | Install depedencies ---------------------------------------------------- 23.85s 2026-04-22 09:24:19.689102 | aio | Update apt cache -------------------------------------------------------- 8.15s 2026-04-22 09:24:19.689304 | aio | Create a volume group for each loop device ------------------------------ 3.13s 2026-04-22 09:24:19.689508 | aio | Create a logical volume for each loop device ---------------------------- 2.09s 2026-04-22 09:24:19.689771 | aio | Gathering Facts --------------------------------------------------------- 1.22s 2026-04-22 09:24:19.689976 | aio | Start loop devices ------------------------------------------------------ 0.93s 2026-04-22 09:24:19.690173 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.84s 2026-04-22 09:24:19.690412 | aio | Set permissions on loopback devices ------------------------------------- 0.83s 2026-04-22 09:24:19.690585 | aio | Configure short hostname ------------------------------------------------ 0.81s 2026-04-22 09:24:19.690738 | aio | Gathering Facts --------------------------------------------------------- 0.79s 2026-04-22 09:24:19.690868 | aio | Create devices for Ceph ------------------------------------------------- 0.71s 2026-04-22 09:24:19.691013 | aio | Start up service -------------------------------------------------------- 0.66s 2026-04-22 09:24:19.691182 | aio | Generate lvm.conf ------------------------------------------------------- 0.39s 2026-04-22 09:24:19.691356 | aio | Ensure hostname inside hosts file --------------------------------------- 0.36s 2026-04-22 09:24:19.691527 | aio | Get list of all loopback devices ---------------------------------------- 0.25s 2026-04-22 09:24:19.691665 | aio | Fail if there is any existing loopback devices -------------------------- 0.02s 2026-04-22 09:24:19.771561 | aio | INFO [default > prepare] Executed: Successful 2026-04-22 09:24:19.780709 | aio | INFO [default > converge] Executing 2026-04-22 09:24:20.888289 | aio | 2026-04-22 09:24:20.888446 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-22 09:24:20.888620 | aio | 2026-04-22 09:24:20.888863 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:24:20.889071 | aio | Wednesday 22 April 2026 09:24:20 +0000 (0:00:00.052) 0:00:00.052 ******* 2026-04-22 09:24:22.096948 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-04-22 09:24:22.107208 | aio | ok: [aio] 2026-04-22 09:24:22.107408 | aio | 2026-04-22 09:24:22.107635 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:24:22.107854 | aio | Wednesday 22 April 2026 09:24:22 +0000 (0:00:01.219) 0:00:01.271 ******* 2026-04-22 09:24:22.551095 | aio | ok: [aio] 2026-04-22 09:24:22.551279 | aio | 2026-04-22 09:24:22.551524 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:24:22.551763 | aio | Wednesday 22 April 2026 09:24:22 +0000 (0:00:00.443) 0:00:01.715 ******* 2026-04-22 09:24:22.589622 | aio | skipping: [aio] 2026-04-22 09:24:22.589801 | aio | 2026-04-22 09:24:22.590021 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-22 09:24:22.590242 | aio | Wednesday 22 April 2026 09:24:22 +0000 (0:00:00.038) 0:00:01.753 ******* 2026-04-22 09:24:23.023709 | aio | changed: [aio] 2026-04-22 09:24:23.023776 | aio | 2026-04-22 09:24:23.023865 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:24:23.023971 | aio | Wednesday 22 April 2026 09:24:23 +0000 (0:00:00.434) 0:00:02.187 ******* 2026-04-22 09:24:23.156079 | aio | ok: [aio] => { 2026-04-22 09:24:23.156278 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-22 09:24:23.156522 | aio | } 2026-04-22 09:24:23.156696 | aio | 2026-04-22 09:24:23.156963 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:24:23.157184 | aio | Wednesday 22 April 2026 09:24:23 +0000 (0:00:00.131) 0:00:02.319 ******* 2026-04-22 09:24:24.755309 | aio | changed: [aio] 2026-04-22 09:24:24.755376 | aio | 2026-04-22 09:24:24.755388 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:24:24.755399 | aio | Wednesday 22 April 2026 09:24:24 +0000 (0:00:01.598) 0:00:03.918 ******* 2026-04-22 09:24:24.790922 | aio | skipping: [aio] 2026-04-22 09:24:24.790962 | aio | 2026-04-22 09:24:24.791093 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:24:24.791268 | aio | Wednesday 22 April 2026 09:24:24 +0000 (0:00:00.036) 0:00:03.955 ******* 2026-04-22 09:24:24.829619 | aio | skipping: [aio] 2026-04-22 09:24:24.829696 | aio | 2026-04-22 09:24:24.829779 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:24:24.829970 | aio | Wednesday 22 April 2026 09:24:24 +0000 (0:00:00.038) 0:00:03.993 ******* 2026-04-22 09:24:25.083221 | aio | ok: [aio] 2026-04-22 09:24:25.083285 | aio | 2026-04-22 09:24:25.083393 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:24:25.083682 | aio | Wednesday 22 April 2026 09:24:25 +0000 (0:00:00.253) 0:00:04.247 ******* 2026-04-22 09:24:26.374020 | aio | ok: [aio] 2026-04-22 09:24:26.374066 | aio | 2026-04-22 09:24:26.374073 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:24:26.374077 | aio | Wednesday 22 April 2026 09:24:26 +0000 (0:00:01.290) 0:00:05.537 ******* 2026-04-22 09:24:26.453864 | aio | ok: [aio] => { 2026-04-22 09:24:26.453910 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-22 09:24:26.453915 | aio | } 2026-04-22 09:24:26.453920 | aio | 2026-04-22 09:24:26.453924 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:24:26.453929 | aio | Wednesday 22 April 2026 09:24:26 +0000 (0:00:00.079) 0:00:05.617 ******* 2026-04-22 09:24:27.229973 | aio | changed: [aio] 2026-04-22 09:24:27.230137 | aio | 2026-04-22 09:24:27.230150 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:24:27.230207 | aio | Wednesday 22 April 2026 09:24:27 +0000 (0:00:00.776) 0:00:06.394 ******* 2026-04-22 09:24:30.282997 | aio | changed: [aio] 2026-04-22 09:24:30.283073 | aio | 2026-04-22 09:24:30.283262 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-22 09:24:30.283312 | aio | Wednesday 22 April 2026 09:24:30 +0000 (0:00:03.052) 0:00:09.447 ******* 2026-04-22 09:24:30.313743 | aio | skipping: [aio] 2026-04-22 09:24:30.313808 | aio | 2026-04-22 09:24:30.313912 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-22 09:24:30.314039 | aio | Wednesday 22 April 2026 09:24:30 +0000 (0:00:00.030) 0:00:09.477 ******* 2026-04-22 09:24:30.341321 | aio | skipping: [aio] 2026-04-22 09:24:30.341400 | aio | 2026-04-22 09:24:30.341628 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-22 09:24:30.341679 | aio | Wednesday 22 April 2026 09:24:30 +0000 (0:00:00.027) 0:00:09.505 ******* 2026-04-22 09:24:30.366334 | aio | skipping: [aio] 2026-04-22 09:24:30.366430 | aio | 2026-04-22 09:24:30.366575 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-22 09:24:30.366737 | aio | Wednesday 22 April 2026 09:24:30 +0000 (0:00:00.024) 0:00:09.530 ******* 2026-04-22 09:24:36.046510 | aio | changed: [aio] 2026-04-22 09:24:36.046588 | aio | 2026-04-22 09:24:36.046793 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-22 09:24:36.046835 | aio | Wednesday 22 April 2026 09:24:36 +0000 (0:00:05.680) 0:00:15.210 ******* 2026-04-22 09:24:36.734803 | aio | changed: [aio] 2026-04-22 09:24:36.734877 | aio | 2026-04-22 09:24:36.734943 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-22 09:24:36.735110 | aio | Wednesday 22 April 2026 09:24:36 +0000 (0:00:00.687) 0:00:15.898 ******* 2026-04-22 09:24:37.894551 | aio | changed: [aio] => (item={'path': '/etc/containerd'}) 2026-04-22 09:24:37.894619 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-22 09:24:37.894695 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-22 09:24:37.895189 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-22 09:24:37.895233 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-22 09:24:37.895239 | aio | 2026-04-22 09:24:37.895244 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-22 09:24:37.895249 | aio | Wednesday 22 April 2026 09:24:37 +0000 (0:00:01.160) 0:00:17.058 ******* 2026-04-22 09:24:38.570333 | aio | changed: [aio] 2026-04-22 09:24:38.570576 | aio | 2026-04-22 09:24:38.570592 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-22 09:24:38.570602 | aio | Wednesday 22 April 2026 09:24:38 +0000 (0:00:00.668) 0:00:17.727 ******* 2026-04-22 09:24:38.570661 | aio | 2026-04-22 09:24:38.570862 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-22 09:24:38.570906 | aio | Wednesday 22 April 2026 09:24:38 +0000 (0:00:00.006) 0:00:17.734 ******* 2026-04-22 09:24:39.512751 | aio | ok: [aio] 2026-04-22 09:24:39.512864 | aio | 2026-04-22 09:24:39.513341 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-04-22 09:24:39.513389 | aio | Wednesday 22 April 2026 09:24:39 +0000 (0:00:00.942) 0:00:18.676 ******* 2026-04-22 09:24:39.986103 | aio | changed: [aio] 2026-04-22 09:24:39.986184 | aio | 2026-04-22 09:24:39.986409 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-22 09:24:39.986452 | aio | Wednesday 22 April 2026 09:24:39 +0000 (0:00:00.473) 0:00:19.150 ******* 2026-04-22 09:24:40.553423 | aio | changed: [aio] 2026-04-22 09:24:40.553498 | aio | 2026-04-22 09:24:40.553557 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:24:40.553673 | aio | Wednesday 22 April 2026 09:24:40 +0000 (0:00:00.567) 0:00:19.717 ******* 2026-04-22 09:24:40.813361 | aio | ok: [aio] 2026-04-22 09:24:40.813451 | aio | 2026-04-22 09:24:40.813513 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:24:40.813647 | aio | Wednesday 22 April 2026 09:24:40 +0000 (0:00:00.259) 0:00:19.977 ******* 2026-04-22 09:24:40.879927 | aio | ok: [aio] => { 2026-04-22 09:24:40.879989 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-22 09:24:40.880077 | aio | } 2026-04-22 09:24:40.880393 | aio | 2026-04-22 09:24:40.880440 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:24:40.880446 | aio | Wednesday 22 April 2026 09:24:40 +0000 (0:00:00.066) 0:00:20.043 ******* 2026-04-22 09:24:42.076386 | aio | changed: [aio] 2026-04-22 09:24:42.076457 | aio | 2026-04-22 09:24:42.076648 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:24:42.076694 | aio | Wednesday 22 April 2026 09:24:42 +0000 (0:00:01.196) 0:00:21.240 ******* 2026-04-22 09:24:46.480312 | aio | changed: [aio] 2026-04-22 09:24:46.480379 | aio | 2026-04-22 09:24:46.480548 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-22 09:24:46.480564 | aio | Wednesday 22 April 2026 09:24:46 +0000 (0:00:04.404) 0:00:25.644 ******* 2026-04-22 09:24:47.502928 | aio | ok: [aio] 2026-04-22 09:24:47.502992 | aio | 2026-04-22 09:24:47.503084 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-22 09:24:47.503186 | aio | Wednesday 22 April 2026 09:24:47 +0000 (0:00:01.022) 0:00:26.667 ******* 2026-04-22 09:24:47.900673 | aio | changed: [aio] 2026-04-22 09:24:47.900763 | aio | 2026-04-22 09:24:47.900977 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-22 09:24:47.901148 | aio | Wednesday 22 April 2026 09:24:47 +0000 (0:00:00.397) 0:00:27.064 ******* 2026-04-22 09:24:48.461413 | aio | changed: [aio] 2026-04-22 09:24:48.461565 | aio | 2026-04-22 09:24:48.461863 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-22 09:24:48.461921 | aio | Wednesday 22 April 2026 09:24:48 +0000 (0:00:00.560) 0:00:27.625 ******* 2026-04-22 09:24:49.163121 | aio | changed: [aio] => (item={'path': '/etc/docker'}) 2026-04-22 09:24:49.163196 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-22 09:24:49.163294 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-22 09:24:49.163613 | aio | 2026-04-22 09:24:49.163654 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-22 09:24:49.163660 | aio | Wednesday 22 April 2026 09:24:49 +0000 (0:00:00.702) 0:00:28.327 ******* 2026-04-22 09:24:49.706448 | aio | changed: [aio] 2026-04-22 09:24:49.706522 | aio | 2026-04-22 09:24:49.706787 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-22 09:24:49.706849 | aio | Wednesday 22 April 2026 09:24:49 +0000 (0:00:00.543) 0:00:28.870 ******* 2026-04-22 09:24:50.285677 | aio | changed: [aio] 2026-04-22 09:24:50.285742 | aio | 2026-04-22 09:24:50.285831 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-22 09:24:50.286263 | aio | Wednesday 22 April 2026 09:24:50 +0000 (0:00:00.572) 0:00:29.443 ******* 2026-04-22 09:24:50.286308 | aio | 2026-04-22 09:24:50.286314 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-04-22 09:24:50.286319 | aio | Wednesday 22 April 2026 09:24:50 +0000 (0:00:00.006) 0:00:29.449 ******* 2026-04-22 09:24:50.995794 | aio | ok: [aio] 2026-04-22 09:24:50.995909 | aio | 2026-04-22 09:24:50.996234 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-04-22 09:24:50.996253 | aio | Wednesday 22 April 2026 09:24:50 +0000 (0:00:00.709) 0:00:30.159 ******* 2026-04-22 09:24:53.728111 | aio | changed: [aio] 2026-04-22 09:24:53.728186 | aio | 2026-04-22 09:24:53.728443 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-22 09:24:53.728517 | aio | Wednesday 22 April 2026 09:24:53 +0000 (0:00:02.732) 0:00:32.891 ******* 2026-04-22 09:24:54.352099 | aio | changed: [aio] 2026-04-22 09:24:54.352212 | aio | 2026-04-22 09:24:54.352227 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-22 09:24:54.352292 | aio | Wednesday 22 April 2026 09:24:54 +0000 (0:00:00.624) 0:00:33.516 ******* 2026-04-22 09:24:54.404140 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-22 09:24:54.404267 | aio | 2026-04-22 09:24:54.404302 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] **** 2026-04-22 09:24:54.404364 | aio | Wednesday 22 April 2026 09:24:54 +0000 (0:00:00.051) 0:00:33.567 ******* 2026-04-22 09:24:54.437758 | aio | skipping: [aio] 2026-04-22 09:24:54.437846 | aio | 2026-04-22 09:24:54.437900 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-22 09:24:54.438062 | aio | Wednesday 22 April 2026 09:24:54 +0000 (0:00:00.033) 0:00:33.601 ******* 2026-04-22 09:24:59.336082 | aio | changed: [aio] 2026-04-22 09:24:59.336152 | aio | 2026-04-22 09:24:59.336398 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-22 09:24:59.336444 | aio | Wednesday 22 April 2026 09:24:59 +0000 (0:00:04.898) 0:00:38.499 ******* 2026-04-22 09:25:00.125273 | aio | ok: [aio] => (item=chronyd) 2026-04-22 09:25:00.125333 | aio | ok: [aio] => (item=sshd) 2026-04-22 09:25:00.125609 | aio | 2026-04-22 09:25:00.125626 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-22 09:25:00.125632 | aio | Wednesday 22 April 2026 09:25:00 +0000 (0:00:00.789) 0:00:39.289 ******* 2026-04-22 09:25:00.484952 | aio | changed: [aio] 2026-04-22 09:25:00.485014 | aio | 2026-04-22 09:25:00.485117 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-22 09:25:00.485251 | aio | Wednesday 22 April 2026 09:25:00 +0000 (0:00:00.359) 0:00:39.648 ******* 2026-04-22 09:25:00.735438 | aio | ok: [aio] 2026-04-22 09:25:00.735513 | aio | 2026-04-22 09:25:00.735587 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-22 09:25:00.735749 | aio | Wednesday 22 April 2026 09:25:00 +0000 (0:00:00.250) 0:00:39.899 ******* 2026-04-22 09:25:01.230639 | aio | changed: [aio] 2026-04-22 09:25:01.230714 | aio | 2026-04-22 09:25:01.230921 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-22 09:25:01.230964 | aio | Wednesday 22 April 2026 09:25:01 +0000 (0:00:00.495) 0:00:40.394 ******* 2026-04-22 09:25:01.615575 | aio | changed: [aio] 2026-04-22 09:25:01.615713 | aio | 2026-04-22 09:25:01.615726 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-22 09:25:01.615737 | aio | Wednesday 22 April 2026 09:25:01 +0000 (0:00:00.384) 0:00:40.779 ******* 2026-04-22 09:25:01.808558 | aio | ok: [aio] 2026-04-22 09:25:01.808690 | aio | 2026-04-22 09:25:01.808710 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-22 09:25:01.808772 | aio | Wednesday 22 April 2026 09:25:01 +0000 (0:00:00.192) 0:00:40.972 ******* 2026-04-22 09:25:02.079079 | aio | ok: [aio] => (item=aio) 2026-04-22 09:25:02.079211 | aio | 2026-04-22 09:25:02.079223 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-22 09:25:02.079380 | aio | Wednesday 22 April 2026 09:25:02 +0000 (0:00:00.270) 0:00:41.243 ******* 2026-04-22 09:25:02.122642 | aio | ok: [aio] 2026-04-22 09:25:02.123120 | aio | 2026-04-22 09:25:02.123179 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-22 09:25:02.123190 | aio | Wednesday 22 April 2026 09:25:02 +0000 (0:00:00.043) 0:00:41.286 ******* 2026-04-22 09:25:02.195032 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for aio 2026-04-22 09:25:02.195112 | aio | 2026-04-22 09:25:02.195269 | aio | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-04-22 09:25:02.195288 | aio | Wednesday 22 April 2026 09:25:02 +0000 (0:00:00.072) 0:00:41.358 ******* 2026-04-22 09:25:02.570566 | aio | changed: [aio] 2026-04-22 09:25:02.570649 | aio | 2026-04-22 09:25:02.570734 | aio | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-04-22 09:25:02.570835 | aio | Wednesday 22 April 2026 09:25:02 +0000 (0:00:00.375) 0:00:41.734 ******* 2026-04-22 09:25:03.481573 | aio | changed: [aio] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-04-22 09:25:03.481652 | aio | changed: [aio] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-04-22 09:25:03.482049 | aio | changed: [aio] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-04-22 09:25:03.482066 | aio | 2026-04-22 09:25:03.482072 | aio | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-04-22 09:25:03.482076 | aio | Wednesday 22 April 2026 09:25:03 +0000 (0:00:00.910) 0:00:42.645 ******* 2026-04-22 09:27:28.371185 | aio | ok: [aio] 2026-04-22 09:27:28.371267 | aio | 2026-04-22 09:27:28.371348 | aio | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-04-22 09:27:28.371449 | aio | Wednesday 22 April 2026 09:27:28 +0000 (0:02:24.889) 0:03:07.535 ******* 2026-04-22 09:27:28.640275 | aio | changed: [aio] 2026-04-22 09:27:28.640312 | aio | 2026-04-22 09:27:28.640317 | aio | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-04-22 09:27:28.640322 | aio | Wednesday 22 April 2026 09:27:28 +0000 (0:00:00.268) 0:03:07.804 ******* 2026-04-22 09:27:28.678473 | aio | ok: [aio] 2026-04-22 09:27:28.678521 | aio | 2026-04-22 09:27:28.678529 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:27:28.678537 | aio | Wednesday 22 April 2026 09:27:28 +0000 (0:00:00.037) 0:03:07.842 ******* 2026-04-22 09:27:28.752104 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:27:28.752140 | aio | 2026-04-22 09:27:28.752146 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:27:28.752150 | aio | Wednesday 22 April 2026 09:27:28 +0000 (0:00:00.074) 0:03:07.916 ******* 2026-04-22 09:27:34.733834 | aio | ok: [aio] 2026-04-22 09:27:34.733951 | aio | 2026-04-22 09:27:34.734275 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:27:34.734326 | aio | Wednesday 22 April 2026 09:27:34 +0000 (0:00:05.981) 0:03:13.897 ******* 2026-04-22 09:27:34.802611 | aio | ok: [aio] => (item=aio) 2026-04-22 09:27:34.803010 | aio | 2026-04-22 09:27:34.803093 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:27:34.803100 | aio | Wednesday 22 April 2026 09:27:34 +0000 (0:00:00.068) 0:03:13.966 ******* 2026-04-22 09:27:35.356333 | aio | ok: [aio] 2026-04-22 09:27:35.356386 | aio | 2026-04-22 09:27:35.356492 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:27:35.356604 | aio | Wednesday 22 April 2026 09:27:35 +0000 (0:00:00.554) 0:03:14.520 ******* 2026-04-22 09:27:42.830657 | aio | ok: [aio] 2026-04-22 09:27:42.830739 | aio | 2026-04-22 09:27:42.830929 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-22 09:27:42.830977 | aio | Wednesday 22 April 2026 09:27:42 +0000 (0:00:07.474) 0:03:21.994 ******* 2026-04-22 09:28:36.769132 | aio | changed: [aio] 2026-04-22 09:28:36.769204 | aio | 2026-04-22 09:28:36.769443 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-22 09:28:36.769498 | aio | Wednesday 22 April 2026 09:28:36 +0000 (0:00:53.938) 0:04:15.933 ******* 2026-04-22 09:28:51.273266 | aio | ok: [aio] 2026-04-22 09:28:51.273358 | aio | 2026-04-22 09:28:51.273386 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:28:51.273512 | aio | Wednesday 22 April 2026 09:28:51 +0000 (0:00:14.504) 0:04:30.437 ******* 2026-04-22 09:28:51.342484 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:28:51.342536 | aio | 2026-04-22 09:28:51.342542 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:28:51.342547 | aio | Wednesday 22 April 2026 09:28:51 +0000 (0:00:00.069) 0:04:30.506 ******* 2026-04-22 09:28:51.392924 | aio | skipping: [aio] 2026-04-22 09:28:51.392989 | aio | 2026-04-22 09:28:51.393001 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:28:51.393011 | aio | Wednesday 22 April 2026 09:28:51 +0000 (0:00:00.050) 0:04:30.556 ******* 2026-04-22 09:28:51.443808 | aio | skipping: [aio] => (item=aio) 2026-04-22 09:28:51.443871 | aio | skipping: [aio] 2026-04-22 09:28:51.444203 | aio | 2026-04-22 09:28:51.444262 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:28:51.444268 | aio | Wednesday 22 April 2026 09:28:51 +0000 (0:00:00.051) 0:04:30.607 ******* 2026-04-22 09:28:51.776675 | aio | ok: [aio] 2026-04-22 09:28:51.776776 | aio | 2026-04-22 09:28:51.776985 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:28:51.777042 | aio | Wednesday 22 April 2026 09:28:51 +0000 (0:00:00.332) 0:04:30.940 ******* 2026-04-22 09:28:58.365365 | aio | ok: [aio] 2026-04-22 09:28:58.365456 | aio | 2026-04-22 09:28:58.365666 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-22 09:28:58.365722 | aio | Wednesday 22 April 2026 09:28:58 +0000 (0:00:06.588) 0:04:37.529 ******* 2026-04-22 09:29:10.668557 | aio | changed: [aio] 2026-04-22 09:29:10.668643 | aio | 2026-04-22 09:29:10.668838 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-22 09:29:10.668918 | aio | Wednesday 22 April 2026 09:29:10 +0000 (0:00:12.303) 0:04:49.832 ******* 2026-04-22 09:29:17.159313 | aio | ok: [aio] 2026-04-22 09:29:17.159386 | aio | 2026-04-22 09:29:17.159732 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-22 09:29:17.159779 | aio | Wednesday 22 April 2026 09:29:17 +0000 (0:00:06.490) 0:04:56.323 ******* 2026-04-22 09:29:28.793979 | aio | changed: [aio] => (item={'name': 'diskprediction_local'}) 2026-04-22 09:29:28.794070 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-04-22 09:29:28.794166 | aio | changed: [aio] => (item={'name': 'prometheus'}) 2026-04-22 09:29:28.794288 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-04-22 09:29:28.794383 | aio | 2026-04-22 09:29:28.794480 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-22 09:29:28.794557 | aio | 2026-04-22 09:29:28.794651 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:29:28.794744 | aio | Wednesday 22 April 2026 09:29:28 +0000 (0:00:11.635) 0:05:07.958 ******* 2026-04-22 09:29:29.733939 | aio | ok: [aio] 2026-04-22 09:29:29.734508 | aio | 2026-04-22 09:29:29.734523 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:29:29.734530 | aio | Wednesday 22 April 2026 09:29:29 +0000 (0:00:00.939) 0:05:08.897 ******* 2026-04-22 09:29:29.996270 | aio | ok: [aio] 2026-04-22 09:29:29.996343 | aio | 2026-04-22 09:29:29.996500 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:29:29.996567 | aio | Wednesday 22 April 2026 09:29:29 +0000 (0:00:00.262) 0:05:09.160 ******* 2026-04-22 09:29:30.033919 | aio | skipping: [aio] 2026-04-22 09:29:30.033984 | aio | 2026-04-22 09:29:30.034110 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-22 09:29:30.034184 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.037) 0:05:09.198 ******* 2026-04-22 09:29:30.309797 | aio | ok: [aio] 2026-04-22 09:29:30.309866 | aio | 2026-04-22 09:29:30.309939 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:29:30.310048 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.275) 0:05:09.473 ******* 2026-04-22 09:29:30.364188 | aio | ok: [aio] => { 2026-04-22 09:29:30.364331 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-22 09:29:30.364542 | aio | } 2026-04-22 09:29:30.364711 | aio | 2026-04-22 09:29:30.364914 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:29:30.365090 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.054) 0:05:09.527 ******* 2026-04-22 09:29:30.732966 | aio | ok: [aio] 2026-04-22 09:29:30.733080 | aio | 2026-04-22 09:29:30.733105 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:29:30.733117 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.368) 0:05:09.896 ******* 2026-04-22 09:29:30.763625 | aio | skipping: [aio] 2026-04-22 09:29:30.764451 | aio | 2026-04-22 09:29:30.764516 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:29:30.764531 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.031) 0:05:09.928 ******* 2026-04-22 09:29:30.804191 | aio | skipping: [aio] 2026-04-22 09:29:30.804273 | aio | 2026-04-22 09:29:30.804572 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:29:30.804781 | aio | Wednesday 22 April 2026 09:29:30 +0000 (0:00:00.040) 0:05:09.968 ******* 2026-04-22 09:29:31.061465 | aio | ok: [aio] 2026-04-22 09:29:31.061535 | aio | 2026-04-22 09:29:31.061758 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:29:31.061803 | aio | Wednesday 22 April 2026 09:29:31 +0000 (0:00:00.257) 0:05:10.225 ******* 2026-04-22 09:29:32.080020 | aio | ok: [aio] 2026-04-22 09:29:32.080080 | aio | 2026-04-22 09:29:32.080185 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:29:32.080312 | aio | Wednesday 22 April 2026 09:29:32 +0000 (0:00:01.018) 0:05:11.244 ******* 2026-04-22 09:29:32.165192 | aio | ok: [aio] => { 2026-04-22 09:29:32.165372 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-22 09:29:32.165518 | aio | } 2026-04-22 09:29:32.165664 | aio | 2026-04-22 09:29:32.165844 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:29:32.166082 | aio | Wednesday 22 April 2026 09:29:32 +0000 (0:00:00.084) 0:05:11.328 ******* 2026-04-22 09:29:32.552295 | aio | ok: [aio] 2026-04-22 09:29:32.552370 | aio | 2026-04-22 09:29:32.552534 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:29:32.552706 | aio | Wednesday 22 April 2026 09:29:32 +0000 (0:00:00.387) 0:05:11.716 ******* 2026-04-22 09:29:34.631143 | aio | ok: [aio] 2026-04-22 09:29:34.631222 | aio | 2026-04-22 09:29:34.631557 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-22 09:29:34.631607 | aio | Wednesday 22 April 2026 09:29:34 +0000 (0:00:02.078) 0:05:13.795 ******* 2026-04-22 09:29:34.661029 | aio | skipping: [aio] 2026-04-22 09:29:34.661468 | aio | 2026-04-22 09:29:34.661501 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-22 09:29:34.661509 | aio | Wednesday 22 April 2026 09:29:34 +0000 (0:00:00.029) 0:05:13.824 ******* 2026-04-22 09:29:34.690608 | aio | skipping: [aio] 2026-04-22 09:29:34.690676 | aio | 2026-04-22 09:29:34.690778 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-22 09:29:34.690906 | aio | Wednesday 22 April 2026 09:29:34 +0000 (0:00:00.030) 0:05:13.854 ******* 2026-04-22 09:29:34.719835 | aio | skipping: [aio] 2026-04-22 09:29:34.719917 | aio | 2026-04-22 09:29:34.720164 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-22 09:29:34.720211 | aio | Wednesday 22 April 2026 09:29:34 +0000 (0:00:00.028) 0:05:13.883 ******* 2026-04-22 09:29:35.805012 | aio | ok: [aio] 2026-04-22 09:29:35.805129 | aio | 2026-04-22 09:29:35.805276 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-22 09:29:35.805424 | aio | Wednesday 22 April 2026 09:29:35 +0000 (0:00:01.085) 0:05:14.968 ******* 2026-04-22 09:29:36.337918 | aio | ok: [aio] 2026-04-22 09:29:36.338016 | aio | 2026-04-22 09:29:36.338182 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-22 09:29:36.338314 | aio | Wednesday 22 April 2026 09:29:36 +0000 (0:00:00.532) 0:05:15.501 ******* 2026-04-22 09:29:37.540532 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-04-22 09:29:37.540609 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-22 09:29:37.540827 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-22 09:29:37.540998 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-22 09:29:37.541136 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-22 09:29:37.541262 | aio | 2026-04-22 09:29:37.541397 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-22 09:29:37.541522 | aio | Wednesday 22 April 2026 09:29:37 +0000 (0:00:01.202) 0:05:16.704 ******* 2026-04-22 09:29:38.167762 | aio | ok: [aio] 2026-04-22 09:29:38.167978 | aio | 2026-04-22 09:29:38.168266 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-22 09:29:38.168530 | aio | Wednesday 22 April 2026 09:29:38 +0000 (0:00:00.618) 0:05:17.323 ******* 2026-04-22 09:29:38.168777 | aio | 2026-04-22 09:29:38.169078 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-22 09:29:38.169351 | aio | Wednesday 22 April 2026 09:29:38 +0000 (0:00:00.008) 0:05:17.331 ******* 2026-04-22 09:29:38.571970 | aio | ok: [aio] 2026-04-22 09:29:38.572031 | aio | 2026-04-22 09:29:38.572044 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:29:38.572053 | aio | Wednesday 22 April 2026 09:29:38 +0000 (0:00:00.403) 0:05:17.735 ******* 2026-04-22 09:29:38.830614 | aio | ok: [aio] 2026-04-22 09:29:38.830678 | aio | 2026-04-22 09:29:38.830898 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:29:38.830932 | aio | Wednesday 22 April 2026 09:29:38 +0000 (0:00:00.259) 0:05:17.994 ******* 2026-04-22 09:29:38.885368 | aio | ok: [aio] => { 2026-04-22 09:29:38.886245 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-22 09:29:38.886296 | aio | } 2026-04-22 09:29:38.886304 | aio | 2026-04-22 09:29:38.886311 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:29:38.886318 | aio | Wednesday 22 April 2026 09:29:38 +0000 (0:00:00.054) 0:05:18.048 ******* 2026-04-22 09:29:39.302272 | aio | ok: [aio] 2026-04-22 09:29:39.303279 | aio | 2026-04-22 09:29:39.303343 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:29:39.303356 | aio | Wednesday 22 April 2026 09:29:39 +0000 (0:00:00.415) 0:05:18.464 ******* 2026-04-22 09:29:42.503773 | aio | ok: [aio] 2026-04-22 09:29:42.503854 | aio | 2026-04-22 09:29:42.504140 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-22 09:29:42.504208 | aio | Wednesday 22 April 2026 09:29:42 +0000 (0:00:03.202) 0:05:21.667 ******* 2026-04-22 09:29:43.637466 | aio | ok: [aio] 2026-04-22 09:29:43.637871 | aio | 2026-04-22 09:29:43.638002 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-22 09:29:43.638010 | aio | Wednesday 22 April 2026 09:29:43 +0000 (0:00:01.133) 0:05:22.801 ******* 2026-04-22 09:29:43.895209 | aio | ok: [aio] 2026-04-22 09:29:43.895769 | aio | 2026-04-22 09:29:43.895822 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-22 09:29:43.895830 | aio | Wednesday 22 April 2026 09:29:43 +0000 (0:00:00.257) 0:05:23.058 ******* 2026-04-22 09:29:44.436744 | aio | ok: [aio] 2026-04-22 09:29:44.436806 | aio | 2026-04-22 09:29:44.436917 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-22 09:29:44.437055 | aio | Wednesday 22 April 2026 09:29:44 +0000 (0:00:00.541) 0:05:23.600 ******* 2026-04-22 09:29:45.201389 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-04-22 09:29:45.202237 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-22 09:29:45.202286 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-22 09:29:45.202294 | aio | 2026-04-22 09:29:45.202301 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-22 09:29:45.202308 | aio | Wednesday 22 April 2026 09:29:45 +0000 (0:00:00.764) 0:05:24.365 ******* 2026-04-22 09:29:45.723835 | aio | ok: [aio] 2026-04-22 09:29:45.723898 | aio | 2026-04-22 09:29:45.724000 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-22 09:29:45.724139 | aio | Wednesday 22 April 2026 09:29:45 +0000 (0:00:00.522) 0:05:24.887 ******* 2026-04-22 09:29:46.239172 | aio | ok: [aio] 2026-04-22 09:29:46.239213 | aio | 2026-04-22 09:29:46.239219 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-22 09:29:46.239223 | aio | Wednesday 22 April 2026 09:29:46 +0000 (0:00:00.507) 0:05:25.395 ******* 2026-04-22 09:29:46.239228 | aio | 2026-04-22 09:29:46.239237 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-22 09:29:46.239241 | aio | Wednesday 22 April 2026 09:29:46 +0000 (0:00:00.006) 0:05:25.402 ******* 2026-04-22 09:29:46.621373 | aio | ok: [aio] 2026-04-22 09:29:46.621446 | aio | 2026-04-22 09:29:46.621677 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-22 09:29:46.621727 | aio | Wednesday 22 April 2026 09:29:46 +0000 (0:00:00.382) 0:05:25.785 ******* 2026-04-22 09:29:46.671978 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-22 09:29:46.672029 | aio | 2026-04-22 09:29:46.672038 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] **** 2026-04-22 09:29:46.672044 | aio | Wednesday 22 April 2026 09:29:46 +0000 (0:00:00.049) 0:05:25.835 ******* 2026-04-22 09:29:46.696072 | aio | skipping: [aio] 2026-04-22 09:29:46.696123 | aio | 2026-04-22 09:29:46.696131 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-22 09:29:46.696138 | aio | Wednesday 22 April 2026 09:29:46 +0000 (0:00:00.024) 0:05:25.859 ******* 2026-04-22 09:29:47.790522 | aio | ok: [aio] 2026-04-22 09:29:47.790578 | aio | 2026-04-22 09:29:47.790586 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-22 09:29:47.790593 | aio | Wednesday 22 April 2026 09:29:47 +0000 (0:00:01.094) 0:05:26.953 ******* 2026-04-22 09:29:48.539319 | aio | ok: [aio] => (item=chronyd) 2026-04-22 09:29:48.539911 | aio | ok: [aio] => (item=sshd) 2026-04-22 09:29:48.539959 | aio | 2026-04-22 09:29:48.539967 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-22 09:29:48.539974 | aio | Wednesday 22 April 2026 09:29:48 +0000 (0:00:00.749) 0:05:27.703 ******* 2026-04-22 09:29:48.881786 | aio | ok: [aio] 2026-04-22 09:29:48.882239 | aio | 2026-04-22 09:29:48.882292 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-22 09:29:48.882300 | aio | Wednesday 22 April 2026 09:29:48 +0000 (0:00:00.342) 0:05:28.045 ******* 2026-04-22 09:29:49.134145 | aio | ok: [aio] 2026-04-22 09:29:49.134214 | aio | 2026-04-22 09:29:49.134426 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-22 09:29:49.134476 | aio | Wednesday 22 April 2026 09:29:49 +0000 (0:00:00.252) 0:05:28.298 ******* 2026-04-22 09:29:49.414001 | aio | ok: [aio] 2026-04-22 09:29:49.414071 | aio | 2026-04-22 09:29:49.414285 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-22 09:29:49.414329 | aio | Wednesday 22 April 2026 09:29:49 +0000 (0:00:00.279) 0:05:28.578 ******* 2026-04-22 09:29:49.648912 | aio | ok: [aio] 2026-04-22 09:29:49.649051 | aio | 2026-04-22 09:29:49.649066 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-22 09:29:49.649081 | aio | Wednesday 22 April 2026 09:29:49 +0000 (0:00:00.234) 0:05:28.812 ******* 2026-04-22 09:29:49.911121 | aio | ok: [aio] => (item=aio) 2026-04-22 09:29:49.911193 | aio | 2026-04-22 09:29:49.911503 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-22 09:29:49.911526 | aio | Wednesday 22 April 2026 09:29:49 +0000 (0:00:00.262) 0:05:29.074 ******* 2026-04-22 09:29:49.948964 | aio | ok: [aio] 2026-04-22 09:29:49.949285 | aio | 2026-04-22 09:29:49.949356 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:29:49.949363 | aio | Wednesday 22 April 2026 09:29:49 +0000 (0:00:00.037) 0:05:29.112 ******* 2026-04-22 09:29:50.014017 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:29:50.014106 | aio | 2026-04-22 09:29:50.014358 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:29:50.014417 | aio | Wednesday 22 April 2026 09:29:50 +0000 (0:00:00.065) 0:05:29.178 ******* 2026-04-22 09:29:50.052373 | aio | skipping: [aio] 2026-04-22 09:29:50.052445 | aio | 2026-04-22 09:29:50.052627 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:29:50.052797 | aio | Wednesday 22 April 2026 09:29:50 +0000 (0:00:00.038) 0:05:29.216 ******* 2026-04-22 09:29:50.083455 | aio | skipping: [aio] => (item=aio) 2026-04-22 09:29:50.083501 | aio | skipping: [aio] 2026-04-22 09:29:50.083507 | aio | 2026-04-22 09:29:50.083511 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:29:50.083516 | aio | Wednesday 22 April 2026 09:29:50 +0000 (0:00:00.030) 0:05:29.247 ******* 2026-04-22 09:29:50.402270 | aio | ok: [aio] 2026-04-22 09:29:50.402319 | aio | 2026-04-22 09:29:50.402327 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:29:50.402333 | aio | Wednesday 22 April 2026 09:29:50 +0000 (0:00:00.318) 0:05:29.565 ******* 2026-04-22 09:29:57.147845 | aio | ok: [aio] 2026-04-22 09:29:57.147929 | aio | 2026-04-22 09:29:57.148069 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-22 09:29:57.148251 | aio | Wednesday 22 April 2026 09:29:57 +0000 (0:00:06.746) 0:05:36.312 ******* 2026-04-22 09:30:02.504402 | aio | ok: [aio] 2026-04-22 09:30:02.504499 | aio | 2026-04-22 09:30:02.504514 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-22 09:30:02.504672 | aio | Wednesday 22 April 2026 09:30:02 +0000 (0:00:05.356) 0:05:41.668 ******* 2026-04-22 09:30:22.960648 | aio | ok: [aio] 2026-04-22 09:30:22.960818 | aio | 2026-04-22 09:30:22.960837 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-22 09:30:22.961097 | aio | Wednesday 22 April 2026 09:30:22 +0000 (0:00:20.455) 0:06:02.124 ******* 2026-04-22 09:33:02.915727 | aio | ok: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-04-22 09:33:02.916473 | aio | ok: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-04-22 09:33:02.916522 | aio | ok: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-04-22 09:33:02.916530 | aio | 2026-04-22 09:33:02.916544 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-22 09:33:02.916551 | aio | Wednesday 22 April 2026 09:33:02 +0000 (0:02:39.955) 0:08:42.079 ******* 2026-04-22 09:33:08.536925 | aio | ok: [aio] 2026-04-22 09:33:08.536992 | aio | 2026-04-22 09:33:08.537252 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-22 09:33:08.537318 | aio | Wednesday 22 April 2026 09:33:08 +0000 (0:00:05.621) 0:08:47.701 ******* 2026-04-22 09:33:19.627738 | aio | ok: [aio] 2026-04-22 09:33:19.627861 | aio | 2026-04-22 09:33:19.628234 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-22 09:33:19.628287 | aio | Wednesday 22 April 2026 09:33:19 +0000 (0:00:11.090) 0:08:58.791 ******* 2026-04-22 09:33:19.687733 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-04-22 09:33:19.687792 | aio | 2026-04-22 09:33:19.688028 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-22 09:33:19.688061 | aio | Wednesday 22 April 2026 09:33:19 +0000 (0:00:00.060) 0:08:58.851 ******* 2026-04-22 09:33:19.733458 | aio | ok: [aio] 2026-04-22 09:33:19.733908 | aio | 2026-04-22 09:33:19.733981 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-22 09:33:19.733989 | aio | Wednesday 22 April 2026 09:33:19 +0000 (0:00:00.045) 0:08:58.897 ******* 2026-04-22 09:33:32.199876 | aio | ok: [aio] 2026-04-22 09:33:32.200011 | aio | 2026-04-22 09:33:32.200209 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-22 09:33:32.200254 | aio | Wednesday 22 April 2026 09:33:32 +0000 (0:00:12.466) 0:09:11.363 ******* 2026-04-22 09:33:32.242219 | aio | ok: [aio] 2026-04-22 09:33:32.242699 | aio | 2026-04-22 09:33:32.242740 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-22 09:33:32.242760 | aio | Wednesday 22 April 2026 09:33:32 +0000 (0:00:00.042) 0:09:11.405 ******* 2026-04-22 09:33:32.285544 | aio | skipping: [aio] => (item=1) 2026-04-22 09:33:32.285667 | aio | skipping: [aio] => (item=1) 2026-04-22 09:33:32.286359 | aio | skipping: [aio] => (item=1) 2026-04-22 09:33:32.286419 | aio | skipping: [aio] 2026-04-22 09:33:32.286430 | aio | 2026-04-22 09:33:32.286439 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-22 09:33:32.286448 | aio | Wednesday 22 April 2026 09:33:32 +0000 (0:00:00.043) 0:09:11.449 ******* 2026-04-22 09:33:32.317541 | aio | skipping: [aio] 2026-04-22 09:33:32.317626 | aio | 2026-04-22 09:33:32.320167 | aio | PLAY RECAP ********************************************************************* 2026-04-22 09:33:32.320214 | aio | aio : ok=106 changed=29 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026-04-22 09:33:32.320221 | aio | 2026-04-22 09:33:32.320226 | aio | 2026-04-22 09:33:32.320230 | aio | TASKS RECAP ******************************************************************** 2026-04-22 09:33:32.320235 | aio | Wednesday 22 April 2026 09:33:32 +0000 (0:00:00.032) 0:09:11.481 ******* 2026-04-22 09:33:32.320239 | aio | =============================================================================== 2026-04-22 09:33:32.320243 | aio | vexxhost.ceph.osd : Install OSDs -------------------------------------- 159.96s 2026-04-22 09:33:32.320247 | aio | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 144.89s 2026-04-22 09:33:32.320251 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 53.94s 2026-04-22 09:33:32.320256 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 20.46s 2026-04-22 09:33:32.320260 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.50s 2026-04-22 09:33:32.320265 | aio | vexxhost.ceph.osd : Get `ceph orch ps` --------------------------------- 12.47s 2026-04-22 09:33:32.320269 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.30s 2026-04-22 09:33:32.320273 | aio | vexxhost.ceph.mgr : Configure manager modules -------------------------- 11.64s 2026-04-22 09:33:32.320278 | aio | vexxhost.ceph.osd : Mark require osd release --------------------------- 11.09s 2026-04-22 09:33:32.320282 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.47s 2026-04-22 09:33:32.320287 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.75s 2026-04-22 09:33:32.320291 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.59s 2026-04-22 09:33:32.320295 | aio | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.49s 2026-04-22 09:33:32.320300 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.98s 2026-04-22 09:33:32.320305 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.68s 2026-04-22 09:33:32.320310 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 5.62s 2026-04-22 09:33:32.320314 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.36s 2026-04-22 09:33:32.320319 | aio | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.90s 2026-04-22 09:33:32.320324 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.40s 2026-04-22 09:33:32.320329 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.20s 2026-04-22 09:33:32.499780 | aio | INFO [default > converge] Executed: Successful 2026-04-22 09:33:32.509979 | aio | INFO [default > idempotence] Executing 2026-04-22 09:33:33.661617 | aio | 2026-04-22 09:33:33.661725 | aio | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-04-22 09:33:33.661737 | aio | 2026-04-22 09:33:33.661747 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:33:33.661756 | aio | Wednesday 22 April 2026 09:33:33 +0000 (0:00:00.054) 0:00:00.054 ******* 2026-04-22 09:33:34.925593 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-04-22 09:33:34.934724 | aio | ok: [aio] 2026-04-22 09:33:34.934766 | aio | 2026-04-22 09:33:34.934781 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:33:34.934795 | aio | Wednesday 22 April 2026 09:33:34 +0000 (0:00:01.274) 0:00:01.328 ******* 2026-04-22 09:33:35.365729 | aio | ok: [aio] 2026-04-22 09:33:35.365793 | aio | 2026-04-22 09:33:35.365805 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:33:35.365815 | aio | Wednesday 22 April 2026 09:33:35 +0000 (0:00:00.430) 0:00:01.758 ******* 2026-04-22 09:33:35.403809 | aio | skipping: [aio] 2026-04-22 09:33:35.403888 | aio | 2026-04-22 09:33:35.403903 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-22 09:33:35.403917 | aio | Wednesday 22 April 2026 09:33:35 +0000 (0:00:00.038) 0:00:01.797 ******* 2026-04-22 09:33:35.840106 | aio | ok: [aio] 2026-04-22 09:33:35.840164 | aio | 2026-04-22 09:33:35.840172 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:33:35.840185 | aio | Wednesday 22 April 2026 09:33:35 +0000 (0:00:00.436) 0:00:02.233 ******* 2026-04-22 09:33:35.956879 | aio | ok: [aio] => { 2026-04-22 09:33:35.956944 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-22 09:33:35.956956 | aio | } 2026-04-22 09:33:35.956966 | aio | 2026-04-22 09:33:35.956982 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:33:35.957204 | aio | Wednesday 22 April 2026 09:33:35 +0000 (0:00:00.116) 0:00:02.349 ******* 2026-04-22 09:33:36.482045 | aio | ok: [aio] 2026-04-22 09:33:36.482122 | aio | 2026-04-22 09:33:36.482455 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:33:36.482498 | aio | Wednesday 22 April 2026 09:33:36 +0000 (0:00:00.526) 0:00:02.875 ******* 2026-04-22 09:33:36.529930 | aio | skipping: [aio] 2026-04-22 09:33:36.530007 | aio | 2026-04-22 09:33:36.530297 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:33:36.530354 | aio | Wednesday 22 April 2026 09:33:36 +0000 (0:00:00.047) 0:00:02.923 ******* 2026-04-22 09:33:36.578555 | aio | skipping: [aio] 2026-04-22 09:33:36.578638 | aio | 2026-04-22 09:33:36.578960 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:33:36.579015 | aio | Wednesday 22 April 2026 09:33:36 +0000 (0:00:00.048) 0:00:02.972 ******* 2026-04-22 09:33:36.858553 | aio | ok: [aio] 2026-04-22 09:33:36.858613 | aio | 2026-04-22 09:33:36.858724 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:33:36.858857 | aio | Wednesday 22 April 2026 09:33:36 +0000 (0:00:00.280) 0:00:03.252 ******* 2026-04-22 09:33:38.263188 | aio | ok: [aio] 2026-04-22 09:33:38.263240 | aio | 2026-04-22 09:33:38.263246 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:33:38.263250 | aio | Wednesday 22 April 2026 09:33:38 +0000 (0:00:01.404) 0:00:04.657 ******* 2026-04-22 09:33:38.343753 | aio | ok: [aio] => { 2026-04-22 09:33:38.343801 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-22 09:33:38.343809 | aio | } 2026-04-22 09:33:38.343815 | aio | 2026-04-22 09:33:38.343822 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:33:38.343828 | aio | Wednesday 22 April 2026 09:33:38 +0000 (0:00:00.079) 0:00:04.736 ******* 2026-04-22 09:33:38.770856 | aio | ok: [aio] 2026-04-22 09:33:38.770910 | aio | 2026-04-22 09:33:38.770918 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:33:38.770925 | aio | Wednesday 22 April 2026 09:33:38 +0000 (0:00:00.427) 0:00:05.164 ******* 2026-04-22 09:33:41.220270 | aio | ok: [aio] 2026-04-22 09:33:41.220349 | aio | 2026-04-22 09:33:41.220563 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-22 09:33:41.220607 | aio | Wednesday 22 April 2026 09:33:41 +0000 (0:00:02.450) 0:00:07.614 ******* 2026-04-22 09:33:41.253480 | aio | skipping: [aio] 2026-04-22 09:33:41.253540 | aio | 2026-04-22 09:33:41.253647 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-22 09:33:41.253744 | aio | Wednesday 22 April 2026 09:33:41 +0000 (0:00:00.032) 0:00:07.647 ******* 2026-04-22 09:33:41.284860 | aio | skipping: [aio] 2026-04-22 09:33:41.293653 | aio | 2026-04-22 09:33:41.293671 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-22 09:33:41.293679 | aio | Wednesday 22 April 2026 09:33:41 +0000 (0:00:00.030) 0:00:07.678 ******* 2026-04-22 09:33:41.312898 | aio | skipping: [aio] 2026-04-22 09:33:41.313115 | aio | 2026-04-22 09:33:41.313318 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-22 09:33:41.313509 | aio | Wednesday 22 April 2026 09:33:41 +0000 (0:00:00.028) 0:00:07.706 ******* 2026-04-22 09:33:42.362882 | aio | ok: [aio] 2026-04-22 09:33:42.363126 | aio | 2026-04-22 09:33:42.363416 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-22 09:33:42.363684 | aio | Wednesday 22 April 2026 09:33:42 +0000 (0:00:01.049) 0:00:08.756 ******* 2026-04-22 09:33:43.243458 | aio | ok: [aio] 2026-04-22 09:33:43.243570 | aio | 2026-04-22 09:33:43.243751 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-22 09:33:43.243970 | aio | Wednesday 22 April 2026 09:33:43 +0000 (0:00:00.880) 0:00:09.637 ******* 2026-04-22 09:33:44.422221 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-04-22 09:33:44.422497 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-22 09:33:44.422515 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-22 09:33:44.422532 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-22 09:33:44.423495 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-22 09:33:44.423544 | aio | 2026-04-22 09:33:44.423551 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-22 09:33:44.423555 | aio | Wednesday 22 April 2026 09:33:44 +0000 (0:00:01.177) 0:00:10.814 ******* 2026-04-22 09:33:45.063963 | aio | ok: [aio] 2026-04-22 09:33:45.064061 | aio | 2026-04-22 09:33:45.064094 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-22 09:33:45.064615 | aio | Wednesday 22 April 2026 09:33:45 +0000 (0:00:00.636) 0:00:11.451 ******* 2026-04-22 09:33:45.064658 | aio | 2026-04-22 09:33:45.064664 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-22 09:33:45.064669 | aio | Wednesday 22 April 2026 09:33:45 +0000 (0:00:00.007) 0:00:11.458 ******* 2026-04-22 09:33:45.721946 | aio | ok: [aio] 2026-04-22 09:33:45.722022 | aio | 2026-04-22 09:33:45.722226 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:33:45.722272 | aio | Wednesday 22 April 2026 09:33:45 +0000 (0:00:00.657) 0:00:12.116 ******* 2026-04-22 09:33:45.986659 | aio | ok: [aio] 2026-04-22 09:33:45.986722 | aio | 2026-04-22 09:33:45.986822 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:33:45.986936 | aio | Wednesday 22 April 2026 09:33:45 +0000 (0:00:00.264) 0:00:12.380 ******* 2026-04-22 09:33:46.054461 | aio | ok: [aio] => { 2026-04-22 09:33:46.054531 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-22 09:33:46.054897 | aio | } 2026-04-22 09:33:46.054940 | aio | 2026-04-22 09:33:46.054945 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:33:46.054950 | aio | Wednesday 22 April 2026 09:33:46 +0000 (0:00:00.067) 0:00:12.448 ******* 2026-04-22 09:33:46.493761 | aio | ok: [aio] 2026-04-22 09:33:46.493882 | aio | 2026-04-22 09:33:46.494141 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:33:46.494192 | aio | Wednesday 22 April 2026 09:33:46 +0000 (0:00:00.439) 0:00:12.887 ******* 2026-04-22 09:33:49.739147 | aio | ok: [aio] 2026-04-22 09:33:49.739189 | aio | 2026-04-22 09:33:49.739195 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-22 09:33:49.739200 | aio | Wednesday 22 April 2026 09:33:49 +0000 (0:00:03.245) 0:00:16.133 ******* 2026-04-22 09:33:50.846243 | aio | ok: [aio] 2026-04-22 09:33:50.846311 | aio | 2026-04-22 09:33:50.846408 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-22 09:33:50.846515 | aio | Wednesday 22 April 2026 09:33:50 +0000 (0:00:01.107) 0:00:17.240 ******* 2026-04-22 09:33:51.215818 | aio | ok: [aio] 2026-04-22 09:33:51.215883 | aio | 2026-04-22 09:33:51.215979 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-22 09:33:51.216088 | aio | Wednesday 22 April 2026 09:33:51 +0000 (0:00:00.369) 0:00:17.609 ******* 2026-04-22 09:33:51.764238 | aio | ok: [aio] 2026-04-22 09:33:51.764758 | aio | 2026-04-22 09:33:51.764812 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-22 09:33:51.764820 | aio | Wednesday 22 April 2026 09:33:51 +0000 (0:00:00.548) 0:00:18.158 ******* 2026-04-22 09:33:52.493677 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-04-22 09:33:52.493759 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-22 09:33:52.494381 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-22 09:33:52.494437 | aio | 2026-04-22 09:33:52.494445 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-22 09:33:52.494452 | aio | Wednesday 22 April 2026 09:33:52 +0000 (0:00:00.729) 0:00:18.887 ******* 2026-04-22 09:33:53.117775 | aio | ok: [aio] 2026-04-22 09:33:53.117821 | aio | 2026-04-22 09:33:53.117827 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-22 09:33:53.117832 | aio | Wednesday 22 April 2026 09:33:53 +0000 (0:00:00.624) 0:00:19.511 ******* 2026-04-22 09:33:53.667058 | aio | ok: [aio] 2026-04-22 09:33:53.667305 | aio | 2026-04-22 09:33:53.667318 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-22 09:33:53.667328 | aio | Wednesday 22 April 2026 09:33:53 +0000 (0:00:00.542) 0:00:20.054 ******* 2026-04-22 09:33:53.667629 | aio | 2026-04-22 09:33:53.667677 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-22 09:33:53.667683 | aio | Wednesday 22 April 2026 09:33:53 +0000 (0:00:00.007) 0:00:20.061 ******* 2026-04-22 09:33:54.073958 | aio | ok: [aio] 2026-04-22 09:33:54.074021 | aio | 2026-04-22 09:33:54.074108 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-22 09:33:54.074210 | aio | Wednesday 22 April 2026 09:33:54 +0000 (0:00:00.406) 0:00:20.468 ******* 2026-04-22 09:33:54.119820 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-22 09:33:54.119899 | aio | 2026-04-22 09:33:54.120105 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] **** 2026-04-22 09:33:54.120150 | aio | Wednesday 22 April 2026 09:33:54 +0000 (0:00:00.045) 0:00:20.513 ******* 2026-04-22 09:33:54.158154 | aio | skipping: [aio] 2026-04-22 09:33:54.158641 | aio | 2026-04-22 09:33:54.158694 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-22 09:33:54.158701 | aio | Wednesday 22 April 2026 09:33:54 +0000 (0:00:00.037) 0:00:20.551 ******* 2026-04-22 09:33:55.251437 | aio | ok: [aio] 2026-04-22 09:33:55.251511 | aio | 2026-04-22 09:33:55.251730 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-22 09:33:55.251774 | aio | Wednesday 22 April 2026 09:33:55 +0000 (0:00:01.093) 0:00:21.645 ******* 2026-04-22 09:33:56.013214 | aio | ok: [aio] => (item=chronyd) 2026-04-22 09:33:56.013706 | aio | ok: [aio] => (item=sshd) 2026-04-22 09:33:56.013756 | aio | 2026-04-22 09:33:56.013762 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-22 09:33:56.013767 | aio | Wednesday 22 April 2026 09:33:56 +0000 (0:00:00.761) 0:00:22.407 ******* 2026-04-22 09:33:56.366655 | aio | ok: [aio] 2026-04-22 09:33:56.366720 | aio | 2026-04-22 09:33:56.366739 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-22 09:33:56.366861 | aio | Wednesday 22 April 2026 09:33:56 +0000 (0:00:00.353) 0:00:22.760 ******* 2026-04-22 09:33:56.636509 | aio | ok: [aio] 2026-04-22 09:33:56.636598 | aio | 2026-04-22 09:33:56.636831 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-22 09:33:56.636882 | aio | Wednesday 22 April 2026 09:33:56 +0000 (0:00:00.269) 0:00:23.030 ******* 2026-04-22 09:33:57.097819 | aio | ok: [aio] 2026-04-22 09:33:57.097894 | aio | 2026-04-22 09:33:57.098132 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-22 09:33:57.098182 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.461) 0:00:23.491 ******* 2026-04-22 09:33:57.474198 | aio | ok: [aio] 2026-04-22 09:33:57.474322 | aio | 2026-04-22 09:33:57.474335 | aio | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-04-22 09:33:57.474445 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.376) 0:00:23.868 ******* 2026-04-22 09:33:57.628363 | aio | ok: [aio] 2026-04-22 09:33:57.628450 | aio | 2026-04-22 09:33:57.628509 | aio | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-04-22 09:33:57.628639 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.154) 0:00:24.022 ******* 2026-04-22 09:33:57.910641 | aio | ok: [aio] => (item=aio) 2026-04-22 09:33:57.910707 | aio | 2026-04-22 09:33:57.910974 | aio | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-04-22 09:33:57.911015 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.282) 0:00:24.304 ******* 2026-04-22 09:33:57.957897 | aio | ok: [aio] 2026-04-22 09:33:57.958249 | aio | 2026-04-22 09:33:57.958297 | aio | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-04-22 09:33:57.958303 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.046) 0:00:24.351 ******* 2026-04-22 09:33:57.997043 | aio | skipping: [aio] 2026-04-22 09:33:57.997103 | aio | 2026-04-22 09:33:57.997216 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:33:57.997349 | aio | Wednesday 22 April 2026 09:33:57 +0000 (0:00:00.039) 0:00:24.391 ******* 2026-04-22 09:33:58.077911 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:33:58.077978 | aio | 2026-04-22 09:33:58.078214 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:33:58.078255 | aio | Wednesday 22 April 2026 09:33:58 +0000 (0:00:00.080) 0:00:24.471 ******* 2026-04-22 09:34:04.601435 | aio | ok: [aio] 2026-04-22 09:34:04.601524 | aio | 2026-04-22 09:34:04.601863 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:34:04.601912 | aio | Wednesday 22 April 2026 09:34:04 +0000 (0:00:06.523) 0:00:30.995 ******* 2026-04-22 09:34:04.654013 | aio | ok: [aio] => (item=aio) 2026-04-22 09:34:04.654116 | aio | 2026-04-22 09:34:04.654435 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:34:04.654489 | aio | Wednesday 22 April 2026 09:34:04 +0000 (0:00:00.052) 0:00:31.047 ******* 2026-04-22 09:34:05.142811 | aio | ok: [aio] 2026-04-22 09:34:05.142880 | aio | 2026-04-22 09:34:05.143114 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:34:05.143165 | aio | Wednesday 22 April 2026 09:34:05 +0000 (0:00:00.489) 0:00:31.536 ******* 2026-04-22 09:34:11.716440 | aio | ok: [aio] 2026-04-22 09:34:11.716508 | aio | 2026-04-22 09:34:11.716610 | aio | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-04-22 09:34:11.716747 | aio | Wednesday 22 April 2026 09:34:11 +0000 (0:00:06.573) 0:00:38.110 ******* 2026-04-22 09:34:22.711667 | aio | ok: [aio] 2026-04-22 09:34:22.711745 | aio | 2026-04-22 09:34:22.712037 | aio | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-04-22 09:34:22.712096 | aio | Wednesday 22 April 2026 09:34:22 +0000 (0:00:10.994) 0:00:49.105 ******* 2026-04-22 09:34:40.378211 | aio | ok: [aio] 2026-04-22 09:34:40.378278 | aio | 2026-04-22 09:34:40.378499 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:34:40.378537 | aio | Wednesday 22 April 2026 09:34:40 +0000 (0:00:17.666) 0:01:06.772 ******* 2026-04-22 09:34:40.447922 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:34:40.448008 | aio | 2026-04-22 09:34:40.448260 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:34:40.448313 | aio | Wednesday 22 April 2026 09:34:40 +0000 (0:00:00.069) 0:01:06.841 ******* 2026-04-22 09:34:40.486904 | aio | skipping: [aio] 2026-04-22 09:34:40.486965 | aio | 2026-04-22 09:34:40.487219 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:34:40.487268 | aio | Wednesday 22 April 2026 09:34:40 +0000 (0:00:00.038) 0:01:06.880 ******* 2026-04-22 09:34:40.541683 | aio | skipping: [aio] => (item=aio) 2026-04-22 09:34:40.542249 | aio | skipping: [aio] 2026-04-22 09:34:40.542307 | aio | 2026-04-22 09:34:40.542315 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:34:40.542322 | aio | Wednesday 22 April 2026 09:34:40 +0000 (0:00:00.054) 0:01:06.935 ******* 2026-04-22 09:34:40.870160 | aio | ok: [aio] 2026-04-22 09:34:40.870937 | aio | 2026-04-22 09:34:40.871014 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:34:40.871030 | aio | Wednesday 22 April 2026 09:34:40 +0000 (0:00:00.327) 0:01:07.263 ******* 2026-04-22 09:34:47.571490 | aio | ok: [aio] 2026-04-22 09:34:47.571632 | aio | 2026-04-22 09:34:47.571645 | aio | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-04-22 09:34:47.571730 | aio | Wednesday 22 April 2026 09:34:47 +0000 (0:00:06.702) 0:01:13.965 ******* 2026-04-22 09:34:54.873756 | aio | ok: [aio] 2026-04-22 09:34:54.873844 | aio | 2026-04-22 09:34:54.874063 | aio | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-04-22 09:34:54.874112 | aio | Wednesday 22 April 2026 09:34:54 +0000 (0:00:07.302) 0:01:21.267 ******* 2026-04-22 09:35:09.190267 | aio | ok: [aio] 2026-04-22 09:35:09.190353 | aio | 2026-04-22 09:35:09.190677 | aio | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-04-22 09:35:09.190750 | aio | Wednesday 22 April 2026 09:35:09 +0000 (0:00:14.316) 0:01:35.584 ******* 2026-04-22 09:35:20.835897 | aio | ok: [aio] => (item={'name': 'diskprediction_local'}) 2026-04-22 09:35:20.835985 | aio | ok: [aio] => (item={'name': 'dashboard'}) 2026-04-22 09:35:20.836046 | aio | ok: [aio] => (item={'name': 'prometheus'}) 2026-04-22 09:35:20.836605 | aio | ok: [aio] => (item={'name': 'iostat'}) 2026-04-22 09:35:20.836657 | aio | 2026-04-22 09:35:20.836665 | aio | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-04-22 09:35:20.836672 | aio | 2026-04-22 09:35:20.836678 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:35:20.836684 | aio | Wednesday 22 April 2026 09:35:20 +0000 (0:00:11.645) 0:01:47.230 ******* 2026-04-22 09:35:21.757250 | aio | ok: [aio] 2026-04-22 09:35:21.757315 | aio | 2026-04-22 09:35:21.757511 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:35:21.757527 | aio | Wednesday 22 April 2026 09:35:21 +0000 (0:00:00.921) 0:01:48.151 ******* 2026-04-22 09:35:22.020861 | aio | ok: [aio] 2026-04-22 09:35:22.020924 | aio | 2026-04-22 09:35:22.021032 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:35:22.021137 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.263) 0:01:48.415 ******* 2026-04-22 09:35:22.057318 | aio | skipping: [aio] 2026-04-22 09:35:22.057392 | aio | 2026-04-22 09:35:22.057494 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-04-22 09:35:22.057593 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.036) 0:01:48.451 ******* 2026-04-22 09:35:22.315689 | aio | ok: [aio] 2026-04-22 09:35:22.315768 | aio | 2026-04-22 09:35:22.315975 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:35:22.316046 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.258) 0:01:48.709 ******* 2026-04-22 09:35:22.388851 | aio | ok: [aio] => { 2026-04-22 09:35:22.388928 | aio | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-04-22 09:35:22.389360 | aio | } 2026-04-22 09:35:22.389415 | aio | 2026-04-22 09:35:22.389421 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:35:22.389426 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.072) 0:01:48.782 ******* 2026-04-22 09:35:22.759810 | aio | ok: [aio] 2026-04-22 09:35:22.759889 | aio | 2026-04-22 09:35:22.760120 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:35:22.760169 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.370) 0:01:49.153 ******* 2026-04-22 09:35:22.799491 | aio | skipping: [aio] 2026-04-22 09:35:22.799571 | aio | 2026-04-22 09:35:22.799791 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:35:22.799839 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.040) 0:01:49.193 ******* 2026-04-22 09:35:22.841450 | aio | skipping: [aio] 2026-04-22 09:35:22.841530 | aio | 2026-04-22 09:35:22.841746 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:35:22.841784 | aio | Wednesday 22 April 2026 09:35:22 +0000 (0:00:00.042) 0:01:49.235 ******* 2026-04-22 09:35:23.125315 | aio | ok: [aio] 2026-04-22 09:35:23.125381 | aio | 2026-04-22 09:35:23.125584 | aio | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-04-22 09:35:23.125636 | aio | Wednesday 22 April 2026 09:35:23 +0000 (0:00:00.283) 0:01:49.519 ******* 2026-04-22 09:35:24.203693 | aio | ok: [aio] 2026-04-22 09:35:24.203759 | aio | 2026-04-22 09:35:24.203975 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:35:24.203990 | aio | Wednesday 22 April 2026 09:35:24 +0000 (0:00:01.078) 0:01:50.597 ******* 2026-04-22 09:35:24.282376 | aio | ok: [aio] => { 2026-04-22 09:35:24.282508 | aio | "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz" 2026-04-22 09:35:24.283052 | aio | } 2026-04-22 09:35:24.283071 | aio | 2026-04-22 09:35:24.283078 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:35:24.283084 | aio | Wednesday 22 April 2026 09:35:24 +0000 (0:00:00.078) 0:01:50.676 ******* 2026-04-22 09:35:24.676141 | aio | ok: [aio] 2026-04-22 09:35:24.676215 | aio | 2026-04-22 09:35:24.676526 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:35:24.676574 | aio | Wednesday 22 April 2026 09:35:24 +0000 (0:00:00.393) 0:01:51.070 ******* 2026-04-22 09:35:26.751250 | aio | ok: [aio] 2026-04-22 09:35:26.751329 | aio | 2026-04-22 09:35:26.751546 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-04-22 09:35:26.751602 | aio | Wednesday 22 April 2026 09:35:26 +0000 (0:00:02.075) 0:01:53.145 ******* 2026-04-22 09:35:26.776207 | aio | skipping: [aio] 2026-04-22 09:35:26.776277 | aio | 2026-04-22 09:35:26.776508 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-04-22 09:35:26.776715 | aio | Wednesday 22 April 2026 09:35:26 +0000 (0:00:00.024) 0:01:53.170 ******* 2026-04-22 09:35:26.800590 | aio | skipping: [aio] 2026-04-22 09:35:26.800712 | aio | 2026-04-22 09:35:26.800751 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-04-22 09:35:26.800861 | aio | Wednesday 22 April 2026 09:35:26 +0000 (0:00:00.024) 0:01:53.194 ******* 2026-04-22 09:35:26.831369 | aio | skipping: [aio] 2026-04-22 09:35:26.831502 | aio | 2026-04-22 09:35:26.831698 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-04-22 09:35:26.832601 | aio | Wednesday 22 April 2026 09:35:26 +0000 (0:00:00.030) 0:01:53.225 ******* 2026-04-22 09:35:27.807728 | aio | ok: [aio] 2026-04-22 09:35:27.807917 | aio | 2026-04-22 09:35:27.808154 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-04-22 09:35:27.808371 | aio | Wednesday 22 April 2026 09:35:27 +0000 (0:00:00.976) 0:01:54.201 ******* 2026-04-22 09:35:28.343599 | aio | ok: [aio] 2026-04-22 09:35:28.343825 | aio | 2026-04-22 09:35:28.344055 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-04-22 09:35:28.344295 | aio | Wednesday 22 April 2026 09:35:28 +0000 (0:00:00.535) 0:01:54.737 ******* 2026-04-22 09:35:29.551086 | aio | ok: [aio] => (item={'path': '/etc/containerd'}) 2026-04-22 09:35:29.551203 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-04-22 09:35:29.551349 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-04-22 09:35:29.551501 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-04-22 09:35:29.551644 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-04-22 09:35:29.551772 | aio | 2026-04-22 09:35:29.551910 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-04-22 09:35:29.552051 | aio | Wednesday 22 April 2026 09:35:29 +0000 (0:00:01.207) 0:01:55.944 ******* 2026-04-22 09:35:30.175702 | aio | ok: [aio] 2026-04-22 09:35:30.175777 | aio | 2026-04-22 09:35:30.175856 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-04-22 09:35:30.175958 | aio | Wednesday 22 April 2026 09:35:30 +0000 (0:00:00.616) 0:01:56.561 ******* 2026-04-22 09:35:30.176046 | aio | 2026-04-22 09:35:30.176145 | aio | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-04-22 09:35:30.176243 | aio | Wednesday 22 April 2026 09:35:30 +0000 (0:00:00.007) 0:01:56.569 ******* 2026-04-22 09:35:30.592635 | aio | ok: [aio] 2026-04-22 09:35:30.592698 | aio | 2026-04-22 09:35:30.592710 | aio | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-04-22 09:35:30.592720 | aio | Wednesday 22 April 2026 09:35:30 +0000 (0:00:00.415) 0:01:56.985 ******* 2026-04-22 09:35:30.840046 | aio | ok: [aio] 2026-04-22 09:35:30.840113 | aio | 2026-04-22 09:35:30.840208 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-04-22 09:35:30.840342 | aio | Wednesday 22 April 2026 09:35:30 +0000 (0:00:00.248) 0:01:57.234 ******* 2026-04-22 09:35:30.902918 | aio | ok: [aio] => { 2026-04-22 09:35:30.902994 | aio | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-04-22 09:35:30.903412 | aio | } 2026-04-22 09:35:30.903461 | aio | 2026-04-22 09:35:30.903467 | aio | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-04-22 09:35:30.903472 | aio | Wednesday 22 April 2026 09:35:30 +0000 (0:00:00.062) 0:01:57.296 ******* 2026-04-22 09:35:31.309295 | aio | ok: [aio] 2026-04-22 09:35:31.309667 | aio | 2026-04-22 09:35:31.309686 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-04-22 09:35:31.309697 | aio | Wednesday 22 April 2026 09:35:31 +0000 (0:00:00.406) 0:01:57.702 ******* 2026-04-22 09:35:34.535017 | aio | ok: [aio] 2026-04-22 09:35:34.535086 | aio | 2026-04-22 09:35:34.535287 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-04-22 09:35:34.535303 | aio | Wednesday 22 April 2026 09:35:34 +0000 (0:00:03.226) 0:02:00.929 ******* 2026-04-22 09:35:35.666344 | aio | ok: [aio] 2026-04-22 09:35:35.666460 | aio | 2026-04-22 09:35:35.666731 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-04-22 09:35:35.666789 | aio | Wednesday 22 April 2026 09:35:35 +0000 (0:00:01.131) 0:02:02.060 ******* 2026-04-22 09:35:35.953311 | aio | ok: [aio] 2026-04-22 09:35:35.953376 | aio | 2026-04-22 09:35:35.953625 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-04-22 09:35:35.953694 | aio | Wednesday 22 April 2026 09:35:35 +0000 (0:00:00.286) 0:02:02.347 ******* 2026-04-22 09:35:36.541636 | aio | ok: [aio] 2026-04-22 09:35:36.541723 | aio | 2026-04-22 09:35:36.542087 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-04-22 09:35:36.542136 | aio | Wednesday 22 April 2026 09:35:36 +0000 (0:00:00.588) 0:02:02.935 ******* 2026-04-22 09:35:37.310108 | aio | ok: [aio] => (item={'path': '/etc/docker'}) 2026-04-22 09:35:37.310220 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-04-22 09:35:37.310771 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-04-22 09:35:37.310793 | aio | 2026-04-22 09:35:37.310801 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-04-22 09:35:37.310808 | aio | Wednesday 22 April 2026 09:35:37 +0000 (0:00:00.768) 0:02:03.703 ******* 2026-04-22 09:35:37.897403 | aio | ok: [aio] 2026-04-22 09:35:37.897478 | aio | 2026-04-22 09:35:37.897799 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-04-22 09:35:37.898018 | aio | Wednesday 22 April 2026 09:35:37 +0000 (0:00:00.587) 0:02:04.291 ******* 2026-04-22 09:35:38.471051 | aio | ok: [aio] 2026-04-22 09:35:38.471122 | aio | 2026-04-22 09:35:38.471792 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-04-22 09:35:38.471847 | aio | Wednesday 22 April 2026 09:35:38 +0000 (0:00:00.566) 0:02:04.857 ******* 2026-04-22 09:35:38.471855 | aio | 2026-04-22 09:35:38.471861 | aio | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-04-22 09:35:38.471867 | aio | Wednesday 22 April 2026 09:35:38 +0000 (0:00:00.007) 0:02:04.864 ******* 2026-04-22 09:35:38.917994 | aio | ok: [aio] 2026-04-22 09:35:38.918071 | aio | 2026-04-22 09:35:38.918462 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-04-22 09:35:38.918548 | aio | Wednesday 22 April 2026 09:35:38 +0000 (0:00:00.446) 0:02:05.311 ******* 2026-04-22 09:35:38.963827 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml) 2026-04-22 09:35:38.963928 | aio | 2026-04-22 09:35:38.964317 | aio | TASK [vexxhost.ceph.cephadm : Ensure GNU coreutils is used on Ubuntu 26.04] **** 2026-04-22 09:35:38.964409 | aio | Wednesday 22 April 2026 09:35:38 +0000 (0:00:00.045) 0:02:05.357 ******* 2026-04-22 09:35:38.995546 | aio | skipping: [aio] 2026-04-22 09:35:38.995630 | aio | 2026-04-22 09:35:38.995692 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-04-22 09:35:38.995827 | aio | Wednesday 22 April 2026 09:35:38 +0000 (0:00:00.031) 0:02:05.389 ******* 2026-04-22 09:35:40.013038 | aio | ok: [aio] 2026-04-22 09:35:40.013486 | aio | 2026-04-22 09:35:40.013508 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-04-22 09:35:40.013516 | aio | Wednesday 22 April 2026 09:35:40 +0000 (0:00:01.017) 0:02:06.406 ******* 2026-04-22 09:35:40.766624 | aio | ok: [aio] => (item=chronyd) 2026-04-22 09:35:40.767206 | aio | ok: [aio] => (item=sshd) 2026-04-22 09:35:40.767258 | aio | 2026-04-22 09:35:40.767266 | aio | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-04-22 09:35:40.767273 | aio | Wednesday 22 April 2026 09:35:40 +0000 (0:00:00.753) 0:02:07.160 ******* 2026-04-22 09:35:41.105661 | aio | ok: [aio] 2026-04-22 09:35:41.105731 | aio | 2026-04-22 09:35:41.106075 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-04-22 09:35:41.106125 | aio | Wednesday 22 April 2026 09:35:41 +0000 (0:00:00.339) 0:02:07.499 ******* 2026-04-22 09:35:41.427813 | aio | ok: [aio] 2026-04-22 09:35:41.427887 | aio | 2026-04-22 09:35:41.428248 | aio | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-04-22 09:35:41.428301 | aio | Wednesday 22 April 2026 09:35:41 +0000 (0:00:00.322) 0:02:07.821 ******* 2026-04-22 09:35:41.715943 | aio | ok: [aio] 2026-04-22 09:35:41.716008 | aio | 2026-04-22 09:35:41.716352 | aio | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-04-22 09:35:41.716414 | aio | Wednesday 22 April 2026 09:35:41 +0000 (0:00:00.288) 0:02:08.109 ******* 2026-04-22 09:35:41.966756 | aio | ok: [aio] 2026-04-22 09:35:41.966820 | aio | 2026-04-22 09:35:41.966904 | aio | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-04-22 09:35:41.967042 | aio | Wednesday 22 April 2026 09:35:41 +0000 (0:00:00.251) 0:02:08.360 ******* 2026-04-22 09:35:42.268255 | aio | ok: [aio] => (item=aio) 2026-04-22 09:35:42.268842 | aio | 2026-04-22 09:35:42.268909 | aio | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-04-22 09:35:42.268959 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.301) 0:02:08.662 ******* 2026-04-22 09:35:42.315588 | aio | ok: [aio] 2026-04-22 09:35:42.315658 | aio | 2026-04-22 09:35:42.315718 | aio | TASK [Install Ceph host] ******************************************************* 2026-04-22 09:35:42.315849 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.047) 0:02:08.709 ******* 2026-04-22 09:35:42.378664 | aio | included: vexxhost.ceph.cephadm_host for aio 2026-04-22 09:35:42.378731 | aio | 2026-04-22 09:35:42.378949 | aio | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-04-22 09:35:42.378993 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.063) 0:02:08.772 ******* 2026-04-22 09:35:42.422630 | aio | skipping: [aio] 2026-04-22 09:35:42.423064 | aio | 2026-04-22 09:35:42.423115 | aio | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-04-22 09:35:42.423123 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.043) 0:02:08.816 ******* 2026-04-22 09:35:42.464886 | aio | skipping: [aio] => (item=aio) 2026-04-22 09:35:42.464941 | aio | skipping: [aio] 2026-04-22 09:35:42.465396 | aio | 2026-04-22 09:35:42.465437 | aio | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-04-22 09:35:42.465444 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.042) 0:02:08.858 ******* 2026-04-22 09:35:42.786469 | aio | ok: [aio] 2026-04-22 09:35:42.786542 | aio | 2026-04-22 09:35:42.786617 | aio | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-04-22 09:35:42.786749 | aio | Wednesday 22 April 2026 09:35:42 +0000 (0:00:00.321) 0:02:09.180 ******* 2026-04-22 09:35:56.531098 | aio | ok: [aio] 2026-04-22 09:35:56.531207 | aio | 2026-04-22 09:35:56.531232 | aio | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-04-22 09:35:56.531370 | aio | Wednesday 22 April 2026 09:35:56 +0000 (0:00:13.744) 0:02:22.925 ******* 2026-04-22 09:36:02.031192 | aio | ok: [aio] 2026-04-22 09:36:02.031276 | aio | 2026-04-22 09:36:02.031607 | aio | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-04-22 09:36:02.031667 | aio | Wednesday 22 April 2026 09:36:02 +0000 (0:00:05.499) 0:02:28.424 ******* 2026-04-22 09:36:19.640662 | aio | ok: [aio] 2026-04-22 09:36:19.640805 | aio | 2026-04-22 09:36:19.641120 | aio | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-04-22 09:36:19.641166 | aio | Wednesday 22 April 2026 09:36:19 +0000 (0:00:17.609) 0:02:46.034 ******* 2026-04-22 09:36:19.711392 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd0/data) 2026-04-22 09:36:19.711457 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd1/data) 2026-04-22 09:36:19.711555 | aio | skipping: [aio] => (item=/dev/ceph-aio-osd2/data) 2026-04-22 09:36:19.711931 | aio | skipping: [aio] 2026-04-22 09:36:19.711948 | aio | 2026-04-22 09:36:19.711960 | aio | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-04-22 09:36:19.711964 | aio | Wednesday 22 April 2026 09:36:19 +0000 (0:00:00.070) 0:02:46.105 ******* 2026-04-22 09:36:25.906899 | aio | ok: [aio] 2026-04-22 09:36:25.906954 | aio | 2026-04-22 09:36:25.907069 | aio | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-04-22 09:36:25.907207 | aio | Wednesday 22 April 2026 09:36:25 +0000 (0:00:06.195) 0:02:52.301 ******* 2026-04-22 09:36:32.536291 | aio | ok: [aio] 2026-04-22 09:36:32.536362 | aio | 2026-04-22 09:36:32.536569 | aio | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-04-22 09:36:32.536625 | aio | Wednesday 22 April 2026 09:36:32 +0000 (0:00:06.629) 0:02:58.930 ******* 2026-04-22 09:36:32.594660 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for aio 2026-04-22 09:36:32.594732 | aio | 2026-04-22 09:36:32.594983 | aio | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-04-22 09:36:32.595017 | aio | Wednesday 22 April 2026 09:36:32 +0000 (0:00:00.058) 0:02:58.988 ******* 2026-04-22 09:36:32.640059 | aio | ok: [aio] 2026-04-22 09:36:32.640188 | aio | 2026-04-22 09:36:32.640412 | aio | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-04-22 09:36:32.640499 | aio | Wednesday 22 April 2026 09:36:32 +0000 (0:00:00.045) 0:02:59.033 ******* 2026-04-22 09:36:38.737019 | aio | ok: [aio] 2026-04-22 09:36:38.737135 | aio | 2026-04-22 09:36:38.737422 | aio | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-04-22 09:36:38.737444 | aio | Wednesday 22 April 2026 09:36:38 +0000 (0:00:06.096) 0:03:05.130 ******* 2026-04-22 09:36:38.772266 | aio | ok: [aio] 2026-04-22 09:36:38.772337 | aio | 2026-04-22 09:36:38.772465 | aio | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-04-22 09:36:38.772610 | aio | Wednesday 22 April 2026 09:36:38 +0000 (0:00:00.035) 0:03:05.166 ******* 2026-04-22 09:36:38.811422 | aio | skipping: [aio] => (item=1) 2026-04-22 09:36:38.811497 | aio | skipping: [aio] => (item=1) 2026-04-22 09:36:38.811593 | aio | skipping: [aio] => (item=1) 2026-04-22 09:36:38.812000 | aio | skipping: [aio] 2026-04-22 09:36:38.812044 | aio | 2026-04-22 09:36:38.812049 | aio | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-04-22 09:36:38.812054 | aio | Wednesday 22 April 2026 09:36:38 +0000 (0:00:00.039) 0:03:05.205 ******* 2026-04-22 09:36:38.841184 | aio | skipping: [aio] 2026-04-22 09:36:38.841270 | aio | 2026-04-22 09:36:38.843341 | aio | PLAY RECAP ********************************************************************* 2026-04-22 09:36:38.843373 | aio | aio : ok=95 changed=0 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 2026-04-22 09:36:38.843384 | aio | 2026-04-22 09:36:38.843393 | aio | 2026-04-22 09:36:38.843402 | aio | TASKS RECAP ******************************************************************** 2026-04-22 09:36:38.843411 | aio | Wednesday 22 April 2026 09:36:38 +0000 (0:00:00.030) 0:03:05.235 ******* 2026-04-22 09:36:38.843420 | aio | =============================================================================== 2026-04-22 09:36:38.843429 | aio | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 17.67s 2026-04-22 09:36:38.843438 | aio | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 17.61s 2026-04-22 09:36:38.843446 | aio | vexxhost.ceph.mgr : Validate manager exist ----------------------------- 14.32s 2026-04-22 09:36:38.843455 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 13.74s 2026-04-22 09:36:38.843464 | aio | vexxhost.ceph.mgr : Configure manager modules -------------------------- 11.65s 2026-04-22 09:36:38.843472 | aio | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 10.99s 2026-04-22 09:36:38.843481 | aio | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 7.30s 2026-04-22 09:36:38.843490 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.70s 2026-04-22 09:36:38.843499 | aio | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.63s 2026-04-22 09:36:38.843507 | aio | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.57s 2026-04-22 09:36:38.843516 | aio | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.52s 2026-04-22 09:36:38.843525 | aio | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.20s 2026-04-22 09:36:38.843533 | aio | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.10s 2026-04-22 09:36:38.843542 | aio | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.50s 2026-04-22 09:36:38.843566 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.25s 2026-04-22 09:36:38.843575 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.23s 2026-04-22 09:36:38.843590 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.45s 2026-04-22 09:36:38.843599 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 2.08s 2026-04-22 09:36:38.843608 | aio | vexxhost.containers.package : Update state for tar ---------------------- 1.40s 2026-04-22 09:36:38.843619 | aio | Gathering Facts --------------------------------------------------------- 1.27s 2026-04-22 09:36:39.018510 | aio | INFO [default > idempotence] Executed: Successful 2026-04-22 09:36:39.028683 | aio | INFO [default > side_effect] Executing 2026-04-22 09:36:39.029263 | aio | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-22 09:36:39.036286 | aio | INFO [default > verify] Executing 2026-04-22 09:36:39.843968 | aio | 2026-04-22 09:36:39.844043 | aio | PLAY [Verify] ****************************************************************** 2026-04-22 09:36:39.844074 | aio | 2026-04-22 09:36:39.844087 | aio | TASK [Gathering Facts] ********************************************************* 2026-04-22 09:36:39.844096 | aio | Wednesday 22 April 2026 09:36:39 +0000 (0:00:00.009) 0:00:00.009 ******* 2026-04-22 09:36:41.055015 | aio | [WARNING]: Host 'aio' is using the discovered Python interpreter at '/usr/bin/python3.10', but future installation of another Python interpreter could cause a different interpreter to be discovered. See https://docs.ansible.com/ansible-core/2.20/reference_appendices/interpreter_discovery.html for more information. 2026-04-22 09:36:41.061972 | aio | ok: [aio] 2026-04-22 09:36:41.062008 | aio | 2026-04-22 09:36:41.062020 | aio | TASK [Get cluster health status] *********************************************** 2026-04-22 09:36:41.062042 | aio | Wednesday 22 April 2026 09:36:41 +0000 (0:00:01.218) 0:00:01.228 ******* 2026-04-22 09:36:51.663088 | aio | ok: [aio] 2026-04-22 09:36:51.663201 | aio | 2026-04-22 09:36:51.663219 | aio | TASK [Print cluster health status] ********************************************* 2026-04-22 09:36:51.663282 | aio | Wednesday 22 April 2026 09:36:51 +0000 (0:00:10.600) 0:00:11.828 ******* 2026-04-22 09:36:51.698097 | aio | ok: [aio] => { 2026-04-22 09:36:51.698323 | aio | "_ceph_health": { 2026-04-22 09:36:51.698649 | aio | "changed": false, 2026-04-22 09:36:51.698729 | aio | "cmd": [ 2026-04-22 09:36:51.698937 | aio | "cephadm", 2026-04-22 09:36:51.699192 | aio | "shell", 2026-04-22 09:36:51.699428 | aio | "--", 2026-04-22 09:36:51.699583 | aio | "ceph", 2026-04-22 09:36:51.699771 | aio | "health" 2026-04-22 09:36:51.700030 | aio | ], 2026-04-22 09:36:51.700205 | aio | "delta": "0:00:10.243112", 2026-04-22 09:36:51.700394 | aio | "end": "2026-04-22 09:36:51.619347", 2026-04-22 09:36:51.700584 | aio | "failed": false, 2026-04-22 09:36:51.700835 | aio | "msg": "", 2026-04-22 09:36:51.701054 | aio | "rc": 0, 2026-04-22 09:36:51.701252 | aio | "start": "2026-04-22 09:36:41.376235", 2026-04-22 09:36:51.701473 | aio | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", 2026-04-22 09:36:51.701666 | aio | "stderr_lines": [ 2026-04-22 09:36:51.701970 | aio | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-04-22 09:36:51.702232 | aio | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config" 2026-04-22 09:36:51.702403 | aio | ], 2026-04-22 09:36:51.702596 | aio | "stdout": "HEALTH_OK", 2026-04-22 09:36:51.702783 | aio | "stdout_lines": [ 2026-04-22 09:36:51.702969 | aio | "HEALTH_OK" 2026-04-22 09:36:51.703157 | aio | ] 2026-04-22 09:36:51.703329 | aio | } 2026-04-22 09:36:51.703523 | aio | } 2026-04-22 09:36:51.703694 | aio | 2026-04-22 09:36:51.703901 | aio | TASK [Assert that the cluster status is healthy] ******************************* 2026-04-22 09:36:51.704132 | aio | Wednesday 22 April 2026 09:36:51 +0000 (0:00:00.036) 0:00:11.864 ******* 2026-04-22 09:36:51.730453 | aio | ok: [aio] => { 2026-04-22 09:36:51.730658 | aio | "changed": false, 2026-04-22 09:36:51.730903 | aio | "msg": "All assertions passed" 2026-04-22 09:36:51.731112 | aio | } 2026-04-22 09:36:51.731302 | aio | 2026-04-22 09:36:51.731517 | aio | TASK [Create a test Ceph pool] ************************************************* 2026-04-22 09:36:51.731737 | aio | Wednesday 22 April 2026 09:36:51 +0000 (0:00:00.031) 0:00:11.896 ******* 2026-04-22 09:36:58.631702 | aio | changed: [aio] 2026-04-22 09:36:58.631892 | aio | 2026-04-22 09:36:58.632124 | aio | TASK [Create a test Ceph key] ************************************************** 2026-04-22 09:36:58.632351 | aio | Wednesday 22 April 2026 09:36:58 +0000 (0:00:06.900) 0:00:18.797 ******* 2026-04-22 09:37:01.194721 | aio | changed: [aio] 2026-04-22 09:37:01.194767 | aio | 2026-04-22 09:37:01.194775 | aio | TASK [Retrieve info for the test Ceph key] ************************************* 2026-04-22 09:37:01.194782 | aio | Wednesday 22 April 2026 09:37:01 +0000 (0:00:02.563) 0:00:21.360 ******* 2026-04-22 09:37:02.745030 | aio | ok: [aio] 2026-04-22 09:37:02.745334 | aio | 2026-04-22 09:37:02.745349 | aio | TASK [Assert that key_info returns the correct key] **************************** 2026-04-22 09:37:02.745418 | aio | Wednesday 22 April 2026 09:37:02 +0000 (0:00:01.550) 0:00:22.911 ******* 2026-04-22 09:37:02.788815 | aio | ok: [aio] => { 2026-04-22 09:37:02.788871 | aio | "changed": false, 2026-04-22 09:37:02.788879 | aio | "msg": "All assertions passed" 2026-04-22 09:37:02.788886 | aio | } 2026-04-22 09:37:02.788892 | aio | 2026-04-22 09:37:02.788898 | aio | PLAY RECAP ********************************************************************* 2026-04-22 09:37:02.788905 | aio | aio : ok=8 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-04-22 09:37:02.788911 | aio | 2026-04-22 09:37:02.788916 | aio | 2026-04-22 09:37:02.788921 | aio | TASKS RECAP ******************************************************************** 2026-04-22 09:37:02.788927 | aio | Wednesday 22 April 2026 09:37:02 +0000 (0:00:00.041) 0:00:22.952 ******* 2026-04-22 09:37:02.788932 | aio | =============================================================================== 2026-04-22 09:37:02.788938 | aio | Get cluster health status ---------------------------------------------- 10.60s 2026-04-22 09:37:02.790546 | aio | Create a test Ceph pool ------------------------------------------------- 6.90s 2026-04-22 09:37:02.790585 | aio | Create a test Ceph key -------------------------------------------------- 2.56s 2026-04-22 09:37:02.790597 | aio | Retrieve info for the test Ceph key ------------------------------------- 1.55s 2026-04-22 09:37:02.790617 | aio | Gathering Facts --------------------------------------------------------- 1.22s 2026-04-22 09:37:02.790627 | aio | Assert that key_info returns the correct key ---------------------------- 0.04s 2026-04-22 09:37:02.790637 | aio | Print cluster health status --------------------------------------------- 0.04s 2026-04-22 09:37:02.790646 | aio | Assert that the cluster status is healthy ------------------------------- 0.03s 2026-04-22 09:37:02.877158 | aio | INFO [default > verify] Executed: Successful 2026-04-22 09:37:02.887941 | aio | INFO [default > cleanup] Executing 2026-04-22 09:37:02.888305 | aio | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-04-22 09:37:02.925808 | aio | INFO [default > destroy] Executing 2026-04-22 09:37:02.926047 | aio | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-04-22 09:37:02.926239 | aio | INFO [default > destroy] Executed: Successful 2026-04-22 09:37:02.926792 | aio | WARNING Molecule executed 1 scenario (1 missing files) 2026-04-22 09:37:03.497011 | aio | ok: Runtime: 0:13:50.400819 2026-04-22 09:37:03.512610 | 2026-04-22 09:37:03.512660 | PLAY RECAP 2026-04-22 09:37:03.512705 | aio | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-04-22 09:37:03.512726 | 2026-04-22 09:37:03.652889 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-04-22 09:37:03.656919 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-22 09:37:04.259895 | 2026-04-22 09:37:04.260067 | PLAY [all] 2026-04-22 09:37:04.271715 | 2026-04-22 09:37:04.271804 | TASK [fetch-output : Set log path for multiple nodes] 2026-04-22 09:37:04.317021 | aio | skipping: Conditional result was False 2026-04-22 09:37:04.323443 | 2026-04-22 09:37:04.323522 | TASK [fetch-output : Set log path for single node] 2026-04-22 09:37:04.368392 | aio | ok 2026-04-22 09:37:04.374488 | 2026-04-22 09:37:04.374556 | LOOP [fetch-output : Ensure local output dirs] 2026-04-22 09:37:04.796518 | aio -> localhost | ok: "/var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/logs" 2026-04-22 09:37:05.023829 | aio -> localhost | changed: "/var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/artifacts" 2026-04-22 09:37:05.237678 | aio -> localhost | changed: "/var/lib/zuul/builds/0ac57b87e22c413aa4631d4597c559c4/work/docs" 2026-04-22 09:37:05.254105 | 2026-04-22 09:37:05.254292 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-04-22 09:37:05.919253 | aio | changed: .d..t...... ./ 2026-04-22 09:37:05.919630 | aio | changed: All items complete 2026-04-22 09:37:05.919666 | 2026-04-22 09:37:06.392117 | aio | changed: .d..t...... ./ 2026-04-22 09:37:06.847279 | aio | changed: .d..t...... ./ 2026-04-22 09:37:06.870872 | 2026-04-22 09:37:06.871088 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-04-22 09:37:07.320733 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.007334 2026-04-22 09:37:07.558595 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.008323 2026-04-22 09:37:07.576260 | 2026-04-22 09:37:07.576424 | PLAY [all] 2026-04-22 09:37:07.583238 | 2026-04-22 09:37:07.583311 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-04-22 09:37:08.013007 | aio | changed 2026-04-22 09:37:08.018805 | 2026-04-22 09:37:08.018855 | PLAY RECAP 2026-04-22 09:37:08.018903 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-04-22 09:37:08.018925 | 2026-04-22 09:37:08.169667 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-04-22 09:37:08.171210 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-04-22 09:37:08.752672 | 2026-04-22 09:37:08.752851 | PLAY [localhost] 2026-04-22 09:37:08.763564 | 2026-04-22 09:37:08.763641 | TASK [Generate Zuul manifest] 2026-04-22 09:37:08.783102 | localhost | ok 2026-04-22 09:37:08.799615 | 2026-04-22 09:37:08.799796 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-04-22 09:37:09.123419 | localhost | changed 2026-04-22 09:37:09.134502 | 2026-04-22 09:37:09.134583 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-04-22 09:37:09.166533 | localhost | ok 2026-04-22 09:37:09.176291 | 2026-04-22 09:37:09.176384 | TASK [Upload logs] 2026-04-22 09:37:09.198328 | localhost | ok 2026-04-22 09:37:09.265065 | 2026-04-22 09:37:09.265204 | TASK [Set zuul-log-path fact] 2026-04-22 09:37:09.287863 | localhost | ok 2026-04-22 09:37:09.302649 | 2026-04-22 09:37:09.302724 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-04-22 09:37:09.335795 | localhost | ok 2026-04-22 09:37:09.342651 | 2026-04-22 09:37:09.342717 | TASK [upload-logs : Create log directories] 2026-04-22 09:37:09.786660 | localhost | changed 2026-04-22 09:37:09.791602 | 2026-04-22 09:37:09.791677 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-04-22 09:37:10.207799 | localhost -> localhost | ok: Runtime: 0:00:00.004107 2026-04-22 09:37:10.213170 | 2026-04-22 09:37:10.213235 | TASK [upload-logs : Upload logs to log server] 2026-04-22 09:37:10.721731 | localhost | Output suppressed because no_log was given 2026-04-22 09:37:10.727255 | 2026-04-22 09:37:10.727370 | LOOP [upload-logs : Compress console log and json output] 2026-04-22 09:37:10.790364 | localhost | skipping: Conditional result was False 2026-04-22 09:37:10.797867 | localhost | skipping: Conditional result was False 2026-04-22 09:37:10.810924 | 2026-04-22 09:37:10.811076 | LOOP [upload-logs : Upload compressed console log and json output] 2026-04-22 09:37:10.862353 | localhost | skipping: Conditional result was False 2026-04-22 09:37:10.862766 | 2026-04-22 09:37:10.868573 | localhost | skipping: Conditional result was False 2026-04-22 09:37:10.884496 | 2026-04-22 09:37:10.884646 | LOOP [upload-logs : Upload console log and json output]